Your emotion or mine: labeling feelings alters emotional face perception-an ERP study on automatic and intentional affect labeling

Event-Related Potentials to Facial Expressions Are Related to Stimulus-Level Perceived Arousal and Valence

Facial expressions provide critical details about social partners' inner states. We investigated whether event-related potentials (ERP) related to the visual processing of facial expressions are modulated by participants' perceived arousal and valence at the stimulus level. ERPs were recorded while participants (N = 80) categorized the gender of faces expressing fear, anger, happiness, and no emotion. Participants then viewed each face again and rated them on arousal and valence using 1-9 Likert scales. For each participant, ratings of each unique face were linked back to corresponding ERP trials. ERPs were analyzed at all time points and electrodes using hierarchical mass univariate statistics. Three different ANOVA models were employed: the original emotion model, and models with valence or arousal ratings as trial-level regressors. Results from models with ratings highly overlapped with the original model, although they were more temporally restricted. The N170 component was the most impacted by arousal and valence ratings, with four out of six emotion contrasts revealing significant valence or arousal interactions. Emotion effects on the P2 component were mostly unrelated to ratings. On the EPN component, only two contrasts related to both arousal and valence ratings. Thus, ERP emotion effects are related to participants' perceived arousal and valence of the stimuli, although this association depends on the contrast analyzed. These findings, their limitations, and generalizability are discussed in reference to existing theories and literature.

Meanness and deficits in facial affect processing: Evidence from the N170

The triarchic construct of meanness, characterized by traits such as low empathy and lack of remorse, appears to be associated with deficits in affective processing. Specifically, meanness-related traits have been linked to deficits in brain reactivity and recognition of facial emotion. Recent meta-analytic work has provided preliminary evidence suggesting that N170 ERP amplitude reductions to fear faces might serve as a neurophysiological marker for meanness traits. However, most of these studies do not examine emotions other than fear, leaving open the question of whether meanness-related alterations in fear face processing might generalize to other facial expressions, nor the role of the other constructs of the triarchic model of psychopathy (i.e., boldness and disinhibition). The current study aimed to address these issues by measuring N170 amplitudes in a mixed-gender sample of 119 undergraduates while they passively viewed a broader range of emotional facial expressions (Anger, Fear, Happiness, and Neutral) alongside control (Scrambled) pictures. The specificity of this association to trait meanness compared to the other triarchic constructs was also assessed. Our results demonstrated meanness-related reductions in N170 amplitudes across all types of facial expressions, not just to fearful faces, even after controlling for the overlap with the other triarchic constructs. These findings highlight a general deficit in the structural encoding of facial features in high mean individuals, emphasizing the potential role of the N170 as a physiological tool for advancing our understanding of the mechanisms contributing to the aggressive, callous, and low-empathic characteristics of psychopathy.

Perceiving emotions in the eyes: The biasing role of a fearful mouth

The role of the eye region in interpersonal communication and emotional recognition is widely acknowledged. However, the influence of mouth expression on perceiving and recognizing genuine emotions in the eye region, especially with limited attentional resources, remains unclear. Thirty-four participants in this study completed a dual-target rapid serial visual presentation (RSVP) task while their event-related potential (ERP) data were simultaneously recorded. They were instructed to identify the type of houses and the emotional expression displayed in the eye region. The first target (T1) consisted of three upright houses, and the second target (T2) included fearful and neutral normal faces, mouth-scrambled faces, as well as composite faces (fearful eye + neutral mouth, neutral eye + fearful mouth). A robust mass univariate statistics approach was utilized to analyze the EEG data. Behaviorally, the presence of a fearful mouth facilitated recognition of the fearful eye region but hindered recognition of the neutral eye region compared to a neutral mouth. The ERP results showed that fearful expressions elicited larger N170, early posterior negativity (EPN), and P3 amplitudes relative to neutral expressions. The P1 amplitudes were increased, whereas the N170 and EPN amplitudes were reduced in response to normal and composite faces compared to mouth-scrambled faces. Collectively, these findings indicate that an unattended fearful mouth can capture covert attention and shape evaluation of eye expressions within a face, providing novel insights into the impact of visually salient mouth cues on cognitive processes involved in mind reading.

Maintenance of Bodily Expressions Modulates Functional Connectivity Between Prefrontal Cortex and Extrastriate Body Area During Working Memory Processing

Background/Objectives: As a form of visual input, bodily expressions can be maintained and manipulated in visual working memory (VWM) over a short period of time. While the prefrontal cortex (PFC) plays an indispensable role in top-down control, it remains largely unclear whether this region also modulates the VWM storage of bodily expressions during a delay period. Therefore, the two primary goals of this study were to examine whether the emotional bodies would elicit heightened brain activity among areas such as the PFC and extrastriate body area (EBA) and whether the emotional effects subsequently modulate the functional connectivity patterns for active maintenance during delay periods. Methods: During functional magnetic resonance imaging (fMRI) scanning, participants performed a delayed-response task in which they were instructed to view and maintain a body stimulus in working memory before emotion categorization (happiness, anger, and neutral). If processing happy and angry bodies consume increased cognitive demands, stronger PFC activation and its functional connectivity with perceptual areas would be observed. Results: Results based on univariate and multivariate analyses conducted on the data collected during stimulus presentation revealed an enhanced processing of the left PFC and left EBA. Importantly, subsequent functional connectivity analyses performed on delayed-period data using a psychophysiological interaction model indicated that functional connectivity between the PFC and EBA increases for happy and angry bodies compared to neutral bodies. Conclusions: The emotion-modulated coupling between the PFC and EBA during maintenance deepens our understanding of the functional organization underlying the VWM processing of bodily information.

Skin conductance response and habituation to emotional facial expressions and words

Skin conductance response (SCR) serves as a dependable marker of sympathetic activation used to measure emotional arousal. This study investigates the impact of presentation modality (face or word) on the degree of emotional discrimination elicited by SCR. Facial expressions or words associated with six basic emotions-anger, happiness, disgust, fear, sadness, and surprise-were studied among 102 participants. The amplitude of SCR was accurately predicted by subjective arousal ratings of these stimuli, but not by valence ratings. The habituation process to emotional and neutral stimuli across six successive presentations was characterized by an exponential decay function, capturing the rate at which SCR response diminishes in relation to the preceding trial of the same stimulus. Through the subtraction of the response to neutral stimuli from the emotion-evoked SCR, it was demonstrated that the initial presentation of each emotion elicits a substantial response, particularly attributable to the emotional content. Notably, the initial emotional response to faces expressing happiness, disgust, and sadness surpassed that of words conveying the same emotions. The results indicate that different emotional responses can be quantified using a simple electrical instrument.

SHAP value-based ERP analysis (SHERPA): Increasing the sensitivity of EEG signals with explainable AI methods

Conventionally, event-related potential (ERP) analysis relies on the researcher to identify the sensors and time points where an effect is expected. However, this approach is prone to bias and may limit the ability to detect unexpected effects or to investigate the full range of the electroencephalography (EEG) signal. Data-driven approaches circumvent this limitation, however, the multiple comparison problem and the statistical correction thereof affect both the sensitivity and specificity of the analysis. In this study, we present SHERPA - a novel approach based on explainable artificial intelligence (XAI) designed to provide the researcher with a straightforward and objective method to find relevant latency ranges and electrodes. SHERPA is comprised of a convolutional neural network (CNN) for classifying the conditions of the experiment and SHapley Additive exPlanations (SHAP) as a post hoc explainer to identify the important temporal and spatial features. A classical EEG face perception experiment is employed to validate the approach by comparing it to the established researcher- and data-driven approaches. Likewise, SHERPA identified an occipital cluster close to the temporal coordinates for the N170 effect expected. Most importantly, SHERPA allows quantifying the relevance of an ERP for a psychological mechanism by calculating an "importance score". Hence, SHERPA suggests the presence of a negative selection process at the early and later stages of processing. In conclusion, our new method not only offers an analysis approach suitable in situations with limited prior knowledge of the effect in question but also an increased sensitivity capable of distinguishing neural processes with high precision.

Your feelings are reasonable: Emotional validation promotes persistence among preschoolers

Persistence is a critical factor that significantly predicts life outcomes. Although individual differences in persistence emerge early in life, the knowledge of effective strategies for cultivating persistence in young children remains limited. Based on these two studies, we suggest that emotional validation, defined as the acceptance of emotions without judgment, is a beneficial technique for promoting persistence in the wake of frustration. Study 1 examined 150 parents of children aged 4-6 years and found that parents' tendency to validate their children's emotions was positively associated with children's trait persistence. We conducted a randomized experiment (N = 93, aged 4-6 years) in Study 2 to establish a causal relationship between emotional validation and persistence in preschoolers. Children who received emotional validation feedback (n = 31) exhibited higher levels of persistence than those who received emotional invalidation (n = 31) and no feedback (baseline, n = 31) on a frustrating task. The persistence between the emotional invalidation and no-feedback conditions was not statistically different. This finding highlights the vital role of emotional validation in promoting persistence in children at trait and state levels. In summary, this study offers a compelling strategy for empowering young children with resilience and determination when they encounter challenges. RESEARCH HIGHLIGHTS: Parental emotional validation predicts the trait-level persistence of children aged 4-6 years. Children who received emotion-validation feedback persisted longer on a task than those who received emotion-invalidation feedback or no feedback. Children in the emotion invalidation condition did not differ from those in the no-feedback condition in terms of persistence. Future studies are required to investigate the mechanisms underlying emotional validation in promoting task persistence in children.

Morality or competence is more important? The effect of evaluation dimensions on ERP responses to neutral faces depends on contextual valence and self-relevance

Recent studies have shown that the processing of neutral facial expressions could be modulated by the valence and self-relevance of preceding verbal evaluations. However, these studies have not distinguished the dimension (i.e., morality and competence) from verbal evaluations. In fact, there is a hot controversy about whether morality or competence receives more weight. Therefore, using the ERP technique, the current study aimed to address this issue by comparing the influence of morality and competence evaluations on behavioral and neural responses to neutral facial expressions when these evaluations varied with contextual valence and self-relevance. Our ERP results revealed that the early EPN amplitudes were larger for neutral faces after receiving evaluations about self relative to evaluations about senders. Moreover, the EPN was more negative after a competence evaluation relative to a morality evaluation when these evaluations were positive, while this effect was absent when these evaluations were negative. The late LPP was larger after a morality evaluation compared to a competence evaluation when these evaluations were negative and directed to self. However, no significant LPP effect between morality and competence evaluations was observed when these evaluations were positive. The present study extended previous studies by showing that early and late processing stages of faces are affected by the evaluation dimension in a top-down manner and further modulated by contextual valence and self-relevance.

Electrophysiological correlates of face and object perception: A comparative analysis of 2D laboratory and virtual reality conditions

Human face perception is a specialized visual process with inherent social significance. The neural mechanisms reflecting this intricate cognitive process have evolved in spatially complex and emotionally rich environments. Previous research using VR to transfer an established face perception paradigm to realistic conditions has shown that the functional properties of face-sensitive neural correlates typically observed in the laboratory are attenuated outside the original modality. The present study builds on these results by comparing the perception of persons and objects under conventional laboratory (PC) and realistic conditions in VR. Adhering to established paradigms, the PC- and VR modalities both featured images of persons and cars alongside standard control images. To investigate the individual stages of realistic face processing, response times, the typical face-sensitive N170 component, and relevant subsequent components (L1, L2; pre-, post-response) were analyzed within and between modalities. The between-modality comparison of response times and component latencies revealed generally faster processing under realistic conditions. However, the obtained N170 latency and amplitude differences showed reduced discriminative capacity under realistic conditions during this early stage. These findings suggest that the effects commonly observed in the lab are specific to monitor-based presentations. Analyses of later and response-locked components showed specific neural mechanisms for identification and evaluation are employed when perceiving the stimuli under realistic conditions, reflected in discernible amplitude differences in response to faces and objects beyond the basic perceptual features. Conversely, the results do not provide evidence for comparable stimulus-specific perceptual processing pathways when viewing pictures of the stimuli under conventional laboratory conditions.

Additive effects of emotional expression and stimulus size on the perception of genuine and artificial facial expressions: an ERP study

Seeing an angry individual in close physical proximity can not only result in a larger retinal representation of that individual and an enhanced resolution of emotional cues, but may also increase motivation for rapid visual processing and action preparation. The present study investigated the effects of stimulus size and emotional expression on the perception of happy, angry, non-expressive, and scrambled faces. We analyzed event-related potentials (ERPs) and behavioral responses of N = 40 participants who performed a naturalness classification task on real and artificially created facial expressions. While the emotion-related effects on accuracy for recognizing authentic expressions were modulated by stimulus size, ERPs showed only additive effects of stimulus size and emotional expression, with no significant interaction with size. This contrasts with previous research on emotional scenes and words. Effects of size were present in all included ERPs, whereas emotional expressions affected the N170, EPN, and LPC, irrespective of size. These results imply that the decoding of emotional valence in faces can occur even for small stimuli. Supra-additive effects in faces may necessitate larger size ranges or dynamic stimuli that increase arousal.

Implicit induction of expressive suppression in regulation of happy crowd emotions

Implicit emotion regulation provides an effective means of controlling emotions triggered by a single face without conscious awareness and effort. Crowd emotion has been proposed to be perceived as more intense than it actually is, but it is still unclear how to regulate it implicitly. In this study, participants viewed sets of faces of varying emotionality (e.g. happy to angry) and estimated the mean emotion of each set after being primed with an expressive suppression goal, a cognitive reappraisal goal, or a neutral goal. Faster discrimination for happy than angry crowds was observed. After induction of the expressive suppression goal instead of the cognitive reappraisal goal, augmented N170 and early posterior negativity (EPN) amplitudes, as well as attenuated late positive potential (LPP) amplitudes, were observed in response to happy crowds compared to the neutral goal. Differential processing of angry crowds was not observed after the induction of both regulatory goals compared to the neutral goal. Our findings thus reveal the happy-superiority effect and that implicit induction of expressive suppression improves happy crowd emotion recognition, promotes selective coding, and successfully downregulates the neural response to happy crowds.

To see or not to see: the parallel processing of self-relevance and facial expressions

The self, like the concept of central "gravity", facilitates the processing of information that is directly relevant to the self. This phenomenon is known as the self-prioritization effect. However, it remains unclear whether the self-prioritization effect extends to the processing of emotional facial expressions. To fill this gap, we used a self-association paradigm to investigate the impact of self-relevance on the recognition of emotional facial expressions while controlling for confounding factors such as familiarity and overlearning. Using a large and diverse sample, we replicated the effect of self-relevance on face processing but found no evidence for a modulation of self-relevance on facial emotion recognition. We propose two potential theoretical explanations to account for these findings and emphasize that further research with different experimental designs and a multitasks measurement approach is needed to understand this mechanism fully. Overall, our study contributes to the literature on the parallel cognitive processing of self-relevance and facial emotion recognition, with implications for both social and cognitive psychology.

Processing emotions from faces and words measured by event-related brain potentials

Affective aspects of a stimulus can be processed rapidly and before cognitive attribution, acting much earlier for verbal stimuli than previously considered. Aimed for specific mechanisms, event-related brain potentials (ERPs), expressed in facial expressions or word meaning and evoked by six basic emotions - anger, disgust, fear, happy, sad, and surprise - relative to emotionally neutral stimuli were analysed in a sample of 116 participants. Brain responses in the occipital and left temporal regions elicited by the sadness in facial expressions or words were indistinguishable from responses evoked by neutral faces or words. Confirming previous findings, facial fear elicited an early and strong posterior negativity. Instead of expected parietal positivity, both the happy faces and words produced significantly more negative responses compared to neutral. Surprise in facial expressions and words elicited a strong early response in the left temporal cortex, which could be a signature of appraisal. The results of this study are consistent with the view that both types of affective stimuli, facial emotions and word meaning, set off rapid processing and responses occur very early in the processing stage.

Current and lasting effects of affect labeling on late positive potential (LPP) amplitudes elicited by negative events

INTRODUCTION

Labeling the emotional aspect of self-unrelated stimuli (i.e., affect labeling) is a crucial strategy for implicit emotion regulation. However, it is uncertain whether affect labeling influences event-related potential (ERP) responses (e.g., the late positive potential, LPP) to negative stimuli in comparison with control conditions in which attention is shifted to the emotional content of the stimuli (e.g., affect matching). Additionally, it is unknown whether affect labeling has a lasting effect on the processing of negative stimuli.

METHODS

Participants were required to label the emotion (negative or neutral) of target pictures with two words, to match the emotion with alternative pictures or to merely view the target pictures. Target pictures were presented again immediately after the regulation task. After all the target pictures had been labeled, matched and viewed, the pictures were re-exposed for the third time.

RESULTS

The results showed that negative pictures elicited larger late LPP responses during the affect labeling task than during other tasks. However, the LPP responses were smaller for negative pictures in the affect labeling condition than in the other conditions when target pictures were re-exposed immediately after the task. When target pictures were re-presented again long after the regulation tasks, the LPP responses were smaller for negative stimuli with a history of affect labeling than viewing, whereas this effect did not differ between the affect labeling and matching conditions.

CONCLUSION

The current findings suggest that affect labeling has current effects and, to some extent, has lasting effects on negative stimulus processing.

Real-life relevant face perception is not captured by the N170 but reflected in later potentials: A comparison of 2D and virtual reality stimuli

The perception of faces is one of the most specialized visual processes in the human brain and has been investigated by means of the early event-related potential component N170. However, face perception has mostly been studied in the conventional laboratory, i.e., monitor setups, offering rather distal presentation of faces as planar 2D-images. Increasing spatial proximity through Virtual Reality (VR) allows to present 3D, real-life-sized persons at personal distance to participants, thus creating a feeling of social involvement and adding a self-relevant value to the presented faces. The present study compared the perception of persons under conventional laboratory conditions (PC) with realistic conditions in VR. Paralleling standard designs, pictures of unknown persons and standard control images were presented in a PC- and a VR-modality. To investigate how the mechanisms of face perception differ under realistic conditions from those under conventional laboratory conditions, the typical face-specific N170 and subsequent components were analyzed in both modalities. Consistent with previous laboratory research, the N170 lost discriminatory power when translated to realistic conditions, as it only discriminated faces and controls under laboratory conditions. Most interestingly, analysis of the later component [230–420 ms] revealed more differentiated face-specific processing in VR, as indicated by distinctive, stimulus-specific topographies. Complemented by source analysis, the results on later latencies show that face-specific neural mechanisms are applied only under realistic conditions (A video abstract is available in the Supplementary material and via YouTube: https://youtu.be/TF8wiPUrpSY).

Potentiated early neural responses to fearful faces are not driven by specific face parts

Prioritized processing of fearful compared to neutral faces is reflected in increased amplitudes of components of the event-related potential (ERP). It is unknown whether specific face parts drive these modulations. Here, we investigated the contributions of face parts on ERPs to task-irrelevant fearful and neutral faces using an ERP-dependent facial decoding technique and a large sample of participants (N = 83). Classical ERP analyses showed typical and robust increases of N170 and EPN amplitudes by fearful relative to neutral faces. Facial decoding further showed that the absolute amplitude of these components, as well as the P1, was driven by the low-frequency contrast of specific face parts. However, the difference between fearful and neutral faces was not driven by any specific face part, as supported by Bayesian statistics. Furthermore, there were no correlations between trait anxiety and main effects or interactions. These results suggest that increased N170 and EPN amplitudes to task-irrelevant fearful compared to neutral faces are not driven by specific facial regions but represent a holistic face processing effect.

Decoding of Processing Preferences from Language Paradigms by Means of EEG-ERP Methodology: Risk Markers of Cognitive Vulnerability for Depression and Protective Indicators of Well-Being? Cerebral Correlates and Mechanisms

Depression is a frequent mental affective disorder. Cognitive vulnerability models propose two major cognitive risk factors that favor the onset and severity of depressive symptoms. These include a pronounced self-focus, as well as a negative emotional processing bias. According to two-process models of cognitive vulnerability, these two risk factors are not independent from each other, but affect information processing already at an early perceptual processing level. Simultaneously, a processing advantage for self-related positive information including better memory for positive than negative information has been associated with mental health and well-being. This perspective paper introduces a research framework that discusses how EEG-ERP methodology can serve as a standardized tool for the decoding of negative and positive processing biases and their potential use as risk markers of cognitive vulnerability for depression, on the one hand, and as protective indicators of well-being, on the other hand. Previous results from EEG-ERP studies investigating the time-course of self-referential emotional processing are introduced, summarized, and discussed with respect to the specificity of depression-related processing and the importance of EEG-ERP-based experimental testing for well-being and the prevention and treatment of depressive disorders.

Negative news dominates fast and slow brain responses and social judgments even after source credibility evaluation

Remedies to counter the impact of misinformation are in high demand, but little is known about the neuro-cognitive consequences of untrustworthy information and how they can be mitigated. In this preregistered study, we investigated the effects of social-emotional headline contents on social judgments and brain responses and whether they can be modulated by explicit evaluations of the trustworthiness of the media source. Participants (N = 30) evaluated -and clearly discerned- the trustworthiness of news sources before they were exposed to person-related news headlines. Despite this intervention, social judgments and brain responses were dominated largely by emotional headline contents. Results suggest differential effects of source credibility might depend on headline valence. Electrophysiological indexes of fast emotional and arousal-related brain responses, as well as correlates of slow evaluative processing were enhanced for persons associated with positive headline contents from trusted sources, but not when positive headlines stemmed from distrusted sources. In contrast, negative headlines dominated fast and slow brain responses unaffected by explicit source credibility evaluations. These results provide novel insights into the brain mechanisms underlying the "success" of emotional news from untrustworthy sources, suggesting a pronounced susceptibility to negative information even from distrusted sources that is reduced for positive contents. The differential pattern of responses to misinformation in mind and brain sheds light on the cognitive mechanisms underlying the processing of misinformation and possible strategies to avoid their potentially detrimental effects.

Affect labelling increases the intensity of positive emotions

Although affect labelling has been widely reported to decrease negative emotions, it is less clear whether affect labelling also decreases positive emotions. In four studies, we explored how affect labelling (choosing the emotion that best corresponds with the image), content labelling (choosing the word that best corresponds with the content of the image), and simply viewing images influence positive and negative emotions. Labelling positive emotions led participants to report higher positive emotional intensity than did content labelling or just viewing the image (Study 1, N = 49), and this effect persisted regardless of whether they labelled emotions during or after the image (Study 2, N = 116), rated the intensity or positivity of their emotions (Study 3, N = 120), or rated their emotions after a delay or no delay (Study 4, N = 120). Surprisingly, we did not replicate the previous findings on affect labelling and negative emotion, instead showing that content labelling of negative emotional images tended to be the most consistent predictor of decreased negative emotions. Our results challenge the formulation that affect labelling leads to the automatic downregulation of emotions and instead suggest that it might be an effective mechanism in the upregulation of positive emotions.

Self-face and emotional faces-are they alike?

The image of one’s own face is a particularly distinctive feature of the self. The self-face differs from other faces not only in respect of its familiarity but also in respect of its subjective emotional significance and saliency. The current study aimed at elucidating similarities/dissimilarities between processing of one’s own face and emotional faces: happy faces (based on the self-positive bias) and fearful faces (because of their high perceptual saliency, a feature shared with self-face). Electroencephalogram data were collected in the group of 30 participants who performed a simple detection task. Event-related potential analyses indicated significantly increased P3 and late positive potential amplitudes to the self-face in comparison to all other faces: fearful, happy and neutral. Permutation tests confirmed the differences between the self-face and all three types of other faces for numerous electrode sites and in broad time windows. Representational similarity analysis, in turn, revealed distinct processing of the self-face and did not provide any evidence in favour of similarities between the self-face and emotional (either negative or positive) faces. These findings strongly suggest that the self-face processing do not resemble those of emotional faces, thus implying that prioritized self-referential processing is driven by the subjective relevance of one’s own face.

Emotional news affects social judgments independent of perceived media credibility

How does the credibility we attribute to media sources influence our opinions and judgments derived from news? Participants read headlines about the social behavior of depicted unfamiliar persons from websites of trusted or distrusted well-known German news media. As a consequence, persons paired with negative or positive headlines were judged more negative or positive than persons associated with neutral information independent of source credibility. Likewise, electrophysiological signatures of slow and controlled evaluative brain activity revealed a dominant influence of emotional headline contents regardless of credibility. Modulations of earlier brain responses associated with arousal and reflexive emotional processing show an effect of negative news and suggest that distrusted sources may even enhance the impact of negative headlines. These findings demonstrate that though we may have distinct perceptions about the credibility of media sources, information processing and social judgments rely on the emotional content of headlines, even when they stem from sources we distrust.

Socially induced negative affective knowledge modulates early face perception but not gaze cueing of attention

Prior affective and social knowledge about other individuals has been shown to modulate perception of their faces and gaze‐related attentional processes. However, it remains unclear whether emotionally charged knowledge acquired through interactive social learning also modulates face processing and attentional control. Thus, the aim of this study was to test whether affective knowledge induced through social interactions in a naturalistic exchange game can influence early stages of face processing and attentional shifts in a subsequent gaze‐cueing task. As indicated by self‐reported ratings, the game was successful in inducing valenced affective knowledge towards positive and negative players. In the subsequent task, in which the locations of future targets were cued by the gaze of the game players, we observed enhanced early neural activity (larger amplitude of the P1 component) in response to a photograph of the negative player. This indicates that negative affective knowledge about an individual indeed modulates very early stages of the processing of this individual's face. Our study contributes to the existing literature by providing further evidence for the saliency of interactive social exchange paradigms that are used to induce affective knowledge. Moreover, it extends the previous research by presenting a very early modulation of perception by socially learned affective knowledge. Importantly, it also offers increased ecological validity of the findings due to the use of naturalistic social exchange in the study design.

This research complements previous evidence that experimentally induced socio‐affective knowledge about other individuals, modulates processing of their faces, and shows that negative (but not positive) affect enhances very early face processing (the P1). Importantly, we provide an effective affect induction tool—an interactive social exchange game—which offers increased social ecological validity in experimental settings.

Comparison of Scalp ERP to Faces in Macaques and Humans

Face recognition is an essential activity of social living, common to many primate species. Underlying processes in the brain have been investigated using various techniques and compared between species. Functional imaging studies have shown face-selective cortical regions and their degree of correspondence across species. However, the temporal dynamics of face processing, particularly processing speed, are likely different between them. Across sensory modalities activation of primary sensory cortices in macaque monkeys occurs at about 3/5 the latency of corresponding activation in humans, though this human simian difference may diminish or disappear in higher cortical regions. We recorded scalp event-related potentials (ERPs) to presentation of faces in macaques and estimated the peak latency of ERP components. Comparisons of latencies between macaques (112 ms) and humans (192 ms) suggested that the 3:5 ratio could be preserved in higher cognitive regions of face processing between those species.

Reduced early fearful face processing during perceptual distraction in high trait anxious participants

Fearful facial expressions are prioritized across different stages of information processing as reflected by early, mid-latency, and late components of event-related brain potentials (ERP). Trait anxiety has been proposed to modulate these responses, but it is yet unclear how such modulations depend on feature-based attention. In this preregistered study (N = 80), we investigated the effects of trait anxiety on ERP differences between fearful and neutral faces across three different tasks. Participants had to discriminate either the orientation of lines overlaid onto the faces, the gender of the face, or the emotional expression, thus increasing attention to emotionally relevant facial features across the tasks. Fearful versus neutral faces elicited increased P1 and N170 amplitudes across tasks and potentiated amplitudes when attention was directed to faces (early posterior negativity [EPN]) or the expression (EPN and late positive potential). Higher trait anxiety was related to smaller EPN differences between fearful and neutral faces during the perceptual discrimination task. This early relationship suggests reduced instead of amplified processing of fearful faces for high trait anxious participants under perceptual distraction.

Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces

The processing of fearful facial expressions is prioritized by the human brain. This priority is maintained across various information processing stages as evident in early, intermediate and late components of event-related potentials (ERPs). However, emotional modulations are inconsistently reported for these different processing stages. In this pre-registered study, we investigated how feature-based attention differentially affects ERPs to fearful and neutral faces in 40 participants. The tasks required the participants to discriminate either the orientation of lines overlaid onto the face, the sex of the face or the face's emotional expression, increasing attention to emotion-related features. We found main effects of emotion for the N170, early posterior negativity (EPN) and late positive potential (LPP). While N170 emotional modulations were task-independent, interactions of emotion and task were observed for the EPN and LPP. While EPN emotion effects were found in the sex and emotion tasks, the LPP emotion effect was mainly driven by the emotion task. This study shows that early responses to fearful faces are task-independent (N170) and likely based on low-level and configural information while during later processing stages, attention to the face (EPN) or-more specifically-to the face's emotional expression (LPP) is crucial for reliable amplified processing of emotional faces.

Processing Facial Expressions That Conflict With Their Meanings to an Observer: An Event Related Potential Study

As social signals, identical facial expressions can be perceived differently, even oppositely, depending on the circumstances. Fast and accurate understanding of the information conveyed by others’ facial expressions is crucial for successful social interaction. In the current study, we used electroencephalographic analysis of several event-related potentials (ERPs) to investigate how the brain processes the facial expressions of others when they indicate different self-outcomes. In half of the trial blocks, a happy face indicated “Win” and an angry face indicated “Lose.” In the other half of the blocks, the rule was reversed. The results showed that the N170 could distinguish expression valence and the N300 could distinguish outcome valence. The valence of the expression (happy or angry) and the valence of the outcome (Win or Loss) interacted with each other in the early, automatic perceptual processing stage (N1) as well as in the later, cognitive evaluation stage (P300). Standardized Low-Resolution Electromagnetic Tomography (sLORETA) results indicated that the N1 modulation only occurred for happy faces, which may relate to automatic emotion regulation, while the interaction on P300 was significant only for angry faces, which might be associated with the regulation of negative emotions.

Anticipatory feelings: Neural correlates and linguistic markers

This review introduces anticipatory feelings (AF) as a new construct related to the process of anticipation and prediction of future events. AF, defined as the state of awareness of physiological and neurocognitive changes that occur within an oganism in the form of a process of adapting to future events, are an important component of anticipation and expectancy. They encompass bodily-related interoceptive and affective components and are influenced by intrapersonal and dispositional factors, such as optimism, hope, pessimism, or worry. In the present review, we consider evidence from animal and human research, including neuroimaging studies, to characterize the brain structures and brain networks involved in AF. The majority of studies reviewed revealed three brain regions involved in future oriented feelings: 1) the insula; 2) the ventromedial prefrontal cortex (vmPFC); and 3) the amygdala. Moreover, these brain regions were confirmed by a meta-analysis, using a platform for large-scale, automated synthesis of fMRI data. Finally, by adopting a neurolinguistic and a big data approach, we illustrate how AF are expressed in language.

Emotion and conflict adaptation: the role of phasic arousal and self-relevance

Conflict adaptation reflects the increase in cognitive control after previous conflict between task-relevant and task-irrelevant information. Tonic (sustained) arousal elicited by emotional words embedded in a conflict task has previously been shown to increase conflict adaptation. However, the role of phasic (transient) emotional arousal remains unclear. In Experiment 1 (N = 55), we therefore investigated the effect of phasic arousal using a colour flanker task with negative, positive, and neutral words as stimuli. We hypothesised that phasic arousal elicited in this context will increase conflict adaptation in the subsequent trial. Indeed, when the words were positive or negative as compared to neutral, we observed increased conflict adaptation. In Experiment 2 (N = 54), we examined the role of the self-relevance by presenting words with a self-related pronoun ("my") or sender-related pronoun ("his"/"her"). We expected that emotional words with high self-relevance would lead to stronger effects of emotional arousal on conflict adaptation. Confirming this hypothesis, results showed that emotional words within a self-related context again increased conflict adaptation, whereas this effect was not observed in the sender-related context. Taken together, these results are the first to show that phasic arousal elicited by emotional words increases conflict adaptation, in particular when these words have high self-relevance.

Modulation of face- and emotion-selective ERPs by the three most common types of face image manipulations

In neuroscientific studies, the naturalness of face presentation differs; a third of published studies makes use of close-up full coloured faces, a third uses close-up grey-scaled faces and another third employs cutout grey-scaled faces. Whether and how these methodological choices affect emotion-sensitive components of the event-related brain potentials (ERPs) is yet unclear. Therefore, this pre-registered study examined ERP modulations to close-up full-coloured and grey-scaled faces as well as cutout fearful and neutral facial expressions, while attention was directed to no-face oddballs. Results revealed no interaction of face naturalness and emotion for any ERP component, but showed, however, large main effects for both factors. Specifically, fearful faces and decreasing face naturalness elicited substantially enlarged N170 and early posterior negativity amplitudes and lower face naturalness also resulted in a larger P1.This pattern reversed for the LPP, showing linear increases in LPP amplitudes with increasing naturalness. We observed no interaction of emotion with face naturalness, which suggests that face naturalness and emotion are decoded in parallel at these early stages. Researchers interested in strong modulations of early components should make use of cutout grey-scaled faces, while those interested in a pronounced late positivity should use close-up coloured faces.

The effect of emotional and self-referential contexts on ERP responses towards surprised faces

The perception of surprised faces is demonstrably modulated by emotional context. However, the influence of self-relevance and its interaction with emotional context have not been explored. The present study investigated the effects of contextual valence and self-reference on the perception of surprised faces. Our results revealed that faces in a negative context elicited a larger N170 than those in a neutral context. The EPN was affected by the interaction between contextual valence and self-reference, with larger amplitudes for faces in self-related positive contexts and sender-related negative contexts. Additionally, LPP amplitudes were enhanced for faces in negative contexts relative to neutral and positive contexts, as well as for self-related contexts in comparison to sender-related contexts. Together, these findings help to elucidate the psychophysiological mechanisms underlying the effects of emotional and self-referential contexts on the perception of surprised faces, which are characterized by distinctive ERPs.

My Sadness - Our Happiness: Writing About Positive, Negative, and Neutral Autobiographical Life Events Reveals Linguistic Markers of Self-Positivity and Individual Well-Being

Objective: Narratives of autobiographical events contain rich information about an individual's private experience, his/her deepest thoughts, feelings, and emotions. The present study investigates linguistic markers of emotion expression and subjective well-being in adults during one session of positive, negative, and neutral expressive writing. Participants (N = 28 healthy participants, N = 7 adults with depressive symptoms), all native speakers of German were instructed to write expressively about personally relevant autobiographical life events of negative, positive, and neutral content. Methods: Quantitative text analysis was performed to determine the amount of emotional words, first person pronouns (singular vs. plural), and cognitive function words used in positive, negative, and neutral narratives and to examine the potency of these classes of words as linguistic markers of positivity/negativity, self-reference, and cognitive reappraisal. Additionally, the relationship between expressive writing and subjective well-being was explored by assessing changes in self-reported psychosomatic symptoms and in bodily and emotional awareness immediately after positive, negative, and neutral writing. Results: Regarding healthy participants, negative narratives contained significantly more negative emotional words than positive or neutral narratives. However, negative narratives also contained more positive emotional words compared to negative emotional words in positive narratives. Moreover, negative narratives contained more cognitive function words than positive narratives, suggesting that healthy participants tried to reappraise negative experiences while writing about negative personal life events. Positive narratives were characterized by an increased use of positive words and of pronouns of the first person plural ("we"), supporting a positivity bias and an extension of self-reference from first person singular to plural (we-reference) during positive expressive writing. Similarly, writing about neutral events was characterized by a positivity bias. Although based on descriptive analysis only, preferential use of positive words and cognitive function words in negative narratives was absent in participants reporting depressive symptoms. Positive, negative, and neutral expressive writing was accompanied by differential changes in bodily sensations, emotional awareness, and self-reported psychosomatic symptoms in all participants. Discussion: The findings are discussed with respect to previous research, a self-positivity bias, and a universal positivity bias in language use highlighting the relevance of these biases as markers of subjective well-being.

Whose emotion is it? Measuring self-other discrimination in romantic relationships during an emotional evaluation paradigm

In healthy subjects, emotional stimuli, positive stimuli in particular, are processed in a facilitated manner as are stimuli related to the self. These preferential processing biases also seem to hold true for self-related positive stimuli when compared to self-related negative or other-related positive stimuli suggesting a self-positivity bias in affective processing. The present study investigates the stability of this self-positivity bias and its possible extension to the emotional other in a sample of N = 147 participants including single participants (n = 61) and individuals currently in a romantic relationship (n = 86) reporting moderate to high levels of passionate love. Participants were presented a series of emotional and neutral words that could be related to the reader’s self (e.g., “my pleasure”, “my fear”), or to an insignificant third person, unknown to the reader (e.g., “his pleasure”, “his fear”) or devoid of any person reference (e.g., “the pleasure”, “the fear”). The task was to read the words silently and to evaluate the word pairs in reference to one’s own feelings elicited during reading. Results showed a self-positivity bias in emotional judgments in all participants, particularly in men. Moreover, participants in a romantic relationship (women and men) evaluated positive, other-related stimuli more often as valence-congruent with one’s own feelings than single participants. Taken together, these findings support the idea of a self-positivity bias in healthy subjects and an expansion of this bias while being in a romantic relationship.

Self-Reference Emerges Earlier than Emotion during an Implicit Self-Referential Emotion Processing Task: Event-Related Potential Evidence

Self-referential emotion refers to the process of evaluating emotional stimuli with respect to the self. Processes indicative of a self-positivity bias are reflected in electroencephalogram (EEG) signals at ~400 ms when the task does not require a discrimination of self from other. However, when distinguishing between self-referential and other-referential emotions is required, previous studies have shown inconsistent temporal dynamics of EEG signals in slightly different tasks. Based on the observation of early self–other discrimination, we hypothesized that self would be rapidly activated in the early stage to modulate emotional processing in the late stage during an implicit self-referential emotion. To test this hypothesis, we employed an implicit task in which participants were asked to judge the order of Chinese characters of trait adjectives preceded by a self (“I”) or other pronoun (“He” or “She”). This study aimed to explore the difference of social-related emotional evaluation from self-reference; the other pronoun was not defined to a specific person, rather it referred to the general concept. Sixteen healthy Chinese subjects participated in the experiment. Event-related potentials (ERPs) showed that there were self-other discrimination effects in the N1 (80–110 ms) and P1 (170–200 ms) components in the anterior brain. The emotional valence was discriminated in the later component of N2 (220–250 ms). The interaction between self-reference and emotional valence occurred during the late positive potential (LPP; 400–500 ms). Moreover, there was a positive correlation between response time (RT) and N1 in the self-reference condition based on the positive-negative contrast, suggesting a modulatory effect of the self-positivity bias. The results indicate that self-reference emerges earlier than emotion and then combines with emotional processing in an implicit task. The findings extend the view that the self plays a highly integrated and modulated role in self-referential emotion processing.

Bodily Reactions to Emotional Words Referring to Own versus Other People's Emotions

According to embodiment theories, language and emotion affect each other. In line with this, several previous studies investigated changes in bodily responses including facial expressions, heart rate or skin conductance during affective evaluation of emotional words and sentences. This study investigates the embodiment of emotional word processing from a social perspective by experimentally manipulating the emotional valence of a word and its personal reference. Stimuli consisted of pronoun-noun pairs, i.e., positive, negative, and neutral nouns paired with possessive pronouns of the first or the third person (“my,” “his”) or the non-referential negation term (“no”) as controls. Participants had to quickly evaluate the word pairs by key presses as either positive, negative, or neutral, depending on the subjective feelings they elicit. Hereafter, they elaborated the intensity of the feeling on a non-verbal scale from 1 (very unpleasant) to 9 (very pleasant). Facial expressions (M. Zygomaticus, M. Corrugator), heart rate, and, for exploratory purposes, skin conductance were recorded continuously during the spontaneous and elaborate evaluation tasks. Positive pronoun-noun phrases were responded to the quickest and judged more often as positive when they were self-related, i.e., related to the reader’s self (e.g., “my happiness,” “my joy”) than when related to the self of a virtual other (e.g., “his happiness,” “his joy”), suggesting a self-positivity bias in the emotional evaluation of word stimuli. Physiologically, evaluation of emotional, unlike neutral pronoun-noun pairs initially elicited an increase in mean heart rate irrespective of stimulus reference. Changes in facial muscle activity, M. Zygomaticus in particular, were most pronounced during spontaneous evaluation of positive other-related pronoun-noun phrases in line with theoretical assumptions that facial expressions are socially embedded even in situation where no real communication partner is present. Taken together, the present results confirm and extend the embodiment hypothesis of language by showing that bodily signals can be differently pronounced during emotional evaluation of self- and other-related emotional words.

Neural Processing of Threat Cues in Young Children With Attention-Deficit/Hyperactivity Symptoms

A growing literature indicates that attention deficit/hyperactivity disorder (ADHD) involves difficulty processing threat-related emotion faces. This deficit is especially important to understand in young children, as threat emotion processing is related to the development of social skills and related behavioral regulation. Therefore, the current study aimed to better understand the neural basis of this processing in young children with ADHD symptoms. Forty-seven children between 4 and 7 years of age were included in the analysis, 28 typical developing and 19 with clinically significant levels of ADHD hyperactive/impulsive symptoms. Participants completed a passive affective face-viewing task. Event-related potentials were assessed for each emotion, and parental report of child behavior and emotion regulation abilities was assessed. Children with ADHD symptoms showed altered N170 modulation in response to specific emotion faces, such that the N170 was less negative in response to fearful compared to neutral faces, whereas typically developing children showed the opposite pattern. Groups did not differ in reactivity to anger or non-threat-related emotion faces. The N170 difference in fearful compared to neutral faces correlated with reported behavior, such that less fear reactivity predicted fewer prosocial behaviors. Abnormalities in the underlying neural systems for fear processing in young children with ADHD symptoms may play an important role in social and behavioral deficits within this population.

The Effect of Self-Referential Expectation on Emotional Face Processing

The role of self-relevance has been somewhat neglected in static face processing paradigms but may be important in understanding how emotional faces impact on attention, cognition and affect. The aim of the current study was to investigate the effect of self-relevant primes on processing emotional composite faces. Sentence primes created an expectation of the emotion of the face before sad, happy, neutral or composite face photos were viewed. Eye movements were recorded and subsequent responses measured the cognitive and affective impact of the emotion expressed. Results indicated that primes did not guide attention, but impacted on judgments of valence intensity and self-esteem ratings. Negative self-relevant primes led to the most negative self-esteem ratings, although the effect of the prime was qualified by salient facial features. Self-relevant expectations about the emotion of a face and subsequent attention to a face that is congruent with these expectations strengthened the affective impact of viewing the face.

Emotional facial expressions evoke faster orienting responses, but weaker emotional responses at neural and behavioural levels compared to scenes: A simultaneous EEG and facial EMG study

In the current study, electroencephalography (EEG) was recorded simultaneously with facial electromyography (fEMG) to determine whether emotional faces and emotional scenes are processed differently at the neural level. In addition, it was investigated whether these differences can be observed at the behavioural level via spontaneous facial muscle activity. Emotional content of the stimuli did not affect early P1 activity. Emotional faces elicited enhanced amplitudes of the face-sensitive N170 component, while its counterpart, the scene-related N100, was not sensitive to emotional content of scenes. At 220-280ms, the early posterior negativity (EPN) was enhanced only slightly for fearful as compared to neutral or happy faces. However, its amplitudes were significantly enhanced during processing of scenes with positive content, particularly over the right hemisphere. Scenes of positive content also elicited enhanced spontaneous zygomatic activity from 500-750ms onwards, while happy faces elicited no such changes. Contrastingly, both fearful faces and negative scenes elicited enhanced spontaneous corrugator activity at 500-750ms after stimulus onset. However, relative to baseline EMG changes occurred earlier for faces (250ms) than for scenes (500ms) whereas for scenes activity changes were more pronounced over the whole viewing period. Taking into account all effects, the data suggests that emotional facial expressions evoke faster attentional orienting, but weaker affective neural activity and emotional behavioural responses compared to emotional scenes.

Arousal, valence, and the uncanny valley: psychophysiological and self-report findings

The main prediction of the Uncanny Valley Hypothesis (UVH) is that observation of humanlike characters that are difficult to distinguish from the human counterpart will evoke a state of negative affect. Well-established electrophysiological [late positive potential (LPP) and facial electromyography (EMG)] and self-report [Self-Assessment Manikin (SAM)] indices of valence and arousal, i.e., the primary orthogonal dimensions of affective experience, were used to test this prediction by examining affective experience in response to categorically ambiguous compared with unambiguous avatar and human faces (N = 30). LPP and EMG provided direct psychophysiological indices of affective state during passive observation and the SAM provided self-reported indices of affective state during explicit cognitive evaluation of static facial stimuli. The faces were drawn from well-controlled morph continua representing the UVH’ dimension of human likeness (DHL). The results provide no support for the notion that category ambiguity along the DHL is specifically associated with enhanced experience of negative affect. On the contrary, the LPP and SAM-based measures of arousal and valence indicated a general increase in negative affective state (i.e., enhanced arousal and negative valence) with greater morph distance from the human end of the DHL. A second sample (N = 30) produced the same finding, using an ad hoc self-rating scale of feelings of familiarity, i.e., an oft-used measure of affective experience along the UVH’ familiarity dimension. In conclusion, this multi-method approach using well-validated psychophysiological and self-rating indices of arousal and valence rejects – for passive observation and for explicit affective evaluation of static faces – the main prediction of the UVH.

Processing of facial and nonsocial information is differentially associated with severity of symptoms in patients with multiepisode schizophrenia

Patients with schizophrenia show impairments in social cognitive abilities, such as recognizing facial emotions. However, the relation to symptoms remains unclear. The goal of this study was to explore whether facial emotion recognition and face identity recognition are associated with severity of symptoms and to which extent associations with symptoms differ for processing of social versus nonsocial information. Facial emotion recognition, face recognition, and abstract pattern recognition were evaluated in 98 patients with multiepisode schizophrenia. Severity of symptoms was measured using a five-factor model of the Positive and Negative Syndrome Scale. Results show that facial emotion recognition and, to a lesser extent, face recognition were predominantly associated with severity of disorganization symptoms. In contrast, recognition of nonsocial patterns was associated with negative symptoms, excitement, and emotional distress. Reaction time rather than accuracy of social cognition explained variance in symptomatology. These results lead to the conclusion that facial emotion processing in schizophrenia appears to be associated with severity of symptoms, especially disorganization.

Negative evaluation bias for positive self-referential information in borderline personality disorder

Previous research has suggested that patients meeting criteria for borderline personality disorder (BPD) display altered self-related information processing. However, experimental studies on dysfunctional self-referential information processing in BPD are rare. In this study, BPD patients (N = 30) and healthy control participants (N = 30) judged positive, neutral, and negative words in terms of emotional valence. Referential processing was manipulated by a preceding self-referential pronoun, an other-referential pronoun, or no referential context. Subsequently, patients and participants completed a free recall and recognition task. BPD patients judged positive and neutral words as more negative than healthy control participants when the words had self-reference or no reference. In BPD patients, these biases were significantly correlated with self-reported attributional style, particularly for negative events, but unrelated to measures of depressive mood. However, BPD patients did not differ from healthy control participants in a subsequent free recall task and a recognition task. Our findings point to a negative evaluation bias for positive, self-referential information in BPD. This bias did not affect the storage of information in memory, but may be related to self-attributions of negative events in everyday life in BPD.