Effects of affective and emotional congruency on facial expression processing under different task demands

Electrophysiological correlates of semantic pain processing in the affective priming

Introduction

Pain plays a fundamental role in the well-being of the individual, and its semantic content may have specific properties compared to other negative domains (i.e., fear and anger) which allows the cognitive system to detect it with priority. Considering the influence of the affective context in which stimuli (targets) are evaluated, it is possible that their valence could be differentially processed if preceded by negative stimuli (primes) associated with pain than negative stimuli not associated with pain. Thus, the present study aims to investigate the electrophysiological correlates of the implicit processing of words with pain content by using an affective priming paradigm.

Methods

Event-related potentials (ERPs) were recorded while participants were presented with positive and negative word targets (not associated with pain) that were preceded by positive, negative (not associated with pain), and pain word primes. Participants were asked to judge the valence of the target word.

Results

Results showed faster reaction times (RTs) in congruent conditions, especially when the negative target was preceded by a pain prime rather than a positive one. ERPs analyses showed no effect of pain at an early-stage processing (N400), but a larger waveform when the pain prime preceded the positive prime on the LPP.

Discussion

These results reaffirm the importance that valence has in establishing the priority with which stimuli are encoded in the environment and highlight the role that pain has in the processing of stimuli, supporting the hypothesis according to which the valence and the semantics of a stimulus interact with each other generating a specific response for each type of emotion.

Effects of emotional congruency and task complexity on decision-making

The heuristic approach to decision-making holds that the selection process becomes more efficient when part of the information available is ignored. One element involved in selecting information is emotional valence. If emotional congruency is related to simplified decision-making strategies, then the interaction of this factor with task complexity should exist. The present study explored how factors of this nature influence decision-making efficiency. We hypothesized that emotional congruency would have a positive effect on task execution and that the magnitude of that effect would increase with greater task complexity because in that condition the amount of information to be processed is greater, meaning that a heuristic approach to the problem would be more efficient. We design a decision in browser decision-making task in which participants had to select emotional images to gain points. Depending on the correlation between emotional valence and in-task image value, we defined three emotional congruency conditions: direct, null, and inverse. Our results show that distinct types of emotional congruency have differential effects on behavior. While direct congruency-enhanced overall decision-making performance, inverse congruency interacted with task complexity to modify the pace at which task feedback affected behavior.

A Scoping Review of the Literature On Prosodic Elements Related to Emotional Speech in Human-Robot Interaction

Background

Sentiment expression and detection are crucial for effective and empathetic human-robot interaction. Previous work in this field often focuses on non-verbal emotion expression, such as facial expressions and gestures. Less is known about which specific prosodic speech elements are required in human-robot interaction. Our research question was: what prosodic elements are related to emotional speech in human-computer/robot interaction?

Methods

The scoping review was conducted in alignment with the Arksey and O’Malley methods. Literature was identified from the SCOPUS, IEEE Xplore, ACM Digital Library and PsycINFO databases in May 2021. After screening and de-duplication, data were extracted into an Excel coding sheet and summarised.

Results

Thirteen papers, published from 2012 to 2020 were included in the review. The most commonly used prosodic elements were tone/pitch (n = 8), loudness/volume (n = 6) speech speed (n = 4) and pauses (n = 3). Non-linguistic vocalisations (n = 1) were less frequently used. The prosodic elements were generally effective in helping to convey or detect emotion, but were less effective for negative sentiment (e.g., anger, fear, frustration, sadness and disgust).

Discussion

Future research should explore the effectiveness of commonly used prosodic elements (tone, loudness, speed and pauses) in emotional speech, using larger sample sizes and real-life interaction scenarios. The success of prosody in conveying negative sentiment to humans may be improved with additional non-verbal cues (e.g., coloured light or motion). More research is needed to determine how these may be combined with prosody and which combination is most effective in human-robot affective interaction.

Diminished ability to integrate target stimuli with context during emotional recognition in individuals with broad autism phenotype

Individuals with broad autism phenotype (BAP) have a tendency not to integrate emotional stimuli with the surrounding context. They have also shown different patterns and abilities in processing positive and negative emotions. This study aimed to examine whether the effect of context on target stimuli could vary depending on the type of target emotion in individuals with BAP. Based on the Broad Autism Phenotype Questionnaire (BAPQ) and Autism-Spectrum Quotient (AQ), 36 individuals with BAP and 33 healthy controls were selected. All the participants performed an overlap-emotional task consisting of six conditions: 2 (congruence: congruent and incongruent) × 3 (emotion: fearful, sad, and happy). Reaction time and accuracy were measured as dependent variables. The results revealed that the individuals with BAP showed no difference in reaction time between the condition of congruence and incongruence, but that the control group was faster to categorize facial expression on the condition of congruence than that of incongruence regardless of the type of target emotion. There were no differences between the two groups in any of the conditions with regard to accuracy. These findings indicate that individuals with BAP tend not to integrate target emotions with contextual information, a feature that could worsen the speed of emotional recognition in individuals with BAP. This study confirmed that the individuals with BAP have different cognition patterns in emotional recognition than the control group.

High Emotional Similarity Will Enhance the Face Memory and Face-Context Associative Memory

Previous research has explored how emotional valence (positive or negative) affected face-context associative memory, while little is known about how arousing stimuli that share the same valence but differ in emotionality are bound together and retained in memory. In this study, we manipulated the emotional similarity between the target face and the face associated with the context emotion (i.e., congruent, high similarity, and low similarity), and examined the effect of emotional similarity of negative emotion (i.e., disgust, anger, and fear) on face-context associative memory. Our results showed that the greater the emotional similarity between the faces, the better the face memory and face-context associative memory were. These findings suggest that the processing of facial expression and its associated context may benefit from taking into account the emotional similarity between the faces.

Are facial emotion recognition tasks adequate for assessing social cognition in older people? A review of the literature

OBJECTIVE

Facial emotion recognition (FER) is a component of social cognition and important to interpersonal relations. Therefore, tasks have been developed to assess this skill in different population. Regarding older people, even healthy individuals have a poorer performance compared to rate of correct answers commonly used to assess such tasks. Perform a systematic review to analyze studies addressing the performance of healthy older adults on FER tasks compared to the 70% correct response rate commonly used for the creation of stimulus banks.

MATERIAL AND METHODS

Searches were conducted up to May 2019 in the Pubmed, PsycInfo, Web of Science, and Scopus databases using the keywords ("faces" OR "facial") AND ("recognition" OR "expression" OR "emotional") AND ("elderly" OR "older adults").

RESULTS

Twenty-seven articles were included in the present review. In 16 studies (59.2%), older people had correct response rates on FER lower than 70% on at least one of the emotions evaluated. Among the studies that evaluated each emotion specifically, 62.5% found correct response rates lower than 70% for the emotion fear, 50% for surprise, 50% for sadness, 37.5% for anger, 21.4% for disgust, and 5.9% for happiness. Moreover, the studies that evaluated the level of intensity of the emotions demonstrated a lower rate of correct responses when the intensity of the facial expression was low.

CONCLUSION

That studies employ methods and facial stimuli that may not be adequate for measuring this skill in older people. Thus, it is important to create adequate tasks for assessing the skill in this population.

In context: emotional intent and temporal immediacy of contextual descriptions modulate affective ERP components to facial expressions

In this study, we explored how contextual information about threat dynamics affected the electrophysiological correlates of face perception. Forty-six healthy native Swedish speakers read verbal descriptions signaling an immediate vs delayed intent to escalate or deescalate an interpersonal conflict. Each verbal description was followed by a face with an angry or neutral expression, for which participants rated valence and arousal. Affective ratings confirmed that the emotional intent expressed in the descriptions modulated emotional reactivity to the facial stimuli in the expected direction. The electrophysiological data showed that compared to neutral faces, angry faces resulted in enhanced early and late event-related potentials (VPP, P300 and LPP). Additionally, emotional intent and temporal immediacy modulated the VPP and P300 similarly across angry and neutral faces, suggesting that they influence early face perception independently of facial affect. By contrast, the LPP amplitude to faces revealed an interaction between facial expression and emotional intent. Deescalating descriptions eliminated the LPP differences between angry and neutral faces. Together, our results suggest that information about a person’s intentions modulates the processing of facial expressions.

Affective states influence emotion perception: evidence for emotional egocentricity

Research in social cognition has shown that our own emotional experiences are an important source of information to understand what other people are feeling. The current study investigated whether individuals project their own affective states when reading other's emotional expressions. We used brief autobiographical recall and audiovisual stimuli to induce happy, neutral and sad transient states. After each emotion induction, participants made emotion judgments about ambiguous faces displaying a mixture of happiness and sadness. Using an adaptive psychophysics procedure, we estimated the tendency to perceive the faces as happy under each of the induced affective states. Results demonstrate the occurrence of egocentric projections, such that faces were more likely judged as happy when participants reported being happy as compared to when they were sad. Moreover, the degree of emotional egocentricity was associated with individual differences in perspective-taking, with smaller biases being observed in individuals with higher disposition to take the perspective of others. Our findings extend previous literature on emotional egocentricity by showing that self-projection occurs when we make emotion attributions based on the other's emotional expressions, and supports the notion that perspective-taking tendencies play a role in the ability to understand the other's affective states.

Emotional recognition for simulated clinical environment using unpleasant odors: quasi-experimental study

Objective:

to compare the effect of exposure to unpleasant odors in a simulated clinical environment on the emotions of undergraduate nursing students.

Method:

quasi-experimental study. A total of 24 nursing students participated the study, divided into two groups, 12 in the intervention group with exposure to unpleasant odors, and 12 in the control group without exposure to unpleasant odors. To simulate the unpleasant vomiting odor in intervention group, fermented foods were used: boiled oats, curdled milk, spoiled Parmesan cheese, raw egg, pea soup, raisins and vinegar. Participants were filmed and the facial expression analysis was performed at six critical points: student approach; report of the complaint; clinical evaluation; and patient occurrence, intervention and reevaluation based on what was proposed by the Circumplex model of emotions recognition.

Results:

a total of 83,215 emotions related to the six critical points were verified. At the critical point of the proposed scenario with exposure to unpleasant odors, the intervention group presented the basic emotion of sadness and the Control Group, anger.

Conclusion:

it is inferred that the inclusion of unpleasant odors in the simulated scenarios can broaden the emotional development of health students.

Valence makes a stronger contribution than arousal to affective priming

BACKGROUND

Recent data suggest that both word valence and arousal modulate subsequent cognitive processing. However, whether valence or arousal makes a stronger contribution to cognitive processing is less understood.

METHODS

The present study performed three experiments that varied the valence (positive or negative) and arousal (high or low) of prime-target word pairs in a lexical decision-priming task. Affective priming was derived from pure valence (Experiment 1), pure arousal (Experiment 2), or a combination of valence and arousal (Experiment 3).

RESULTS

By comparing three types of priming effects, we found an effect of valence on affective priming was obvious regardless of whether the relationship of the prime-target varied with valence, arousal, or the combination of valence and arousal. In contrast, an effect of arousal on affective priming only appeared in the condition that based on the arousal relationship of the prime-target pair. Moreover, the valence-driven priming effect, arousal-driven priming effect, and emotional-driven priming effect were modulated by valence type but not by arousal level of word stimuli.

CONCLUSION

The present results revealed a pattern of valence and arousal in semantic networks, indicating that the valence information of emotional words tends to be more stable than arousal information within the semantic system, at least in the present lexical decision-priming task.

Double-checking emotions: Valence and emotion category in contextual integration of facial expressions of emotion

Faces showing happy, angry or fearful expressions were presented in emotionally congruent or incongruent situational contexts (short sentences describing events that would usually provoke happiness, anger or fear). The participants were assigned the task of judging whether the expression was appropriate or not to the context (congruency judgment task). Effects of emotional congruency were observed at both the behavioral and electrophysiological levels. Behavioral results showed evidence of congruency effects based on specific emotion content (e.g., less accurate and slower responses to fear faces in angry contexts). Event-related-potentials (ERP) results also showed emotional congruency effects at different post-stimulus onset latencies, beginning with the face-sensitive N170 component. An effect of emotional congruency was also shown on the N400 component that is typically sensitive to semantic congruency. Finally, a late positive potential (LPP), appearing at 450-650 ms post-stimulus onset showed a complex pattern of effects with modulations driven by the different combinations of contexts and target expressions. These results are interpreted in terms of a double process of valence and emotion checking that is supposed to underlie affective processing and contextual integration of facial expressions of emotions.

Joint Modulation of Facial Expression Processing by Contextual Congruency and Task Demands

Faces showing expressions of happiness or anger were presented together with sentences that described happiness-inducing or anger-inducing situations. Two main variables were manipulated: (i) congruency between contexts and expressions (congruent/incongruent) and (ii) the task assigned to the participant, discriminating the emotion shown by the target face (emotion task) or judging whether the expression shown by the face was congruent or not with the context (congruency task). Behavioral and electrophysiological results (event-related potentials (ERP)) showed that processing facial expressions was jointly influenced by congruency and task demands. ERP results revealed task effects at frontal sites, with larger positive amplitudes between 250–450 ms in the congruency task, reflecting the higher cognitive effort required by this task. Effects of congruency appeared at latencies and locations corresponding to the early posterior negativity (EPN) and late positive potential (LPP) components that have previously been found to be sensitive to emotion and affective congruency. The magnitude and spatial distribution of the congruency effects varied depending on the task and the target expression. These results are discussed in terms of the modulatory role of context on facial expression processing and the different mechanisms underlying the processing of expressions of positive and negative emotions.

Influence of emotional contexts on facial emotion attribution in schizophrenia

Recent emotion recognition studies in schizophrenia have reported misattribution of emotional content to emotionally neutral faces. While in these studies faces are presented in the absence of any contextual reference, in daily life facial expressions are typically perceived within a specific situational context. However, there is no evidence on the possible modulatory role of contextual aids on emotion attribution to neutral faces. We address this issue in the present study. Thirty schizophrenia patients and thirty paired controls performed an emotion categorization task (by choosing one among six labels of emotions) with neutral target faces that were superimposed on affectively positive, negative or neutral scenes. In presence of positive contexts, patients categorized neutral faces as happy and fearful more frequently than controls. When negative contexts were present, patients also categorized neutral faces as fearful more frequently than controls. However, in the presence of neutral contexts patients and controls did not differ in their categorization pattern. These results suggest that explicit presence of a neutral context seems to compensate for the bias showed by patients. With the purpose of correcting emotion misattribution in schizophrenia, emotionally neutral contexts might be incorporated to treatments aimed at improving social cognition performance in this patient population.