Out of Focus: Facial Feedback Manipulation Modulates Automatic Processing of Unattended Emotional Faces

An ERP study on pre-attentive processing of emotional faces in individuals with high social anhedonia

Expression-related visual mismatch negativity (EMMN) is encoded by prediction errors associated with facial emotion changes. Previous studies have shown that patients with psychiatric disorders (e.g., schizophrenia and major depressive disorder) exhibit significantly reduced EMMNs. However, although social anhedonia is recognized as a transdiagnostic feature across psychiatric disorders, it remains unclear whether individuals with high social anhedonia (HSA) also display similar deficits. The present study aimed to explore the pre-attentive processing characteristics of unexpected facial emotions in individuals with HSA. Thirty-one participants with HSA and 31 participants with low social anhedonia (LSA) were recruited. The EMMN components elicited by happy and sad expressions in an oddball-control paradigm were analysed under three different time windows (70-140 ms, 180-270 ms, 280-360 ms) over six regions of interest. In comparison with the LSA group, the EMMN amplitudes elicited by emotional faces were lower in the HSA group in the 280-360 ms time window. In addition, the results showed that the decreased EMMN amplitudes in the 280-360 ms time window were significantly correlated with social anhedonia. Our study indicated decreased EMMN and its close relationship with social anhedonia in individuals with HSA, which promotes a deeper understanding of the psychophysiological mechanism of emotional face processing in individuals with social anhedonia.

Facial feedback manipulation influences the automatic detection of unexpected emotional body expressions

Unexpected or changing facial expressions are known to be able to engage more automatic processing than frequently occurring facial expressions, thereby inducing a neural differential wave response known as expression mismatch negativity (EMMN). Recent studies have shown that EMMN can be modulated by the observer's facial feedback (i.e., feedback from their own facial movements). A similar EMMN activity has been discovered for body expressions, but thus far only a few emotion types have been investigated. It is unknown whether the EMMNs evoked by body expressions can be influenced by facial feedback. To explore this question, we recorded EEG activity of 29 participants in the reverse oddball paradigm. Here two unexamined categories of body expressions were presented, happy and sad, placed in two paired stimulus sequences: in one the happy body was presented with a probability of 80% (standards) while the sad body was presented with a probability of 20% (deviants), and in the other the probabilities were reversed. The facial feedback was manipulated by different pen holding conditions (i.e., participants holding the pen with the teeth, lips, or nondominant hand). The nonparametric cluster permutation test revealed significant happy and sad body-related EMMN (bEMMN) activities. The happy-bEMMN were more negative than sad-bEMMN within the range of 100-150 ms. Additionally, the bEMMN amplitude of both emotions is modulated by the facial feedback conditions. These results expand the range of emotional types applicable to bEMMN and provide evidence for the validity of the facial feedback hypothesis across emotional carriers.

I spy with my little eye: The detection of changes in emotional faces and the influence of facial feedback in Parkinson disease

BACKGROUND AND PURPOSE

Parkinson disease (PD) is a progressive neurodegenerative disorder that affects the motor system but also involves deficits in emotional processing such as facial emotion recognition. In healthy participants, it has been shown that facial mimicry, the automatic imitation of perceived facial expressions, facilitates the interpretation of the emotional states of our counterpart. In PD patients, recent studies revealed reduced facial mimicry and consequently reduced facial feedback, suggesting that this reduction might contribute to the prominent emotion recognition deficits found in PD.

METHODS

We investigated the influence of facial mimicry on facial emotion recognition. Twenty PD patients and 20 healthy controls (HCs) underwent a classical facial mimicry manipulation (holding a pen with the lips, teeth, or nondominant hand) while performing an emotional change detection task with faces.

RESULTS

As expected, emotion recognition was significantly influenced by facial mimicry manipulation in HCs, further supporting the hypothesis of facial feedback and the related theory of embodied simulation. Importantly, patients with PD, generally and independent from the facial mimicry manipulation, were impaired in their ability to detected emotion changes. Our data further show that PD patients' facial emotional recognition abilities are completely unaffected by mimicry manipulation, suggesting that PD patients cannot profit from an artificial modulation of the already impaired facial feedback.

CONCLUSIONS

These findings suggest that it is not the hypomimia and the absence of facial feedback per se, but a disruption of the facial feedback loop, that leads to the prominent emotion recognition deficit in PD patients.

A Utilização da Imitação Facial em Tarefas de Reconhecimento de Expressões Emocionais

Resumo A imitação facial é um comportamento involuntário capaz de facilitar a transmissão de informações não verbais relevantes em diferentes contextos sociais. Este estudo teve por objetivo analisar a capacidade de reconhecimento de expressões emocionais enquanto o observador tensiona a própria face ou imita a face-alvo. A hipótese utilizada foi a de que indivíduos que tensionam a própria face terão menor probabilidade de acertos na execução das tarefas de reconhecimento de expressões emocionais e aqueles que imitam a expressão terão uma maior probabilidade de acertos na execução das mesmas tarefas. A amostra foi composta por 30 participantes, divididos em dois grupos experimentais: o Grupo Imitação (GI) e o Grupo Ruído (GR), ambos com 18 participantes do sexo feminino e 12 do sexo masculino. O experimento consistiu em apresentar fotos de atores expressando facialmente uma emoção básica por 10 segundos. Neste período, os participantes deveriam, então, observar ou intervir facialmente, imitando ou tensionando a própria face (de acordo com o grupo alocado, Imitação ou Ruído). Após os 10 segundos executando a instrução (observar, imitar ou interferir), o participante deveria responder - entre as opções alegria, tristeza, nojo, raiva, surpresa e medo - a emoção correspondente à imagem. Os resultados apresentaram diferenças significativas quando comparadas as tarefas de tensionar ou imitar a face-alvo, sugerindo que a alteração da própria face do observador pode influenciar durante o desempenho de uma tarefa de reconhecimento de emoções em faces.

Impact of emotional valence on mismatch negativity in the course of cortical face processing

Various aspects of cortical face processing have been studied by assessing event related potentials (ERP). It has been described in the literature that mismatch negativity (MMN), a well-studied ERP, is not only modulated by sensory features but also emotional valence. However, the exact impact of emotion on the temporo-spatial profile of visual MMN during face processing remains inconsistent. By employing a sequential oddball paradigm using both neutral and emotional deviants, we were able to differentiate two distinct vMMN subcomponents. While an early subcomponent at 150-250 ms is elicited by emotional salient facial stimuli, the later subcomponent at 250-400 ms seems to reflect the detection of regularity violations in facial recognition per se, unaffected by emotional salience. Our results suggest that emotional valence is encoded in vMMN signal strength at an early stage of facial processing. Furthermore, we assume that of facial processing consists of temporo-spatially distinct, partially overlapping levels concerning different facial aspects.

The automatic detection of unexpected emotion and neutral body postures: A visual mismatch negativity study

The ability to automatically detect emotional changes in the environment is crucial for social interaction. In the visual system, expression-related mismatch negativity (EMMN) reflects the automatic processing of emotional changes in facial expression. However, body postures also carry visual emotional information that can be recognized effectively and processed automatically, although their processing mechanism remains unknown. In this study, the reverse oddball paradigm was used to investigate the mismatch responses of unexpected fear and neutral body postures. The nonparametric cluster permutation test revealed significant fear and neutral visual mismatch negativity (vMMN) activities, and the fear-related vMMN was enhanced prior (130-230 ms) to the neutral vMMN (180-230 ms). The body-sensitive N190 component may partially account for the vMMN obtained in this study. The fearful body posture evoked a greater N190 response over the neutral body, and amplitudes of N190 were more negative in the deviant condition than the standard condition. Additionally, the body-related visual mismatch oscillatory responses were associated with enhancement of the alpha band oscillation, especially for the fearful body posture. These results expanded the applicable scope of body posture cues corresponding to mismatch signals, objectively defined the electrophysiological activities evoked, and revealed the processing bias toward negative emotion.

Effects of posed smiling on memory for happy and sad facial expressions

The perception and storage of facial emotional expressions constitutes an important human skill that is essential for our daily social interactions. While previous research revealed that facial feedback can influence the perception of facial emotional expressions, it is unclear whether facial feedback also plays a role in memory processes of facial emotional expressions. In the present study we investigated the impact of facial feedback on the performance in emotional visual working memory (WM). For this purpose, 37 participants underwent a classical facial feedback manipulation (FFM) (holding a pen with the teeth—inducing a smiling expression vs. holding a pen with the non-dominant hand—as a control condition) while they performed a WM task on varying intensities of happy or sad facial expressions. Results show that the smiling manipulation improved memory performance selectively for happy faces, especially for highly ambiguous facial expressions. Furthermore, we found that in addition to an overall negative bias specifically for happy faces (i.e. happy faces are remembered as more negative than they initially were), FFM induced a positivity bias when memorizing emotional facial information (i.e. faces were remembered as being more positive than they actually were). Finally, our data demonstrate that men were affected more by FFM: during induced smiling men showed a larger positive bias than women did. These data demonstrate that facial feedback not only influences our perception but also systematically alters our memory of facial emotional expressions.

Emotional visual mismatch negativity: a joint investigation of social and non-social dimensions in adults with autism

Unusual behaviors and brain activity to socio-emotional stimuli have been reported in Autism Spectrum Disorder (ASD). Atypical reactivity to change and intolerance of uncertainty are also present, but little is known on their possible impact on facial expression processing in autism. The visual mismatch negativity (vMMN) is an electrophysiological response automatically elicited by changing events such as deviant emotional faces presented among regular neutral faces. While vMMN has been found altered in ASD in response to low-level changes in simple stimuli, no study has investigated this response to visual social stimuli. Here two deviant expressions were presented, neutral and angry, embedded in a sequence of repetitive neutral stimuli. vMMN peak analyses were performed for latency and amplitude in early and late time windows. The ASD group presented smaller amplitude of the late vMMN to both neutral and emotional deviants compared to the typically developed adults (TD) group, and only the TD group presented a sustained activity related to emotional change (i.e., angry deviant). Source reconstruction of the vMMNs further revealed that any change processing elicited a reduced activity in ASD group compared to TD in the saliency network, while the specific processing emotional change elicited activity in the temporal region and in the insula. This study confirms atypical change processing in ASD and points to a specific difficulty in the processing of emotional changes, potentially playing a crucial role in social interaction deficits. Nevertheless, these results require to be further replicated with a greater sample size and generalized to other emotional expressions.

The Pacified Face: Early Embodiment Processes and the Use of Dummies

Few things affect us as much as facial expressions, as they inform us about others' feelings and intentions, thereby influencing our own emotions and behaviors. A substantial body of literature links the critical abilities of recognizing and understanding emotion displays with facial mimicry, a sensorimotor process involving rapid imitation of perceived expressions. For example, blocking or altering facial mimicry in adults leads to disruptions in judgments in emotion recognition or emotional language processing. The present review focuses on pacifier use in infancy, a common practice that has the potential to interfere with infants' facial movements in ways identical to laboratory paradigms designed to block facial mimicry. Despite this similarity and the widespread use of infant soothers, little is known about their long-term effects. Here we review studies exploring the psychological correlates and implications of pacifier use. In particular, we discuss how soothers may interfere with the development of social skills in infants and present evidence linking pacifier use with disrupted adults' mimicry of facial expressions displayed by infants. Other preliminary findings reveal negative correlations between the use of soothers and children's spontaneous facial mimicry as well as emotional competence of young adults. Such studies, although correlational, suggest that this widespread parenting practice may affect the development of social skills by influencing emotional coordination. We discuss the implications of these findings and propose avenues for future research that can provide insights into the role of embodied processes in the development of emotional competence and adult functioning.