Facial expression influences recognition memory for faces: Robust enhancement effect of fearful expression

Medial prefrontal and occipito-temporal activity at encoding determines enhanced recognition of threatening faces after 1.5 years

Studies demonstrated that faces with threatening emotional expressions are better remembered than non-threatening faces. However, whether this memory advantage persists over years and which neural systems underlie such an effect remains unknown. Here, we employed an individual difference approach to examine whether the neural activity during incidental encoding was associated with differential recognition of faces with emotional expressions (angry, fearful, happy, sad and neutral) after a retention interval of > 1.5 years (N = 89). Behaviorally, we found a better recognition for threatening (angry, fearful) versus non-threatening (happy and neutral) faces after a delay of > 1.5 years, which was driven by forgetting of non-threatening faces compared with immediate recognition after encoding. Multivariate principal component analysis (PCA) on the behavioral responses further confirmed the discriminative recognition performance between threatening and non-threatening faces. A voxel-wise whole-brain analysis on the concomitantly acquired functional magnetic resonance imaging (fMRI) data during incidental encoding revealed that neural activity in bilateral inferior occipital gyrus (IOG) and ventromedial prefrontal/orbitofrontal cortex (vmPFC/OFC) was associated with the individual differences in the discriminative emotional face recognition performance measured by an innovative behavioral pattern similarity analysis (BPSA). The left fusiform face area (FFA) was additionally determined using a regionally focused analysis. Overall, the present study provides evidence that threatening facial expressions lead to persistent face recognition over periods of > 1.5 years, and that differential encoding-related activity in the medial prefrontal cortex and occipito-temporal cortex may underlie this effect.

The influence of negative emotional intensity on dual-processing recognition

Dual-processing theory assumes recognition memory involves two distinct processes: familiarity and recollection. Although the influence of emotional intensity on memory has been investigated, it remains unclear whether the influence of negative stimuli depends on familiarity or recollection. This study recorded event-related potentials as participants performed a modified remember/know procedure with highly negative, mildly negative, and neutral stimuli. The results showed that, relative to highly negative stimuli, mildly negative and neutral stimuli showed increased mean discrimination for responses of 'know' in the following pattern: highly negative < mildly negative < neutral. Neutral stimuli enhanced the frontal old/new effect. Relative to mildly negative and neutral stimuli, highly negative stimuli showed increased mean discrimination for responses of 'remember', and enhanced the parietal old/new effect. These results suggested negative emotional intensity influences recollection and familiarity differently, as recognition of highly negative stimuli depends on recollection, and recognition of neutral stimuli depends on familiarity.

Memory of my victory and your defeat: Contributions of reward- and memory-related regions to the encoding of winning events in competitions with others

Social interactions enhance human memories, but little is known about how the neural mechanisms underlying episodic memories are modulated by rewarding outcomes in social interactions. To investigate this, fMRI data were recorded while healthy young adults encoded unfamiliar faces in either a competition or a control task. In the competition task, participants encoded opponents' faces in the rock-paper-scissors game, where trial-by-trial outcomes of Win, Draw, and Lose for participants were shown by facial expressions of opponents (Angry, Neutral, and Happy). In the control task, participants encoded faces by assessing facial expressions. After encoding, participants recognized faces previously learned. Behavioral data showed that emotional valence for opponents' Angry faces as the Win outcome was rated positively in the competition task, whereas the rating for Angry faces was rated negatively in the control task, and that Angry faces were remembered more accurately than Neutral or Happy faces in both tasks. fMRI data showed that activation in the medial orbitofrontal cortex (mOFC) paralleled the pattern of valence ratings, with greater activation for the Win than Draw or Lose conditions of the competition task, and the Angry condition of the control task. Moreover, functional connectivity between the mOFC and hippocampus was increased in Win compared to Angry, and the mOFC-hippocampus functional connectivity predicted individual differences in subsequent memory performance only in Win of the competition task, but not in any other conditions of the two tasks. These results demonstrate that the memory enhancement by context-dependent social rewards involves interactions between reward- and memory-related regions.

Effect of post-encoding emotion on long-term memory: Modulation of emotion category and memory strength

Although studies have shown that post-encoding emotion enhances long-term memory, it is unclear whether the effect varies depending on a specific category of emotion and whether the effect depends on memory strength. In the current study, participants encoded a list of words, half of which were presented once and the remaining half of which were presented four times. Afterwards participants watched a video that was neutral, or induced one of the following emotions: anger, sadness, disgust, fear, or happiness. Overall recognition was lower in the anger-inducing condition than in the sadness-inducing or happiness-inducing condition. Recollection (i.e., adjusted rate of correctly identifying a word as old while being able to retrieve details related to the study episode) was lower in the anger-inducing condition than in the sadness-inducing condition. No significant effect of emotion was found on familiarity (i.e., adjusted rate of correctly identifying a word as old without being able to retrieve any details related to the study episode). Furthermore, memory strength modulated the effect on familiarity: Familiarity for prioritized words was lower than for non-prioritized words only in the "anger" and "sadness" conditions but not in other emotion conditions. The effect of post-encoding emotion differs depending on a specific category of emotion and modulation of memory strength relies on a specific component of recognition memory.

The effect of fearful expressions on recognition memory for faces: Behavioral and electrophysiological data

Facial expressions affect memory for face identity. We tested how fearful expressions modulate recognition memory for faces. In two studies, participants completed a continuous recognition task with fearful and neutral faces while their electroencephalogram was recorded. Each face stimulus was presented twice and participants were instructed to indicate whether it was presented for the first ('new') or second time ('old'). The false alarm rate was higher for fearful than neutral faces, which is opposite to the emotion enhancement effect on memory but in line with the liberal response bias for emotional information. There was no evidence of emotional modulation of the N400 old/new effect, which suggests that the sense of familiarity was not affected by fearful facial expressions. The LPC old/new effect, however, was modulated by facial expression, as it was absent for fearful faces because of a greater positivity in response to new fearful than new neutral faces. This LPC old/new effect finding may reflect that the emotional salience of fearful new faces is mistaken for a sense of recollection, resulting in an increased false alarm rate. In short, people seem more likely to (mistakenly) think that they have encountered a person before when the person looks scared compared to non-emotional, which has relevance for daily life and forensic situations such as police lineups.

Recognition of Contextually Threat-Related Scenes is Enhanced by Preceding Emotionally Incongruent Facial Expression

Previous studies on intentional and incidental face memory have investigated the effects of emotional facial expression on facial recognition itself. However, it is still uncertain whether facial expression influences later recognition of other emotional stimuli, such as emotional scenes. To address this issue, participants during the encoding phase were presented with emotional scenes together with facial expressions. The emotion of the scenes was either congruent or incongruent with that of the facial expression. In order to increase the attention towards faces/facial expressions, the task was related to faces rather than scenes, for example, the participants were asked either to memorize the facial identities (intentional face learning, Experiment 1) or to identify the gender of the faces (incidental face learning, Experiment 2). Subsequently, the participants were asked to perform an unexpected old/new recognition task regarding the scene pictures. In general, the results showed that recognition of threat-related scenes was enhanced by a preceding emotionally incongruent facial expression irrespective of intentional or incidental face learning. The findings indicate that facial expression influences recognition of contextual threat-related scenes.

NEVER forget: negative emotional valence enhances recapitulation

A hallmark feature of episodic memory is that of "mental time travel," whereby an individual feels they have returned to a prior moment in time. Cognitive and behavioral neuroscience methods have revealed a neurobiological counterpart: Successful retrieval often is associated with reactivation of a prior brain state. We review the emerging literature on memory reactivation and recapitulation, and we describe evidence for the effects of emotion on these processes. Based on this review, we propose a new model: Negative Emotional Valence Enhances Recapitulation (NEVER). This model diverges from existing models of emotional memory in three key ways. First, it underscores the effects of emotion during retrieval. Second, it stresses the importance of sensory processing to emotional memory. Third, it emphasizes how emotional valence - whether an event is negative or positive - affects the way that information is remembered. The model specifically proposes that, as compared to positive events, negative events both trigger increased encoding of sensory detail and elicit a closer resemblance between the sensory encoding signature and the sensory retrieval signature. The model also proposes that negative valence enhances the reactivation and storage of sensory details over offline periods, leading to a greater divergence between the sensory recapitulation of negative and positive memories over time. Importantly, the model proposes that these valence-based differences occur even when events are equated for arousal, thus rendering an exclusively arousal-based theory of emotional memory insufficient. We conclude by discussing implications of the model and suggesting directions for future research to test the tenets of the model.

Facial Identity Memory Is Enhanced When Sender's Expression Is Congruent to Perceiver's Experienced Emotion

The role of the social context in facial identity recognition and expression recall was investigated by manipulating the sender's emotional expression and the perceiver's experienced emotion during encoding. A mixed-design with one manipulated between-subjects factor (perceiver's experienced emotion) and two within-subjects factors (change in experienced emotion and sender's emotional expression) was used. Senders' positive and negative expressions were implicitly encoded while perceivers experienced their baseline emotion and then either a positive or a negative emotion. Facial identity recognition was then tested using senders' neutral expressions. Memory for senders previously seen expressing positive or negative emotion was facilitated if the perceiver initially encoded the expression while experiencing a positive or a negative emotion, respectively. Furthermore, perceivers were confident of their decisions. This research provides a more detailed understanding of the social context by exploring how the sender-perceiver interaction affects the memory for the sender.

Memory for faces and voices varies as a function of sex and expressed emotion

We investigated how memory for faces and voices (presented separately and in combination) varies as a function of sex and emotional expression (anger, disgust, fear, happiness, sadness, and neutral). At encoding, participants judged the expressed emotion of items in forced-choice tasks, followed by incidental Remember/Know recognition tasks. Results from 600 participants showed that accuracy (hits minus false alarms) was consistently higher for neutral compared to emotional items, whereas accuracy for specific emotions varied across the presentation modalities (i.e., faces, voices, and face-voice combinations). For the subjective sense of recollection (“remember” hits), neutral items received the highest hit rates only for faces, whereas for voices and face-voice combinations anger and fear expressions instead received the highest recollection rates. We also observed better accuracy for items by female expressers, and own-sex bias where female participants displayed memory advantage for female faces and face-voice combinations. Results further suggest that own-sex bias can be explained by recollection, rather than familiarity, rates. Overall, results show that memory for faces and voices may be influenced by the expressions that they carry, as well as by the sex of both items and participants. Emotion expressions may also enhance the subjective sense of recollection without enhancing memory accuracy.

Recognition memory for low- and high-frequency-filtered emotional faces: Low spatial frequencies drive emotional memory enhancement, whereas high spatial frequencies drive the emotion-induced recognition bias

This article deals with two well-documented phenomena regarding emotional stimuli: emotional memory enhancement-that is, better long-term memory for emotional than for neutral stimuli-and the emotion-induced recognition bias-that is, a more liberal response criterion for emotional than for neutral stimuli. Studies on visual emotion perception and attention suggest that emotion-related processes can be modulated by means of spatial-frequency filtering of the presented emotional stimuli. Specifically, low spatial frequencies are assumed to play a primary role for the influence of emotion on attention and judgment. Given this theoretical background, we investigated whether spatial-frequency filtering also impacts (1) the memory advantage for emotional faces and (2) the emotion-induced recognition bias, in a series of old/new recognition experiments. Participants completed incidental-learning tasks with high- (HSF) and low- (LSF) spatial-frequency-filtered emotional and neutral faces. The results of the surprise recognition tests showed a clear memory advantage for emotional stimuli. Most importantly, the emotional memory enhancement was significantly larger for face images containing only low-frequency information (LSF faces) than for HSF faces across all experiments, suggesting that LSF information plays a critical role in this effect, whereas the emotion-induced recognition bias was found only for HSF stimuli. We discuss our findings in terms of both the traditional account of different processing pathways for HSF and LSF information and a stimulus features account. The double dissociation in the results favors the latter account-that is, an explanation in terms of differences in the characteristics of HSF and LSF stimuli.