Repetition and ERPs during emotional scene processing: A selective review

Moving toward reality: Electrocortical reactivity to naturalistic multimodal emotional videos

While previous research has investigated the effects of emotional videos on peripheral physiological measures and conscious experience, this study extends the research to include electrocortical measures, specifically the steady-state visual-evoked potential (ssVEP). A carefully curated set of 45 videos, designed to represent a wide range of emotional and neutral content, were presented with a flickering border. The videos featured a continuous single-shot perspective, natural soundtrack, and excluded elements associated with professional films, to enhance realism. The results demonstrate a consistent reduction in ssVEP amplitude during emotional videos which strongly correlates with the rated emotional intensity of the clips. This suggests that narrative audiovisual stimuli have the potential to track dynamic emotional processing in the cortex, providing new avenues for research in affective neuroscience. The findings highlight the potential of using realistic video stimuli to investigate how the human brain processes emotional events in a paradigm that increases ecological validity. Future studies can further develop this paradigm by expanding the video set, targeting specific cortical networks, and manipulating narrative predictability. Overall, this study establishes a foundation for investigating emotional perception using realistic video stimuli and has the potential to expand our understanding of real-world emotional processing in the human brain.

Do rare emotional scenes enhance LPP modulation?

The slow wave late positive potential (LPP) is one of the most dependable measures of emotional processing in human neuroscience. While LPP positivity shows modest malleability by emotional regulation and competing tasks, its fundamental enhancement by emotional scene perception is extremely reliable. Here we assess the impact of emotional scene frequency (67%, 50% and 17%) on the strength of LPP modulation, across 3 groups of participants, using consistent presentation and analysis methods. The results demonstrate strong consistency in the strength of emotional modulation across frequent, equiprobable, and rare emotion conditions. However, a small enhancement of LPP positivity was found during unpleasant scenes in the rare emotion condition. The LPP thus appears to be largely insensitive to contextual features such as scene frequency and predictability, suggesting that strong emotional cues persistently engage orienting and evaluation processes because this tendency was selected in phylogeny.

Effects of emotional study context on immediate and delayed recognition memory: Evidence from event-related potentials

Whilst research has largely focused on the recognition of emotional items, emotion may be a more subtle part of our surroundings and conveyed by context rather than by items. Using ERPs, we investigated which effects an arousing context during encoding may have for item-context binding and subsequent familiarity-based and recollection-based item-memory. It has been suggested that arousal could facilitate item-context bindings and by this enhance the contribution of recollection to subsequent memory judgements. Alternatively, arousal could shift attention onto central features of a scene and by this foster unitisation during encoding. This could boost the contribution of familiarity to remembering. Participants learnt neutral objects paired with ecologically highly valid emotional faces whose names later served as neutral cues during an immediate and delayed test phase. Participants identified objects faster when they had originally been studied together with emotional context faces. Items with both neutral and emotional context elicited an early frontal ERP old/new difference (200-400 ms). Neither the neurophysiological correlate for familiarity nor recollection were specific to emotionality. For the ERP correlate of recollection, we found an interaction between stimulus type and day, suggesting that this measure decreased to a larger extend on Day 2 compared with Day 1. However, we did not find direct evidence for delayed forgetting of items encoded in emotional contexts at Day 2. Emotion at encoding might make retrieval of items with emotional context more readily accessible, but we found no significant evidence that emotional context either facilitated familiarity-based or recollection-based item-memory after a delay of 24 h.

Neural Processing of Repeated Emotional Scenes in Schizophrenia, Schizoaffective Disorder, and Bipolar Disorder

Impaired emotional processing and cognitive functioning are common in schizophrenia, schizoaffective disorder, and bipolar disorders, causing significant socioemotional disability. While a large body of research demonstrates abnormal cognition/emotion interactions in these disorders, previous studies investigating abnormalities in the emotional scene response using event-related potentials (ERPs) have yielded mixed findings, and few studies compare findings across psychiatric diagnoses. The current study investigates the effects of emotion and repetition on ERPs in a large, well-characterized sample of participants with schizophrenia-bipolar syndromes. Two ERP components that are modulated by emotional content and scene repetition, the early posterior negativity (EPN) and late positive potential (LPP), were recorded in healthy controls and participants with schizophrenia, schizoaffective disorder, bipolar disorder with psychosis, and bipolar disorder without psychosis. Effects of emotion and repetition were compared across groups. Results displayed significant but small effects in schizophrenia and schizoaffective disorder, with diminished EPN amplitudes to neutral and novel scenes, reduced LPP amplitudes to emotional scenes, and attenuated effects of scene repetition. Despite significant findings, small effect sizes indicate that emotional scene processing is predominantly intact in these disorders. Multivariate analyses indicate that these mild ERP abnormalities are related to cognition, psychosocial functioning, and psychosis severity. This relationship suggests that impaired cognition, rather than diagnosis or mood disturbance, may underlie disrupted neural scene processing in schizophrenia-bipolar syndromes.

Spatiotemporal Dynamics of Affective and Semantic Valence Among Women

As an important dimension of emotional assessment, valence can refer to affective valence reflecting an emotional response, or semantic valence reflecting knowledge about the nature of a stimulus. A previous study has used repeated exposure to separate these two similar cognitive processes. Here, for the first time, we compared the spatiotemporal dynamics of the affective and semantic modes of valence by combining event-related potentials with repeated exposure. Forty-seven female participants were assigned to the feeling-focused and semantic-focused groups and thereafter repeatedly viewed the pictures selected for the study. Self-report behavioral results showed that post-test scores were significantly lower than pre-test scores in the feeling-focused group, while the differences between the two tests were not significant in the semantic-focused group. At the neural level, N2 amplitudes decreased and early late positive potential amplitudes increased in both groups, suggesting that the participants perceived the repeated pictures more fluently and retrieved the traces of the stimulus spontaneously regardless of the valence they judged. However, the late positive potential amplitudes in anterior areas and the activity of the middle frontal gyrus were attenuated in the feeling-focused group; however, this component in posterior areas and the activity of the precentral gyrus were increased in the semantic-focused group. Therefore, the processes of affective and semantic valence are similar in the early stages of image perception and retrieval, while in the later stage of valence judgment, these processes show different brain activation patterns. The results provide electrophysiological evidence for the differences in psychological processes when judging the two modes of valence.

Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces

The processing of fearful facial expressions is prioritized by the human brain. This priority is maintained across various information processing stages as evident in early, intermediate and late components of event-related potentials (ERPs). However, emotional modulations are inconsistently reported for these different processing stages. In this pre-registered study, we investigated how feature-based attention differentially affects ERPs to fearful and neutral faces in 40 participants. The tasks required the participants to discriminate either the orientation of lines overlaid onto the face, the sex of the face or the face's emotional expression, increasing attention to emotion-related features. We found main effects of emotion for the N170, early posterior negativity (EPN) and late positive potential (LPP). While N170 emotional modulations were task-independent, interactions of emotion and task were observed for the EPN and LPP. While EPN emotion effects were found in the sex and emotion tasks, the LPP emotion effect was mainly driven by the emotion task. This study shows that early responses to fearful faces are task-independent (N170) and likely based on low-level and configural information while during later processing stages, attention to the face (EPN) or-more specifically-to the face's emotional expression (LPP) is crucial for reliable amplified processing of emotional faces.

Modulation of face- and emotion-selective ERPs by the three most common types of face image manipulations

In neuroscientific studies, the naturalness of face presentation differs; a third of published studies makes use of close-up full coloured faces, a third uses close-up grey-scaled faces and another third employs cutout grey-scaled faces. Whether and how these methodological choices affect emotion-sensitive components of the event-related brain potentials (ERPs) is yet unclear. Therefore, this pre-registered study examined ERP modulations to close-up full-coloured and grey-scaled faces as well as cutout fearful and neutral facial expressions, while attention was directed to no-face oddballs. Results revealed no interaction of face naturalness and emotion for any ERP component, but showed, however, large main effects for both factors. Specifically, fearful faces and decreasing face naturalness elicited substantially enlarged N170 and early posterior negativity amplitudes and lower face naturalness also resulted in a larger P1.This pattern reversed for the LPP, showing linear increases in LPP amplitudes with increasing naturalness. We observed no interaction of emotion with face naturalness, which suggests that face naturalness and emotion are decoded in parallel at these early stages. Researchers interested in strong modulations of early components should make use of cutout grey-scaled faces, while those interested in a pronounced late positivity should use close-up coloured faces.

Some Compliments (and Insults) Are More Heartfelt

Abstract. Previous research suggests that individuals with increased awareness of internal bodily states (i.e., high interoceptive awareness) are more sensitive to emotional stimuli, particularly stimuli that are negative or threatening. Concurrently, there is increasing evidence that words that are more body-referent (e.g., bonehead) are processed faster, perceived more accurately, and generate larger neuroelectrical signals than those that are less body-referent (e.g., idiot). The present study examined individual differences in interoceptive awareness (IA) to these more embodied words. While electroencephalogram (EEG) was recorded, participants passively viewed insults, compliments, and neutral stimuli, half of which were more embodied (e.g., bonehead, beautiful) and half of which were less embodied (e.g., idiot, friendly). Results showed that the high perceivers generated a larger P2 to embodied compliments than less embodied compliments while average perceivers generated a larger P2 to embodied insults than to less embodied insults. The results provide preliminary evidence that good cardiac awareness is not only associated with increased sensitivity to negative stimuli, but to stimuli pertaining to the body itself.

Estimating statistical power for event-related potential studies using the late positive potential

The late positive potential (LPP) is a common measurement used to study emotional processes of subjects in ERP paradigms. Despite its extensive use in affective neuroscience, there is presently no gold standard for how to appropriately power ERP studies using the LPP. The present study investigates how the number of trials, number of subjects, and magnitude of the effect size affect statistical power in analyses of the LPP. Using Monte Carlo simulations of ERP experiments with varying numbers of trials, subjects, and synthetic effects of known magnitude, we measured the probability of obtaining a statistically significant effect in 1,489 experiments repeated 1,000 times each. Predictably, our results showed that statistical power increases with increasing numbers of trials and subjects and at larger effect sizes. We also found that higher levels of statistical power can be achieved with lower numbers of subjects and trials and at lower effect sizes in within-subject than in between-subjects designs. Furthermore, we found that, as subjects are added to an experiment, the slope of the relationship between effect size and statistical power increased and shifted to the left until the power asymptoted to nearly 100% at higher effect sizes. This suggests that adding more subjects greatly increases statistical power at lower effect sizes (<1 µV) compared with more robust (>1.5 µV) effect sizes. We confirmed the results from the simulations based on the synthetic effects by running a new series of simulated experiments based on real data collected while participants looked at emotional images.

The reality of "food porn": Larger brain responses to food-related cues than to erotic images predict cue-induced eating

While some individuals can defy the lure of temptation, many others find appetizing food irresistible. The goal of this study was to investigate the neuropsychological mechanisms that increase individuals' vulnerability to cue-induced eating. Using ERPs, a direct measure of brain activity, we showed that individuals with larger late positive potentials in response to food-related cues than to erotic images are more susceptible to cue-induced eating and, in the presence of a palatable food option, eat more than twice as much as individuals with the opposite brain reactivity profile. By highlighting the presence of individual brain reactivity profiles associated with susceptibility to cue-induced eating, these findings contribute to the understanding of the neurobiological basis of vulnerability to obesity.

Orienting and memory to unexpected and/or unfamiliar visual events in children and adults

For children, new experiences occur very often, and learning to differentiate between old and new events is a fundamental process necessary for appropriate reactions to stimuli. Thus the present study is concerned with maturation of brain responses to repeated novel events. We examined the effect of repetition of familiar (meaningful) and unfamiliar (meaningless) symbols on the event-related-potentials (ERPs) recorded during novelty oddball and recognition memory tasks from children, adolescents and young adults. During the novelty oddball task, repetition of the familiar symbols elicited a reduction in the novelty P3 in the ERPs of all age groups, while repetition of the unfamiliar symbols elicited a reduction in novelty P3 amplitude only in children. As expected, recognition memory performance improved with age and was better for familiar than unfamiliar symbols. For all age groups, ERPs to correctly recognized familiar old symbols elicited a larger positivity than ERPs to correctly identified new symbols, indicating a reliable memory effect. However, ERPs to unfamiliar old and new symbols did not differ in adults and adolescents but did differ in children. The data suggest that children process familiar visual symbols in a similar fashion to that of adults, and that children process unfamiliar symbols differently from adults.

The Late Positive Potentials Evoked by Cigarette-Related and Emotional Images Show no Gender Differences in Smokers

When trying to quit, women are less likely than men to achieve long-term smoking abstinence. Identifying the neuropsychological mechanisms underlying women's higher relapse vulnerability will help clinicians to develop effective tailored smoking cessation interventions. Here we used event-related potentials (ERPs), a direct measure of brain activity, to evaluate the extent to which neurophysiological responses to cigarette-related and other emotional stimuli differ between female and male smokers. Both women and men showed similar patterns of brain reactivity across all picture categories; pleasant and unpleasant images prompted larger Late Positive Potentials (LPPs, a robust measure of motivational relevance) than neutral images in both groups, and cigarette-related images prompted lower LPPs than high arousing emotional images in both groups. Unlike previous studies, there were no differences between male and female smokers with regard to LPP responses to cigarette-related images. This suggests that the LPP may not be ideally suited to discriminate neurophysiological gender differences or that there are simply no gender differences in the neurophysiological responses to cigarette-related stimuli. We collected ERPs from 222 non-nicotine-deprived smokers (101 women) while they watched a slideshow that included high and low emotionally arousing pleasant and unpleasant pictures, cigarette-related, and neutral pictures. We used the mean amplitude of the LPP to assess the affective significance that participants attributed to these pictures.

Direct Electrophysiological Mapping of Shape-Induced Affective Perception

Visual information may convey different affective valences and induce our brain into different affective perceptions. Many studies have found that unpleasant stimuli could produce stronger emotional effects than pleasant stimuli could. Although there has been a notion that triangle is perceived as negative and circle as positive, there has been no systematic study to map the degrees of valence of shapes with different affective perceptions. Here, we employed four shapes (ellipse, triangle, and line-drawn happy and angry faces) to investigate the behavior and electrophysiological responses, in order to systematically study shape-induced affective perception. The reaction time delay and the event-related potential (ERP), particularly the early ERP component, were applied to find the associations with different affective perceptions. Our behavioral results showed that reaction time for angry face was significantly shorter than those for the other three types of stimuli (p < 0.05). In the ERP results, P1, N1, P2, and N2 amplitudes for angry face were significantly larger than those for happy face. Similarly, P1, N1, P2, and N2 amplitudes for triangle were significantly larger than those for ellipse. Particularly, P1 amplitude in the parietal lobe for angry face was the strongest, followed by happy face, triangle, and ellipse. Hence, this work found distinct electrophysiological evidence to map the shape-induced affective perception. It supports the hypothesis that affective strain would induce larger amplitude than affective ease does and strong affective stimuli induce larger amplitude than mild affective stimuli do.

Neural activation and memory for natural scenes: Explicit and spontaneous retrieval

Stimulus repetition elicits either enhancement or suppression in neural activity, and a recent fMRI meta-analysis of repetition effects for visual stimuli (Kim, 2017) reported cross-stimulus repetition enhancement in medial and lateral parietal cortex, as well as regions of prefrontal, temporal, and posterior cingulate cortex. Repetition enhancement was assessed here for repeated and novel scenes presented in the context of either an explicit episodic recognition task or an implicit judgment task, in order to study the role of spontaneous retrieval of episodic memories. Regardless of whether episodic memory was explicitly probed or not, repetition enhancement was found in medial posterior parietal (precuneus/cuneus), lateral parietal cortex (angular gyrus), as well as in medial prefrontal cortex (frontopolar), which did not differ by task. Enhancement effects in the posterior cingulate cortex were significantly larger during explicit compared to implicit task, primarily due to a lack of functional activity for new scenes. Taken together, the data are consistent with an interpretation that medial and (ventral) lateral parietal cortex are associated with spontaneous episodic retrieval, whereas posterior cingulate cortical regions may reflect task or decision processes.

Cigarette cues capture attention of smokers and never-smokers, but for different reasons

BACKGROUND

While the notion that smokers reliably show higher reactivity to cigarette-related versus neutral cues is both theoretically and empirically supported, it is unclear why never-smokers also show enhanced brain responses to cigarette-related cues.

METHODS

Using a repetitive picture viewing paradigm, in which responses evoked by affective cues are more resistant to habituation, we assessed the effects of stimulus repetition on event-related potentials (ERPs) evoked by pleasant, unpleasant, cigarette-related, and neutral images in 34 smokers (SMO) and 34 never-smokers (NEV). We examined the early posterior negativity (EPN) and the late positive potential (LPP), two ERP components which are sensitive to a picture's motivational qualities.

RESULTS

Before stimulus repetition, pleasant, unpleasant, and cigarette-related cues produced greater EPN and LPP amplitudes than neutral cues in all subjects. During stimulus repetition, both components were similarly modulated by emotional arousal, such that pleasant, unpleasant, and cigarette-related cues evoked greater EPN and LPP amplitude, relative to neutral. Smoking status did not modulate these effects. While there were no group differences in self-reported stimulus ratings of valence for pleasant, unpleasant, or neutral stimuli, NEV rated cigarette-related cues as unpleasant. We observed a moderate, negative correlation between LPP amplitude and self-reported valence ratings of cigarette-related cues among NEV.

CONCLUSIONS

These data suggest that cigarette-related cues capture attentional resources of both SMO and NEV, but for different reasons. For SMO, cigarette-related cues have acquired motivational significance through repeated associations with nicotine delivery, whereas for NEV, cigarette-related cues are perceived as unpleasant.

Emotional Picture Perception: Repetition Effects in Free-Viewing and during an Explicit Categorization Task

Several studies have found that, despite a decrease in the overall amplitude of the late positive potential (LPP) with repeated presentation of the same picture, emotional stimuli continue to elicit a larger LPP than neutral ones. These findings seem to support the hypothesis that the affective modulation of the LPP reflects a mandatory process and does not rely on stimulus novelty. However, in these studies participants were asked to merely look at the pictures, without carrying out any additional task (free-viewing), making picture emotionality the most salient aspect of the stimulus, despite its repetition. The current study aimed to examine the impact of an explicit categorization task on the emotional processing of repeated pictures. To this purpose, ERPs to novel and repeated pictures were measured during free-viewing as well as during an explicit categorization task, where the emotional content of the pictures was task-irrelevant. The within-subject comparison between the free-viewing and task context revealed that the overall LPP habituated more rapidly in the free-viewing condition, but, more importantly, the LPP affective modulation was unaffected by task requirements during both novel and repeated presentations. These results suggest that the affective modulation of the LPP reflects an automatic engagement of cortico-limbic motivational systems, which continues to take place regardless of stimulus novelty and task context.

Motivated attention and family risk for depression: Neuronal generator patterns at scalp elicited by lateralized aversive pictures reveal blunted emotional responsivity

Behavioral and electrophysiologic evidence suggests that major depression (MDD) involves right parietotemporal dysfunction, a region activated by arousing affective stimuli. Building on prior event-related potential (ERP) findings (Kayser et al. 2016 NeuroImage 142:337–350), this study examined whether these abnormalities also characterize individuals at clinical high risk for MDD. We systematically explored the impact of family risk status and personal history of depression and anxiety on three distinct stages of emotional processing comprising the late positive potential (LPP). ERPs (72 channels) were recorded from 74 high and 53 low risk individuals (age 13–59 years, 58 male) during a visual half-field paradigm using highly-controlled pictures of cosmetic surgery patients showing disordered (negative) or healed (neutral) facial areas before or after treatment. Reference-free current source density (CSD) transformations of ERP waveforms were quantified by temporal principal components analysis (tPCA). Component scores of prominent CSD-tPCA factors sensitive to emotional content were analyzed via permutation tests and repeated measures ANOVA for mixed factorial designs with unstructured covariance matrix, including gender, age and clinical covariates. Factor-based distributed inverse solutions provided descriptive estimates of emotional brain activations at group level corresponding to hierarchical activations along ventral visual processing stream. Risk status affected emotional responsivity (increased positivity to negative-than-neutral stimuli) overlapping early N2 sink (peak latency 212 ms), P3 source (385 ms), and a late centroparietal source (630 ms). High risk individuals had reduced right-greater-than-left emotional lateralization involving occipitotemporal cortex (N2 sink) and bilaterally reduced emotional effects involving posterior cingulate (P3 source) and inferior temporal cortex (630 ms) when compared to those at low risk. While the early emotional effects were enhanced for left hemifield (right hemisphere) presentations, hemifield modulations did not differ between risk groups, suggesting top-down rather than bottom-up effects of risk. Groups did not differ in their stimulus valence or arousal ratings. Similar effects were seen for individuals with a lifetime history of depression or anxiety disorder in comparison to those without. However, there was no evidence that risk status and history of MDD or anxiety disorder interacted in their impact on emotional responsivity, suggesting largely independent attenuation of attentional resource allocation to enhance perceptual processing of motivationally salient stimuli. These findings further suggest that a deficit in motivated attention preceding conscious awareness may be a marker of risk for depression.

•

Emotional hemifield ERP task with 127 individuals at high and low family risk for MDD

•

CSD-PCA methods summarized affective modulation of late positive potential (LPP).

•

High risk and prior diagnosis of MDD or anxiety disorder independently reduced LPP.

•

Suggested hypoarousal (top-down) of right temporoparietal and other emotional regions

•

Left hemifield (bottom-up) modulations of early emotional asymmetries were preserved.