Massed and distributed repetition of natural scenes: Brain potentials and oscillatory activity

EEG correlates of static and dynamic face perception: the role of naturalistic motion

Much of our understanding of how the brain processes dynamic faces comes from research that compares static photographs to dynamic morphs, which exhibit simplified, computer-generated motion. By comparing static, video recorded, and dynamic morphed expressions, we aim to identify the neural correlates of naturalistic facial dynamism, using time-domain and time-frequency analysis. Dynamic morphs were made from the neutral and peak frames of video recorded transitions of happy and fearful expressions, which retained expression change and removed asynchronous and non-linear features of naturalistic facial motion. We found that dynamic morphs elicited increased N400 amplitudes and lower LPP amplitudes compared to other stimulus types. Video recordings elicited higher LPP amplitudes and greater frontal delta activity compared to other stimuli. Thematic analysis of participant interviews using a large language model revealed that participants found it difficult to assess the genuineness of morphed expressions, and easier to analyse the genuineness of happy compared to fearful expressions. Our findings suggest that animating real faces with artificial motion may violate expectations (N400) and reduce the social salience (LPP) of dynamic morphs. Results also suggest that delta oscillations in the frontal region may be involved with the perception of naturalistic facial motion in happy and fearful expressions. Overall, our findings highlight the sensitivity of neural mechanisms required for face perception to subtle changes in facial motion characteristics, which has important implications for neuroimaging research using faces with simplified motion.

Sustained training with novel distractors attenuates the behavioral interference of emotional pictures but does not affect the electrocortical markers of emotional processing

Introduction

Research has recently shown that behavioral interference prompted by emotional distractors is subject to habituation when the same exemplars are repeated, but promptly recovers in response to novel stimuli. The present study investigated whether prolonged experience with distractors that were all novel was effective in shaping the attentional filter, favoring stable and generalizable inhibition effects.

Methods

To test this, the impact of emotional distractors was measured before and after a sustained training phase with only novel distractor pictures, and that for a group of participants depicted only a variety of neutral contents, whereas a different group was exposed only to emotional contents.

Results

Results showed that emotional interference on reaction times was attenuated after the training phase (compared to the pre-test), but emotional distractors continued to interfere more than neutral ones in the post-test. The two groups did not differ in terms of training effect, suggesting that the distractor suppression mechanism developed during training was not sensitive to the affective category of natural scenes with which one had had experience. The affective modulation of neither the LPP or Alpha-ERD showed any effect of training.

Discussion

Altogether, these findings suggest that sustained experience with novel distractors may attenuate attention allocation toward task irrelevant emotional stimuli, but the evaluative processes and the engagement of motivational systems are always needed to support the monitoring of the environment for significant cues.

Alpha-band oscillations and emotion: A review of studies on picture perception

Although alpha-band activity has long been a focus of psychophysiological research, its modulation by emotional value during picture perception has only recently been studied systematically. Here, we review these studies and report that the most consistent alpha oscillatory pattern indexing emotional processing is an enhanced desynchronization (ERD) over posterior sensors when viewing emotional compared with neutral pictures. This enhanced alpha ERD is not specific to unpleasant picture content, as previously proposed for other measures of affective response, but has also been observed for pleasant stimuli. Evidence suggests that this effect is not confined to the alpha band but that it also involves a desynchronization of the lower beta frequencies (8-20 Hz). The emotional modulation of alpha ERD occurs even after massive stimulus repetition and when emotional cues serve as task-irrelevant distractors, consistent with the hypothesis that evaluative processes are mandatory in emotional picture processing. A similar enhanced ERD has been observed for other significant cues (e.g., conditioned aversive stimuli, or in anticipation of a potential threat), suggesting that it reflects cortical excitability associated with the engagement of the motivational systems.

Distinct Effects of Stimulus Repetition on Various Temporal Stages of Subject's Own Name Processing

The self is one of the most important concepts in psychology, which is of great significance for human survival and development. As an important self-related stimulus, the subject’s own name (SON) shows great advantages in cognitive and social processing and is widely used as an oddball stimulus in previous studies. However, it remained unknown whether the multiple repetition of stimulus would have similar influence on the neural response to SON and the other names under equal probability. In this study, adopting EEG and an equal–probability paradigm, we first detected the SON-related ERP components which could differentiate SON from other names, and then investigated how these components are influenced by repeated exposure of the stimulus. Our results showed that SON evoked an earlier SON-related negativity (SRN) at the fronto-central region and a late positive potential (LPP) at the centro-parietal region. More intriguingly, the earlier SRN demonstrated reduction after multiple repetitions, whereas LPP did not exhibit significant changes. In conclusion, these findings revealed that multiple repetitions of the stimulus might influence the various temporal stages in SON-related processing and highlighted the robustness of the late stage in this processing.

Stimulus novelty and emotionality interact in the processing of visual distractors

Novel distractors are prioritized for attentional selection. When distractors also convey emotional content, they divert attention from the primary task more than neutral stimuli do. In the present study, while participants were engaged in a central task, we examined the impact of peripheral distractors that varied for emotional content and novelty. Results showed that emotional interference on reaction times completely habituated with repetition and promptly recovered with novelty. The enhanced LPP for emotional pictures was attenuated by repetitions and, interestingly, stimulus novelty only affected emotional, but not neutral distractors, in both the RTs and LPP. Alpha-ERD was similarly reduced for repeated emotional and neutral distractors. Altogether, these findings suggest that the impact of peripheral distractors can be attenuated through a non-strategic learning mechanism mediated by mere stimulus repetition, which is fine-tuned to detect changes in emotional distractors only, supporting the hypothesis that novelty and emotion share the same motivational circuits.

Alpha-to-beta- and gamma-band activity reflect predictive coding in affective visual processing

Processing of negative affective pictures typically leads to desynchronization of alpha-to-beta frequencies (ERD) and synchronization of gamma frequencies (ERS). Given that in predictive coding higher frequencies have been associated with prediction errors, while lower frequencies have been linked to expectations, we tested the hypothesis that alpha-to-beta ERD and gamma ERS induced by aversive pictures are associated with expectations and prediction errors, respectively. We recorded EEG while volunteers were involved in a probabilistically cued affective picture task using three different negative valences to produce expectations and prediction errors. Our data show that alpha-to-beta band activity after stimulus presentation was related to the expected valence of the stimulus as predicted by a cue. The absolute mismatch of the expected and actual valence, which denotes an absolute prediction error was related to increases in alpha, beta and gamma band activity. This demonstrates that top-down predictions and bottom-up prediction errors are represented in typical spectral patterns associated with affective picture processing. This study provides direct experimental evidence that negative affective picture processing can be described by neuronal predictive coding computations.

Neural Processing of Repeated Emotional Scenes in Schizophrenia, Schizoaffective Disorder, and Bipolar Disorder

Impaired emotional processing and cognitive functioning are common in schizophrenia, schizoaffective disorder, and bipolar disorders, causing significant socioemotional disability. While a large body of research demonstrates abnormal cognition/emotion interactions in these disorders, previous studies investigating abnormalities in the emotional scene response using event-related potentials (ERPs) have yielded mixed findings, and few studies compare findings across psychiatric diagnoses. The current study investigates the effects of emotion and repetition on ERPs in a large, well-characterized sample of participants with schizophrenia-bipolar syndromes. Two ERP components that are modulated by emotional content and scene repetition, the early posterior negativity (EPN) and late positive potential (LPP), were recorded in healthy controls and participants with schizophrenia, schizoaffective disorder, bipolar disorder with psychosis, and bipolar disorder without psychosis. Effects of emotion and repetition were compared across groups. Results displayed significant but small effects in schizophrenia and schizoaffective disorder, with diminished EPN amplitudes to neutral and novel scenes, reduced LPP amplitudes to emotional scenes, and attenuated effects of scene repetition. Despite significant findings, small effect sizes indicate that emotional scene processing is predominantly intact in these disorders. Multivariate analyses indicate that these mild ERP abnormalities are related to cognition, psychosocial functioning, and psychosis severity. This relationship suggests that impaired cognition, rather than diagnosis or mood disturbance, may underlie disrupted neural scene processing in schizophrenia-bipolar syndromes.

Spatiotemporal Dynamics of Affective and Semantic Valence Among Women

As an important dimension of emotional assessment, valence can refer to affective valence reflecting an emotional response, or semantic valence reflecting knowledge about the nature of a stimulus. A previous study has used repeated exposure to separate these two similar cognitive processes. Here, for the first time, we compared the spatiotemporal dynamics of the affective and semantic modes of valence by combining event-related potentials with repeated exposure. Forty-seven female participants were assigned to the feeling-focused and semantic-focused groups and thereafter repeatedly viewed the pictures selected for the study. Self-report behavioral results showed that post-test scores were significantly lower than pre-test scores in the feeling-focused group, while the differences between the two tests were not significant in the semantic-focused group. At the neural level, N2 amplitudes decreased and early late positive potential amplitudes increased in both groups, suggesting that the participants perceived the repeated pictures more fluently and retrieved the traces of the stimulus spontaneously regardless of the valence they judged. However, the late positive potential amplitudes in anterior areas and the activity of the middle frontal gyrus were attenuated in the feeling-focused group; however, this component in posterior areas and the activity of the precentral gyrus were increased in the semantic-focused group. Therefore, the processes of affective and semantic valence are similar in the early stages of image perception and retrieval, while in the later stage of valence judgment, these processes show different brain activation patterns. The results provide electrophysiological evidence for the differences in psychological processes when judging the two modes of valence.

Specifying the neural basis of the spacing effect with multivariate ERP

The spacing effect refers to the finding that, given a fixed amount of study time, a longer interval between study repetitions improves long-term retention (e.g., Cepeda et al., 2006; Ebbinghaus, 1885/1967; Melton, 1970). Although the spacing effect is a robust and reliable finding in the memory literature, its cognitive and neural mechanisms remain unclear. We used event-related potentials (ERPs) to investigate the neural correlates of the spacing effect in the context of the study-phase retrieval hypothesis, which posits that repeated exposure of an item serves as a reminder of one's previous experience with the item, thereby promoting long-term retention. ERPs were recorded from 30 healthy young adults as they studied pairs of words under three levels of lag, corresponding to 0, 4, or 12 intervening pairs between the first and second occurrences of a target pair. We used two study-phase tasks that differed in the degree of retrieval that was required. During the test phase, participants were tested on paired-associate recall. The results demonstrated a significant effect of spacing on memory performance. However, the effect of encoding task and the interaction between encoding task and spacing were not significant. The results of the partial least squares analyses, which are not constrained by time window or electrode selection, revealed a spacing effect on the ERP data for both study-phase tasks; this effect occurred late in the epoch and was most salient over the centro-parietal scalp region. The results add to the literature on the neural correlates of the spacing effect by providing a more comprehensive account compared to past ERP findings that were focused on testing specific ERP components. They also call for further investigation on the various theoretical accounts of the spacing effect.

Novelty Manipulations, Memory Performance, and Predictive Coding: the Role of Unexpectedness

Novelty is central to the study of memory, but the wide range of experimental manipulations aimed to reveal its effects on learning produced inconsistent results. The novelty/encoding hypothesis suggests that novel information undergoes enhanced encoding and thus leads to benefits in memory, especially in recognition performance; however, recent studies cast doubts on this assumption. On the other hand, data from animal studies provided evidence on the robust effects of novelty manipulations on the neurophysiological correlates of memory processes. Conceptualizations and operationalizations of novelty are remarkably variable and were categorized into different subtypes, such as stimulus, context, associative or spatial novelty. Here, we summarize previous findings about the effects of novelty on memory and suggest that predictive coding theories provide a framework that could shed light on the differential influence of novelty manipulations on memory performance. In line with predictive coding theories, we emphasize the role of unexpectedness as a crucial property mediating the behavioral and neural effects of novelty manipulations.

Contextual Modulation of Emotional Distraction: Attentional Capture and Motivational Significance

Emotional stimuli engage corticolimbic circuits and capture attention even when they are task-irrelevant distractors. Whether top–down or contextual factors can modulate the filtering of emotional distractors is a matter of debate. Recent studies have indicated that behavioral interference by emotional distractors habituates rapidly when the same stimuli are repeated across trials. However, little is known as to whether we can attenuate the impact of novel (never repeated) emotional distractors when they occur frequently. In two experiments, we investigated the effects of distractor frequency on the processing of task-irrelevant novel pictures, as reflected in both behavioral interference and neural activity, while participants were engaged in an orientation discrimination task. Experiment 1 showed that, compared with a rare distractor condition (20%), frequent distractors (80%) reduced the interference of emotional stimuli. Moreover, Experiment 2 provided evidence that emotional interference was reduced by distractor frequency even when rare, and unexpected, emotional distractors appeared among frequent neutral distractors. On the other hand, in both experiments, the late positive potential amplitude was enhanced for emotional, compared with neutral, pictures, and this emotional modulation was not reduced when distractors were frequently presented. Altogether, these findings suggest that the high occurrence of task-irrelevant stimuli does not proactively prevent the processing of emotional distractors. Even when attention allocation to novel emotional stimuli is reduced, evaluative processes and the engagement of motivational systems are needed to support the monitoring of the environment for significant events.

Role of the hippocampus in the spacing effect during memory retrieval

It is well known that distributed learning (DL) leads to improved memory performance compared with massed learning (ML) (i.e., spacing effect). However, the extent to which the hippocampus is involved in the spacing effect at shorter and longer retention intervals remains unclear. To address this issue, two groups of participants were asked to encode face-scene pairs at 20-min, 1-day, and 1-month intervals before they were scanned using fMRI during an associative recognition task. The pairs were repeated six times in either a massed (i.e., six times in 1 day) or a distributed (i.e., six times over 3 days, twice per day) manner. The results showed that compared with that in the ML group, the activation of the left hippocampus was stronger in the DL group when the participants retrieved old pairs correctly and rejected new pairs correctly at different retention intervals. In addition, the posterior hippocampus was more strongly activated when the new associations were rejected correctly after DL than ML, especially at the 1-month interval. Hence, our results provide evidence that the hippocampus is involved in better memory performance after DL compared to ML at both shorter and longer retention intervals.

Enhanced spontaneous retrieval of cues from emotional events: An ERP study

Recent evidence points to enhanced episodic memory retrieval not only for emotional items but also for neutral information encoded in emotional contexts. However, prior research only tested instructed explicit recognition, and hence here we investigated whether memory retrieval is also heightened for cues from emotional contexts when retrieval is not explicitly probed. During the first session of a two-session experiment, neutral objects were presented on different background scenes varying in emotional and neutral contents. One week later, objects were presented again (with no background) intermixed with novel objects. In both sessions, participants were instructed to attentively watch the stimuli (free viewing procedure), and during the second session, ERPs were also collected to measure the ERP Old/New effect, an electrophysiological correlate of episodic memory retrieval. Analyses were performed using cluster-based permutation tests in order to identify reliable spatio-temporal ERP differences. Based on this approach, old relative to new objects, were associated with larger ERP positivity in an early (364-744 ms) and late time window (760-1148 ms) over distinct central electrode clusters. Interestingly, significant late ERP Old/New differences were only observed for objects previously encoded with emotional, but not neutral scenes (504 to 1144 ms). Because these ERP differences were observed in a non-instructed retrieval context, our results indicate that long-term, spontaneous retrieval for neutral objects, is particularly heightened if encoded within emotionally salient contextual information. These findings may assist in understanding mechanisms underlying spontaneous retrieval of emotional associates and the utility of ERPs to study maladaptive involuntary memories in trauma- and stress-related disorders.

Implementing Cognitive Training Into a Surgical Skill Course: A Pilot Study on Laparoscopic Suturing and Knot Tying

Mini-invasive surgery-for example, laparoscopy-has challenged surgeons' skills by extending their usual haptic space and displaying indirect visual feedback through a screen. This may require new mental abilities, including spatial orientation and mental representation. This study aimed to test the effect of cognitive training based on motor imagery (MI) and action observation (AO) on surgical skills. A total of 28 postgraduate residents in surgery took part in our study and were randomly distributed into 1 of the 3 following groups: (1) the basic surgical skill, which is a short 2-day laparoscopic course + MI + AO group; (2) the basic surgical skill group; and (3) the control group. The MI + AO group underwent additional cognitive training, whereas the basic surgical skill group performed neutral activity during the same time. The laparoscopic suturing and knot tying performance as well as spatial ability and mental workload were assessed before and after the training period. We did not observe an effect of cognitive training on the laparoscopic performance. However, the basic surgical skill group significantly improved spatial orientation performance and rated lower mental workload, whereas the 2 others exhibited lower performance in a mental rotation test. Thus, actual and cognitive training pooled together during a short training period elicited too high a strain, thus limiting potential improvements. Because MI and AO already showed positive outcomes on surgical skills, this issue may, thus, be mitigated according to our specific learning conditions. Distributed learning may possibly better divide and share the strain associated with new surgical skills learning.

Emotional Picture Perception: Repetition Effects in Free-Viewing and during an Explicit Categorization Task

Several studies have found that, despite a decrease in the overall amplitude of the late positive potential (LPP) with repeated presentation of the same picture, emotional stimuli continue to elicit a larger LPP than neutral ones. These findings seem to support the hypothesis that the affective modulation of the LPP reflects a mandatory process and does not rely on stimulus novelty. However, in these studies participants were asked to merely look at the pictures, without carrying out any additional task (free-viewing), making picture emotionality the most salient aspect of the stimulus, despite its repetition. The current study aimed to examine the impact of an explicit categorization task on the emotional processing of repeated pictures. To this purpose, ERPs to novel and repeated pictures were measured during free-viewing as well as during an explicit categorization task, where the emotional content of the pictures was task-irrelevant. The within-subject comparison between the free-viewing and task context revealed that the overall LPP habituated more rapidly in the free-viewing condition, but, more importantly, the LPP affective modulation was unaffected by task requirements during both novel and repeated presentations. These results suggest that the affective modulation of the LPP reflects an automatic engagement of cortico-limbic motivational systems, which continues to take place regardless of stimulus novelty and task context.

Benefits and Costs of Context Reinstatement in Episodic Memory: An ERP Study

This study investigated context-dependent episodic memory retrieval. An influential idea in the memory literature is that performance benefits when the retrieval context overlaps with the original encoding context. However, such memory facilitation may not be driven by the encoding-retrieval overlap per se but by the presence of diagnostic features in the reinstated context that discriminate the target episode from competing episodes. To test this prediction, the encoding-retrieval overlap and the diagnostic value of the context were manipulated in a novel associative recognition memory task. Participants were asked to memorize word pairs presented together with diagnostic (unique) and nondiagnostic (shared) background scenes. At test, participants recognized the word pairs in the presence and absence of the previously encoded contexts. Behavioral data show facilitated memory performance in the presence of the original context but, importantly, only when the context was diagnostic of the target episode. The electrophysiological data reveal an early anterior ERP encoding-retrieval overlap effect that tracks the cost associated with having nondiagnostic contexts present at retrieval, that is, shared by multiple previous episodes, and a later posterior encoding-retrieval overlap effect that reflects facilitated access to the target episode during retrieval in diagnostic contexts. Taken together, our results underscore the importance of the diagnostic value of the context and suggest that context-dependent episodic memory effects are multiple determined.

Repetition and ERPs during emotional scene processing: A selective review

A set of studies are reviewed that investigate the effects of repetition during scene perception on event-related potentials, elucidating perceptual, memory and emotional processes. Repetition suppression was consistently found for the amplitude of early frontal N2 and posterior P2 components, which was greatly enhanced for massed, compared to distributed, repetition. Both repetition suppression and enhancement of the amplitude of a centro-parietal positive potential (LPP) were found in specific contexts. Suppression was reliably found following a massive number of repetitions of few items, whereas enhancement is found when repetitions are spaced; enhancement was apparent both during simple free viewing as well as on an explicit recognition test. Regardless of repetition, an enhanced LPP was always found for emotional, compared to neutral, scenes. Taken together, the data suggest that different effects of massed and distributed repetitions on specific ERP components index perceptual priming, habituation, and spontaneous episodic retrieval.

Evaluative ratings and attention across the life span: emotional arousal and gender

This study was designed to investigate the evolution of emotional processing over the whole adult life span as a function of stimulus arousal and participants' gender. To this end, self-reported affective evaluation and attentional capture prompted by pleasant and unpleasant pictures varying in arousal were measured in a large sample of participants (n = 211) balanced by gender and equally spread across seven decades from 20 to 90 years. Results showed age differences only for affective evaluation of pleasant stimuli, with opposite patterns depending on stimulus arousal. As age increased, low-arousing pleasant cues (e.g. images of babies) were experienced as more pleasant and arousing by both males and females, whereas high-arousing stimuli (e.g. erotic images) were experienced as less pleasant only by females. In contrast, emotional pictures (both pleasant and unpleasant) were effective at capturing attention in a similar way across participants, regardless of age and gender. Taken together, these findings suggest that specific emotional cues prompt different subjective responses across different age groups, while basic mechanisms involved in attentional engagement towards both pleasant and unpleasant stimuli are preserved in healthy ageing.

Imaging distributed and massed repetitions of natural scenes: spontaneous retrieval and maintenance

Repetitions that are distributed (spaced) across time prompt enhancement of a memory-related event-related potential, compared to when repetitions are massed (contiguous). Here, we used fMRI to investigate neural enhancement and suppression effects during free viewing of natural scenes that were either novel or repeated four times with massed or distributed repetitions. Distributed repetition was uniquely associated with a repetition enhancement effect in a bilateral posterior parietal cluster that included the precuneus and posterior cingulate and which has previously been implicated in episodic memory retrieval. Unique to massed repetition, conversely, was enhancement in a right dorsolateral prefrontal cluster that has been implicated in short-term maintenance. Repetition suppression effects for both types of spacing were widespread in regions activated during novel picture processing. Taken together, the data are consistent with a hypothesis that distributed repetition prompts spontaneous retrieval of prior occurrences, whereas massed repetition prompts short-term maintenance of the episodic representation, due to contiguous presentation. These processing differences may mediate the classic spacing effect in learning and memory.