Early prefrontal brain responses to the Hedonic quality of emotional words--a simultaneous EEG and MEG study

Attentional tuning of valent word forms

Using event-related brain potentials (ERPs), we tested the hypothesis of valent word forms (Kissler et al., 2006, Prog Brain Res) stating that the mere visual shapes of emotional words acquire valence through numerous co-occurrences with affective activation over an experienced reader's life. Thereby, associations between neuronal representations of visual word forms and affect are strengthened. If so, selective attention to a specific level of the valence of single visual words should not only pre-activate neuronal representations of that level of valence, but this activation should also spread to the associated word forms. This should improve their processing and/or affective discrimination. In a valence-detection task, N = 53 participants made speeded responses only to words of the current target level of valence (negative, neutral, or positive), which varied across separate blocks. We focused on posterior visual P1 and N170 components, two well-established ERP markers of low-level and structural word form processing, respectively. P1 increased from negative over neutral to positive words; this effect was stronger in target compared to nontarget words. N170 was larger for emotional compared to neutral target words, whereas nontarget words showed a strong reverse pattern. The P1 effect for target words and the N170 effect for nontarget words both were driven by good task performers in terms of fast hit responses. Results support the idea of valent word forms that can be tuned by selective attention to valence, which implies both, facilitated affective discrimination and processing of target words, and inhibition of the processing of nontarget words.

What Do You Want to Eat? Influence of Menu Description and Design on Consumer's Mind: An fMRI Study

The main objective of this research was to analyse the active regions when processing dishes with a pleasant (vs. unpleasant) design and the effect of the previously read rational (vs. emotional) description when visualising the dish. The functional magnetic resonance image technique was used for the study. The results showed that participants who visualised pleasant vs. unpleasant dishes became active in several domains (e.g., attention, cognition and reward). On the other side, visualisation of unpleasant dishes activated stronger regions linked to inhibition, rejection, and related ambiguity. We found that subjects who read rational descriptions when visualising pleasant dishes activated regions related to congruence integration, while subjects who visualised emotional descriptions showed an increased neuronal response to pleasant dishes in the regions related to memory, emotion and congruence.

From structure to concepts: The two stages of facial expression recognition

Facial expressions are the dominant way of human emotional and social communications. However, it remains unclear that how can perceivers extract emotion from the face. In the present study, we adopted a repetition-priming paradigm in combine with event-related potentials (ERP) to examine neurocognitive processing stages of facial expression perception. Results showed that emotional words were recognized faster than emotional faces, when both of which were primed by emotional faces, indicating the involvement of concepts processes in facial expression recognition. ERP results showed that all emotional faces could evoke responses of N170, while there was no significant difference between positive and negative emotional faces, suggesting that geometrical configurations of faces rather than emotional concepts of faces are processed at the stage of N170. In contrast, both emotional words and faces showed larger P2 in response to anger than happiness, which suggests that emotional concepts are extracted from faces at the stage of P2. To examine the underlying dynamic causal connectivity between facial structure and emotional conception, we conducted information flow analysis, which showed significant decreases of information flow from the fusiform gyrus to dorsal anterior cingulate cortex/dorsal medial prefrontal cortex and increases of information flow from the fusiform gyrus to posterior insula. These results revealed neural mechanisms underlying processes from physical structure to emotional concepts. Our findings suggest that facial expression recognition consists of two stages from geometrical structure of faces to emotional concepts of facial expressions, which provides evidence for facial expression processing and has important implications in the diagnosis and treatment of emotion recognition related disorders.

Attending to Eliza: rapid brain responses reflect competence attribution in virtual social feedback processing

In the age of virtual communication, the source of a message is often inferred rather than perceived, raising the question of how sender attributions affect content processing. We investigated this issue in an evaluative feedback scenario. Participants were told that an expert psychotherapist, a layperson or a randomly acting computer was going to give them online positive, neutral or negative personality feedback while high-density EEG was recorded. Sender attribution affected processing rapidly, even though the feedback was on average identical. Event-related potentials revealed a linear increase with attributed expertise beginning 150 ms after disclosure and most pronounced for N1, P2 and early posterior negativity components. P3 and late positive potential amplitudes were increased for both human senders and for emotionally significant (positive or negative) feedback. Strikingly, feedback from a putative expert prompted large P3 responses, even for inherently neutral content. Source analysis localized early enhancements due to attributed sender expertise in frontal and somatosensory regions and later responses in the posterior cingulate and extended visual and parietal areas, supporting involvement of mentalizing, embodied processing and socially motivated attention. These findings reveal how attributed sender expertise rapidly alters feedback processing in virtual interaction and have implications for virtual therapy and online communication.

Repeated noninvasive stimulation of the ventromedial prefrontal cortex reveals cumulative amplification of pleasant compared to unpleasant scene processing: A single subject pilot study

The ventromedial prefrontal cortex (vmPFC) is a major hub of the reward system and has been shown to activate specifically in response to pleasant / rewarding stimuli. Previous studies demonstrate enhanced pleasant cue reactivity after single applications of transcranial direct current stimulation (tDCS) to the vmPFC. Here we present a pilot case study in which we assess the cumulative impact of multiple consecutive vmPFC-tDCS sessions on the processing of visual emotional stimuli in an event-related MEG recording design. The results point to stable modulation of increased positivity biases (pleasant > unpleasant stimulus signal strength) after excitatory vmPFC stimulation and a reversed pattern (pleasant < unpleasant) after inhibitory stimulation across five consecutive tDCS sessions. Moreover, cumulative effects of these emotional bias modulations were observable for several source-localized spatio-temporal clusters, suggesting an increase in modulatory efficiency by repeated tDCS sessions. This pilot study provides evidence for improvements in the effectiveness and utility of a novel tDCS paradigm in the context of emotional processing.

Spatiotemporal pattern of appraising social and emotional relevance: Evidence from event-related brain potentials

Social information is particularly relevant for the human species because of its direct link to guiding physiological responses and behavior. Accordingly, extant functional magnetic resonance imaging (fMRI) data suggest that social content may form a unique stimulus dimension. It remains largely unknown, however, how neural activity underlying social (versus nonsocial) information processing temporally unfolds, and how such social information appraisal may interact with the processing of other stimulus characteristics, particularly emotional meaning. Here, we presented complex visual scenes differing in both social (vs. nonsocial) and emotional relevance (positive, negative, neutral) intermixed with scrambled versions of these pictures to N = 24 healthy young adults. Event-related brain potentials (ERPs) to intact pictures were examined for gaining insight to the dynamics of appraisal of both dimensions, implemented within the brain. Our main finding is an early interaction between social and emotional relevance due to enhanced amplitudes of early ERP components to emotionally positive and neutral pictures of social compared to nonsocial content, presumably reflecting rapid allocation of attention and counteracting an overall negativity bias. Importantly, our ERP data show high similarity with previously observed fMRI data using the same stimuli, and source estimations located the ERP effects in overlapping occipitotemporal brain areas. Our novel data suggest that relevance detection may occur already as early as around 100 ms after stimulus onset and may combine relevance checks not only examining intrinsic pleasantness/emotional valence but also social content as a unique, highly relevant stimulus dimension.

Noninvasive Stimulation of the Ventromedial Prefrontal Cortex Indicates Valence Ambiguity in Sad Compared to Happy and Fearful Face Processing

The ventromedial prefrontal cortex (vmPFC) is known to be specifically involved in the processing of stimuli with pleasant, rewarding meaning to the observer. By the use of non-invasive transcranial direct current stimulation (tDCS), it was previously possible to show evidence for this valence specificity and to modulate the impact of the vmPFC on emotional network processing. Prior results showed increased neural activation during pleasant relative to unpleasant stimulus processing after excitatory compared to inhibitory vmPFC-tDCS. As dysfunctional vmPFC activation patterns are associated with major depressive disorder (MDD), tDCS of this region could render an attractive application in future therapy. Here, we investigated vmPFC-tDCS effects on sad compared to happy face processing, as sad faces are often used in the study of mood disorders. After counterbalanced inhibitory or excitatory tDCS, respectively, healthy participants viewed happy and sad faces during magnetoencephalography (MEG) recording. In addition, tDCS effects on an interpretational bias of ambiguous happy-sad face morphs and an attentional bias of a dot-probe task with happy and sad faces as emotional primes were investigated. Finally, in conjoint analyses with data from a previous sibling study (happy and fearful faces) we examined whether excitatory vmPFC-tDCS would reveal a general increase in processing of pleasant stimuli independent of the type of unpleasant stimuli applied (sad vs. fearful faces). MEG and behavioral results showed that happy faces promoted a relative positivity bias after excitatory compared to inhibitory tDCS, visible in left orbitofrontal cortex and in the emotion-primed dot-probe task. A converse pattern in the MEG data during sad face processing suggests the possible involvement of an empathy network and thus significantly differed from neuronal processing of fearful face processing. Implications for the bearing of vmPFC modulation on emotional face processing and the impact of specific unpleasant face expressions are discussed.

Emotion in Context: How Sender Predictability and Identity Affect Processing of Words as Imminent Personality Feedback

Recent findings suggest that communicative context affects the timing and magnitude of emotion effects in word processing. In particular, social attributions seem to be one important source of plasticity for the processing of affectively charged language. Here, we investigate the timing and magnitude of ERP responses toward positive, neutral, and negative trait adjectives during the anticipation of putative socio-evaluative feedback from different senders (human and computer) varying in predictability. In the first experiment, during word presentation participants could not anticipate whether a human or a randomly acting computer sender was about to give feedback. Here, a main effect of emotion was observed only on the late positive potential (LPP), showing larger amplitudes for positive compared to neutral adjectives. In the second study the same stimuli and set-up were used, but a block-wise presentation was realized, resulting in fixed and fully predictable sender identity. Feedback was supposedly given by an expert (psychotherapist), a layperson (unknown human), and again by a randomly acting computer. Main effects of emotion started with an increased P1 for negative adjectives, followed by effects at the N1 and early posterior negativity (EPN), showing both largest amplitudes for positive words, as well as for the LPP, where positive and negative words elicited larger amplitudes than neutral words. An interaction revealed that emotional LPP modulations occurred only for a human sender. Finally, regardless of content, anticipating human feedback led to larger P1 and P3 components, being highest for the putative expert. These findings demonstrate the malleability of emotional language processing by social contexts. When clear predictions can be made, our brains rapidly differentiate between emotional and neutral information, as well as between different senders. Attributed human presence affects emotional language processing already during feedback anticipation, in line with a selective gating of attentional resources via anticipatory social significance attributions. By contrast, emotion effects occur much later, when crucial social context information is still missing. These findings demonstrate the context-dependence of emotion effects in word processing and are particularly relevant since virtual communication with unknown senders, whose identity is inferred rather than perceived, has become reality for millions of people.

How the Dorsolateral Prefrontal Cortex Controls Affective Processing in Absence of Visual Awareness - Insights From a Combined EEG-rTMS Study

The dorsolateral prefrontal cortex (DLPFC) plays a key role in the modulation of affective processing. However, its specific role in the regulation of neurocognitive processes underlying the interplay of affective perception and visual awareness has remained largely unclear. Using a mixed factorial design, this study investigated effects of inhibitory continuous theta-burst stimulation (cTBS) of the right DLPFC (rDLPFC) compared to an Active Control condition on behavioral (N = 48) and electroencephalographic (N = 38) correlates of affective processing in healthy Chinese participants. Event-related potentials (ERPs) in response to passively viewed subliminal and supraliminal negative and neutral natural scenes were recorded before and after cTBS application. We applied minimum-norm approaches to estimate the corresponding neuronal sources. On a behavioral level, we found evidence for reduced emotional interference by, and less negative and aroused ratings of negative supraliminal stimuli following rDLPFC inhibition. We found no evidence for stimulation effects on self-reported mood or the behavioral discrimination of subliminal stimuli. On a neurophysiological level, rDLPFC inhibition relatively enhanced occipito-parietal brain activity for both subliminal and supraliminal negative compared to neutral images (112–268 ms; 320–380 ms). The early onset and localization of these effects suggests that rDLPFC inhibition boosts automatic processes of “emotional attention” independently of visual awareness. Further, our study reveals the first available evidence for a differential influence of rDLPFC inhibition on subliminal versus supraliminal neural emotion processing. Explicitly, our findings indicate that rDLPFC inhibition selectively enhances late (292–360 ms) activity in response to supraliminal negative images. We tentatively suggest that this differential frontal activity likely reflects enhanced awareness-dependent down-regulation of negative scene processing, eventually leading to facilitated disengagement from and less negative and aroused evaluations of negative supraliminal stimuli.

A paradox of apparent brainless behavior: The time-course of compound word recognition

A review of the behavioral and neurophysiological estimates of the time-course of compound word recognition brings to light a paradox whereby temporal activity associated with lexical variables in behavioral studies predates temporal activity of seemingly comparable lexical processing in neuroimaging studies. However, under the assumption that brain activity is a cause of behavior, the earliest reliable behavioral effect of a lexical variable must represent an upper temporal bound for the origin of that effect in the neural record. The present research provides these behavioral bounds for lexical variables involved in compound word processing. We report data from five naturalistic reading studies in which participants read sentences containing English compound words, and apply a distributional technique of survival analysis to resulting eye-movement fixation durations (Reingold & Sheridan, 2014). The results of the survival analysis of the eye-movement record place a majority of the earliest discernible onsets of orthographic, morphological, and semantic effects at less than 200 ms (with a range of 138-269 ms). Our results place constraints on the absolute time-course of effects reported in the neurolinguistic literature, and support theories of complex word recognition which posit early simultaneous access of form and meaning.

Electrophysiological correlates of the interplay between low-level visual features and emotional content during word reading

Processing affectively charged visual stimuli typically results in increased amplitude of specific event-related potential (ERP) components. Low-level features similarly modulate electrophysiological responses, with amplitude changes proportional to variations in stimulus size and contrast. However, it remains unclear whether emotion-related amplifications during visual word processing are necessarily intertwined with changes in specific low-level features or, instead, may act independently. In this pre-registered electrophysiological study, we varied font size and contrast of neutral and negative words while participants were monitoring their semantic content. We examined ERP responses associated with early sensory and attentional processes as well as later stages of stimulus processing. Results showed amplitude modulations by low-level visual features early on following stimulus onset - i.e., P1 and N1 components -, while the LPP was independently modulated by these visual features. Independent effects of size and emotion were observed only at the level of the EPN. Here, larger EPN amplitudes for negative were observed only for small high contrast and large low contrast words. These results suggest that early increase in sensory processing at the EPN level for negative words is not automatic, but bound to specific combinations of low-level features, occurring presumably via attentional control processes.

Neuronal Correlates of Product Feature Attractiveness

Decision-making is the process of selecting a logical choice from among the available options and happens as a complex process in the human brain. It is based on information processing and cost-analysis; it involves psychological factors, specifically, emotions. In addition to cost factors personal preferences have significant influence on decision making. For marketing purposes, it is interesting to know how these emotions are related to product acquisition decision and how to improve these products according to the user's preferences. For our proof-of-concept study, we use magneto- and electro-encephalography (MEG, EEG) to evaluate the very early reactions in the brain related to the emotions. Recordings from these methods are comprehensive sources of information to investigate neural processes of the human brain with good spatial- and excellent temporal resolution. Those characteristics make these methods suitable to examine the neurologic process that gives origin to human behavior and specifically, decision making. Literature describes some neuronal correlates for individual preferences, like asymmetrical distribution of frequency specific activity in frontal and prefrontal areas, which are associated with emotional processing. Such correlates could be used to objectively evaluate the pleasantness of product appearance and branding (i.e., logo), thus avoiding subjective bias. This study evaluates the effects of different product features on brain activity and whether these methods could potentially be used for marketing and product design. We analyzed the influence of color and fit of sports shirts, as well as a brand logo on the brain activity, specifically in frontal asymmetric activation. Measurements were performed using MEG and EEG with 10 healthy subjects. Images of t-shirts with different characteristics were presented on a screen. We recorded the subjective evaluation by asking for a positive, negative or neutral rating. The results showed significantly different responses between positively and negatively rated shirts. While the influence of the presence of a logo was present in behavioral data, but not in the neurocognitive data, the influence of shirt fit and color could be reconstructed in both data sets. This method may enable evaluation of subjective product preference.

Auditory attention enhances processing of positive and negative words in inferior and superior prefrontal cortex

Visually presented emotional words are processed preferentially and effects of emotional content are similar to those of explicit attention deployment in that both amplify visual processing. However, auditory processing of emotional words is less well characterized and interactions between emotional content and task-induced attention have not been fully understood. Here, we investigate auditory processing of emotional words, focussing on how auditory attention to positive and negative words impacts their cerebral processing. A Functional magnetic resonance imaging (fMRI) study manipulating word valence and attention allocation was performed. Participants heard negative, positive and neutral words to which they either listened passively or attended by counting negative or positive words, respectively. Regardless of valence, active processing compared to passive listening increased activity in primary auditory cortex, left intraparietal sulcus, and right superior frontal gyrus (SFG). The attended valence elicited stronger activity in left inferior frontal gyrus (IFG) and left SFG, in line with these regions' role in semantic retrieval and evaluative processing. No evidence for valence-specific attentional modulation in auditory regions or distinct valence-specific regional activations (i.e., negative > positive or positive > negative) was obtained. Thus, allocation of auditory attention to positive and negative words can substantially increase their processing in higher-order language and evaluative brain areas without modulating early stages of auditory processing. Inferior and superior frontal brain structures mediate interactions between emotional content, attention, and working memory when prosodically neutral speech is processed.

Multi-modal causality analysis of eyes-open and eyes-closed data from simultaneously recorded EEG and MEG

Owing to the recent advances in multi-modal data analysis, the aim of the present study was to analyze the functional network of the brain which remained the same during the eyes-open (EO) and eyes-closed (EC) resting task. The simultaneously recorded electroencephalogram (EEG) and magnetoencephalogram (MEG) were used for this study, recorded from five distinct cortical regions of the brain. We focused on the 'alpha' functional network, corresponding to the individual peak frequency in the alpha band. The total data set of 120 seconds was divided into three segments of 18 seconds each, taken from start, middle, and end of the recording. This segmentation allowed us to analyze the evolution of the underlying functional network. The method of time-resolved partial directed coherence (tPDC) was used to assess the causality. This method allowed us to focus on the individual peak frequency in the 'alpha' band (7-13 Hz). Because of the significantly higher power in the recorded EEG in comparison to MEG, at the individual peak frequency of the alpha band, results rely only on EEG. The MEG was used only for comparison. Our results show that different regions of the brain start to `disconnect' from one another over the course of time. The driving signals, along with the feedback signals between different cortical regions start to recede over time. This shows that, with the course of rest, brain regions reduce communication with each another.

Brief learning induces a memory bias for arousing-negative words: an fMRI study in high and low trait anxious persons

Persons suffering from anxiety disorders display facilitated processing of arousing and negative stimuli, such as negative words. This memory bias is reflected in better recall and increased amygdala activity in response to such stimuli. However, individual learning histories were not considered in most studies, a concern that we meet here. Thirty-four female persons (half with high-, half with low trait anxiety) participated in a criterion-based associative word-learning paradigm, in which neutral pseudowords were paired with aversive or neutral pictures, which should lead to a valence change for the negatively paired pseudowords. After learning, pseudowords were tested with fMRI to investigate differential brain activation of the amygdala evoked by the newly acquired valence. Explicit and implicit memory was assessed directly after training and in three follow-ups at 4-day intervals. The behavioral results demonstrate that associative word-learning leads to an explicit (but no implicit) memory bias for negatively linked pseudowords, relative to neutral ones, which confirms earlier studies. Bilateral amygdala activation underlines the behavioral effect: Higher trait anxiety is correlated with stronger amygdala activation for negatively linked pseudowords than for neutrally linked ones. Most interestingly, this effect is also present for negatively paired pseudowords that participants could not remember well. Moreover, neutrally paired pseudowords evoked higher amygdala reactivity than completely novel ones in highly anxious persons, which can be taken as evidence for generalization. These findings demonstrate that few word-learning trials generate a memory bias for emotional stimuli, indexed both behaviorally and neurophysiologically. Importantly, the typical memory bias for emotional stimuli and the generalization to neutral ones is larger in high anxious persons.

Evaluative conditioning of positive and negative valence affects P1 and N1 in verbal processing

The present study examined the effect of contextual learning on the neural processing of previously meaningless pseudowords. During an evaluative conditioning session on 5 consecutive days, participants learned to associate 120 pseudowords with either positive, neutral or negative pictures. In a second session, participants were presented all conditioned pseudowords again together with 40 new pseudowords in a recognition memory task while their event-related potentials (ERPs) were recorded. The behavioral data confirm successful learning of pseudoword valence. At the neural level, early modulations of the ERPs are visible at the P1 and the N1 components discriminating between positively and negatively conditioned pseudowords. Differences to new pseudowords were visible at later processing stages as indicated by modulations of the LPC. These results support a contextual learning hypothesis that is able to explain very early emotional ERP modulations in visual word recognition. Source localization indicates a role of medial-frontal brain regions as a likely origin of these early valence discrimination signals which are discussed to promote top-down signals to sensory processing.

Neural correlates of an early attentional capture by positive distractor words

Exogenous or automatic attention to emotional distractors has been observed for emotional scenes and faces. In the language domain, however, automatic attention capture by emotional words has been scarcely investigated. In the current event-related potentials study we explored distractor effects elicited by positive, negative and neutral words in a concurrent but distinct target distractor paradigm. Specifically, participants performed a digit categorization task in which task-irrelevant words were flanked by numbers. The results of both temporo-spatial principal component and source location analyses revealed the existence of early distractor effects that were specifically triggered by positive words. At the scalp level, task-irrelevant positive compared to neutral and negative words elicited larger amplitudes in an anterior negative component that peaked around 120 ms. Also, at the voxel level, positive distractor words increased activity in orbitofrontal regions compared to negative words. These results suggest that positive distractor words quickly and automatically capture attentional resources diverting them from the task where attention was voluntarily directed.

Magnetoencephalographic evidence of early right hemisphere overactivation during metaphor comprehension in schizophrenia

Whereas language processing in neurotypical brains is left lateralized, individuals with schizophrenia (SZ) display a bilateral or reversed pattern of lateralization. We used MEG to investigate the implications of this atypicality on fine (left hemisphere) versus coarse (right hemisphere) semantic processing. Ten SZ and 14 controls were presented with fine (conventional metaphor, literal, and unrelated expressions) and coarse (novel metaphor) linguistic stimuli. Results showed greater activation of the right hemisphere for novel metaphors and greater bilateral activation for unrelated expressions at the M170 window in SZ. Moreover, at the M350, SZ showed reduced bilateral activation. We conclude that SZ are overreliant on early-stage coarse semantic processing. As a result, they jump too quickly to remote conclusions, with limited control over the meanings they form. This may explain one of the core symptoms of the disorder-loose associations.

Brain activation to briefly presented emotional words: effects of stimulus awareness

It is unknown to what extent briefly presented emotional words can be processed without awareness. By means of two independent functional magnetic resonance imaging studies, using either a block or an event-related design, we investigated brain activation to very briefly presented threat related and neutral words during two backward masking conditions (with and without gap between target and mask). In both experiments, emotional words were perceived during the supraliminal "with gap" condition, but they were not recognized during the subliminal "without gap" condition, as indicated by signal detection theory analysis. Imaging results of both experiments showed increased activation of the amygdala, the medial prefrontal cortex and language-processing cortical areas to negative versus neutral words during supraliminal but not subliminal conditions. These results suggest that even very briefly presented emotional words are capable of triggering increased cortical and subcortical processing; however, only when awareness of these stimuli is given.

All in its proper time: monitoring the emergence of a memory bias for novel, arousing-negative words in individuals with high and low trait anxiety

The well-established memory bias for arousing-negative stimuli seems to be enhanced in high trait-anxious persons and persons suffering from anxiety disorders. We monitored the emergence and development of such a bias during and after learning, in high and low trait anxious participants. A word-learning paradigm was applied, consisting of spoken pseudowords paired either with arousing-negative or neutral pictures. Learning performance during training evidenced a short-lived advantage for arousing-negative associated words, which was not present at the end of training. Cued recall and valence ratings revealed a memory bias for pseudowords that had been paired with arousing-negative pictures, immediately after learning and two weeks later. This held even for items that were not explicitly remembered. High anxious individuals evidenced a stronger memory bias in the cued-recall test, and their ratings were also more negative overall compared to low anxious persons. Both effects were evident, even when explicit recall was controlled for. Regarding the memory bias in anxiety prone persons, explicit memory seems to play a more crucial role than implicit memory. The study stresses the need for several time points of bias measurement during the course of learning and retrieval, as well as the employment of different measures for learning success.