Processing of masked and unmasked emotional faces under different attentional conditions: an electrophysiological investigation

Attention modulates facial expression processing in subsyndromal depression: A behavioral and ERP study

Impaired facial expression perception is a core element in depression, but the underlying mechanism remains controversial. This event-related potential study investigated how attention modulates facial expression perception in depression using a nonclinical sample. A group of healthy controls (HC, N = 39) and a group of individuals with subsyndromal depression (SD, N = 39) categorized faces based on either facial expression (happy vs. sad) or gender (male vs. female). Behaviorally, the SD group was less sensitive to the emotional valence of facial expression than the HC group when their attention was directed to facial expression, as revealed by comparable subjective ratings and accuracy rates in response to facial expressions. When attention was directed towards facial gender, the SD group versus the HC group showed a negative bias, as revealed by a faster N170 for sad faces than happy faces. Together, our findings suggest that attention plays a role in understanding the relationship between depression and facial expression perception.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Fixation-related electrical potentials during a free visual search task reveal the timing of visual awareness

It has been repeatedly claimed that emotional faces readily capture attention, and that they may be processed without awareness. Yet some observations cast doubt on these assertions. Part of the problem may lie in the experimental paradigms employed. Here, we used a free viewing visual search task during electroencephalographic recordings, where participants searched for either fearful or neutral facial expressions among distractor expressions. Fixation-related potentials were computed for fearful and neutral targets and the response compared for stimuli consciously reported or not. We showed that awareness was associated with an electrophysiological negativity starting at around 110 ms, while emotional expressions were distinguished on the N170 and early posterior negativity only when stimuli were consciously reported. These results suggest that during unconstrained visual search, the earliest electrical correlate of awareness may emerge as early as 110 ms, and fixating at an emotional face without reporting it may not produce any unconscious processing.

Attentional capture by fearful faces requires consciousness and is modulated by task-relevancy: A dot-probe EEG study

In the current EEG study, we used a dot-probe task in conjunction with backward masking to examine the neural activity underlying awareness and spatial processing of fearful faces and the neural processes for subsequent cued spatial targets. We presented face images under different viewing conditions (subliminal and supraliminal) and manipulated the relation between a fearful face in the pair and a subsequent target. Our mass univariate analysis showed that fearful faces elicit the N2-posterior-contralateral, indexing spatial attention capture, only when they are presented supraliminally. Consistent with this, the multivariate pattern analysis revealed a successful decoding of the location of the fearful face only in the supraliminal viewing condition. Additionally, the spatial attention capture by fearful faces modulated the processing of subsequent lateralised targets that were spatially congruent with the fearful face, in both al and electrophysiological data. There was no evidence for nonconscious processing of the fearful faces in the current paradigm. We conclude that spatial attentional capture by fearful faces requires visual awareness and it is modulated by top-down task demands.

Exogenous Attention to Emotional Stimuli Presenting Realistic (3D) Looming Motion

Previous research shows that dynamic stimuli, on the one hand, and emotional stimuli, on the other, capture exogenous attention due to their biological relevance. Through neural (ERPs) and behavioral measures (reaction times and errors), the present study explored the combined effect of looming motion and emotional content on attentional capture. To this end, 3D-recreated static and dynamic animals assessed as emotional (positive or negative) or neutral were presented as distractors while 71 volunteers performed a line orientation task. We observed a two-phase effect: firstly (before 300 ms), early components of ERPs (P1p and N2po) showed enhanced exogenous attentional capture by looming positive distractors and static threatening animals. Thereafter, dynamic and static threatening distractors received enhanced endogenous attention as revealed by both late ERP activity (LPC) and behavioral (errors) responses. These effects are likely explained by both the emotional valence and the distance of the stimulus at each moment.

The Effects of Spatial Attention Focus and Visual Awareness on the Processing of Fearful Faces: An ERP Study

Previous research on the relationship between attention and emotion processing have focused essentially on consciously-viewed, supraliminal stimuli, while the attention-emotion interplay remains unexplored in situations where visual awareness is restricted. Here, we presented participants with face pairs in a backward masking paradigm and examined the electrophysiological activity in response to fearful and neutral expressions under different conditions of attention (spatially attended vs. unattended) and stimulus visibility (subliminal vs. supraliminal). We found an enhanced N2 (visual awareness negativity -VAN-) and an enhanced P3 for supraliminal compared to subliminal faces. The VAN, indexing the early perceptual awareness, was enhanced when the faces were spatially attended compared to when they were unattended, showing that the VAN does not require spatial attention focus but can be enhanced by it. Fearful relative to neutral expressions enhanced the early neural activity (N2) regardless of spatial attention but only in the supraliminal viewing condition. However, fear-related enhancements on later neural activity (P3) were found when stimuli were both attended and presented supraliminally. These findings suggest that visual awareness is needed for emotion processing during both early and late stages. Spatial attention is required for emotion processing at the later stage but not at the early stage.

Neural activities during the Processing of unattended and unseen emotional faces: a voxel-wise Meta-analysis

Voxel-wise meta-analyses of task-evoked regional activity were conducted for healthy individuals during the unconscious processing of emotional and neutral faces with an aim to examine whether and how different experimental paradigms influenced brain activation patterns. Studies were categorized into sensory and attentional unawareness paradigms. Thirty-four fMRI studies including 883 healthy participants were identified. Across experimental paradigms, unaware emotional faces elicited stronger activation of the limbic system, striatum, inferior frontal gyrus, insula and the temporal lobe, compared to unaware neutral faces. Crucially, in attentional unawareness paradigms, unattended emotional faces elicited a right-lateralized increased activation (i.e., right amygdala, right temporal pole), suggesting a right hemisphere dominance for processing emotional faces during inattention. By contrast, in sensory unawareness paradigms, unseen emotional faces elicited increased activation of the left striatum, the left amygdala and the right middle temporal gyrus. Additionally, across paradigms, unconsciously processed positive emotions were found associated with more activation in temporal and parietal cortices whereas unconsciously processed negative emotions elicited stronger activation in subcortical regions, compared to neutral faces.

Fast Unconscious Processing of Emotional Stimuli in Early Stages of the Visual Cortex

Several cortical and subcortical brain areas have been reported to be sensitive to the emotional content of subliminal stimuli. However, the timing of these activations remains unclear. Our scope was to detect the earliest cortical traces of emotional unconscious processing of visual stimuli by recording event-related potentials (ERPs) from 43 participants. Subliminal spiders (emotional) and wheels (neutral), sharing similar low-level visual parameters, were presented at two different locations (fixation and periphery). The differential (peak-to-peak) amplitude from CP1 (77 ms from stimulus onset) to C2 (100 ms), two early visual ERP components originated in V1/V2 according to source localization analyses, was analyzed via Bayesian and traditional frequentist analyses. Spiders elicited greater CP1–C2 amplitudes than wheels when presented at fixation. This fast effect of subliminal stimulation—not reported previously to the best of our knowledge—has implications in several debates: 1) The amygdala cannot be mediating these effects, 2) latency of other evaluative structures recently proposed, such as the visual thalamus, is compatible with these results, 3) the absence of peripheral stimuli effects points to a relevant role of the parvocellular visual system in unconscious processing.

Emotional face processing correlates with depression/anxiety symptoms but not wellbeing in non-clinical adults: An event-related potential study

Whilst alterations in emotional face processing, as indicated by event-related potentials (ERPs), are associated with depression and anxiety symptoms in clinical and non-clinical samples, it has remained unclear whether they are related to mental wellbeing. The current study aimed to address this question in a non-clinical sample. The analysis included 402 adult twins from the TWIN-E study. The COMPAS-W and the Depression Anxiety Stress Scale (DASS-42) were used to measure mental wellbeing and depression/anxiety symptoms, respectively. Participants viewed facial expressions under Unmasked (conscious) and Masked (subliminal) conditions while ERPs were recorded. The associations of emotion processing with mental wellbeing and depression/anxiety symptoms were assessed using multivariate linear mixed models. There was a strong association between depression/anxiety symptoms and the N170 amplitude difference for the Fear - Happy contrast in the Masked condition after controlling for wellbeing scores (B = 0.34, p < .001). Specifically, higher depression/anxiety symptoms were associated with a lack of differentiation between fearful and happy faces. No associations were found between emotional face processing and mental wellbeing scores. These results indicate that even within a non-clinical sample, alterations in emotional ERPs, namely the N170, reflect differences in depression/anxiety symptoms rather than differences in wellbeing. Furthermore, this effect was limited to automatic processing, rather than conscious processing of emotional stimuli, suggesting the observed differences apply only to the subconscious pathway.

Self-face and emotional faces-are they alike?

The image of one’s own face is a particularly distinctive feature of the self. The self-face differs from other faces not only in respect of its familiarity but also in respect of its subjective emotional significance and saliency. The current study aimed at elucidating similarities/dissimilarities between processing of one’s own face and emotional faces: happy faces (based on the self-positive bias) and fearful faces (because of their high perceptual saliency, a feature shared with self-face). Electroencephalogram data were collected in the group of 30 participants who performed a simple detection task. Event-related potential analyses indicated significantly increased P3 and late positive potential amplitudes to the self-face in comparison to all other faces: fearful, happy and neutral. Permutation tests confirmed the differences between the self-face and all three types of other faces for numerous electrode sites and in broad time windows. Representational similarity analysis, in turn, revealed distinct processing of the self-face and did not provide any evidence in favour of similarities between the self-face and emotional (either negative or positive) faces. These findings strongly suggest that the self-face processing do not resemble those of emotional faces, thus implying that prioritized self-referential processing is driven by the subjective relevance of one’s own face.

Gender differences in subliminal affective face priming: A high-density ERP study

INTRODUCTION

Subliminal affective priming effects (SAPEs) refer to the phenomenon by which the presentation of an affective prime stimulus influences the subsequent affective evaluation of a target stimulus. Previous studies have reported that unconsciously processed stimuli affect behavioral performance more than consciously processed stimuli. However, the impact of SAPEs on the face-specific N170 component is unclear. We studied how SAPEs for fearful faces affected the N170 for subsequent supraliminal target faces using event-related potentials (ERPs).

METHODS

Japanese adults (n = 44, 20 females) participated in this study. Subliminal prime faces (neutral or fearful) were presented for 17 ms, followed by a backward mask for 283 ms and 800 ms target faces (neutral, emotionally ambiguous, or fearful). 128-channel ERPs were recorded while participants judged the expression of target faces as neutral or fearful. Response rates and response times were also measured for assessing behavioral alterations.

RESULTS

Although the behavioral results revealed no evidence of SAPEs, we found gender-related SAPEs in right N170 amplitude. Specifically, female participants exhibited enhanced right N170 amplitude for emotionally neutral faces primed by fearful faces, while male participants exhibited decreased N170 amplitude in fearful prime trials with fearful target faces. Male participants exhibited significant correlations between N170 amplitude and behavioral response time in the fearful prime-neutral target condition.

CONCLUSIONS

Our ERP results suggest the existence of a gender difference in target-face processing preceded by subliminally presented face stimuli in the right occipito-temporal region.

How ubiquitous is the direct-gaze advantage? Evidence for an averted-gaze advantage in a gaze-discrimination task

Human eye gaze conveys an enormous amount of socially relevant information, and the rapid assessment of gaze direction is of particular relevance in order to adapt behavior accordingly. Specifically, previous research demonstrated evidence for an advantage of processing direct (vs. averted) gaze. The present study examined discrimination performance for gaze direction (direct vs. averted) under controlled presentation conditions: Using a backward-masking gaze-discrimination task, photographs of faces with direct and averted gaze were briefly presented, followed by a mask stimulus. Additionally, effects of facial context on gaze discrimination were assessed by either presenting gaze direction in isolation (i.e., by only showing the eye region) or in the context of an upright or inverted face. Across three experiments, we consistently observed a facial context effect with highest discrimination performance for faces presented in upright position, lower performance for inverted faces, and lowest performance for eyes presented in isolation. Additionally, averted gaze was generally responded to faster and with higher accuracy than direct gaze, indicating an averted-gaze advantage. Overall, the results suggest that direct gaze is not generally associated with processing advantages, thereby highlighting the important role of presentation conditions and task demands in gaze perception.

Awareness of Emotional Expressions in Cannabis Users: An Event-Related Potential Study

Cannabis use has been associated with anxiogenic effects when used in low frequency for a short duration, but cannabis can also have anxiogenic effects when used heavily for a long duration. Animal studies have indicated the neurobiological mechanisms related to cannabis and anxiety; however, research has been limited on the related neurocognitive mechanisms. Previous research has indicated that cannabis use is associated with alterations in event-related potentials (ERPs). The purpose of the current study was to examine anxiety related attentional processing of emotional expressions using ERP methods. We used a backward masking paradigm to restrict awareness of facial expressions (i.e., fearful, happy, and neutral). The results indicated that cannabis use was associated with differences in emotional processing. Specifically, the results suggested cannabis users had increased P1 amplitudes toward happy facial expressions compared to fearful and neutral. Additionally, cannabis users seemed to have reduced N170 hemisphere lateralization.

Impaired conscious access and abnormal attentional amplification in schizophrenia

Previous research suggests that the conscious perception of a masked stimulus is impaired in schizophrenia, while unconscious bottom-up processing of the same stimulus, as assessed by subliminal priming, can be preserved. Here, we test this postulated dissociation between intact bottom-up and impaired top-down processing and evaluate its brain mechanisms using high-density recordings of event-related potentials. Sixteen patients with schizophrenia and sixteen controls were exposed to peripheral digits with various degrees of visibility, under conditions of either focused attention or distraction by another task. In the distraction condition, the brain activity evoked by masked digits was drastically reduced in both groups, but early bottom-up visual activation could still be detected and did not differ between patients and controls. By contrast, under focused top-down attention, a major impairment was observed: in patients, contrary to controls, the late non-linear ignition associated with the P3 component was reduced. Interestingly, the patients showed an essentially normal attentional amplification of the P1 and N2 components. These results suggest that some but not all top-down attentional amplification processes are impaired in schizophrenia, while bottom-up processing seems to be preserved.

•

An elevated consciousness threshold is observed in schizophrenia.

•

Under unattended conditions, brain activity was similarly reduced in schizophrenic patients and controls.

•

Under attended conditions, the late ignition associated with the P3 component is impaired in patients.

•

In schizophrenia, top-down attentional amplification is abnormal while bottom-up processing is essentially spared.

Post-Decision Wagering Affects Metacognitive Awareness of Emotional Stimuli: An Event Related Potential Study

The present research investigated metacognitive awareness of emotional stimuli and its psychophysiological correlates. We used a backward masking task presenting participants with fearful or neutral faces. We asked participants for face discrimination and then probed their metacognitive awareness with confidence rating (CR) and post-decision wagering (PDW) scales. We also analysed psychophysiological correlates of awareness with event-related potential (ERP) components: P1, N170, early posterior negativity (EPN), and P3. We have not observed any differences between PDW and CR conditions in the emotion identification task. However, the "aware" ratings were associated with increased accuracy performance. This effect was more pronounced in PDW, especially for fearful faces, suggesting that emotional stimuli awareness may be enhanced by monetary incentives. EEG analysis showed larger N170, EPN and P3 amplitudes in aware compared to unaware trials. It also appeared that both EPN and P3 ERP components were more pronounced in the PDW condition, especially when emotional faces were presented. Taken together, our ERP findings suggest that metacognitive awareness of emotional stimuli depends on the effectiveness of both early and late visual information processing. Our study also indicates that awareness of emotional stimuli can be enhanced by the motivation induced by wagering.