Time course of influence on the allocation of attentional resources caused by unconscious fearful faces

Can neural correlates of encoding explain the context dependence of reward-enhanced memory?

Selective encoding can be studied by manipulating how valuable it is for participants to remember specific stimuli, for instance, by varying the monetary reward participants receive for recalling a particular stimulus in a subsequent memory test. It would be reasonable for participants to strategically attend more to high-reward items compared to low-reward items in mixed list contexts, but to attend both types of items equally in pure list contexts, where all items are of equal value. Reward-enhanced memory may be driven by automatic dopaminergic interactions between reward circuitry and the hippocampus and thus be insensitive to list context; or it may be driven by meta-cognitive strategies, and thus context-dependent. We contrasted these alternatives by manipulating list composition and tracked selective encoding through multiple EEG measures of attention and rehearsal. Behavioral results were context-dependent, such that recall of high-reward items was increased only in mixed lists. This result and aspects of the recall dynamics confirm predictions of the eCMR (emotional Context Maintenance and Retrieval) model. The power of ssVEPs was lower for high-reward items regardless of list composition, suggesting decreased visual processing of high-reward stimuli and that ssVEPs may index the modulation of context-to-item associations predicted by eCMR. By contrast, reward modulated the amplitude of Late Positive Potential and Frontal Slow Wave only in mixed lists. Taken together, the results provide evidence that reward-enhanced memory is caused by an interplay between strategic processes applied when high- and low-reward items compete for cognitive resources during encoding and context-dependent mechanisms operating during recall.

The importance of awareness in face processing: A critical review of interocular suppression studies

Human faces convey essential information for understanding others' mental states and intentions. The importance of faces in social interaction has prompted suggestions that some relevant facial features such as configural information, emotional expression, and gaze direction may promote preferential access to awareness. This evidence has predominantly come from interocular suppression studies, with the most common method being the Breaking Continuous Flash Suppression (bCFS) procedure, which measures the time it takes different stimuli to overcome interocular suppression. However, the procedures employed in such studies suffer from multiple methodological limitations. For example, they are unable to disentangle detection from identification processes, their results may be confounded by participants' response bias and decision criteria, they typically use small stimulus sets, and some of their results attributed to detecting high-level facial features (e.g., emotional expression) may be confounded by differences in low-level visual features (e.g., contrast, spatial frequency). In this article, we review the evidence from the bCFS procedure on whether relevant facial features promote access to awareness, discuss the main limitations of this very popular method, and propose strategies to address these issues.

Surprising Threats Accelerate Conscious Perception

The folk psychological notion that "we see what we expect to see" is supported by evidence that we become consciously aware of visual stimuli that match our prior expectations more quickly than stimuli that violate our expectations. Similarly, "we see what we want to see," such that more biologically-relevant stimuli are also prioritised for conscious perception. How, then, is perception shaped by biologically-relevant stimuli that we did not expect? Here, we conducted two experiments using breaking continuous flash suppression (bCFS) to investigate how prior expectations modulated response times to neutral and fearful faces. In both experiments, we found that prior expectations for neutral faces hastened responses, whereas the opposite was true for fearful faces. This interaction between emotional expression and prior expectations was driven predominantly by participants with higher trait anxiety. Electroencephalography (EEG) data collected in Experiment 2 revealed an interaction evident in the earliest stages of sensory encoding, suggesting prediction errors expedite sensory encoding of fearful faces. These findings support a survival hypothesis, where biologically-relevant fearful stimuli are prioritised for conscious access even more so when unexpected, especially for people with high trait anxiety.

Visual Mismatch Negativity Reflects Enhanced Response to the Deviant: Evidence From Event-Related Potentials and Electroencephalogram Time-Frequency Analysis

Automatic detection of information changes in the visual environment is crucial for individual survival. Researchers use the oddball paradigm to study the brain’s response to frequently presented (standard) stimuli and occasionally presented (deviant) stimuli. The component that can be observed in the difference wave is called visual mismatch negativity (vMMN), which is obtained by subtracting event-related potentials (ERPs) evoked by the deviant from ERPs evoked by the standard. There are three hypotheses to explain the vMMN. The sensory fatigue (or refractoriness) hypothesis considers that weakened neural activity caused by repetition results in decreased ERPs of the standard. The memory trace hypothesis proposes that vMMN results from increased responses to the deviant. The predictive coding hypothesis attributes the difference to enhanced responses for deviants and suppression for standards. However, when distinguishing between these effects, previous researchers did not consider the effect of low-level features on the vMMN. In this experiment, we used face sequences composed of different emotions (e.g., neutral and fearful face) and presented an oddball sequence, a reverse oddball sequence, and an equiprobable sequence to participants. The deviant of the oddball sequence was subtracted from the standard of the oddball sequence, the reverse oddball sequence, and the same type of stimulus of the equiprobable sequence to get oddball-vMMN (vMMN1), reverse oddball-vMMN (vMMN2), and equiprobable-vMMN (vMMN3), respectively. The results showed no significant difference between vMMN2 and vMMN3 in 100–350 ms following stimulus onset, while the vMMN effect was significant, indicating that the probability of the standard did not affect vMMN, which supported the memory trace hypothesis. Additionally, the fearful-related vMMN were more negative than the neutral-related vMMN within the range of 100–150 ms, suggesting a negative bias. We analyzed the source location of different vMMNs. There was no significant difference in brain regions between different vMMNs. Time-frequency analysis showed that the deviant had stronger theta-band oscillatory than the standard (visual mismatch oscillatory responses, vMORs). However, there was no difference between vMORs2 and vMORs3, indicating that vMORs reflect an enhanced response to the deviant in terms of neural oscillation, supporting the memory trace hypothesis.

"There Is No (Where a) Face Like Home": Recognition and Appraisal Responses to Masked Facial Dialects of Emotion in Four Different National Cultures

The theory of universal emotions suggests that certain emotions such as fear, anger, disgust, sadness, surprise and happiness can be encountered cross-culturally. These emotions are expressed using specific facial movements that enable human communication. More recently, theoretical and empirical models have been used to propose that universal emotions could be expressed via discretely different facial movements in different cultures due to the non-convergent social evolution that takes place in different geographical areas. This has prompted the consideration that own-culture emotional faces have distinct evolutionary important sociobiological value and can be processed automatically, and without conscious awareness. In this paper, we tested this hypothesis using backward masking. We showed, in two different experiments per country of origin, to participants in Britain, Chile, New Zealand and Singapore, backward masked own and other-culture emotional faces. We assessed detection and recognition performance, and self-reports for emotionality and familiarity. We presented thorough cross-cultural experimental evidence that when using Bayesian assessment of non-parametric receiver operating characteristics and hit-versus-miss detection and recognition response analyses, masked faces showing own cultural dialects of emotion were rated higher for emotionality and familiarity compared to other-culture emotional faces and that this effect involved conscious awareness.

Danger is in the eyes of the beholder: The effect of visible and invisible affective faces on the judgment of social interactions

Previous studies demonstrated that observation of facial expressions can modulate threat detection while looking at neutral or emotion-related scenes. Similarly, stimuli presented outside conscious awareness could influence social judgments of neutral novel stimuli. The two-fold aim of this study was: i) to evaluate whether observation of seen emotional faces could affect the judgment of social interactions without contextual cues (visible prime condition), and ii) whether this effect could also emerge when the emotional faces were made not visible by means of continuous flash suppression (invisible prime condition). We found that both seen and unseen faces are able to affect the judgment of ambiguous social interactions although this effect was particularly evident when affective faces were clearly visible. The present findings supported the idea that both conscious and unconscious processing of emotional faces have an important role in modulating perceivers' affective state and their judgment of social interactions.

Attention allocation to subliminally presented affective faces in high and low social anxiety

Attention bias to affective stimuli, particularly threatening stimuli, has been well documented, with attention bias to affective faces often reported in populations with social anxiety (SA). However, inconsistencies exist in the literature regarding the direction of the bias, with some studies reporting a bias to attend toward social threat, and others reporting a bias to avoid social threat. This variability in the attention bias literature could be related to fluctuations in how attentional resources are allocated toward social stimuli over time. This study aimed to isolate early processing of affective faces using a backward masking paradigm in participants with high and low levels of subclinical SA. We used prepulse inhibition (PPI) of startle to index the amount of early attention allocated to masked affective faces. There was greater PPI to masked angry faces compared to neutral faces across all participants, suggesting that more attention was allocated to threatening faces. This effect was similar across face genders and participant SA levels. There was also a trend for more attention to be allocated to masked affective faces (angry and happy) compared to neutral faces across all participants. These findings demonstrate that attention bias to subliminal affect, and threat specifically, may not be modulated by subclinical levels of SA at very early stages of attention processing.

Affective Bias without Hemispheric Competition: Evidence for Independent Processing Resources in Each Cortical Hemisphere

We assessed the extent of neural competition for attentional processing resources in early visual cortex between foveally presented task stimuli and peripheral emotional distracter images. Task-relevant and distracting stimuli were shown in rapid serial visual presentation (RSVP) streams to elicit the steady-state visual evoked potential, which serves as an electrophysiological marker of attentional resource allocation in early visual cortex. A task-related RSVP stream of symbolic letters was presented centrally at 15 Hz while distracting RSVP streams were displayed at 4 or 6 Hz in the left and right visual hemifields. These image streams always had neutral content in one visual field and would unpredictably switch from neutral to unpleasant content in the opposite visual field. We found that the steady-state visual evoked potential amplitude was consistently modulated as a function of change in emotional valence in peripheral RSVPs, indicating sensory gain in response to distracting affective content. Importantly, the facilitated processing for emotional content shown in one visual hemifield was not paralleled by any perceptual costs in response to the task-related processing in the center or the neutral image stream in the other visual hemifield. Together, our data provide further evidence for sustained sensory facilitation in favor of emotional distracters. Furthermore, these results are in line with previous reports of a “different hemifield advantage” with low-level visual stimuli and are suggestive of independent processing resources in each cortical hemisphere that operate beyond low-level visual cues, that is, with complex images that impact early stages of visual processing via reentrant feedback loops from higher order processing areas.