Neural correlates of emotion perception depending on culture and gaze direction

Face masks inhibit facial cues for approachability and trustworthiness: an eyetracking study

Wearing face masks during the Covid-19 pandemic has undeniable benefits from our health perspective. However, the interpersonal costs on social interactions may have been underappreciated. Because masks obscure critical facial regions signaling approach/avoidance intent and social trust, this implies that facial inference of approachability and trustworthiness may be severely discounted. Here, in our eyetracking experiment, we show that people judged masked faces as less approachable and trustworthy. Further analyses showed that the attention directed towards the eye region relative to the mouth region mediated the effect on approachability, but not on trustworthiness. This is because for masked faces, with the mouth region obscured, visual attention is then automatically diverted away from the mouth and towards the eye region, which is an undiagnostic cue for judging a target's approachability. Together, these findings support that mask-wearing inhibits the critical facial cues needed for social judgements.

Supplementary Information

The online version contains supplementary material available at 10.1007/s12144-022-03705-8.

The Neurobiological Correlates of Gaze Perception in Healthy Individuals and Neurologic Patients

The ability to adaptively follow conspecific eye movements is crucial for establishing shared attention and survival. Indeed, in humans, interacting with the gaze direction of others causes the reflexive orienting of attention and the faster object detection of the signaled spatial location. The behavioral evidence of this phenomenon is called gaze-cueing. Although this effect can be conceived as automatic and reflexive, gaze-cueing is often susceptible to context. In fact, gaze-cueing was shown to interact with other factors that characterize facial stimulus, such as the kind of cue that induces attention orienting (i.e., gaze or non-symbolic cues) or the emotional expression conveyed by the gaze cues. Here, we address neuroimaging evidence, investigating the neural bases of gaze-cueing and the perception of gaze direction and how contextual factors interact with the gaze shift of attention. Evidence from neuroimaging, as well as the fields of non-invasive brain stimulation and neurologic patients, highlights the involvement of the amygdala and the superior temporal lobe (especially the superior temporal sulcus (STS)) in gaze perception. However, in this review, we also emphasized the discrepancies of the attempts to characterize the distinct functional roles of the regions in the processing of gaze. Finally, we conclude by presenting the notion of invariant representation and underline its value as a conceptual framework for the future characterization of the perceptual processing of gaze within the STS.

The rapid and automatic categorization of facial expression changes in highly variable natural images

Emotional expressions are quickly and automatically read from human faces under natural viewing conditions. Yet, categorization of facial expressions is typically measured in experimental contexts with homogenous sets of face stimuli. Here we evaluated how the 6 basic facial emotions (Fear, Disgust, Happiness, Anger, Surprise or Sadness) can be rapidly and automatically categorized with faces varying in head orientation, lighting condition, identity, gender, age, ethnic origin and background context. High-density electroencephalography was recorded in 17 participants viewing 50 s sequences with natural variable images of neutral-expression faces alternating at a 6 Hz rate. Every five stimuli (1.2 Hz), variable natural images of one of the six basic expressions were presented. Despite the wide physical variability across images, a significant F/5 = 1.2 Hz response and its harmonics (e.g., 2F/5 = 2.4 Hz, etc.) was observed for all expression changes at the group-level and in every individual participant. Facial categorization responses were found mainly over occipito-temporal sites, with distinct hemispheric lateralization and cortical topographies according to the different expressions. Specifically, a stronger response was found to Sadness categorization, especially over the left hemisphere, as compared to Fear and Happiness, together with a right hemispheric dominance for categorization of Fearful faces. Importantly, these differences were specific to upright faces, ruling out the contribution of low-level visual cues. Overall, these observations point to robust rapid and automatic facial expression categorization processes in the human brain.

Type 1 diabetes and working memory processing of emotional faces

Several executive functions decline with the development of type-1 diabetes (T1D), particularly working memory (WM). In adults, WM ensures efficient cognitive processing by focusing on task-relevant information while suppressing distractors. It has been well documented that WM can be influenced by emotional stimuli, which may facilitate the retention of information, interfere with uptake, or even affect its capacity. We evaluated the effect of T1D on visual WM processing using emotional faces as stimuli, in young patients with satisfactory clinical evolution, and matched controls without T1D. All subjects performed a 2-back task detecting facial identity using neutral, happy or fearful faces in a block design for fMRI. Behavioral performance was similar with the exception that patients responded significantly slower. Most importantly, between-group differences were found in patterns of brain activation. In comparison, more widespread brain activation -predominantly prefrontal- was found in the participants with T1D when processing neutral faces, while a decrease was observed when processing happy and fearful ones. Statistical contrasts demonstrated significantly-different activation patterns between groups when processing emotional faces, as controls exhibited greater activation in the cuneus, posterior cortex and parahippocampal gyrus, while the patients showed greater activation in the prefrontal structures. Results may reflect compensatory efforts made to minimize the deleterious effects of disease development on attention allocation processes and the operational efficiency of WM. The results suggest that emotional parameters should be periodically assessed in individuals with T1D in order to anticipate the emergence of attention and WM impairment.

Arousal Rather than Basic Emotions Influence Long-Term Recognition Memory in Humans

Emotion can influence various cognitive processes, however its impact on memory has been traditionally studied over relatively short retention periods and in line with dimensional models of affect. The present study aimed to investigate emotional effects on long-term recognition memory according to a combined framework of affective dimensions and basic emotions. Images selected from the Nencki Affective Picture System were rated on the scale of affective dimensions and basic emotions. After 6 months, subjects took part in a surprise recognition test during an fMRI session. The more negative the pictures the better they were remembered, but also the more false recognitions they provoked. Similar effects were found for the arousal dimension. Recognition success was greater for pictures with lower intensity of happiness and with higher intensity of surprise, sadness, fear, and disgust. Consecutive fMRI analyses showed a significant activation for remembered (recognized) vs. forgotten (not recognized) images in anterior cingulate and bilateral anterior insula as well as in bilateral caudate nuclei and right thalamus. Further, arousal was found to be the only subjective rating significantly modulating brain activation. Higher subjective arousal evoked higher activation associated with memory recognition in the right caudate and the left cingulate gyrus. Notably, no significant modulation was observed for other subjective ratings, including basic emotion intensities. These results emphasize the crucial role of arousal for long-term recognition memory and support the hypothesis that the memorized material, over time, becomes stored in a distributed cortical network including the core salience network and basal ganglia.

Neuroanatomy of intergroup bias: A white matter microstructure study of individual differences

Intergroup bias-the tendency to behave more positively toward an ingroup member than an outgroup member-is a powerful social force, for good and ill. Although it is widely demonstrated, intergroup bias is not universal, as it is characterized by significant individual differences. Recently, attention has begun to turn to whether neuroanatomy might explain these individual differences in intergroup bias. However, no research to date has examined whether white matter microstructure could help determine differences in behavior toward ingroup and outgroup members. In the current research, we examine intergroup bias with the third-party punishment paradigm and white matter integrity and connectivity strength as determined by diffusion tensor imaging (DTI). We found that both increased white matter integrity at the right temporal-parietal junction (TPJ) and connectivity strength between the right TPJ and the dorsomedial prefrontal cortex (DMPFC) were associated with increased impartiality in the third-party punishment paradigm, i.e., reduced intergroup bias. Further, consistent with the role that these brain regions play in the mentalizing network, we found that these effects were mediated by mentalizing processes. Participants with greater white matter integrity at the right TPJ and connectivity strength between the right TPJ and the DMPFC employed mentalizing processes more equally for ingroup and outgroup members, and this non-biased use of mentalizing was associated with increased impartiality. The current results help shed light on the mechanisms of bias and, potentially, on interventions that promote impartiality over intergroup bias.

Emotion perception and executive control interact in the salience network during emotionally charged working memory processing

Processing of emotional stimuli can either hinder or facilitate ongoing working memory (WM); however, the neural basis of these effects remains largely unknown. Here we examined the neural mechanisms of these paradoxical effects by implementing a novel emotional WM task in an fMRI study. Twenty-five young healthy participants performed an N-back task with fearful and neutral faces as stimuli. Participants made more errors when performing 0-back task with fearful versus neutral faces, whereas they made fewer errors when performing 2-back task with fearful versus neutral faces. These emotional impairment and enhancement on behavioral performance paralleled significant interactions in distributed regions in the salience network including anterior insula (AI) and dorsal cingulate cortex (dACC), as well as in emotion perception network including amygdala and temporal-occipital association cortex (TOC). The dorsal AI (dAI) and dACC were more activated when comparing fearful with neutral faces in 0-back task. Contrarily, dAI showed reduced activation, while TOC and amygdala showed stronger responses to fearful as compared to neutral faces in the 2-back task. These findings provide direct neural evidence to the emerging dual competition model suggesting that the salience network plays a critical role in mediating interaction between emotion perception and executive control when facing ever-changing behavioral demands.