Interactions between Identity and Emotional Expression in Face Processing across the Lifespan: Evidence from Redundancy Gains

Age-related reduction in trait anxiety: Behavioral and neural evidence of automaticity in negative facial emotion processing

Trait anxiety diminishes with age, which may result from age-related decline in registering salient emotional stimuli and/or enhancement in emotion regulation. We tested the hypotheses in 88 adults 21 to 85 years of age and studied with fMRI of the Hariri task. Age-related decline in stimulus registration would manifest in delayed reaction time (RT) and diminished saliency circuit activity in response to emotional vs. neutral stimuli. Enhanced control of negative emotions would manifest in diminished limbic/emotional circuit and higher prefrontal cortical (PFC) responses to negative emotion. The results showed that anxiety was negatively correlated with age. Age was associated with faster RT and diminished activation of the medial PFC, in the area of the dorsal and rostral anterior cingulate cortex (dACC/rACC) - a hub of the saliency circuit - during matching of negative but not positive vs. neutral emotional faces. A slope test confirmed the differences in the regressions. Further, age was not associated with activation of the PFC in whole-brain regression or in region-of-interest analysis of the dorsolateral PFC, an area identified from meta-analyses of the emotion regulation literature. Together, the findings fail to support either hypothesis; rather, the findings suggest age-related automaticity in processing negative emotions as a potential mechanism of diminished anxiety. Automaticity results in faster RT and diminished anterior cingulate activity in response to negative but not positive emotional stimuli. In support, analyses of psychophysiological interaction demonstrated higher dACC/rACC connectivity with the default mode network, which has been implicated in automaticity in information processing. As age increased, individuals demonstrated faster RT with higher connectivity during matching of negative vs. neutral images. Automaticity in negative emotion processing needs to be investigated as a mechanism of age-related reduction in anxiety.

Emerged human-like facial expression representation in a deep convolutional neural network

Recent studies found that the deep convolutional neural networks (DCNNs) trained to recognize facial identities spontaneously learned features that support facial expression recognition, and vice versa. Here, we showed that the self-emerged expression-selective units in a VGG-Face trained for facial identification were tuned to distinct basic expressions and, importantly, exhibited hallmarks of human expression recognition (i.e., facial expression confusion and categorical perception). We then investigated whether the emergence of expression-selective units is attributed to either face-specific experience or domain-general processing by conducting the same analysis on a VGG-16 trained for object classification and an untrained VGG-Face without any visual experience, both having the identical architecture with the pretrained VGG-Face. Although similar expression-selective units were found in both DCNNs, they did not exhibit reliable human-like characteristics of facial expression perception. Together, these findings revealed the necessity of domain-specific visual experience of face identity for the development of facial expression perception, highlighting the contribution of nurture to form human-like facial expression perception.

Measuring facial identity and emotion integration using the redundancy gain paradigm

Early theories on face perception posit that invariant (i.e., identity) and changeable (i.e., expression) facial aspects are processed separately. However, many researchers have countered the hypothesis of parallel processes with findings of interactions between identity and emotion perception. The majority of tasks measuring interactions between identity and emotion employ a selective attention design, in which participants are instructed to attend to one dimension (e.g., identity) while the other dimension varies orthogonally (e.g., emotion), but is task irrelevant. Recently, a divided attention design (i.e., the redundancy gain paradigm) in which both identity and emotion are task relevant was employed to assess the interaction between identity and emotion. A redundancy gain is calculated by a drop in reaction time in trials in which a target from both dimensions is present in the stimulus face (e.g., “sad Person A”), compared with trials with only a single target present (e.g., “sad” or “Person A”). Redundancy gains are hypothesized to point to an interactive activation of both dimensions, and as such, could complement designs adopting a selective attention task. The initial aim of the current study was to reproduce the earlier findings with this paradigm on identity and emotion perception (Yankouskaya, Booth, & Humphreys, Attention, Perception, & Psychophysics, 74(8), 1692–1711, 2012), but our study failed to replicate the results. In a series of subtasks, multiple aspects of the design were manipulated separately in our goal to shed light on the factors that influence the redundancy gain effect in faces. A redundancy gain was eventually obtained after controlling for contingencies and stimulus presentation time.

The processing of facial identity and expression is interactive, but dependent on task and experience

Facial identity and emotional expression are two important sources of information for daily social interaction. However the link between these two aspects of face processing has been the focus of an unresolved debate for the past three decades. Three views have been advocated: (1) separate and parallel processing of identity and emotional expression signals derived from faces; (2) asymmetric processing with the computation of emotion in faces depending on facial identity coding but not vice versa; and (3) integrated processing of facial identity and emotion. We present studies with healthy participants that primarily apply methods from mathematical psychology, formally testing the relations between the processing of facial identity and emotion. Specifically, we focused on the "Garner" paradigm, the composite face effect and the divided attention tasks. We further ask whether the architecture of face-related processes is fixed or flexible and whether (and how) it can be shaped by experience. We conclude that formal methods of testing the relations between processes show that the processing of facial identity and expressions interact, and hence are not fully independent. We further demonstrate that the architecture of the relations depends on experience; where experience leads to higher degree of inter-dependence in the processing of identity and expressions. We propose that this change occurs as integrative processes are more efficient than parallel. Finally, we argue that the dynamic aspects of face processing need to be incorporated into theories in this field.