Two different faces of threat. Comparing the neural systems for recognizing fear and anger in dynamic body expressions

Emotion-Guided Attention Impacts Deliberate Multi-Evidence Emotion-Related Perceptual Decision-Making

Emotion-guided endogenous attention (e.g., attending to fear) may play a crucial role in determining how humans integrate emotional evidence from various sources when assessing the general emotional tenor of the environment. For instance, what emotion a presenter focuses on can shape their perception of the overall emotion of the room. While there is an increasing interest in understanding how endogenous attention affects emotion perception, existing studies have largely focused on single-stimulus perception. There is limited understanding of how endogenous attention influences emotion evidence integration across multiple sources. To investigate this question, human participants (N = 40) were invited to judge the average emotion across an array of faces ranging from fearful to happy. Endogenous attention was manipulated by instructing participants to decide whether the face array was "fearful or not" (fear attention), "happy or not" (happy attention). Eye movement results revealed an endogenous attention-induced sampling bias such that participants paid more attention to extreme emotional evidence congruent with the target emotion. Computational modeling revealed that endogenous attention shifted the decision criterion to be more conservative, leading to reduced target-category decisions. These findings unraveled the cognitive and computational mechanisms of how endogenous attention impacts the way we gather emotional evidence and make integrative decisions, shedding light on emotion-related decision-making.

"Invisible Dangers": Unconscious processing of angry vs fearful faces and its relationship to subjective anger

Traditional paradigms for studying the unconscious processing of threatening facial expressions face methodological limitations and have predominantly focused on fear, leaving gaps in our understanding of anger. Additionally, it is unclear how the unconscious perception of anger influences subjective anger experiences. To address this, the current study employed Continuous Flash Suppression (CFS), a robust method for studying unconscious processing, to assess suppression times for angry, fearful and happy facial expressions. Following the administration of CFS, participants underwent an anger induction paradigm, and state anger symptoms were assessed at multiple timepoints. Suppression times for angry faces were compared to those for happy and fearful faces, and their relationship with state anger symptoms post-induction was examined. Results revealed that fearful faces broke suppression significantly faster than happy faces. Anger was slower to break suppression compared to fear, but no significant differences emerged between anger and happiness. In addition, the faster emergence into awareness of fear compared to anger was linked to an increased state anger after the induction, indicating that differences in the unconscious processing of these two emotions can potentially influence symptoms of subjective anger. These findings provide new insights into how angry and fearful faces are processed unconsciously, with implications for understanding the cognitive mechanisms underlying subjective anger.

Decoding affect in emotional body language: valence representation in the action observation network

Humans are highly adept at inferring emotional states from body movements in social interactions. Nonetheless, it is under debate how this process is facilitated by neural activations across multiple brain regions. The specific contributions of various brain areas to the perception of valence in biological motion remain poorly understood, particularly those within the action observation network (AON) and those involved in processing emotional valence. This study explores which cortical regions involved in processing emotional body language depicted by kinematic stimuli contain valence information, and whether this is reflected either in the magnitude of activation or in distinct activation patterns. Results showed that neural patterns within the AON, notably the inferior parietal lobule (IPL), exhibit a neural geometry that reflects the valence impressions of the observed stimuli. However, the representational geometry of valence-sensitive areas mirrors these impressions to a lesser degree. Our findings also reveal that the activation magnitude in both AON and valence-sensitive regions does not correlate with the perceived valence of emotional interactions. Results underscore the critical role of the AON, particularly the IPL, in interpreting the valence of emotional interactions, indicating its essential function in the perception of valence, especially when observing biological movements.

How is emotional evidence from multiple sources used in perceptual decision making?

Judging the emotional nature of a scene requires us to deliberately integrate pieces of evidence with varying intensities of emotion. Our existing knowledge about emotion-related perceptual decision-making is largely based on paradigms using single stimulus and, when involving multiple stimuli, rapid decisions. Consequently, it remains unclear how we sample and integrate multiple pieces of emotional evidence deliberately to form an overall judgment. Findings from non-emotion rapid decision-making studies show humans down-sample and downweight extreme evidence. However, deliberate decision-making may rely on a different attention mode than in rapid decision-making; and extreme emotional stimuli are inherently salient. Given these critical differences, it is imperative to directly examine the deliberate decision-making process about multiple emotional stimuli. In the current study, human participants (N = 33) viewed arrays of faces with expressions ranging from extremely fearful to extremely happy freely with their eye movement tracked. They then decided whether the faces were more fearful or happier on average. In contrast to conclusions drawn from non-emotion and rapid decision-making studies, eye movement measures revealed that participants attentionally sampled extreme emotional evidence more than less extreme evidence. Computational modeling results indicated that even though participants exhibited biased attention distribution, they weighted various emotional evidence equally. These findings provide novel insights into how people sample and integrate multiple pieces of emotional evidence, contribute to a more comprehensive understanding of emotion-related decision-making, and shed light on the mechanisms of pathological affective decisions.

Maintenance of Bodily Expressions Modulates Functional Connectivity Between Prefrontal Cortex and Extrastriate Body Area During Working Memory Processing

Background/Objectives: As a form of visual input, bodily expressions can be maintained and manipulated in visual working memory (VWM) over a short period of time. While the prefrontal cortex (PFC) plays an indispensable role in top-down control, it remains largely unclear whether this region also modulates the VWM storage of bodily expressions during a delay period. Therefore, the two primary goals of this study were to examine whether the emotional bodies would elicit heightened brain activity among areas such as the PFC and extrastriate body area (EBA) and whether the emotional effects subsequently modulate the functional connectivity patterns for active maintenance during delay periods. Methods: During functional magnetic resonance imaging (fMRI) scanning, participants performed a delayed-response task in which they were instructed to view and maintain a body stimulus in working memory before emotion categorization (happiness, anger, and neutral). If processing happy and angry bodies consume increased cognitive demands, stronger PFC activation and its functional connectivity with perceptual areas would be observed. Results: Results based on univariate and multivariate analyses conducted on the data collected during stimulus presentation revealed an enhanced processing of the left PFC and left EBA. Importantly, subsequent functional connectivity analyses performed on delayed-period data using a psychophysiological interaction model indicated that functional connectivity between the PFC and EBA increases for happy and angry bodies compared to neutral bodies. Conclusions: The emotion-modulated coupling between the PFC and EBA during maintenance deepens our understanding of the functional organization underlying the VWM processing of bodily information.

An fMRI dataset in response to large-scale short natural dynamic facial expression videos

Facial expression is among the most natural methods for human beings to convey their emotional information in daily life. Although the neural mechanisms of facial expression have been extensively studied employing lab-controlled images and a small number of lab-controlled video stimuli, how the human brain processes natural dynamic facial expression videos still needs to be investigated. To our knowledge, this type of data specifically on large-scale natural facial expression videos is currently missing. We describe here the natural Facial Expressions Dataset (NFED), an fMRI dataset including responses to 1,320 short (3-second) natural facial expression video clips. These video clips are annotated with three types of labels: emotion, gender, and ethnicity, along with accompanying metadata. We validate that the dataset has good quality within and across participants and, notably, can capture temporal and spatial stimuli features. NFED provides researchers with fMRI data for understanding of the visual processing of large number of natural facial expression videos.

Can deepfakes be used to study emotion perception? A comparison of dynamic face stimuli

Video recordings accurately capture facial expression movements; however, they are difficult for face perception researchers to standardise and manipulate. For this reason, dynamic morphs of photographs are often used, despite their lack of naturalistic facial motion. This study aimed to investigate how humans perceive emotions from faces using real videos and two different approaches to artificially generating dynamic expressions - dynamic morphs, and AI-synthesised deepfakes. Our participants perceived dynamic morphed expressions as less intense when compared with videos (all emotions) and deepfakes (fearful, happy, sad). Videos and deepfakes were perceived similarly. Additionally, they perceived morphed happiness and sadness, but not morphed anger or fear, as less genuine than other formats. Our findings support previous research indicating that social responses to morphed emotions are not representative of those to video recordings. The findings also suggest that deepfakes may offer a more suitable standardized stimulus type compared to morphs. Additionally, qualitative data were collected from participants and analysed using ChatGPT, a large language model. ChatGPT successfully identified themes in the data consistent with those identified by an independent human researcher. According to this analysis, our participants perceived dynamic morphs as less natural compared with videos and deepfakes. That participants perceived deepfakes and videos similarly suggests that deepfakes effectively replicate natural facial movements, making them a promising alternative for face perception research. The study contributes to the growing body of research exploring the usefulness of generative artificial intelligence for advancing the study of human perception.

Testosterone administration decreases sensitivity to angry facial expressions in healthy males: A computational modeling approach

Previous research indicates that higher testosterone levels are related to increased aggressive and dominant behaviors, particularly in males. One possible mechanism for these hormone-behavior associations could involve threat perception. However, the causal influence of testosterone on men's recognition of threatening facial expressions remains unknown. Here, we tested the causal effect of exogenous testosterone on men's sensitivity to facial threat by combining a psychophysical task with computational modeling. We administered a single dose (150 mg) of testosterone or placebo gel to healthy young men (n = 120) in a double-blind, placebo-controlled, between-participant design. Participants were presented with morphed emotional faces mixing anger/fear and neutral expressions and made judgments about the emotional expression. Across typical regression analysis, signal detection analysis, and drift diffusion modeling, our results consistently showed that individuals who received testosterone (versus placebo) exhibited a lower perceived sensitivity to angry facial expressions. But we observed no significant effects of testosterone administration on fearful facial expressions. The findings indicate that testosterone attenuates sensitivity to facial threat, especially angry facial expressions, which could lead to a misestimation of others' dominance and an increase in one's own aggressive and dominant behaviors.

Individual differences in the evaluation of ambiguous visual and auditory threat-related expressions

This study investigated the neural correlates of the judgement of auditory and visual ambiguous threat-related information, and the influence of state anxiety on this process. Healthy subjects were scanned using a fast, high-resolution functional magnetic resonance imaging (fMRI) multiband sequence while they performed a two-alternative forced-choice emotion judgement task on faces and vocal utterances conveying explicit anger or fear, as well as ambiguous ones. Critically, the latter was specific to each subject, obtained through a morphing procedure and selected prior to scanning following a perceptual decision-making task. Behavioural results confirmed a greater task-difficulty for subject-specific ambiguous stimuli and also revealed a judgement bias for visual fear, and, to a lesser extent, for auditory anger. Imaging results showed increased activity in regions of the salience and frontoparietal control networks (FPCNs) and deactivation in areas of the default mode network for ambiguous, relative to explicit, expressions. In contrast, the right amygdala (AMG) responded more strongly to explicit stimuli. Interestingly, its response to the same ambiguous stimulus depended on the subjective judgement of the expression. Finally, we found that behavioural and neural differences between ambiguous and explicit expressions decreased as a function of state anxiety scores. Taken together, our results show that behavioural and brain responses to emotional expressions are determined not only by emotional clarity but also modality and the subjects' subjective perception of the emotion expressed, and that some of these responses are modulated by state anxiety levels.

Task-related modulation of motor response to emotional bodies: A TMS motor-evoked potential study

Exposure to emotional body postures during perceptual decision-making tasks has been linked to transient suppression of motor reactivity, supporting the monitoring of emotionally relevant information. However, it remains unclear whether this effect occurs implicitly, i.e., when emotional information is irrelevant to the task. To investigate this issue, we used single-pulse transcranial magnetic stimulation (TMS) to assess motor excitability while healthy participants were asked to categorize pictures of body expressions as emotional or neutral (emotion recognition task) or as belonging to a male or a female actor (gender recognition task) while receiving TMS over the motor cortex at 100 and 125 ms after picture onset. Results demonstrated that motor-evoked potentials (MEPs) were reduced for emotional body postures relative to neutral postures during the emotion recognition task. Conversely, MEPs increased for emotional body postures relative to neutral postures during the gender recognition task. These findings indicate that motor inhibition, contingent upon observing emotional body postures, is selectively associated with actively monitoring emotional features. In contrast, observing emotional body postures prompts motor facilitation when task-relevant features are non-emotional. These findings contribute to embodied cognition models that link emotion perception and action tendencies.

The influence of consonant wanderings and facial expressions in warmth and competence judgments

ABSTRACTThe preference for usernames whose oral pronunciation implies inward wandering articulatory movements over those involving outward movements - the in-out effect - has been shown to shape person perception judgments. Across three studies, we further tested the boundary conditions to this effect by combining the manipulation of the articulation direction of mock online usernames with one of the most critical cues for interpersonal judgments - facial expressions. As expected, users displaying smiling faces were rated as warmer and more competent than those displaying angry expressions. Notably, even in the presence of such diagnostic cues for social judgment, the articulatory activity involved in pronouncing a person's name still affected the impressions formed, particularly in the warmth dimension. These results show that the in-out effect did not vanish even when highly diagnostic visual information was available. Overall, the current work further emphasises the role of sensorimotor experience in person perception while providing additional evidence for the in-out effect, its boundary conditions, and potential mechanisms.

Intensity of repetitive negative thinking in depression is associated with greater functional connectivity between semantic processing and emotion regulation areas

BACKGROUND

Repetitive negative thinking (RNT), a cognitive process that encompasses past (rumination) and future (worry) directed thoughts focusing on negative experiences and the self, is a transdiagnostic construct that is especially relevant for major depressive disorder (MDD). Severe RNT often occurs in individuals with severe levels of MDD, which makes it challenging to disambiguate the neural circuitry underlying RNT from depression severity.

METHODS

We used a propensity score, i.e., a conditional probability of having high RNT given observed covariates to match high and low RNT individuals who are similar in the severity of depression, anxiety, and demographic characteristics. Of 148 MDD individuals, we matched high and low RNT groups (n = 50/group) and used a data-driven whole-brain voxel-to-voxel connectivity pattern analysis to investigate the resting-state functional connectivity differences between the groups.

RESULTS

There was an association between RNT and connectivity in the bilateral superior temporal sulcus (STS), an important region for speech processing including inner speech. High relative to low RNT individuals showed greater connectivity between right STS and bilateral anterior insular cortex (AI), and between bilateral STS and left dorsolateral prefrontal cortex (DLPFC). Greater connectivity in those regions was specifically related to RNT but not to depression severity.

CONCLUSIONS

RNT intensity is directly related to connectivity between STS and AI/DLPFC. This might be a mechanism underlying the role of RNT in perceptive, cognitive, speech, and emotional processing. Future investigations will need to determine whether modifying these connectivities could be a treatment target to reduce RNT.

Construction and validation of the Dalian emotional movement open-source set (DEMOS)

Human body movements are important for emotion recognition and social communication and have received extensive attention from researchers. In this field, emotional biological motion stimuli, as depicted by point-light displays, are widely used. However, the number of stimuli in the existing material library is small, and there is a lack of standardized indicators, which subsequently limits experimental design and conduction. Therefore, based on our prior kinematic dataset, we constructed the Dalian Emotional Movement Open-source Set (DEMOS) using computational modeling. The DEMOS has three views (i.e., frontal 0°, left 45°, and left 90°) and in total comprises 2664 high-quality videos of emotional biological motion, each displaying happiness, sadness, anger, fear, disgust, and neutral. All stimuli were validated in terms of recognition accuracy, emotional intensity, and subjective movement. The objective movement for each expression was also calculated. The DEMOS can be downloaded for free from https://osf.io/83fst/ . To our knowledge, this is the largest multi-view emotional biological motion set based on the whole body. The DEMOS can be applied in many fields, including affective computing, social cognition, and psychiatry.

The prefrontal cortex is differentially involved in implicit and explicit facial emotion processing: An fNIRS study

Despite extensive research, the differential roles of the prefrontal cortex (PFC) in implicit and explicit facial emotion processing remain elusive. Functional near-infrared spectroscopy (fNIRS) is a neuroimaging technique that can measure changes in both oxyhemoglobin (HbO) and deoxyhemoglobin (HbR) concentrations. Currently, how HbO and HbR change during facial emotion processing remains unclear. Here, fNIRS was used to examine and compare PFC activation during implicit and explicit facial emotion processing. Forty young adults performed a facial-matching task that required either emotion discrimination (explicit task) or age discrimination (implicit task), and the activation of their PFCs was measured by fNIRS. Participants attempted the task on two occasions to determine whether their activation patterns were maintained over time. The PFC displayed increases in HbO and/or decreases in HbR during the implicit and explicit facial emotion tasks. Importantly, there were significantly greater changes in PFC HbO during the explicit task, whereas no significant difference in HbR changes between conditions was found. Between sessions, HbO changes were reduced across tasks, but the difference in HbO changes between the implicit and explicit tasks remained unchanged. The test-retest reliability of the behavioral measures was excellent, whereas that of fNIRS measures was mostly poor to fair. Thus, the PFC plays a specific role in recognizing facial expressions, and its differential involvement in implicit and explicit facial emotion processing can be consistently captured at the group level by changes in HbO. This study demonstrates the potential of fNIRS for elucidating the neural mechanisms underlying facial emotion recognition.

Age-related differences in resting-state functional connectivity from childhood to adolescence

The human brain is active at rest, and spontaneous fluctuations in functional MRI BOLD signals reveal an intrinsic functional architecture. During childhood and adolescence, functional networks undergo varying patterns of maturation, and measures of functional connectivity within and between networks differ as a function of age. However, many aspects of these developmental patterns (e.g. trajectory shape and directionality) remain unresolved. In the present study, we characterised age-related differences in within- and between-network resting-state functional connectivity (rsFC) and integration (i.e. participation coefficient, PC) in a large cross-sectional sample of children and adolescents (n = 628) aged 8-21 years from the Lifespan Human Connectome Project in Development. We found evidence for both linear and non-linear differences in cortical, subcortical, and cerebellar rsFC, as well as integration, that varied by age. Additionally, we found that sex moderated the relationship between age and putamen integration where males displayed significant age-related increases in putamen PC compared with females. Taken together, these results provide evidence for complex, non-linear differences in some brain systems during development.

Perception of Prosody in Hearing-Impaired Individuals and Users of Hearing Assistive Devices: An Overview of Recent Advances

PURPOSE

Prosody perception is an essential component of speech communication and social interaction through which both linguistic and emotional information are conveyed. Considering the importance of the auditory system in processing prosody-related acoustic features, the aim of this review article is to review the effects of hearing impairment on prosody perception in children and adults. It also assesses the performance of hearing assistive devices in restoring prosodic perception.

METHOD

Following a comprehensive online database search, two lines of inquiry were targeted. The first summarizes recent attempts toward determining the effects of hearing loss and interacting factors such as age and cognitive resources on prosody perception. The second analyzes studies reporting beneficial or detrimental impacts of hearing aids, cochlear implants, and bimodal stimulation on prosodic abilities in people with hearing loss.

RESULTS

The reviewed studies indicate that hearing-impaired individuals vary widely in perceiving affective and linguistic prosody, depending on factors such as hearing loss severity, chronological age, and cognitive status. In addition, most of the emerging information points to limitations of hearing assistive devices in processing and transmitting the acoustic features of prosody.

CONCLUSIONS

The existing literature is incomplete in several respects, including the lack of a consensus on how and to what extent hearing prostheses affect prosody perception, especially the linguistic function of prosody, and a gap in assessing prosody under challenging listening situations such as noise. This review article proposes directions that future research could follow to provide a better understanding of prosody processing in those with hearing impairment, which may help health care professionals and designers of assistive technology to develop innovative diagnostic and rehabilitation tools.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21809772.

A large-scale brain network of species-specific dynamic human body perception

This ultrahigh field 7 T fMRI study addressed the question of whether there exists a core network of brain areas at the service of different aspects of body perception. Participants viewed naturalistic videos of monkey and human faces, bodies, and objects along with mosaic-scrambled videos for control of low-level features. Independent component analysis (ICA) based network analysis was conducted to find body and species modulations at both the voxel and the network levels. Among the body areas, the highest species selectivity was found in the middle frontal gyrus and amygdala. Two large-scale networks were highly selective to bodies, dominated by the lateral occipital cortex and right superior temporal sulcus (STS) respectively. The right STS network showed high species selectivity, and its significant human body-induced node connectivity was focused around the extrastriate body area (EBA), STS, temporoparietal junction (TPJ), premotor cortex, and inferior frontal gyrus (IFG). The human body-specific network discovered here may serve as a brain-wide internal model of the human body serving as an entry point for a variety of processes relying on body descriptions as part of their more specific categorization, action, or expression recognition functions.

Domestic Violence From a Child Perspective: Impact of an Immersive Virtual Reality Experience on Men With a History of Intimate Partner Violent Behavior

Domestic violence has long-term negative consequences on children. In this study, men with a history of partner aggression and a control group of non-offenders were embodied in a child's body from a first-person perspective in virtual reality (VR). From this perspective, participants witnessed a scene of domestic violence where a male avatar assaulted a female avatar. We evaluated the impact of the experience on emotion recognition skills and heart rate deceleration responses. We found that the experience mainly impacted the recognition of angry facial expressions. The results also indicate that males with a history of partner aggression had larger physiological responses during an explicit violent event (when the virtual abuser threw a telephone) compared with controls, while their physiological reactions were less pronounced when the virtual abuser invaded the victim's personal space. We show that embodiment from a child's perspective during a conflict situation in VR impacts emotion recognition, physiological reactions, and attitudes towards violence. We provide initial evidence of the potential of VR in the rehabilitation and neuropsychological assessment of males with a history of domestic violence, especially in relation to children.

The bodily fundament of empathy: The role of action, nonaction-oriented, and interoceptive body representations

Mental representations with bodily contents or in various bodily formats have been suggested to play a pivotal role in social cognition, including empathy. However, there is a lack of systematic studies investigating, in the same sample of participants and using an individual differences approach, whether and to what extent the sensorimotor, perceptual, and interoceptive representations of the body could fulfill an explanatory role in the empathic abilities.To address this goal, we carried out two studies in which healthy adults were given measures of interoceptive sensibility (IS), action (aBR), and nonaction-oriented body representations (NaBR), and affective, cognitive, and motor empathy. A higher tendency to be self-focused on interoceptive signals predicted higher affective, cognitive, and motor empathy levels. A better performance in tasks probing aBR and NaBR predicted, respectively, higher motor and cognitive empathy levels.These findings support the view that the various facets of the empathic response are differently grounded in the body since they diversely involve representations with a different bodily format.Individual differences in the focus on one's internal body state representation can directly modulate all the components of the empathic experience. Instead, a body representation used interpersonally to represent both one's own body and others' bodies, in particular in its spatial specificity, could be necessary to accurately understand other people's minds (cognitive empathy), while a sensorimotor body representation used to represent both one's own body and others' bodies actions, could be fundamental for the self-awareness of feelings expressed in actions (motor empathy).

Law Enforcement Officers’ Ability to Recognize Emotions: The Role of Personality Traits and Basic Needs’ Satisfaction

Background: This study intended to explore the role of personality traits and basic psychological needs in law enforcement officers’ ability to recognize emotions: anger, joy, sadness, fear, surprise, disgust, and neutral. It was significant to analyze law enforcement officers’ emotion recognition and the contributing factors, as this field has been under-researched despite increased excessive force use by officers in many countries. Methods: This study applied the Big Five–2 (BFI-2), the Basic Psychological Needs Satisfaction and Frustration Scale (BPNSFS), and the Karolinska Directed Emotional Faces set of stimuli (KDEF). The data was gathered using an online questionnaire provided directly to law enforcement agencies. A total of 154 law enforcement officers participated in the study, 50.65% were females, and 49.35% were males. The mean age was 41.2 (age range = 22–61). In order to analyze the data, SEM and multiple linear regression methods were used. Results: This study analyzed variables of motion recognition, personality traits, and needs satisfaction and confirmed that law enforcement officers’ personality traits play a significant role in emotion recognition. Respondents’ agreeableness significantly predicted increased overall emotion recognition; conscientiousness predicted increased anger recognition; joy recognition was significantly predicted by extraversion, neuroticism, and agreeableness. This study also confirmed that law enforcement officers’ basic psychological needs satisfaction/frustration play a significant role in emotion recognition. Respondents’ relatedness satisfaction significantly predicted increased overall emotion recognition, fear recognition, joy recognition, and sadness recognition. Relatedness frustration significantly predicted decreased anger recognition, surprise recognition, and neutral face recognition. Furthermore, this study confirmed links between law enforcement officers’ personality traits, satisfaction/frustration of basic psychological needs, and emotion recognition, χ2 = 57.924; df = 41; p = 0.042; TLI = 0.929; CFI = 0.956; RMSEA = 0.042 [0.009–0.065]. Discussion: The findings suggested that agreeableness, conscientiousness, extraversion, and neuroticism play an essential role in satisfaction and frustration of relatedness needs, which, subsequently, link to emotion recognition. Due to the relatively small sample size, the issues of validity/reliability of some instruments, and other limitations, the results of this study should preferably be regarded with concern.

Intra-individual Reliability of Voice- and Music-elicited Responses and their Modulation by Expertise

A growing number of functional neuroimaging studies have identified regions within the temporal lobe, particularly along the planum polare and planum temporale, that respond more strongly to music than other types of acoustic stimuli, including voice. This "music preferred" regions have been reported using a variety of stimulus sets, paradigms and analysis approaches and their consistency across studies confirmed through meta-analyses. However, the critical question of intra-subject reliability of these responses has received less attention. Here, we directly assessed this important issue by contrasting brain responses to musical vs. vocal stimuli in the same subjects across three consecutive fMRI runs, using different types of stimuli. Moreover, we investigated whether these music- and voice-preferred responses were reliably modulated by expertise. Results demonstrated that music-preferred activity previously reported in temporal regions, and its modulation by expertise, exhibits a high intra-subject reliability. However, we also found that activity in some extra-temporal regions, such as the precentral and middle frontal gyri, did depend on the particular stimuli employed, which may explain why these are less consistently reported in the literature. Taken together, our findings confirm and extend the notion that specific regions in the brain consistently respond more strongly to certain socially-relevant stimulus categories, such as faces, voices and music, but that some of these responses appear to depend, at least to some extent, on the specific features of the paradigm employed.

The automatic detection of unexpected emotion and neutral body postures: A visual mismatch negativity study

The ability to automatically detect emotional changes in the environment is crucial for social interaction. In the visual system, expression-related mismatch negativity (EMMN) reflects the automatic processing of emotional changes in facial expression. However, body postures also carry visual emotional information that can be recognized effectively and processed automatically, although their processing mechanism remains unknown. In this study, the reverse oddball paradigm was used to investigate the mismatch responses of unexpected fear and neutral body postures. The nonparametric cluster permutation test revealed significant fear and neutral visual mismatch negativity (vMMN) activities, and the fear-related vMMN was enhanced prior (130-230 ms) to the neutral vMMN (180-230 ms). The body-sensitive N190 component may partially account for the vMMN obtained in this study. The fearful body posture evoked a greater N190 response over the neutral body, and amplitudes of N190 were more negative in the deviant condition than the standard condition. Additionally, the body-related visual mismatch oscillatory responses were associated with enhancement of the alpha band oscillation, especially for the fearful body posture. These results expanded the applicable scope of body posture cues corresponding to mismatch signals, objectively defined the electrophysiological activities evoked, and revealed the processing bias toward negative emotion.

Differential beta desynchronisation responses to dynamic emotional facial expressions are attenuated in higher trait anxiety and autism

Daily life demands that we differentiate between a multitude of emotional facial expressions (EFEs). The mirror neuron system (MNS) is becoming increasingly implicated as a neural network involved with understanding emotional body expressions. However, the specificity of the MNS's involvement in emotion recognition has remained largely unexplored. This study investigated whether six basic dynamic EFEs (anger, disgust, fear, happiness, sadness, and surprise) would be differentiated through event-related desynchronisation (ERD) of sensorimotor alpha and beta oscillatory activity, which indexes sensorimotor MNS activity. We found that beta ERD differentiated happy, fearful, and sad dynamic EFEs at the central region of interest, but not at occipital regions. Happy EFEs elicited significantly greater central beta ERD relative to fearful and sad EFEs within 800 - 2,000 ms after EFE onset. These differences were source-localised to the primary somatosensory cortex, which suggests they are likely to reflect differential sensorimotor simulation rather than differential attentional engagement. Furthermore, individuals with higher trait anxiety showed less beta ERD differentiation between happy and sad faces. Similarly, individuals with higher trait autism showed less beta ERD differentiation between happy and fearful faces. These findings suggest that the differential simulation of specific affective states is attenuated in individuals with higher trait anxiety and autism. In summary, the MNS appears to support the skills needed for emotion processing in daily life, which may be influenced by certain individual differences. This provides novel evidence for the notion that simulation-based emotional skills may underlie the emotional difficulties that accompany affective disorders, such as anxiety.

Sensorimotor Activity and Network Connectivity to Dynamic and Static Emotional Faces in 7-Month-Old Infants

The present study investigated whether, as in adults, 7-month-old infants’ sensorimotor brain areas are recruited in response to the observation of emotional facial expressions. Activity of the sensorimotor cortex, as indexed by µ rhythm suppression, was recorded using electroencephalography (EEG) while infants observed neutral, angry, and happy facial expressions either in a static (N = 19) or dynamic (N = 19) condition. Graph theory analysis was used to investigate to which extent neural activity was functionally localized in specific cortical areas. Happy facial expressions elicited greater sensorimotor activation compared to angry faces in the dynamic experimental condition, while no difference was found between the three expressions in the static condition. Results also revealed that happy but not angry nor neutral expressions elicited a significant right-lateralized activation in the dynamic condition. Furthermore, dynamic emotional faces generated more efficient processing as they elicited higher global efficiency and lower networks’ diameter compared to static faces. Overall, current results suggest that, contrarily to neutral and angry faces, happy expressions elicit sensorimotor activity at 7 months and dynamic emotional faces are more efficiently processed by functional brain networks. Finally, current data provide evidence of the existence of a right-lateralized activity for the processing of happy facial expressions.

Do shapes have feelings? Social attribution in children with autism spectrum disorder and attention-deficit/hyperactivity disorder

Theory of mind (ToM) deficits are common in children with neurodevelopmental disorders (NDDs), such as autism spectrum disorder (ASD) and attention-deficit/hyperactivity disorder (ADHD), which contribute to their social and cognitive difficulties. The social attribution task (SAT) involves geometrical shapes moving in patterns that depict social interactions and is known to recruit brain regions from the classic ToM network. To better understand ToM in ASD and ADHD children, we examined the neural correlates using the SAT and functional magnetic resonance imaging (fMRI) in a cohort of 200 children: ASD (N = 76), ADHD (N = 74) and typically developing (TD; N = 50) (4-19 years). In the scanner, participants were presented with SAT videos corresponding to social help, social threat, and random conditions. Contrasting social vs. random, the ASD compared with TD children showed atypical activation in ToM brain areas-the middle temporal and anterior cingulate gyri. In the social help vs. social threat condition, atypical activation of the bilateral middle cingulate and right supramarginal and superior temporal gyri was shared across the NDD children, with between-diagnosis differences only being observed in the right fusiform. Data-driven subgrouping identified two distinct subgroups spanning all groups that differed in both their clinical characteristics and brain-behaviour relations with ToM ability.

Decoding the difference between explicit and implicit body expression representation in high level visual, prefrontal and inferior parietal cortex

Recent studies provide an increasing understanding of how visual objects categories like faces or bodies are represented in the brain and also raised the question whether a category based or more dynamic network inspired models are more powerful. Two important and so far sidestepped issues in this debate are, first, how major category attributes like the emotional expression directly influence category representation and second, whether category and attribute representation are sensitive to task demands. This study investigated the impact of a crucial category attribute like emotional expression on category area activity and whether this varies with the participants' task. Using (fMRI) we measured BOLD responses while participants viewed whole body expressions and performed either an explicit (emotion) or an implicit (shape) recognition task. Our results based on multivariate methods show that the type of task is the strongest determinant of brain activity and can be decoded in EBA, VLPFC and IPL. Brain activity was higher for the explicit task condition in VLPFC and was not emotion specific. This pattern suggests that during explicit recognition of the body expression, body category representation may be strengthened, and emotion and action related activity suppressed. Taken together these results stress the importance of the task and of the role of category attributes for understanding the functional organization of high level visual cortex.

A computational neuroethology perspective on body and expression perception

Survival prompts organisms to prepare adaptive behavior in response to environmental and social threat. However, what are the specific features of the appearance of a conspecific that trigger such adaptive behaviors? For social species, the prime candidates for triggering defense systems are the visual features of the face and the body. We propose a novel approach for studying the ability of the brain to gather survival-relevant information from seeing conspecific body features. Specifically, we propose that behaviorally relevant information from bodies and body expressions is coded at the levels of midlevel features in the brain. These levels are relatively independent from higher-order cognitive and conscious perception of bodies and emotions. Instead, our approach is embedded in an ethological framework and mobilizes computational models for feature discovery.

Does gaze direction of fearful faces facilitate the processing of threat? An ERP study of spatial precuing effects

Eye gaze is very important for attentional orienting in social life. By adopting the event-related potential (ERP) technique, we explored whether attentional orienting of eye gaze is modulated by emotional congruency between facial expressions and the targets in a spatial cuing task. Faces with different emotional expressions (fearful/angry/happy/neutral) directing their eye gaze to the left or right were used as cues, indicating the possible location of subsequent targets. Targets were line drawings of animals, which could be either threatening or neutral. Participants indicated by choice responses whether the animal would fit inside a shoebox in real life or not. Reaction times to targets were faster after valid compared with invalid cues, showing the typical eye gaze cuing effect. Analyses of the late positive potential (LPP) elicited by targets revealed a significant modulation of the gaze cuing effect by emotional congruency. Threatening targets elicited larger LPPs when validly cued by gaze in faces with negative (fearful and angry) expressions. Similarly, neutral targets showed larger LPPs when validly cued by faces with neutral expressions. Such effects were not present after happy face cues. Source localization in the LPP time window revealed that for threatening targets, the activity of right medial frontal gyrus could be related to a larger gaze-orienting effect for the fearful than the angry condition. Our findings provide electrophysiological evidence for the modulation of gaze cuing effects by emotional congruency.

Atypical spatiotemporal activation of cerebellar lobules during emotional face processing in adolescents with autism

Autism spectrum disorder (ASD) is characterized by social deficits and atypical facial processing of emotional expressions. The underlying neuropathology of these abnormalities is still unclear. Recent studies implicate cerebellum in emotional processing; other studies show cerebellar abnormalities in ASD. Here, we elucidate the spatiotemporal activation of cerebellar lobules in ASD during emotional processing of happy and angry faces in adolescents with ASD and typically developing (TD) controls. Using magnetoencephalography, we calculated dynamic statistical parametric maps across a period of 500 ms after emotional stimuli onset and determined differences between group activity to happy and angry emotions. Following happy face presentation, adolescents with ASD exhibited only left‐hemispheric cerebellar activation in a cluster extending from lobule VI to lobule V (compared to TD controls). Following angry face presentation, adolescents with ASD exhibited only midline cerebellar activation (posterior IX vermis). Our findings indicate an early (125–175 ms) overactivation in cerebellar activity only for happy faces and a later overactivation for both happy (250–450 ms) and angry (250–350 ms) faces in adolescents with ASD. The prioritized hemispheric activity (happy faces) could reflect the promotion of a more flexible and adaptive social behavior, while the latter midline activity (angry faces) may guide conforming behavior.

Pupillary Response to Affective Voices: Physiological Responsivity and Posttraumatic Stress Disorder

Posttraumatic stress disorder (PTSD) is related to dysfunctional emotional processing, thus motivating the search for physiological indices that can elucidate this process. Toward this aim, we compared pupillary response patterns in response to angry and fearful auditory stimuli among 99 adults, some with PTSD (n = 14), some trauma-exposed without PTSD (TE; n = 53), and some with no history of trauma exposure (CON; n = 32). We hypothesized that individuals with PTSD would show more pupillary response to angry and fearful auditory stimuli compared to those in the TE and CON groups. Among participants who had experienced a traumatic event, we explored the association between PTSD symptoms and pupillary response; contrary to our prediction, individuals with PTSD displayed the least pupillary response to fearful auditory stimuli compared those in the TE, B = -0.022, p = .077, and CON, B = -0.042, p = .002, groups, but they did not differ on angry auditory stimuli, B = 0.019, p = .118 and B = 0.006, p = .634, respectively. It is important to note that within-group analyses revealed that participants with PTSD differed significantly in their response to angry versus fearful stimuli, B = -0.032, p = .015. We also found a positive association between PTSD symptoms and pupillary response to angry stimuli. Our findings suggest that differential pupil response to anger and fear stimuli may be a promising way to understand emotional processing in PTSD.

Is the Putative Mirror Neuron System Associated with Empathy? A Systematic Review and Meta-Analysis

Theoretical perspectives suggest that the mirror neuron system (MNS) is an important neurobiological contributor to empathy, yet empirical support is mixed. Here, we adopt a summary model for empathy, consisting of motor, emotional, and cognitive components of empathy. This review provides an overview of existing empirical studies investigating the relationship between putative MNS activity and empathy in healthy populations. 52 studies were identified that investigated the association between the MNS and at least one domain of empathy, representing data from 1044 participants. Our results suggest that emotional and cognitive empathy are moderately correlated with MNS activity, however, these domains were mixed and varied across techniques used to acquire MNS activity (TMS, EEG, and fMRI). Few studies investigated motor empathy, and of those, no significant relationships were revealed. Overall, results provide preliminary evidence for a relationship between MNS activity and empathy. However, our findings highlight methodological variability in study design as an important factor in understanding this relationship. We discuss limitations regarding these methodological variations and important implications for clinical and community translations, as well as suggestions for future research.

Computation-Based Feature Representation of Body Expressions in the Human Brain

Humans and other primate species are experts at recognizing body expressions. To understand the underlying perceptual mechanisms, we computed postural and kinematic features from affective whole-body movement videos and related them to brain processes. Using representational similarity and multivoxel pattern analyses, we showed systematic relations between computation-based body features and brain activity. Our results revealed that postural rather than kinematic features reflect the affective category of the body movements. The feature limb contraction showed a central contribution in fearful body expression perception, differentially represented in action observation, motor preparation, and affect coding regions, including the amygdala. The posterior superior temporal sulcus differentiated fearful from other affective categories using limb contraction rather than kinematics. The extrastriate body area and fusiform body area also showed greater tuning to postural features. The discovery of midlevel body feature encoding in the brain moves affective neuroscience beyond research on high-level emotion representations and provides insights in the perceptual features that possibly drive automatic emotion perception.

Network level characteristics in the emotion recognition network after unilateral temporal lobe surgery

The human amygdala is considered a key region for successful emotion recognition. We recently reported that temporal lobe surgery (TLS), including resection of the amygdala, does not affect emotion recognition performance (Journal of Neuroscience, 2018, 38, 9263). In the present study, we investigate the neural basis of this preserved function at the network level. We use generalized psychophysiological interaction and graph theory indices to investigate network level characteristics of the emotion recognition network in TLS patients and healthy controls. Based on conflicting emotion processing theories, we anticipated two possible outcomes: a substantial increase of the non-amygdalar connections of the emotion recognition network to compensate functionally for the loss of the amygdala, in line with basic emotion theory versus only minor changes in network level properties as predicted by psychological construction theory. We defined the emotion recognition network in the total sample and investigated group differences on five network level indices (i.e. characteristic path length, global efficiency, clustering coefficient, local efficiency and small-worldness). The results did not reveal a significant increase in the left or right temporal lobectomy group (compared to the control group) in any of the graph measures, indicating that preserved behavioural emotion recognition in TLS is not associated with a massive connectivity increase between non-amygdalar nodes at network level. We conclude that the emotion recognition network is robust and functionally able to compensate for structural damage without substantial global reorganization, in line with a psychological construction theory.

A neurocognitive model of perceptual decision-making on emotional signals

Humans make various kinds of decisions about which emotions they perceive from others. Although it might seem like a split-second phenomenon, deliberating over which emotions we perceive unfolds across several stages of decisional processing. Neurocognitive models of general perception postulate that our brain first extracts sensory information about the world then integrates these data into a percept and lastly interprets it. The aim of the present study was to build an evidence-based neurocognitive model of perceptual decision-making on others' emotions. We conducted a series of meta-analyses of neuroimaging data spanning 30 years on the explicit evaluations of others' emotional expressions. We find that emotion perception is rather an umbrella term for various perception paradigms, each with distinct neural structures that underline task-related cognitive demands. Furthermore, the left amygdala was responsive across all classes of decisional paradigms, regardless of task-related demands. Based on these observations, we propose a neurocognitive model that outlines the information flow in the brain needed for a successful evaluation of and decisions on other individuals' emotions. HIGHLIGHTS: Emotion classification involves heterogeneous perception and decision-making tasks Decision-making processes on emotions rarely covered by existing emotions theories We propose an evidence-based neuro-cognitive model of decision-making on emotions Bilateral brain processes for nonverbal decisions, left brain processes for verbal decisions Left amygdala involved in any kind of decision on emotions.

Amygdala functional connectivity in the acute aftermath of trauma prospectively predicts severity of posttraumatic stress symptoms

Understanding neural mechanisms that confer risk for posttraumatic stress disorder (PTSD) is critical for earlier intervention, yet longitudinal work has been sparse. The amygdala is part of a core network consistently implicated in PTSD symptomology. Most neural models of PTSD have focused on the amygdala's interactions with the dorsal anterior cingulate cortex, ventromedial prefrontal cortex, and hippocampus. However, an increasing number of studies have linked PTSD symptoms to aberrations in amygdala functional connections with other brain regions involved in emotional information processing, self-referential processing, somatosensory processing, visual processing, and motor control. In the current study, trauma-exposed individuals (N = 54) recruited from the emergency department completed a resting state fMRI scan as well as a script-driven trauma recall fMRI task scan two-weeks post-trauma along with demographic, PTSD, and other clinical symptom questionnaires two-weeks and six-months post-trauma. We examined whether amygdala-whole brain functional connectivity (FC) during rest and task could predict six-month post-trauma PTSD symptoms. More negative amygdala-cerebellum and amygdala-postcentral gyrus FC during rest as well as more negative amygdala-postcentral gyrus and amygdala-midcingulate cortex during recall of the trauma memory predicted six-month post-trauma PTSD after controlling for scanner type. Follow-up multiple regression sensitivity analyses controlling for several other relevant predictors of PTSD symptoms, revealed that amygdala-cerebellum FC during rest and amygdala-postcentral gyrus FC during trauma recall were particularly robust predictors of six-month PTSD symptoms. The results extend cross-sectional studies implicating abnormal FC of the amygdala with other brain regions involved in somatosensory processing, motor control, and emotional information processing in PTSD, to the prospective prediction of risk for chronic PTSD. This work may contribute to earlier identification of at-risk individuals and elucidate potential intervention targets.

Interactions between emotion and action in the brain

A growing literature supports the existence of interactions between emotion and action in the brain, and the central participation of the anterior midcingulate cortex (aMCC) in this regard. In the present functional magnetic resonance imaging study, we sought to investigate the role of self-relevance during such interactions by varying the context in which threating pictures were presented (with guns pointed towards or away from the observer). Participants performed a simple visual detection task following exposure to such stimuli. Except for voxelwise tests, we adopted a Bayesian analysis framework which evaluated evidence for the hypotheses of interest, given the data, in a continuous fashion. Behaviorally, our results demonstrated a valence by context interaction such that there was a tendency of speeding up responses to targets after viewing threat pictures directed towards the participant. In the brain, interaction patterns that paralleled those observed behaviorally were observed most notably in the middle temporal gyrus, supplementary motor area, precentral gyrus, and anterior insula. In these regions, activity was overall greater during threat conditions relative to neutral ones, and this effect was enhanced in the directed towards context. A valence by context interaction was observed in the aMCC too, where we also observed a correlation (across participants) of evoked responses and reaction time data. Taken together, our study revealed the context-sensitive engagement of motor-related areas during emotional perception, thus supporting the idea that emotion and action interact in important ways in the brain.

Expanding Simulation Models of Emotional Understanding: The Case for Different Modalities, Body-State Simulation Prominence, and Developmental Trajectories

Recent models of emotion recognition suggest that when people perceive an emotional expression, they partially activate the respective emotion in themselves, providing a basis for the recognition of that emotion. Much of the focus of these models and of their evidential basis has been on sensorimotor simulation as a basis for facial expression recognition - the idea, in short, that coming to know what another feels involves simulating in your brain the motor plans and associated sensory representations engaged by the other person's brain in producing the facial expression that you see. In this review article, we argue that simulation accounts of emotion recognition would benefit from three key extensions. First, that fuller consideration be given to simulation of bodily and vocal expressions, given that the body and voice are also important expressive channels for providing cues to another's emotional state. Second, that simulation of other aspects of the perceived emotional state, such as changes in the autonomic nervous system and viscera, might have a more prominent role in underpinning emotion recognition than is typically proposed. Sensorimotor simulation models tend to relegate such body-state simulation to a subsidiary role, despite the plausibility of body-state simulation being able to underpin emotion recognition in the absence of typical sensorimotor simulation. Third, that simulation models of emotion recognition be extended to address how embodied processes and emotion recognition abilities develop through the lifespan. It is not currently clear how this system of sensorimotor and body-state simulation develops and in particular how this affects the development of emotion recognition ability. We review recent findings from the emotional body recognition literature and integrate recent evidence regarding the development of mimicry and interoception to significantly expand simulation models of emotion recognition.

Quantifying the individual auditory and visual brain response in 7-month-old infants watching a brief cartoon movie

Electroencephalography (EEG) continues to be the most popular method to investigate cognitive brain mechanisms in young children and infants. Most infant studies rely on the well-established and easy-to-use event-related brain potential (ERP). As a severe disadvantage, ERP computation requires a large number of repetitions of items from the same stimulus-category, compromising both ERPs' reliability and their ecological validity in infant research. We here explore a way to investigate infant continuous EEG responses to an ongoing, engaging signal (i.e., "neural tracking") by using multivariate temporal response functions (mTRFs), an approach increasingly popular in adult EEG research. N = 52 infants watched a 5-min episode of an age-appropriate cartoon while the EEG signal was recorded. We estimated and validated forward encoding models of auditory-envelope and visual-motion features. We compared individual and group-based ('generic') models of the infant brain response to comparison data from N = 28 adults. The generic model yielded clearly defined response functions for both, the auditory and the motion regressor. Importantly, this response profile was present also on an individual level, albeit with lower precision of the estimate but above-chance predictive accuracy for the modelled individual brain responses. In sum, we demonstrate that mTRFs are a feasible way of analyzing continuous EEG responses in infants. We observe robust response estimates both across and within participants from only 5 min of recorded EEG signal. Our results open ways for incorporating more engaging and more ecologically valid stimulus materials when probing cognitive, perceptual, and affective processes in infants and young children.

'Something in the way you move': Infants are sensitive to emotions conveyed in action kinematics

Body movements, as well as faces, communicate emotions. Research in adults has shown that the perception of action kinematics has a crucial role in understanding others' emotional experiences. Still, little is known about infants' sensitivity to body emotional expressions, since most of the research in infancy focused on faces. While there is some first evidence that infants can recognize emotions conveyed in whole-body postures, it is still an open question whether they can extract emotional information from action kinematics. We measured electromyographic (EMG) activity over the muscles involved in happy (zygomaticus major, ZM), angry (corrugator supercilii, CS) and fearful (frontalis, F) facial expressions, while 11-month-old infants observed the same action performed with either happy or angry kinematics. Results demonstrate that infants responded to angry and happy kinematics with matching facial reactions. In particular, ZM activity increased while CS activity decreased in response to happy kinematics and vice versa for angry kinematics. Our results show for the first time that infants can rely on kinematic information to pick up on the emotional content of an action. Thus, from very early in life, action kinematics represent a fundamental and powerful source of information in revealing others' emotional state.

Emotional faces guide the eyes in the absence of awareness

The ability to act quickly to a threat is a key skill for survival. Under awareness, threat-related emotional information, such as an angry or fearful face, has not only perceptual advantages but also guides rapid actions such as eye movements. Emotional information that is suppressed from awareness still confers perceptual and attentional benefits. However, it is unknown whether suppressed emotional information can directly guide actions, or whether emotional information has to enter awareness to do so. We suppressed emotional faces from awareness using continuous flash suppression and tracked eye gaze position. Under successful suppression, as indicated by objective and subjective measures, gaze moved towards fearful faces, but away from angry faces. Our findings reveal that: (1) threat-related emotional stimuli can guide eye movements in the absence of visual awareness; (2) threat-related emotional face information guides distinct oculomotor actions depending on the type of threat conveyed by the emotional expression.

Emotional Contrast and Psychological Function Impact Response Inhibition to Threatening Faces

Poor inhibitory control over negative emotional information has been identified as a possible contributor to affective disorders, but the distinct effects of emotional contrast and fearful versus angry faces on response inhibition remain unknown. In the present study, young adults completed an emotional go/no-go task involving happy, neutral, and either fearful or angry faces. Results did not reveal differences in accuracy or speed between angry and fearful face conditions. However, responses were slower and indicated poorer inhibition in blocks where threatening faces were paired with happy, versus neutral, faces. Results may reflect cognitive load of emotional valence contrast, such that higher contrast blocks (containing threatening with happy faces) produced more conflict and required more processing than lower contrast blocks (threatening with neutral faces). Preliminary findings also revealed higher anxiety and depression symptoms corresponded with slower responses and worse accuracy, consistent with patterns of adverse impacts of anxiety and depression on response inhibition to threatening faces, even at subclinical levels of symptomatology.

The Developmental Origins of the Social Brain: Empathy, Morality, and Justice

The social brain is the cornerstone that effectively negotiates and navigates complex social environments and relationships. When mature, these social abilities facilitate the interaction and cooperation with others. Empathy, morality, and justice, among others, are all closely intertwined, yet the relationships between them are quite complex. They are fundamental components of our human nature, and shape the landscape of our social lives. The various facets of empathy, including affective arousal/emotional sharing, empathic concern, and perspective taking, have unique contributions as subcomponents of morality. This review helps understand how basic forms of empathy, morality, and justice are substantialized in early ontogeny. It provides valuable information as to gain new insights into the underlying neurobiological precursors of the social brain, enabling future translation toward therapeutic and medical interventions.

Neural Underpinnings of the Perception of Emotional States Derived From Biological Human Motion: A Review of Neuroimaging Research

Research on the perception of biological human motion shows that people are able to infer emotional states by observing body movements. This article reviews the methodology applied in fMRI research on the neural representation of such emotion perception. Specifically, we ask how different stimulus qualities of bodily expressions, individual emotional valence, and task instructions may affect the neural representation of an emotional scene. The review demonstrates the involvement of a variety of brain areas, thereby indicating how well the human brain is adjusted to navigate in multiple social situations. All stimulus categories (i.e., full-light body displays, point-light displays, and avatars) can induce an emotional percept and are associated with increased activation in an extensive neural network. This network seems to be organized around areas belonging to the so-called action observation network (PMC, IFG, and IPL) and the mentalizing network (TPJ, TP, dmPFC, and lOFC) as well as areas processing body form and motion (e.g., EBA, FBA, and pSTS). Furthermore, emotion-processing brain sites such as the amygdala and the hypothalamus seem to play an important role during the observation of emotional body expressions. Whereas most brain regions clearly display an increased response to emotional body movements in general, some structures respond selectively to negative valence. Moreover, neural activation seems to depend on task characteristics, indicating that certain structures are activated even when attention is shifted away from emotional body movements.