Association of trait emotional intelligence and individual fMRI-activation patterns during the perception of social signals from voice and face

Pre-COVID brain network topology prospectively predicts social anxiety alterations during the COVID-19 pandemic

Background

Social anxiety (SA) is a negative emotional response that can lead to mental health issues, which some have experienced during the coronavirus disease 2019 (COVID-19) pandemic. Little attention has been given to the neurobiological mechanisms underlying inter-individual differences in SA alterations related to COVID-19. This study aims to identify neurofunctional markers of COVID-specific SA development.

Methods

110 healthy participants underwent resting-state magnetic resonance imaging and behavioral tests before the pandemic (T1, October 2019 to January 2020) and completed follow-up behavioral measurements during the pandemic (T2, February to May 2020). We constructed individual functional networks and used graph theoretical analysis to estimate their global and nodal topological properties, then used Pearson correlation and partial least squares correlations examine their associations with COVID-specific SA alterations.

Results

In terms of global network parameters, SA alterations (T2-T1) were negatively related to pre-pandemic brain small-worldness and normalized clustering coefficient. In terms of nodal network parameters, SA alterations were positively linked to a pronounced degree centrality pattern, encompassing both the high-level cognitive networks (dorsal attention network, cingulo-opercular task control network, default mode network, memory retrieval network, fronto-parietal task control network, and subcortical network) and low-level perceptual networks (sensory/somatomotor network, auditory network, and visual network). These findings were robust after controlling for pre-pandemic general anxiety, other stressful life events, and family socioeconomic status, as well as by treating SA alterations as categorical variables.

Conclusions

The individual functional network associated with SA alterations showed a disrupted topological organization with a more random state, which may shed light on the neurobiological basis of COVID-related SA changes at the network level.

Structural equation modeling of female gait attractiveness using gait kinematics

In our social lives, movement's attractiveness greatly affects interpersonal cognition, and gait kinematics mediates walkers' attractiveness. However, no model using gait kinematics has so far predicted gait attractiveness. Thus, this study constructed models of female gait attractiveness with gait kinematics and physique factors as explanatory variables for both barefoot and high-heel walking. First, using motion capture data from 17 women walking, including seven professional runway models, we created gait animations. We also calculated the following gait kinematics as candidate variables to explain walking's attractiveness: four body-silhouette-related variables and six health-related variables. Then, 60 observers evaluated each gait animation's attractiveness and femininity. We performed correlation analysis between these variables and evaluation scores to obtain explanatory variables. Structural equation modeling suggested two models for gait attractiveness, one composed of trunk and head silhouette factors and the other of physique, trunk silhouette, and health-related gait factors. The study's results deepened our understanding of mechanisms behind nonverbal interpersonal cognition through physical movement and brought us closer to realization of artificial generation of attractive gait motions.

Neural Representation of Collective Self-esteem in Resting-state Functional Connectivity and its Validation in Task-dependent Modality

INTRODUCTION

Collective self-esteem (CSE) is an important personality variable, defined as self-worth derived from membership in social groups. A study explored the neural basis of CSE using a task-based functional magnetic resonance imaging (fMRI) paradigm; however, task-independent neural basis of CSE remains to be explored, and whether the CSE neural basis of resting-state fMRI is consistent with that of task-based fMRI is unclear.

METHODS

We built support vector regression (SVR) models to predict CSE scores using topological metrics measured in the resting-state functional connectivity network (RSFC) as features. Then, to test the reliability of the SVR analysis, the activation pattern of the identified brain regions from SVR analysis was used as features to distinguish collective self-worth from other conditions by multivariate pattern classification in task-based fMRI dataset.

RESULTS

SVR analysis results showed that leverage centrality successfully decoded the individual differences in CSE. The ventromedial prefrontal cortex, anterior cingulate cortex, posterior cingulate gyrus, precuneus, orbitofrontal cortex, posterior insula, postcentral gyrus, inferior parietal lobule, temporoparietal junction, and inferior frontal gyrus, which are involved in self-referential processing, affective processing, and social cognition networks, participated in this prediction. Multivariate pattern classification analysis found that the activation pattern of the identified regions from the SVR analysis successfully distinguished collective self-worth from relational self-worth, personal self-worth and semantic control.

CONCLUSION

Our findings revealed CSE neural basis in the whole-brain RSFC network, and established the concordance between leverage centrality and the activation pattern (evoked during collective self-worth task) of the identified regions in terms of representing CSE.

Emotional intelligence mediates the protective role of the orbitofrontal cortex spontaneous activity measured by fALFF against depressive and anxious symptoms in late adolescence

As a stable personality construct, trait emotional intelligence (TEI) refers to a battery of perceived emotion-related skills that make individuals behave effectively to adapt to the environment and maintain well-being. Abundant evidence has consistently shown that TEI is important for the outcomes of many mental health issues, particularly depression and anxiety. However, the neural substrates involved in TEI and the underlying neurobehavioral mechanism of how TEI reduces depression and anxiety symptoms remain largely unknown. Herein, resting-state functional magnetic resonance imaging and a group of behavioral measures were applied to examine these questions among a large sample comprising 231 general adolescent students aged 16-20 years (52% female). Whole-brain correlation analysis and prediction analysis demonstrated that TEI was negatively linked with spontaneous activity (measured with the fractional amplitude of low-frequency fluctuations) in the bilateral medial orbitofrontal cortex (OFC), a critical site implicated in emotion-related processes. Furthermore, structural equation modeling analysis found that TEI mediated the link of OFC spontaneous activity to depressive and anxious symptoms. Collectively, the current findings present new evidence for the neurofunctional bases of TEI and suggest a potential "brain-personality-symptom" pathway for alleviating depressive and anxious symptoms among students in late adolescence.

Neural correlates of multisensory integration in the human brain: an ALE meta-analysis

Previous fMRI research identified superior temporal sulcus as central integration area for audiovisual stimuli. However, less is known about a general multisensory integration network across senses. Therefore, we conducted activation likelihood estimation meta-analysis with multiple sensory modalities to identify a common brain network. We included 49 studies covering all Aristotelian senses i.e., auditory, visual, tactile, gustatory, and olfactory stimuli. Analysis revealed significant activation in bilateral superior temporal gyrus, middle temporal gyrus, thalamus, right insula, and left inferior frontal gyrus. We assume these regions to be part of a general multisensory integration network comprising different functional roles. Here, thalamus operate as first subcortical relay projecting sensory information to higher cortical integration centers in superior temporal gyrus/sulcus while conflict-processing brain regions as insula and inferior frontal gyrus facilitate integration of incongruent information. We additionally performed meta-analytic connectivity modelling and found each brain region showed co-activations within the identified multisensory integration network. Therefore, by including multiple sensory modalities in our meta-analysis the results may provide evidence for a common brain network that supports different functional roles for multisensory integration.

Resting-state BOLD temporal variability in sensorimotor and salience networks underlies trait emotional intelligence and explains differences in emotion regulation strategies

A converging body of behavioural findings supports the hypothesis that the dispositional use of emotion regulation (ER) strategies depends on trait emotional intelligence (trait EI) levels. Unfortunately, neuroscientific investigations of such relationship are missing. To fill this gap, we analysed trait measures and resting state data from 79 healthy participants to investigate whether trait EI and ER processes are associated to similar neural circuits. An unsupervised machine learning approach (independent component analysis) was used to decompose resting-sate functional networks and to assess whether they predict trait EI and specific ER strategies. Individual differences results showed that high trait EI significantly predicts and negatively correlates with the frequency of use of typical dysfunctional ER strategies. Crucially, we observed that an increased BOLD temporal variability within sensorimotor and salience networks was associated with both high trait EI and the frequency of use of cognitive reappraisal. By contrast, a decreased variability in salience network was associated with the use of suppression. These findings support the tight connection between trait EI and individual tendency to use functional ER strategies, and provide the first evidence that modulations of BOLD temporal variability in specific brain networks may be pivotal in explaining this relationship.

Neural Basis of Impaired Emotion Recognition in Adult Attention-Deficit/Hyperactivity Disorder

BACKGROUND

Deficits in emotion recognition have been repeatedly documented in patients diagnosed with attention-deficit/hyperactivity disorder (ADHD), but their neural basis is unknown so far.

METHODS

In the current study, adult patients with ADHD (n = 44) and healthy control subjects (n = 43) underwent functional magnetic resonance imaging during explicit emotion recognition of stimuli expressing affective information in face, voice, or face-voice combinations. The employed experimental paradigm allowed us to delineate areas for processing audiovisual information based on their functional activation profile, including the bilateral posterior superior temporal gyrus/middle temporal gyrus, amygdala, medial prefrontal cortex, and precuneus, as well as the right posterior thalamus.

RESULTS

As expected, unbiased hit rates for correct classification of the expressed emotions were lower in patients with ADHD than in healthy control subjects irrespective of the presented sensory modality. This deficit at a behavioral level was accompanied by lower activation in patients with ADHD versus healthy control subjects in the cortex adjacent to the right superior temporal gyrus/middle temporal gyrus and the right posterior thalamus, which represent key areas for processing socially relevant signals and their integration across modalities. A cortical region adjacent to the right posterior superior temporal gyrus was the only brain region that showed a significant correlation between brain activation and emotion identification performance.

CONCLUSIONS

Altogether, these results provide the first evidence for a potential neural substrate of the observed impairments in emotion recognition in adults with ADHD.

Correlates of individual voice and face preferential responses during resting state

Human nonverbal social signals are transmitted to a large extent by vocal and facial cues. The prominent importance of these cues is reflected in specialized cerebral regions which preferentially respond to these stimuli, e.g. the temporal voice area (TVA) for human voices and the fusiform face area (FFA) for human faces. But it remained up to date unknown whether there are respective specializations during resting state, i.e. in the absence of any cues, and if so, whether these representations share neural substrates across sensory modalities. In the present study, resting state functional connectivity (RSFC) as well as voice- and face-preferential activations were analysed from functional magnetic resonance imaging (fMRI) data sets of 60 healthy individuals. Data analysis comprised seed-based analyses using the TVA and FFA as regions of interest (ROIs) as well as multi voxel pattern analyses (MVPA). Using the face- and voice-preferential responses of the FFA and TVA as regressors, we identified several correlating clusters during resting state spread across frontal, temporal, parietal and occipital regions. Using these regions as seeds, characteristic and distinct network patterns were apparent with a predominantly convergent pattern for the bilateral TVAs whereas a largely divergent pattern was observed for the bilateral FFAs. One region in the anterior medial frontal cortex displayed a maximum of supramodal convergence of informative connectivity patterns reflecting voice- and face-preferential responses of both TVAs and the right FFA, pointing to shared neural resources in supramodal voice and face processing. The association of individual voice- and face-preferential neural activity with resting state connectivity patterns may support the perspective of a network function of the brain beyond an activation of specialized regions.

ERP Markers of Valence Coding in Emotional Speech Processing

How is auditory emotional information processed? The study's aim was to compare cerebral responses to emotionally positive or negative spoken phrases matched for structure and content. Twenty participants listened to 198 vocal stimuli while detecting filler phrases containing first names. EEG was recorded from 128 sites. Three event-related potential (ERP) components were quantified and found to be sensitive to emotional valence since 350 ms of latency. P450 and late positivity were enhanced by positive content, whereas anterior negativity was larger to negative content. A similar set of markers (P300, N400, LP) was found previously for the processing of positive versus negative affective vocalizations, prosody, and music, which suggests a common neural mechanism for extracting the emotional content of auditory information. SwLORETA applied to potentials recorded between 350 and 550 ms showed that negative speech activated the right temporo/parietal areas (BA40, BA20/21), whereas positive speech activated the left homologous and inferior frontal areas.

The Neural Correlates of Face-Voice-Integration in Social Anxiety Disorder

Faces and voices are very important sources of threat in social anxiety disorder (SAD), a common psychiatric disorder where core elements are fears of social exclusion and negative evaluation. Previous research in social anxiety evidenced increased cerebral responses to negative facial or vocal expressions and also generally increased hemodynamic responses to voices and faces. But it is unclear if also the cerebral process of face-voice-integration is altered in SAD. Applying functional magnetic resonance imaging, we investigated the correlates of the audiovisual integration of dynamic faces and voices in SAD as compared to healthy individuals. In the bilateral midsections of the superior temporal sulcus (STS) increased integration effects in SAD were observed driven by greater activation increases during audiovisual stimulation as compared to auditory stimulation. This effect was accompanied by increased functional connectivity with the visual association cortex and a more anterior position of the individual integration maxima along the STS in SAD. These findings demonstrate that the audiovisual integration of facial and vocal cues in SAD is not only systematically altered with regard to intensity and connectivity but also the individual location of the integration areas within the STS. These combined findings offer a novel perspective on the neuronal representation of social signal processing in individuals suffering from SAD.

Affective iconic words benefit from additional sound-meaning integration in the left amygdala

Recent studies have shown that a similarity between sound and meaning of a word (i.e., iconicity) can help more readily access the meaning of that word, but the neural mechanisms underlying this beneficial role of iconicity in semantic processing remain largely unknown. In an fMRI study, we focused on the affective domain and examined whether affective iconic words (e.g., high arousal in both sound and meaning) activate additional brain regions that integrate emotional information from different domains (i.e., sound and meaning). In line with our hypothesis, affective iconic words, compared to their non‐iconic counterparts, elicited additional BOLD responses in the left amygdala known for its role in multimodal representation of emotions. Functional connectivity analyses revealed that the observed amygdalar activity was modulated by an interaction of iconic condition and activations in two hubs representative for processing sound (left superior temporal gyrus) and meaning (left inferior frontal gyrus) of words. These results provide a neural explanation for the facilitative role of iconicity in language processing and indicate that language users are sensitive to the interaction between sound and meaning aspect of words, suggesting the existence of iconicity as a general property of human language.

Polygenic Score of Subjective Well-Being Is Associated with the Brain Morphology in Superior Temporal Gyrus and Insula

Subjective well-being (SWB) is closely related to our physical and mental health. Existing studies show that neural or genetic basis underpins individual difference in SWB. Moreover, researchers have found high enrichment of SWB-related mutations in the central nervous system, but the relationship between the genetic architecture of SWB and brain morphology has not been explored. Considering the polygenic nature of SWB, in this study, we aim to establish a measure of additive genetic effect on SWB and explore its relationship to the brain anatomical structure. Based on the results of genome-wide association study (GWAS) on SWB, the polygenic scores (PGSs) of SWB at eight different thresholds were calculated in a large Chinese sample (N = 585). Then, we analyzed the associations between the PGSs of SWB and cortical thickness (CT) or gray matter volume (GMV) measured from 3.0-T structural imaging data. In whole-brain analyses, we found that a higher PGS was significantly associated with increased CT in the right superior temporal gyrus (STG) and GMV in the right insula, both of which are involved in social cognition and emotional processing. More importantly, these findings were repeatable at some different thresholds. The results may suggest that the brain morphology of right STG and insula is partly regulated by SWB-related genetic factors.

Near-infrared spectroscopy reveals neural perception of vocal emotions in human neonates

Processing affective prosody, that is the emotional tone of a speaker, is fundamental to human communication and adaptive behaviors. Previous studies have mainly focused on adults and infants; thus the neural mechanisms underlying the processing of affective prosody in newborns remain unclear. Here, we used near-infrared spectroscopy to examine the ability of 0-to-4-day-old neonates to discriminate emotions conveyed by speech prosody in their maternal language and a foreign language. Happy, fearful, and angry prosodies enhanced neural activation in the right superior temporal gyrus relative to neutral prosody in the maternal but not the foreign language. Happy prosody elicited greater activation than negative prosody in the left superior frontal gyrus and the left angular gyrus, regions that have not been associated with affective prosody processing in infants or adults. These findings suggest that sensitivity to affective prosody is formed through prenatal exposure to vocal stimuli of the maternal language. Furthermore, the sensitive neural correlates appeared more distributed in neonates than infants, indicating a high-level of neural specialization between the neonatal stage and early infancy. Finally, neonates showed preferential neural responses to positive over negative prosody, which is contrary to the "negativity bias" phenomenon established in adult and infant studies.

Cerebral resting state markers of biased perception in social anxiety

Social anxiety (SA) comprises a multitude of persistent fears around the central element of dreaded negative evaluation and exclusion. This very common anxiety is spectrally distributed among the general population and associated with social perception biases deemed causal in its maintenance. Here, we investigated cerebral resting state markers linking SA and biased social perception. To this end, resting state functional connectivity (RSFC) was assessed as the neurobiological marker in a study population with greatly varying SA using fMRI in the first step of the experiment. One month later the impact of unattended laughter-exemplifying social threat-on a face rating task was evaluated as a measure of biased social perception. Applying a dimensional approach, SA-related cognitive biases tied to the valence, dominance and arousal of the threat signal and their underlying RSFC patterns among central nodes of the cerebral emotion, voice and face processing networks were identified. In particular, the connectivity patterns between the amygdalae and the right temporal voice area met all criteria for a cerebral mediation of the association between SA and the laughter valence-related interpretation bias. Thus, beyond this identification of non-state-dependent cerebral markers of biased perception in SA, this study highlights both a starting point and targets for future research on the causal relationships between cerebral connectivity patterns, SA and biased perception, potentially via neurofeedback methods.

Neurobiological correlates of emotional intelligence in voice and face perception networks

Facial expressions and voice modulations are among the most important communicational signals to convey emotional information. The ability to correctly interpret this information is highly relevant for successful social interaction and represents an integral component of emotional competencies that have been conceptualized under the term emotional intelligence. Here, we investigated the relationship of emotional intelligence as measured with the Salovey-Caruso-Emotional-Intelligence-Test (MSCEIT) with cerebral voice and face processing using functional and structural magnetic resonance imaging. MSCEIT scores were positively correlated with increased voice-sensitivity and gray matter volume of the insula accompanied by voice-sensitivity enhanced connectivity between the insula and the temporal voice area, indicating generally increased salience of voices. Conversely, in the face processing system, higher MSCEIT scores were associated with decreased face-sensitivity and gray matter volume of the fusiform face area. Taken together, these findings point to an alteration in the balance of cerebral voice and face processing systems in the form of an attenuated face-vs-voice bias as one potential factor underpinning emotional intelligence.

Examining Brain Structures Associated With Emotional Intelligence and the Mediated Effect on Trait Creativity in Young Adults

Little is known about the association between emotional intelligence (EI) and trait creativity (TC), and the brain structural bases which involves. This study investigated the neuroanatomical basis of the association between EI and TC which measured by the Schutte self-report EI scale and the Williams creativity aptitude test. First, the voxel-based morphometry (VBM) analysis was used to explore the brain structures which is closely related to EI in a large young sample (n = 213). The results showed that EI was positively correlated with the regional gray matter volume (rGMV) in the right orbitofrontal cortex (OFC), which is regarded as a key region of emotional processing. More importantly, further mediation analysis revealed that rGMV in the right OFC partially mediated the association between EI and TC, which showed the OFC volume could account for the relationship between EI and TC. These findings confirmed the close relationship between EI and TC, and highlighted that the brain volumetric variation in the OFC associated with the top-down processing of emotion regulation, which may play a critical role in the promotion of TC. Together, these findings contributed to sharpening the understanding of the complex relationship between EI and TC from the perspective of brain structural basis.

Speech Prosodies of Different Emotional Categories Activate Different Brain Regions in Adult Cortex: an fNIRS Study

Emotional expressions of others embedded in speech prosodies are important for social interactions. This study used functional near-infrared spectroscopy to investigate how speech prosodies of different emotional categories are processed in the cortex. The results demonstrated several cerebral areas critical for emotional prosody processing. We confirmed that the superior temporal cortex, especially the right middle and posterior parts of superior temporal gyrus (BA 22/42), primarily works to discriminate between emotional and neutral prosodies. Furthermore, the results suggested that categorization of emotions occurs within a high-level brain region–the frontal cortex, since the brain activation patterns were distinct when positive (happy) were contrasted to negative (fearful and angry) prosody in the left middle part of inferior frontal gyrus (BA 45) and the frontal eye field (BA8), and when angry were contrasted to neutral prosody in bilateral orbital frontal regions (BA 10/11). These findings verified and extended previous fMRI findings in adult brain and also provided a “developed version” of brain activation for our following neonatal study.

Dynamic Reconfiguration of the Supplementary Motor Area Network during Imagined Music Performance

The supplementary motor area (SMA) has been shown to be the center for motor planning and is active during music listening and performance. However, limited data exist on the role of the SMA in music. Music performance requires complex information processing in auditory, visual, spatial, emotional, and motor domains, and this information is integrated for the performance. We hypothesized that the SMA is engaged in multimodal integration of information, distributed across several regions of the brain to prepare for ongoing music performance. To test this hypothesis, functional networks involving the SMA were extracted from functional magnetic resonance imaging (fMRI) data that were acquired from musicians during imagined music performance and during the resting state. Compared with the resting condition, imagined music performance increased connectivity of the SMA with widespread regions in the brain including the sensorimotor cortices, parietal cortex, posterior temporal cortex, occipital cortex, and inferior and dorsolateral prefrontal cortex. Increased connectivity of the SMA with the dorsolateral prefrontal cortex suggests that the SMA is under cognitive control, while increased connectivity with the inferior prefrontal cortex suggests the involvement of syntax processing. Increased connectivity with the parietal cortex, posterior temporal cortex, and occipital cortex is likely for the integration of spatial, emotional, and visual information. Finally, increased connectivity with the sensorimotor cortices was potentially involved with the translation of thought planning into motor programs. Therefore, the reconfiguration of the SMA network observed in this study is considered to reflect the multimodal integration required for imagined and actual music performance. We propose that the SMA network construct “the internal representation of music performance” by integrating multimodal information required for the performance.

The Language, Tone and Prosody of Emotions: Neural Substrates and Dynamics of Spoken-Word Emotion Perception

Rapid assessment of emotions is important for detecting and prioritizing salient input. Emotions are conveyed in spoken words via verbal and non-verbal channels that are mutually informative and unveil in parallel over time, but the neural dynamics and interactions of these processes are not well understood. In this paper, we review the literature on emotion perception in faces, written words, and voices, as a basis for understanding the functional organization of emotion perception in spoken words. The characteristics of visual and auditory routes to the amygdala—a subcortical center for emotion perception—are compared across these stimulus classes in terms of neural dynamics, hemispheric lateralization, and functionality. Converging results from neuroimaging, electrophysiological, and lesion studies suggest the existence of an afferent route to the amygdala and primary visual cortex for fast and subliminal processing of coarse emotional face cues. We suggest that a fast route to the amygdala may also function for brief non-verbal vocalizations (e.g., laugh, cry), in which emotional category is conveyed effectively by voice tone and intensity. However, emotional prosody which evolves on longer time scales and is conveyed by fine-grained spectral cues appears to be processed via a slower, indirect cortical route. For verbal emotional content, the bulk of current evidence, indicating predominant left lateralization of the amygdala response and timing of emotional effects attributable to speeded lexical access, is more consistent with an indirect cortical route to the amygdala. Top-down linguistic modulation may play an important role for prioritized perception of emotions in words. Understanding the neural dynamics and interactions of emotion and language perception is important for selecting potent stimuli and devising effective training and/or treatment approaches for the alleviation of emotional dysfunction across a range of neuropsychiatric states.

Recruitment of Language-, Emotion- and Speech-Timing Associated Brain Regions for Expressing Emotional Prosody: Investigation of Functional Neuroanatomy with fMRI

We aimed to progress understanding of prosodic emotion expression by establishing brain regions active when expressing specific emotions, those activated irrespective of the target emotion, and those whose activation intensity varied depending on individual performance. BOLD contrast data were acquired whilst participants spoke non-sense words in happy, angry or neutral tones, or performed jaw-movements. Emotion-specific analyses demonstrated that when expressing angry prosody, activated brain regions included the inferior frontal and superior temporal gyri, the insula, and the basal ganglia. When expressing happy prosody, the activated brain regions also included the superior temporal gyrus, insula, and basal ganglia, with additional activation in the anterior cingulate. Conjunction analysis confirmed that the superior temporal gyrus and basal ganglia were activated regardless of the specific emotion concerned. Nevertheless, disjunctive comparisons between the expression of angry and happy prosody established that anterior cingulate activity was significantly higher for angry prosody than for happy prosody production. Degree of inferior frontal gyrus activity correlated with the ability to express the target emotion through prosody. We conclude that expressing prosodic emotions (vs. neutral intonation) requires generic brain regions involved in comprehending numerous aspects of language, emotion-related processes such as experiencing emotions, and in the time-critical integration of speech information.

'Emotional Intelligence': Lessons from Lesions

'Emotional intelligence' (EI) is one of the most highly used psychological terms in popular nomenclature, yet its construct, divergent, and predictive validities are contentiously debated. Despite this debate, the EI construct is composed of a set of emotional abilities - recognizing emotional states in the self and others, using emotions to guide thought and behavior, understanding how emotions shape behavior, and emotion regulation - that undoubtedly influence important social and personal outcomes. In this review, evidence from human lesion studies is reviewed in order to provide insight into the necessary brain regions for each of these core emotional abilities. Critically, we consider how this neuropsychological evidence might help to guide efforts to define and measure EI.

Developments in Trait Emotional Intelligence Research

Trait emotional intelligence (“trait EI”) concerns our perceptions of our emotional abilities, that is, how good we believe we are in terms of understanding, regulating, and expressing emotions in order to adapt to our environment and maintain well-being. In this article, we present succinct summaries of selected findings from research on (a) the location of trait EI in personality factor space, (b) the biological underpinnings of the construct, (c) indicative applications in the areas of clinical, health, social, educational, organizational, and developmental psychology, and (d) trait EI training. Findings to date suggest that individual differences in trait EI are a consistent predictor of human behavior across the life span.

The sound of emotions-Towards a unifying neural network perspective of affective sound processing

Affective sounds are an integral part of the natural and social environment that shape and influence behavior across a multitude of species. In human primates, these affective sounds span a repertoire of environmental and human sounds when we vocalize or produce music. In terms of neural processing, cortical and subcortical brain areas constitute a distributed network that supports our listening experience to these affective sounds. Taking an exhaustive cross-domain view, we accordingly suggest a common neural network that facilitates the decoding of the emotional meaning from a wide source of sounds rather than a traditional view that postulates distinct neural systems for specific affective sound types. This new integrative neural network view unifies the decoding of affective valence in sounds, and ascribes differential as well as complementary functional roles to specific nodes within a common neural network. It also highlights the importance of an extended brain network beyond the central limbic and auditory brain systems engaged in the processing of affective sounds.

Association between Ability Emotional Intelligence and Left Insula during Social Judgment of Facial Emotions

The human ability of identifying, processing and regulating emotions from social stimuli is generally referred as Emotional Intelligence (EI). Within EI, Ability EI identifies a performance measure assessing individual skills at perceiving, using, understanding and managing emotions. Previous models suggest that a brain "somatic marker circuitry" (SMC) sustains emotional sub-processes included in EI. Three primary brain regions are included: the amygdala, the insula and the ventromedial prefrontal cortex (vmPFC). Here, our aim was to investigate the relationship between Ability EI scores and SMC activity during social judgment of emotional faces. Sixty-three healthy subjects completed a test measuring Ability EI and underwent fMRI during a social decision task (i.e. approach or avoid) about emotional faces with different facial expressions. Imaging data revealed that EI scores are associated with left insula activity during social judgment of emotional faces as a function of facial expression. Specifically, higher EI scores are associated with greater left insula activity during social judgment of fearful faces but also with lower activity of this region during social judgment of angry faces. These findings indicate that the association between Ability EI and the SMC activity during social behavior is region- and emotion-specific.

The neural basis of trait self-esteem revealed by the amplitude of low-frequency fluctuations and resting state functional connectivity

Self-esteem is an affective, self-evaluation of oneself and has a significant effect on mental and behavioral health. Although research has focused on the neural substrates of self-esteem, little is known about the spontaneous brain activity that is associated with trait self-esteem (TSE) during the resting state. In this study, we used the resting-state functional magnetic resonance imaging (fMRI) signal of the amplitude of low-frequency fluctuations (ALFFs) and resting state functional connectivity (RSFC) to identify TSE-related regions and networks. We found that a higher level of TSE was associated with higher ALFFs in the left ventral medial prefrontal cortex (vmPFC) and lower ALFFs in the left cuneus/lingual gyrus and right lingual gyrus. RSFC analyses revealed that the strengths of functional connectivity between the left vmPFC and bilateral hippocampus were positively correlated with TSE; however, the connections between the left vmPFC and right inferior frontal gyrus and posterior superior temporal sulcus were negatively associated with TSE. Furthermore, the strengths of functional connectivity between the left cuneus/lingual gyrus and right dorsolateral prefrontal cortex and anterior cingulate cortex were positively related to TSE. These findings indicate that TSE is linked to core regions in the default mode network and social cognition network, which is involved in self-referential processing, autobiographical memory and social cognition.

The role of the medial temporal limbic system in processing emotions in voice and music

Subcortical brain structures of the limbic system, such as the amygdala, are thought to decode the emotional value of sensory information. Recent neuroimaging studies, as well as lesion studies in patients, have shown that the amygdala is sensitive to emotions in voice and music. Similarly, the hippocampus, another part of the temporal limbic system (TLS), is responsive to vocal and musical emotions, but its specific roles in emotional processing from music and especially from voices have been largely neglected. Here we review recent research on vocal and musical emotions, and outline commonalities and differences in the neural processing of emotions in the TLS in terms of emotional valence, emotional intensity and arousal, as well as in terms of acoustic and structural features of voices and music. We summarize the findings in a neural framework including several subcortical and cortical functional pathways between the auditory system and the TLS. This framework proposes that some vocal expressions might already receive a fast emotional evaluation via a subcortical pathway to the amygdala, whereas cortical pathways to the TLS are thought to be equally used for vocal and musical emotions. While the amygdala might be specifically involved in a coarse decoding of the emotional value of voices and music, the hippocampus might process more complex vocal and musical emotions, and might have an important role especially for the decoding of musical emotions by providing memory-based and contextual associations.

Crossmodal adaptation in right posterior superior temporal sulcus during face-voice emotional integration

The integration of emotional information from the face and voice of other persons is known to be mediated by a number of "multisensory" cerebral regions, such as the right posterior superior temporal sulcus (pSTS). However, whether multimodal integration in these regions is attributable to interleaved populations of unisensory neurons responding to face or voice or rather by multimodal neurons receiving input from the two modalities is not fully clear. Here, we examine this question using functional magnetic resonance adaptation and dynamic audiovisual stimuli in which emotional information was manipulated parametrically and independently in the face and voice via morphing between angry and happy expressions. Healthy human adult subjects were scanned while performing a happy/angry emotion categorization task on a series of such stimuli included in a fast event-related, continuous carryover design. Subjects integrated both face and voice information when categorizing emotion-although there was a greater weighting of face information-and showed behavioral adaptation effects both within and across modality. Adaptation also occurred at the neural level: in addition to modality-specific adaptation in visual and auditory cortices, we observed for the first time a crossmodal adaptation effect. Specifically, fMRI signal in the right pSTS was reduced in response to a stimulus in which facial emotion was similar to the vocal emotion of the preceding stimulus. These results suggest that the integration of emotional information from face and voice in the pSTS involves a detectable proportion of bimodal neurons that combine inputs from visual and auditory cortices.

Dissociating task difficulty from incongruence in face-voice emotion integration

In the everyday environment, affective information is conveyed by both the face and the voice. Studies have demonstrated that a concurrently presented voice can alter the way that an emotional face expression is perceived, and vice versa, leading to emotional conflict if the information in the two modalities is mismatched. Additionally, evidence suggests that incongruence of emotional valence activates cerebral networks involved in conflict monitoring and resolution. However, it is currently unclear whether this is due to task difficulty—that incongruent stimuli are harder to categorize—or simply to the detection of mismatching information in the two modalities. The aim of the present fMRI study was to examine the neurophysiological correlates of processing incongruent emotional information, independent of task difficulty. Subjects were scanned while judging the emotion of face-voice affective stimuli. Both the face and voice were parametrically morphed between anger and happiness and then paired in all audiovisual combinations, resulting in stimuli each defined by two separate values: the degree of incongruence between the face and voice, and the degree of clarity of the combined face-voice information. Due to the specific morphing procedure utilized, we hypothesized that the clarity value, rather than incongruence value, would better reflect task difficulty. Behavioral data revealed that participants integrated face and voice affective information, and that the clarity, as opposed to incongruence value correlated with categorization difficulty. Cerebrally, incongruence was more associated with activity in the superior temporal region, which emerged after task difficulty had been accounted for. Overall, our results suggest that activation in the superior temporal region in response to incongruent information cannot be explained simply by task difficulty, and may rather be due to detection of mismatching information between the two modalities.

Non-verbal emotion communication training induces specific changes in brain function and structure

The perception of emotional cues from voice and face is essential for social interaction. However, this process is altered in various psychiatric conditions along with impaired social functioning. Emotion communication trainings have been demonstrated to improve social interaction in healthy individuals and to reduce emotional communication deficits in psychiatric patients. Here, we investigated the impact of a non-verbal emotion communication training (NECT) on cerebral activation and brain structure in a controlled and combined functional magnetic resonance imaging (fMRI) and voxel-based morphometry study. NECT-specific reductions in brain activity occurred in a distributed set of brain regions including face and voice processing regions as well as emotion processing- and motor-related regions presumably reflecting training-induced familiarization with the evaluation of face/voice stimuli. Training-induced changes in non-verbal emotion sensitivity at the behavioral level and the respective cerebral activation patterns were correlated in the face-selective cortical areas in the posterior superior temporal sulcus and fusiform gyrus for valence ratings and in the temporal pole, lateral prefrontal cortex and midbrain/thalamus for the response times. A NECT-induced increase in gray matter (GM) volume was observed in the fusiform face area. Thus, NECT induces both functional and structural plasticity in the face processing system as well as functional plasticity in the emotion perception and evaluation system. We propose that functional alterations are presumably related to changes in sensory tuning in the decoding of emotional expressions. Taken together, these findings highlight that the present experimental design may serve as a valuable tool to investigate the altered behavioral and neuronal processing of emotional cues in psychiatric disorders as well as the impact of therapeutic interventions on brain function and structure.

Show me how you walk and I tell you how you feel - a functional near-infrared spectroscopy study on emotion perception based on human gait

The ability to recognize and adequately interpret emotional states in others plays a fundamental role in regulating social interaction. Body language presents an essential element of nonverbal communication which is often perceived prior to mimic expression. However, the neural networks that underlie the processing of emotionally expressive body movement and body posture are poorly understood. 33 healthy subjects have been investigated using the optically based imaging method functional near-infrared spectroscopy (fNIRS) during the performance of a newly developed emotion discrimination paradigm consisting of faceless avatars expressing fearful, angry, sad, happy or neutral gait patterns. Participants were instructed to judge (a) the presented emotional state (emotion task) and (b) the observed walking speed of the respective avatar (speed task). We measured increases in cortical oxygenated haemoglobin (O2HB) in response to visual stimulation during emotion discrimination. These O2HB concentration changes were enhanced for negative emotions in contrast to neutral gait sequences in right occipito-temporal and left temporal and temporo-parietal brain regions. Moreover, fearful and angry bodies elicited higher activation increases during the emotion task compared to the speed task. Haemodynamic responses were correlated with a number of behavioural measures, whereby a positive relationship between emotion regulation strategy preference and O2HB concentration increases after sad walks was mediated by the ability to accurately categorize sad walks. Our results support the idea of a distributed brain network involved in the recognition of bodily emotion expression that comprises visual association areas as well as body/movement perception specific cortical regions that are also sensitive to emotion. This network is activated less when the emotion is not intentionally processed (i.e. during the speed task). Furthermore, activity of this perceptive network is, mediated by the ability to correctly recognize emotions, indirectly connected to active emotion regulation processes. We conclude that a full understanding of emotion perception and its neural substrate requires the investigation of dynamic representations and means of expression other than the face.

People-selectivity, audiovisual integration and heteromodality in the superior temporal sulcus

The functional role of the superior temporal sulcus (STS) has been implicated in a number of studies, including those investigating face perception, voice perception, and face–voice integration. However, the nature of the STS preference for these ‘social stimuli’ remains unclear, as does the location within the STS for specific types of information processing. The aim of this study was to directly examine properties of the STS in terms of selective response to social stimuli. We used functional magnetic resonance imaging (fMRI) to scan participants whilst they were presented with auditory, visual, or audiovisual stimuli of people or objects, with the intention of localising areas preferring both faces and voices (i.e., ‘people-selective’ regions) and audiovisual regions designed to specifically integrate person-related information. Results highlighted a ‘people-selective, heteromodal’ region in the trunk of the right STS which was activated by both faces and voices, and a restricted portion of the right posterior STS (pSTS) with an integrative preference for information from people, as compared to objects. These results point towards the dedicated role of the STS as a ‘social-information processing’ centre.

Experimental and clinical usefulness of crossmodal paradigms in psychiatry: an illustration from emotional processing in alcohol-dependence

Crossmodal processing (i.e., the construction of a unified representation stemming from distinct sensorial modalities inputs) constitutes a crucial ability in humans' everyday life. It has been extensively explored at cognitive and cerebral levels during the last decade among healthy controls. Paradoxically however, and while difficulties to perform this integrative process have been suggested in a large range of psychopathological states (e.g., schizophrenia and autism), these crossmodal paradigms have been very rarely used in the exploration of psychiatric populations. The main aim of the present paper is thus to underline the experimental and clinical usefulness of exploring crossmodal processes in psychiatry. We will illustrate this proposal by means of the recent data obtained in the crossmodal exploration of emotional alterations in alcohol-dependence. Indeed, emotional decoding impairments might have a role in the development and maintenance of alcohol-dependence, and have been extensively investigated by means of experiments using separated visual or auditory stimulations. Besides these unimodal explorations, we have recently conducted several studies using audio-visual crossmodal paradigms, which has allowed us to improve the ecological validity of the unimodal experimental designs and to offer new insights on the emotional alterations among alcohol-dependent individuals. We will show how these preliminary results can be extended to develop a coherent and ambitious research program using crossmodal designs in various psychiatric populations and sensory modalities. We will finally end the paper by underlining the various potential clinical applications and the fundamental implications that can be raised by this emerging project.

Uni- and multisensory brain areas are synchronised across spectators when watching unedited dance recordings

The superior temporal sulcus (STS) and gyrus (STG) are commonly identified to be functionally relevant for multisensory integration of audiovisual (AV) stimuli. However, most neuroimaging studies on AV integration used stimuli of short duration in explicit evaluative tasks. Importantly though, many of our AV experiences are of a long duration and ambiguous. It is unclear if the enhanced activity in audio, visual, and AV brain areas would also be synchronised over time across subjects when they are exposed to such multisensory stimuli. We used intersubject correlation to investigate which brain areas are synchronised across novices for uni- and multisensory versions of a 6-min 26-s recording of an unfamiliar, unedited Indian dance recording (Bharatanatyam). In Bharatanatyam, music and dance are choreographed together in a highly intermodal-dependent manner. Activity in the middle and posterior STG was significantly correlated between subjects and showed also significant enhancement for AV integration when the functional magnetic resonance signals were contrasted against each other using a general linear model conjunction analysis. These results extend previous studies by showing an intermediate step of synchronisation for novices: while there was a consensus across subjects' brain activity in areas relevant for unisensory processing and AV integration of related audio and visual stimuli, we found no evidence for synchronisation of higher level cognitive processes, suggesting these were idiosyncratic.

Crossmodal interactions in audiovisual emotion processing

Emotion in daily life is often expressed in a multimodal fashion. Consequently emotional information from one modality can influence processing in another. In a previous fMRI study we assessed the neural correlates of audio-visual integration and found that activity in the left amygdala is significantly attenuated when a neutral stimulus is paired with an emotional one compared to conditions where emotional stimuli were present in both channels. Here we used dynamic causal modelling to investigate the effective connectivity in the neuronal network underlying this emotion presence congruence effect. Our results provided strong evidence in favor of a model family, differing only in the interhemispheric interactions. All winning models share a connection from the bilateral fusiform gyrus (FFG) into the left amygdala and a non-linear modulatory influence of bilateral posterior superior temporal sulcus (pSTS) on these connections. This result indicates that the pSTS not only integrates multi-modal information from visual and auditory regions (as reflected in our model by significant feed-forward connections) but also gates the influence of the sensory information on the left amygdala, leading to attenuation of amygdala activity when a neutral stimulus is integrated. Moreover, we found a significant lateralization of the FFG due to stronger driving input by the stimuli (faces) into the right hemisphere, whereas such lateralization was not present for sound-driven input into the superior temporal gyrus. In summary, our data provides further evidence for a rightward lateralization of the FFG and in particular for a key role of the pSTS in the integration and gating of audio-visual emotional information.

Supramodal representation of emotions

Supramodal representation of emotion and its neural substrates have recently attracted attention as a marker of social cognition. However, the question whether perceptual integration of facial and vocal emotions takes place in primary sensory areas, multimodal cortices, or in affective structures remains unanswered yet. Using novel computer-generated stimuli, we combined emotional faces and voices in congruent and incongruent ways and assessed functional brain data (fMRI) during an emotional classification task. Both congruent and incongruent audiovisual stimuli evoked larger responses in thalamus and superior temporal regions compared with unimodal conditions. Congruent emotions were characterized by activation in amygdala, insula, ventral posterior cingulate (vPCC), temporo-occipital, and auditory cortices; incongruent emotions activated a frontoparietal network and bilateral caudate nucleus, indicating a greater processing load in working memory and emotion-encoding areas. The vPCC alone exhibited differential reactions to congruency and incongruency for all emotion categories and can thus be considered a central structure for supramodal representation of complex emotional information. Moreover, the left amygdala reflected supramodal representation of happy stimuli. These findings document that emotional information does not merge at the perceptual audiovisual integration level in unimodal or multimodal areas, but in vPCC and amygdala.

Trait Emotional Intelligence and the Big Five

Trait emotional intelligence (EI) is a constellation of emotion-related self-perceptions located at the lower levels of personality hierarchies. This article examines the validity of the Trait Emotional Intelligence Questionnaire–Child Form and investigates its relationships with Big Five factors and cognitive ability. A total of 690 children (317 Males; M Age = 10.25 years; SD = 1.58 years) completed the TEIQue-CF, the Raven Progressive, Matrices and the Big Five Questionnaire; in addition, a subsample of 136 participants answered to Depression and Anxiety scales. Results evidenced that TEIQue-CF is a reliable measure of Trait EI that is partially determined by all of the Big Five factors but independent of cognitive ability. Trait EI predicts depression and anxiety scores over and above the five higher order personality dimensions.

Preattentive processing of audio-visual emotional signals

Previous research has shown that redundant information in faces and voices leads to faster emotional categorization compared to incongruent emotional information even when attending to only one modality. The aim of the present study was to test whether these crossmodal effects are predominantly due to a response conflict rather than interference at earlier, e.g. perceptual processing stages. In Experiment 1, participants had to categorize the valence and rate the intensity of happy, sad, angry and neutral unimodal or bimodal face-voice stimuli. They were asked to rate either the facial or vocal expression and ignore the emotion expressed in the other modality. Participants responded faster and more precisely to emotionally congruent compared to incongruent face-voice pairs in both the Attend Face and in the Attend Voice condition. Moreover, when attending to faces, emotionally congruent bimodal stimuli were more efficiently processed than unimodal visual stimuli. To study the role of a possible response conflict, Experiment 2 used a modified paradigm in which emotional and response conflicts were disentangled. Incongruency effects were significant even in the absence of response conflicts. The results suggest that emotional signals available through different sensory channels are automatically combined prior to response selection.