Interactions between emotion and action in the brain

Depicting Coupling Between Cortical Morphology and Functional Networks in Major Depressive Disorder

An enduring mystery in neuroscience is the intricate interplay between brain anatomical structure and functional dynamics, particularly in the context of mental disorders such as major depressive disorder (MDD). A pivotal scientific question arises: How does the cortical morphology-function coupling (MFC) manifest in MDD, and what insights can this coupling provide into the clinical manifestations of the disorder? To tackle this question, we conducted a comprehensive analysis using high-resolution T1-weighted structural magnetic resonance imaging (MRI) and resting-state functional MRI (rs-fMRI) data from a cohort of 830 MDD patients and 853 healthy control (HC). By constructing morphological and functional networks based on cortical gray matter (GM) morphology and regional rs-fMRI time series correlations, respectively, we aimed to quantify MFC by assessing the spatial correspondence between these networks. Results revealed that MDD patients exhibited a spatial hierarchical pattern of MFC similar to HC, with variations in specific networks. Specifically, lower coupling was observed in the visual network (VIS) and sensorimotor network (SMN), while higher coupling was noted in the default mode network (DMN) and frontoparietal network (FPN). Notably, MDD patients demonstrated significantly increased MFC within the VIS, SMN, and dorsal attention network (DAN) compared to HC. Furthermore, altered MFC in the VIS correlated positively with depressive symptom severity. These findings contribute to our understanding of the potential clinical significance of MFC alterations in MDD.

Transdiagnostic and Disorder-specific Neural Correlates of Emotion Processing in Major Depressive Disorder and Borderline Personality Disorder: Coordinate-based and Image-based Comparative Meta-Analyses

BACKGROUND

Major Depressive Disorder (MDD) and Borderline Personality Disorder (BPD) involve substantial impairments in negative and positive emotions processing. This meta-analysis aims to identify both transdiagnostic and disorder-specific neural abnormalities during the processing of negative and positive stimuli for MDD and BPD.

METHODS

The current coordinate-based and image-based meta-analyses comprised 42 fMRI studies involving MDD (42 Negative studies vs. 22 Positive studies; 1,532 MDD patients vs. 1,481 healthy controls) and 25 involving BPD (23 Negative studies vs. 7 Positive studies; 522 BPD patients vs. 519 healthy controls).

RESULTS

Compared to healthy controls, MDD patients exhibited hyporeactivity in left precentral gyrus during negative emotion processing, and decreased activation in left temporal lobe, insula, and bilateral anterior cingulate cortex during positive emotion processing, while BPD patients displayed hyperreactivity in left hippocampus and amygdala and hyporeactivity in right inferior frontal gyrus during negative emotion processing. Compared to BPD, MDD exhibited greater hyporeactivity in bilateral anterior cingulate cortex during negative emotion processing and in left middle temporal gyrus during positive emotion processing. The transdiagnostic hyporeactivity of BPD and MDD was mainly located in left inferior and right middle frontal gyrus during negative emotion processing.

CONCLUSIONS

Our findings highlight both distinct and transdiagnostic neural mechanisms of emotion processing for MDD and BPD.

Examining anterior prefrontal cortex resting-state functional connectivity patterns associated with depressive symptoms in chronic moderate-to-severe traumatic brain injury

In chronic moderate-to-severe TBI (msTBI), depression is one of the most common psychiatric consequences. Yet to date, there is limited understanding of its neural underpinnings. This study aimed to better understand this gap by examining seed-to-voxel connectivity in depression, with all voxel-wise associations seeded to the bilateral anterior prefrontal cortices (aPFC). In a secondary analysis of 32 patients with chronic msTBI and 17 age-matched controls acquired from the Toronto Rehab TBI Recovery Study database, the Personality Assessment Inventory Depression scale scores were used to group patients into an msTBI-Dep group (T ≥ 60; n = 13) and an msTBI-Non-Dep group (T < 60; n = 19). Resting-state fMRI scans were analyzed using seed-based connectivity analyses. F-tests, controlling for age and education, were used to assess differences in bilateral aPFC rsFC across the 3 groups. After nonparametric permutation testing, the left aPFC demonstrated significantly increased rsFC with the left (p = 0.041) and right (p = 0.013) fusiform gyri, the right superior temporal lobe (p = 0.032), and the right precentral gyrus (p = 0.042) in the msTBI-Dep group compared to controls. The msTBI-Non-Dep group had no significant rsFC differences with either group. To our knowledge, this study is the first to examine aPFC rsFC in a sample of patients with msTBI exclusively. Our preliminary findings suggest a role for the aPFC in the pathophysiology of depressive symptoms in patients with chronic msTBI. Increased aPFC-sensory/motor rsFC could be associated with vulnerability to depression post-TBI, a hypothesis that warrants further investigation.

Threat directionality modulates defensive reactions in humans: cardiac and electrodermal responses

Features of threatening cues and the associated context influence the perceived imminence of threat and the defensive responses evoked. To provide additional knowledge about how the directionality of a threat (i.e. directed-towards or away from the viewer) might impact defensive responses in humans, participants were shown pictures of a man carrying a gun (threat) or nonlethal object (neutral) directed-away from or towards the participant. Cardiac and electrodermal responses were collected. Compared to neutral images, threatening images depicting a gun directed-towards the participant induced sustained bradycardia and an increased electrodermal response, interpreted as immobility under attack. This defensive immobility reaction is evoked by high perceived threat and inescapable situations and indicates intense action preparation. Pictures of guns directed-away from the participant induced shorter bradycardia and no significant modulation of the electrodermal response compared to neutral pictures, which might be consistent with the perception of a less threatening situation. The results show that the directionality of threat stimuli is a key factor that prompts different patterns of defensive responses.

Maternal prenatal depressive symptoms and child brain responses to affective touch at two years of age

BACKGROUND

Touch is an essential form of mother-child interaction, instigating better social bonding and emotional stability.

METHODS

We used diffuse optical tomography to explore the relationship between total haemoglobin (HbT) responses to affective touch in the child's brain at two years of age and maternal self-reported prenatal depressive symptoms (EPDS). Affective touch was implemented via slow brushing of the child's right forearm at 3 cm/s and non-affective touch via fast brushing at 30 cm/s and HbT responses were recorded on the left hemisphere.

RESULTS

We discovered a cluster in the postcentral gyrus exhibiting a negative correlation (Pearson's r = -0.84, p = 0.015 corrected for multiple comparisons) between child HbT response to affective touch and EPDS at gestational week 34. Based on region of interest (ROI) analysis, we found negative correlations between child responses to affective touch and maternal prenatal EPDS at gestational week 14 in the precentral gyrus, Rolandic operculum and secondary somatosensory cortex. The responses to non-affective touch did not correlate with EPDS in these regions.

LIMITATIONS

The number of mother-child dyads was 16. However, by utilising high-density optode arrangements, individualised anatomical models, and video and accelerometry to monitor movement, we were able to minimize methodological sources of variability in the data.

CONCLUSIONS

The results show that maternal depressive symptoms during pregnancy may be associated with reduced child responses to affective touch in the temporoparietal cortex. Responses to affective touch may be considered as potential biomarkers for psychosocial development in children. Early identification of and intervention in maternal depression may be important already during early pregnancy.

Prioritized neural processing of social threats during perceptual decision-making

Emotional signals, notably those signaling threat, benefit from prioritized processing in the human brain. Yet, it remains unclear whether perceptual decisions about the emotional, threat-related aspects of stimuli involve specific or similar neural computations compared to decisions about their non-threatening/non-emotional components. We developed a novel behavioral paradigm in which participants performed two different detection tasks (emotion vs. color) on the same, two-dimensional visual stimuli. First, electroencephalographic (EEG) activity in a cluster of central electrodes reflected the amount of perceptual evidence around 100 ms following stimulus onset, when the decision concerned emotion, not color. Second, participants' choice could be predicted earlier for emotion (240 ms) than for color (380 ms) by the mu (10 Hz) rhythm, which reflects motor preparation. Taken together, these findings indicate that perceptual decisions about threat-signaling dimensions of facial displays are associated with prioritized neural coding in action-related brain regions, supporting the motivational value of socially relevant signals.

The role of pre-supplementary motor cortex in action control with emotional stimuli: A repetitive transcranial magnetic stimulation study

Swiftly halting ongoing motor actions is essential to react to unforeseen and potentially perilous circumstances. However, the neural bases subtending the complex interplay between emotions and motor control have been scarcely investigated. Here, we used an emotional stop signal task (SST) to investigate whether specific neural circuits engaged by action suppression are differently modulated by emotional signals with respect to neutral ones. Participants performed an SST before and after the administration of one session of repetitive transcranial magnetic stimulation (rTMS) over the pre-supplementary motor cortex (pre-SMA), the right inferior frontal gyrus (rIFG), and the left primary motor cortex (lM1). Results show that rTMS over the pre-SMA improved the ability to inhibit prepotent action (i.e., better action control) when emotional stimuli were presented. In contrast, action control in a neutral context was fostered by rTMS over the rIFG. No changes were observed after lM1 stimulation. Intriguingly, individuals with higher impulsivity traits exhibited enhanced motor control when facing neutral stimuli following rIFG stimulation. These results further our understanding of the interplay between emotions and motor functions, shedding light on the selective modulation of neural pathways underpinning these processes.

Sex differences in the effects of individual anxiety state on regional responses to negative emotional scenes

BACKGROUND

Men and women are known to show differences in the incidence and clinical manifestations of mood and anxiety disorders. Many imaging studies have investigated the neural correlates of sex differences in emotion processing. However, it remains unclear how anxiety might impact emotion processing differently in men and women.

METHOD

We recruited 119 healthy adults and assessed their levels of anxiety using State-Trait Anxiety Inventory (STAI) State score. With functional magnetic resonance imaging (fMRI), we examined regional responses to negative vs. neutral (Neg-Neu) picture matching in the Hariri task. Behavioral data were analyzed using regression and repeated-measures analysis of covariance with age as a covariate, and fMRI data were analyzed using a full-factorial model with sex as a factor and age as a covariate.

RESULTS

Men and women did not differ in STAI score, or accuracy rate or reaction time (RT) (Neg-Neu). However, STAI scores correlated positively with RT (Neg-Neu) in women but not in men. Additionally, in women, STAI score correlated positively with lingual gyrus (LG) and negatively with medial prefrontal cortex (mPFC) and superior frontal gyrus (SFG) activity during Neg vs. Neu trials. The parameter estimates (βs) of mPFC also correlated with RT (Neg-Neu) in women but not in men. Generalized psychophysiological interaction (gPPI) analysis in women revealed mPFC connectivity with the right inferior frontal gyrus, right SFG, and left parahippocampal gyrus during Neg vs. Neu trials in positive correlation with both STAI score and RT (Neg-Neu). In a mediation analysis, mPFC gPPI but not mPFC activity fully mediated the association between STAI scores and RT (Neg-Neu).

CONCLUSION

With anxiety affecting the behavioral and neural responses to negative emotions in women but not in men and considering the known roles of the mPFC in emotion regulation, we discussed heightened sensitivity and regulatory demands during negative emotion processing as neurobehavioral markers of anxiety in women.

Intermuscular coherence reveals that affective emotional pictures modulate neural control mechanisms during the initiation of arm pointing movements

Introduction

Several studies in psychology provided compelling evidence that emotions significantly impact motor control. Yet, these evidences mostly rely on behavioral investigations, whereas the underlying neurophysiological processes remain poorly understood.

Methods

Using a classical paradigm in motor control, we tested the impact of affective pictures associated with positive, negative or neutral valence on the kinematics and patterns of muscle activations of arm pointing movements performed from a standing position. The hand reaction and movement times were measured and electromyography (EMG) was used to measure the activities from 10 arm, leg and trunk muscles that are involved in the postural maintenance and arm displacement in pointing movements. Intermuscular coherence (IMC) between pairs of muscles was computed to measure changes in patterns of muscle activations related to the emotional stimuli.

Results

The hand movement time increased when an emotional picture perceived as unpleasant was presented as compared to when the emotional picture was perceived as pleasant. When an unpleasant emotional picture was presented, beta (β, 15-35 Hz) and gamma (γ, 35-60 Hz) IMC decreased in the recorded pairs of postural muscles during the initiation of pointing movements. Moreover, a linear relationship between the magnitude of the intermuscular coherence in the pairs of posturo-focal muscles and the hand movement time was found in the unpleasant scenarios.

Discussion

These findings reveal that emotional stimuli can significantly affect the content of the motor command sent by the central nervous system to muscles when performing voluntary goal-directed movements.

An Event-Related Potential (ERP) Examination of the Neural Responses to Emotional and Movement-Related Images

Previous research has suggested that the perception of emotional images may also activate brain regions related to the preparation of motoric plans. However, little research has investigated whether these emotion-movement interactions occur at early or later stages of visual perception. In the current research, event-related potentials (ERPs) were used to examine the time course of the independent - and combined - effects of perceiving emotions and implied movement. Twenty-five participants viewed images from four categories: 1) emotional with implied movement, 2) emotional with no implied movement, 3) neutral with implied movement, and 4) neutral with no implied movement. Both emotional stimuli and movement-related stimuli led to larger N200 (200-300 ms) waveforms. Furthermore, at frontal sites, there was a marginal interaction between emotion and implied movement, such that negative stimuli showed greater N200 amplitudes vs. neutral stimuli, but only for images with implied movement. At posterior sites, a similar effect was observed for images without implied movement. The late positive potential (LPP; 500-1000 ms) was significant for emotion (at frontal sites) and movement (at frontal, central, and posterior sites), as well as for their interaction (at parietal sites), with larger LPPs for negative vs. neutral images with movement only. Together, these results suggest that the perception of emotion and movement interact at later stages of visual perception.

Sex differences in the effects of individual anxiety state on regional responses to negative emotional scenes

Background

Men and women are known to show differences in the incidence and clinical manifestations of mood and anxiety disorders. Many imaging studies have investigated the neural correlates of sex differences in emotion processing. However, it remains unclear how anxiety might impact emotion processing differently in men and women.

Method

We recruited 119 healthy adults and assessed their levels of anxiety using State-Trait Anxiety Inventory (STAI) State score. With functional magnetic resonance imaging (fMRI), we examined regional responses to negative vs. neutral (Neg-Neu) picture matching in the Hariri task. Behavioral data were analyzed using regression and repeated-measures analysis of covariance with age as a covariate, and fMRI data were analyzed using a full-factorial model with sex as a factor and age as a covariate.

Results

Men and women did not differ in STAI score, or accuracy rate or reaction time (RT) (Neg-Neu). However, STAI scores correlated positively with RT (Neg-Neu) in women but not in men. Additionally, in women, STAI score correlated positively with lingual gyrus (LG) and negatively with medial prefrontal cortex (mPFC) and superior frontal gyrus (SFG) activity during Neg vs. Neu trials. The parameter estimates (β's) of mPFC also correlated with RT (Neg-Neu) in women but not in men. Generalized psychophysiological interaction (gPPI) analysis in women revealed mPFC connectivity with the right inferior frontal gyrus, right SFG, and left parahippocampal gyrus during Neg vs. Neu trials in positive correlation with both STAI score and RT (Neg-Neu). In a mediation analysis, mPFC gPPI but not mPFC activity fully mediated the association between STAI scores and RT (Neg-Neu).

Conclusion

With anxiety affecting the behavioral and neural responses to negative emotions in women but not in men and considering the known roles of the mPFC in emotion regulation, we discussed heightened sensitivity and regulatory demands during negative emotion processing as neurobehavioral markers of anxiety in women.

Cognitive and emotional processing in tasks with emotional valence: Analysis of age and gender role on child development variations

Cognitive control consists of high-level cognitive processes regulating thoughts and actions during goal-directed behavior and problem-solving. This study analyzes the performance of 4- to 8-year-old children in Stroop-like and ToL tasks using stimuli with different emotional valence. Significant differences were found in the performance in the congruent block of the Stroop-like task, where 5-year-old children presented a higher performance in the neutral condition. Also, a significant difference was only found in the incongruent block (with higher demand for inhibition), which indicates that girls performed better than boys in both task conditions. Variations in the Stroop-like task performance were found in preschoolers but not in older children, especially in girls than in boys. Specifically, these variations were found between age groups with at least two years of difference. No statistically significant differences were found in performance nor planning time in ToL between the age and gender groups in any of the task conditions. The findings highlight the need to analyze the interaction between cognitive and emotional processing, individual differences, and task demands.

Catatonia-like behavior and immune activation: a crosstalk between psychopathology and pathology in schizophrenia

BACKGROUND

In Kalhbaum's first characterization of catatonia, the emotional symptoms, such as decreased or restricted expression of feelings and emotions, which is described as blunted affect, are related to the motor symptoms. In later years, the affective domain was excluded from the concept of catatonia and was not included among the diagnostic criteria in the various Diagnostic Statistical Manual (DSM) versions. In recent times, some authors have proposed the proposition of reevaluating the notion of catatonia through the reintroduction of the affective domain. The objective of this study was to examine the correlation between catatonic-like behavior (CLB), such as emotional withdrawal, blunted affect, and psychomotor slowing, and inflammatory markers, namely the neutrophil/lymphocytes ratio (NLR) and lymphocytes/monocytes ratio (LMR), in individuals diagnosed with schizophrenia.

METHOD

A sample of 25 patients with schizophrenia (10 females, 15 males) was recruited, and the Brief Psychiatric Rating Scale (BPRS) was used to assess the severity of emotional withdrawal, blunted affect, and psychomotor slowing.

FINDINGS

The correlation analysis (Spearman ρ) revealed a robust direct association between blunted affect and psychomotor slowing (ρ = 0.79, P = 0.001), and a significant direct correlation between CLB (emotional withdrawal, ρ = 0.51, P = 0.05; blunted affect ρ = 0.58, P = 0.05; motor retardation, ρ = 0.56, P = 0.05) and LMR (ρ = 0.53, P = 0.05). In addition, patients with a duration of illness (DOI) older than five years had a higher presence of CLB and a higher LMR than patients with a more recent diagnosis of the disease. Likely, patients with positive symptoms and in the prodromal and active stages of the disease have a different immune profile than patients in the residual stage and with a predominance of negative symptoms.

CONCLUSIONS

Psychomotor slowing and blunted affect are two significantly related features, representing the two-faced Janus of immobility. Furthermore, aggregating them in CLB is more predominant the longer the duration of schizophrenia and is associated with different a specific pattern of immune activation.

Functional connectivity gradients of the cingulate cortex

Heterogeneity of the cingulate cortex is evident in multiple dimensions including anatomy, function, connectivity, and involvement in networks and diseases. Using the recently developed functional connectivity gradient approach and resting-state functional MRI data, we found three functional connectivity gradients that captured distinct dimensions of cingulate hierarchical organization. The principal gradient exhibited a radiating organization with transitions from the middle toward both anterior and posterior parts of the cingulate cortex and was related to canonical functional networks and corresponding behavioral domains. The second gradient showed an anterior-posterior axis across the cingulate cortex and had prominent geometric distance dependence. The third gradient displayed a marked differentiation of subgenual and caudal middle with other parts of the cingulate cortex and was associated with cortical morphology. Aside from providing an updated framework for understanding the multifaceted nature of cingulate heterogeneity, the observed hierarchical organization of the cingulate cortex may constitute a novel research agenda with potential applications in basic and clinical neuroscience.

Threat and Reward Imminence Processing in the Human Brain

In the human brain, aversive and appetitive processing have been studied with controlled stimuli in rather static settings. In addition, the extent to which aversive-related and appetitive-related processing engage distinct or overlapping circuits remains poorly understood. Here, we sought to investigate the dynamics of aversive and appetitive processing while male and female participants engaged in comparable trials involving threat avoidance or reward seeking. A central goal was to characterize the temporal evolution of responses during periods of threat or reward imminence. For example, in the aversive domain, we predicted that the bed nucleus of the stria terminalis (BST), but not the amygdala, would exhibit anticipatory responses given the role of the former in anxious apprehension. We also predicted that the periaqueductal gray (PAG) would exhibit threat-proximity responses based on its involvement in proximal-threat processes, and that the ventral striatum would exhibit threat-imminence responses given its role in threat escape in rodents. Overall, we uncovered imminence-related temporally increasing ("ramping") responses in multiple brain regions, including the BST, PAG, and ventral striatum, subcortically, and dorsal anterior insula and anterior midcingulate, cortically. Whereas the ventral striatum generated anticipatory responses in the proximity of reward as expected, it also exhibited threat-related imminence responses. In fact, across multiple brain regions, we observed a main effect of arousal. In other words, we uncovered extensive temporally evolving, imminence-related processing in both the aversive and appetitive domain, suggesting that distributed brain circuits are dynamically engaged during the processing of biologically relevant information regardless of valence, findings further supported by network analysis.SIGNIFICANCE STATEMENT In the human brain, aversive and appetitive processing have been studied with controlled stimuli in rather static settings. Here, we sought to investigate the dynamics of aversive/appetitive processing while participants engaged in trials involving threat avoidance or reward seeking. A central goal was to characterize the temporal evolution of responses during periods of threat or reward imminence. We uncovered imminence-related temporally increasing ("ramping") responses in multiple brain regions, including the bed nucleus of the stria terminalis, periaqueductal gray, and ventral striatum, subcortically, and dorsal anterior insula and anterior midcingulate, cortically. Overall, we uncovered extensive temporally evolving, imminence-related processing in both the aversive and appetitive domain, suggesting that distributed brain circuits are dynamically engaged during the processing of biologically relevant information regardless of valence.

Threat and reward imminence processing in the human brain

In the human brain, aversive and appetitive processing have been studied with controlled stimuli in rather static settings. In addition, the extent to which aversive- and appetitive-related processing engage distinct or overlapping circuits remains poorly understood. Here, we sought to investigate the dynamics of aversive and appetitive processing while male and female participants engaged in comparable trials involving threat-avoidance or reward-seeking. A central goal was to characterize the temporal evolution of responses during periods of threat or reward imminence . For example, in the aversive domain, we predicted that the bed nucleus of the stria terminalis (BST), but not the amygdala, would exhibit anticipatory responses given the role of the former in anxious apprehension. We also predicted that the periaqueductal gray (PAG) would exhibit threat-proximity responses based on its involvement in proximal-threat processes, and that the ventral striatum would exhibit threat-imminence responses given its role in threat escape in rodents. Overall, we uncovered imminence-related temporally increasing ("ramping") responses in multiple brain regions, including the BST, PAG, and ventral striatum, subcortically, and dorsal anterior insula and anterior midcingulate, cortically. Whereas the ventral striatum generated anticipatory responses in the proximity of reward as expected, it also exhibited threat-related imminence responses. In fact, across multiple brain regions, we observed a main effect of arousal. In other words, we uncovered extensive temporally-evolving, imminence-related processing in both the aversive and appetitive domain, suggesting that distributed brain circuits are dynamically engaged during the processing of biologically relevant information irrespective of valence, findings further supported by network analysis.

Significance Statement

In the human brain, aversive and appetitive processing have been studied with controlled stimuli in rather static settings. Here, we sought to investigate the dynamics of aversive/appetitive processing while participants engaged in trials involving threat-avoidance or reward-seeking. A central goal was to characterize the temporal evolution of responses during periods of threat or reward imminence . We uncovered imminence-related temporally increasing ("ramping") responses in multiple brain regions, including the bed nucleus of the stria terminalis, periaqueductal gray, and ventral striatum, subcortically, and dorsal anterior insula and anterior midcingulate, cortically. Overall, we uncovered extensive temporally-evolving, imminence-related processing in both the aversive and appetitive domain, suggesting that distributed brain circuits are dynamically engaged during the processing of biologically relevant information irrespective of valence.

The pleasantness and unpleasantness of an object distinctively drives its grasping prediction: behavioral evidence

Action and perception share a common sensorimotor network permitting a functional action-perception coupling. This coupling would permit to predict the outcome of others' actions. Moreover, recent findings suggest that action-perception linkage could be sensitive to emotional content of the visual scene. The present study sought to address how emotion inherent to an object (pleasantness and unpleasantness) affects action prediction processing. To this end, we compared the participants' temporal estimative of the hand contact with emotional objects in occlusion and full vision conditions. We found that the emotion strongly interfered in the prediction of its grasping. Indeed, the participants highly anticipated the touch instant for unpleasant valence compared to pleasant and neutral ones. Moreover, the visual conditions (i.e., occlusion and full vision) affect the magnitude of the predictive error except to unpleasant object. Accordingly, the present results unveil that pleasantness and unpleasantness of an object distinctively drive the prediction of its touch instant.

Subject independent emotion recognition using EEG and physiological signals – a comparative study

Purpose

The aim of this study is to investigate subject independent emotion recognition capabilities of EEG and peripheral physiological signals namely: electroocoulogram (EOG), electromyography (EMG), electrodermal activity (EDA), temperature, plethysmograph and respiration. The experiments are conducted on both modalities independently and in combination. This study arranges the physiological signals in order based on the prediction accuracy obtained on test data using time and frequency domain features.

Design/methodology/approach

DEAP dataset is used in this experiment. Time and frequency domain features of EEG and physiological signals are extracted, followed by correlation-based feature selection. Classifiers namely – Naïve Bayes, logistic regression, linear discriminant analysis, quadratic discriminant analysis, logit boost and stacking are trained on the selected features. Based on the performance of the classifiers on the test set, the best modality for each dimension of emotion is identified.

Findings

 The experimental results with EEG as one modality and all physiological signals as another modality indicate that EEG signals are better at arousal prediction compared to physiological signals by 7.18%, while physiological signals are better at valence prediction compared to EEG signals by 3.51%. The valence prediction accuracy of EOG is superior to zygomaticus electromyography (zEMG) and EDA by 1.75% at the cost of higher number of electrodes. This paper concludes that valence can be measured from the eyes (EOG) while arousal can be measured from the changes in blood volume (plethysmograph). The sorted order of physiological signals based on arousal prediction accuracy is plethysmograph, EOG (hEOG + vEOG), vEOG, hEOG, zEMG, tEMG, temperature, EMG (tEMG + zEMG), respiration, EDA, while based on valence prediction accuracy the sorted order is EOG (hEOG + vEOG), EDA, zEMG, hEOG, respiration, tEMG, vEOG, EMG (tEMG + zEMG), temperature and plethysmograph.

Originality/value

Many of the emotion recognition studies in literature are subject dependent and the limited subject independent emotion recognition studies in the literature report an average of leave one subject out (LOSO) validation result as accuracy. The work reported in this paper sets the baseline for subject independent emotion recognition using DEAP dataset by clearly specifying the subjects used in training and test set. In addition, this work specifies the cut-off score used to classify the scale as low or high in arousal and valence dimensions. Generally, statistical features are used for emotion recognition using physiological signals as a modality, whereas in this work, time and frequency domain features of physiological signals and EEG are used. This paper concludes that valence can be identified from EOG while arousal can be predicted from plethysmograph.

A comparison of uni- and multi-variate methods for identifying brain networks activated by cognitive tasks using intracranial EEG

Cognitive tasks are commonly used to identify brain networks involved in the underlying cognitive process. However, inferring the brain networks from intracranial EEG data presents several challenges related to the sparse spatial sampling of the brain and the high variability of the EEG trace due to concurrent brain processes. In this manuscript, we use a well-known facial emotion recognition task to compare three different ways of analyzing the contrasts between task conditions: permutation cluster tests, machine learning (ML) classifiers, and a searchlight implementation of multivariate pattern analysis (MVPA) for intracranial sparse data recorded from 13 patients undergoing presurgical evaluation for drug-resistant epilepsy. Using all three methods, we aim at highlighting the brain structures with significant contrast between conditions. In the absence of ground truth, we use the scientific literature to validate our results. The comparison of the three methods’ results shows moderate agreement, measured by the Jaccard coefficient, between the permutation cluster tests and the machine learning [0.33 and 0.52 for the left (LH) and right (RH) hemispheres], and 0.44 and 0.37 for the LH and RH between the permutation cluster tests and MVPA. The agreement between ML and MVPA is higher: 0.65 for the LH and 0.62 for the RH. To put these results in context, we performed a brief review of the literature and we discuss how each brain structure’s involvement in the facial emotion recognition task.

Relationship between psychosocial stress-induced prefrontal cortex activity and gut microbiota in healthy Participants-A functional near-infrared spectroscopy study

Brain and gut microbes communicate in a bidirectional manner with each affecting a person's response to psychosocial stress. Although human studies demonstrated that the intake of probiotics can alter stress-related behavior in both patients and healthy participants, the association between stress-related brain functions and the gut microbiota has mostly been investigated in patients with depression. However, the response to psychosocial stress differs, even among healthy individuals, and elucidating the natural state of the gut microbiota would broaden the understanding of responses to psychosocial stress. We investigated the relationship between psychosocial stress response in the prefrontal cortex and the abundance of gut microbes in healthy male participants. The participants were exposed to psychosocial stress during a task while brain activation data were recorded using functional near-infrared spectroscopy. The heart rate and subjective stress were recorded, and fecal samples were collected. The stressful condition was accompanied by high subjective stress, high heart rate, and higher prefrontal activation in the right pre-motor cortex/supplementary motor area, right dorsolateral prefrontal cortex, right frontal pole, and right inferior prefrontal gyrus. The psychosocial stress response in the prefrontal cortex was also associated with changes in the gut microbiota abundance. The abundance of Alistipes, Clostridium IV, Clostridium XI, Faecalibacterium, and Blautia in healthy participants who had high psychosocial stress resembled that noted in patients with depression. These results suggest that the gut microbiota differs, among healthy participants, depending on the psychosocial stress response. We believe that this study is the first to report a direct relationship between brain function and the gut microbiota in healthy participants, and our findings would shed a new light on this field in the near future.

•

Brain and gut microbe communication affects the response to psychosocial stress.

•

Gut microbiota related to psychosocial stress in healthy individuals is unknown.

•

Stress-induced brain activation was observed in the right prefrontal cortex.

•

Brain activity was associated with gut microbiota related to depression.

•

Gut microbiota differs depending on the response to psychosocial stress.

Emotion dynamics as hierarchical Bayesian inference in time

What fundamental property of our environment would be most valuable and optimal in characterizing the emotional dynamics we experience in daily life? Empirical work has shown that an accurate estimation of uncertainty is necessary for our optimal perception, learning, and decision-making. However, the role of this uncertainty in governing our affective dynamics remains unexplored. Using Bayesian encoding, decoding and computational modeling, on a large-scale neuroimaging and behavioral data on a passive movie-watching task, we showed that emotions naturally arise due to ongoing uncertainty estimations about future outcomes in a hierarchical neural architecture. Several prefrontal subregions hierarchically encoded a lower-dimensional signal that highly correlated with the evolving uncertainty. Crucially, the lateral orbitofrontal cortex (lOFC) tracked the temporal fluctuations of this uncertainty and was predictive of the participants' predisposition to anxiety. Furthermore, we observed a distinct functional double-dissociation within OFC with increased connectivity between medial OFC and DMN, while with that of lOFC and FPN in response to the evolving affect. Finally, we uncovered a temporally predictive code updating an individual's beliefs spontaneously with fluctuating outcome uncertainty in the lOFC. A biologically relevant and computationally crucial parameter in the theories of brain function, we propose uncertainty to be central to the definition of complex emotions.

The neurocomputational bases of explore-exploit decision-making

Flexible decision-making requires animals to forego immediate rewards (exploitation) and try novel choice options (exploration) to discover if they are preferable to familiar alternatives. Using the same task and a partially observable Markov decision process (POMDP) model to quantify the value of choices, we first determined that the computational basis for managing explore-exploit tradeoffs is conserved across monkeys and humans. We then used fMRI to identify where in the human brain the immediate value of exploitative choices and relative uncertainty about the value of exploratory choices were encoded. Consistent with prior neurophysiological evidence in monkeys, we observed divergent encoding of reward value and uncertainty in prefrontal and parietal regions, including frontopolar cortex, and parallel encoding of these computations in motivational regions including the amygdala, ventral striatum, and orbitofrontal cortex. These results clarify the interplay between prefrontal and motivational circuits that supports adaptive explore-exploit decisions in humans and nonhuman primates.

Unsupervised classification reveals consistency and degeneracy in neural network patterns of emotion

In the present study, we used an unsupervised classification algorithm to reveal both consistency and degeneracy in neural network connectivity during anger and anxiety. Degeneracy refers to the ability of different biological pathways to produce the same outcomes. Previous research is suggestive of degeneracy in emotion, but little research has explicitly examined whether degenerate functional connectivity patterns exist for emotion categories such as anger and anxiety. Twenty-four subjects underwent functional magnetic resonance imaging (fMRI) while listening to unpleasant music and self-generating experiences of anger and anxiety. A data-driven model building algorithm with unsupervised classification (subgrouping Group Iterative Multiple Model Estimation) identified patterns of connectivity among 11 intrinsic networks that were associated with anger vs anxiety. As predicted, degenerate functional connectivity patterns existed within these overarching consistent patterns. Degenerate patterns were not attributable to differences in emotional experience or other individual-level factors. These findings are consistent with the constructionist account that emotions emerge from flexible functional neuronal assemblies and that emotion categories such as anger and anxiety each describe populations of highly variable instances.

The characterization of actions at the superordinate, basic and subordinate level

Objects can be categorized at different levels of abstraction, ranging from the superordinate (e.g., fruit) and the basic (e.g., apple) to the subordinate level (e.g., golden delicious). The basic level is assumed to play a key role in categorization, e.g., in terms of the number of features used to describe these actions and the speed of processing. To which degree do these principles also apply to the categorization of observed actions? To address this question, we first selected a range of actions at the superordinate (e.g., locomotion), basic (e.g., to swim) and subordinate level (e.g., to swim breaststroke), using verbal material (Experiments 1-3). Experiments 4-6 aimed to determine the characteristics of these actions across the three taxonomic levels. Using a feature listing paradigm (Experiment 4), we determined the number of features that were provided by at least six out of twenty participants (common features), separately for the three different levels. In addition, we examined the number of shared (i.e., provided for more than one category) and distinct (i.e., provided for one category only) features. Participants produced the highest number of common features for actions at the basic level. Actions at the subordinate level shared more features with other actions at the same level than those at the superordinate level. Actions at the superordinate and basic level were described with more distinct features compared to those provided at the subordinate level. Using an auditory priming paradigm (Experiment 5), we observed that participants responded faster to action images preceded by a matching auditory cue corresponding to the basic and subordinate level, but not for superordinate level cues, suggesting that the basic level is the most abstract level at which verbal cues facilitate the processing of an upcoming action. Using a category verification task (Experiment 6), we found that participants were faster and more accurate to verify action categories (depicted as images) at the basic and subordinate level in comparison to the superordinate level. Together, in line with the object categorization literature, our results suggest that information about action categories is maximized at the basic level.

Can the early visual processing of others' actions be related to social power and dominance?

Although goals often drive action understanding, this ability is also prone to important variability among individuals, which may have its origin in individual social characteristics. The present study aimed at evaluating the relationship between the tendency to prioritize goal information over grip information during early visual processing of action and several social dimensions. Visual processing of grip and goal information during action recognition was evaluated in 64 participants using the priming protocol developed by Decroix and Kalénine (Exp Brain Res 236(8):2411-2426, 2018). Object-directed action photographs were primed by photographs sharing the same goal and/or the same grip. The effects of goal and grip priming on action recognition were evaluated for different prime durations. The same participants further fulfilled questionnaires characterizing the way individuals deal with their social environment, namely their sense of social power, dominance, perspective taking, and construal level. At the group level, results confirmed greater goal than grip priming effects on action recognition for the shortest prime duration. Regression analyses between the pattern of response times in the action priming protocol and scores at the questionnaires further showed that the advantage of goal over grip priming was associated with higher sense of social power, and possibly to lower dominance. Overall, data confirm that observers tend to prioritize goal-related information when processing visual actions but further indicate that this tendency is sensitive to individual social characteristics. Results suggest that goal information may not always drive action understanding and point out the connection between low-level processing of observed actions and more general individual characteristics.

Angry facial expressions bias towards aversive actions

Social interaction requires fast and efficient processing of another person's intentions. In face-to-face interactions, aversive or appetitive actions typically co-occur with emotional expressions, allowing an observer to anticipate action intentions. In the present study, we investigated the influence of facial emotions on the processing of action intentions. Thirty-two participants were presented with video clips showing virtual agents displaying a facial emotion (angry vs. happy) while performing an action (punch vs. fist-bump) directed towards the observer. During each trial, video clips stopped at varying durations of the unfolding action, and participants had to recognize the presented action. Naturally, participants' recognition accuracy improved with increasing duration of the unfolding actions. Interestingly, while facial emotions did not influence accuracy, there was a significant influence on participants' action judgements. Participants were more likely to judge a presented action as a punch when agents showed an angry compared to a happy facial emotion. This effect was more pronounced in short video clips, showing only the beginning of an unfolding action, than in long video clips, showing near-complete actions. These results suggest that facial emotions influence anticipatory processing of action intentions allowing for fast and adaptive responses in social interactions.

Fear of movement-related pain disturbs cortical preparatory activity after becoming aware of motor intention

Fear of movement-related pain is known to disturb the process of motor preparation in patients with chronic pain. In the present study, we aimed to clarify the neural mechanisms underlying the influence of fear movement-related pain on motor preparatory brain activity using Libet's clock and electroencephalography (EEG). Healthy participants were asked to press a button while watching a rotating Libet's clock-hand, and report the number on the clock ("W time") when they made the "decision" to press the button with their right index finger. Immediately after pressing the button, a painful electrical stimulus was delivered to the dorsum of the left hand, causing participants to feel fear of movement (button press-related pain). We found that fear of movement-related pain caused the W time to be early, and that the amplitudes of readiness potentials (RPs) increased after awareness of motor intention emerged. In addition, fear of movement-related pain caused over-activation of the medial frontal cortex, supplementary motor area, cingulate motor area, and primary motor cortex after participants became aware of their motor intention. Such over-activation might result from conflict between the unrealized desire to escape from a painful experience and motivation to perform a required motor task.

Postural correlates of painful stimuli exposure: impact of mental simulation processes and pain-level of the stimuli

Previous studies have reported (i) freezing-like posturographic correlates in response to painful as compared to non-painful scenes vision (Lelard et al., Front Hum Neurosci 7:4, 2013) and (ii) an increase of this response during the mental simulation as compared to the passive viewing of the painful scenes (Lelard et al., Front Psychol 8:2012, 2017). The main objective of the present study was to explore the modulation of posturographic correlates of painful scenes vision by the level of depicted pain and the influence of mental simulation on this modulation. Thirty-six participants (36.3 ± 11.4 years old) were included in this study. During the experiment, participants had to stand on a posturographic platform. Three types of static visual stimuli were randomly depicting different pain-level situations: no-pain, low-pain, high-pain. In a first run, participants watched these stimuli passively (passive condition); in a second run, they were asked to "imagine that they were personally experiencing the situations they were about to see" (mental simulation condition). For each picture, subjective ratings were recorded for displeasure and desire to avoid at the end of the posturographic session. Results support an approach-type behavior in response to high-pain stimuli in the passive condition which becomes a withdrawal-type behavior in the mental simulation condition. Moreover, this withdrawal-type behavior is modulated by the level of depicted pain and this modulation does not appear for the subjective data. As a conclusion, these results are in accordance with those of previous studies showing the modulation of posturographic correlates of pain perception by mental simulation and report, for the first time, modulation of this effect by the level of depicted pain. The dichotomy of this modulatory effect between subjective and objective data is discussed as well as the finding of an approach-type behavior towards painful stimuli when passively viewing them becoming a withdrawal-type behavior when mental simulation is applied to the same stimuli.

Controllability over stressor decreases responses in key threat-related brain areas

Controllability over stressors has major impacts on brain and behavior. In humans, however, the effect of controllability on responses to stressors is poorly understood. Using functional magnetic resonance imaging (fMRI), we investigated how controllability altered responses to a shock-plus-sound stressor with a between-group yoked design, where participants in controllable and uncontrollable groups experienced matched stressor exposure. Employing Bayesian multilevel analysis at the level of regions of interest and voxels in the insula, and standard voxelwise analysis, we found that controllability decreased stressor-related responses across threat-related regions, notably in the bed nucleus of the stria terminalis and anterior insula. Posterior cingulate cortex, posterior insula, and possibly medial frontal gyrus showed increased responses during control over stressor. Our findings support the idea that the aversiveness of stressors is reduced when controllable, leading to decreased responses across key regions involved in anxiety-related processing, even at the level of the extended amygdala.

Effects of childhood trauma experience and BDNF Val66Met polymorphism on brain plasticity relate to emotion regulation

Brain-derived neurotrophic factor (BDNF) Val66Met polymorphism may modulate the link between childhood trauma experience and psychopathology by altering trophic signaling on neuroplasticity. However, few multimodal magnetic resonance imaging (MRI) researches have investigated this gene-environment interaction on both structural and functional plasticity, thereby advancing knowledge about the etiology, prevention, and customized therapeutic directions of mental disease in individuals with childhood trauma experience. We recruited a large non-clinical sample of young adults that completed Childhood Trauma Questionnaire (CTQ), behavioral scores, multimodal MRI scans, and genotyping. Morphometric similarity network (MSN) and independent component analysis were adopted to quantify brain structural and functional changes. Gene-environment-brain-behavior relationships were identified by multiple regression and mediation effect analysis. CTQ score was positively associated with depression and anxiety scores. We found interactions on MSN in sensorimotor, temporal, and orbitofrontal cortex. For intra-network connectivity, significant interaction was noted in clusters within sensorimotor network. For inter-network connectivity, connectivity between dorsal attention network and salience network showed an interactive effect. For mean connectivity strength of each network, we found a main effect of CTQ score on self-reference network that was an outstanding mediator supporting the relationship between CTQ score and anxiety. Our findings demonstrate that childhood trauma and the BDNF Val66Met polymorphism are associated with brain plasticity involving emotion regulation, structurally and functionally, which may contribute to understanding psychotic mechanisms and predicting differential susceptibility. Imaging genetics may be useful as biomarkers to provide early assessment and guide cognitive interventions to avoid or decrease the risk of developing psychopathology.