Human brain EEG indices of emotions: delineating responses to affective vocalizations by measuring frontal theta event-related synchronization

Discriminating Multiple Emotional States from EEG Using a Data-Adaptive, Multiscale Information-Theoretic Approach

A multivariate sample entropy metric of signal complexity is applied to EEG data recorded when subjects were viewing four prior-labeled emotion-inducing video clips from a publically available, validated database. Besides emotion category labels, the video clips also came with arousal scores. Our subjects were also asked to provide their own emotion labels. In total 30 subjects with age range 19–70 years participated in our study. Rather than relying on predefined frequency bands, we estimate multivariate sample entropy over multiple data-driven scales using the multivariate empirical mode decomposition (MEMD) technique and show that in this way we can discriminate between five self-reported emotions ([Formula: see text]). These results could not be obtained by analyzing the relation between arousal scores and video clips, signal complexity and arousal scores, and self-reported emotions and traditional power spectral densities and their hemispheric asymmetries in the theta, alpha, beta, and gamma frequency bands. This shows that multivariate, multiscale sample entropy is a promising technique to discriminate multiple emotional states from EEG recordings.

Interactive effects of age and gender on EEG power and coherence during a short-term memory task in middle-aged adults

The effects of age and gender on electroencephalographic (EEG) activity during a short-term memory task were assessed in a group of 40 healthy participants aged 22-63 years. Multi-channel EEG was recorded in 20 younger (mean = 24.65-year-old, 10 male) and 20 middle-aged participants (mean = 46.40-year-old, 10 male) during performance of a Sternberg task. EEG power and coherence measures were analyzed in different frequency bands. Significant interactions emerged between age and gender in memory performance and concomitant EEG parameters, suggesting that the aging process differentially influences men and women. Middle-aged women showed a lower short-term memory performance compared to young women, which was accompanied by decreasing delta and theta power and increasing brain connectivity with age in women. In contrast, men showed no age-related decline in short-term memory performance and no changes in EEG parameters. These results provide first evidence of age-related alterations in EEG activity underlying memory processes, which were already evident in the middle years of life in women but not in men.

Effect of negative and positive emotions on EEG spectral asymmetry

The aim of the study was to evaluate the applicability of electroencephalogram (EEG) spectral asymmetry index (SASI) for discrimination of the effect of negative and positive emotions on human brain bioelectrical activity. SASI has been previously proposed as a method to detect depression based on the balance of EEG theta and beta frequency band powers. Emotions were evoked on 22 healthy subjects using emotional pictures portraying humans from International Affective Picture System (IAPS) and late response to stimuli was examined (1700-2200 ms). Electroencephalogram (EEG) was recorded in 30 channels divided into 10 brain regions: left frontal, right frontal, left temporal, right temporal, frontal, frontocentral, central, centroparietal, parietal and occipital. Negative stimuli, compared to neutral stimuli, significantly increased SASI in frontocentral, central, centroparietal, parietal and occipital areas. Positive stimuli, compared to neutral stimuli, significantly decreased SASI in left temporal, centroparietal, parietal and occipital areas. The results indicate that SASI provides a good discrimination between the effects of negative, neutral and positive emotions on human EEG.

Post-operative benefits of animal-assisted therapy in pediatric surgery: a randomised study

Background

Interest in animal-assisted therapy has been fuelled by studies supporting the many health benefits. The purpose of this study was to better understand the impact of an animal-assisted therapy program on children response to stress and pain in the immediate post-surgical period.

Patients and Methods

Forty children (3–17 years) were enrolled in the randomised open-label, controlled, pilot study. Patients were randomly assigned to the animal-assisted therapy-group (n = 20, who underwent a 20 min session with an animal-assisted therapy dog, after surgery) or the standard-group (n = 20, standard postoperative care). The study variables were determined in each patient, independently of the assigned group, by a researcher unblinded to the patient’s group. The outcomes of the study were to define the neurological, cardiovascular and endocrinological impact of animal-assisted therapy in response to stress and pain. Electroencephalogram activity, heart rate, blood pressure, oxygen saturation, cerebral prefrontal oxygenation, salivary cortisol levels and the faces pain scale were considered as outcome measures.

Results

After entrance of the dog faster electroencephalogram diffuse beta-activity (> 14 Hz) was reported in all children of the animal-assisted therapy group; in the standard-group no beta-activity was recorded (100% vs 0%, p<0.001). During observation, some differences in the time profile between groups were observed for heart rate (test for interaction p = 0.018), oxygen saturation (test for interaction p = 0.06) and cerebral oxygenation (test for interaction p = 0.09). Systolic and diastolic blood pressure were influenced by animal-assisted therapy, though a higher variability in diastolic pressure was observed. Salivary cortisol levels did not show different behaviours over time between groups (p=0.70). Lower pain perception was noted in the animal-assisted group in comparison with the standard-group (p = 0.01).

Conclusion

Animal-assisted therapy facilitated rapid recovery in vigilance and activity after anaesthesia, modified pain perception and induced emotional prefrontal responses. An adaptative cardiovascular response was also present.

Trial Registration

ClinicalTrials.gov NCT02284100

Quality of teleoperator adaptive control for telerobotic operations

Extensive studies have been conducted on telerobotic operations for decades due to their widespread applications in a variety of areas. Most studies have been focused on two major issues: stability and telepresence. Few have studied the influence of the operation status of the teleoperator on the performance of telerobotic operations. As subnormal operation status of the teleoperator may result in insufficient and even incorrect operations, the quality of teleoperator (QoT) is an important impact on the performance of the telerobotic operations in terms of the efficiency and safety even if both the stability and telepresence are guaranteed. Therefore, this paper investigates the online identification of the QoT and its application to telerobotic operations. The QoT is identified based on five QoT indicators which are generated based on the teleoperator’s brain EEG signals. A QoT adaptive control method is designed to adapt the velocity and responsivity of the robotic system to the operation status of the teleoperator such that the teleoperation efficiency and safety can be enhanced. The online QoT identification method was conducted on various teleoperators and the QoT adaptive control method was implemented on a mobile manipulator teleoperation system. The experimental results demonstrated the effectiveness and advantages of the proposed methods.

Oscillatory brain dynamics associated with the automatic processing of emotion in words

This study examines the automaticity of processing the emotional aspects of words, and characterizes the oscillatory brain dynamics that accompany this automatic processing. Participants read emotionally negative, neutral and positive nouns while performing a color detection task in which only perceptual-level analysis was required. Event-related potentials and time frequency representations were computed from the concurrently measured EEG. Negative words elicited a larger P2 and a larger late positivity than positive and neutral words, indicating deeper semantic/evaluative processing of negative words. In addition, sustained alpha power suppressions were found for the emotional compared to neutral words, in the time range from 500 to 1000ms post-stimulus. These results suggest that sustained attention was allocated to the emotional words, whereas the attention allocated to the neutral words was released after an initial analysis. This seems to hold even when the emotional content of the words is task-irrelevant.

An EEG-based mental workload estimator trained on working memory task can work well under simulated multi-attribute task

Mental workload (MW)-based adaptive system has been found to be an effective approach to enhance the performance of human-machine interaction and to avoid human error caused by overload. However, MW estimated from the spontaneously generated electroencephalogram (EEG) was found to be task-specific. In existing studies, EEG-based MW classifier can work well under the task used to train the classifier (within-task) but crash completely when used to classify MW of a task that is similar to but not included in the training data (cross-task). The possible causes have been considered to be the task-specific EEG patterns, the mismatched workload across tasks and the temporal effects. In this study, cross-task performance-based feature selection (FS) and regression model were tried to cope with these challenges, in order to make EEG-based MW estimator trained on working memory tasks work well under a complex simulated multi-attribute task (MAT). The results show that the performance of regression model trained on working memory task and tested on multi-attribute task with the feature subset picked-out were significantly improved (correlation coefficient (COR): 0.740 ± 0.147 and 0.598 ± 0.161 for FS data and validation data respectively) when compared to the performance in the same condition with all features (chance level). It can be inferred that there do exist some MW-related EEG features can be picked out and there are something in common between MW of a relatively simple task and a complex task. This study provides a promising approach to measure MW across tasks.

EEG power asymmetry and functional connectivity as a marker of treatment effectiveness in DBS surgery for depression

Recently, deep brain stimulation (DBS) has been evaluated as an experimental therapy for treatment-resistant depression. Although there have been encouraging results in open-label trials, about half of the patients fail to achieve meaningful benefit. Although progress has been made in understanding the neurobiology of MDD, the ability to characterize differences in brain dynamics between those who do and do not benefit from DBS is lacking. In this study, we investigated EEG resting-state data recorded from 12 patients that have undergone DBS surgery. Of those, six patients were classified as responders to DBS, defined as an improvement of 50% or more on the 17-item Hamilton Rating Scale for Depression (HAMD-17). We compared hemispheric frontal theta and parietal alpha power asymmetry and synchronization asymmetry between responders and non-responders. Hemispheric power asymmetry showed statistically significant differences between responders and non-responders with healthy controls showing an asymmetry similar to responders but opposite to non-responders. This asymmetry was characterized by an increase in frontal theta in the right hemisphere relative to the left combined with an increase in parietal alpha in the left hemisphere relative to the right in non-responders compared with responders. Hemispheric mean synchronization asymmetry showed a statistically significant difference between responders and non-responders in the theta band, with healthy controls showing an asymmetry similar to responders but opposite to non-responders. This asymmetry resulted from an increase in frontal synchronization in the right hemisphere relative to the left combined with an increase in parietal synchronization in the left hemisphere relative to the right in non-responders compared with responders. Connectivity diagrams revealed long-range differences in frontal/central-parietal connectivity between the two groups in the theta band. This pattern was observed irrespective of whether EEG data were collected with active DBS or with the DBS stimulation turned off, suggesting stable functional and possibly structural modifications that may be attributed to plasticity.

EEG changes caused by spontaneous facial self-touch may represent emotion regulating processes and working memory maintenance

Spontaneous facial self-touch gestures (sFSTG) are performed manifold every day by every human being, primarily in stressful situations. These movements are not usually designed to communicate and are frequently accomplished with little or no awareness. The aim of the present study was to investigate whether sFSTG are associated with specific changes in the electrical brain activity that might indicate an involvement of regulatory emotional processes and working memory. Fourteen subjects performed a delayed memory task of complex haptic stimuli. The stimuli had to be explored and then remembered for a retention interval of 5min. The retention interval was interrupted by unpleasant sounds from The International Affective Digitized Sounds and short sound-free periods. During the experiment a video stream of behavior, 19-channel EEG, and EMG (of forearm muscles) were recorded. Comparisons of the behavioral data and spectral power of different EEG frequency bands (theta, alpha, beta, and gamma) were conducted. An increase of sFSTG during the application of unpleasant sounds was observed. A significant increase of spectral theta and beta power was observed after exploration of the stimuli as well as after sFSTG in centro-parietal electrodes. The spectral theta power extremely decreased just before sFSTG during the retention interval. Contrary to this, no significant changes were detected in any of the frequencies when the spectral power before and after instructed facial self-touch movements (b-iFSTG and a-iFSTG) were compared. The changes of spectral theta power in the intervals before and after sFSTG in centro-parietal electrodes imply that sFSTG are associated with cortical regulatory processes in the domains of working memory and emotions.

Using distraction to regulate emotion: insights from EEG theta dynamics

Distraction is a powerful and widely-used emotion regulation strategy. Although distraction regulates emotion sooner than other cognitive strategies (Thiruchselvam, Blechert, Sheppes, Rydstrom, & Gross, 2011), it is not yet clear whether it is capable of blocking the earliest stages of emotion generation. To address this issue, we capitalized on the excellent temporal resolution of EEG by focusing on occipital theta dynamics which were associated with distinct stages of visual processing of emotional stimuli. Individually defined theta band dynamics were extracted from a previously published EEG dataset (Thiruchselvam et al., 2011) in which participants attended to unpleasant (and neutral) images or regulated emotion using distraction and reappraisal. Results revealed two peaks within early theta power increase, both of which were increased by emotional stimuli. Distraction did not affect theta power during an early peak (150-350 ms), but did successfully decrease activity in a second peak (350-550 ms). These results suggest that although distraction acts relatively early in the emotion-generative trajectory, it does not block fast detection of emotional significance. Given that theta dynamics were uncorrelated with Late Positive Potential activity, the present results also encourage researchers to add the occipital theta to the growing toolkit of EEG-based measures of emotion regulation.

Brain response to affective pictures in the chimpanzee

Advancement of non-invasive brain imaging techniques has allowed us to examine details of neural activities involved in affective processing in humans; however, no comparative data are available for chimpanzees, the closest living relatives of humans. In the present study, we measured event-related brain potentials in a fully awake adult chimpanzee as she looked at affective and neutral pictures. The results revealed a differential brain potential appearing 210 ms after presentation of an affective picture, a pattern similar to that in humans. This suggests that at least a part of the affective process is similar between humans and chimpanzees. The results have implications for the evolutionary foundations of emotional phenomena, such as emotional contagion and empathy.

A review on the computational methods for emotional state estimation from the human EEG

A growing number of affective computing researches recently developed a computer system that can recognize an emotional state of the human user to establish affective human-computer interactions. Various measures have been used to estimate emotional states, including self-report, startle response, behavioral response, autonomic measurement, and neurophysiologic measurement. Among them, inferring emotional states from electroencephalography (EEG) has received considerable attention as EEG could directly reflect emotional states with relatively low costs and simplicity. Yet, EEG-based emotional state estimation requires well-designed computational methods to extract information from complex and noisy multichannel EEG data. In this paper, we review the computational methods that have been developed to deduct EEG indices of emotion, to extract emotion-related features, or to classify EEG signals into one of many emotional states. We also propose using sequential Bayesian inference to estimate the continuous emotional state in real time. We present current challenges for building an EEG-based emotion recognition system and suggest some future directions.

Theta signal as the neural signature of social exclusion

The feeling of being excluded from a social interaction triggers social pain, a sensation as intense as actual physical pain. Little is known about the neurophysiological underpinnings of social pain. We addressed this issue using intracranial electroencephalography in 15 patients performing a ball game where inclusion and exclusion blocks were alternated. Time-frequency analyses showed an increase in power of theta-band oscillations during exclusion in the anterior insula (AI) and posterior insula, the subgenual anterior cingulate cortex (sACC), and the fusiform "face area" (FFA). Interestingly, the AI showed an initial fast response to exclusion but the signal rapidly faded out. Activity in the sACC gradually increased and remained significant thereafter. This suggests that the AI may signal social pain by detecting emotional distress caused by the exclusion, whereas the sACC may be linked to the learning aspects of social pain. Theta activity in the FFA was time-locked to the observation of a player poised to exclude the participant, suggesting that the FFA encodes the social value of faces. Taken together, our findings suggest that theta activity represents the neural signature of social pain. The time course of this signal varies across regions important for processing emotional features linked to social information.