1
|
Galindo-Aldana G, Montoya-Rivera LA, Esqueda-Elizondo JJ, Inzunza-Gonzalez E, Garcia-Guerrero EE, Padilla-Lopez A, Bautista TG, Torres-González C. Mindfulness-Based Intervention Effects on EEG and Executive Functions: A Systematic Review. Brain Sci 2025; 15:324. [PMID: 40149845 PMCID: PMC11940744 DOI: 10.3390/brainsci15030324] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2025] [Revised: 03/14/2025] [Accepted: 03/18/2025] [Indexed: 03/29/2025] Open
Abstract
Background. Mindfulness-based interventions (MBIs) have emerged as an alternative intervention for symptoms of psychological and psychiatric conditions, such as depression, anxiety, and emotional discomfort. Over the last ten years, MBIs have established a growing body of evidence that shows cognitive and neurophysiological benefits. Depression and anxiety are conditions with a high prevalence in the world population. In developing countries, it is reported that, given the conditions of being at a social disadvantage, anxiety and depression are higher, resulting in compromised psychological well-being and mental health. Objectives. This systematic review aims to quantitatively and qualitatively assess changes in the neuropsychological, particularly executive functioning and social cognition domains, and electroencephalographical (EEG) effects of MBIs. Methods. A systematic review was conducted using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) in three databases, Web of Science, Scopus, and EBSCO MedLine complete; 14,464 articles were found, 141 articles evaluated the effects of MBI on executive functioning, and 16 included both as in qualitative and quantitative variables. Results. The qualitative results show that the research on the effects of MBI on behavior and cognitive skills, including executive function, social cognition, and EEG analysis, is very scarce but consistent in suggesting strong correlations on cognitive and electrophysiological alpha-beta proportions asymmetry on frontal areas. Undoubtedly, executive functions, as a behavioral regulatory and self-monitoring system, are the most popular study of interest in the literature, including emotional regulation, awareness, planning, social skills, and focused attention. Although there are fewer studies assessing the effects of MBIs on social cognition skills. The funnel plot showed a symmetrical distribution but ranked out of significant correlation. Most estimates of treatment effects are positive (58%); however, the average outcome observed did not significantly differ from zero. Conclusions. This study concludes that the research integrating the analysis of the electrophysiological and executive function effects of MBI shows important methodological variations and clinical conditions, which explains the significant results reported individually. Even when most of the literature reports positive effects of MBIs on several behavioral and neurophysiological domains, there are still confounding factors that must be taken into consideration by researchers and clinicians before attributing possible inaccurate or generalizable benefits.
Collapse
Affiliation(s)
- Gilberto Galindo-Aldana
- Laboratory of Neuroscience and Cognition, Facultad de Ciencias Administrativas, Sociales e Ingeniería, Universidad Autonoma de Baja California, Carr. Est. No. 3 s/n Col. Gutierrez, Mexicali 21700, BC, Mexico; (G.G.-A.); (L.A.M.-R.)
| | - Luis Arturo Montoya-Rivera
- Laboratory of Neuroscience and Cognition, Facultad de Ciencias Administrativas, Sociales e Ingeniería, Universidad Autonoma de Baja California, Carr. Est. No. 3 s/n Col. Gutierrez, Mexicali 21700, BC, Mexico; (G.G.-A.); (L.A.M.-R.)
| | - Jose Jaime Esqueda-Elizondo
- Facultad de Ciencias Químicas e Ingeniería, Universidad Autonoma de Baja California, Calzada Universidad No. 14418, Tijuana 22424, BC, Mexico;
| | - Everardo Inzunza-Gonzalez
- Facultad de Ingeniería, Arquitectura y Diseño, Universidad Autonoma de Baja California, Carretera Tijuana-Ensenada No. 3917, Ensenada 22860, BC, Mexico; (E.I.-G.); (E.E.G.-G.)
| | - Enrique Efren Garcia-Guerrero
- Facultad de Ingeniería, Arquitectura y Diseño, Universidad Autonoma de Baja California, Carretera Tijuana-Ensenada No. 3917, Ensenada 22860, BC, Mexico; (E.I.-G.); (E.E.G.-G.)
| | - Alfredo Padilla-Lopez
- Facultad de Ciencias Humanas, Universidad Autonoma de Baja California, Mexicali 21700, BC, Mexico;
| | - Tara G. Bautista
- College of Social and Behavioral Sciences, Northern Arizona University, Flagstaff, AZ 86001, USA;
| | - Cynthia Torres-González
- Laboratory of Neuroscience and Cognition, Facultad de Ciencias Administrativas, Sociales e Ingeniería, Universidad Autonoma de Baja California, Carr. Est. No. 3 s/n Col. Gutierrez, Mexicali 21700, BC, Mexico; (G.G.-A.); (L.A.M.-R.)
| |
Collapse
|
2
|
Schreiner L, Wipprecht A, Olyanasab A, Sieghartsleitner S, Pretl H, Guger C. Brain-computer-interface-driven artistic expression: real-time cognitive visualization in the pangolin scales animatronic dress and screen dress. Front Hum Neurosci 2025; 19:1516776. [PMID: 40115887 PMCID: PMC11925262 DOI: 10.3389/fnhum.2025.1516776] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2024] [Accepted: 02/24/2025] [Indexed: 03/23/2025] Open
Abstract
This paper explores the intersection of brain-computer interfaces (BCIs) and artistic expression, showcasing two innovative projects that merge neuroscience with interactive wearable technology. BCIs, traditionally applied in clinical settings, have expanded into creative domains, enabling real-time monitoring and representation of cognitive states. The first project showcases a low-channel BCI Screen Dress, utilizing a 4-channel electroencephalography (EEG) headband to extract an engagement biomarker. The engagement is visualized through animated eyes on small screens embedded in a 3D-printed dress, which dynamically responds to the wearer's cognitive state. This system offers an accessible approach to cognitive visualization, leveraging real-time engagement estimation and demonstrating the effectiveness of low-channel BCIs in artistic applications. In contrast, the second project involves an ultra-high-density EEG (uHD EEG) system integrated into an animatronic dress inspired by pangolin scales. The uHD EEG system drives physical movements and lighting, visually and kinetically expressing different EEG frequency bands. Results show that both projects have successfully transformed brain signals into interactive, wearable art, offering a multisensory experience for both wearers and audiences. These projects highlight the vast potential of BCIs beyond traditional clinical applications, extending into fields such as entertainment, fashion, and education. These innovative wearable systems underscore the ability of BCIs to expand the boundaries of creative expression, turning the wearer's cognitive processes into art. The combination of neuroscience and fashion tech, from simplified EEG headsets to uHD EEG systems, demonstrates the scalability of BCI applications in artistic domains.
Collapse
Affiliation(s)
- Leonhard Schreiner
- g.tec Medical Engineering GmbH, Schiedlberg, Austria
- Institute for Integrated Circuits, Johannes Kepler University, Linz, Austria
| | | | - Ali Olyanasab
- g.tec Medical Engineering GmbH, Schiedlberg, Austria
- Institute for Integrated Circuits, Johannes Kepler University, Linz, Austria
| | - Sebastian Sieghartsleitner
- g.tec Medical Engineering GmbH, Schiedlberg, Austria
- Institute of Computational Perception, Johannes Kepler University, Linz, Austria
| | - Harald Pretl
- Institute for Integrated Circuits, Johannes Kepler University, Linz, Austria
| | | |
Collapse
|
3
|
Ito M, Takahashi T, Kurihara Y, Osu R. The Effect of Evaluating Self's Emotions on Frontal Alpha Asymmetry. Brain Behav 2025; 15:e70419. [PMID: 40123190 PMCID: PMC11931087 DOI: 10.1002/brb3.70419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/17/2024] [Revised: 12/07/2024] [Accepted: 02/22/2025] [Indexed: 03/25/2025] Open
Abstract
PURPOSE In research to assess emotions from biometric signals, participants are asked to evaluate the emotions they subjectively experienced to confirm whether the assumed emotions were actually elicited. However, the evaluation of emotion may influence the biometric signals related to the emotion itself. While such evaluative processes may function as a form of emotion regulation, which is known to modulate emotional experiences, the neural mechanisms and effects of evaluation itself remain unclear. Specifically, the temporal dynamics of how these evaluations affect emotion-related brain activity in electroencephalography (EEG) have not been investigated. Based on theories of emotional processing and self-focused attention, we hypothesized that emotion evaluations would enhance emotional processing as reflected in frontal alpha asymmetry (FAA) through both immediate attentional effects and sustained self-focused attention. METHOD We measured a 29-channel EEG in 40 healthy participants who were presented with unpleasant and highly arousing images. Participants were assigned to either an experimental group that performed the task with subjective evaluation followed by without subjective evaluation, or a control group that performed the task without subjective evaluation twice. This design allowed us to examine both immediate effects of evaluation and its lasting influence on subsequent emotional processing. FINDING The results revealed that FAA was significantly lower during emotional evaluation compared to conditions without subjective evaluation, particularly during stimulus processing (300-500 ms). This early modulation suggests that evaluation automatically engages attentional processes, may reflect enhanced negative emotional processing as well as the activation of behavioral inhibition system through self-focused attention. CONCLUSION This study demonstrates that the emotional evaluation procedure itself can significantly alter early emotion-related brain activity, providing insights into how self-focused emotional evaluation engages both emotional and motivational processes. These findings suggest the need for methodological reconsiderations in EEG emotion estimation studies.
Collapse
Affiliation(s)
- Masato Ito
- Graduate School of Human SciencesWaseda UniversityTokorozawaSaitamaJapan
| | - Toru Takahashi
- Faculty of Human SciencesWaseda UniversityTokorozawaSaitamaJapan
- Japan Society for The Promotion of ScienceChiyoda‐kuTokyoJapan
| | - Yuto Kurihara
- Graduate School of Human SciencesWaseda UniversityTokorozawaSaitamaJapan
- Faculty of Human SciencesWaseda UniversityTokorozawaSaitamaJapan
- Japan Society for The Promotion of ScienceChiyoda‐kuTokyoJapan
| | - Rieko Osu
- Faculty of Human SciencesWaseda UniversityTokorozawaSaitamaJapan
| |
Collapse
|
4
|
Sedehi JF, Dabanloo NJ, Maghooli K, Sheikhani A. Develop an emotion recognition system using jointly connectivity between electroencephalogram and electrocardiogram signals. Heliyon 2025; 11:e41767. [PMID: 39897840 PMCID: PMC11786643 DOI: 10.1016/j.heliyon.2025.e41767] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2024] [Revised: 01/03/2025] [Accepted: 01/06/2025] [Indexed: 02/04/2025] Open
Abstract
This study pioneers an innovative approach to improve the accuracy and dependability of emotion recognition (ER) systems by integrating electroencephalogram (EEG) with electrocardiogram (ECG) data. We propose a novel method of estimating effective connectivity (EC) to capture the dynamic interplay between the heart and brain during emotions of happiness, disgust, fear, and sadness. Leveraging three EC estimation techniques (Granger causality (GC), partial directed coherence (PDC) and directed transfer function (DTF)), we feed the resulting EC representations as inputs into convolutional neural networks (CNNs), namely ResNet-18 and MobileNetV2, known for their swift and superior performance. To evaluate this approach, we have used EEG and ECG data from the public MAHNOB-HCI database through 5-fold cross-validation criterion. Remarkably, our approach achieves an average accuracy of 97.34 ± 1.19 and 96.53 ± 3.54 for DTF images within the alpha frequency band using ResNet-18 and MobileNetV2, respectively. Comparative analyses in comparison to cutting-edge research unequivocally prove the efficacy of augmenting ECG with EEG, showcasing substantial improvements in ER performance across the spectrum of emotions studied.
Collapse
Affiliation(s)
- Javid Farhadi Sedehi
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Nader Jafarnia Dabanloo
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Keivan Maghooli
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Ali Sheikhani
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| |
Collapse
|
5
|
Wei HL, Guo Y, He F, Zhao Y. EEG Signal Processing Techniques and Applications-2nd Edition. SENSORS (BASEL, SWITZERLAND) 2025; 25:805. [PMID: 39943443 PMCID: PMC11820103 DOI: 10.3390/s25030805] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/07/2025] [Accepted: 01/24/2025] [Indexed: 02/16/2025]
Abstract
Electroencephalography (EEG), as a well-established, non-invasive tool, has been successfully applied to a wide range of conditions due to its many evident advantages, such as economy, portability, easy operation, easy accessibility, and widespread availability in hospitals [...].
Collapse
Affiliation(s)
- Hua-Liang Wei
- Department of Automatic Control and Systems Engineering, School of Electrical and Electronic Engineering, The University of Sheffield, Sheffield S1 3JD, UK;
| | - Yuzhu Guo
- School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China;
| | - Fei He
- Centre for Computational Science and Mathematical Modelling, Coventry University, Coventry CV1 2JH, UK
| | - Yifan Zhao
- Faculty of Engineering and Applied Sciences, Cranfield University, Cranfield MK43 0AL, UK
| |
Collapse
|
6
|
Yum YN, Poon K, Lau WKW, Ho FC, Sin KF, Chung KM, Lee HY, Liang DC. Music therapy improves engagement and initiation for autistic children with mild intellectual disabilities: A randomized controlled study. Autism Res 2024; 17:2702-2722. [PMID: 39508131 DOI: 10.1002/aur.3254] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2024] [Accepted: 10/19/2024] [Indexed: 11/08/2024]
Abstract
This study aimed to evaluate the effectiveness of music therapy (MT) for children with co-occurring autism spectrum disorder (ASD) and intellectual disabilities (ID) and explore whether pre-intervention quantitative electroencephalogram (qEEG) responses can predict outcomes. A randomized controlled trial was conducted with 33 children receiving MT and 34 receiving an active control therapy. Participants received either MT or a non-musical social skills intervention for 45 min weekly over 12 weeks. Primary outcomes were measured using the Childhood Autism Rating Scale (CARS-2), along with the parent-rated Social Responsiveness Scale (SRS-2) and video coding of social behaviors. Both conditions significantly improved in CARS-2 scores at 2 weeks and 4 months post-intervention, with no differences between MT and control conditions. No changes were found in SRS-2 scores. While both conditions showed reduced disengagement after intervention, only the MT condition showed increased engagement and initiation. Strong qEEG responses to social scenes and music predicted increased initiation, indicating its potential to help tailor interventions. These results support incorporating MT into standard services and further research on qEEG predictors.
Collapse
Affiliation(s)
- Yen Na Yum
- Department of Special Education and Counselling, The Education University of Hong Kong, Hong Kong, SAR, China
| | - Kean Poon
- School of Education, University of New South Wales, Sydney, New South Wales, Australia
| | - Way Kwok-Wai Lau
- Department of Health Sciences, Hong Kong Metropolitan University, Hong Kong, SAR, China
| | - Fuk Chuen Ho
- Department of Special Education and Counselling, The Education University of Hong Kong, Hong Kong, SAR, China
| | - Kuen Fung Sin
- Department of Special Education and Counselling, The Education University of Hong Kong, Hong Kong, SAR, China
| | - King Man Chung
- International Music Therapy Center, Hong Kong, SAR, China
| | - Ho Yan Lee
- International Music Therapy Center, Hong Kong, SAR, China
| | - Di Chao Liang
- Department of Special Education and Counselling, The Education University of Hong Kong, Hong Kong, SAR, China
| |
Collapse
|
7
|
Perone S, Vaughan AM. Frontal alpha asymmetry dynamics: A window into active self-regulatory processes. Biol Psychol 2024; 193:108872. [PMID: 39321992 DOI: 10.1016/j.biopsycho.2024.108872] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2024] [Revised: 08/22/2024] [Accepted: 09/17/2024] [Indexed: 09/27/2024]
Abstract
Frontal Alpha Asymmetry (FAA) has been studied since the late 1970s as a neural correlate of emotion regulation and motivational processes. FAA is often viewed through a dispositional lens reflecting individual differences in positive or negative emotionality and biases toward approach or avoidance motivational processes. However, FAA also shifts in response to context-specific conditions that elicit approach or avoidance responses, indicating FAA reflects active, ongoing self-regulatory processes. Moreover, FAA changes over time, and how it changes over time is affected by context, experience, and development. We propose FAA evolves over four different time scales including the (1) second-to-second, (2) laboratory task, (3) intervention or intensive learning experience, and (4) developmental time scales. We present evidence showing FAA evolves over each of these time scales and highlight influences of individual differences and the developmental context on how FAA changes over time. We emphasize the insights gained by studying change in FAA over each time scale. We concluded with recommendations about future directions and speculate about the nested, bidirectional nature of the four timescales.
Collapse
Affiliation(s)
- Sammy Perone
- Department of Human Development, Washington State University, USA.
| | - Aryn M Vaughan
- Department of Human Development, Washington State University, USA
| |
Collapse
|
8
|
Diwoux A, Gabriel D, Bardel MH, Ben Khalifa Y, Billot PÉ. Neurophysiological approaches to exploring emotional responses to cosmetics: a systematic review of the literature. Front Hum Neurosci 2024; 18:1443001. [PMID: 39502789 PMCID: PMC11534817 DOI: 10.3389/fnhum.2024.1443001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Accepted: 10/07/2024] [Indexed: 11/08/2024] Open
Abstract
Introduction This systematic review explores the use of neurophysiological measurements to study emotional responses to cosmetic products. The aim is to evaluate existing literature on these measurements in cosmetics, identify the main findings, highlight methodological challenges, and propose new guidelines for future research. Method A systematic search focusing on neurophysiological measures to determine emotions induced by different cosmetic products was carried out in accordance with PRISMA guidelines. Results A total of 33 articles identified with the EBSCO database met the inclusion criteria. In all, 10 different measurement tools were used in these articles to assess the emotional effects of cosmetic products. Discussion This review emphasizes the complexity of interactions between cosmetics and emotional responses. It underscores the importance of future research with a more holistic approach that couples several physiological measurements. Among them, electrophysiological brain activity shows potential for enhancing understanding of emotional responses related to cosmetic products. Frontal asymmetry, particularly in the alpha frequency band, was often use and frequently linked to positive emotional states, although conflicting evidence exists. Additionally, cardiac activity, specifically the LF/HF ratio, emerges as a promising marker for differentiating between different cosmetic products. However, methodological heterogeneity, present challenges for replicability, generalizability, and complicate data interpretation.
Collapse
Affiliation(s)
- Audrey Diwoux
- Beauty Research and Performance Department, CHANEL Parfums Beauté, Pantin, France
- Université de Franche-Comté, INSERM, UMR 1322 LINC, Besançon, France
| | - Damien Gabriel
- Université de Franche-Comté, INSERM, UMR 1322 LINC, Besançon, France
- Centre d'Investigation Clinique, Inserm, CIC 1431, CHU, Besançon, France
- Plateforme de Neuroimagerie Fonctionnelle et Neuromodulation Neuraxess, Besançon, France
| | - Marie-Héloïse Bardel
- Beauty Research and Performance Department, CHANEL Parfums Beauté, Pantin, France
| | - Youcef Ben Khalifa
- Beauty Research and Performance Department, CHANEL Parfums Beauté, Pantin, France
| | - Pierre-Édouard Billot
- Université de Franche-Comté, INSERM, UMR 1322 LINC, Besançon, France
- Plateforme de Neuroimagerie Fonctionnelle et Neuromodulation Neuraxess, Besançon, France
| |
Collapse
|
9
|
Hu F, Wang F, Bi J, An Z, Chen C, Qu G, Han S. HASTF: a hybrid attention spatio-temporal feature fusion network for EEG emotion recognition. Front Neurosci 2024; 18:1479570. [PMID: 39469033 PMCID: PMC11513351 DOI: 10.3389/fnins.2024.1479570] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2024] [Accepted: 09/30/2024] [Indexed: 10/30/2024] Open
Abstract
Introduction EEG-based emotion recognition has gradually become a new research direction, known as affective Brain-Computer Interface (aBCI), which has huge application potential in human-computer interaction and neuroscience. However, how to extract spatio-temporal fusion features from complex EEG signals and build learning method with high recognition accuracy and strong interpretability is still challenging. Methods In this paper, we propose a hybrid attention spatio-temporal feature fusion network for EEG-based emotion recognition. First, we designed a spatial attention feature extractor capable of merging shallow and deep features to extract spatial information and adaptively select crucial features under different emotional states. Then, the temporal feature extractor based on the multi-head attention mechanism is integrated to perform spatio-temporal feature fusion to achieve emotion recognition. Finally, we visualize the extracted spatial attention features using feature maps, further analyzing key channels corresponding to different emotions and subjects. Results Our method outperforms the current state-of-the-art methods on two public datasets, SEED and DEAP. The recognition accuracy are 99.12% ± 1.25% (SEED), 98.93% ± 1.45% (DEAP-arousal), and 98.57% ± 2.60% (DEAP-valence). We also conduct ablation experiments, using statistical methods to analyze the impact of each module on the final result. The spatial attention features reveal that emotion-related neural patterns indeed exist, which is consistent with conclusions in the field of neurology. Discussion The experimental results show that our method can effectively extract and fuse spatial and temporal information. It has excellent recognition performance, and also possesses strong robustness, performing stably across different datasets and experimental environments for emotion recognition.
Collapse
Affiliation(s)
- Fangzhou Hu
- Faculty of Robot Science and Engineering, Northeastern University, Shenyang, China
| | - Fei Wang
- Faculty of Robot Science and Engineering, Northeastern University, Shenyang, China
| | - Jinying Bi
- Faculty of Robot Science and Engineering, Northeastern University, Shenyang, China
| | - Zida An
- Faculty of Robot Science and Engineering, Northeastern University, Shenyang, China
| | - Chao Chen
- Faculty of Robot Science and Engineering, Northeastern University, Shenyang, China
| | - Gangguo Qu
- Faculty of Robot Science and Engineering, Northeastern University, Shenyang, China
| | - Shuai Han
- Department of Neurosurgery, Shengjing Hospital of China Medical University, Shenyang, China
| |
Collapse
|
10
|
Hu K, Wang R, Zhao S, Yin E, Wu H. The association between social rewards and anxiety: Links from neurophysiological analysis in virtual reality and social interaction game. Neuroimage 2024; 299:120846. [PMID: 39260780 DOI: 10.1016/j.neuroimage.2024.120846] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Revised: 08/31/2024] [Accepted: 09/09/2024] [Indexed: 09/13/2024] Open
Abstract
Individuals' affective experience can be intricate, influenced by various factors including monetary rewards and social factors during social interaction. However, within this array of factors, divergent evidence has been considered as potential contributors to social anxiety. To gain a better understanding of the specific factors associated with anxiety during social interaction, we combined a social interaction task with neurophysiological recordings obtained through an anxiety-elicitation task conducted in a Virtual Reality (VR) environment. Employing inter-subject representational similarity analysis (ISRSA), we explored the potential linkage between individuals' anxiety neural patterns and their affective experiences during social interaction. Our findings suggest that, after controlling for other factors, the influence of the partner's emotional cues on individuals' affective experiences is specifically linked to their neural pattern of anxiety. This indicates that the emergence of anxiety during social interaction may be particularly associated with the emotional cues provided by the social partner, rather than individuals' own reward or prediction errors during social interaction. These results provide further support for the cognitive theory of social anxiety and extend the application of VR in future cognitive and affective studies.
Collapse
Affiliation(s)
- Keyu Hu
- Centre for Cognitive and Brain Sciences and Department of Psychology, University of Macau, Macau, China
| | - Ruien Wang
- Centre for Cognitive and Brain Sciences and Department of Psychology, University of Macau, Macau, China
| | - Shaokai Zhao
- Defense Innovation Institute, Academy of Military Sciences, Beijing, China
| | - Erwei Yin
- Defense Innovation Institute, Academy of Military Sciences, Beijing, China
| | - Haiyan Wu
- Centre for Cognitive and Brain Sciences and Department of Psychology, University of Macau, Macau, China.
| |
Collapse
|
11
|
Wilhelm RA, Lacey MF, Masters SL, Breeden CJ, Mann E, MacDonald HV, Gable PA, White EJ, Stewart JL. Greater weekly physical activity linked to left resting frontal alpha asymmetry in women: A study on gender differences in highly active young adults. PSYCHOLOGY OF SPORT AND EXERCISE 2024; 74:102679. [PMID: 38797225 DOI: 10.1016/j.psychsport.2024.102679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2023] [Revised: 04/29/2024] [Accepted: 05/22/2024] [Indexed: 05/29/2024]
Abstract
Physical activity, beneficial for physical and psychological health, may facilitate affective mechanisms of positive emotion and approach-motivation. Greater resting frontal alpha asymmetry (FAA), an index of greater relative left than right frontal cortical activity, is a neural correlate of affective mechanisms possibly associated with active lifestyles. This study sought to amplify limited literature on the relationship between physical (in)activity, FAA, and gender differences. College students (n = 70) self-reported physical activity (Total PA) and sedentary activity (Total Sitting) via the International Physical Activity Questionnaire-Short Form (IPAQ-SF), followed by a resting electroencephalography session to record FAA. A Total PA × gender interaction (β = 0.462, t = 3.163, p = 0.002) identified a positive relationship between Total PA and FAA in women (β = 0.434, t = 2.221, p = 0.030) and a negative relationship for men (β = -0.338, t = -2.300, p = 0.025). Total Sitting was positively linked to FAA (β = 0.288, t = 2.228, p = 0.029; no gender effect). Results suggest affective mechanisms reflected by FAA (e.g., positive emotion, approach-motivation) are associated with physical activity for women, indicating a possible mechanism of the psychological benefits linked with physically active lifestyles. A positive relationship between sedentary behavior and greater left FAA may also reflect motivated mechanisms of behavior that aid in minimizing energy expenditure, particularly within the context of our highly active sample.
Collapse
Affiliation(s)
- Ricardo A Wilhelm
- Laureate Institute for Brain Research (LIBR), Tulsa, OK, USA; Department of Psychology, University of Alabama, Tuscaloosa, AL, USA.
| | - Micayla F Lacey
- Department of Psychology, University of Alabama, Tuscaloosa, AL, USA; Department of Behavioral & Social Sciences, Wilkes University, Wilkes-Barre, PA, USA.
| | - Stephanie L Masters
- Department of Psychology, University of Alabama, Tuscaloosa, AL, USA; Department of Psychology & Counseling, Hood College, Frederick, MD, USA
| | - Christopher J Breeden
- Department of Psychology, University of Alabama, Tuscaloosa, AL, USA; Department of Psychology, Wingate University, Wingate, NC, USA
| | - Eric Mann
- Laureate Institute for Brain Research (LIBR), Tulsa, OK, USA
| | | | - Philip A Gable
- Department of Psychology, University of Alabama, Tuscaloosa, AL, USA; Department of Psychological & Brain Sciences, University of Delaware, Newark, DE, USA
| | - Evan J White
- Laureate Institute for Brain Research (LIBR), Tulsa, OK, USA; Oxley School of Community Medicine, University of Tulsa, Tulsa, OK, USA
| | - Jennifer L Stewart
- Laureate Institute for Brain Research (LIBR), Tulsa, OK, USA; Oxley School of Community Medicine, University of Tulsa, Tulsa, OK, USA
| |
Collapse
|
12
|
Anderson AJ, Perone S. How Did We Get So Bored? A Bioecological Model of the Development of Boredom. Psychol Rep 2024:332941241275590. [PMID: 39155500 DOI: 10.1177/00332941241275590] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/20/2024]
Abstract
Boredom is a negative emotion that most people experience on occasion. However, boredom is also present on a trait level. People high in trait boredom experience boredom more frequently or have difficulty tolerating it. Individuals high in trait boredom are more likely to experience depression or anxiety or engage in risk behaviors. Little is known about the development of trait boredom. We propose a bioecological model of the development of trait boredom in which it originates from early individual differences in temperament and executive control. Trait boredom is shaped over time through interactions between the child and their developmental context, such as parents, teachers, and neighborhoods. Boredom can also spur creativity. Capitalizing on the creative side of boredom may help promote low levels of trait boredom and healthy coping. We provide a roadmap to study the development of trait boredom to advance our understanding of how it emerges and develops.
Collapse
Affiliation(s)
| | - Sammy Perone
- Department of Human Development, Washington State University, Pullman, WA, USA
| |
Collapse
|
13
|
Gainotti G. A historical approach to models of emotional laterality. Brain Res 2024; 1836:148948. [PMID: 38643929 DOI: 10.1016/j.brainres.2024.148948] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Revised: 03/25/2024] [Accepted: 04/16/2024] [Indexed: 04/23/2024]
Abstract
In this paper I discuss the main models that have tried to explain brain asymmetries for emotions. The first models, based on clinical observations, proposed either a general right hemisphere dominance for emotions (the'right hemisphere') model or a different specialization of the right hemisphere for negative and of the left hemisphere for positive emotions (the'valence' model). In more recent times new models, based on partly modified versions of the previous ones have been proposed. The revised version of the 'valence' model, labeled the 'approach-avoidance' model maintained that hemispheric asymmetries are not related to the valence of the emotional stimulus but to the motivational (approach vs avoidance) system that is engaged by that stimulus. On the contrary, revised versions of the 'right hemisphere' hypothesis proposed graded versions of this model, maintaining that only some kinds or some levels of emotions are clearly right lateralized. One version of these models (the'emotion type hypothesis') assumed that only elementary basic emotions should be subsumed by the right hemisphere, wheres more complex social emotions should be subtended by the left hemisphere. The other version (the 'schematic level of emotion hypothesis') assumed that the right hemisphere should subsume only the basic 'schematic' level of emotions, characterized by an automatic and unconscious processing, whereas the more propositional and conscious 'conceptual' level could be less lateralized or subsumed by the left hemisphere. This last model is supported by the obsevation that the right hemisphere reveals a modus operandi (i.e. a prevalence of the 'automatic' over the 'intentional' and of the 'unconscious' over the 'conscious' functional processing) that is typical of the 'schematic level of emotions.
Collapse
Affiliation(s)
- Guido Gainotti
- Institute of Neurology, Università Cattolica del Sacro Cuore, Fondazione Policlinico A. Gemelli, Largo A. Gemelli, 8 00168 Roma, Italy.
| |
Collapse
|
14
|
Ding Y, Robinson N, Tong C, Zeng Q, Guan C. LGGNet: Learning From Local-Global-Graph Representations for Brain-Computer Interface. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2024; 35:9773-9786. [PMID: 37021989 DOI: 10.1109/tnnls.2023.3236635] [Citation(s) in RCA: 19] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Neuropsychological studies suggest that co-operative activities among different brain functional areas drive high-level cognitive processes. To learn the brain activities within and among different functional areas of the brain, we propose local-global-graph network (LGGNet), a novel neurologically inspired graph neural network (GNN), to learn local-global-graph (LGG) representations of electroencephalography (EEG) for brain-computer interface (BCI). The input layer of LGGNet comprises a series of temporal convolutions with multiscale 1-D convolutional kernels and kernel-level attentive fusion. It captures temporal dynamics of EEG which then serves as input to the proposed local- and global-graph-filtering layers. Using a defined neurophysiologically meaningful set of local and global graphs, LGGNet models the complex relations within and among functional areas of the brain. Under the robust nested cross-validation settings, the proposed method is evaluated on three publicly available datasets for four types of cognitive classification tasks, namely the attention, fatigue, emotion, and preference classification tasks. LGGNet is compared with state-of-the-art (SOTA) methods, such as DeepConvNet, EEGNet, R2G-STNN, TSception, regularized graph neural network (RGNN), attention-based multiscale convolutional neural network-dynamical graph convolutional network (AMCNN-DGCN), hierarchical recurrent neural network (HRNN), and GraphNet. The results show that LGGNet outperforms these methods, and the improvements are statistically significant ( ) in most cases. The results show that bringing neuroscience prior knowledge into neural network design yields an improvement of classification performance. The source code can be found at https://github.com/yi-ding-cs/LGG.
Collapse
|
15
|
Wang L, Sheng J, Duan S, Lin S, Li Y, Li Z, Li S, Sataer Y, Chen J. How Society Anxiety Influences Attention Control in College Students: The Moderated Mediation Effect of Cognitive Flexibility and Resting-state Electroencephalography Activity. J Cogn Neurosci 2024; 36:327-339. [PMID: 38060259 DOI: 10.1162/jocn_a_02095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/08/2023]
Abstract
Social anxiety is a prevalent issue among college students, adversely affecting their overall well-being. Drawing from the cognitive model of social anxiety and attention control theory, heightened levels of social anxiety may correspond to poorer attention control ability. However, little is known about the underlying cognitive mechanisms of the relationship between social anxiety and attention control. To address this research gap, the current study recruited a sample of 156 college students (56 women) who underwent self-report measures of social anxiety, cognitive flexibility, and attention control, followed by a resting-state EEG recording. The results revealed a significant negative predictive effect of social anxiety on attention control, with cognitive flexibility partially mediating this relationship. Furthermore, resting-state theta power emerged as a significant moderator, accentuating the negative impact of social anxiety on cognitive flexibility among individuals with lower theta power. In addition, frontal alpha asymmetry (FAA) demonstrated a moderating effect, with lower FAA intensifying the predictive influence of cognitive flexibility on attention control. Taken together, these results suggested that social anxiety can predict attention control either directly or indirectly via the mediating role of cognitive flexibility, and lower theta power and FAA has a risk amplification effect, which provide novel insights into the treatment and prevention of social anxiety and its negative impact on college students.
Collapse
Affiliation(s)
- Li Wang
- South China Normal University
| | | | | | | | | | - Zhe Li
- South China Normal University
| | | | | | | |
Collapse
|
16
|
Kaltsouni E, Schmidt F, Zsido RG, Eriksson A, Sacher J, Sundström-Poromaa I, Sumner RL, Comasco E. Electroencephalography findings in menstrually-related mood disorders: A critical review. Front Neuroendocrinol 2024; 72:101120. [PMID: 38176542 DOI: 10.1016/j.yfrne.2023.101120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/09/2023] [Revised: 12/21/2023] [Accepted: 12/31/2023] [Indexed: 01/06/2024]
Abstract
The female reproductive years are characterized by fluctuations in ovarian hormones across the menstrual cycle, which have the potential to modulate neurophysiological and behavioral dynamics. Menstrually-related mood disorders (MRMDs) comprise cognitive-affective or somatic symptoms that are thought to be triggered by the rapid fluctuations in ovarian hormones in the luteal phase of the menstrual cycle. MRMDs include premenstrual syndrome (PMS), premenstrual dysphoric disorder (PMDD), and premenstrual exacerbation (PME) of other psychiatric disorders. Electroencephalography (EEG) non-invasively records in vivo synchronous activity from populations of neurons with high temporal resolution. The present overview sought to systematically review the current state of task-related and resting-state EEG investigations on MRMDs. Preliminary evidence indicates lower alpha asymmetry at rest being associated with MRMDs, while one study points to the effect being luteal-phase specific. Moreover, higher luteal spontaneous frontal brain activity (slow/fast wave ratio as measured by the delta/beta power ratio) has been observed in persons with MRMDs, while sleep architecture results point to potential circadian rhythm disturbances. In this review, we discuss the quality of study designs as well as future perspectives and challenges of supplementing the diagnostic and scientific toolbox for MRMDs with EEG.
Collapse
Affiliation(s)
- Elisavet Kaltsouni
- Department of Womeńs and Childreńs Health, Science for Life Laboratory, Uppsala University, Sweden
| | - Felix Schmidt
- Department of Womeńs and Childreńs Health, Science for Life Laboratory, Uppsala University, Sweden; Centre for Women's Mental Health during the Reproductive Lifespan, Uppsala University, 751 85 Uppsala, Sweden
| | - Rachel G Zsido
- Cognitive Neuroendocrinology, Max Planck Institute for Human Cognitive and Brain Sciences, Germany; Department of Psychiatry, Clinical Neuroscience Laboratory for Sex Differences in the Brain, Massachusetts General Hospital, Harvard Medical School, USA
| | - Allison Eriksson
- Centre for Women's Mental Health during the Reproductive Lifespan, Uppsala University, 751 85 Uppsala, Sweden; Department of Womeńs and Childreńs Health, Uppsala University, Sweden
| | - Julia Sacher
- Cognitive Neuroendocrinology, Max Planck Institute for Human Cognitive and Brain Sciences, Germany; Clinic of Cognitive Neurology, University of Leipzig, Germany
| | | | | | - Erika Comasco
- Department of Womeńs and Childreńs Health, Science for Life Laboratory, Uppsala University, Sweden.
| |
Collapse
|
17
|
Maidhof C, Müller V, Lartillot O, Agres K, Bloska J, Asano R, Odell-Miller H, Fachner J. Intra- and inter-brain coupling and activity dynamics during improvisational music therapy with a person with dementia: an explorative EEG-hyperscanning single case study. Front Psychol 2023; 14:1155732. [PMID: 37842703 PMCID: PMC10570426 DOI: 10.3389/fpsyg.2023.1155732] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 09/06/2023] [Indexed: 10/17/2023] Open
Abstract
Objective Real-life research into the underlying neural dynamics of improvisational music therapy, used with various clinical populations, is largely lacking. This single case study explored within-session differences in musical features and in within- and between-brain coupling between a Person with Dementia (PwD) and a music therapist during a music therapy session. Methods Dual-EEG from a music therapist and a PwD (male, 31 years) was recorded. Note density, pulse clarity and synchronicity were extracted from audio-visual data. Three music therapists identified moments of interest and no interest (MOI/MONI) in two drum improvisations. The Integrative Coupling Index, reflecting time-lagged neural synchronization, and musical features were compared between the MOI and MONI. Results Between-brain coupling of 2 Hz activity was increased during the MOI, showing anteriority of the therapist's neural activity. Within-brain coupling for the PwD was stronger from frontal and central areas during the MOI, but within-brain coupling for the therapist was stronger during MONI. Differences in musical features indicated that both acted musically more similar to one another during the MOI. Conclusion Within-session differences in neural synchronization and musical features highlight the dynamic nature of music therapy. Significance The findings contribute to a better understanding of social and affective processes in the brain and (interactive) musical behaviors during specific moments in a real-life music therapy session. This may provide insights into the role of such moments for relational-therapeutic processes.
Collapse
Affiliation(s)
- Clemens Maidhof
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
- Josef Ressel Centre for Personalized Music Therapy, University of Applied Sciences IMC Krems, Krems an der Donau, Austria
| | - Viktor Müller
- Center for Lifespan Psychology, Max Planck Institute for Human Development, Berlin, Germany
| | - Olivier Lartillot
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| | - Kat Agres
- Yong Siew Toh Conservatory of Music, National University of Singapore, Singapore, Singapore
- Centre for Music and Health, National University of Singapore, Singapore, Singapore
| | - Jodie Bloska
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
| | - Rie Asano
- Institute of Musicology, University of Cologne, Cologne, Germany
- Advanced Comprehensive Research Organization, Teikyo University, Tokyo, Japan
| | - Helen Odell-Miller
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
| | - Jörg Fachner
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge, United Kingdom
- Josef Ressel Centre for Personalized Music Therapy, University of Applied Sciences IMC Krems, Krems an der Donau, Austria
| |
Collapse
|
18
|
Butler LB, Nooner KB. The Link between Suicidality and Electroencephalography Asymmetry: A Systematic Review and Meta-analysis. CLINICAL PSYCHOPHARMACOLOGY AND NEUROSCIENCE : THE OFFICIAL SCIENTIFIC JOURNAL OF THE KOREAN COLLEGE OF NEUROPSYCHOPHARMACOLOGY 2023; 21:419-428. [PMID: 37424411 PMCID: PMC10335909 DOI: 10.9758/cpn.22.1043] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 12/26/2022] [Indexed: 07/11/2023]
Abstract
As one of the leading causes of death globally, suicide has been researched extensively to better understand factors that confer risk or resilience for suicidality. Promising areas of the literature have focused on brain-based factors that might indicate susceptibility to suicide. Some studies have investigated the link between electroencephalography (EEG) asymmetry, referring to differences in electrical activity in the brain from the left to right hemisphere, and suicidality. The present study is a comprehensive review and meta-analysis of the literature to see if certain patterns in EEG asymmetry serve as a diathesis for suicidal thoughts and behaviors. The results of the current investigation found that EEG asymmetry was not systematically related to suicide based on the literature reviewed. While the present review does not rule out all brain-based factors, the findings suggest that EEG asymmetry may not be a biomarker for suicidality.
Collapse
Affiliation(s)
- Laine B. Butler
- Department of Psychology, University of North Carolina Wilmington, Wilmington, NC, USA
| | - Kate B. Nooner
- Department of Psychology, University of North Carolina Wilmington, Wilmington, NC, USA
| |
Collapse
|
19
|
Valesi R, Gabrielli G, Zito M, Bellati M, Bilucaglia M, Caponetto A, Fici A, Galanto A, Falcone MG, Russo V. From Coaching to Neurocoaching: A Neuroscientific Approach during a Coaching Session to Assess the Relational Dynamics between Coach and Coachee-A Pilot Study. Behav Sci (Basel) 2023; 13:596. [PMID: 37504044 PMCID: PMC10376351 DOI: 10.3390/bs13070596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 07/10/2023] [Accepted: 07/13/2023] [Indexed: 07/29/2023] Open
Abstract
Life transitions represent moments characterized by changes that can profoundly influence individual life trajectories and subjective well-being. Recently, career coaching has become an important method of helping people expand their self-awareness, facilitate personal development, and increase their performance in the school-to-work transition. Although previous studies have confirmed that one of the most important keys to the success of a coaching program is the quality of the relationship between coach and coachee, there is a lack of knowledge regarding how to objectively measure it. In this pilot study, we adopted a neuroscientific approach to introduce objective measures of the relationship between coach and coachee through the phases of a coaching session. A sample of 14 university students and a professional coach participated in career-coaching sessions while their affective states were measured by recording brain (EEG) and physiological (Skin conductance) activity. Electroencephalographic indicators of valence, arousal, and engagement showed differences between session phases, highlighting the possibility of a neurophysiological measurement of relational dynamics. Our results provide initial evidence that neurophysiological activity can be considered a way to understand differences in the coach-coachee relationship, thereby providing information on the effectiveness of coaching interventions and facilitating a better life transition from school to work.
Collapse
Affiliation(s)
- Riccardo Valesi
- Department of Management, University of Bergamo, 24129 Bergamo, Italy
| | - Giorgio Gabrielli
- Department of Business, Law, Economics and Consumer Behaviour "Carlo A. Ricciardi", Università IULM, 20143 Milan, Italy
- Behavior and Brain Lab IULM-Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Margherita Zito
- Department of Business, Law, Economics and Consumer Behaviour "Carlo A. Ricciardi", Università IULM, 20143 Milan, Italy
- Behavior and Brain Lab IULM-Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Mara Bellati
- Behavior and Brain Lab IULM-Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Marco Bilucaglia
- Department of Business, Law, Economics and Consumer Behaviour "Carlo A. Ricciardi", Università IULM, 20143 Milan, Italy
- Behavior and Brain Lab IULM-Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Alessia Caponetto
- Behavior and Brain Lab IULM-Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Alessandro Fici
- Department of Business, Law, Economics and Consumer Behaviour "Carlo A. Ricciardi", Università IULM, 20143 Milan, Italy
- Behavior and Brain Lab IULM-Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| | - Annarita Galanto
- Skillmatch-Insubria Group, Università Carlo Cattaneo-LIUC, 21053 Castellanza, Italy
| | | | - Vincenzo Russo
- Department of Business, Law, Economics and Consumer Behaviour "Carlo A. Ricciardi", Università IULM, 20143 Milan, Italy
- Behavior and Brain Lab IULM-Neuromarketing Research Center, Università IULM, 20143 Milan, Italy
| |
Collapse
|
20
|
Tong C, Ding Y, Lim KJ, Guan C. MTDN: Learning Multiple Temporal Dynamics Representation for Emotional Valence Classification with EEG. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2023; 2023:1-4. [PMID: 38083323 DOI: 10.1109/embc40787.2023.10340760] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/18/2023]
Abstract
Emotion recognition from electroencephalogram (EEG) requires computational models to capture the crucial features of the emotional response to external stimulation. Spatial, spectral, and temporal information are relevant features for emotion recognition. However, learning temporal dynamics is a challenging task, and there is a lack of efficient approaches to capture such information. In this work, we present a deep learning framework called MTDN that is designed to capture spectral features with a filterbank module and to learn spatial features with a spatial convolution block. Multiple temporal dynamics are jointly learned with parallel long short-term memory (LSTM) embedding and self-attention modules. The LSTM module is used to embed the time segments, and then the self-attention is utilized to learn the temporal dynamics by intercorrelating every embedded time segment. Multiple temporal dynamics representations are then aggregated to form the final extracted features for classification. We experiment on a publicly available dataset, DEAP, to evaluate the performance of our proposed framework and compare MTDN with existing published results. The results demonstrate improvement over the current state-of-the-art methods on the valence dimension of the DEAP dataset.
Collapse
|
21
|
Perone S, Anderson AJ, Weybright EH. Older and Wiser? Age-related Change in State and Trait Boredom During Adolescence and Associations with Neural Correlates of Self-regulation. ADAPTIVE HUMAN BEHAVIOR AND PHYSIOLOGY 2023; 9:1-17. [PMID: 37360189 PMCID: PMC10028326 DOI: 10.1007/s40750-023-00213-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Revised: 03/09/2023] [Accepted: 03/13/2023] [Indexed: 03/24/2023]
Abstract
Purpose The purpose of the current study was to examine age-related change in state and trait boredom in 12- to 17-year-old adolescents and test whether neurophysiological correlates of self-regulation relate to boredom during adolescence in the same way that has been found in adults. Methods Eighty-nine 12- to 17-year-old adolescents participated. Three types of trait boredom were measured: boredom proneness, leisure boredom, and boredom susceptibility. State boredom was also measured after completing a boredom induction task while EEG was recorded. Slopes in frontal alpha asymmetry (FAA) were extracted from the EEG as a measure of approach (leftward shifts) or avoidance (rightward shifts). Results A curvilinear relationship between age and boredom proneness and age and boredom susceptibility was observed, indicating trait boredom rises and falls across adolescence. State boredom, by contrast, increased linearly with age. Slopes in FAA inversely related only to boredom proneness, indicating higher levels of this type of trait boredom related to an avoidant response as a state of boredom ensues. Conclusion We suggest the rise and fall of trait boredom across adolescence may be due to changes in person-environment fit during middle adolescence, whereas state boredom may increase with age due to improvements in attentional processes that mundane lab tasks do not satisfactorily engage. The link between FAA and only one type of trait boredom indicates self-regulatory processes and boredom are not yet strongly coupled in adolescence. Implications for prevention of negative behavioral health outcomes associated with high levels of trait boredom are discussed.
Collapse
Affiliation(s)
- Sammy Perone
- Department of Human Development, Washington State University, 515 Johnson Tower, Pullman, WA 99163 USA
| | | | - Elizabeth H. Weybright
- Department of Human Development, Washington State University, 515 Johnson Tower, Pullman, WA 99163 USA
| |
Collapse
|
22
|
Marcu GM, Szekely-Copîndean RD, Radu AM, Bucuță MD, Fleacă RS, Tănăsescu C, Roman MD, Boicean A, Băcilă CI. Resting-state frontal, frontlateral, and parietal alpha asymmetry:A pilot study examining relations with depressive disorder type and severity. Front Psychol 2023; 14:1087081. [PMID: 37008856 PMCID: PMC10062203 DOI: 10.3389/fpsyg.2023.1087081] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2022] [Accepted: 02/14/2023] [Indexed: 03/09/2023] Open
Abstract
IntroductionThe search for biomarkers has been central to efforts of improving clinical diagnosis and prognosis in psychopathology in the last decades. The main approach has been to validate biomarkers that could accurately discriminate between clinical diagnoses of very prevalent forms of psychopathology. One of the most popular electrophysiological markers proposed for discrimination in depressive disorders is the electroencephalography (EEG)-derived frontal alpha asymmetry. However, the validity, reliability and predictive value of this biomarker have been questioned in recent years, mainly due to conceptual and methodological heterogeneity.MethodsIn the current non-experimental, correlational study we investigated relationship of resting-state EEG alpha asymmetry from multiple sites (frontal, frontolateral, and parietal) with different forms of depressive disorders (varying in type or severity), in a clinical sample.ResultsResults showed that alpha asymmetry in the parietal (P3-P4) was significantly higher than in the frontal (F3-F4) and frontolateral sites (F7-F8). However, we did not find significant relations between alpha asymmetry indices and our depressive disorder measures, except for a moderate positive association between frontolateral alpha asymmetry (eyes-closed only) and depressive disorder severity (determined through clinical structured interview). We also found no significant differences in alpha asymmetry between participants, depending on their depression type.DiscussionBased on results, we propose the parietal and frontolateral asymmetry indices to form hypotheses that should not be abandoned in the depression markers research, but worth for further experimental research. Methodological and clinical implications of the current findings are discussed.
Collapse
Affiliation(s)
- Gabriela M. Marcu
- Department of Psychology, Lucian Blaga University of Sibiu, Sibiu, Romania
- Faculty of Medicine, Carol Davila University of Medicine and Pharmacy, Bucharest, Romania
- Scientific Collective for Research in Neuroscience, Clinical Psychiatric Hospital “Dr. Gh. Preda”, Sibiu, Romania
| | - Raluca D. Szekely-Copîndean
- Scientific Collective for Research in Neuroscience, Clinical Psychiatric Hospital “Dr. Gh. Preda”, Sibiu, Romania
- Department of Social and Human Research, Romanian Academy, Cluj-Napoca, Romania
| | - Ana-Maria Radu
- Department of Psychology, Lucian Blaga University of Sibiu, Sibiu, Romania
- Scientific Collective for Research in Neuroscience, Clinical Psychiatric Hospital “Dr. Gh. Preda”, Sibiu, Romania
- *Correspondence: Ana-Maria Radu,
| | - Mihaela D. Bucuță
- Department of Psychology, Lucian Blaga University of Sibiu, Sibiu, Romania
- Center for Psychological Research, Lucian Blaga University of Sibiu, Sibiu, Romania
| | - Radu S. Fleacă
- Faculty of Medicine, Lucian Blaga University of Sibiu, Sibiu, Romania
| | - Ciprian Tănăsescu
- Faculty of Medicine, Lucian Blaga University of Sibiu, Sibiu, Romania
| | - Mihai D. Roman
- Faculty of Medicine, Lucian Blaga University of Sibiu, Sibiu, Romania
| | - Adrian Boicean
- Faculty of Medicine, Lucian Blaga University of Sibiu, Sibiu, Romania
| | - Ciprian I. Băcilă
- Scientific Collective for Research in Neuroscience, Clinical Psychiatric Hospital “Dr. Gh. Preda”, Sibiu, Romania
- Faculty of Medicine, Lucian Blaga University of Sibiu, Sibiu, Romania
| |
Collapse
|
23
|
Rountree-Harrison D, Berkovsky S, Kangas M. Heart and brain traumatic stress biomarker analysis with and without machine learning: A scoping review. Int J Psychophysiol 2023; 185:27-49. [PMID: 36720392 DOI: 10.1016/j.ijpsycho.2023.01.009] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Revised: 01/22/2023] [Accepted: 01/25/2023] [Indexed: 01/31/2023]
Abstract
The enigma of post-traumatic stress disorder (PTSD) is embedded in a complex array of physiological responses to stressful situations that result in disruptions in arousal and cognitions that characterise the psychological disorder. Deciphering these physiological patterns is complex, which has seen the use of machine learning (ML) grow in popularity. However, it is unclear to what extent ML has been used with physiological data, specifically, the electroencephalogram (EEG) and electrocardiogram (ECG) to further understand the physiological responses associated with PTSD. To better understand the use of EEG and ECG biomarkers, with and without ML, a scoping review was undertaken. A total of 124 papers based on adult samples were identified comprising 19 ML studies involving EEG and ECG. A further 21 studies using EEG data, and 84 studies employing ECG meeting all other criteria but not employing ML were included for comparison. Identified studies indicate classical ML methodologies currently dominate EEG and ECG biomarkers research, with derived biomarkers holding clinically relevant diagnostic implications for PTSD. Discussion of the emerging trends, algorithms used and their success is provided, along with areas for future research.
Collapse
Affiliation(s)
- Darius Rountree-Harrison
- Macquarie University, Balaclava Road, Macquarie Park, New South Wales 2109, Australia; New South Wales Service for the Rehabilitation and Treatment of Torture and Trauma Survivors (STARTTS), 152-168 The Horsley Drive Carramar, New South Wales 2163, Australia.
| | - Shlomo Berkovsky
- Macquarie University, Balaclava Road, Macquarie Park, New South Wales 2109, Australia
| | - Maria Kangas
- Macquarie University, Balaclava Road, Macquarie Park, New South Wales 2109, Australia
| |
Collapse
|
24
|
Deng X, Zhang S, Chen X, Coplan RJ, Xiao B, Ding X. Links between social avoidance and frontal alpha asymmetry during processing emotional facial stimuli: An exploratory study. Biol Psychol 2023; 178:108516. [PMID: 36792050 DOI: 10.1016/j.biopsycho.2023.108516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2022] [Revised: 02/10/2023] [Accepted: 02/12/2023] [Indexed: 02/16/2023]
Abstract
Individuals who are socially avoidant actively remove themselves from opportunities for social interaction and have a strong desire for solitude. Although social avoidance is associated with a host of adjustment difficulties, its neural substrates remain under-explored. To address this gap, we conducted an exploratory study to compare electroencephalography (EEG) frontal alpha asymmetry (FAA) scores during processing emotional facial stimuli in socially avoidant and non-withdrawn comparison individuals. From an original sample of N = 384 undergraduate students, 25 avoidant and 27 comparison individuals were identified. For this subset of participants, EEG modulations and self-reported experience ratings during a picture processing task were assessed. Among the results, the socially avoidant group's ratings of positive stimuli were significantly lower than the non-withdrawn comparison group. The socially avoidant group also had significantly lower FAA scores in response to positive stimuli than the comparison group. Further, asymmetry scores of the comparison group in the positive conditions were higher than in the negative and neutral conditions. However, there were no significant differences between these three conditions in the socially avoidant group. Our results suggest that socially avoidant individuals may eschew interpersonal relationships because of a relatively greater right hemisphere cortical activity, which may contribute to a withdrawal motivation when confronted with negative emotional stimuli in social contexts.
Collapse
Affiliation(s)
- Xinmei Deng
- School of Psychology, Shenzhen University, Shenzhen, China; The Shenzhen Humanities & Social Sciences Key Research Bases of the Center for Mental Health, Shenzhen University, Shenzhen, China
| | - Simin Zhang
- Department of Psychology, Shanghai Normal University, Shanghai, China
| | - Xiaomin Chen
- School of Psychology, Shenzhen University, Shenzhen, China
| | - Robert J Coplan
- Department of Psychology, Carleton University, Ottawa, Canada
| | - Bowen Xiao
- Department of Educational and Counselling Psychology, and Special Education, The University of British Columbia, Vancouver, Canada
| | - Xuechen Ding
- Department of Psychology, Shanghai Normal University, Shanghai, China; The Research Base of Online Education for Shanghai Middle and Primary Schools, Shanghai, China.
| |
Collapse
|
25
|
Anderson AJ, Perone S. Predicting individual differences in behavioral activation and behavioral inhibition from functional networks in the resting EEG. Biol Psychol 2023; 177:108483. [PMID: 36587892 DOI: 10.1016/j.biopsycho.2022.108483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2022] [Revised: 12/09/2022] [Accepted: 12/28/2022] [Indexed: 12/31/2022]
Abstract
The behavioral activation system (BAS) and behavioral inhibition system (BIS) are thought to underly affective dispositions and self-regulatory processes. The BAS is sensitive to reward and involved in approach behaviors, and the BIS is sensitive to punishment and involved in avoidance behaviors. Trait BAS and BIS relate to distinct behavioral profiles and neural activity, but little is known about how trait BAS and BIS relate to functional networks in EEG. We applied a data-driven method called connectome predictive modeling (CPM) to identify networks relating to trait BAS and BIS and tested whether the strength of those networks predicted trait BAS and BIS in novel subjects using a leave-one-out cross-validation procedure. Adult participants (N = 107) completed a resting state task with eyes closed and eyes open, and trait BAS and BIS were measured via Carver and White's (1994) BIS and BAS scales. We hypothesized distinct positive (more synchronization) and negative (less synchronization) networks would relate to trait BAS and BIS. For eyes closed, we identified two negative networks, one in theta and one in alpha predicted BIS. We identified three positive networks, one in theta and one in beta predicted Fun Seeking and one in theta predicted Drive. For eyes open, negative theta and alpha networks predicted BIS, a positive theta network predicted Fun Seeking, and a negative gamma network predicted mean BAS. Visualization of the networks are presented. Discussion centers on the observed networks and how to advance application of CPM to EEG, including with clinical implications.
Collapse
Affiliation(s)
- Alana J Anderson
- Department of Human Development, Washington State University, USA.
| | - Sammy Perone
- Department of Human Development, Washington State University, USA
| |
Collapse
|
26
|
Aristizabal-Tique VH, Henao-Pérez M, López-Medina DC, Zambrano-Cruz R, Díaz-Londoño G. Facial thermal and blood perfusion patterns of human emotions: Proof-of-Concept. J Therm Biol 2023; 112:103464. [PMID: 36796909 DOI: 10.1016/j.jtherbio.2023.103464] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2021] [Revised: 12/07/2022] [Accepted: 12/22/2022] [Indexed: 01/11/2023]
Abstract
In this work, a preliminary study of proof-of-concept was conducted to evaluate the performance of the thermographic and blood perfusion data when emotions of positive and negative valence are applied, where the blood perfusion data are obtained from the thermographic data. The images were obtained for baseline, positive, and negative valence according to the protocol of the Geneva Affective Picture Database. Absolute and percentage differences of average values of the data between the valences and the baseline were calculated for different regions of interest (forehead, periorbital eyes, cheeks, nose and upper lips). For negative valence, a decrease in temperature and blood perfusion was observed in the regions of interest, and the effect was greater on the left side than on the right side. In positive valence, the temperature and blood perfusion increased in some cases, showing a complex pattern. The temperature and perfusion of the nose was reduced for both valences, which is indicative of the arousal dimension. The blood perfusion images were found to be greater contrast; the percentage differences in the blood perfusion images are greater than those obtained in thermographic images. Moreover, the blood perfusion images, and vasomotor answer are consistent, therefore, they can be a better biomarker than thermographic analysis in identifying emotions.
Collapse
Affiliation(s)
| | - Marcela Henao-Pérez
- School of Medicine, Universidad Cooperativa de Colombia, Medellín, 050012, Colombia.
| | | | - Renato Zambrano-Cruz
- School of Psychology, Universidad Cooperativa de Colombia, Medellín, 050012, Colombia.
| | - Gloria Díaz-Londoño
- School of Science, Universidad Nacional de Colombia-Sede, Medellín, 050034, Colombia.
| |
Collapse
|
27
|
Dehghani A, Soltanian-Zadeh H, Hossein-Zadeh GA. Probing fMRI brain connectivity and activity changes during emotion regulation by EEG neurofeedback. Front Hum Neurosci 2023; 16:988890. [PMID: 36684847 PMCID: PMC9853008 DOI: 10.3389/fnhum.2022.988890] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Accepted: 12/13/2022] [Indexed: 01/09/2023] Open
Abstract
Despite the existence of several emotion regulation studies using neurofeedback, interactions among a small number of regions were evaluated, and therefore, further investigation is needed to understand the interactions of the brain regions involved in emotion regulation. We implemented electroencephalography (EEG) neurofeedback with simultaneous functional magnetic resonance imaging (fMRI) using a modified happiness-inducing task through autobiographical memories to upregulate positive emotion. Then, an explorative analysis of whole brain regions was done to understand the effect of neurofeedback on brain activity and the interaction of whole brain regions involved in emotion regulation. The participants in the control and experimental groups were asked to do emotion regulation while viewing positive images of autobiographical memories and getting sham or real (based on alpha asymmetry) EEG neurofeedback, respectively. The proposed multimodal approach quantified the effects of EEG neurofeedback in changing EEG alpha power, fMRI blood oxygenation level-dependent (BOLD) activity of prefrontal, occipital, parietal, and limbic regions (up to 1.9% increase), and functional connectivity in/between prefrontal, parietal, limbic system, and insula in the experimental group. New connectivity links were identified by comparing the brain functional connectivity between experimental conditions (Upregulation and View blocks) and also by comparing the brain connectivity of the experimental and control groups. Psychometric assessments confirmed significant changes in positive and negative mood states in the experimental group by neurofeedback. Based on the exploratory analysis of activity and connectivity among all brain regions involved in emotion regions, we found significant BOLD and functional connectivity increases due to EEG neurofeedback in the experimental group, but no learning effect was observed in the control group. The results reveal several new connections among brain regions as a result of EEG neurofeedback which can be justified according to emotion regulation models and the role of those regions in emotion regulation and recalling positive autobiographical memories.
Collapse
Affiliation(s)
- Amin Dehghani
- School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran,Department of Psychological and Brain Sciences, Dartmouth College, Hanover, NH, United States,*Correspondence: Amin Dehghani, ,
| | - Hamid Soltanian-Zadeh
- School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran,Medical Image Analysis Lab, Department of Radiology and Research Administration, Henry Ford Health System, Detroit, MI, United States,School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| | - Gholam-Ali Hossein-Zadeh
- School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran,School of Cognitive Sciences, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran
| |
Collapse
|
28
|
Norris JE, DeStefano LA, Schmitt LM, Pedapati EV, Erickson CA, Sweeney JA, Ethridge LE. Hemispheric Utilization of Alpha Oscillatory Dynamics as a Unique Biomarker of Neural Compensation in Females with Fragile X Syndrome. ACS Chem Neurosci 2022; 13:3389-3402. [PMID: 36411085 DOI: 10.1021/acschemneuro.2c00404] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
Abstract
Fragile X syndrome (FXS) is a neurodevelopmental disorder caused by a trinucleotide expansion on the FMR1 gene and characterized by intellectual disability, sensory hypersensitivity, executive function difficulties, and social anxiety. Recently, efforts to define neural biomarkers for FXS have highlighted disruptions to power in the alpha frequency band; however the dynamic mechanisms supporting these findings are poorly understood. The current study aimed to explore the temporal and hemispheric dynamics supporting alpha phenotypes in FXS and their relationship with neural phenotypes related to auditory processing using electroencephalography during an auditory evoked task. Adolescents and adults (N = 36) with FXS and age/sex matched typically developing controls (N = 40) completed an auditory chirp task. Frontal alpha power in the prestimulus period was decomposed into "bursts" using percentile thresholding, then assessed for number of bursts per second (burst count) and burst length. Data were compared across left and right hemispheres to assess lateralization of neural activity. Individuals with FXS showed more differences in alpha power compared to TDC primarily in the right hemisphere. Notably, alpha hemisphere outcomes in males with FXS were driven by the number of times they entered a dynamically relevant period of alpha (burst count) rather than length of time spent in alpha. Females with FXS showed reduced burst counts but remained in sustained high alpha states for longer periods of time. Length of time spent in alpha may reflect a modulatory or compensatory mechanism capable of recovering sensory processing abilities in females with FXS resulting in a less severe clinical presentation. Right hemisphere abnormalities may impact sensory processing differences between males and females with FXS. The relationship between alpha burst length, count, sex, and hemisphere may shed light on underlying mechanisms for previously observed alpha power abnormalities in FXS and their variation by sex.
Collapse
Affiliation(s)
- Jordan E Norris
- Department of Psychology, University of Oklahoma, Norman, Oklahoma 73019, United States
| | - Lisa A DeStefano
- Division of Developmental and Behavioral Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio 45229, United States
| | - Lauren M Schmitt
- Division of Developmental and Behavioral Pediatrics, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio 45229, United States.,Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati, Cincinnati, Ohio 45221, United States
| | - Ernest V Pedapati
- Division of Child and Adolescent Psychiatry, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio 45229, United States.,Division of Child Neurology, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio 45229, United States.,Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati, Cincinnati, Ohio 45221, United States
| | - Craig A Erickson
- Division of Child and Adolescent Psychiatry, Cincinnati Children's Hospital Medical Center, Cincinnati, Ohio 45229, United States.,Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati, Cincinnati, Ohio 45221, United States
| | - John A Sweeney
- Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati, Cincinnati, Ohio 45221, United States
| | - Lauren E Ethridge
- Department of Psychology, University of Oklahoma, Norman, Oklahoma 73019, United States.,Department of Pediatrics, Section on Developmental and Behavioral Pediatrics, University of Oklahoma Health Sciences Center, Oklahoma City, Oklahoma 73104, United States
| |
Collapse
|
29
|
Bagherzadeh S, Maghooli K, Shalbaf A, Maghsoudi A. Emotion recognition using effective connectivity and pre-trained convolutional neural networks in EEG signals. Cogn Neurodyn 2022; 16:1087-1106. [PMID: 36237402 PMCID: PMC9508317 DOI: 10.1007/s11571-021-09756-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2020] [Revised: 09/29/2021] [Accepted: 11/14/2021] [Indexed: 12/26/2022] Open
Abstract
Convolutional Neural Networks (CNN) have recently made considerable advances in the field of biomedical signal processing. These methodologies can assist in emotion recognition for affective brain computer interface. In this paper, a novel emotion recognition system based on the effective connectivity and the fine-tuned CNNs from multichannel Electroencephalogram (EEG) signal is presented. After preprocessing EEG signals, the relationships among 32 channels of EEG in the form of effective brain connectivity analysis which represents information flow between regions are computed by direct Directed Transfer Function (dDTF) method which yields a 32*32 image. Then, these constructed images from EEG signals for each subject were fed as input to four versions of pre-trained CNN models, AlexNet, ResNet-50, Inception-v3 and VGG-19 and the parameters of these models are fine-tuned, independently. The proposed deep learning architectures automatically learn patterns in the constructed image of the EEG signals in frequency bands. The efficiency of the proposed approach is evaluated on MAHNOB-HCI and DEAP databases. The experiments for classifying five emotional states show that the ResNet-50 applied on dDTF images in alpha band achieves best results due to specific architecture which captures the brain connectivity, efficiently. The accuracy and F1-score values for MAHNOB-HCI were obtained 99.41, 99.42 and for DEAP databases, 98.17, and 98.23. Newly proposed model is capable of effectively analyzing the brain function using information flow from multichannel EEG signals using effective connectivity measure of dDTF and ResNet-50.
Collapse
Affiliation(s)
- Sara Bagherzadeh
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Keivan Maghooli
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| | - Ahmad Shalbaf
- Department of Biomedical Engineering and Medical Physics, School of Medicine, Shahid Beheshti University of Medical Sciences, Tehran, Iran
| | - Arash Maghsoudi
- Department of Biomedical Engineering, Science and Research Branch, Islamic Azad University, Tehran, Iran
| |
Collapse
|
30
|
Hemispheric asymmetries for emotions in non-human primates: A systematic review. Neurosci Biobehav Rev 2022; 141:104830. [PMID: 36031009 DOI: 10.1016/j.neubiorev.2022.104830] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 07/19/2022] [Accepted: 08/14/2022] [Indexed: 11/21/2022]
Abstract
A systematic review of investigations evaluating hemispheric asymmetries for emotions in primates was undertaken to individuate the most consistent lines of research allowing to check the hypothesis of a continuum in emotional lateralization across vertebrates. We reviewed studies on the lateralization of emotional expression (N = 31) and perception (N = 32) and of markers of emotional activation (N = 9), trying to distinguish those which had given respectively more consistent or more conflicting outcomes. Furthermore, we tried to identify the most strongly supported model of emotional lateralization. The most consistent results were obtained in studies investigating asymmetries in emotional expression at the facial level and in the perception of emotional facial expressions, whereas the most disappointing data were obtained in investigations evaluating possible neurophysiological markers of lateralized emotional activation. These results supported more the hypothesis of a continuity between humans and non-human primates than the more general hypothesis of a continuum between humans and all vertebrates. Furthermore, results supported more the 'right hemisphere' than the 'valence' model of emotional lateralization.
Collapse
|
31
|
Akil AM, Ujhelyi A, Logemann HNA. Exposure to Depression Memes on Social Media Increases Depressive Mood and It Is Moderated by Self-Regulation: Evidence From Self-Report and Resting EEG Assessments. Front Psychol 2022; 13:880065. [PMID: 35846661 PMCID: PMC9278136 DOI: 10.3389/fpsyg.2022.880065] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Accepted: 04/25/2022] [Indexed: 11/13/2022] Open
Abstract
This study aimed to investigate the effects of depression memes, spread mainly on social media, on depressive mood, and the moderating role of self-regulation based on self-report and electrophysiological (resting EEG frontal alpha asymmetry) assessments. We conducted a semi-online crossover study; first, we collected brain activity data from healthy young adults (n = 32) who were subsequently provided a link to the online experiment. Each participant participated in both the neutral and meme conditions. We also evaluated their level of depressive mood immediately before and after exposure to the stimuli. We further conducted a series of linear mixed effects model analyses and found that depression memes contributed to an increase in depressive symptoms. Specifically, lack of emotional clarity, difficulties in goal-directed behaviors in emotional distress, and impulse control difficulties were linked to greater depressive mood in the case of exposure to depression memes compared with neutral images. However, time interactions were insignificant. These results mainly indicate the centrality of behavioral problems during times of emotional distress caused by depression memes. Lastly, although frontal alpha asymmetry did not predict a change in depressive mood or significantly differ across conditions, lower inhibitory control may result in increased processing of depression memes as negative stimuli. This result is consistent with our self-report results (e.g., impulsivity) as well as other related studies in the literature. However, further research is needed to verify these frontal alpha asymmetry results.
Collapse
Affiliation(s)
- Atakan M. Akil
- Doctoral School of Psychology, ELTE Eötvös Loránd University, Budapest, Hungary,Institute of Psychology, ELTE, Eötvös Loránd University, Budapest, Hungary,*Correspondence: Atakan M. Akil,
| | - Adrienn Ujhelyi
- Institute of Psychology, ELTE, Eötvös Loránd University, Budapest, Hungary
| | | |
Collapse
|
32
|
Turk E, Endevelt-Shapira Y, Feldman R, van den Heuvel MI, Levy J. Brains in Sync: Practical Guideline for Parent-Infant EEG During Natural Interaction. Front Psychol 2022; 13:833112. [PMID: 35572249 PMCID: PMC9093685 DOI: 10.3389/fpsyg.2022.833112] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Accepted: 04/05/2022] [Indexed: 12/14/2022] Open
Abstract
Parent-infant EEG is a novel hyperscanning paradigm to measure social interaction simultaneously in the brains of parents and infants. The number of studies using parent-infant dual-EEG as a theoretical framework to measure brain-to-brain synchrony during interaction is rapidly growing, while the methodology for measuring synchrony is not yet uniform. While adult dual-EEG methodology is quickly improving, open databases, tutorials, and methodological validations for dual-EEG with infants are largely missing. In this practical guide, we provide a step-by-step manual on how to implement and run parent-infant EEG paradigms in a neurodevelopmental laboratory in naturalistic settings (e.g., free interactions). Next, we highlight insights on the variety of choices that can be made during (pre)processing dual-EEG data, including recommendations on interpersonal neural coupling metrics and interpretations of the results. Moreover, we provide an exemplar dataset of two mother-infant dyads during free interactions ("free play") that may serve as practice material. Instead of providing a critical note, we would like to move the field of parent-infant EEG forward and be transparent about the challenges that come along with the exciting opportunity to study the development of our social brain within the naturalistic context of dual-EEG.
Collapse
Affiliation(s)
- Elise Turk
- Department of Cognitive Neuropsychology, Tilburg University, Tilburg, Netherlands
| | - Yaara Endevelt-Shapira
- Baruch Ivcher School of Psychology, Interdisciplinary Center Herzliya, Reichman University, Herzliya, Israel
| | - Ruth Feldman
- Baruch Ivcher School of Psychology, Interdisciplinary Center Herzliya, Reichman University, Herzliya, Israel
| | | | - Jonathan Levy
- Baruch Ivcher School of Psychology, Interdisciplinary Center Herzliya, Reichman University, Herzliya, Israel.,Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| |
Collapse
|
33
|
Bagherzadeh S, Maghooli K, Shalbaf A, Maghsoudi A. Recognition of emotional states using frequency effective connectivity maps through transfer learning approach from electroencephalogram signals. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103544] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2022]
|
34
|
Tucek G, Maidhof C, Vogl J, Heine A, Zeppelzauer M, Steinhoff N, Fachner J. EEG Hyperscanning and Qualitative Analysis of Moments of Interest in Music Therapy for Stroke Rehabilitation—A Feasibility Study. Brain Sci 2022; 12:brainsci12050565. [PMID: 35624953 PMCID: PMC9139517 DOI: 10.3390/brainsci12050565] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 04/23/2022] [Accepted: 04/24/2022] [Indexed: 02/04/2023] Open
Abstract
Interdisciplinary research into the underlying neural processes of music therapy (MT) and subjective experiences of patients and therapists are largely lacking. The aim of the current study was to assess the feasibility of newly developed procedures (including electroencephalography/electrocardiography hyperscanning, synchronous audio–video monitoring, and qualitative interviews) to study the personal experiences and neuronal dynamics of moments of interest during MT with stroke survivors. The feasibility of our mobile setup and procedures as well as their clinical implementation in a rehabilitation centre and an acute hospital ward were tested with four phase C patients. Protocols and interviews were used for the documentation and analysis of the feasibility. Recruiting patients for MT sessions was feasible, although data collection on three consecutive weeks was not always possible due to organisational constraints, especially in the hospital with acute ward routines. Research procedures were successfully implemented, and according to interviews, none of the patients reported any burden, tiredness, or increased stress due to the research procedures, which lasted approx. 3 h (ranging from 135 min to 209 min) for each patient. Implementing the research procedures in a rehabilitation unit with stroke patients was feasible, and only small adaptations were made for further research.
Collapse
Affiliation(s)
- Gerhard Tucek
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
| | - Clemens Maidhof
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge CB1 2LZ, UK
| | - Julia Vogl
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
| | - Astrid Heine
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
| | - Matthias Zeppelzauer
- Department of Media & Digital Technologies, Institute of Creative Media Technologies, St. Poelten University of Applied Sciences, 3100 St. Poelten, Austria;
| | - Nikolaus Steinhoff
- OptimaMed Neurological Rehabilitation Centre Kittsee GmbH, 2421 Kittsee, Austria;
| | - Jörg Fachner
- Josef Ressel Centre for Horizons of Personalised Music Therapy, Department of Health Sciences, Institute for Therapeutic Sciences, IMC University of Applied Sciences Krems, 3500 Krems, Austria; (G.T.); (C.M.); (J.V.); (A.H.)
- Cambridge Institute for Music Therapy Research, Anglia Ruskin University, Cambridge CB1 2LZ, UK
- Correspondence: ; Tel.: +44-1223-698-416
| |
Collapse
|
35
|
Yue K, Guo M, Liu Y, Hu H, Lu K, Chen S, Wang D. Investigate the Neuro Mechanisms of Stereoscopic Visual Fatigue. IEEE J Biomed Health Inform 2022; 26:2963-2973. [PMID: 35316199 DOI: 10.1109/jbhi.2022.3161083] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Stereoscopic visual fatigue (SVF) due to prolonged immersion in the virtual environment can lead to negative user experience, thus hindering the development of virtual reality (VR) industry. Previous studies have focused on investigating the evaluation indicators associated with SVF, while few studies have been conducted to reveal the underlying neural mechanism, especially in VR applications. In this paper, a modified Go/NoGo paradigm was adopted to induce SVF in VR environment with Go trials for maintaining participants' attention to experimental viewing tasks and NoGo trials for investigating the neural effects under SVF. Random dot stereograms (RDSs) with 11 disparities and 2 types of shapes (arrow and rectangle) were presented to evoke the depth-related visual evoked potentials (DVEPs) during 64-channel EEG recordings. EEG datasets collected from 15 participants in NoGo trials were selected to conduct individual processing and group analysis, in which the characteristics of the DVEPs components for various fatigue degrees were compared with one-way repeated-measurement ANOVA and independent components were clustered to explore the original cortex areas related to SVF. Point-by-point permutation statistics revealed that DVEPs sample points from 230ms to 280ms in most brain areas changed significantly with SVF. More specifically, we found that amplitudes of component P2 changed significantly when SVF increased. Additionally, independent component analysis (ICA) identified that component P2 which originated from posterior cingulate cortex and precuneus, was associated statistically with SVF. We believe that SVF is rather a conscious status concerning the changes of self-awareness or self-location awareness than the performance reduction of retinal image processing. Moreover, we suggest that indicators representing higher conscious state may be a better indicator for SVF evaluation in VR environments.
Collapse
|
36
|
Wang Z, Goerlich KS, Xu P, Luo Y, Aleman A. Perceptive and Affective Impairments In Emotive Eye-Region Processing in Alexithymia. Soc Cogn Affect Neurosci 2022; 17:912-922. [PMID: 35277722 PMCID: PMC9527467 DOI: 10.1093/scan/nsac013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2021] [Revised: 01/13/2022] [Accepted: 02/20/2022] [Indexed: 12/02/2022] Open
Abstract
Alexithymia is characterized by impairments in emotion processing, frequently linked to facial expressions of emotion. The eye-region conveys information necessary for emotion processing. It has been demonstrated that alexithymia is associated with reduced attention to the eyes, but little is known regarding the cognitive and electrophysiological mechanisms underlying emotive eye-region processing in alexithymia. Here, we recorded behavioral and electrophysiological responses of individuals with alexithymia (ALEX; n = 25) and individuals without alexithymia (NonALEX; n = 23) while they viewed intact and eyeless faces with angry and sad expressions during a dual-target rapid serial visual presentation task. Results showed different eye-region focuses and differentiating N1 responses between intact and eyeless faces to anger and sadness in NonALEX, but not in ALEX, suggesting deficient perceptual processing of the eye-region in alexithymia. Reduced eye-region focus and smaller differences in frontal alpha asymmetry in response to sadness between intact and eyeless faces were observed in ALEX than NonALEX, indicative of impaired affective processing of the eye-region in alexithymia. These findings highlight perceptual and affective abnormalities of emotive eye-region processing in alexithymia. Our results contribute to understanding the neuropsychopathology of alexithymia and alexithymia-related disorders.
Collapse
Affiliation(s)
- Zhihao Wang
- Shenzhen Key Laboratory of Affective and Social Neuroscience, Magnetic Resonance Imaging Center, Center for Brain Disorders and Cognitive Sciences, Center for Brain Disorders and Cognitive Sciences, Shenzhen University, Shenzhen 518060, China
- Department of Biomedical Sciences of Cells & Systems, Section Cognitive Neuroscience, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Katharina S Goerlich
- Department of Biomedical Sciences of Cells & Systems, Section Cognitive Neuroscience, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Pengfei Xu
- Beijing Key Laboratory of Applied Experimental Psychology, National Demonstration Center for Experimental Psychology Education (BNU), Faculty of Psychology, Beijing Normal University, Beijing 100875, China
- Center for Neuroimaging, Shenzhen Institute of Neuroscience, Shenzhen 518106, China
| | - Yuejia Luo
- Shenzhen Key Laboratory of Affective and Social Neuroscience, Magnetic Resonance Imaging Center, Center for Brain Disorders and Cognitive Sciences, Center for Brain Disorders and Cognitive Sciences, Shenzhen University, Shenzhen 518060, China
- College of Teacher Education, Qilu Normal University, Jinan 250200, China
- The Research Center of Brain Science and Visual Cognition, Medical School, Kunming University of Science and Technology, Kunming 650031, China
| | - André Aleman
- Shenzhen Key Laboratory of Affective and Social Neuroscience, Magnetic Resonance Imaging Center, Center for Brain Disorders and Cognitive Sciences, Center for Brain Disorders and Cognitive Sciences, Shenzhen University, Shenzhen 518060, China
- Department of Biomedical Sciences of Cells & Systems, Section Cognitive Neuroscience, University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| |
Collapse
|
37
|
Metzen D, Genç E, Getzmann S, Larra MF, Wascher E, Ocklenburg S. Frontal and parietal EEG alpha asymmetry: a large-scale investigation of short-term reliability on distinct EEG systems. Brain Struct Funct 2021; 227:725-740. [PMID: 34676455 PMCID: PMC8843903 DOI: 10.1007/s00429-021-02399-1] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Accepted: 09/28/2021] [Indexed: 11/29/2022]
Abstract
EEG resting-state alpha asymmetry is one of the most widely investigated forms of functional hemispheric asymmetries in both basic and clinical neuroscience. However, studies yield inconsistent results. One crucial prerequisite to obtain reproducible results is the reliability of the index of interest. There is a body of research suggesting a moderate-to-good reliability of EEG resting-state alpha asymmetry, but unfortunately sample sizes in these studies are typically small. This study presents the first large-scale short-term reliability study of frontal and parietal EEG resting-state alpha asymmetry. We used the Dortmund Vital Study data set containing 370 participants. In each participant, EEG resting state was recorded eight times, twice with their eyes opened, twice with their eyes-closed, each on two different EEG systems. We found good reliability of EEG alpha power and alpha asymmetry on both systems for electrode pairs. We also found that alpha power asymmetry reliability is higher in the eyes-closed condition than in the eyes-open condition. The frontomedial electrode pair showed weaker reliability than the frontolateral and parietal electrode pairs. Interestingly, we found no population-level alpha asymmetry in frontal electrodes, one of the most investigated electrode sites in alpha asymmetry research. In conclusion, our results suggest that while EEG alpha asymmetry is an overall reliable measure, frontal alpha asymmetry should be assessed using multiple electrode pairs.
Collapse
Affiliation(s)
- Dorothea Metzen
- Department of Biopsychology, Faculty of Psychology, Institute of Cognitive Neuroscience, Ruhr University Bochum, Universitätsstraße 150, 44801, Bochum, Germany.
| | - Erhan Genç
- Department of Psychology and Neurosciences, Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund (IfADo), 44139, Dortmund, Germany
| | - Stephan Getzmann
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund (IfADo), 44139, Dortmund, Germany
| | - Mauro F Larra
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund (IfADo), 44139, Dortmund, Germany
| | - Edmund Wascher
- Department of Ergonomics, Leibniz Research Centre for Working Environment and Human Factors, Technical University of Dortmund (IfADo), 44139, Dortmund, Germany
| | | |
Collapse
|
38
|
Poltorak A. Replicating Cortical Signatures May Open the Possibility for "Transplanting" Brain States via Brain Entrainment. Front Hum Neurosci 2021; 15:710003. [PMID: 34630058 PMCID: PMC8492906 DOI: 10.3389/fnhum.2021.710003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2021] [Accepted: 08/18/2021] [Indexed: 02/03/2023] Open
Abstract
Brain states, which correlate with specific motor, cognitive, and emotional states, may be monitored with noninvasive techniques such as electroencephalography (EEG) and magnetoencephalography (MEG) that measure macroscopic cortical activity manifested as oscillatory network dynamics. These rhythmic cortical signatures provide insight into the neuronal activity used to identify pathological cortical function in numerous neurological and psychiatric conditions. Sensory and transcranial stimulation, entraining the brain with specific brain rhythms, can effectively induce desired brain states (such as state of sleep or state of attention) correlated with such cortical rhythms. Because brain states have distinct neural correlates, it may be possible to induce a desired brain state by replicating these neural correlates through stimulation. To do so, we propose recording brain waves from a "donor" in a particular brain state using EEG/MEG to extract cortical signatures of the brain state. These cortical signatures would then be inverted and used to entrain the brain of a "recipient" via sensory or transcranial stimulation. We propose that brain states may thus be transferred between people by acquiring an associated cortical signature from a donor, which, following processing, may be applied to a recipient through sensory or transcranial stimulation. This technique may provide a novel and effective neuromodulation approach to the noninvasive, non-pharmacological treatment of a variety of psychiatric and neurological disorders for which current treatments are mostly limited to pharmacotherapeutic interventions.
Collapse
Affiliation(s)
- Alexander Poltorak
- Neuroenhancement Lab, Suffern, NY, United States
- The City College of New York, New York, NY, United States
| |
Collapse
|
39
|
Gainotti G. The Difficult Integration between Human and Animal Studies on Emotional Lateralization: A Perspective Article. Brain Sci 2021; 11:brainsci11080975. [PMID: 34439594 PMCID: PMC8395003 DOI: 10.3390/brainsci11080975] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 07/16/2021] [Accepted: 07/17/2021] [Indexed: 01/12/2023] Open
Abstract
Even if for many years hemispheric asymmetries have been considered as a uniquely human feature, an increasing number of studies have described hemispheric asymmetries for various behavioral functions in several nonhuman species. An aspect of animal lateralization that has attracted particular attention has concerned the hemispheric asymmetries for emotions, but human and animal studies on this subject have been developed as independent lines of investigation, without attempts for their integration. In this perspective article, after an illustration of factors that have hampered the integration between human and animal studies on emotional lateralization, I will pass to analyze components and stages of the processing of emotions to distinguish those which point to a continuum between humans and many animal species, from those which suggest a similarity only between humans and great apes. The right lateralization of sympathetic functions (involved in brain and bodily activities necessary in emergency situations) seems consistent across many animal species, whereas asymmetries in emotional communication and in structures involved in emotional experience, similar to those observed in humans, have been documented only in primates.
Collapse
Affiliation(s)
- Guido Gainotti
- Institute of Neurology, Catholic University, Largo Agostino Gemelli 8, 00168 Rome, Italy
| |
Collapse
|
40
|
Pei G, Li T. A Literature Review of EEG-Based Affective Computing in Marketing. Front Psychol 2021; 12:602843. [PMID: 33796042 PMCID: PMC8007771 DOI: 10.3389/fpsyg.2021.602843] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2020] [Accepted: 02/19/2021] [Indexed: 01/18/2023] Open
Abstract
Affect plays an important role in the consumer decision-making process and there is growing interest in the development of new technologies and computational approaches that can interpret and recognize the affects of consumers, with benefits for marketing described in relation to both academia and industry. From an interdisciplinary perspective, this paper aims to review past studies focused on electroencephalography (EEG)-based affective computing (AC) in marketing, which provides a promising avenue for studying the mechanisms underlying affective states and developing recognition computational models to predict the psychological responses of customers. This review offers an introduction to EEG technology and an overview of EEG-based AC; provides a snapshot of the current state of the literature. It briefly presents the themes, challenges, and trends in studies of affect evaluation, recognition, and classification; and further proposes potential guidelines for researchers and marketers.
Collapse
Affiliation(s)
- Guanxiong Pei
- Zhejiang Laboratory, Research Center for Advanced AI Theory, Hangzhou, China
| | - Taihao Li
- Zhejiang Laboratory, Research Center for Advanced AI Theory, Hangzhou, China
| |
Collapse
|
41
|
Lacey MF, Gable PA. Frontal Asymmetry in an approach-avoidance conflict paradigm. Psychophysiology 2021; 58:e13780. [PMID: 33543777 DOI: 10.1111/psyp.13780] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Revised: 10/20/2020] [Accepted: 01/18/2021] [Indexed: 11/28/2022]
Abstract
The frontal cortex appears to be asymmetrically related to approach motivation, avoidance motivation, and motivational conflict. Much past work has investigated approach and avoidance motivation, but little work has investigated frontal asymmetry in the face of motivational conflict in part because of the inherent conflict between avoidance motivation and motivational conflict. The current study sought to disentangle the existing confound between avoidance motivation and motivational conflict. In the study, participants selected the likelihood of viewing negative (vs. positive) images for zero reward points (avoidance only condition), or negative (vs. positive) images for the chance to win reward points (approach-avoidance conflict conditions). Participants exhibited greater relative right frontal asymmetry while making percent likelihood selections in the approach-avoidance conflict conditions relative to the avoidance only conditions. Additionally, participants exhibited greater relative right frontal asymmetry while viewing disgust images during trials with the greatest approach-avoidance conflict relative to trials with the lowest approach-avoidance conflict. Together, these results suggest that motivational conflict, and not avoidance motivation, is associated with greater relative right frontal activity.
Collapse
Affiliation(s)
- Micayla F Lacey
- Department of Psychology, The University of Alabama, Tuscaloosa, AL, USA
| | - Philip A Gable
- Department of Psychology, The University of Alabama, Tuscaloosa, AL, USA.,Department of Psychology, University of Delaware, Newark, DE, USA
| |
Collapse
|
42
|
Packheiser J, Berretz G, Rook N, Bahr C, Schockenhoff L, Güntürkün O, Ocklenburg S. Investigating real-life emotions in romantic couples: a mobile EEG study. Sci Rep 2021; 11:1142. [PMID: 33441947 PMCID: PMC7806608 DOI: 10.1038/s41598-020-80590-w] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Accepted: 12/22/2020] [Indexed: 01/29/2023] Open
Abstract
The neural basis of emotional processing has been largely investigated in constrained spatial environments such as stationary EEGs or fMRI scanners using highly artificial stimuli like standardized pictures depicting emotional scenes. Typically, such standardized experiments have low ecological validity and it remains unclear whether their results reflect neuronal processing in real-life affective situations at all. Critically, emotional situations do not only encompass the perception of emotions, but also behavioral components associated with them. In this study, we aimed to investigate real-life emotions by recording couples in their homes using mobile EEG technology during embracing, kissing and emotional speech. We focused on asymmetries in affective processing as emotions have been demonstrated to be strongly lateralized in the brain. We found higher alpha and beta power asymmetry during kissing and embracing on frontal electrodes during emotional kisses and speech compared to a neutral control condition indicative of stronger left-hemispheric activation. In contrast, we found lower alpha power asymmetry at parieto-occipital electrode sites in the emotional compared to the neutral condition indicative of stronger right-hemispheric activation. Our findings for alpha power asymmetries are in line with models of emotional lateralization that postulate a valence-specific processing over frontal cortices and right-hemispheric dominance in emotional processing in parieto-occipital regions. In contrast, beta power asymmetries pointed more towards valence-specific processing indicating that, while alpha and beta frequencies seem to be functionally associated, they are not reflecting identical cognitive processing.
Collapse
Affiliation(s)
- Julian Packheiser
- grid.5570.70000 0004 0490 981XInstitute of Cognitive Neuroscience, Department of Psychology, Ruhr-University Bochum, Universitätsstraße 150, 44780 Bochum, Germany
| | - Gesa Berretz
- grid.5570.70000 0004 0490 981XInstitute of Cognitive Neuroscience, Department of Psychology, Ruhr-University Bochum, Universitätsstraße 150, 44780 Bochum, Germany
| | - Noemi Rook
- grid.5570.70000 0004 0490 981XInstitute of Cognitive Neuroscience, Department of Psychology, Ruhr-University Bochum, Universitätsstraße 150, 44780 Bochum, Germany
| | - Celine Bahr
- grid.5570.70000 0004 0490 981XInstitute of Cognitive Neuroscience, Department of Psychology, Ruhr-University Bochum, Universitätsstraße 150, 44780 Bochum, Germany
| | - Lynn Schockenhoff
- grid.5570.70000 0004 0490 981XInstitute of Cognitive Neuroscience, Department of Psychology, Ruhr-University Bochum, Universitätsstraße 150, 44780 Bochum, Germany
| | - Onur Güntürkün
- grid.5570.70000 0004 0490 981XInstitute of Cognitive Neuroscience, Department of Psychology, Ruhr-University Bochum, Universitätsstraße 150, 44780 Bochum, Germany
| | - Sebastian Ocklenburg
- grid.5570.70000 0004 0490 981XInstitute of Cognitive Neuroscience, Department of Psychology, Ruhr-University Bochum, Universitätsstraße 150, 44780 Bochum, Germany
| |
Collapse
|
43
|
Zohdi H, Scholkmann F, Wolf U. Individual Differences in Hemodynamic Responses Measured on the Head Due to a Long-Term Stimulation Involving Colored Light Exposure and a Cognitive Task: A SPA-fNIRS Study. Brain Sci 2021; 11:54. [PMID: 33466405 PMCID: PMC7824905 DOI: 10.3390/brainsci11010054] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2020] [Revised: 12/20/2020] [Accepted: 12/30/2020] [Indexed: 12/11/2022] Open
Abstract
When brain activity is measured by neuroimaging, the canonical hemodynamic response (increase in oxygenated hemoglobin ([O2Hb]) and decrease in deoxygenated hemoglobin ([HHb]) is not always seen in every subject. The reason for this intersubject-variability of the responses is still not completely understood. This study is performed with 32 healthy subjects, using the systemic physiology augmented functional near-infrared spectroscopy (SPA-fNIRS) approach. We investigate the intersubject variability of hemodynamic and systemic physiological responses, due to a verbal fluency task (VFT) under colored light exposure (CLE; blue and red). Five and seven different hemodynamic response patterns were detected in the subgroup analysis of the blue and red light exposure, respectively. We also found that arterial oxygen saturation and mean arterial pressure were positively correlated with [O2Hb] at the prefrontal cortex during the CLE-VFT independent of the color of light and classification of the subjects. Our study finds that there is substantial intersubject-variability of cerebral hemodynamic responses, which is partially explained by subject-specific systemic physiological changes induced by the CLE-VFT. This means that both subgroup analyses and the additional assessment of systemic physiology are of crucial importance to achieve a comprehensive understanding of the effects of a CLE-VFT on human subjects.
Collapse
Affiliation(s)
- Hamoon Zohdi
- Institute of Complementary and Integrative Medicine, University of Bern, 3012 Bern, Switzerland; (H.Z.); (F.S.)
| | - Felix Scholkmann
- Institute of Complementary and Integrative Medicine, University of Bern, 3012 Bern, Switzerland; (H.Z.); (F.S.)
- Biomedical Optics Research Laboratory, Neonatology Research, Department of Neonatology, University Hospital Zurich, University of Zurich, 8091 Zurich, Switzerland
| | - Ursula Wolf
- Institute of Complementary and Integrative Medicine, University of Bern, 3012 Bern, Switzerland; (H.Z.); (F.S.)
| |
Collapse
|
44
|
Perone S, Anderson AJ, Weybright EH. It is all relative: Contextual influences on boredom and neural correlates of regulatory processes. Psychophysiology 2020; 58:e13746. [PMID: 33314169 DOI: 10.1111/psyp.13746] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2020] [Revised: 09/23/2020] [Accepted: 11/18/2020] [Indexed: 02/01/2023]
Abstract
Interest in the influences on and strategies to mitigate boredom has grown immensely. Boredom emerges in contexts in which people have difficulty paying attention, such as underchallenging relative to optimally challenging conditions. The current study probed contextual influences on peoples' experience of boredom by manipulating the order with which people performed easy and optimally challenging conditions of a task (N = 113). We measured frontal alpha asymmetry (FAA) and theta/beta as neural correlates of self-regulatory and attentional control processes, respectively. Results showed self-reported boredom was higher in the easy condition when the optimal condition was completed before it. Similarly, participant's FAA shifted rightward from the first to the second task when the optimal condition was completed prior to the easy condition, indicating that self-regulatory processes were strongly engaged under these context-specific conditions. Theta/beta was lower during the easy relative to the optimal condition, regardless of the task order, indicating that maintaining attention in the easy condition was more difficult. No relations between perceptions of the task and neural correlates were observed. Exploratory analyses revealed higher levels of variability in FAA and theta/beta were associated with less enjoyment and more boredom, respectively. We speculate these observations reflect the less consistent engagement of self-regulatory and attentional control and, in turn, might play a role in peoples' subjective experience. We discuss the implications of our findings for our understanding of influences on and strategies to mitigate boredom, as well as how attentional and self-regulatory processes operate under conditions boredom typically emerges.
Collapse
Affiliation(s)
- Sammy Perone
- Department of Human Development, Washington State University, Pullman, WA, USA
| | - Alana J Anderson
- Department of Human Development, Washington State University, Pullman, WA, USA
| | | |
Collapse
|
45
|
Yum YN, Lau WKW, Poon K, Ho FC. Music therapy as social skill intervention for children with comorbid ASD and ID: study protocol for a randomized controlled trial. BMC Pediatr 2020; 20:545. [PMID: 33276744 PMCID: PMC7718656 DOI: 10.1186/s12887-020-02454-6] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/09/2020] [Accepted: 12/01/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Autism spectrum disorder (ASD) is a developmental impairment characterized by persistent deficits in social communication and interactions, and over half of children with ASD possess below average intellectual ability (IQ < 85). The social development and response to social skill interventions among children with ASD and comorbid intellectual disability (ID) is not well understood. Music therapy is a systematic process of intervention, wherein a therapist may help clients promote their social skills by using musical experience. The proposed study will address limited research evidence on music therapy as an intervention for social functioning in children with ASD with mild to borderline ID. METHOD A randomized controlled trial (RCT) with two parallel groups of 40 children each (1:1 allocation ratio) is planned. Participants will receive 45 min of music therapy or non-musical intervention targeting social skills once a week for 12 weeks. Primary outcome measures will be independent ratings on the Childhood Autism Rating Scale and parent ratings on the Social Responsiveness Scale-2. Linear mixed-effects models for these two outcome measures will be created for data collected at 2-week pre-intervention, 2-week post-intervention, and 4-month post-intervention sessions. In-session behaviors at the first and last intervention will be videotaped and coded offline and compared. Pretreatment neural response of quantitative electroencephalograms (qEEG) to social scenes will be used to predict the outcomes of musical and non-musical social skill interventions, whereas qEEG responses to music will be used to predict the effectiveness of musical social skill intervention. DISCUSSION If neural markers of social skill development are found, then the long-term goal is to develop individualized intervention based on pre-treatment markers to maximize treatment efficacy. The proposed study's results may also suggest directions to development and provision of music therapy services in Hong Kong. TRIAL REGISTRATION ClinicalTrials.gov ( NCT04557488 ). Registered September 21, 2020.
Collapse
Affiliation(s)
- Yen Na Yum
- Department of Special Education and Counselling, The Education University of Hong Kong, 10 Lo Ping Road, Tai Po, New Territories, Hong Kong SAR, China.
| | - Way Kwok-Wai Lau
- Department of Special Education and Counselling, The Education University of Hong Kong, 10 Lo Ping Road, Tai Po, New Territories, Hong Kong SAR, China
| | - Kean Poon
- Department of Special Education and Counselling, The Education University of Hong Kong, 10 Lo Ping Road, Tai Po, New Territories, Hong Kong SAR, China
| | - Fuk Chuen Ho
- Department of Special Education and Counselling, The Education University of Hong Kong, 10 Lo Ping Road, Tai Po, New Territories, Hong Kong SAR, China
| |
Collapse
|
46
|
He R, Fan J, Wang H, Zhong Y, Ma J. Differentiating Responders and Non-responders to rTMS Treatment for Disorder of Consciousness Using EEG After-Effects. Front Neurol 2020; 11:583268. [PMID: 33329325 PMCID: PMC7714935 DOI: 10.3389/fneur.2020.583268] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2020] [Accepted: 10/26/2020] [Indexed: 12/17/2022] Open
Abstract
Background: It is controversial whether repetitive transcranial magnetic stimulation (rTMS) has potential benefits in improving the awareness of patients with disorder of consciousness (DOC). We hypothesized that rTMS could improve consciousness only in DOC patients who have measurable brain responses to rTMS. Objective: In this study, we aimed to investigate the EEG after-effects induced by rTMS in DOC patients and attempted to propose a prediction algorithm to discriminate between DOC patients who would respond to rTMS treatment from those who would not. Methods: Twenty-five DOC patients were enrolled in this study. Over 4 weeks, each patient received 20 sessions of 20 Hz rTMS that was applied over the left dorsolateral prefrontal cortex (DLPFC). For each patient, resting-state EEG was recorded before and immediately after one session of rTMS to assess the neurophysiologic modification induced by rTMS. The coma recovery scale revised (CRS-R) was used to define responders with improved consciousness. Results: Of the 25 DOC patients, 10 patients regained improved consciousness and were classified as responders. The responders were characterized by more preserved alpha power and a significant reduction of delta power induced by rTMS. The analysis of receiver operating characteristic (ROC) curves showed that the algorithm calculated from the relative alpha power and the relative delta power had a high accuracy in identifying DOC patients who were responders. Conclusions: DOC patients who had more preserved alpha power and a significant reduction in the delta band that was induced by rTMS are likely to regain improved consciousness, which provides a tool to identify DOC patients who may benefit in terms of therapeutic consciousness.
Collapse
Affiliation(s)
- Renhong He
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China.,Department of Rehabilitation Medicine, Nanfang Hospital, Southern Medical University, Guangzhou, China
| | - Jianzhong Fan
- Department of Rehabilitation Medicine, Nanfang Hospital, Southern Medical University, Guangzhou, China
| | - Huijuan Wang
- Department of Rehabilitation Medicine, Nanfang Hospital, Southern Medical University, Guangzhou, China
| | - Yuhua Zhong
- Department of Rehabilitation Medicine, Nanfang Hospital, Southern Medical University, Guangzhou, China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangzhou, China
| |
Collapse
|
47
|
Stanković M. A conceptual critique of brain lateralization models in emotional face perception: Toward a hemispheric functional-equivalence (HFE) model. Int J Psychophysiol 2020; 160:57-70. [PMID: 33186657 DOI: 10.1016/j.ijpsycho.2020.11.001] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2020] [Revised: 10/15/2020] [Accepted: 11/04/2020] [Indexed: 01/21/2023]
Abstract
The present review proposes a novel dynamic model of brain lateralization of emotional (happy, surprised, fearful, sad, angry, and disgusted) and neutral face perception. Evidence to date suggests that emotional face perception is lateralized in the brain. At least five prominent hypotheses of the lateralization of emotional face perception have been previously proposed; the right-hemisphere hypothesis; the valence-specific hypothesis; the modified valence-specific hypothesis; the motivational hypothesis; and behavioral activation/inhibition system hypothesis. However, a growing number of recent replication studies exploring those hypotheses frequently provide inconsistent or even contradictory results. The latest neuroimaging and behavioral studies strongly demonstrate the functional capacity of both hemispheres to process emotions relatively successfully. Moreover, the flexibility of emotional brain-networks in both hemispheres is functionally high even to the extent of a possible reversed asymmetry of the left and the right hemisphere performance under altered neurophysiological and psychological conditions. The present review aims to a) provide a critical conceptual analysis of prior and current hypotheses of brain lateralization of emotional and neutral face perception; b) propose an integrative introduction of a novel hemispheric functional-equivalence (HFE) model in emotional and neutral face perception based on the evaluation of theoretical considerations, behavioral and neuroimaging studies: the brain is initially right-biased in emotional and neutral face perception by default; however, altered psychophysiological conditions (e.g., acute stress, a demanding emotional task) activate a distributed brain-network of both hemispheres toward functional equivalence that results in relatively equalized behavioral performance in emotional and neutral face perception. The proposed novel model may provide a practical tool in further experimental investigation of brain lateralization of emotional face perception.
Collapse
Affiliation(s)
- Miloš Stanković
- General and Experimental Psychology, Department of Psychology, Ludwig-Maximilians-Universität München, Munich, Germany.
| |
Collapse
|
48
|
Perone S, Gartstein MA, Anderson AJ. Dynamics of frontal alpha asymmetry in mother-infant dyads: Insights from the Still Face Paradigm. Infant Behav Dev 2020; 61:101500. [PMID: 33197784 DOI: 10.1016/j.infbeh.2020.101500] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2020] [Revised: 10/18/2020] [Accepted: 10/25/2020] [Indexed: 12/21/2022]
Abstract
The parent-infant dynamic has a foundational role in emotion regulation development. Electroencephalography (EEG) hyperscanning from mother-infant dyads can provide an unprecedented window into inter-brain dynamics during the parent-infant exchange. This potential depends on the feasibility of hyperscanning with dyads in emotionally taxing contexts. We sought to demonstrate feasibility of hyperscanning from 10 mother-infant dyads during the Still Face Procedure (SFP). We measured frontal alpha asymmetry (FAA) to elucidate ongoing regulatory dynamics and considered maternal caregiving quality as a window into dyads' history. Results showed dyads exhibited a rightward shift in FAA over the course of SFP, indicating growing negative emotionality and desire to withdraw. Results also showed growing variability in FAA for infants over the course of SFP, indicating less active emotional control as stress ensued. Variability was especially low for mothers during periods when asked to be emotionally unavailable, suggesting active control to match the task demands. Dyads with a more responsive mother exhibited higher (more left) FAA relative to dyads with a less responsive mother, which might reflect a more positive emotional experience overall. We raise important methodological and theoretical questions that hyperscanning during SFP can address, such as the developmental origins of trait-like self-regulatory dispositions.
Collapse
Affiliation(s)
- Sammy Perone
- Department of Human Development, Washington State University, United States.
| | - Maria A Gartstein
- Department of Psychology, Washington State University, United States
| | - Alana J Anderson
- Department of Human Development, Washington State University, United States
| |
Collapse
|
49
|
Gabrielli G, Bilucaglia M, Zito M, Laureanti R, Caponetto A, Circi R, Fici A, Rivetti F, Valesi R, Galanto A, Senoner G, Russo V. Neurocoaching: exploring the relationship between coach and coachee by means of bioelectrical signal similarities. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:3184-3187. [PMID: 33018681 DOI: 10.1109/embc44109.2020.9176497] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Coaching aims to unlock the human's potential, self-awareness and responsibility, improving the professional performances and the personal satisfaction. Its effectiveness is known to depend on the degree of bonding and mutual engagement of the coaching relationship. In this exploratory study we recorded synchronised EEG and SC data from both coach and coachee during 36 individual sessions, performed following 2 different coaching methods. Our principal aim was to investigate the temporal evolution of the bonding and the mutual engagement along the different steps of a session, by means of a "similarity" metric based on the DTW distance between signals (namely, S-TVM). We found significant differences between session phases for the EEG-related S-TVMs (BAR, BATR and AWI), with maximum values (defined as "tuning") all in the same phase, but differentiated between the two experiments. The results suggest a temporal concurrency of the engagement and emotional tunings, whose specific location seems to be a function of the coaching approach.
Collapse
|
50
|
Shen X, Hu X, Liu S, Song S, Zhang D. Exploring EEG microstates for affective computing: decoding valence and arousal experiences during video watching .. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2020; 2020:841-846. [PMID: 33018116 DOI: 10.1109/embc44109.2020.9175482] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Investigating the electroencephalography (EEG) correlates of human emotional experiences has attracted increasing interest in the field of affective computing. Substantial progress has been made during the past decades, mainly by using EEG features extracted from localized brain activities. The present study explored a brain network-based feature defined by EEG microstates for a possible representation of emotional experiences. A publicly available and widely used benchmarking EEG dataset called DEAP was used, in which 32 participants watched 40 one-minute music videos with their 32channel EEG recorded. Four quasi-stable prototypical microstates were obtained, and their temporal parameters were extracted as features. In random forest regression, the microstate features showed better performances for decoding valence (model fitting mean squared error (MSE) = 3.85±0.28 and 4.07 ± 0.30, respectively, p = 0.022) and comparable performances for decoding arousal (MSE = 3.30±0.30 and 3.41 ±0.31, respectively, p = 0.169), as compared to conventional spectral power features. As microstate features describe neural activities from a global spatiotemporal dynamical perspective, our findings demonstrate a possible new mechanism for understanding human emotion and provide a promising type of EEG feature for affective computing.
Collapse
|