1
|
Gkintoni E, Aroutzidis A, Antonopoulou H, Halkiopoulos C. From Neural Networks to Emotional Networks: A Systematic Review of EEG-Based Emotion Recognition in Cognitive Neuroscience and Real-World Applications. Brain Sci 2025; 15:220. [PMID: 40149742 PMCID: PMC11940461 DOI: 10.3390/brainsci15030220] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2024] [Revised: 02/11/2025] [Accepted: 02/15/2025] [Indexed: 03/29/2025] Open
Abstract
BACKGROUND/OBJECTIVES This systematic review presents how neural and emotional networks are integrated into EEG-based emotion recognition, bridging the gap between cognitive neuroscience and practical applications. METHODS Following PRISMA, 64 studies were reviewed that outlined the latest feature extraction and classification developments using deep learning models such as CNNs and RNNs. RESULTS Indeed, the findings showed that the multimodal approaches were practical, especially the combinations involving EEG with physiological signals, thus improving the accuracy of classification, even surpassing 90% in some studies. Key signal processing techniques used during this process include spectral features, connectivity analysis, and frontal asymmetry detection, which helped enhance the performance of recognition. Despite these advances, challenges remain more significant in real-time EEG processing, where a trade-off between accuracy and computational efficiency limits practical implementation. High computational cost is prohibitive to the use of deep learning models in real-world applications, therefore indicating a need for the development and application of optimization techniques. Aside from this, the significant obstacles are inconsistency in labeling emotions, variation in experimental protocols, and the use of non-standardized datasets regarding the generalizability of EEG-based emotion recognition systems. DISCUSSION These challenges include developing adaptive, real-time processing algorithms, integrating EEG with other inputs like facial expressions and physiological sensors, and a need for standardized protocols for emotion elicitation and classification. Further, related ethical issues with respect to privacy, data security, and machine learning model biases need to be much more proclaimed to responsibly apply research on emotions to areas such as healthcare, human-computer interaction, and marketing. CONCLUSIONS This review provides critical insight into and suggestions for further development in the field of EEG-based emotion recognition toward more robust, scalable, and ethical applications by consolidating current methodologies and identifying their key limitations.
Collapse
Affiliation(s)
- Evgenia Gkintoni
- Department of Educational Sciences and Social Work, University of Patras, 26504 Patras, Greece;
| | - Anthimos Aroutzidis
- Department of Management Science and Technology, University of Patras, 26334 Patras, Greece; (A.A.); (H.A.)
| | - Hera Antonopoulou
- Department of Management Science and Technology, University of Patras, 26334 Patras, Greece; (A.A.); (H.A.)
| | - Constantinos Halkiopoulos
- Department of Management Science and Technology, University of Patras, 26334 Patras, Greece; (A.A.); (H.A.)
| |
Collapse
|
2
|
Niu X, Utayde MF, Sanders KEG, Cunningham TJ, Zhang G, Kensinger EA, Payne JD. The effects of shared, depression-specific, and anxiety-specific internalizing symptoms on negative and neutral episodic memories following post-learning sleep. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2025; 25:114-134. [PMID: 39138784 PMCID: PMC11805811 DOI: 10.3758/s13415-024-01209-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 05/24/2024] [Indexed: 08/15/2024]
Abstract
Emotional memory bias is a common characteristic of internalizing symptomatology and is enhanced during sleep. The current study employs bifactor S-1 modeling to disentangle depression-specific anhedonia, anxiety-specific anxious arousal, and the common internalizing factor, general distress, and test whether these internalizing symptoms interact with sleep to influence memory for emotional and neutral information. Healthy adults (N = 281) encoded scenes featuring either negative objects (e.g., a vicious looking snake) or neutral objects (e.g., a chipmunk) placed on neutral backgrounds (e.g., an outdoor scene). After a 12-hour period of daytime wakefulness (n = 140) or nocturnal sleep (n = 141), participants judged whether objects and backgrounds were the same, similar, or new compared with what they viewed during encoding. Participants also completed the mini version of the Mood and Anxiety Symptom Questionnaire. Higher anxious arousal predicted worse memory across all stimuli features, but only after a day spent being awake-not following a night of sleep. No significant effects were found for general distress and anhedonia in either the sleep or wake condition. In this study, internalizing symptoms were not associated with enhanced emotional memory. Instead, memory performance specifically in individuals with higher anxious arousal was impaired overall, regardless of emotional valence, but this was only the case when the retention interval spanned wakefulness (i.e., not when it spanned sleep). This suggests that sleep may confer a protective effect on general memory impairments associated with anxiety.
Collapse
Affiliation(s)
- Xinran Niu
- Department of Psychology, University of Notre Dame, E466 Corbett Family Hall, Notre Dame, IN, 46556, USA
| | - Mia F Utayde
- Department of Psychology, University of Notre Dame, E466 Corbett Family Hall, Notre Dame, IN, 46556, USA
| | - Kristin E G Sanders
- Department of Psychology, University of Notre Dame, E466 Corbett Family Hall, Notre Dame, IN, 46556, USA
| | - Tony J Cunningham
- The Center for Sleep & Cognition, Harvard Medical School & Beth Israel Deaconess Medical Center, Boston, MA, USA
| | - Guangjian Zhang
- Department of Psychology, University of Notre Dame, E466 Corbett Family Hall, Notre Dame, IN, 46556, USA
| | | | - Jessica D Payne
- Department of Psychology, University of Notre Dame, E466 Corbett Family Hall, Notre Dame, IN, 46556, USA.
| |
Collapse
|
3
|
Muraki EJ, Born S, Pexman PM. Grasping Variance in Word Norms: Individual Differences in Motor Imagery and Semantic Ratings. J Cogn 2025; 8:12. [PMID: 39803178 PMCID: PMC11720573 DOI: 10.5334/joc.418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 11/09/2024] [Indexed: 01/16/2025] Open
Abstract
Word norming datasets have become an important resource for psycholinguistic research, and they are based on the underlying assumption that individual differences are inconsequential to the measurement of semantic dimensions. In this pre-registered study we tested this assumption by examining whether individual differences in motor imagery are related to variance in semantic ratings. We collected graspability ratings (i.e., how easily a word's referent can be grasped using one hand) for 350 words and also had each participant complete a series of motor imagery questionnaires. Using linear mixed effect models we tested whether measures of motor imagery ability (e.g., the Florida Praxis Imagery Questionnaire and the Test of Ability in Movement Imagery for Hands) and motor imagery vividness (e.g., the Vividness of Movement Imagery Questionnaire 2) could account for variance (raw and absolute difference scores) in graspability ratings. We observed a significant relationship between motor imagery vividness and absolute rating difference scores, wherein people with more vivid motor imagery provided ratings that were further from the mean word ratings. However there was no relationship between motor imagery and raw rating difference scores. The results suggest that there are measurable systematic differences in how participants make sensorimotor semantic ratings, which has implications for how sensorimotor semantic word norms are used for investigations of lexical semantic processing.
Collapse
Affiliation(s)
- Emiko J. Muraki
- Department of Psychology, University of Calgary, Calgary, Canada
| | - Sydney Born
- Department of Psychology, University of Calgary, Calgary, Canada
| | - Penny M. Pexman
- Department of Psychology, Western University, London, Canada
| |
Collapse
|
4
|
Berezina E, Lee AS, Gill CMHD, Chua JY. Is a picture worth the same emotions everywhere? Validation of images from the Nencki affective picture system in Malaysia. DISCOVER MENTAL HEALTH 2024; 4:61. [PMID: 39621142 PMCID: PMC11612132 DOI: 10.1007/s44192-024-00116-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/22/2024] [Accepted: 11/14/2024] [Indexed: 12/06/2024]
Abstract
Several validated image sets, such as NAPS, IAPS, GAPED, and OASIS, have been developed to elicit affective states. However, these image sets were primarily validated on Western populations within European and American contexts, and none have been fully validated in a Southeast Asian sample, where emotional restraint may also be valued similarly to the East Asian contexts. This study aimed to validate and provide norms for the Nencki Affective Picture System (NAPS; Marchewka et al., 2014) within a Malaysian sample. Subsets from the 1356 NAPS images consisting of five image categories (faces, people, objects, landscapes, animals) were presented sequentially to 409 Malaysian adults aged 18 and above, who rated images for valence, arousal and approach/avoidance on a 9-point Likert scale. Valence, arousal and approach/avoidance norms were compared against the original European sample. Malaysian men and women rated images with lower valence and motivation than Europeans, but Malaysian men showed higher arousal ratings compared to European men, while Malaysian women exhibited the opposite pattern, with lower arousal ratings than European women. A linear regression was found instead of a classic 'boomerang' shaped quadratic regression previously observed in Western samples, suggesting that emotional suppression may be at play, in line with social norms. The Malaysian normative ratings will be freely available to all researchers.
Collapse
Affiliation(s)
| | - Ai-Suan Lee
- Department of Psychology, Sunway University, Bandar Sunway, Malaysia
| | | | - Jie Yun Chua
- Department of Economics, University of Warwick, Coventry, UK
| |
Collapse
|
5
|
Song D, Wen H, Dong Y. Affective Norms for Chinese Words of Typical Life Scenes Rated by Older Adults (ANCO). JOURNAL OF PSYCHOLINGUISTIC RESEARCH 2023; 52:1115-1140. [PMID: 37022625 DOI: 10.1007/s10936-023-09948-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 03/19/2023] [Indexed: 06/19/2023]
Abstract
The present study provides an affective norm collected from older adults for 1,050 Chinese words that are closely related to the typical life scenes commonly encountered by older adults. Data were collected for key affective dimensions of valence and arousal using the method of adapted Self-Assessment Manikin (Bradley & Lang, 1994) in a paper-and-pencil procedure. The results showed that the current database (ANCO) was of high reliability and validity. Valence and arousal were in an asymmetrically quadratic relationship in the valence-by-arousal space; i.e., older adults rated negative words as the highest arousing, followed by positive and neutral words. In addition, by comparing affective ratings of the shared words between the present norm collected from older Chinese adults and previous norms collected from young Chinese adults (Wang et al., 2008; Yao et al., 2017; Yu et al., 2016), we found that compared with young adults, older ones perceived negative words as more negative and more arousing, and perceived positive words as more positive and less arousing. ANCO can serve as a valuable source of information for age-related affective research and help explicate the effects of emotion on linguistic and cognitive processes.
Collapse
Affiliation(s)
- Dangui Song
- Language Processing and Development Lab, School of International Studies, Zhejiang University, Hangzhou, China
| | - Hao Wen
- Language Processing and Development Lab, School of International Studies, Zhejiang University, Hangzhou, China
| | - Yanping Dong
- Language Processing and Development Lab, School of International Studies, Zhejiang University, Hangzhou, China.
| |
Collapse
|
6
|
Teismann H, Schubert R, Reilmann R, Berger K. Effects of age and sex on outcomes of the Q-Motor speeded finger tapping and grasping and lifting tests-findings from the population-based BiDirect Study. Front Neurol 2022; 13:965031. [PMID: 36247774 PMCID: PMC9561931 DOI: 10.3389/fneur.2022.965031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Accepted: 08/30/2022] [Indexed: 12/03/2022] Open
Abstract
Background Q-Motor is a suite of motor tests originally designed to assess motor symptoms in Huntington's disease. Among others, Q-Motor encompasses a finger tapping task and a grasping and lifting task. To date, there are no systematic investigations regarding effects of variables which may affect the performance in specific Q-Motor tests per se, and normative Q-Motor data based on a large population-based sample are not yet available. Objective We investigated effects of age and sex on five selected Q-Motor outcomes representing the two core Q-Motor tasks speeded finger tapping and grasping and lifting in a community sample of middle-aged to elderly adults. Furthermore, we explored effects of the potentially mediating variables educational attainment, alcohol consumption, smoking status, and depressive symptoms. Moreover, we explored inter-examiner variability. Finally, we compared the findings to findings for the Purdue Pegboard test. Methods Based on a sample of 726 community-dwelling adults and using multiple (Gaussian) regression analysis, we modeled the motor outcomes using age, sex, years in full-time education, depressive symptoms in the past seven days, alcohol consumption in the past seven days, and smoking status as explanatory variables. Results With regard to the Q-Motor tests, we found that more advanced age was associated with reduced tapping speed, male sex was associated with increased tapping speed and less irregularity, female sex was associated with less involuntary movement, more years of education were associated with increased tapping speed and less involuntary movement, never smoking was associated with less involuntary movement compared to current smoking, and more alcohol consumed was associated with more involuntary movement. Conclusion The present results show specific effects of age and sex on Q-Motor finger tapping and grasping and lifting performance. In addition, besides effects of education, there also were specific effects of smoking status and alcohol consumption. Importantly, the present study provides normative Q-Motor data based on a large population-based sample. Overall, the results are in favor of the feasibility and validity of Q-Motor finger tapping and grasping and lifting for large observational studies. Due to their low task-complexity and lack of placebo effects, Q-Motor tests may generate additional value in particular with regard to clinical conditions such as Huntington's or Parkinson's disease.
Collapse
Affiliation(s)
- Henning Teismann
- Institute of Epidemiology and Social Medicine, University of Münster, Münster, Germany
- *Correspondence: Henning Teismann
| | | | - Ralf Reilmann
- George-Huntington-Institute, Münster, Germany
- Institute of Clinical Radiology, University of Münster, Münster, Germany
- Department of Neurodegenerative Diseases and Hertie-Institute for Clinical Brain Research, University of Tübingen, Tübingen, Germany
| | - Klaus Berger
- Institute of Epidemiology and Social Medicine, University of Münster, Münster, Germany
| |
Collapse
|
7
|
Puhacheuskaya V, Hubert Lyall I, Järvikivi J. COVIDisgust: Language processing through the lens of partisanship. PLoS One 2022; 17:e0271206. [PMID: 35862298 PMCID: PMC9302854 DOI: 10.1371/journal.pone.0271206] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2021] [Accepted: 06/25/2022] [Indexed: 11/21/2022] Open
Abstract
Disgust is an aversive reaction protecting an organism from disease. People differ in how prone they are to experiencing it, and this fluctuates depending on how safe the environment is. Previous research has shown that the recognition and processing of disgusting words depends not on the word’s disgust per se but rather on individual sensitivity to disgust. However, the influence of dynamically changing disgust on language comprehension has not yet been researched. In a series of studies, we investigated whether the media’s portrayal of COVID-19 will affect subsequent language processing via changes in disgust. The participants were exposed to news headlines either depicting COVID-19 as a threat or downplaying it, and then rated single words for disgust and valence (Experiment 1; N = 83) or made a lexical decision (Experiment 2; N = 86). The headline type affected only word ratings and not lexical decisions, but political ideology and disgust proneness affected both. More liberal participants assigned higher disgust ratings after the headlines discounted the threat of COVID-19, whereas more conservative participants did so after the headlines emphasized it. We explain the results through the politicization and polarization of the pandemic. Further, political ideology was more predictive of reaction times in Experiment 2 than disgust proneness. High conservatism correlated with longer reaction times for disgusting and negative words, and the opposite was true for low conservatism. The results suggest that disgust proneness and political ideology dynamically interact with perceived environmental safety and have a measurable effect on language processing. Importantly, they also suggest that the media’s stance on the pandemic and the political framing of the issue may affect the public response by increasing or decreasing our disgust.
Collapse
Affiliation(s)
| | | | - Juhani Järvikivi
- Department of Linguistics, University of Alberta, Edmonton, Alberta, Canada
| |
Collapse
|
8
|
Forster M, Kuhbandner C. Are Student Teachers' Overall Expected Emotions Regarding Their Future Life as a Teacher Biased Toward Their Expected Peak Emotions? Front Psychol 2022; 13:816456. [PMID: 35465480 PMCID: PMC9020193 DOI: 10.3389/fpsyg.2022.816456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2021] [Accepted: 03/18/2022] [Indexed: 11/13/2022] Open
Abstract
Having functional expected emotions regarding one's future life as a teacher is important for student teachers to maintain their motivation to choose a career as a teacher. However, humans show several biases when judging their emotional experiences. One famous bias is the so-called peak-end effect which describes the phenomenon that overall affective judgments do not reflect the average of the involved emotional experiences but the most intense and the most recent of the involved emotional experiences. Regarding student teachers' expected positive emotions, such a bias would be functional since their motivation to become a teacher is enhanced. However, regarding student teachers' expected negative emotions, such a bias would be dysfunctional since their motivation to become a teacher would be decreased. The aim of the present preregistered study was to examine whether student teachers' expected future teaching-related emotions show a peak-end effect. Student teachers viewed 14 common events that could part of a typical everyday routine of a teacher and rated their expected emotional pleasure and discomfort for each of the events. Afterward, they were asked to rate their overall expected emotional pleasure and discomfort when looking at their future professional life as a whole. Results showed that expected pleasure was much larger than expected discomfort regarding both overall, peak, and average ratings. No peak-end effect was observed for overall expected discomfort which reflected the average expected discomfort across events. By contrast, overall expected pleasure was biased toward expected peak pleasure experiences. These findings indicate that student teachers judge their expected overall affect in a functional way: realistically when dealing with negative emotions but through rose-colored glasses when dealing with positive emotions.
Collapse
Affiliation(s)
- Markus Forster
- Department of Human Sciences, University of Regensburg, Regensburg, Germany
| | | |
Collapse
|
9
|
Chapman RM, Gardner MN, Lyons M. Gender Differences in Emotional Connotative Meaning of Words Measured by Osgood's Semantic Differential Techniques in Young Adults. HUMANITIES & SOCIAL SCIENCES COMMUNICATIONS 2022; 9:119. [PMID: 36118842 PMCID: PMC9479698 DOI: 10.1057/s41599-022-01126-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Accepted: 03/10/2022] [Indexed: 06/15/2023]
Abstract
Semantic differential techniques are a useful, well-validated tool to assess affective processing of stimuli and determine how that processing is impacted by various demographic factors, such as gender. In this paper, we explore differences in connotative word processing between men and women as measured by Osgood's semantic differential and what those differences imply about affective processing in the two genders. We recruited 94 young participants (47 men, 47 women, ages 18-39) using an online survey and collected their affective ratings of 120 words on three rating tasks: Evaluation (E), Potency (P), and Activity (A). With these data, we explored the theoretical and mathematical overlap between Osgood's affective meaning factor structure and other models of emotional processing commonly used in gender analyses. We then used Osgood's three-dimensional structure to assess gender-related differences in three affective classes of words (words with connotation that is Positive, Neutral, or Negative for each task) and found that there was no significant difference between the genders when rating Positive words and Neutral words on each of the three rating tasks. However, young women consistently rated Negative words more negatively than young men did on all three of the independent dimensions. This confirms the importance of taking gender effects into account when measuring emotional processing. Our results further indicate there may be differences between Osgood's structure and other models of affective processing that should be further explored.
Collapse
Affiliation(s)
- Robert M. Chapman
- Department of Brain and Cognitive Sciences and Center for Visual Science at the University of Rochester, Rochester, New York, United States of America
| | - Margaret N. Gardner
- Department of Brain and Cognitive Sciences and Center for Visual Science at the University of Rochester, Rochester, New York, United States of America
| | - Megan Lyons
- Department of Brain and Cognitive Sciences and Center for Visual Science at the University of Rochester, Rochester, New York, United States of America
| |
Collapse
|