1
|
Vos G, Ebrahimpour M, van Eijk L, Sarnyai Z, Rahimi Azghadi M. Stress monitoring using low-cost electroencephalogram devices: A systematic literature review. Int J Med Inform 2025; 198:105859. [PMID: 40056845 DOI: 10.1016/j.ijmedinf.2025.105859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2024] [Revised: 02/27/2025] [Accepted: 03/01/2025] [Indexed: 03/10/2025]
Abstract
INTRODUCTION The use of low-cost, consumer-grade wearable health monitoring devices has become increasingly prevalent in mental health research, including stress studies. While cortisol response magnitude remains the gold standard for stress assessment, an expanding body of research employs low-cost EEG devices as primary tools for recording biomarker data, often combined with wrist and ring-based wearables. However, the technical variability among low-cost EEG devices, particularly in sensor count and placement according to the 10-20 Electrode Placement System, poses challenges for reproducibility in study outcomes. OBJECTIVE This review aims to provide an overview of the growing application of low-cost EEG devices and machine learning techniques for assessing brain function, with a focus on stress detection. It also highlights the strengths and weaknesses of various machine learning methods commonly used in stress research, and evaluates the reproducibility of reported findings along with sensor count and placement importance. METHODS A comprehensive review was conducted of published studies utilizing EEG devices for stress detection and their associated machine learning approaches. Searches were performed across databases including Scopus, Google Scholar, ScienceDirect, Nature, and PubMed, yielding 69 relevant articles for analysis. The selected studies were synthesized into four thematic categories: stress assessment using EEG, low-cost EEG devices, datasets for EEG-based stress measurement, and machine learning techniques for EEG-based stress analysis. For machine learning-focused studies, validation and reproducibility methods were critically assessed. Study quality was evaluated and scored using the IJMEDI checklist. RESULTS The review identified several studies employing low-cost EEG devices to monitor brain activity during stress and relaxation phases, with many reporting high predictive accuracy using various machine learning validation techniques. However, only 54% of the studies included health screening prior to experimentation, and 58% were categorized as low-powered due to limited sample sizes. Additionally, few studies validated their results using an independent validation set or cortisol response as a correlating biomarker and there was a lack of consensus on data pre-processing and sensor placement as a key contributor to improving model generalization and accuracy. CONCLUSION Low-cost consumer-grade wearable devices, including EEG and wrist-based monitors, are increasingly utilized in stress-related research, offering promising avenues for non-invasive biomarker monitoring. However, significant gaps remain in standardizing EEG signal processing and sensor placement, both of which are critical for enhancing model generalization and accuracy. Furthermore, the limited use of independent validation sets and cortisol response as correlating biomarkers highlights the need for more robust validation methodologies. Future research should focus on addressing these limitations and establishing consensus on data pre-processing techniques and sensor configurations to improve the reliability and reproducibility of findings in this growing field.
Collapse
Affiliation(s)
- Gideon Vos
- College of Science and Engineering, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia
| | - Maryam Ebrahimpour
- College of Science and Engineering, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia
| | - Liza van Eijk
- College of Health Care Sciences, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia
| | - Zoltan Sarnyai
- College of Public Health, Medical, and Vet Sciences, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia
| | - Mostafa Rahimi Azghadi
- College of Science and Engineering, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia.
| |
Collapse
|
2
|
Valencia R, Anche G, Do Rego Barros G, Arostegui V, Sutaria H, McAllister E, Banihashem M, Volokitin M. Stressbusters: a pilot study investigating the effects of OMT on stress management in medical students. J Osteopath Med 2025; 125:261-267. [PMID: 39692236 DOI: 10.1515/jom-2024-0020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2024] [Accepted: 10/15/2024] [Indexed: 12/19/2024]
Abstract
CONTEXT Medical students report high levels of perceived stress and burnout, especially during the preclinical years. The combination of physical stressors from poor posture, poor sleep quality, and mental stressors from the rigorous curriculum stimulates the sympathetic nervous system (SNS) to secrete cortisol. Previous studies have shown that persistent elevated cortisol levels are associated with negative health outcomes. OBJECTIVES We conducted an Institutional Review Board (IRB)-approved study to determine if regular osteopathic manipulative treatments (OMTs) could impact the stress levels of first-year osteopathic medical students (OMSs) at Touro College of Osteopathic Medicine (TouroCOM) Harlem campus by measuring physiologic stress through changes in weekly salivary cortisol levels, perceived emotional and psychological stress levels, and cognitive function. METHODS We recruited 10 first-year OMSs who were not currently receiving external OMT outside of weekly coursework; other forms of external stress management, such as yoga or meditation, were not controlled for in this study. Utilizing a random number generator, the 10 student respondents were split into a control group that received no treatment and a treatment group that received 15 min of weekly OMT for 6 weeks. The treatment consisted of condylar decompression, paraspinal inhibition, and supine rib raising, which are techniques that are known to balance the SNS and parasympathetic nervous system (PNS). Cortisol levels were quantified by enzyme-linked immunosorbent assay (ELISA) cortisol immunoassay via salivary samples collected at the beginning of each weekly session, prior to treatment for the treatment group, at the same time of day each week. We also measured participants' weekly subjective perception of stress utilizing the College Student Stress Scale (CSSS) and cognitive function utilizing the Lumosity Performance Index (LPI). We conducted a two-tailed, unpaired t-test as well as a U test for the cortisol levels, given the smaller sample size and potential for a nonnormal distribution. RESULTS A lower cortisol level was correlated to a higher optical density (OD), the logarithmic measure of percent transmission of light through a sample; analysis of our data from the ELISA cortisol immunoassay showed an average weekly change in OD (∆OD) for the treatment group of 0.0215 and an average weekly ∆OD of -0.0044 in the control group. The t-test showed p=0.0497, and our U test showed a p=0.0317. Both tests indicated a statistically significant decrease across the weekly salivary cortisol levels in the treatment group utilizing a p<0.05. An additional effect-size analysis supported our finding of a significant decrease in weekly cortisol levels in the treatment group, Cohen's d=1.460. Based on the CSSS responses, there was no significant difference in perceived stress between the control and treatment groups (p=0.8655, two-tailed). Analysis of the LPI revealed no statistically significant difference in cognitive performance (p=0.9265, two-tailed). CONCLUSIONS Our study supports the claim that OMT that targets the SNS and PNS has a significant impact on cortisol levels. While the reduction in cortisol levels was statistically significant, the broader physiological impact remains unclear. Further research is necessary to determine whether this reduction translates to meaningful clinical benefits.
Collapse
Affiliation(s)
- Robert Valencia
- Medical Students, Touro College of Osteopathic Medicine Harlem, New York, USA
| | - Gowtham Anche
- Touro College of Osteopathic Medicine Harlem, New York, USA
| | | | - Victor Arostegui
- Medical Students, Touro College of Osteopathic Medicine Harlem, New York, USA
| | - Henal Sutaria
- Medical Students, Touro College of Osteopathic Medicine Harlem, New York, USA
| | - Emily McAllister
- Medical Students, Touro College of Osteopathic Medicine Harlem, New York, USA
| | - Mary Banihashem
- Associate Professor of Osteopathic Medicine, Touro College of Osteopathic Medicine Harlem, New York, USA
| | - Mikhail Volokitin
- Associate Professor of Osteopathic Medicine, Touro College of Osteopathic Medicine Harlem, New York, USA
| |
Collapse
|
3
|
Siddiqui A, Abu Hasan R, Saad Azhar Ali S, Elamvazuthi I, Lu CK, Tang TB. Detection of Low Resilience Using Data-Driven Effective Connectivity Measures. IEEE Trans Neural Syst Rehabil Eng 2024; 32:3657-3668. [PMID: 39302782 DOI: 10.1109/tnsre.2024.3465269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/22/2024]
Abstract
Conventional thresholding techniques for graph theory analysis, such as absolute, proportional and mean degree, have often been used in characterizing human brain networks under different mental disorders, such as mental stress. However, these approaches may not always be reliable as conventional thresholding approaches are subjected to human biases. Using a mental resilience study, we investigate if data-driven thresholding techniques such as Global Cost Efficiency (GCE-abs) and Orthogonal Minimum Spanning Trees (OMSTs) could provide equivalent results, whilst eliminating human biases. We implemented Phase Slope Index (PSI) to compute effective brain connectivity, and applied data-driven thresholding approaches to filter the brain networks in order to identify key features of low resilience within a cohort of healthy individuals. Our dataset encompassed resting-state EEG recordings gathered from a total of 36 participants (31 females and 5 males). Relevant features were extracted to train and validate a classifier model (Support Vector Machine, SVM). The detection of low stress resilience among healthy individuals using the SVM model scores an accuracy of 80.6% with GCE-abs, and 75% with OMSTs, respectively.
Collapse
|
4
|
Tseng HC, Tai KY, Ma YZ, Van LD, Ko LW, Jung TP. Accurate Mental Stress Detection Using Sequential Backward Selection and Adaptive Synthetic Methods. IEEE Trans Neural Syst Rehabil Eng 2024; 32:3095-3103. [PMID: 39167520 DOI: 10.1109/tnsre.2024.3447274] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/23/2024]
Abstract
The daily experience of mental stress profoundly influences our health and work performance while concurrently triggering alterations in brain electrical activity. Electroencephalogram (EEG) is a widely adopted method for assessing cognitive and affective states. This study delves into the EEG correlates of stress and the potential use of resting EEG in evaluating stress levels. Over 13 weeks, our longitudinal study focuses on the real-life experiences of college students, collecting data from each of the 18 participants across multiple days in classroom settings. To tackle the complexity arising from the multitude of EEG features and the imbalance in data samples across stress levels, we use the sequential backward selection (SBS) method for feature selection and the adaptive synthetic (ADASYN) sampling algorithm for imbalanced data. Our findings unveil that delta and theta features account for approximately 50% of the selected features through the SBS process. In leave-one-out (LOO) cross-validation, the combination of band power and pair-wise coherence (COH) achieves a maximum balanced accuracy of 94.8% in stress-level detection for the above daily stress dataset. Notably, using ADASYN and borderline synthesized minority over-sampling technique (borderline-SMOTE) methods enhances model accuracy compared to the traditional SMOTE approach. These results provide valuable insights into using EEG signals for assessing stress levels in real-life scenarios, shedding light on potential strategies for managing stress more effectively.
Collapse
|
5
|
Badr Y, Tariq U, Al-Shargie F, Babiloni F, Al Mughairbi F, Al-Nashash H. A review on evaluating mental stress by deep learning using EEG signals. Neural Comput Appl 2024; 36:12629-12654. [DOI: 10.1007/s00521-024-09809-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2022] [Accepted: 04/12/2024] [Indexed: 09/05/2024]
Abstract
AbstractMental stress is a common problem that affects individuals all over the world. Stress reduces human functionality during routine work and may lead to severe health defects. Early detection of stress is important for preventing diseases and other negative health-related consequences of stress. Several neuroimaging techniques have been utilized to assess mental stress, however, due to its ease of use, robustness, and non-invasiveness, electroencephalography (EEG) is commonly used. This paper aims to fill a knowledge gap by reviewing the different EEG-related deep learning algorithms with a focus on Convolutional Neural Networks (CNNs) and Long Short-Term Memory networks (LSTMs) for the evaluation of mental stress. The review focuses on data representation, individual deep neural network model architectures, hybrid models, and results amongst others. The contributions of the paper address important issues such as data representation and model architectures. Out of all reviewed papers, 67% used CNN, 9% LSTM, and 24% hybrid models. Based on the reviewed literature, we found that dataset size and different representations contributed to the performance of the proposed networks. Raw EEG data produced classification accuracy around 62% while using spectral and topographical representation produced up to 88%. Nevertheless, the roles of generalizability across different deep learning models and individual differences remain key areas of inquiry. The review encourages the exploration of innovative avenues, such as EEG data image representations concurrently with graph convolutional neural networks (GCN), to mitigate the impact of inter-subject variability. This novel approach not only allows us to harmonize structural nuances within the data but also facilitates the integration of temporal dynamics, thereby enabling a more comprehensive assessment of mental stress levels.
Collapse
|
6
|
Weerasinghe MMA, Wang G, Whalley J, Crook-Rumsey M. Mental stress recognition on the fly using neuroplasticity spiking neural networks. Sci Rep 2023; 13:14962. [PMID: 37696860 PMCID: PMC10495416 DOI: 10.1038/s41598-023-34517-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2022] [Accepted: 05/03/2023] [Indexed: 09/13/2023] Open
Abstract
Mental stress is found to be strongly connected with human cognition and wellbeing. As the complexities of human life increase, the effects of mental stress have impacted human health and cognitive performance across the globe. This highlights the need for effective non-invasive stress detection methods. In this work, we introduce a novel, artificial spiking neural network model called Online Neuroplasticity Spiking Neural Network (O-NSNN) that utilizes a repertoire of learning concepts inspired by the brain to classify mental stress using Electroencephalogram (EEG) data. These models are personalized and tested on EEG data recorded during sessions in which participants listen to different types of audio comments designed to induce acute stress. Our O-NSNN models learn on the fly producing an average accuracy of 90.76% (σ = 2.09) when classifying EEG signals of brain states associated with these audio comments. The brain-inspired nature of the individual models makes them robust and efficient and has the potential to be integrated into wearable technology. Furthermore, this article presents an exploratory analysis of trained O-NSNNs to discover links between perceived and acute mental stress. The O-NSNN algorithm proved to be better for personalized stress recognition in terms of accuracy, efficiency, and model interpretability.
Collapse
Affiliation(s)
- Mahima Milinda Alwis Weerasinghe
- School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, Auckland, New Zealand.
- Brain-Inspired AI and Neuroinformatics Lab, Department of Data Science, Sri Lanka Technological Campus, Padukka, Sri Lanka.
| | - Grace Wang
- School of Psychology and Wellbeing, University of Southern Queensland, Toowoomba, Australia
- Centre for Health Research, University of Southern Queensland, Toowoomba, Australia
| | - Jacqueline Whalley
- Department of Computer Science and Software Engineering, Auckland University of Technology, Auckland, New Zealand
| | - Mark Crook-Rumsey
- Department of Basic and Clinical Neuroscience, King's College London, London, UK
- UK Dementia Research Institute, Centre for Care Research and Technology, Imperial College London, London, UK
| |
Collapse
|
7
|
Khajuria A, Kumar A, Joshi D, Kumaran SS. Reducing Stress with Yoga: A Systematic Review Based on Multimodal Biosignals. Int J Yoga 2023; 16:156-170. [PMID: 38463652 PMCID: PMC10919405 DOI: 10.4103/ijoy.ijoy_218_23] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2023] [Revised: 12/20/2023] [Accepted: 12/22/2023] [Indexed: 03/12/2024] Open
Abstract
Stress is an enormous concern in our culture because it is the root cause of many health issues. Yoga asanas and mindfulness-based practices are becoming increasingly popular for stress management; nevertheless, the biological effect of these practices on stress reactivity is still a research domain. The purpose of this review is to emphasize various biosignals that reflect stress reduction through various yoga-based practices. A comprehensive synthesis of numerous prior investigations in the existing literature was conducted. These investigations undertook a thorough examination of numerous biosignals. Various features are extracted from these signals, which are further explored to reflect the effectiveness of yoga practice in stress reduction. The multifaceted character of stress and the extensive research undertaken in this field indicate that the proposed approach would rely on multiple modalities. The notable growth of the body of literature pertaining to prospective yoga processes is deserving of attention; nonetheless, there exists a scarcity of research undertaken on these mechanisms. Hence, it is recommended that future studies adopt more stringent yoga methods and ensure the incorporation of suitable participant cohorts.
Collapse
Affiliation(s)
- Aayushi Khajuria
- Department of NMR and MRI Facility, All India Institute of Medical Sciences, New Delhi, India
| | - Amit Kumar
- Center for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - Deepak Joshi
- Center for Biomedical Engineering, Indian Institute of Technology Delhi, New Delhi, India
| | - S. Senthil Kumaran
- Department of NMR and MRI Facility, All India Institute of Medical Sciences, New Delhi, India
| |
Collapse
|
8
|
Hemakom A, Atiwiwat D, Israsena P. ECG and EEG based detection and multilevel classification of stress using machine learning for specified genders: A preliminary study. PLoS One 2023; 18:e0291070. [PMID: 37656750 PMCID: PMC10473514 DOI: 10.1371/journal.pone.0291070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 07/27/2023] [Indexed: 09/03/2023] Open
Abstract
Mental health, especially stress, plays a crucial role in the quality of life. During different phases (luteal and follicular phases) of the menstrual cycle, women may exhibit different responses to stress from men. This, therefore, may have an impact on the stress detection and classification accuracy of machine learning models if genders are not taken into account. However, this has never been investigated before. In addition, only a handful of stress detection devices are scientifically validated. To this end, this work proposes stress detection and multilevel stress classification models for unspecified and specified genders through ECG and EEG signals. Models for stress detection are achieved through developing and evaluating multiple individual classifiers. On the other hand, the stacking technique is employed to obtain models for multilevel stress classification. ECG and EEG features extracted from 40 subjects (21 females and 19 males) were used to train and validate the models. In the low&high combined stress conditions, RBF-SVM and kNN yielded the highest average classification accuracy for females (79.81%) and males (73.77%), respectively. Combining ECG and EEG, the average classification accuracy increased to at least 87.58% (male, high stress) and up to 92.70% (female, high stress). For multilevel stress classification from ECG and EEG, the accuracy for females was 62.60% and for males was 71.57%. This study shows that the difference in genders influences the classification performance for both the detection and multilevel classification of stress. The developed models can be used for both personal (through ECG) and clinical (through ECG and EEG) stress monitoring, with and without taking genders into account.
Collapse
Affiliation(s)
- Apit Hemakom
- Neural Signal Processing Research Team, National Electronics and Computer Technology Center, National Science and Technology Development Agency, Pathumthani, Thailand
| | - Danita Atiwiwat
- Division of Health and Applied Sciences, Faculty of Science, Prince of Songkla University, Hat Yai, Songkhla, Thailand
| | - Pasin Israsena
- Neural Signal Processing Research Team, National Electronics and Computer Technology Center, National Science and Technology Development Agency, Pathumthani, Thailand
| |
Collapse
|
9
|
Chai J, Wu R, Li A, Xue C, Qiang Y, Zhao J, Zhao Q, Yang Q. Classification of mild cognitive impairment based on handwriting dynamics and qEEG. Comput Biol Med 2023; 152:106418. [PMID: 36566627 DOI: 10.1016/j.compbiomed.2022.106418] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2022] [Revised: 11/01/2022] [Accepted: 12/10/2022] [Indexed: 12/14/2022]
Abstract
Subtle changes in fine motor control and quantitative electroencephalography (qEEG) in patients with mild cognitive impairment (MCI) are important in screening for early dementia in primary care populations. In this study, an automated, non-invasive and rapid detection protocol for mild cognitive impairment based on handwriting kinetics and quantitative EEG analysis was proposed, and a classification model based on a dual fusion of feature and decision layers was designed for clinical decision-marking. Seventy-nine volunteers (39 healthy elderly controls and 40 patients with mild cognitive impairment) were recruited for this study, and the handwritten data and the EEG signals were performed using a tablet and MUSE under four designed handwriting tasks. Sixty-eight features were extracted from the EEG and handwriting parameters of each test. Features selected from both models were fused using a late feature fusion strategy with a weighted voting strategy for decision making, and classification accuracy was compared using three different classifiers under handwritten features, EEG features and fused features respectively. The results show that the dual fusion model can further improve the classification accuracy, with the highest classification accuracy for the combined features and the best classification result of 96.3% using SVM with RBF kernel as the base classifier. In addition, this not only supports the greater significance of multimodal data for differentiating MCI, but also tests the feasibility of using the portable EEG headband as a measure of EEG in patients with cognitive impairment.
Collapse
Affiliation(s)
- Jiali Chai
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China.
| | - Ruixuan Wu
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Aoyu Li
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Chen Xue
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Yan Qiang
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China.
| | - Juanjuan Zhao
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China; Jinzhong College of Information, 030600, Taiyuan, Shanxi, China
| | - Qinghua Zhao
- College of Information and Computer, Taiyuan University of Technology, 030000, Taiyuan, Shanxi, China
| | - Qianqian Yang
- Jinzhong College of Information, 030600, Taiyuan, Shanxi, China
| |
Collapse
|
10
|
Imperatori C, Massullo C, De Rossi E, Carbone GA, Theodorou A, Scopelliti M, Romano L, Del Gatto C, Allegrini G, Carrus G, Panno A. Exposure to nature is associated with decreased functional connectivity within the distress network: A resting state EEG study. Front Psychol 2023; 14:1171215. [PMID: 37151328 PMCID: PMC10158085 DOI: 10.3389/fpsyg.2023.1171215] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 03/30/2023] [Indexed: 05/09/2023] Open
Abstract
Introduction Despite the well-established evidence supporting the restorative potential of nature exposure, the neurophysiological underpinnings of the restorative cognitive/emotional effect of nature are not yet fully understood. The main purpose of the current study was to investigate the association between exposure to nature and electroencephalography (EEG) functional connectivity in the distress network. Methods Fifty-three individuals (11 men and 42 women; mean age 21.38 ± 1.54 years) were randomly assigned to two groups: (i) a green group and (ii) a gray group. A slideshow consisting of images depicting natural and urban scenarios were, respectively, presented to the green and the gray group. Before and after the slideshow, 5 min resting state (RS) EEG recordings were performed. The exact low-resolution electromagnetic tomography (eLORETA) software was used to execute all EEG analyses. Results Compared to the gray group, the green group showed a significant increase in positive emotions (F 1; 50 = 9.50 p = 0.003) and in the subjective experience of being full of energy and alive (F 1; 50 = 4.72 p = 0.035). Furthermore, as compared to urban pictures, the exposure to natural images was associated with a decrease of delta functional connectivity in the distress network, specifically between the left insula and left subgenual anterior cingulate cortex (T = -3.70, p = 0.023). Discussion Our results would seem to be in accordance with previous neurophysiological studies suggesting that experiencing natural environments is associated with brain functional dynamics linked to emotional restorative processes.
Collapse
Affiliation(s)
- Claudio Imperatori
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
| | - Chiara Massullo
- Experimental Psychology Laboratory, Department of Education, Roma Tre University, Rome, Italy
| | - Elena De Rossi
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
| | - Giuseppe Alessio Carbone
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
- Department of Psychology, University of Turin, Turin, Italy
- *Correspondence: Giuseppe Alessio Carbone,
| | - Annalisa Theodorou
- Experimental Psychology Laboratory, Department of Education, Roma Tre University, Rome, Italy
| | | | - Luciano Romano
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
| | - Claudia Del Gatto
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
| | - Giorgia Allegrini
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
| | - Giuseppe Carrus
- Experimental Psychology Laboratory, Department of Education, Roma Tre University, Rome, Italy
| | - Angelo Panno
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
- Angelo Panno,
| |
Collapse
|
11
|
An Efficient AP-ANN-Based Multimethod Fusion Model to Detect Stress through EEG Signal Analysis. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:7672297. [PMID: 36544857 PMCID: PMC9763020 DOI: 10.1155/2022/7672297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/25/2022] [Revised: 09/30/2022] [Accepted: 10/31/2022] [Indexed: 12/14/2022]
Abstract
Stress is a universal emotion that every human experiences daily. Psychologists say stress may lead to heart attack, depression, hypertension, strokes, or even sudden death. Many technical explorations like stress detection through facial expression, speech, text, physical behaviors, etc., were explored, but no consensus has been reached on the best method. The advancement in biomedical engineering yielded a rapid development of electroencephalogram (EEG) signal analysis that has inspired the idea of a multimethod fusion approach for the first time which employs multiple techniques such as discrete wavelet transform (DWT) for de-noising, adaptive synthetic sampling (ADASYN) for class balancing, and affinity propagation (AP) as a stratified sampling model along with the artificial neural network (ANN) as the classifier model for human emotion classification. From the EEG recordings of the DEAP dataset, the artifacts are removed, the signal is decomposed using a DWT, and features are extracted and fused to form the feature vector. As the dataset is high-dimensional, feature selection is done and ADASYN is used to address the imbalance of classes resulting in large-scale data. The innovative idea of the proposed system is to perform sampling using affinity propagation as a stratified sampling-based clustering algorithm as it determines the number of representative samples automatically which makes it superior to the K-Means, K-Medoid, that requires the K-value. Those samples are used as inputs to various classification models, the comparison of the AP-ANN, AP-SVM, and AP-RF is done, and their most important five performance metrics such as accuracy, precision, recall, F1-score, and specificity were compared. From our experiment, the AP-ANN model provides better accuracy of 86.8% and greater precision of 85.7%, a higher F1 score of 84.9%, a recall rate of 84.1%, and a specificity value of 89.2% which altogether provides better results than the other existing algorithms.
Collapse
|
12
|
Massullo C, Bersani FS, Carbone GA, Panno A, Farina B, Murillo-Rodríguez E, Yamamoto T, Machado S, Budde H, Imperatori C. Decreased Resting State Inter- and Intra-Network Functional Connectivity Is Associated with Perceived Stress in a Sample of University Students: An eLORETA Study. Neuropsychobiology 2022; 81:286-295. [PMID: 35130552 DOI: 10.1159/000521565] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/08/2021] [Accepted: 12/14/2021] [Indexed: 11/19/2022]
Abstract
INTRODUCTION Although the study of the Triple Network (TN) model has gained attention in the exploration of stress-related processes, the neurophysiological mechanisms of TN in relation to perceived stress have been relatively understudied in nonclinical samples so far. The main objective of the present study was to investigate, in a sample of university students, the association of perceived stress with resting state electroencephalography (EEG) functional connectivity in the TN. METHODS Ninety university students (40 males and 50 females; mean age 22.30 ± 2.43 years; mean educational level 16.60 ± 1.62 years) were enrolled. EEG data were analyzed through the exact low-resolution electromagnetic tomography (eLORETA). RESULTS Higher levels of perceived stress were associated with decreased delta EEG connectivity within the central executive network (CEN) and between the CEN and the salience network (SN). Higher levels of perceived stress were also associated with decreased theta EEG connectivity between the CEN and the SN. The associations between perceived stress and EEG connectivity data were significant even when relevant confounding factors (i.e., sex, age, educational level, and psychopathological symptoms) were controlled for. DISCUSSION Taken together, our results suggest that higher levels of perceived stress are associated with a dysfunctional synchronization within the CEN and between the SN and the CEN. This functional pattern might in part reflect the negative impact of high levels of perceived stress on cognitive functioning.
Collapse
Affiliation(s)
| | | | - Giuseppe Alessio Carbone
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
| | - Angelo Panno
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
| | - Benedetto Farina
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy
| | - Eric Murillo-Rodríguez
- Laboratorio de Neurociencias Moleculares e Integrativas Escuela de Medicina, División Ciencias de la Salud, Universidad Anáhuac Mayab, Mérida, Mexico.,Intercontinental Neuroscience Research Group, Mérida, Mexico
| | - Tetsuya Yamamoto
- Intercontinental Neuroscience Research Group, Mérida, Mexico.,Graduate School of Technology, Industrial and Social Sciences, Tokushima University, Tokushima, Japan
| | - Sérgio Machado
- Intercontinental Neuroscience Research Group, Mérida, Mexico.,Department of Sports Methods and Techniques, Federal University of Santa Maria, Santa Maria, Brazil.,Laboratory of Physical Activity Neuroscience, Neurodiversity Institute, Queimados-RJ, Brazil
| | - Henning Budde
- Intercontinental Neuroscience Research Group, Mérida, Mexico.,Faculty of Human Sciences, Institute for Systems Medicine, Medical School Hamburg, Hamburg, Germany
| | - Claudio Imperatori
- Cognitive and Clinical Psychology Laboratory, Department of Human Sciences, European University of Rome, Rome, Italy.,Intercontinental Neuroscience Research Group, Mérida, Mexico
| |
Collapse
|
13
|
A novel technique for stress detection from EEG signal using hybrid deep learning model. Neural Comput Appl 2022. [DOI: 10.1007/s00521-022-07540-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
14
|
Siripongpan A, Namkunee T, Uthansakul P, Jumphoo T, Duangmanee P. Stress among Medical Students Presented with an EEG at Suranaree University of Technology, Thailand. Health Psychol Res 2022; 10:35462. [DOI: 10.52965/001c.35462] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2021] [Accepted: 04/05/2022] [Indexed: 11/06/2022] Open
Abstract
Purpose A high level of stress among medical students is perceived as stress caused by strenuous medical programs and medical school is an extremely stressful environment, to begin with. For this reason, identifying stressors facing medical students is expected to enhance medical school lecturers’ understanding, leading to a provision of assistance for adequate supervision. The purposes of this study were to investigate stress levels in daily life and the electroencephalogram (EEG) characteristics during daily life and pre-examination period of 2nd-year medical students at Suranaree University of Technology (SUT), Thailand, and to compare the EEG characteristics between these two periods. Methods Medical Student Stressor Questionnaire (MSSQ) was used as a research instrument to collect data from sixty medical students. After that, EEG was administered in two periods for these studies (in daily life (baseline) and pre-examination 1 week). Paired t-test was used for analyzing the difference in the EEG characteristics in the 2 periods. Results The results indicated that the stress levels among medical students were mild (3.33%), moderate (53.33%), and high (43.33%). Academic Related Stressor (ARS) was found to be the main cause of stress among the subjects. All had a beta wave in 2 periods. Conclusion In conclusion, stress among medical students can alter brain function as measured by EEG. The findings could assist medical schools in better understanding medical students’ stress levels and planning how to teach in order to improve student achievement.
Collapse
Affiliation(s)
| | | | | | - Talit Jumphoo
- Suranaree University of Technology, Nakon Ratchasima, Thailand
| | | |
Collapse
|
15
|
Analysis of Physiological Signals for Stress Recognition with Different Car Handling Setups. ELECTRONICS 2022. [DOI: 10.3390/electronics11060888] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/10/2022]
Abstract
When designing a car, the vehicle dynamics and handling are important aspects, as they can satisfy a purpose in professional racing, as well as contributing to driving pleasure and safety, real and perceived, in regular drivers. In this paper, we focus on the assessment of the emotional response in drivers while they are driving on a track with different car handling setups. The experiments were performed using a dynamic professional simulator prearranged with different car setups. We recorded various physiological signals, allowing us to analyze the response of the drivers and analyze which car setup is more influential in terms of stress arising in the subjects. We logged two skin potential responses (SPRs), the electrocardiogram (ECG) signal, and eye tracking information. In the experiments, three car setups were used (neutral, understeering, and oversteering). To evaluate how these affect the drivers, we analyzed their physiological signals using two statistical tests (t-test and Wilcoxon test) and various machine learning (ML) algorithms. The results of the Wilcoxon test show that SPR signals provide higher statistical significance when evaluating stress among different drivers, compared to the ECG and eye tracking signals. As for the ML classifiers, we count the number of positive or “stress” labels of 15 s SPR time intervals for each subject and each particular car setup. With the support vector machine classifier, the mean value of the number of positive labels for the four subjects is equal to 13.13% for the base setup, 44.16% for the oversteering setup, and 39.60% for the understeering setup. In the end, our findings show that the base car setup appears to be the least stressful, and that our system enables us to effectively recognize stress while the subjects are driving in the different car configurations.
Collapse
|
16
|
Cannard C, Wahbeh H, Delorme A. Electroencephalography Correlates of Well-Being Using a Low-Cost Wearable System. Front Hum Neurosci 2021; 15:745135. [PMID: 35002651 PMCID: PMC8740323 DOI: 10.3389/fnhum.2021.745135] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2021] [Accepted: 11/15/2021] [Indexed: 12/02/2022] Open
Abstract
Electroencephalography (EEG) alpha asymmetry is thought to reflect crucial brain processes underlying executive control, motivation, and affect. It has been widely used in psychopathology and, more recently, in novel neuromodulation studies. However, inconsistencies remain in the field due to the lack of consensus in methodological approaches employed and the recurrent use of small samples. Wearable technologies ease the collection of large and diversified EEG datasets that better reflect the general population, allow longitudinal monitoring of individuals, and facilitate real-world experience sampling. We tested the feasibility of using a low-cost wearable headset to collect a relatively large EEG database (N = 230, 22-80 years old, 64.3% female), and an open-source automatic method to preprocess it. We then examined associations between well-being levels and the alpha center of gravity (CoG) as well as trait EEG asymmetries, in the frontal and temporoparietal (TP) areas. Robust linear regression models did not reveal an association between well-being and alpha (8-13 Hz) asymmetry in the frontal regions, nor with the CoG. However, well-being was associated with alpha asymmetry in the TP areas (i.e., corresponding to relatively less left than right TP cortical activity as well-being levels increased). This effect was driven by oscillatory activity in lower alpha frequencies (8-10.5 Hz), reinforcing the importance of dissociating sub-components of the alpha band when investigating alpha asymmetries. Age was correlated with both well-being and alpha asymmetry scores, but gender was not. Finally, EEG asymmetries in the other frequency bands were not associated with well-being, supporting the specific role of alpha asymmetries with the brain mechanisms underlying well-being levels. Interpretations, limitations, and recommendations for future studies are discussed. This paper presents novel methodological, experimental, and theoretical findings that help advance human neurophysiological monitoring techniques using wearable neurotechnologies and increase the feasibility of their implementation into real-world applications.
Collapse
Affiliation(s)
- Cédric Cannard
- Centre de Recherche Cerveau et Cognition (CerCo), Centre National de la Recherche Scientifique (CNRS), Paul Sabatier University, Toulouse, France
- Institute of Noetic Sciences (IONS), Petaluma, CA, United States
| | - Helané Wahbeh
- Institute of Noetic Sciences (IONS), Petaluma, CA, United States
| | - Arnaud Delorme
- Centre de Recherche Cerveau et Cognition (CerCo), Centre National de la Recherche Scientifique (CNRS), Paul Sabatier University, Toulouse, France
- Institute of Noetic Sciences (IONS), Petaluma, CA, United States
- Swartz Center for Computational Neuroscience (SCCN), Institute of Neural Computation (INC), University of California, San Diego, San Diego, CA, United States
| |
Collapse
|
17
|
Saeidi M, Karwowski W, Farahani FV, Fiok K, Taiar R, Hancock PA, Al-Juaid A. Neural Decoding of EEG Signals with Machine Learning: A Systematic Review. Brain Sci 2021; 11:1525. [PMID: 34827524 PMCID: PMC8615531 DOI: 10.3390/brainsci11111525] [Citation(s) in RCA: 64] [Impact Index Per Article: 16.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Revised: 11/04/2021] [Accepted: 11/11/2021] [Indexed: 11/16/2022] Open
Abstract
Electroencephalography (EEG) is a non-invasive technique used to record the brain's evoked and induced electrical activity from the scalp. Artificial intelligence, particularly machine learning (ML) and deep learning (DL) algorithms, are increasingly being applied to EEG data for pattern analysis, group membership classification, and brain-computer interface purposes. This study aimed to systematically review recent advances in ML and DL supervised models for decoding and classifying EEG signals. Moreover, this article provides a comprehensive review of the state-of-the-art techniques used for EEG signal preprocessing and feature extraction. To this end, several academic databases were searched to explore relevant studies from the year 2000 to the present. Our results showed that the application of ML and DL in both mental workload and motor imagery tasks has received substantial attention in recent years. A total of 75% of DL studies applied convolutional neural networks with various learning algorithms, and 36% of ML studies achieved competitive accuracy by using a support vector machine algorithm. Wavelet transform was found to be the most common feature extraction method used for all types of tasks. We further examined the specific feature extraction methods and end classifier recommendations discovered in this systematic review.
Collapse
Affiliation(s)
- Maham Saeidi
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL 32816, USA; (F.V.F.); (K.F.)
| | - Waldemar Karwowski
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL 32816, USA; (F.V.F.); (K.F.)
| | - Farzad V. Farahani
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL 32816, USA; (F.V.F.); (K.F.)
- Department of Biostatistics, Johns Hopkins University, Baltimore, MD 21218, USA
| | - Krzysztof Fiok
- Computational Neuroergonomics Laboratory, Department of Industrial Engineering and Management Systems, University of Central Florida, Orlando, FL 32816, USA; (F.V.F.); (K.F.)
| | - Redha Taiar
- MATIM, Moulin de la Housse, Université de Reims Champagne Ardenne, CEDEX 02, 51687 Reims, France;
| | - P. A. Hancock
- Department of Psychology, University of Central Florida, Orlando, FL 32816, USA;
| | - Awad Al-Juaid
- Industrial Engineering Department, Taif University, Taif 26571, Saudi Arabia;
| |
Collapse
|
18
|
Hag A, Handayani D, Pillai T, Mantoro T, Kit MH, Al-Shargie F. EEG Mental Stress Assessment Using Hybrid Multi-Domain Feature Sets of Functional Connectivity Network and Time-Frequency Features. SENSORS (BASEL, SWITZERLAND) 2021; 21:6300. [PMID: 34577505 PMCID: PMC8473213 DOI: 10.3390/s21186300] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/09/2021] [Revised: 09/07/2021] [Accepted: 09/16/2021] [Indexed: 12/28/2022]
Abstract
Exposure to mental stress for long period leads to serious accidents and health problems. To avoid negative consequences on health and safety, it is very important to detect mental stress at its early stages, i.e., when it is still limited to acute or episodic stress. In this study, we developed an experimental protocol to induce two different levels of stress by utilizing a mental arithmetic task with time pressure and negative feedback as the stressors. We assessed the levels of stress on 22 healthy subjects using frontal electroencephalogram (EEG) signals, salivary alpha-amylase level (AAL), and multiple machine learning (ML) classifiers. The EEG signals were analyzed using a fusion of functional connectivity networks estimated by the Phase Locking Value (PLV) and temporal and spectral domain features. A total of 210 different features were extracted from all domains. Only the optimum multi-domain features were used for classification. We then quantified stress levels using statistical analysis and seven ML classifiers. Our result showed that the AAL level was significantly increased (p < 0.01) under stress condition in all subjects. Likewise, the functional connectivity network demonstrated a significant decrease under stress, p < 0.05. Moreover, we achieved the highest stress classification accuracy of 93.2% using the Support Vector Machine (SVM) classifier. Other classifiers produced relatively similar results.
Collapse
Affiliation(s)
- Ala Hag
- School of Computer Science & Engineering, Taylor’s University, Jalan Taylors, Subang Jaya 47500, Malaysia; (A.H.); (T.P.)
| | - Dini Handayani
- School of Computer Science & Engineering, Taylor’s University, Jalan Taylors, Subang Jaya 47500, Malaysia; (A.H.); (T.P.)
| | - Thulasyammal Pillai
- School of Computer Science & Engineering, Taylor’s University, Jalan Taylors, Subang Jaya 47500, Malaysia; (A.H.); (T.P.)
| | - Teddy Mantoro
- Faculty of Engineering and Technology, Sampoerna University, Jakarta 12780, Indonesia;
| | - Mun Hou Kit
- Department of Mechatronic and Biomedical Engineering, Universiti Tunku Abdul Rahman, Bandar Sungai Long, Kajang 43000, Malaysia;
| | - Fares Al-Shargie
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates;
| |
Collapse
|
19
|
Attar ET, Balasubramanian V, Subasi E, Kaya M. Stress Analysis Based on Simultaneous Heart Rate Variability and EEG Monitoring. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2021; 9:2700607. [PMID: 34513342 PMCID: PMC8407658 DOI: 10.1109/jtehm.2021.3106803] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2021] [Revised: 05/07/2021] [Accepted: 08/03/2021] [Indexed: 12/27/2022]
Abstract
OBJECTIVE Stress is a significant risk factor for various diseases such as hypertension, heart attack, stroke, and even sudden death. Stress can also lead to psychological and behavioral disorders. Heart rate variability (HRV) can reflect changes in stress levels while other physiological factors, like blood pressure, are within acceptable ranges. Electroencephalogram (EEG) is a vital technique for studying brain activities and provides useful data regarding changes in mental status. This study incorporates EEG and a detailed HRV analysis to have a better understanding and analysis of stress. Investigating the correlation between EEG and HRV under stress conditions is valuable since they provide complementary information regarding stress. METHODS Simultaneous electrocardiogram (ECG) and EEG recordings were obtained from fifteen subjects. HRV /EEG features were analyzed and compared in rest, stress, and meditation conditions. A one-way ANOVA and correlation coefficient were used for statistical analysis to explore the correlation between HRV features and features extracted from EEG. RESULTS The HRV features LF (low frequency), HF (high frequency), LF/HF, and rMSSD (root mean square of the successive differences) correlated with EEG features, including alpha power band in the left hemisphere and alpha band power asymmetry. CONCLUSION This study demonstrated five significant relationships between EEG and HRV features associated with stress. The ability to use stress-related EEG features in combination with correlated HRV features could help improve detecting stress and monitoring the progress of stress treatments/therapies. The outcomes of this study could enhance the efficiency of stress management technologies such as meditation studies and bio-feedback training.
Collapse
Affiliation(s)
- Eyad Talal Attar
- Department of Biomedical and Chemical Engineering and SciencesFlorida Institute of TechnologyMelbourneFL32901USA
- Department of Electrical and Computer EngineeringKing Abdulaziz UniversityJeddah21589Saudi Arabia
| | - Vignesh Balasubramanian
- Department of Biomedical and Chemical Engineering and SciencesFlorida Institute of TechnologyMelbourneFL32901USA
| | - Ersoy Subasi
- Department of Computer Engineering and SciencesFlorida Institute of TechnologyMelbourneFL32901USA
| | - Mehmet Kaya
- Department of Biomedical and Chemical Engineering and SciencesFlorida Institute of TechnologyMelbourneFL32901USA
| |
Collapse
|
20
|
Kutafina E, Heiligers A, Popovic R, Brenner A, Hankammer B, Jonas SM, Mathiak K, Zweerings J. Tracking of Mental Workload with a Mobile EEG Sensor. SENSORS 2021; 21:s21155205. [PMID: 34372445 PMCID: PMC8348794 DOI: 10.3390/s21155205] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/08/2021] [Revised: 07/23/2021] [Accepted: 07/28/2021] [Indexed: 12/04/2022]
Abstract
The aim of the present investigation was to assess if a mobile electroencephalography (EEG) setup can be used to track mental workload, which is an important aspect of learning performance and motivation and may thus represent a valuable source of information in the evaluation of cognitive training approaches. Twenty five healthy subjects performed a three-level N-back test using a fully mobile setup including tablet-based presentation of the task and EEG data collection with a self-mounted mobile EEG device at two assessment time points. A two-fold analysis approach was chosen including a standard analysis of variance and an artificial neural network to distinguish the levels of cognitive load. Our findings indicate that the setup is feasible for detecting changes in cognitive load, as reflected by alterations across lobes in different frequency bands. In particular, we observed a decrease of occipital alpha and an increase in frontal, parietal and occipital theta with increasing cognitive load. The most distinct levels of cognitive load could be discriminated by the integrated machine learning models with an accuracy of 86%.
Collapse
Affiliation(s)
- Ekaterina Kutafina
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany; (R.P.); (B.H.)
- Faculty of Applied Mathematics, AGH University of Science and Technology, 30-059 Krakow, Poland
- Correspondence:
| | - Anne Heiligers
- Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany; (A.H.); (K.M.); (J.Z.)
| | - Radomir Popovic
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany; (R.P.); (B.H.)
| | - Alexander Brenner
- Institute of Medical Informatics, University of Münster, 48149 Münster, Germany;
| | - Bernd Hankammer
- Institute of Medical Informatics, Medical Faculty, RWTH Aachen University, 52074 Aachen, Germany; (R.P.); (B.H.)
| | - Stephan M. Jonas
- Department of Informatics, Technical University of Munich, 85748 Garching, Germany;
| | - Klaus Mathiak
- Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany; (A.H.); (K.M.); (J.Z.)
| | - Jana Zweerings
- Department of Psychiatry, Psychotherapy and Psychosomatics, School of Medicine, RWTH Aachen University, 52074 Aachen, Germany; (A.H.); (K.M.); (J.Z.)
| |
Collapse
|
21
|
Katmah R, Al-Shargie F, Tariq U, Babiloni F, Al-Mughairbi F, Al-Nashash H. A Review on Mental Stress Assessment Methods Using EEG Signals. SENSORS (BASEL, SWITZERLAND) 2021; 21:5043. [PMID: 34372280 PMCID: PMC8347831 DOI: 10.3390/s21155043] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/13/2021] [Accepted: 07/19/2021] [Indexed: 01/19/2023]
Abstract
Mental stress is one of the serious factors that lead to many health problems. Scientists and physicians have developed various tools to assess the level of mental stress in its early stages. Several neuroimaging tools have been proposed in the literature to assess mental stress in the workplace. Electroencephalogram (EEG) signal is one important candidate because it contains rich information about mental states and condition. In this paper, we review the existing EEG signal analysis methods on the assessment of mental stress. The review highlights the critical differences between the research findings and argues that variations of the data analysis methods contribute to several contradictory results. The variations in results could be due to various factors including lack of standardized protocol, the brain region of interest, stressor type, experiment duration, proper EEG processing, feature extraction mechanism, and type of classifier. Therefore, the significant part related to mental stress recognition is choosing the most appropriate features. In particular, a complex and diverse range of EEG features, including time-varying, functional, and dynamic brain connections, requires integration of various methods to understand their associations with mental stress. Accordingly, the review suggests fusing the cortical activations with the connectivity network measures and deep learning approaches to improve the accuracy of mental stress level assessment.
Collapse
Affiliation(s)
- Rateb Katmah
- Biomedical Engineering Graduate Program, American University of Sharjah, Sharjah 26666, United Arab Emirates;
| | - Fares Al-Shargie
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| | - Usman Tariq
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| | - Fabio Babiloni
- Department of Molecular Medicine, University of Sapienza Rome, 00185 Rome, Italy;
- College Computer Science and Technology, University Hangzhou Dianzi, Hangzhou 310018, China
| | - Fadwa Al-Mughairbi
- College of Medicines and Health Sciences, United Arab Emirates University, Al-Ain 15551, United Arab Emirates;
| | - Hasan Al-Nashash
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| |
Collapse
|
22
|
Sundaresan A, Penchina B, Cheong S, Grace V, Valero-Cabré A, Martel A. Evaluating deep learning EEG-based mental stress classification in adolescents with autism for breathing entrainment BCI. Brain Inform 2021; 8:13. [PMID: 34255197 PMCID: PMC8276906 DOI: 10.1186/s40708-021-00133-5] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Accepted: 05/31/2021] [Indexed: 12/16/2022] Open
Abstract
Mental stress is a major individual and societal burden and one of the main contributing factors that lead to pathologies such as depression, anxiety disorders, heart attacks, and strokes. Given that anxiety disorders are one of the most common comorbidities in youth with autism spectrum disorder (ASD), this population is particularly vulnerable to mental stress, severely limiting overall quality of life. To prevent this, early stress quantification with machine learning (ML) and effective anxiety mitigation with non-pharmacological interventions are essential. This study aims to investigate the feasibility of exploiting electroencephalography (EEG) signals for stress assessment by comparing several ML classifiers, namely support vector machine (SVM) and deep learning methods. We trained a total of eleven subject-dependent models-four with conventional brain-computer interface (BCI) methods and seven with deep learning approaches-on the EEG of neurotypical (n=5) and ASD (n=8) participants performing alternating blocks of mental arithmetic stress induction, guided and unguided breathing. Our results show that a multiclass two-layer LSTM RNN deep learning classifier is capable of identifying mental stress from ongoing EEG with an overall accuracy of 93.27%. Our study is the first to successfully apply an LSTM RNN classifier to identify stress states from EEG in both ASD and neurotypical adolescents, and offers promise for an EEG-based BCI for the real-time assessment and mitigation of mental stress through a closed-loop adaptation of respiration entrainment.
Collapse
Affiliation(s)
- Avirath Sundaresan
- The Nueva School, San Mateo, CA, 94033, USA.,Causal Brain Dynamics, Plasticity and Rehabilitation Team, Frontlab, Brain and Spine Institute, ICM, CNRS UMR, Paris, 7225, France
| | - Brian Penchina
- The Nueva School, San Mateo, CA, 94033, USA.,Causal Brain Dynamics, Plasticity and Rehabilitation Team, Frontlab, Brain and Spine Institute, ICM, CNRS UMR, Paris, 7225, France
| | - Sean Cheong
- The Nueva School, San Mateo, CA, 94033, USA.,Causal Brain Dynamics, Plasticity and Rehabilitation Team, Frontlab, Brain and Spine Institute, ICM, CNRS UMR, Paris, 7225, France
| | - Victoria Grace
- Muvik Labs, LLC, Locust Valley, NY, 11560, USA.,Center for Computer Research in Music and Acoustics, Stanford University, Stanford, CA, 94305, USA.,Causal Brain Dynamics, Plasticity and Rehabilitation Team, Frontlab, Brain and Spine Institute, ICM, CNRS UMR, Paris, 7225, France
| | - Antoni Valero-Cabré
- Center for Computer Research in Music and Acoustics, Stanford University, Stanford, CA, 94305, USA.,Department of Anatomy and Neurobiology, Laboratory of Cerebral Dynamics, Boston University School of Medicine, Boston, MA, 02118, USA.,Cognitive Neuroscience and Information Technology Research Program, Open University of Catalonia (UOC), Barcelona, Spain.,Causal Brain Dynamics, Plasticity and Rehabilitation Team, Frontlab, Brain and Spine Institute, ICM, CNRS UMR, Paris, 7225, France
| | - Adrien Martel
- Cognitive Neuroscience and Information Technology Research Program, Open University of Catalonia (UOC), Barcelona, Spain. .,Causal Brain Dynamics, Plasticity and Rehabilitation Team, Frontlab, Brain and Spine Institute, ICM, CNRS UMR, Paris, 7225, France.
| |
Collapse
|
23
|
Which Factors Affect the Stress of Intraoperative Orthopedic Surgeons by Using Electroencephalography Signals and Heart Rate Variability? SENSORS 2021; 21:s21124016. [PMID: 34200844 PMCID: PMC8230564 DOI: 10.3390/s21124016] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/09/2021] [Revised: 06/04/2021] [Accepted: 06/08/2021] [Indexed: 11/24/2022]
Abstract
Can we recognize intraoperative real-time stress of orthopedic surgeons and which factors affect the stress of intraoperative orthopedic surgeons with EEG and HRV? From June 2018 to November 2018, 265 consecutive records of intraoperative stress measures for orthopedic surgeons were compared. Intraoperative EEG waves and HRV, comprising beats per minute (BPM) and low frequency (LF)/high frequency (HF) ratio were gathered for stress-associated parameters. Differences in stress parameters according to the experience of surgeons, intraoperative blood loss, and operation time depending on whether or not a tourniquet were investigated. Stress-associated EEG signals including beta 3 waves were significantly higher compared to EEG at rest for novice surgeons as the procedure progressed. Among senior surgeons, the LF/HF ratio reflecting the physical demands of stress was higher than that of novice surgeons at all stages. In surgeries including tourniquets, operation time was positively correlated with stress parameters including beta 1, beta 2, beta 3 waves and BPM. In non-tourniquet orthopedic surgeries, intraoperative blood loss was positively correlated with beta 1, beta 2, and beta 3 waves. Among orthopedic surgeons, those with less experience demonstrated relatively higher levels of stress during surgery. Prolonged operation time or excessive intraoperative blood loss appear to be contributing factors that increase stress.
Collapse
|
24
|
Classification of Mental Stress Using CNN-LSTM Algorithms with Electrocardiogram Signals. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:9951905. [PMID: 34194687 PMCID: PMC8203344 DOI: 10.1155/2021/9951905] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/30/2021] [Revised: 04/30/2021] [Accepted: 05/21/2021] [Indexed: 11/24/2022]
Abstract
The mental stress faced by many people in modern society is a factor that causes various chronic diseases, such as depression, cancer, and cardiovascular disease, according to stress accumulation. Therefore, it is very important to regularly manage and monitor a person's stress. In this study, we propose an ensemble algorithm that can accurately determine mental stress states using a modified convolutional neural network (CNN)- long short-term memory (LSTM) architecture. When a person is exposed to stress, a displacement occurs in the electrocardiogram (ECG) signal. It is possible to classify stress signals by analyzing ECG signals and extracting specific parameters. To maximize the performance of the proposed stress classification algorithm, fast Fourier transform (FFT) and spectrograms were applied to preprocess ECG signals and produce signals in both the time and frequency domains to aid the training process. As the performance evaluation benchmarks of the stress classification model, confusion matrices, receiver operating characteristic (ROC) curves, and precision-recall (PR) curves were used, and the accuracy achieved by the proposed model was 98.3%, which is an improvement of 14.7% compared to previous research results. Therefore, our model can help manage the mental health of people exposed to stress. In addition, if combined with various biosignals such as electromyogram (EMG) and photoplethysmography (PPG), it may have the potential for development in various healthcare systems, such as home training, sleep state analysis, and cardiovascular monitoring.
Collapse
|
25
|
Human stress classification during public speaking using physiological signals. Comput Biol Med 2021; 133:104377. [PMID: 33866254 DOI: 10.1016/j.compbiomed.2021.104377] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2021] [Revised: 03/31/2021] [Accepted: 04/01/2021] [Indexed: 11/24/2022]
Abstract
Public speaking is a common type of social evaluative situation and a significant amount of the population feel uneasy with it. It is of utmost importance to detect public speaking stress so that appropriate action can be taken to minimize its impacts on human health. In this study, a multimodal human stress classification scheme in response to real-life public speaking activity is proposed. Electroencephalography (EEG), galvanic skin response (GSR), and photoplethysmography (PPG) signals of forty participants are acquired in rest-state and during public speaking activity to divide data into a stressed and non-stressed group. Frequency domain features from EEG and time-domain features from GSR and PPG signals are extracted. The selected set of features from all modalities are fused to classify the stress into two classes. Classification is performed via a leave-one-out cross-validation scheme by using five different classifiers. The highest accuracy of 96.25% is achieved using a support vector machine classifier with radial basis function. Statistical analysis is performed to examine the significance of EEG, GSR, and PPG signals between the two phases of the experiment. Statistical significance is found in certain EEG frequency bands as well as GSR and PPG data recorded before and after public speaking supporting the fact that brain activity, skin conductance, and blood volumetric flow are credible measures of human stress during public speaking activity.
Collapse
|
26
|
Kyamakya K, Al-Machot F, Haj Mosa A, Bouchachia H, Chedjou JC, Bagula A. Emotion and Stress Recognition Related Sensors and Machine Learning Technologies. SENSORS 2021; 21:s21072273. [PMID: 33804987 PMCID: PMC8037255 DOI: 10.3390/s21072273] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 03/11/2021] [Accepted: 03/15/2021] [Indexed: 12/23/2022]
Affiliation(s)
- Kyandoghere Kyamakya
- Institute for Smart Systems Technologies, Universitaet Klagenfurt, A9020 Klagenfurt, Austria; (A.H.M.); (J.C.C.)
- Correspondence:
| | - Fadi Al-Machot
- Department of Applied Informatics, Universitaet Klagenfurt, 9020 Klagenfurt, Austria;
| | - Ahmad Haj Mosa
- Institute for Smart Systems Technologies, Universitaet Klagenfurt, A9020 Klagenfurt, Austria; (A.H.M.); (J.C.C.)
| | - Hamid Bouchachia
- Machine Intelligence Group, Bournemouth University, Bournemouth BH12 5BB, UK;
| | - Jean Chamberlain Chedjou
- Institute for Smart Systems Technologies, Universitaet Klagenfurt, A9020 Klagenfurt, Austria; (A.H.M.); (J.C.C.)
| | - Antoine Bagula
- ISAT Laboratory, University of the Western Cape, 7535 Bellville, South Africa;
| |
Collapse
|
27
|
Biometric Data as Real-Time Measure of Physiological Reactions to Environmental Stimuli in the Built Environment. ENERGIES 2021. [DOI: 10.3390/en14010232] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
The physiological and cognitive effects of environmental stimuli from the built environment on humans have been studied for more than a century, over short time frames in terms of comfort, and over long-time frames in terms of health and wellbeing. The strong interdependence of objective and subjective factors in these fields of study has traditionally involved the necessity to rely on a number of qualitative sources of information, as self-report variables, which however, raise criticisms concerning their reliability and precision. Recent advancements in sensing technology and data processing methodologies have strongly contributed towards a renewed interest in biometric data as a potential high-precision tool to study the physiological effects of selected stimuli on humans using more objective and real-time measures. Within this context, this review reports on a broader spectrum of available and advanced biosensing techniques used in the fields of building engineering, human physiology, neurology, and psychology. The interaction and interdependence between (i) indoor environmental parameters and (ii) biosignals identifying human physiological response to the environmental stressors are systematically explored. Online databases ScienceDirect, Scopus, MDPI and ResearchGate were scanned to gather all relevant publications in the last 20 years, identifying and listing tools and methods of biometric data collection, assessing the potentials and drawbacks of the most relevant techniques. The review aims to support the introduction of biomedical signals as a tool for understanding the physiological aspects of indoor comfort in the view of achieving an improved balance between human resilience and building resilience, addressing human indoor health as well as energetic and environmental building performance.
Collapse
|
28
|
Vaquero-Blasco MA, Perez-Valero E, Lopez-Gordo MA, Morillas C. Virtual Reality as a Portable Alternative to Chromotherapy Rooms for Stress Relief: A Preliminary Study. SENSORS 2020; 20:s20216211. [PMID: 33143361 PMCID: PMC7663593 DOI: 10.3390/s20216211] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 10/27/2020] [Accepted: 10/28/2020] [Indexed: 12/16/2022]
Abstract
Chromotherapy rooms are comfortable spaces, used in places like special needs schools, where stimuli are carefully selected to cope with stress. However, these rooms are expensive and require a space that cannot be reutilized. In this article, we propose the use of virtual reality (VR) as an inexpensive and portable alternative to chromotherapy rooms for stress relief. We recreated a chromotherapy room stress relief program using a commercial head mounted display (HD). We assessed the stress level of two groups (test and control) through an EEG biomarker, the relative gamma, while they experienced a relaxation session. First, participants were stressed using the Montreal imaging stress task (MIST). Then, for relaxing, the control group utilized a chromotherapy room while the test group used virtual reality. We performed a hypothesis test to compare the self- perceived stress level at different stages of the experiment and it yielded no significant differences in reducing stress for both groups, during relaxing (p-value: 0.8379, α = 0.05) or any other block. Furthermore, according to participant surveys, the use of virtual reality was deemed immersive, comfortable and pleasant (3.9 out of 5). Our preliminary results validate our approach as an inexpensive and portable alternative to chromotherapy rooms for stress relief.
Collapse
Affiliation(s)
- Miguel A. Vaquero-Blasco
- Department of Signal Theory, Telematics and Communications, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain;
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
| | - Eduardo Perez-Valero
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Department of Computer Architecture and Technology, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain
| | - Miguel Angel Lopez-Gordo
- Department of Signal Theory, Telematics and Communications, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain;
- Nicolo Association, Churriana de la Vega, 18194 Granada, Spain
- Correspondence: ; Tel.: +34-958-249-721
| | - Christian Morillas
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Department of Computer Architecture and Technology, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain
| |
Collapse
|
29
|
Penchina B, Sundaresan A, Cheong S, Martel A. Deep LSTM Recurrent Neural Network for Anxiety Classification from EEG in Adolescents with Autism. Brain Inform 2020. [DOI: 10.1007/978-3-030-59277-6_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022] Open
|