1
|
Mai ND, Chung WY. On-Chip Mental Stress Detection: Integrating a Wearable Behind-The-Ear EEG Device With Embedded Tiny Neural Network. IEEE J Biomed Health Inform 2025; 29:1872-1885. [PMID: 40030726 DOI: 10.1109/jbhi.2024.3519600] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
The study introduces an innovative approach to efficient mental stress detection by combining electroencephalography (EEG) analysis with on-chip neural networks, taking advantage of EEG's temporal resolution and the computational capabilities of embedded neural networks. The proposed system utilizes behind-the-ear (BTE) EEG signals and on-chip neural networks for mental stress detection. A wearable custom-designed device captures EEG signals from a single BTE channel, performs on-chip signal-to-spectrogram conversion, and integrates a compact convolutional neural network (CNN) for stress classification. The system systematically identifies key EEG frequency bands associated with stress and includes a user-friendly smartphone application for intuitive stress monitoring. EEG data were collected from 15 participants during stress-inducing tasks, such as Stroop and Mental Arithmetic tests. On-chip processing is essential for filtering EEG noise, converting signals into spectrogram images, and using these images as inputs for stress detection through the proposed on-chip CNN model. The experimental results demonstrate strong performance: leave-one-out cross-validation (LOOCV) achieves 91.72% accuracy, 93.74% specificity, 88.69% sensitivity, 90.43% precision, and an F1-score of 0.8955; while 10-fold cross-validation (CV) yields 95.32% accuracy, 95.89% specificity, 94.47% sensitivity, 93.95% precision, and an F1-score of 0.9421 on untrained datasets. The Beta band (13 Hz to 30 Hz) is identified as the most significant frequency band for detecting mental stress. This integration of BTE EEG analysis with on-chip CNNs represents a significant advancement in mental stress detection and has potential applications in medical assistance tools.
Collapse
|
2
|
Zayed A, Belhadj N, Ben Khalifa K, Bedoui MH, Valderrama C. Efficient Generalized Electroencephalography-Based Drowsiness Detection Approach with Minimal Electrodes. SENSORS (BASEL, SWITZERLAND) 2024; 24:4256. [PMID: 39001037 PMCID: PMC11244425 DOI: 10.3390/s24134256] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/13/2024] [Revised: 06/21/2024] [Accepted: 06/27/2024] [Indexed: 07/16/2024]
Abstract
Drowsiness is a main factor for various costly defects, even fatal accidents in areas such as construction, transportation, industry and medicine, due to the lack of monitoring vigilance in the mentioned areas. The implementation of a drowsiness detection system can greatly help to reduce the defects and accident rates by alerting individuals when they enter a drowsy state. This research proposes an electroencephalography (EEG)-based approach for detecting drowsiness. EEG signals are passed through a preprocessing chain composed of artifact removal and segmentation to ensure accurate detection followed by different feature extraction methods to extract the different features related to drowsiness. This work explores the use of various machine learning algorithms such as Support Vector Machine (SVM), the K nearest neighbor (KNN), the Naive Bayes (NB), the Decision Tree (DT), and the Multilayer Perceptron (MLP) to analyze EEG signals sourced from the DROZY database, carefully labeled into two distinct states of alertness (awake and drowsy). Segmentation into 10 s intervals ensures precise detection, while a relevant feature selection layer enhances accuracy and generalizability. The proposed approach achieves high accuracy rates of 99.84% and 96.4% for intra (subject by subject) and inter (cross-subject) modes, respectively. SVM emerges as the most effective model for drowsiness detection in the intra mode, while MLP demonstrates superior accuracy in the inter mode. This research offers a promising avenue for implementing proactive drowsiness detection systems to enhance occupational safety across various industries.
Collapse
Affiliation(s)
- Aymen Zayed
- Technology and Medical Imaging Laboratory, Faculty of Medicine Monastir, University of Monastir, Monastir 5019, Tunisia
- National Engineering School of Sousse, University of Sousse, BP 264 Erriyadh, Sousse 4023, Tunisia
- Department of Electronics and Microelectronics (SEMi), University of Mons, 7000 Mons, Belgium
| | - Nidhameddine Belhadj
- Laboratory of Electronics and Microelectronics, Faculty of Sciences of Monastir, Monsatir 5019, Tunisia
| | - Khaled Ben Khalifa
- Technology and Medical Imaging Laboratory, Faculty of Medicine Monastir, University of Monastir, Monastir 5019, Tunisia
- Higher Institute of Applied Science and Technology of Sousse, University of Sousse, Sousse 4003, Tunisia
| | - Mohamed Hedi Bedoui
- Technology and Medical Imaging Laboratory, Faculty of Medicine Monastir, University of Monastir, Monastir 5019, Tunisia
| | - Carlos Valderrama
- Department of Electronics and Microelectronics (SEMi), University of Mons, 7000 Mons, Belgium
| |
Collapse
|
3
|
van Klaren C, Maij A, Marsman L, van Drongelen A. The evaluation of cEEGrids for fatigue detection in aviation. SLEEP ADVANCES : A JOURNAL OF THE SLEEP RESEARCH SOCIETY 2024; 5:zpae009. [PMID: 38420258 PMCID: PMC10901434 DOI: 10.1093/sleepadvances/zpae009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2023] [Revised: 01/26/2024] [Indexed: 03/02/2024]
Abstract
Operator fatigue poses a major concern in safety-critical industries such as aviation, potentially increasing the chances of errors and accidents. To better understand this risk, there is a need for noninvasive objective measures of fatigue. This study aimed to evaluate the performance of cEEGrids, a type of ear-EEG, for fatigue detection by analyzing the alpha and theta power before and after sleep restriction in four sessions on two separate days, employing a within-participants design. Results were compared to traditional, highly validated methods: the Karolinska Sleepiness Scale (KSS) and Psychomotor Vigilance Task (PVT). After sleep restriction and an office workday, 12 participants showed increased alpha band power in multiple electrode channels, but no channels correlated with KSS scores and PVT response speed. These findings indicate that cEEGrids can detect differences in alpha power following mild sleep loss. However, it should be noted that this capability was limited to specific channels, and no difference in theta power was observed. The study shows the potential and limitations of ear-EEG for fatigue detection as a less invasive alternative to cap-EEG. Further design and electrode configuration adjustments are necessary before ear-EEG can be implemented for fatigue detection in the field.
Collapse
Affiliation(s)
- Carmen van Klaren
- Royal Netherlands Aerospace Centre (NLR), Department of Safety and Human Performance, Amsterdam, The Netherlands
| | - Anneloes Maij
- Royal Netherlands Aerospace Centre (NLR), Department of Safety and Human Performance, Amsterdam, The Netherlands
| | - Laurie Marsman
- Royal Netherlands Aerospace Centre (NLR), Department of Safety and Human Performance, Amsterdam, The Netherlands
| | - Alwin van Drongelen
- Royal Netherlands Aerospace Centre (NLR), Department of Safety and Human Performance, Amsterdam, The Netherlands
| |
Collapse
|
4
|
Hussein RM, Miften FS, George LE. Driver drowsiness detection methods using EEG signals: a systematic review. Comput Methods Biomech Biomed Engin 2023; 26:1237-1249. [PMID: 35983784 DOI: 10.1080/10255842.2022.2112574] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2022] [Revised: 07/21/2022] [Accepted: 08/08/2022] [Indexed: 11/03/2022]
Abstract
Electroencephalography (EEG) is a complex signal that may require several years of training, advanced signal processing, and feature extraction methodologies to interpret correctly. Recently, many methods have been used to extract and classify EEG data. This study reviews 62 papers that used EEG signals to detect driver drowsiness, published between January 2018 and 2022. We extract trends and highlight interesting approaches from this large body of literature to inform future research and formulate recommendations. To find relevant papers published in scientific journals, conferences, and electronic preprint repositories, researchers searched major databases covering the domains of science and engineering. For each investigation, many data items about (1) the data, (2) the channels used, (3) the extraction and classification procedure, and (4) the outcomes were extracted. These items were then analyzed one by one to uncover trends. Our analysis reveals that the amount of EEG data used across studies varies. We saw that more than half the studies used simulation driving experimental. About 21% of the studies used support vector machine (SVM), while 19% used convolutional neural networks (CNN). Overall, we can conclude that drowsiness and fatigue impair driving performance, resulting in drivers who are more exposed to risky situations.
Collapse
Affiliation(s)
- Raed Mohammed Hussein
- Iraqi Commission for Computers and Informatics, Informatics Institute of Postgraduate Studies, Baghdad, Iraq
| | - Firas Sabar Miften
- College of Education for Pure Science, University of Thi-Qar, Nasiriyah, Iraq
| | - Loay E George
- University of Information Technology & Communication, Baghdad, Iraq
| |
Collapse
|
5
|
Soni S, Seal A, Mohanty SK, Sakurai K. Electroencephalography signals-based sparse networks integration using a fuzzy ensemble technique for depression detection. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104873] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
6
|
Peng Y, Xu Q, Lin S, Wang X, Xiang G, Huang S, Zhang H, Fan C. The Application of Electroencephalogram in Driving Safety: Current Status and Future Prospects. Front Psychol 2022; 13:919695. [PMID: 35936295 PMCID: PMC9354986 DOI: 10.3389/fpsyg.2022.919695] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/13/2022] [Accepted: 06/13/2022] [Indexed: 12/02/2022] Open
Abstract
The driver is one of the most important factors in the safety of the transportation system. The driver's perceptual characteristics are closely related to driving behavior, while electroencephalogram (EEG) as the gold standard for evaluating human perception is non-deceptive. It is essential to study driving characteristics by analyzing the driver's brain activity pattern, effectively acquiring driver perceptual characteristics, creating a direct connection between the driver's brain and external devices, and realizing information interchange. This paper first introduces the theories related to EEG, then reviews the applications of EEG in scenarios such as fatigue driving, distracted driving, and emotional driving. The limitations of existing research have been identified and the prospect of EEG application in future brain-computer interface automotive assisted driving systems have been proposed. This review provides guidance for researchers to use EEG to improve driving safety. It also offers valuable suggestions for future research.
Collapse
Affiliation(s)
- Yong Peng
- Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic & Transportation Engineering, Central South University, Changsha, China
| | - Qian Xu
- Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic & Transportation Engineering, Central South University, Changsha, China
| | - Shuxiang Lin
- Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic & Transportation Engineering, Central South University, Changsha, China
| | - Xinghua Wang
- Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic & Transportation Engineering, Central South University, Changsha, China
| | - Guoliang Xiang
- Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic & Transportation Engineering, Central South University, Changsha, China
| | - Shufang Huang
- School of Business and Trade, Hunan Industry Polytechnic, Changsha, China
| | - Honghao Zhang
- School of Mechanical Engineering, Shandong University, Jinan, China
| | - Chaojie Fan
- Key Laboratory of Traffic Safety on Track of Ministry of Education, School of Traffic & Transportation Engineering, Central South University, Changsha, China
| |
Collapse
|
7
|
|