1
|
Yassin MM, Saad MN, Khalifa AM, Said AM. Advancing clinical understanding of surface electromyography biofeedback: bridging research, teaching, and commercial applications. Expert Rev Med Devices 2024; 21:709-726. [PMID: 38967375 DOI: 10.1080/17434440.2024.2376699] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2024] [Accepted: 07/02/2024] [Indexed: 07/06/2024]
Abstract
INTRODUCTION Expanding the use of surface electromyography-biofeedback (EMG-BF) devices in different therapeutic settings highlights the gradually evolving role of visualizing muscle activity in the rehabilitation process. This review evaluates their concepts, uses, and trends, combining evidence-based research. AREAS COVERED This review dissects the anatomy of EMG-BF systems, emphasizing their transformative integration with machine-learning (ML) and deep-learning (DL) paradigms. Advances such as the application of sophisticated DL architectures for high-density EMG data interpretation, optimization techniques for heightened DL model performance, and the fusion of EMG with electroencephalogram (EEG) signals have been spotlighted for enhancing biomechanical analyses in rehabilitation. The literature survey also categorizes EMG-BF devices based on functionality and clinical usage, supported by insights from commercial sectors. EXPERT OPINION The current landscape of EMG-BF is rapidly evolving, chiefly propelled by innovations in artificial intelligence (AI). The incorporation of ML and DL into EMG-BF systems augments their accuracy, reliability, and scope, marking a leap in patient care. Despite challenges in model interpretability and signal noise, ongoing research promises to address these complexities, refining biofeedback modalities. The integration of AI not only predicts patient-specific recovery timelines but also tailors therapeutic interventions, heralding a new era of personalized medicine in rehabilitation and emotional detection.
Collapse
Affiliation(s)
- Mazen M Yassin
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, China
- Biomedical Engineering Department, Faculty of Engineering, Minia University, Minia, Egypt
- Department of Biomedical Engineering, Helwan University, Cairo, Egypt
| | - Mohamed N Saad
- Biomedical Engineering Department, Faculty of Engineering, Minia University, Minia, Egypt
| | - Ayman M Khalifa
- Department of Biomedical Engineering, Helwan University, Cairo, Egypt
| | - Ashraf M Said
- Biomedical Engineering Program, Electrical Engineering Department, Benha Faculty of Engineering, Benha University, Al Qalyubiyah, Egypt
| |
Collapse
|
2
|
Mishra A, Agrawal M, Ali A, Garg P. Uninterrupted real-time cerebral stress level monitoring using wearable biosensors: A review. Biotechnol Appl Biochem 2023; 70:1895-1914. [PMID: 37455443 DOI: 10.1002/bab.2491] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 06/15/2023] [Indexed: 07/18/2023]
Abstract
Stress is the major unseen bug for the health of humans with the increasing workaholic era. Long periods of avoidance are the main precursor for chronic disorders that are quite tough to treat. As precaution is better than cure, stress detection and monitoring are vital. Although there are ways to measure stress clinically, there is still a constant need and demand for methods that measure stress personally and in an ex vitro manner for the convenience of the user. The concept of continuous stress monitoring has been introduced to tackle the issue of unseen stress accumulating in the body simultaneously with being user-friendly and reliable. Stress biosensors nowadays provide real-time, noninvasive, and continuous monitoring of stress. These biosensors are innovative anthropogenic creations that are a combination of biomarkers and indicators like heart rate variation, electrodermal activity, skin temperature, galvanic skin response, and electroencephalograph of stress in the body along with machine learning algorithms and techniques. The collaboration of biological markers, artificial intelligence techniques, and data science tools makes stress biosensors a hot topic for research. These attributes have made continuous stress detection a possibility with ease. The advancement in stress biosensing technologies has made a great impact on the lives of human beings so far. This article focuses on the comprehensive study of stress-indicating biomarkers and the techniques along with principles of the biosensors used for continuous stress detection. The precise overview of wearable stress monitoring systems is also sectioned to pave a pathway for possible future research studies.
Collapse
Affiliation(s)
- Anuja Mishra
- Department of Biotechnology, Institute of Applied Science & Humanities, GLA University, Mathura, Uttar Pradesh, India
| | - Mukti Agrawal
- Department of Biotechnology, Institute of Applied Science & Humanities, GLA University, Mathura, Uttar Pradesh, India
| | - Aaliya Ali
- School of Applied Sciences and Biotechnology, Shoolini University, Solan, Himachal Pradesh, India
- Center for Omics and Biodiversity Research, Shoolini University, Solan, Himachal Pradesh, India
| | - Prakrati Garg
- School of Applied Sciences and Biotechnology, Shoolini University, Solan, Himachal Pradesh, India
- Center for Omics and Biodiversity Research, Shoolini University, Solan, Himachal Pradesh, India
| |
Collapse
|
3
|
Fuentes-Martinez VJ, Romero S, Lopez-Gordo MA, Minguillon J, Rodríguez-Álvarez M. Low-Cost EEG Multi-Subject Recording Platform for the Assessment of Students' Attention and the Estimation of Academic Performance in Secondary School. SENSORS (BASEL, SWITZERLAND) 2023; 23:9361. [PMID: 38067731 PMCID: PMC10708847 DOI: 10.3390/s23239361] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Revised: 11/15/2023] [Accepted: 11/20/2023] [Indexed: 12/18/2023]
Abstract
The level of student attention in class greatly affects their academic performance. Teachers typically rely on visual inspection to react to students' attention in time, but this subjective method leads to inconsistencies across classes. Online education exacerbates the issue as students can turn off cameras and microphones to keep their own privacy. To address this, we present a novel, low-cost EEG-based platform for assessing students' attention and estimating their academic performance. In a study involving 34 secondary school students (aged 14 to 16), participants watched an academic video and answered evaluation questions while their EEG activity was recorded using a commercial headset. The results demonstrate a significant correlation (0.53, p-value = 0.003) between the power spectral density (PSD) of the EEG beta band (12-30 Hz) and students' academic performance. Additionally, there was a notable difference in PSD-beta between high and low academic performers. These findings encourage the use of PSD-beta for the immediate and objective assessment of both the student attention and the subsequent academic performance. The platform offers valuable and objective feedback to teachers, enhancing the effectiveness of both face-to-face and online teaching and learning environments.
Collapse
Affiliation(s)
- Victor Juan Fuentes-Martinez
- Department of Computer Engineering, Automation and Robotics, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain;
- Department of Signal Theory, Telematics and Communications, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain; (M.A.L.-G.); (J.M.)
- Neuroengineering and Computation Lab, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain
| | - Samuel Romero
- Department of Computer Engineering, Automation and Robotics, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain;
- Neuroengineering and Computation Lab, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain
| | - Miguel Angel Lopez-Gordo
- Department of Signal Theory, Telematics and Communications, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain; (M.A.L.-G.); (J.M.)
- Neuroengineering and Computation Lab, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain
| | - Jesus Minguillon
- Department of Signal Theory, Telematics and Communications, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain; (M.A.L.-G.); (J.M.)
- Neuroengineering and Computation Lab, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain
| | - Manuel Rodríguez-Álvarez
- Department of Computer Engineering, Automation and Robotics, Research Centre for Information and Communication Technologies (CITIC-UGR), University of Granada, 18014 Granada, Spain;
| |
Collapse
|
4
|
Kim H, Song J, Kim S, Lee S, Park Y, Lee S, Lee S, Kim J. Recent Advances in Multiplexed Wearable Sensor Platforms for Real-Time Monitoring Lifetime Stress: A Review. BIOSENSORS 2023; 13:bios13040470. [PMID: 37185545 PMCID: PMC10136450 DOI: 10.3390/bios13040470] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 04/06/2023] [Accepted: 04/09/2023] [Indexed: 05/17/2023]
Abstract
Researchers are interested in measuring mental stress because it is linked to a variety of diseases. Real-time stress monitoring via wearable sensor systems can aid in the prevention of stress-related diseases by allowing stressors to be controlled immediately. Physical tests, such as heart rate or skin conductance, have recently been used to assess stress; however, these methods are easily influenced by daily life activities. As a result, for more accurate stress monitoring, validations requiring two or more stress-related biomarkers are demanded. In this review, the combinations of various types of sensors (hereafter referred to as multiplexed sensor systems) that can be applied to monitor stress are discussed, referring to physical and chemical biomarkers. Multiplexed sensor systems are classified as multiplexed physical sensors, multiplexed physical-chemical sensors, and multiplexed chemical sensors, with the effect of measuring multiple biomarkers and the ability to measure stress being the most important. The working principles of multiplexed sensor systems are subdivided, with advantages in measuring multiple biomarkers. Furthermore, stress-related chemical biomarkers are still limited to cortisol; however, we believe that by developing multiplexed sensor systems, it will be possible to explore new stress-related chemical biomarkers by confirming their correlations to cortisol. As a result, the potential for further development of multiplexed sensor systems, such as the development of wearable electronics for mental health management, is highlighted in this review.
Collapse
Affiliation(s)
- Heena Kim
- Department of Biomedical Engineering, College of Life Science and Biotechnology, Dongguk University, Seoul 04620, Republic of Korea
| | - Jaeyoon Song
- Department of Biomedical Engineering, College of Life Science and Biotechnology, Dongguk University, Seoul 04620, Republic of Korea
| | - Sehyeon Kim
- Department of Biomedical Engineering, College of Life Science and Biotechnology, Dongguk University, Seoul 04620, Republic of Korea
| | - Suyoung Lee
- Department of Biomedical Engineering, College of Life Science and Biotechnology, Dongguk University, Seoul 04620, Republic of Korea
| | - Yejin Park
- Department of Biomedical Engineering, College of Life Science and Biotechnology, Dongguk University, Seoul 04620, Republic of Korea
| | - Seungjun Lee
- Department of Biomedical Engineering, College of Life Science and Biotechnology, Dongguk University, Seoul 04620, Republic of Korea
| | - Seunghee Lee
- Department of Biomedical Engineering, College of Life Science and Biotechnology, Dongguk University, Seoul 04620, Republic of Korea
| | - Jinsik Kim
- Department of Biomedical Engineering, College of Life Science and Biotechnology, Dongguk University, Seoul 04620, Republic of Korea
| |
Collapse
|
5
|
Klimek A, Mannheim I, Schouten G, Wouters EJM, Peeters MWH. Wearables measuring electrodermal activity to assess perceived stress in care: a scoping review. Acta Neuropsychiatr 2023; 37:e19. [PMID: 36960675 DOI: 10.1017/neu.2023.19] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/25/2023]
Abstract
BACKGROUND Chronic stress responses can lead to physical and behavioural health problems, often experienced and observed in the care of people with intellectual disabilities or people with dementia. Electrodermal activity (EDA) is a bio-signal for stress, which can be measured by wearables and thereby support stress management. However, the how, when and to what extent patients and healthcare providers can benefit is unclear. This study aims to create an overview of available wearables enabling the detection of perceived stress by using EDA. METHODS Following the PRISMA-SCR protocol for scoping reviews, four databases were included in the search of peer-reviewed studies published between 2012 and 2022, reporting detection of EDA in relation to self-reported stress or stress-related behaviours. Type of wearable, bodily location, research population, context, stressor type and the reported relationship between EDA and perceived stress were extracted. RESULTS Of the 74 included studies, the majority included healthy subjects in laboratory situations. Field studies and studies using machine learning (ML) to predict stress have increased in the last years. EDA is most often measured on the wrist, with offline data processing. Studies predicting perceived stress or stress-related behaviour using EDA features, reported accuracies between 42% and 100% with an average of 82.6%. Of these studies, the majority used ML. CONCLUSION Wearable EDA sensors are promising in detecting perceived stress. Field studies with relevant populations in a health or care context are lacking. Future studies should focus on the application of EDA-measuring wearables in real-life situations to support stress management.
Collapse
Affiliation(s)
- Agata Klimek
- School for Allied Health Professions, Fontys University of Applied Sciences, Eindhoven, The Netherlands
| | - Ittay Mannheim
- School for Allied Health Professions, Fontys University of Applied Sciences, Eindhoven, The Netherlands
- Tranzo, School of Social and Behavioural Sciences, Tilburg University, Tilburg, The Netherlands
| | - Gerard Schouten
- School for Information & Communication Technology, Fontys University of Applied Sciences, Eindhoven, The Netherlands
| | - Eveline J M Wouters
- School for Allied Health Professions, Fontys University of Applied Sciences, Eindhoven, The Netherlands
- Tranzo, School of Social and Behavioural Sciences, Tilburg University, Tilburg, The Netherlands
| | - Manon W H Peeters
- School for Allied Health Professions, Fontys University of Applied Sciences, Eindhoven, The Netherlands
| |
Collapse
|
6
|
Mitro N, Argyri K, Pavlopoulos L, Kosyvas D, Karagiannidis L, Kostovasili M, Misichroni F, Ouzounoglou E, Amditis A. AI-Enabled Smart Wristband Providing Real-Time Vital Signs and Stress Monitoring. SENSORS (BASEL, SWITZERLAND) 2023; 23:2821. [PMID: 36905025 PMCID: PMC10007366 DOI: 10.3390/s23052821] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 02/20/2023] [Accepted: 03/01/2023] [Indexed: 06/18/2023]
Abstract
This work introduces the design, architecture, implementation, and testing of a low-cost and machine-learning-enabled device to be worn on the wrist. The suggested wearable device has been developed for use during emergency incidents of large passenger ship evacuations, and enables the real-time monitoring of the passengers' physiological state, and stress detection. Based on a properly preprocessed PPG signal, the device provides essential biometric data (pulse rate and oxygen saturation level) and an efficient unimodal machine learning pipeline. The stress detecting machine learning pipeline is based on ultra-short-term pulse rate variability, and has been successfully integrated into the microcontroller of the developed embedded device. As a result, the presented smart wristband is able to provide real-time stress detection. The stress detection system has been trained with the use of the publicly available WESAD dataset, and its performance has been tested through a two-stage process. Initially, evaluation of the lightweight machine learning pipeline on a previously unseen subset of the WESAD dataset was performed, reaching an accuracy score equal to 91%. Subsequently, external validation was conducted, through a dedicated laboratory study of 15 volunteers subjected to well-acknowledged cognitive stressors while wearing the smart wristband, which yielded an accuracy score equal to 76%.
Collapse
Affiliation(s)
- Nikos Mitro
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Katerina Argyri
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Lampros Pavlopoulos
- Institute of Communication and Computer Systems (ICCS), 10682 Athens, Greece
| | - Dimitrios Kosyvas
- Institute of Communication and Computer Systems (ICCS), 10682 Athens, Greece
| | - Lazaros Karagiannidis
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Margarita Kostovasili
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Fay Misichroni
- Institute of Communication and Computer Systems (ICCS), 10682 Athens, Greece
| | - Eleftherios Ouzounoglou
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| | - Angelos Amditis
- School of Electrical & Computer Engineering, National Technical University of Athens (NTUA), 10682 Athens, Greece
| |
Collapse
|
7
|
Multi-Task Classification of Physical Activity and Acute Psychological Stress for Advanced Diabetes Treatment. SIGNALS 2023. [DOI: 10.3390/signals4010009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/19/2023] Open
Abstract
Wearable sensor data can be integrated and interpreted to improve the treatment of chronic conditions, such as diabetes, by enabling adjustments in treatment decisions based on physical activity and psychological stress assessments. The challenges in using biological analytes to frequently detect physical activity (PA) and acute psychological stress (APS) in daily life necessitate the use of data from noninvasive sensors in wearable devices, such as wristbands. We developed a recurrent multi-task deep neural network (NN) with long-short-term-memory architecture to integrate data from multiple sensors (blood volume pulse, skin temperature, galvanic skin response, three-axis accelerometers) and simultaneously detect and classify the type of PA, namely, sedentary state, treadmill run, stationary bike, and APS, such as non-stress, emotional anxiety stress, mental stress, and estimate the energy expenditure (EE). The objective was to assess the feasibility of using the multi-task recurrent NN (RNN) rather than independent RNNs for detection and classification of AP and APS. The multi-task RNN achieves comparable performance to independent RNNs, with the multi-task RNN having F1 scores of 98.00% for PA and 98.97% for APS, and a root mean square error (RMSE) of 0.728 calhr.kg for EE estimation for testing data. The independent RNNs have F1 scores of 99.64% for PA and 98.83% for APS, and an RMSE of 0.666 calhr.kg for EE estimation. The results indicate that a multi-task RNN can effectively interpret the signals from wearable sensors. Additionally, we developed individual and multi-task extreme gradient boosting (XGBoost) for separate and simultaneous classification of PA types and APS types. Multi-task XGBoost achieved F1 scores of 99.89% and 98.31% for the classification of PA types and APS types, respectively, while the independent XGBoost achieved F1 scores of 99.68% and 96.77%, respectively. The results indicate that both multi-task RNN and XGBoost can be used for the detection and classification of PA and APS without loss of performance with respect to individual separate classification systems. People with diabetes can achieve better outcomes and quality of life by including physical activity and psychological stress assessments in treatment decision-making.
Collapse
|
8
|
Zhang J, Yin H, Zhang J, Yang G, Qin J, He L. Real-time mental stress detection using multimodality expressions with a deep learning framework. Front Neurosci 2022; 16:947168. [PMID: 35992909 PMCID: PMC9389269 DOI: 10.3389/fnins.2022.947168] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Accepted: 07/11/2022] [Indexed: 11/13/2022] Open
Abstract
Mental stress is becoming increasingly widespread and gradually severe in modern society, threatening people’s physical and mental health. To avoid the adverse effects of stress on people, it is imperative to detect stress in time. Many studies have demonstrated the effectiveness of using objective indicators to detect stress. Over the past few years, a growing number of researchers have been trying to use deep learning technology to detect stress. However, these works usually use single-modality for stress detection and rarely combine stress-related information from multimodality. In this paper, a real-time deep learning framework is proposed to fuse ECG, voice, and facial expressions for acute stress detection. The framework extracts the stress-related information of the corresponding input through ResNet50 and I3D with the temporal attention module (TAM), where TAM can highlight the distinguishing temporal representation for facial expressions about stress. The matrix eigenvector-based approach is then used to fuse the multimodality information about stress. To validate the effectiveness of the framework, a well-established psychological experiment, the Montreal imaging stress task (MIST), was applied in this work. We collected multimodality data from 20 participants during MIST. The results demonstrate that the framework can combine stress-related information from multimodality to achieve 85.1% accuracy in distinguishing acute stress. It can serve as a tool for computer-aided stress detection.
Collapse
Affiliation(s)
- Jing Zhang
- College of Biomedical Engineering, Sichuan University, Chengdu, China
| | - Hang Yin
- College of Biomedical Engineering, Sichuan University, Chengdu, China
| | - Jiayu Zhang
- College of Biomedical Engineering, Sichuan University, Chengdu, China
| | - Gang Yang
- College of Biomedical Engineering, Sichuan University, Chengdu, China
| | - Jing Qin
- Centre for Smart Health, School of Nursing, The Hong Kong Polytechnic University, Hong Kong, Hong Kong SAR, China
| | - Ling He
- College of Biomedical Engineering, Sichuan University, Chengdu, China
- *Correspondence: Ling He,
| |
Collapse
|
9
|
Ehrmann G, Blachowicz T, Homburg SV, Ehrmann A. Measuring Biosignals with Single Circuit Boards. Bioengineering (Basel) 2022; 9:bioengineering9020084. [PMID: 35200437 PMCID: PMC8869486 DOI: 10.3390/bioengineering9020084] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2022] [Accepted: 02/14/2022] [Indexed: 12/23/2022] Open
Abstract
To measure biosignals constantly, using textile-integrated or even textile-based electrodes and miniaturized electronics, is ideal to provide maximum comfort for patients or athletes during monitoring. While in former times, this was usually solved by integrating specialized electronics into garments, either connected to a handheld computer or including a wireless data transfer option, nowadays increasingly smaller single circuit boards are available, e.g., single-board computers such as Raspberry Pi or microcontrollers such as Arduino, in various shapes and dimensions. This review gives an overview of studies found in the recent scientific literature, reporting measurements of biosignals such as ECG, EMG, sweat and other health-related parameters by single circuit boards, showing new possibilities offered by Arduino, Raspberry Pi etc. in the mobile long-term acquisition of biosignals. The review concentrates on the electronics, not on textile electrodes about which several review papers are available.
Collapse
Affiliation(s)
- Guido Ehrmann
- Virtual Institute of Applied Research on Advanced Materials (VIARAM)
- Correspondence:
| | - Tomasz Blachowicz
- Institute of Physics—Center for Science and Education, Silesian University of Technology, 44-100 Gliwice, Poland;
| | - Sarah Vanessa Homburg
- Faculty of Engineering and Mathematics, Bielefeld University of Applied Sciences, 33619 Bielefeld, Germany; (S.V.H.); (A.E.)
| | - Andrea Ehrmann
- Faculty of Engineering and Mathematics, Bielefeld University of Applied Sciences, 33619 Bielefeld, Germany; (S.V.H.); (A.E.)
| |
Collapse
|
10
|
Apostolidis H, Tsiatsos T. Exploring anxiety awareness during academic science examinations. PLoS One 2021; 16:e0261167. [PMID: 34910743 PMCID: PMC8673629 DOI: 10.1371/journal.pone.0261167] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2020] [Accepted: 11/26/2021] [Indexed: 11/23/2022] Open
Abstract
There is a developing interdisciplinary research field which has been trying to integrate results and expertise from various scientific areas, such as affective computing, pedagogical methodology and psychological appraisal theories, into learning environments. Moreover, anxiety recognition and regulation has attracted the interest of researchers as an important factor in the implementation of advanced learning environments. The present article explores the test anxiety and stress awareness of university students who are attending a science course during examinations. Real-time anxiety awareness as provided by biofeedback during science exams in an academic environment is shown to have a positive effect on the anxiety students experience and on their self-efficacy regarding examinations. Furthermore, the relevant research identifies a significant relationship between the students' anxiety level and their performance. Finally, the current study indicates that the students' anxiety awareness as provided by biofeedback is related to their performance, a relationship that is mediated and explained by the students' anxiety.
Collapse
Affiliation(s)
- Hippokratis Apostolidis
- Software and Interactive Technologies Laboratory, School of Informatics, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Thrasyvoulos Tsiatsos
- Software and Interactive Technologies Laboratory, School of Informatics, Aristotle University of Thessaloniki, Thessaloniki, Greece
| |
Collapse
|
11
|
Sheikh M, Qassem M, Kyriacou PA. Wearable, Environmental, and Smartphone-Based Passive Sensing for Mental Health Monitoring. Front Digit Health 2021; 3:662811. [PMID: 34713137 PMCID: PMC8521964 DOI: 10.3389/fdgth.2021.662811] [Citation(s) in RCA: 36] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2021] [Accepted: 03/02/2021] [Indexed: 12/21/2022] Open
Abstract
Collecting and analyzing data from sensors embedded in the context of daily life has been widely employed for the monitoring of mental health. Variations in parameters such as movement, sleep duration, heart rate, electrocardiogram, skin temperature, etc., are often associated with psychiatric disorders. Namely, accelerometer data, microphone, and call logs can be utilized to identify voice features and social activities indicative of depressive symptoms, and physiological factors such as heart rate and skin conductance can be used to detect stress and anxiety disorders. Therefore, a wide range of devices comprising a variety of sensors have been developed to capture these physiological and behavioral data and translate them into phenotypes and states related to mental health. Such systems aim to identify behaviors that are the consequence of an underlying physiological alteration, and hence, the raw sensor data are captured and converted into features that are used to define behavioral markers, often through machine learning. However, due to the complexity of passive data, these relationships are not simple and need to be well-established. Furthermore, parameters such as intrapersonal and interpersonal differences need to be considered when interpreting the data. Altogether, combining practical mobile and wearable systems with the right data analysis algorithms can provide a useful tool for the monitoring and management of mental disorders. The current review aims to comprehensively present and critically discuss all available smartphone-based, wearable, and environmental sensors for detecting such parameters in relation to the treatment and/or management of the most common mental health conditions.
Collapse
Affiliation(s)
- Mahsa Sheikh
- Research Centre for Biomedical Engineering, School of Mathematics, Computer Science & Engineering, City, University of London, London, United Kingdom
| | - M Qassem
- Research Centre for Biomedical Engineering, School of Mathematics, Computer Science & Engineering, City, University of London, London, United Kingdom
| | - Panicos A Kyriacou
- Research Centre for Biomedical Engineering, School of Mathematics, Computer Science & Engineering, City, University of London, London, United Kingdom
| |
Collapse
|
12
|
Nirabi A, Rahman FA, Habaebi MH, Sidek KA, Yusoff S. Machine Learning-Based Stress Level Detection from EEG Signals. 2021 IEEE 7TH INTERNATIONAL CONFERENCE ON SMART INSTRUMENTATION, MEASUREMENT AND APPLICATIONS (ICSIMA) 2021. [DOI: 10.1109/icsima50015.2021.9526333] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
13
|
EEG-based multi-level stress classification with and without smoothing filter. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
14
|
Katmah R, Al-Shargie F, Tariq U, Babiloni F, Al-Mughairbi F, Al-Nashash H. A Review on Mental Stress Assessment Methods Using EEG Signals. SENSORS (BASEL, SWITZERLAND) 2021; 21:5043. [PMID: 34372280 PMCID: PMC8347831 DOI: 10.3390/s21155043] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/31/2021] [Revised: 07/13/2021] [Accepted: 07/19/2021] [Indexed: 01/19/2023]
Abstract
Mental stress is one of the serious factors that lead to many health problems. Scientists and physicians have developed various tools to assess the level of mental stress in its early stages. Several neuroimaging tools have been proposed in the literature to assess mental stress in the workplace. Electroencephalogram (EEG) signal is one important candidate because it contains rich information about mental states and condition. In this paper, we review the existing EEG signal analysis methods on the assessment of mental stress. The review highlights the critical differences between the research findings and argues that variations of the data analysis methods contribute to several contradictory results. The variations in results could be due to various factors including lack of standardized protocol, the brain region of interest, stressor type, experiment duration, proper EEG processing, feature extraction mechanism, and type of classifier. Therefore, the significant part related to mental stress recognition is choosing the most appropriate features. In particular, a complex and diverse range of EEG features, including time-varying, functional, and dynamic brain connections, requires integration of various methods to understand their associations with mental stress. Accordingly, the review suggests fusing the cortical activations with the connectivity network measures and deep learning approaches to improve the accuracy of mental stress level assessment.
Collapse
Affiliation(s)
- Rateb Katmah
- Biomedical Engineering Graduate Program, American University of Sharjah, Sharjah 26666, United Arab Emirates;
| | - Fares Al-Shargie
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| | - Usman Tariq
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| | - Fabio Babiloni
- Department of Molecular Medicine, University of Sapienza Rome, 00185 Rome, Italy;
- College Computer Science and Technology, University Hangzhou Dianzi, Hangzhou 310018, China
| | - Fadwa Al-Mughairbi
- College of Medicines and Health Sciences, United Arab Emirates University, Al-Ain 15551, United Arab Emirates;
| | - Hasan Al-Nashash
- Department of Electrical Engineering, American University of Sharjah, Sharjah 26666, United Arab Emirates; (U.T.); (H.A.-N.)
| |
Collapse
|
15
|
Akella A, Singh AK, Leong D, Lal S, Newton P, Clifton-Bligh R, Mclachlan CS, Gustin SM, Maharaj S, Lees T, Cao Z, Lin CT. Classifying Multi-Level Stress Responses From Brain Cortical EEG in Nurses and Non-Health Professionals Using Machine Learning Auto Encoder. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2021; 9:2200109. [PMID: 34094720 PMCID: PMC8172183 DOI: 10.1109/jtehm.2021.3077760] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/14/2020] [Revised: 03/17/2021] [Accepted: 04/09/2021] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Mental stress is a major problem in our society and has become an area of interest for many psychiatric researchers. One primary research focus area is the identification of bio-markers that not only identify stress but also predict the conditions (or tasks) that cause stress. Electroencephalograms (EEGs) have been used for a long time to study and identify bio-markers. While these bio-markers have successfully predicted stress in EEG studies for binary conditions, their performance is suboptimal for multiple conditions of stress. METHODS To overcome this challenge, we propose using latent based representations of the bio-markers, which have been shown to significantly improve EEG performance compared to traditional bio-markers alone. We evaluated three commonly used EEG based bio-markers for stress, the brain load index (BLI), the spectral power values of EEG frequency bands (alpha, beta and theta), and the relative gamma (RG), with their respective latent representations using four commonly used classifiers. RESULTS The results show that spectral power value based bio-markers had a high performance with an accuracy of 83%, while the respective latent representations had an accuracy of 91%.
Collapse
Affiliation(s)
- Ashlesha Akella
- FEIT, School of Computer ScienceAustralian Artificial Intelligence Institute, University of Technology SydneyUltimoNSW2007Australia
| | - Avinash Kumar Singh
- FEIT, School of Computer ScienceAustralian Artificial Intelligence Institute, University of Technology SydneyUltimoNSW2007Australia
| | - Daniel Leong
- FEIT, School of Computer ScienceAustralian Artificial Intelligence Institute, University of Technology SydneyUltimoNSW2007Australia
| | - Sara Lal
- Neuroscience Research Unit, School of Life SciencesUniversity of Technology SydneyUltimoNSW2007Australia
| | - Phillip Newton
- Centre for Cardiovascular and Chronic CareUniversity of Technology SydneyUltimoNSW2007Australia
| | - Roderick Clifton-Bligh
- Department of EndocrinologyRoyal North Shore HospitalThe University of SydneySydneyNSW2006Australia
| | - Craig Steven Mclachlan
- Centre for Healthy Futures, Health VerticalTorrens University Australia, Pyrmont CampusPyrmontNSW2009Australia
- Neuroscience Research AustraliaRandwickNSW2031Australia
| | | | - Shamona Maharaj
- Neuroscience Research Unit, School of Life SciencesUniversity of Technology SydneyUltimoNSW2007Australia
| | - Ty Lees
- Edna Bennett Pierce Prevention Research CenterPennsylvania State UniversityState CollegePA16801USA
| | - Zehong Cao
- Information and Communication Technology (ICT)University of TasmaniaHobartTAS7005Australia
| | - Chin-Teng Lin
- FEIT, School of Computer ScienceAustralian Artificial Intelligence Institute, University of Technology SydneyUltimoNSW2007Australia
| |
Collapse
|
16
|
Sevil M, Rashid M, Hajizadeh I, Askari MR, Hobbs N, Brandt R, Park M, Quinn L, Cinar A. Discrimination of simultaneous psychological and physical stressors using wristband biosignals. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 199:105898. [PMID: 33360529 PMCID: PMC7878428 DOI: 10.1016/j.cmpb.2020.105898] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/14/2020] [Accepted: 11/30/2020] [Indexed: 05/07/2023]
Abstract
BACKGROUND AND OBJECTIVE In this work, we address the problem of detecting and discriminating acute psychological stress (APS) in the presence of concurrent physical activity (PA) using wristband biosignals. We focused on signals available from wearable devices that can be worn in daily life because the ultimate objective of this work is to provide APS and PA information in real-time management of chronic conditions such as diabetes by automated personalized insulin delivery. Monitoring APS noninvasively throughout free-living conditions remains challenging because the responses to APS and PA of many physiological variables measured by wearable devices are similar. METHODS Various classification algorithms are compared to simultaneously detect and discriminate the PA (sedentary state, treadmill running, and stationary bike) and the type of APS (non-stress state, mental stress, and emotional anxiety). The impact of APS inducements is verified with commonly used self-reported questionnaires (The State-Trait Anxiety Inventory (STAI)). To aid the classification algorithms, novel features are generated from the physiological variables reported by a wristband device during 117 hours of experiments involving simultaneous APS inducement and PA. We also translate the APS assessment into a quantitative metric for use in predicting the adverse outcomes. RESULTS An accurate classification of the concurrent PA and APS states is achieved with an overall classification accuracy of 99% for PA and 92% for APS. The average accuracy of APS detection during sedentary state, treadmill running, and stationary bike is 97.3, 94.1, and 84.5%, respectively. CONCLUSIONS The simultaneous assessment of APS and PA throughout free-living conditions from a convenient wristband device is useful for monitoring the factors contributing to an elevated risk of acute events in people with chronic diseases like cardiovascular complications and diabetes.
Collapse
Affiliation(s)
- Mert Sevil
- Department of Biomedical Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Mudassir Rashid
- Department of Chemical and Biological Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Iman Hajizadeh
- Department of Chemical and Biological Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Mohammad Reza Askari
- Department of Chemical and Biological Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Nicole Hobbs
- Department of Biomedical Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Rachel Brandt
- Department of Biomedical Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA
| | - Minsun Park
- College of Nursing, University of Illinois at Chicago, IL, 60616, USA
| | - Laurie Quinn
- College of Nursing, University of Illinois at Chicago, IL, 60616, USA
| | - Ali Cinar
- Department of Biomedical Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA; Department of Chemical and Biological Engineering, Illinois Institute of Technology, Chicago, IL, 60616, USA.
| |
Collapse
|
17
|
Vaquero-Blasco MA, Perez-Valero E, Lopez-Gordo MA, Morillas C. Virtual Reality as a Portable Alternative to Chromotherapy Rooms for Stress Relief: A Preliminary Study. SENSORS 2020; 20:s20216211. [PMID: 33143361 PMCID: PMC7663593 DOI: 10.3390/s20216211] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/01/2020] [Revised: 10/27/2020] [Accepted: 10/28/2020] [Indexed: 12/16/2022]
Abstract
Chromotherapy rooms are comfortable spaces, used in places like special needs schools, where stimuli are carefully selected to cope with stress. However, these rooms are expensive and require a space that cannot be reutilized. In this article, we propose the use of virtual reality (VR) as an inexpensive and portable alternative to chromotherapy rooms for stress relief. We recreated a chromotherapy room stress relief program using a commercial head mounted display (HD). We assessed the stress level of two groups (test and control) through an EEG biomarker, the relative gamma, while they experienced a relaxation session. First, participants were stressed using the Montreal imaging stress task (MIST). Then, for relaxing, the control group utilized a chromotherapy room while the test group used virtual reality. We performed a hypothesis test to compare the self- perceived stress level at different stages of the experiment and it yielded no significant differences in reducing stress for both groups, during relaxing (p-value: 0.8379, α = 0.05) or any other block. Furthermore, according to participant surveys, the use of virtual reality was deemed immersive, comfortable and pleasant (3.9 out of 5). Our preliminary results validate our approach as an inexpensive and portable alternative to chromotherapy rooms for stress relief.
Collapse
Affiliation(s)
- Miguel A. Vaquero-Blasco
- Department of Signal Theory, Telematics and Communications, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain;
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
| | - Eduardo Perez-Valero
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Department of Computer Architecture and Technology, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain
| | - Miguel Angel Lopez-Gordo
- Department of Signal Theory, Telematics and Communications, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain;
- Nicolo Association, Churriana de la Vega, 18194 Granada, Spain
- Correspondence: ; Tel.: +34-958-249-721
| | - Christian Morillas
- Research Centre for Information and Communications Technologies (CITIC), University of Granada, Calle Periodista Rafael Gómez Montero, 2, 18014 Granada, Spain; (E.P.-V.); (C.M.)
- Department of Computer Architecture and Technology, University of Granada, Calle Periodista Daniel Saucedo Aranda, s/n, 18014 Granada, Spain
| |
Collapse
|
18
|
Pourmohammadi S, Maleki A. Stress detection using ECG and EMG signals: A comprehensive study. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2020; 193:105482. [PMID: 32408236 DOI: 10.1016/j.cmpb.2020.105482] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2019] [Revised: 03/27/2020] [Accepted: 03/27/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND AND OBJECTIVE In recent years, stress and mental health have been considered as important worldwide concerns. Stress detection using physiological signals such as electrocardiogram (ECG), skin conductance (SC), electromyogram (EMG) and electroencephalogram (EEG) is a traditional approach. However, the effect of stress on the EMG signal of different muscles and the efficacy of combination of the EMG and other biological signals for stress detection have not been taken into account yet. This paper presents a comprehensive review of the EMG signal of the right and left trapezius and right and left erector spinae muscles for multi-level stress recognition. Also, the ECG signal was employed to evaluate the efficacy of EMG signals for stress detection. METHODS Both EMG and ECG signals were acquired simultaneously from 34 healthy students (23 females and 11 males, aged 20-37 years). Mental arithmetic, Stroop color-word test, time pressure, and stressful environment were employed to induce stress in the laboratory. RESULTS The accuracies of stress recognition in two, three and four levels were 100%, 97.6%, and 96.2%, respectively, obtained from the distinct combination of feature selection and machine learning algorithms. CONCLUSIONS The comparison of stress detection accuracies resulted from EMG and ECG indicators demonstrated the strong ability and the effectiveness of EMG signal for multi-level stress detection.
Collapse
Affiliation(s)
| | - Ali Maleki
- Biomedical Engineering Department, Semnan University, Semnan, Iran.
| |
Collapse
|
19
|
Real-Time Stress Assessment Using Sliding Window Based Convolutional Neural Network. SENSORS 2020; 20:s20164400. [PMID: 32784531 PMCID: PMC7472011 DOI: 10.3390/s20164400] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/16/2020] [Revised: 06/20/2020] [Accepted: 06/22/2020] [Indexed: 01/08/2023]
Abstract
Mental stress has been identified as a significant cause of several bodily disorders, such as depression, hypertension, neural and cardiovascular abnormalities. Conventional stress assessment methods are highly subjective and tedious and tend to lack accuracy. Machine-learning (ML)-based computer-aided diagnosis systems can be used to assess the mental state with reasonable accuracy, but they require offline processing and feature extraction, rendering them unsuitable for real-time applications. This paper presents a real-time mental stress assessment approach based on convolutional neural networks (CNNs). The CNN-based approach afforded real-time mental stress assessment with an accuracy as high as 96%, the sensitivity of 95%, and specificity of 97%. The proposed approach is compared with state-of-the-art ML techniques in terms of accuracy, time utilisation, and quality of features.
Collapse
|
20
|
Attallah O. An Effective Mental Stress State Detection and Evaluation System Using Minimum Number of Frontal Brain Electrodes. Diagnostics (Basel) 2020; 10:E292. [PMID: 32397517 PMCID: PMC7278014 DOI: 10.3390/diagnostics10050292] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2020] [Revised: 04/28/2020] [Accepted: 05/01/2020] [Indexed: 11/16/2022] Open
Abstract
Currently, mental stress is a common social problem affecting people. Stress reduces human functionality during routine work and may lead to severe health defects. Detecting stress is important in education and industry to determine the efficiency of teaching, to improve education, and to reduce risks from human errors that might occur due to workers' stressful situations. Therefore, the early detection of mental stress using machine learning (ML) techniques is essential to prevent illness and health problems, improve quality of education, and improve industrial safety. The human brain is the main target of mental stress. For this reason, an ML system is proposed which investigates electroencephalogram (EEG) signal for thirty-six participants. Extracting useful features is essential for an efficient mental stress detection (MSD) system. Thus, this framework introduces a hybrid feature-set that feeds five ML classifiers to detect stress and non-stress states, and classify stress levels. To produce a reliable, practical, and efficient MSD system with a reduced number of electrodes, the proposed MSD scheme investigates the electrodes placements on different sites on the scalp and selects that site which has the higher impact on the accuracy of the system. Principal Component analysis is employed also, to reduce the features extracted from such electrodes to lower model complexity, where the optimal number of principal components is examined using sequential forward procedure. Furthermore, it examines the minimum number of electrodes placed on the site which has greater impact on stress detection and evaluation. To test the effectiveness of the proposed system, the results are compared with other feature extraction methods shown in literature. They are also compared with state-of-the-art techniques recorded for stress detection. The highest accuracies achieved in this study are 99.9%(sd = 0.015) and 99.26% (sd = 0.08) for identifying stress and non-stress states, and distinguishing between stress levels, respectively, using only two frontal brain electrodes for detecting stress and non-stress, and three frontal electrodes for evaluating stress levels respectively. The results show that the proposed system is reliable as the sensitivity is 99.9(0.064), 98.35(0.27), specificity is 99.94(0.02), 99.6(0.05), precision is 99.94(0.06), 98.9(0.23), and the diagnostics odd ratio (DOR) is ≥ 100 for detecting stress and non-stress, and evaluating stress levels respectively. This shows that the proposed framework has compelling performance and can be employed for stress detection and evaluation in medical, educational and industrial fields. Finally, the results verified the efficiency and reliability of the proposed system in predicting stress and non-stress on new patients, as the accuracy achieved 98.48% (sd = 1.12), sensitivity = 97.78% (sd = 1.84), specificity = 97.75% (sd = 2.05), precision = 99.26% (sd = 0.67), and DOR ≥ 100 using only two frontal electrodes.
Collapse
Affiliation(s)
- Omneya Attallah
- Department of Electronics and Communications, College of Engineering and Technology, Arab Academy for Science, Technology and Maritime Transport, Alexandria 1029, Egypt
| |
Collapse
|
21
|
Stress Detection via Keyboard Typing Behaviors by Using Smartphone Sensors and Machine Learning Techniques. J Med Syst 2020; 44:68. [PMID: 32072331 DOI: 10.1007/s10916-020-1530-z] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2019] [Accepted: 01/23/2020] [Indexed: 10/25/2022]
Abstract
Stress is one of the biggest problems in modern society. It may not be possible for people to perceive if they are under high stress or not. It is important to detect stress early and unobtrusively. In this context, stress detection can be considered as a classification problem. In this study, it was investigated the effects of stress by using accelerometer and gyroscope sensor data of the writing behavior on a smartphone touchscreen panel. For this purpose, smartphone data including two states (stress and calm) were collected from 46 participants. The obtained sensor signals were divided into 5, 10 and 15 s interval windows to create three different data sets and 112 different features were defined from the raw data. To obtain more effective feature subsets, these features were ranked by using Gain Ratio feature selection algorithm. Afterwards, writing behaviors were classified by C4.5 Decision Trees, Bayesian Networks and k-Nearest Neighbor methods. As a result of the experiments, 74.26%, 67.86%, and 87.56% accuracy classification results were obtained respectively.
Collapse
|
22
|
Fabrication of a portable device for stress monitoring using wearable sensors and soft computing algorithms. Neural Comput Appl 2019. [DOI: 10.1007/s00521-019-04278-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
23
|
Puli A, Kushki A. Toward Automatic Anxiety Detection in Autism: A Real-Time Algorithm for Detecting Physiological Arousal in the Presence of Motion. IEEE Trans Biomed Eng 2019; 67:646-657. [PMID: 31144623 DOI: 10.1109/tbme.2019.2919273] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVE Anxiety is a significant clinical concern in autism spectrum disorder (ASD) due to its negative impact on physical and psychological health. Treatment of anxiety in ASD remains a challenge due to difficulties with self-awareness and communication of anxiety symptoms. To reduce these barriers to treatment, physiological markers of autonomic arousal, collected through wearable sensors, have been proposed as real-time, objective, and language-free measures of anxiety. A critical limitation of the existing anxiety detection systems is that physiological arousal is not specific to anxiety and can occur with other user states such as physical activity. This can result in false positives, which can hinder the operation of these systems in real-world situations. The objective of this paper was to address this challenge by proposing an approach for real-time detection and mitigation of physical activity effects. METHODS A novel multiple model Kalman-like filter is proposed to integrate heart rate and accelerometry signals. The filter tracks user heart rate under different motion assumptions and chooses the appropriate model for anxiety detection based on user motion conditions. RESULTS Evaluation of the algorithm using data from a sample of children with ASD shows a significant reduction in false positives compared to the state-of-the-art, and an overall arousal detection accuracy of 93%. CONCLUSION The proposed method is able to reduce false detections due to user motion and effectively detect arousal states during movement periods. SIGNIFICANCE The results add to the growing evidence supporting the feasibility of wearable technologies for anxiety detection and management in naturalistic settings.
Collapse
|
24
|
Ogino M, Mitsukura Y. Portable Drowsiness Detection through Use of a Prefrontal Single-Channel Electroencephalogram. SENSORS 2018; 18:s18124477. [PMID: 30567347 PMCID: PMC6308812 DOI: 10.3390/s18124477] [Citation(s) in RCA: 41] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2018] [Revised: 12/14/2018] [Accepted: 12/16/2018] [Indexed: 12/11/2022]
Abstract
Drowsiness detection has been studied in the context of evaluating products, assessing driver alertness, and managing office environments. Drowsiness level can be readily detected through measurement of human brain activity. The electroencephalogram (EEG), a device whose application relies on adhering electrodes to the scalp, is the primary method used to monitor brain activity. The many electrodes and wires required to perform an EEG place considerable constraints on the movement of users, and the cost of the device limits its availability. For these reasons, conventional EEG devices are not used in practical studies and businesses. Many potential practical applications could benefit from the development of a wire-free, low-priced device; however, it remains to be elucidated whether portable EEG devices can be used to estimate human drowsiness levels and applied within practical research settings and businesses. In this study, we outline the development of a drowsiness detection system that makes use of a low-priced, prefrontal single-channel EEG device and evaluate its performance in an offline analysis and a practical experiment. Firstly, for the development of the system, we compared three feature extraction methods: power spectral density (PSD), autoregressive (AR) modeling, and multiscale entropy (MSE) for detecting characteristics of an EEG. In order to efficiently select a meaningful PSD, we utilized step-wise linear discriminant analysis (SWLDA). Time-averaging and robust-scaling were used to fit the data for pattern recognition. Pattern recognition was performed by a support vector machine (SVM) with a radial basis function (RBF) kernel. The optimal hyperparameters for the SVM were selected by the grind search method so as to increase drowsiness detection accuracy. To evaluate the performance of the detections, we calculated classification accuracy using the SVM through 10-fold cross-validation. Our model achieved a classification accuracy of 72.7% using the PSD with SWLDA and the SVM. Secondly, we conducted a practical study using the system and evaluated its performance in a practical situation. There was a significant difference (* p < 0.05) between the drowsiness-evoked task and concentration-needed task. Our results demonstrate the efficacy of our low-priced portable drowsiness detection system in quantifying drowsy states. We anticipate that our system will be useful to practical studies with aims as diverse as measurement of classroom mental engagement, evaluation of movies, and office environment evaluation.
Collapse
Affiliation(s)
- Mikito Ogino
- Dentsu ScienceJam Inc., Akasaka, Tokyo 107-0052, Japan.
| | - Yasue Mitsukura
- School of Integrated Design Engineering, Keio University, Yokohama, Kanagawa 223-8522, Japan.
| |
Collapse
|