1
|
Xiang JZ, Wang QY, Fang ZB, Esquivel JA, Su ZX. A multi-modal deep learning approach for stress detection using physiological signals: integrating time and frequency domain features. Front Physiol 2025; 16:1584299. [PMID: 40236827 PMCID: PMC11997569 DOI: 10.3389/fphys.2025.1584299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2025] [Accepted: 03/17/2025] [Indexed: 04/17/2025] Open
Abstract
Objective This study aims to develop a multimodal deep learning-based stress detection method (MMFD-SD) using intermittently collected physiological signals from wearable devices, including accelerometer data, electrodermal activity (EDA), heart rate (HR), and skin temperature. Given the unique demands and high-intensity work environment of the nursing profession, stress measurement in nurses serves as a representative case, reflecting stress levels in other high-pressure occupations. Methods We propose a multimodal deep learning framework that integrates time-domain and frequency-domain features for stress detection. To enhance model robustness and generalization, data augmentation techniques such as sliding window and jittering are applied. Feature extraction includes statistical features derived from raw time-domain signals and frequency-domain features obtained via Fast Fourier Transform (FFT). A customized deep learning architecture employs convolutional neural networks (CNNs) to process time-domain and frequency-domain features separately, followed by fully connected layers for final classification. To address class imbalance, the Synthetic Minority Over-sampling Technique (SMOTE) is utilized. The model is trained and evaluated on a multimodal physiological signal dataset with stress level labels. Results Experimental results demonstrate that the MMFD-SD method achieves outstanding performance in stress detection, with an accuracy of 91.00% and an F1-score of 0.91. Compared to traditional machine learning classifiers such as logistic regression, random forest, and XGBoost, the proposed method significantly improves both accuracy and robustness. Ablation studies reveal that the integration of time-domain and frequency-domain features plays a crucial role in enhancing model performance. Additionally, sensitivity analysis confirms the model's stability and adaptability across different hyperparameter settings. Conclusion The proposed MMFD-SD model provides an accurate and robust stress detection approach by integrating time-domain and frequency-domain features. Designed for occupational environments with intermittent data collection, it effectively addresses real-world stress monitoring challenges. Future research can explore the fusion of additional modalities, real-time stress detection, and improvements in model generalization to enhance its practical applicability.
Collapse
Affiliation(s)
- Jun-Zhi Xiang
- Emergency Department, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang, China
| | - Qin-Yong Wang
- School of Artificial Intelligence, Zhejiang College of Security Technology, Wenzhou, Zhejiang, China
| | - Zhi-Bin Fang
- School of Software Technology, Zhejiang University, Ningbo, Zhejiang, China
| | - James A. Esquivel
- Graduate School, Angeles University Foundation, Angeles, Philippines
| | - Zhi-Xian Su
- School of Artificial Intelligence, Zhejiang College of Security Technology, Wenzhou, Zhejiang, China
| |
Collapse
|
2
|
Sel K, Hawkins-Daarud A, Chaudhuri A, Osman D, Bahai A, Paydarfar D, Willcox K, Chung C, Jafari R. Survey and perspective on verification, validation, and uncertainty quantification of digital twins for precision medicine. NPJ Digit Med 2025; 8:40. [PMID: 39825103 PMCID: PMC11742391 DOI: 10.1038/s41746-025-01447-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/21/2024] [Accepted: 01/13/2025] [Indexed: 01/20/2025] Open
Abstract
Digital twins in precision medicine provide tailored health recommendations by simulating patient-specific trajectories and interventions. We examine the critical role of Verification, Validation, and Uncertainty Quantification (VVUQ) for digital twins in ensuring safety and efficacy, with examples in cardiology and oncology. We highlight challenges and opportunities for developing personalized trial methodologies, validation metrics, and standardizing VVUQ processes. VVUQ frameworks are essential for integrating digital twins into clinical practice.
Collapse
Affiliation(s)
- Kaan Sel
- Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Andrea Hawkins-Daarud
- Institute for Data Science in Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Anirban Chaudhuri
- Oden Institute for Computational Engineering and Sciences, The University of Texas at Austin, Austin, TX, USA
| | - Deen Osman
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX, USA
| | - Ahmad Bahai
- Microsystems Technology Laboratories, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - David Paydarfar
- Oden Institute for Computational Engineering and Sciences, The University of Texas at Austin, Austin, TX, USA
- Department of Neurology, The University of Texas at Austin Dell Medical School, Austin, TX, USA
| | - Karen Willcox
- Oden Institute for Computational Engineering and Sciences, The University of Texas at Austin, Austin, TX, USA
| | - Caroline Chung
- Institute for Data Science in Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Roozbeh Jafari
- Laboratory for Information and Decision Systems, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Department of Electrical and Computer Engineering, Texas A&M University, College Station, TX, USA.
- Lincoln Laboratory, Massachusetts Institute of Technology, Lexington, MA, USA.
| |
Collapse
|
3
|
Yang L, Hu Z, Xiang Z, Zhou J, Wang X, Liu Q, Gan L, Shi S, Yang W, Zhang Y, Wu J. A high-entropy electrode material for electrobiochemical and eletrophysiological signals detection. CHEMICAL ENGINEERING JOURNAL 2024; 499:156209. [DOI: 10.1016/j.cej.2024.156209] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/28/2024]
|
4
|
Anders C, Moontaha S, Real S, Arnrich B. Unobtrusive measurement of cognitive load and physiological signals in uncontrolled environments. Sci Data 2024; 11:1000. [PMID: 39271693 PMCID: PMC11399273 DOI: 10.1038/s41597-024-03738-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2023] [Accepted: 08/05/2024] [Indexed: 09/15/2024] Open
Abstract
While individuals fail to assess their mental health subjectively in their day-to-day activities, the recent development of consumer-grade wearable devices has enormous potential to monitor daily workload objectively by acquiring physiological signals. Therefore, this work collected consumer-grade physiological signals from twenty-four participants, following a four-hour cognitive load elicitation paradigm with self-chosen tasks in uncontrolled environments and a four-hour mental workload elicitation paradigm in a controlled environment. The recorded dataset of approximately 315 hours consists of electroencephalography, acceleration, electrodermal activity, and photoplethysmogram data balanced across low and high load levels. Participants performed office-like tasks in the controlled environment (mental arithmetic, Stroop, N-Back, and Sudoku) with two defined difficulty levels and in the uncontrolled environments (mainly researching, programming, and writing emails). Each task label was provided by participants using two 5-point Likert scales of mental workload and stress and the pairwise NASA-TLX questionnaire. This data is suitable for developing real-time mental health assessment methods, conducting research on signal processing techniques for challenging environments, and developing personal cognitive load assistants.
Collapse
Affiliation(s)
- Christoph Anders
- University of Potsdam, Digital Engineering Faculty, Digital Health - Connected Healthcare of the Hasso Plattner Institute, Potsdam, 14482, Germany.
| | - Sidratul Moontaha
- University of Potsdam, Digital Engineering Faculty, Digital Health - Connected Healthcare of the Hasso Plattner Institute, Potsdam, 14482, Germany.
| | - Samik Real
- University of Potsdam, Digital Engineering Faculty, Digital Health - Connected Healthcare of the Hasso Plattner Institute, Potsdam, 14482, Germany
| | - Bert Arnrich
- University of Potsdam, Digital Engineering Faculty, Digital Health - Connected Healthcare of the Hasso Plattner Institute, Potsdam, 14482, Germany
| |
Collapse
|
5
|
Corponi F, Li BM, Anmella G, Valenzuela-Pascual C, Mas A, Pacchiarotti I, Valentí M, Grande I, Benabarre A, Garriga M, Vieta E, Young AH, Lawrie SM, Whalley HC, Hidalgo-Mazzei D, Vergari A. Wearable Data From Subjects Playing Super Mario, Taking University Exams, or Performing Physical Exercise Help Detect Acute Mood Disorder Episodes via Self-Supervised Learning: Prospective, Exploratory, Observational Study. JMIR Mhealth Uhealth 2024; 12:e55094. [PMID: 39018100 PMCID: PMC11292167 DOI: 10.2196/55094] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2023] [Revised: 04/14/2024] [Accepted: 05/24/2024] [Indexed: 07/18/2024] Open
Abstract
BACKGROUND Personal sensing, leveraging data passively and near-continuously collected with wearables from patients in their ecological environment, is a promising paradigm to monitor mood disorders (MDs), a major determinant of the worldwide disease burden. However, collecting and annotating wearable data is resource intensive. Studies of this kind can thus typically afford to recruit only a few dozen patients. This constitutes one of the major obstacles to applying modern supervised machine learning techniques to MD detection. OBJECTIVE In this paper, we overcame this data bottleneck and advanced the detection of acute MD episodes from wearables' data on the back of recent advances in self-supervised learning (SSL). This approach leverages unlabeled data to learn representations during pretraining, subsequently exploited for a supervised task. METHODS We collected open access data sets recording with the Empatica E4 wristband spanning different, unrelated to MD monitoring, personal sensing tasks-from emotion recognition in Super Mario players to stress detection in undergraduates-and devised a preprocessing pipeline performing on-/off-body detection, sleep/wake detection, segmentation, and (optionally) feature extraction. With 161 E4-recorded subjects, we introduced E4SelfLearning, the largest-to-date open access collection, and its preprocessing pipeline. We developed a novel E4-tailored transformer (E4mer) architecture, serving as the blueprint for both SSL and fully supervised learning; we assessed whether and under which conditions self-supervised pretraining led to an improvement over fully supervised baselines (ie, the fully supervised E4mer and pre-deep learning algorithms) in detecting acute MD episodes from recording segments taken in 64 (n=32, 50%, acute, n=32, 50%, stable) patients. RESULTS SSL significantly outperformed fully supervised pipelines using either our novel E4mer or extreme gradient boosting (XGBoost): n=3353 (81.23%) against n=3110 (75.35%; E4mer) and n=2973 (72.02%; XGBoost) correctly classified recording segments from a total of 4128 segments. SSL performance was strongly associated with the specific surrogate task used for pretraining, as well as with unlabeled data availability. CONCLUSIONS We showed that SSL, a paradigm where a model is pretrained on unlabeled data with no need for human annotations before deployment on the supervised target task of interest, helps overcome the annotation bottleneck; the choice of the pretraining surrogate task and the size of unlabeled data for pretraining are key determinants of SSL success. We introduced E4mer, which can be used for SSL, and shared the E4SelfLearning collection, along with its preprocessing pipeline, which can foster and expedite future research into SSL for personal sensing.
Collapse
Affiliation(s)
- Filippo Corponi
- School of Informatics, University of Edinburgh, Edinburgh, United Kingdom
| | - Bryan M Li
- School of Informatics, University of Edinburgh, Edinburgh, United Kingdom
- The Alan Turing Institute, London, United Kingdom
| | - Gerard Anmella
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Clàudia Valenzuela-Pascual
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Ariadna Mas
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Isabella Pacchiarotti
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Marc Valentí
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Iria Grande
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Antoni Benabarre
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Marina Garriga
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Eduard Vieta
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
| | - Allan H Young
- Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Stephen M Lawrie
- Division of Psychiatry, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
| | - Heather C Whalley
- Division of Psychiatry, Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom
- Generation Scotland, Institute for Genetics and Cancer, University of Edinburgh, Edinburgh, United Kingdom
| | - Diego Hidalgo-Mazzei
- Bipolar and Depressive Disorders Unit, Department of Psychiatry and Psychology, Hospital Clínic de Barcelona, Barcelona, Spain
- Institut d'Investigacions Biomèdiques August Pi i Sunyer, Barcelona, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, Instituto de Salud Carlos III, Madrid, Spain
- Departament de Medicina, Facultat de Medicina i Ciències de la Salut, Universitat de Barcelona, Barcelona, Spain
- Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Antonio Vergari
- School of Informatics, University of Edinburgh, Edinburgh, United Kingdom
| |
Collapse
|
6
|
Georgiou K, Boyanov N, Thanasas D, Sandblom G, Linardoutsos D, Enochsson L. Saliva stress biomarkers in ERCP trainees before and after familiarisation with ERCP on a virtual simulator. Front Surg 2024; 11:1364195. [PMID: 38952438 PMCID: PMC11215138 DOI: 10.3389/fsurg.2024.1364195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/01/2024] [Accepted: 06/06/2024] [Indexed: 07/03/2024] Open
Abstract
Background Stress during the early ERCP learning curve may interfere with acquisition of skills during training. The purpose of this study was to compare stress biomarkers in the saliva of trainees before and after familiarisation with ERCP exercises on a virtual simulator. Methods Altogether 26 endoscopists under training, 14 women and 12 men, completed the three phases of this study: Phase 1. Three different ERCP procedures were performed on the simulator. Saliva for α-amylase (sAA), Chromogranin A (sCgA), and Cortisol (sC) were collected before (baseline), halfway through the exercise (ex.), and 10 min after completion of the exercise (comp.); Phase 2. A three-week familiarisation period where at least 30 different cases were performed on the virtual ERCP simulator; and Phase 3. Identical to Phase 1 where saliva samples were once again collected at baseline, during, and after the exercise. Percentage differences in biomarker levels between baseline and exercise (Diffex) and between baseline and completion (Diffcomp) during Phase 1 and Phase 3 were calculated for each stress marker. Results Mean % changes, Diffex and Diffcomp, were significantly positive (p < 0.05) for all markers in both Phase 1 and Phase 3. Diffex in Phase 1 was significantly greater than Diffex in Phase 3 (p < 0.05) for sAA and sCgA. Diffcomp for sAA in Phase 1 was significantly greater than Diffcomp in Phase 3 (p < 0.05). No significant differences were found in sC concentration between Phases 1 and 3. Conclusion This study shows that familiarisation with the ERCP simulator greatly reduced stress as measured by the three saliva stress biomarkers used with sAA being the best. It also suggests that familiarisation with an ERCP simulator might reduce stress in the clinical setting.
Collapse
Affiliation(s)
- Konstantinos Georgiou
- 1st Department of Propaedeutic Surgery, Hippocrateion Athens General Hospital, Athens Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | - Nikola Boyanov
- Medical Simulation Training Centre, Research Institute of Medical University of Plovdiv, Plovdiv, Bulgaria
| | - Dimitrios Thanasas
- Medical Physics Laboratory Simulation Centre, Athens Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | - Gabriel Sandblom
- Department of Clinical Science and Education Södersjukhuset, Karolinska Institute, Stockholm, Sweden
- Department of Surgery, Södersjukhuset, Stockholm, Sweden
| | - Dimitrios Linardoutsos
- 1st Department of Propaedeutic Surgery, Hippocrateion Athens General Hospital, Athens Medical School, National and Kapodistrian University of Athens, Athens, Greece
| | - Lars Enochsson
- Department of Diagnostics and Intervention, Surgery, Umeå University, Umeå, Sweden
- Department of Clinical Science, Interventions and Technology, Division of Orthopedics and Biotechnology, Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
7
|
Bolpagni M, Pardini S, Dianti M, Gabrielli S. Personalized Stress Detection Using Biosignals from Wearables: A Scoping Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:3221. [PMID: 38794074 PMCID: PMC11126007 DOI: 10.3390/s24103221] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Revised: 05/14/2024] [Accepted: 05/16/2024] [Indexed: 05/26/2024]
Abstract
Stress is a natural yet potentially harmful aspect of human life, necessitating effective management, particularly during overwhelming experiences. This paper presents a scoping review of personalized stress detection models using wearable technology. Employing the PRISMA-ScR framework for rigorous methodological structuring, we systematically analyzed literature from key databases including Scopus, IEEE Xplore, and PubMed. Our focus was on biosignals, AI methodologies, datasets, wearable devices, and real-world implementation challenges. The review presents an overview of stress and its biological mechanisms, details the methodology for the literature search, and synthesizes the findings. It shows that biosignals, especially EDA and PPG, are frequently utilized for stress detection and demonstrate potential reliability in multimodal settings. Evidence for a trend towards deep learning models was found, although the limited comparison with traditional methods calls for further research. Concerns arise regarding the representativeness of datasets and practical challenges in deploying wearable technologies, which include issues related to data quality and privacy. Future research should aim to develop comprehensive datasets and explore AI techniques that are not only accurate but also computationally efficient and user-centric, thereby closing the gap between theoretical models and practical applications to improve the effectiveness of stress detection systems in real scenarios.
Collapse
Affiliation(s)
- Marco Bolpagni
- Human Inspired Technology Research Centre, University of Padua, 35121 Padua, Italy
- Digital Health Research, Centre for Digital Health and Wellbeing, Fondazione Bruno Kessler, 38123 Trento, Italy; (S.P.); (M.D.); (S.G.)
| | - Susanna Pardini
- Digital Health Research, Centre for Digital Health and Wellbeing, Fondazione Bruno Kessler, 38123 Trento, Italy; (S.P.); (M.D.); (S.G.)
| | - Marco Dianti
- Digital Health Research, Centre for Digital Health and Wellbeing, Fondazione Bruno Kessler, 38123 Trento, Italy; (S.P.); (M.D.); (S.G.)
| | - Silvia Gabrielli
- Digital Health Research, Centre for Digital Health and Wellbeing, Fondazione Bruno Kessler, 38123 Trento, Italy; (S.P.); (M.D.); (S.G.)
| |
Collapse
|
8
|
Islam T, Washington P. Non-Invasive Biosensing for Healthcare Using Artificial Intelligence: A Semi-Systematic Review. BIOSENSORS 2024; 14:183. [PMID: 38667177 PMCID: PMC11048540 DOI: 10.3390/bios14040183] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/15/2024] [Revised: 03/27/2024] [Accepted: 04/01/2024] [Indexed: 04/28/2024]
Abstract
The rapid development of biosensing technologies together with the advent of deep learning has marked an era in healthcare and biomedical research where widespread devices like smartphones, smartwatches, and health-specific technologies have the potential to facilitate remote and accessible diagnosis, monitoring, and adaptive therapy in a naturalistic environment. This systematic review focuses on the impact of combining multiple biosensing techniques with deep learning algorithms and the application of these models to healthcare. We explore the key areas that researchers and engineers must consider when developing a deep learning model for biosensing: the data modality, the model architecture, and the real-world use case for the model. We also discuss key ongoing challenges and potential future directions for research in this field. We aim to provide useful insights for researchers who seek to use intelligent biosensing to advance precision healthcare.
Collapse
|
9
|
Kargarandehkordi A, Slade C, Washington P. Personalized AI-Driven Real-Time Models to Predict Stress-Induced Blood Pressure Spikes Using Wearable Devices: Proposal for a Prospective Cohort Study. JMIR Res Protoc 2024; 13:e55615. [PMID: 38526539 PMCID: PMC11002732 DOI: 10.2196/55615] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 02/03/2024] [Accepted: 02/05/2024] [Indexed: 03/26/2024] Open
Abstract
BACKGROUND Referred to as the "silent killer," elevated blood pressure (BP) often goes unnoticed due to the absence of apparent symptoms, resulting in cumulative harm over time. Chronic stress has been consistently linked to increased BP. Prior studies have found that elevated BP often arises due to a stressful lifestyle, although the effect of exact stressors varies drastically between individuals. The heterogeneous nature of both the stress and BP response to a multitude of lifestyle decisions can make it difficult if not impossible to pinpoint the most deleterious behaviors using the traditional mechanism of clinical interviews. OBJECTIVE The aim of this study is to leverage machine learning (ML) algorithms for real-time predictions of stress-induced BP spikes using consumer wearable devices such as Fitbit, providing actionable insights to both patients and clinicians to improve diagnostics and enable proactive health monitoring. This study also seeks to address the significant challenges in identifying specific deleterious behaviors associated with stress-induced hypertension through the development of personalized artificial intelligence models for individual patients, departing from the conventional approach of using generalized models. METHODS The study proposes the development of ML algorithms to analyze biosignals obtained from these wearable devices, aiming to make real-time predictions about BP spikes. Given the longitudinal nature of the data set comprising time-series data from wearables (eg, Fitbit) and corresponding time-stamped labels representing stress levels from Ecological Momentary Assessment reports, the adoption of self-supervised learning for pretraining the network and using transformer models for fine-tuning the model on a personalized prediction task is proposed. Transformer models, with their self-attention mechanisms, dynamically weigh the importance of different time steps, enabling the model to focus on relevant temporal features and dependencies, facilitating accurate prediction. RESULTS Supported as a pilot project from the Robert C Perry Fund of the Hawaii Community Foundation, the study team has developed the core study app, CardioMate. CardioMate not only reminds participants to initiate BP readings using an Omron HeartGuide wearable monitor but also prompts them multiple times a day to report stress levels. Additionally, it collects other useful information including medications, environmental conditions, and daily interactions. Through the app's messaging system, efficient contact and interaction between users and study admins ensure smooth progress. CONCLUSIONS Personalized ML when applied to biosignals offers the potential for real-time digital health interventions for chronic stress and its symptoms. The project's clinical use for Hawaiians with stress-induced high BP combined with its methodological innovation of personalized artificial intelligence models highlights its significance in advancing health care interventions. Through iterative refinement and optimization, the aim is to develop a personalized deep-learning framework capable of accurately predicting stress-induced BP spikes, thereby promoting individual well-being and health outcomes. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) DERR1-10.2196/55615.
Collapse
Affiliation(s)
- Ali Kargarandehkordi
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Christopher Slade
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| | - Peter Washington
- Department of Information and Computer Sciences, University of Hawaii at Manoa, Honolulu, HI, United States
| |
Collapse
|
10
|
Nagaraj S, Goodday S, Hartvigsen T, Boch A, Garg K, Gowda S, Foschini L, Ghassemi M, Friend S, Goldenberg A. Dissecting the heterogeneity of "in the wild" stress from multimodal sensor data. NPJ Digit Med 2023; 6:237. [PMID: 38123810 PMCID: PMC10733336 DOI: 10.1038/s41746-023-00975-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 11/29/2023] [Indexed: 12/23/2023] Open
Abstract
Stress is associated with numerous chronic health conditions, both mental and physical. However, the heterogeneity of these associations at the individual level is poorly understood. While data generated from individuals in their day-to-day lives "in the wild" may best represent the heterogeneity of stress, gathering these data and separating signals from noise is challenging. In this work, we report findings from a major data collection effort using Digital Health Technologies (DHTs) and frontline healthcare workers. We provide insights into stress "in the wild", by using robust methods for its identification from multimodal data and quantifying its heterogeneity. Here we analyze data from the Stress and Recovery in Frontline COVID-19 Workers study following 365 frontline healthcare workers for 4-6 months using wearable devices and smartphone app-based measures. Causal discovery is used to learn how the causal structure governing an individual's self-reported symptoms and physiological features from DHTs differs between non-stress and potential stress states. Our methods uncover robust representations of potential stress states across a population of frontline healthcare workers. These representations reveal high levels of inter- and intra-individual heterogeneity in stress. We leverage multiple stress definitions that span different modalities (from subjective to physiological) to obtain a comprehensive view of stress, as these differing definitions rarely align in time. We show that these different stress definitions can be robustly represented as changes in the underlying causal structure on and off stress for individuals. This study is an important step toward better understanding potential underlying processes generating stress in individuals.
Collapse
Affiliation(s)
- Sujay Nagaraj
- Department of Computer Science, University of Toronto, Toronto, ON, Canada.
- Vector Institute, Toronto, ON, Canada.
- The Hospital for Sick Children, Toronto, ON, Canada.
| | - Sarah Goodday
- 4YouandMe, Seattle, WA, USA
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - Thomas Hartvigsen
- School of Data Science, University of Virginia, Charlottesville, VA, USA
| | | | - Kopal Garg
- Department of Computer Science, University of Toronto, Toronto, ON, Canada
- Vector Institute, Toronto, ON, Canada
- The Hospital for Sick Children, Toronto, ON, Canada
| | - Sindhu Gowda
- Department of Computer Science, University of Toronto, Toronto, ON, Canada
- Vector Institute, Toronto, ON, Canada
| | | | - Marzyeh Ghassemi
- Vector Institute, Toronto, ON, Canada
- Institute for Medical Engineering and Science, MIT, Cambridge, MA, USA
- Department of Electrical Engineering and Computer Science, MIT, Cambridge, MA, USA
| | | | - Anna Goldenberg
- Department of Computer Science, University of Toronto, Toronto, ON, Canada
- Vector Institute, Toronto, ON, Canada
- The Hospital for Sick Children, Toronto, ON, Canada
- Canadian Institute for Advanced Research, Toronto, ON, Canada
- Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, ON, Canada
| |
Collapse
|
11
|
Vos G, Trinh K, Sarnyai Z, Rahimi Azghadi M. Ensemble machine learning model trained on a new synthesized dataset generalizes well for stress prediction using wearable devices. J Biomed Inform 2023; 148:104556. [PMID: 38048895 DOI: 10.1016/j.jbi.2023.104556] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2022] [Revised: 11/16/2023] [Accepted: 11/24/2023] [Indexed: 12/06/2023]
Abstract
INTRODUCTION Advances in wearable sensor technology have enabled the collection of biomarkers that may correlate with levels of elevated stress. While significant research has been done in this domain, specifically in using machine learning to detect elevated levels of stress, the challenge of producing a machine learning model capable of generalizing well for use on new, unseen data remain. Acute stress response has both subjective, psychological and objectively measurable, biological components that can be expressed differently from person to person, further complicating the development of a generic stress measurement model. Another challenge is the lack of large, publicly available datasets labeled for stress response that can be used to develop robust machine learning models. In this paper, we first investigate the generalization ability of models built on datasets containing a small number of subjects, recorded in single study protocols. Next, we propose and evaluate methods combining these datasets into a single, large dataset to study the generalization capability of machine learning models built on larger datasets. Finally, we propose and evaluate the use of ensemble techniques by combining gradient boosting with an artificial neural network to measure predictive power on new, unseen data. In favor of reproducible research and to assist the community advance the field, we make all our experimental data and code publicly available through Github at https://github.com/xalentis/Stress. This paper's in-depth study of machine learning model generalization for stress detection provides an important foundation for the further study of stress response measurement using sensor biomarkers, recorded with wearable technologies. METHODS Sensor biomarker data from six public datasets were utilized in this study. Exploratory data analysis was performed to understand the physiological variance between study subjects, and the complexity it introduces in building machine learning models capable of detecting elevated levels of stress on new, unseen data. To test model generalization, we developed a gradient boosting model trained on one dataset (SWELL), and tested its predictive power on two datasets previously used in other studies (WESAD, NEURO). Next, we merged four small datasets, i.e. (SWELL, NEURO, WESAD, UBFC-Phys), to provide a combined total of 99 subjects, and applied feature engineering to generate additional features utilizing statistical summaries, with sliding windows of 25 s. We name this large dataset, StressData. In addition, we utilized random sampling on StressData combined with another dataset (EXAM) to build a larger training dataset consisting of 200 synthesized subjects, which we name SynthesizedStressData. Finally, we developed an ensemble model that combines our gradient boosting model with an artificial neural network, and tested it using Leave-One-Subject-Out (LOSO) validation, and on two additional, unseen publicly available stress biomarker datasets (WESAD and Toadstool). RESULTS Our results show that previous models built on datasets containing a small number (<50) of subjects, recorded in single study protocols, cannot generalize well to new, unseen datasets. Our presented methodology for generating a large, synthesized training dataset by utilizing random sampling to construct scenarios closely aligned with experimental conditions demonstrate significant benefits. When combined with feature-engineering and ensemble learning, our method delivers a robust stress measurement system capable of achieving 85% predictive accuracy on new, unseen validation data, achieving a 25% performance improvement over single models trained on small datasets. The resulting model can be used as both a classification or regression predictor for estimating the level of perceived stress, when applied on specific sensor biomarkers recorded using a wearable device, while further allowing researchers to construct large, varied datasets for training machine learning models that closely emulate their exact experimental conditions. CONCLUSION Models trained on small, single study protocol datasets do not generalize well for use on new, unseen data and lack statistical power. Machine learning models trained on a dataset containing a larger number of varied study subjects capture physiological variance better, resulting in more robust stress detection. Feature-engineering assists in capturing these physiological variance, and this is further improved by utilizing ensemble techniques by combining the predictive power of different machine learning models, each capable of learning unique signals contained within the data. While there is a general lack of large, labeled public datasets that can be utilized for training machine learning models capable of accurately measuring levels of acute stress, random sampling techniques can successfully be applied to construct larger, varied datasets from these smaller sample datasets, for building robust machine learning models.
Collapse
Affiliation(s)
- Gideon Vos
- College of Science and Engineering, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia
| | - Kelly Trinh
- College of Science and Engineering, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia
| | - Zoltan Sarnyai
- College of Public Health, Medical, and Vet Sciences, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia
| | - Mostafa Rahimi Azghadi
- College of Science and Engineering, James Cook University, James Cook Dr, Townsville, 4811, QLD, Australia.
| |
Collapse
|
12
|
Saylam B, İncel ÖD. Quantifying Digital Biomarkers for Well-Being: Stress, Anxiety, Positive and Negative Affect via Wearable Devices and Their Time-Based Predictions. SENSORS (BASEL, SWITZERLAND) 2023; 23:8987. [PMID: 37960685 PMCID: PMC10649682 DOI: 10.3390/s23218987] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 10/27/2023] [Accepted: 11/03/2023] [Indexed: 11/15/2023]
Abstract
Wearable devices have become ubiquitous, collecting rich temporal data that offers valuable insights into human activities, health monitoring, and behavior analysis. Leveraging these data, researchers have developed innovative approaches to classify and predict time-based patterns and events in human life. Time-based techniques allow the capture of intricate temporal dependencies, which is the nature of the data coming from wearable devices. This paper focuses on predicting well-being factors, such as stress, anxiety, and positive and negative affect, on the Tesserae dataset collected from office workers. We examine the performance of different methodologies, including deep-learning architectures, LSTM, ensemble techniques, Random Forest (RF), and XGBoost, and compare their performances for time-based and non-time-based versions. In time-based versions, we investigate the effect of previous records of well-being factors on the upcoming ones. The overall results show that time-based LSTM performs the best among conventional (non-time-based) RF, XGBoost, and LSTM. The performance even increases when we consider a more extended previous period, in this case, 3 past-days rather than 1 past-day to predict the next day. Furthermore, we explore the corresponding biomarkers for each well-being factor using feature ranking. The obtained rankings are compatible with the psychological literature. In this work, we validated them based on device measurements rather than subjective survey responses.
Collapse
Affiliation(s)
- Berrenur Saylam
- Computer Engineering Department, Boğaziçi University, 34342 İstanbul, Türkiye;
| | | |
Collapse
|
13
|
Bhatt P, Sethi A, Tasgaonkar V, Shroff J, Pendharkar I, Desai A, Sinha P, Deshpande A, Joshi G, Rahate A, Jain P, Walambe R, Kotecha K, Jain NK. Machine learning for cognitive behavioral analysis: datasets, methods, paradigms, and research directions. Brain Inform 2023; 10:18. [PMID: 37524933 PMCID: PMC10390406 DOI: 10.1186/s40708-023-00196-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Accepted: 06/06/2023] [Indexed: 08/02/2023] Open
Abstract
Human behaviour reflects cognitive abilities. Human cognition is fundamentally linked to the different experiences or characteristics of consciousness/emotions, such as joy, grief, anger, etc., which assists in effective communication with others. Detection and differentiation between thoughts, feelings, and behaviours are paramount in learning to control our emotions and respond more effectively in stressful circumstances. The ability to perceive, analyse, process, interpret, remember, and retrieve information while making judgments to respond correctly is referred to as Cognitive Behavior. After making a significant mark in emotion analysis, deception detection is one of the key areas to connect human behaviour, mainly in the forensic domain. Detection of lies, deception, malicious intent, abnormal behaviour, emotions, stress, etc., have significant roles in advanced stages of behavioral science. Artificial Intelligence and Machine learning (AI/ML) has helped a great deal in pattern recognition, data extraction and analysis, and interpretations. The goal of using AI and ML in behavioral sciences is to infer human behaviour, mainly for mental health or forensic investigations. The presented work provides an extensive review of the research on cognitive behaviour analysis. A parametric study is presented based on different physical characteristics, emotional behaviours, data collection sensing mechanisms, unimodal and multimodal datasets, modelling AI/ML methods, challenges, and future research directions.
Collapse
Affiliation(s)
- Priya Bhatt
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Amanrose Sethi
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Vaibhav Tasgaonkar
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Jugal Shroff
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Isha Pendharkar
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Aditya Desai
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Pratyush Sinha
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Aditya Deshpande
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Gargi Joshi
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Anil Rahate
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India
| | - Priyanka Jain
- Centre for Development of Advanced Computing (C-DAC), Delhi, India
| | - Rahee Walambe
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India.
- Symbiosis Centre for Applied Artificial Intelligence, Symbiosis International Deemed University, Pune, India.
| | - Ketan Kotecha
- Symbiosis Institute of Technology, Symbiosis International Deemed University, Pune, India.
- Symbiosis Centre for Applied Artificial Intelligence, Symbiosis International Deemed University, Pune, India.
- UCSI University, Kuala Lumpur, Malaysia.
| | - N K Jain
- Centre for Development of Advanced Computing (C-DAC), Delhi, India
| |
Collapse
|
14
|
Paromita P, Mundnich K, Nadarajan A, Booth BM, Narayanan SS, Chaspari T. Modeling inter-individual differences in ambulatory-based multimodal signals via metric learning: a case study of personalized well-being estimation of healthcare workers. Front Digit Health 2023; 5:1195795. [PMID: 37363272 PMCID: PMC10289192 DOI: 10.3389/fdgth.2023.1195795] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2023] [Accepted: 05/22/2023] [Indexed: 06/28/2023] Open
Abstract
Introduction Intelligent ambulatory tracking can assist in the automatic detection of psychological and emotional states relevant to the mental health changes of professionals with high-stakes job responsibilities, such as healthcare workers. However, well-known differences in the variability of ambulatory data across individuals challenge many existing automated approaches seeking to learn a generalizable means of well-being estimation. This paper proposes a novel metric learning technique that improves the accuracy and generalizability of automated well-being estimation by reducing inter-individual variability while preserving the variability pertaining to the behavioral construct. Methods The metric learning technique implemented in this paper entails learning a transformed multimodal feature space from pairwise similarity information between (dis)similar samples per participant via a Siamese neural network. Improved accuracy via personalization is further achieved by considering the trait characteristics of each individual as additional input to the metric learning models, as well as individual trait base cluster criteria to group participants followed by training a metric learning model for each group. Results The outcomes of the proposed models demonstrate significant improvement over the other inter-individual variability reduction and deep neural baseline methods for stress, anxiety, positive affect, and negative affect. Discussion This study lays the foundation for accurate estimation of psychological and emotional states in realistic and ambulatory environments leading to early diagnosis of mental health changes and enabling just-in-time adaptive interventions.
Collapse
Affiliation(s)
- Projna Paromita
- HUman Bio-Behavioral Signals Lab, Texas A & M University, College Station, TX, United States
| | - Karel Mundnich
- Signal Analysis and Interpretation Laboratory, University of Southern California, Los Angeles, CA, United States
| | - Amrutha Nadarajan
- Signal Analysis and Interpretation Laboratory, University of Southern California, Los Angeles, CA, United States
| | - Brandon M. Booth
- Signal Analysis and Interpretation Laboratory, University of Southern California, Los Angeles, CA, United States
| | - Shrikanth S. Narayanan
- Signal Analysis and Interpretation Laboratory, University of Southern California, Los Angeles, CA, United States
| | - Theodora Chaspari
- HUman Bio-Behavioral Signals Lab, Texas A & M University, College Station, TX, United States
| |
Collapse
|
15
|
Talaat FM, El-Balka RM. Stress monitoring using wearable sensors: IoT techniques in medical field. Neural Comput Appl 2023; 35:1-14. [PMID: 37362562 PMCID: PMC10237081 DOI: 10.1007/s00521-023-08681-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Accepted: 05/10/2023] [Indexed: 06/28/2023]
Abstract
The concept "Internet of Things" (IoT), which facilitates communication between linked devices, is relatively new. It refers to the next generation of the Internet. IoT supports healthcare and is essential to numerous applications for tracking medical services. By examining the pattern of observed parameters, the type of the disease can be anticipated. For people with a range of diseases, health professionals and technicians have developed an excellent system that employs commonly utilized techniques like wearable technology, wireless channels, and other remote equipment to give low-cost healthcare monitoring. Whether put in living areas or worn on the body, network-related sensors gather detailed data to evaluate the patient's physical and mental health. The main objective of this study is to examine the current e-health monitoring system using integrated systems. Automatically providing patients with a prescription based on their status is the main goal of the e-health monitoring system. The doctor can keep an eye on the patient's health without having to communicate with them. The purpose of the study is to examine how IoT technologies are applied in the medical industry and how they help to raise the bar of healthcare delivered by healthcare institutions. The study will also include the uses of IoT in the medical area, the degree to which it is used to enhance conventional practices in various health fields, and the degree to which IoT may raise the standard of healthcare services. The main contributions in this paper are as follows: (1) importing signals from wearable devices, extracting signals from non-signals, performing peak enhancement; (2) processing and analyzing the incoming signals; (3) proposing a new stress monitoring algorithm (SMA) using wearable sensors; (4) comparing between various ML algorithms; (5) the proposed stress monitoring algorithm (SMA) is composed of four main phases: (a) data acquisition phase, (b) data and signal processing phase, (c) prediction phase, and (d) model performance evaluation phase; and (6) grid search is used to find the optimal values for hyperparameters of SVM (C and gamma). From the findings, it is shown that random forest is best suited for this classification, with decision tree and XGBoost following closely behind.
Collapse
Affiliation(s)
- Fatma M. Talaat
- Faculty of Artificial Intelligence, Kafrelsheikh University, Kafrelsheikh, Egypt
| | - Rana Mohamed El-Balka
- Computers and Control Systems Engineering Department, Faculty of Engineering, Mansoura University, Mansoura, Egypt
| |
Collapse
|
16
|
Klimek A, Mannheim I, Schouten G, Wouters EJM, Peeters MWH. Wearables measuring electrodermal activity to assess perceived stress in care: a scoping review. Acta Neuropsychiatr 2023; 37:e19. [PMID: 36960675 DOI: 10.1017/neu.2023.19] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/25/2023]
Abstract
BACKGROUND Chronic stress responses can lead to physical and behavioural health problems, often experienced and observed in the care of people with intellectual disabilities or people with dementia. Electrodermal activity (EDA) is a bio-signal for stress, which can be measured by wearables and thereby support stress management. However, the how, when and to what extent patients and healthcare providers can benefit is unclear. This study aims to create an overview of available wearables enabling the detection of perceived stress by using EDA. METHODS Following the PRISMA-SCR protocol for scoping reviews, four databases were included in the search of peer-reviewed studies published between 2012 and 2022, reporting detection of EDA in relation to self-reported stress or stress-related behaviours. Type of wearable, bodily location, research population, context, stressor type and the reported relationship between EDA and perceived stress were extracted. RESULTS Of the 74 included studies, the majority included healthy subjects in laboratory situations. Field studies and studies using machine learning (ML) to predict stress have increased in the last years. EDA is most often measured on the wrist, with offline data processing. Studies predicting perceived stress or stress-related behaviour using EDA features, reported accuracies between 42% and 100% with an average of 82.6%. Of these studies, the majority used ML. CONCLUSION Wearable EDA sensors are promising in detecting perceived stress. Field studies with relevant populations in a health or care context are lacking. Future studies should focus on the application of EDA-measuring wearables in real-life situations to support stress management.
Collapse
Affiliation(s)
- Agata Klimek
- School for Allied Health Professions, Fontys University of Applied Sciences, Eindhoven, The Netherlands
| | - Ittay Mannheim
- School for Allied Health Professions, Fontys University of Applied Sciences, Eindhoven, The Netherlands
- Tranzo, School of Social and Behavioural Sciences, Tilburg University, Tilburg, The Netherlands
| | - Gerard Schouten
- School for Information & Communication Technology, Fontys University of Applied Sciences, Eindhoven, The Netherlands
| | - Eveline J M Wouters
- School for Allied Health Professions, Fontys University of Applied Sciences, Eindhoven, The Netherlands
- Tranzo, School of Social and Behavioural Sciences, Tilburg University, Tilburg, The Netherlands
| | - Manon W H Peeters
- School for Allied Health Professions, Fontys University of Applied Sciences, Eindhoven, The Netherlands
| |
Collapse
|
17
|
Saravanan P, Nisar T, Zhang Q, Masud F, Sasangohar F. Occupational stress and burnout among intensive care unit nurses during the pandemic: A prospective longitudinal study of nurses in COVID and non-COVID units. Front Psychiatry 2023; 14:1129268. [PMID: 36993929 PMCID: PMC10040835 DOI: 10.3389/fpsyt.2023.1129268] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Accepted: 02/20/2023] [Indexed: 03/14/2023] Open
Abstract
Background Intensive care unit (ICU) nurses are highly prone to occupational stress and burnout, affecting their physical and mental health. The occurrence of the pandemic and related events increased nurses' workload and further exacerbated their stress and burnout. This work investigates occupational stress and burnout experienced by ICU nurses working with COVID and non-COVID patients. Method A prospective longitudinal mixed-methods study was conducted with a cohort of ICU nurses working in medical ICU (COVID unit; n = 14) and cardiovascular ICU (non-COVID unit; n = 5). Each participant was followed for six 12-h shifts. Data on occupational stress and burnout prevalence were collected using validated questionnaires. Physiological indices of stress were collected using wrist-worn wearable technologies. Participants elaborated on the causes of stress experienced each shift by completing open-ended questions. Data were analyzed using statistical and qualitative methods. Results Participants caring for COVID patients at the COVID unit were 3.71 times more likely to experience stress (p < 0.001) in comparison to non-COVID unit participants. No differences in stress levels were found when the same participants worked with COVID and non-COVID patients at different shifts (p = 0.58) at the COVID unit. The cohorts expressed similar contributors to stress, based in communication tasks, patient acuity, clinical procedures, admission processes, proning, labs, and assisting coworkers. Conclusion Nurses in COVID units, irrespective of whether they care for a COVID patient, experience occupational stress and burnout.
Collapse
Affiliation(s)
- Pratima Saravanan
- Center for Health Data Science and Analytics, Houston Methodist, Houston, TX, United States
| | - Tariq Nisar
- Center for Health Data Science and Analytics, Houston Methodist, Houston, TX, United States
| | - Qian Zhang
- Center for Health Data Science and Analytics, Houston Methodist, Houston, TX, United States
| | - Faisal Masud
- Department of Anesthesiology and Critical Care, Houston Methodist DeBakey Heart and Vascular Center, Houston Methodist, Houston, TX, United States
| | - Farzan Sasangohar
- Center for Health Data Science and Analytics, Houston Methodist, Houston, TX, United States
- Department of Industrial and Systems Engineering, Texas A&M College of Engineering, Texas A&M University, College Station, TX, United States
| |
Collapse
|
18
|
Vera-Ortega P, Vázquez-Martín R, Fernandez-Lozano JJ, García-Cerezo A, Mandow A. Enabling Remote Responder Bio-Signal Monitoring in a Cooperative Human-Robot Architecture for Search and Rescue. SENSORS (BASEL, SWITZERLAND) 2022; 23:49. [PMID: 36616647 PMCID: PMC9823914 DOI: 10.3390/s23010049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Revised: 12/16/2022] [Accepted: 12/19/2022] [Indexed: 06/17/2023]
Abstract
The roles of emergency responders are challenging and often physically demanding, so it is essential that their duties are performed safely and effectively. In this article, we address real-time bio-signal sensor monitoring for responders in disaster scenarios. In particular, we propose the integration of a set of health monitoring sensors suitable for detecting stress, anxiety and physical fatigue in an Internet of Cooperative Agents architecture for search and rescue (SAR) missions (SAR-IoCA), which allows remote control and communication between human and robotic agents and the mission control center. With this purpose, we performed proof-of-concept experiments with a bio-signal sensor suite worn by firefighters in two high-fidelity SAR exercises. Moreover, we conducted a survey, distributed to end-users through the Fire Brigade consortium of the Provincial Council of Málaga, in order to analyze the firefighters' opinion about biological signals monitoring while on duty. As a result of this methodology, we propose a wearable sensor suite design with the aim of providing some easy-to-wear integrated-sensor garments, which are suitable for emergency worker activity. The article offers discussion of user acceptance, performance results and learned lessons.
Collapse
|
19
|
Iqbal T, Simpkin AJ, Roshan D, Glynn N, Killilea J, Walsh J, Molloy G, Ganly S, Ryman H, Coen E, Elahi A, Wijns W, Shahzad A. Stress Monitoring Using Wearable Sensors: A Pilot Study and Stress-Predict Dataset. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22218135. [PMID: 36365837 PMCID: PMC9654418 DOI: 10.3390/s22218135] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/03/2022] [Revised: 10/15/2022] [Accepted: 10/20/2022] [Indexed: 05/14/2023]
Abstract
With the recent advancements in the field of wearable technologies, the opportunity to monitor stress continuously using different physiological variables has gained significant interest. The early detection of stress can help improve healthcare and minimizes the negative impact of long-term stress. This paper reports outcomes of a pilot study and associated stress-monitoring dataset, named the "Stress-Predict Dataset", created by collecting physiological signals from healthy subjects using wrist-worn watches with a photoplethysmogram (PPG) sensor. While wearing these watches, 35 healthy volunteers underwent a series of tasks (i.e., Stroop color test, Trier Social Stress Test and Hyperventilation Provocation Test), along with a rest period in-between each task. They also answered questionnaires designed to induce stress levels compatible with daily life. The changes in the blood volume pulse (BVP) and heart rate were recorded by the watch and were labelled as occurring during stress-inducing tasks or a rest period (no stress). Additionally, respiratory rate was estimated using the BVP signal. Statistical models and personalised adaptive reference ranges were used to determine the utility of the proposed stressors and the extracted variables (heart rate and respiratory rate). The analysis showed that the interview session was the most significant stress stimulus, causing a significant variation in heart rate of 27 (77%) participants and respiratory rate of 28 (80%) participants out of 35. The outcomes of this study contribute to the understanding the role of stressors and their association with physiological response and provide a dataset to help develop new wearable solutions for more reliable, valid, and sensitive physio-logical stress monitoring.
Collapse
Affiliation(s)
- Talha Iqbal
- Smart Sensor Laboratory, Lambe Institute of Translational Research, College of Medicine, Nursing Health Sciences, University of Galway, H91 TK33 Galway, Ireland
- Correspondence:
| | - Andrew J. Simpkin
- School of Mathematical and Statistical Sciences, University of Galway, H91 TK33 Galway, Ireland
| | - Davood Roshan
- School of Mathematical and Statistical Sciences, University of Galway, H91 TK33 Galway, Ireland
- CÚRAM Center for Research in Medical Devices, University of Galway, H91 W2TY Galway, Ireland
| | - Nicola Glynn
- Smart Sensor Laboratory, Lambe Institute of Translational Research, College of Medicine, Nursing Health Sciences, University of Galway, H91 TK33 Galway, Ireland
| | - John Killilea
- Smart Sensor Laboratory, Lambe Institute of Translational Research, College of Medicine, Nursing Health Sciences, University of Galway, H91 TK33 Galway, Ireland
| | - Jane Walsh
- School of Psychology, University of Galway, H91 TK33 Galway, Ireland
| | - Gerard Molloy
- School of Psychology, University of Galway, H91 TK33 Galway, Ireland
| | - Sandra Ganly
- Smart Sensor Laboratory, Lambe Institute of Translational Research, College of Medicine, Nursing Health Sciences, University of Galway, H91 TK33 Galway, Ireland
| | - Hannah Ryman
- Smart Sensor Laboratory, Lambe Institute of Translational Research, College of Medicine, Nursing Health Sciences, University of Galway, H91 TK33 Galway, Ireland
| | - Eileen Coen
- Smart Sensor Laboratory, Lambe Institute of Translational Research, College of Medicine, Nursing Health Sciences, University of Galway, H91 TK33 Galway, Ireland
| | - Adnan Elahi
- Electrical and Electronic Engineering, University of Galway, H91 TK33 Galway, Ireland
| | - William Wijns
- Smart Sensor Laboratory, Lambe Institute of Translational Research, College of Medicine, Nursing Health Sciences, University of Galway, H91 TK33 Galway, Ireland
- CÚRAM Center for Research in Medical Devices, University of Galway, H91 W2TY Galway, Ireland
| | - Atif Shahzad
- Smart Sensor Laboratory, Lambe Institute of Translational Research, College of Medicine, Nursing Health Sciences, University of Galway, H91 TK33 Galway, Ireland
- Centre for Systems Modelling and Quantitative Biomedicine (SMQB), University of Birmingham, Birmingham B15 2TT, UK
| |
Collapse
|