Exploring Physiological Signal Responses to Traffic-Related Stress in Simulated Driving

Advanced Necklace for Real-Time PPG Monitoring in Drivers

Monitoring heart rate (HR) through photoplethysmography (PPG) signals is a challenging task due to the complexities involved, even during routine daily activities. These signals can indeed be heavily contaminated by significant motion artifacts resulting from the subjects' movements, which can lead to inaccurate heart rate estimations. In this paper, our objective is to present an innovative necklace sensor that employs low-computational-cost algorithms for heart rate estimation in individuals performing non-abrupt movements, specifically drivers. Our solution facilitates the acquisition of signals with limited motion artifacts and provides acceptable heart rate estimations at a low computational cost. More specifically, we propose a wearable sensor necklace for assessing a driver's well-being by providing information about the driver's physiological condition and potential stress indicators through HR data. This innovative necklace enables real-time HR monitoring within a sleek and ergonomic design, facilitating seamless and continuous data gathering while driving. Prioritizing user comfort, the necklace's design ensures ease of wear, allowing for extended use without disrupting driving activities. The collected physiological data can be transmitted wirelessly to a mobile application for instant analysis and visualization. To evaluate the sensor's performance, two algorithms for estimating the HR from PPG signals are implemented in a microcontroller: a modified version of the mountaineer's algorithm and a sliding discrete Fourier transform. The goal of these algorithms is to detect meaningful peaks corresponding to each heartbeat by using signal processing techniques to remove noise and motion artifacts. The developed design is validated through experiments conducted in a simulated driving environment in our lab, during which drivers wore the sensor necklace. These experiments demonstrate the reliability of the wearable sensor necklace in capturing dynamic changes in HR levels associated with driving-induced stress. The algorithms integrated into the sensor are optimized for low computational cost and effectively remove motion artifacts that occur when users move their heads.

Drivers' Mental Engagement Analysis Using Multi-Sensor Fusion Approaches Based on Deep Convolutional Neural Networks

In this paper, we present a comprehensive assessment of individuals' mental engagement states during manual and autonomous driving scenarios using a driving simulator. Our study employed two sensor fusion approaches, combining the data and features of multimodal signals. Participants in our experiment were equipped with Electroencephalogram (EEG), Skin Potential Response (SPR), and Electrocardiogram (ECG) sensors, allowing us to collect their corresponding physiological signals. To facilitate the real-time recording and synchronization of these signals, we developed a custom-designed Graphical User Interface (GUI). The recorded signals were pre-processed to eliminate noise and artifacts. Subsequently, the cleaned data were segmented into 3 s windows and labeled according to the drivers' high or low mental engagement states during manual and autonomous driving. To implement sensor fusion approaches, we utilized two different architectures based on deep Convolutional Neural Networks (ConvNets), specifically utilizing the Braindecode Deep4 ConvNet model. The first architecture consisted of four convolutional layers followed by a dense layer. This model processed the synchronized experimental data as a 2D array input. We also proposed a novel second architecture comprising three branches of the same ConvNet model, each with four convolutional layers, followed by a concatenation layer for integrating the ConvNet branches, and finally, two dense layers. This model received the experimental data from each sensor as a separate 2D array input for each ConvNet branch. Both architectures were evaluated using a Leave-One-Subject-Out (LOSO) cross-validation approach. For both cases, we compared the results obtained when using only EEG signals with the results obtained by adding SPR and ECG signals. In particular, the second fusion approach, using all sensor signals, achieved the highest accuracy score, reaching 82.0%. This outcome demonstrates that our proposed architecture, particularly when integrating EEG, SPR, and ECG signals at the feature level, can effectively discern the mental engagement of drivers.

Driver Attention Assessment Using Physiological Measures from EEG, ECG, and EDA Signals

In this paper, we consider the evaluation of the mental attention state of individuals driving in a simulated environment. We tested a pool of subjects while driving on a highway and trying to overcome various obstacles placed along the course in both manual and autonomous driving scenarios. Most systems described in the literature use cameras to evaluate features such as blink rate and gaze direction. In this study, we instead analyse the subjects' Electrodermal activity (EDA) Skin Potential Response (SPR), their Electrocardiogram (ECG), and their Electroencephalogram (EEG). From these signals we extract a number of physiological measures, including eye blink rate and beta frequency band power from EEG, heart rate from ECG, and SPR features, then investigate their capability to assess the mental state and engagement level of the test subjects. In particular, and as confirmed by statistical tests, the signals reveal that in the manual scenario the subjects experienced a more challenged mental state and paid higher attention to driving tasks compared to the autonomous scenario. A different experiment in which subjects drove in three different setups, i.e., a manual driving scenario and two autonomous driving scenarios characterized by different vehicle settings, confirmed that manual driving is more mentally demanding than autonomous driving. Therefore, we can conclude that the proposed approach is an appropriate way to monitor driver attention.

Early Life Stress Detection Using Physiological Signals and Machine Learning Pipelines

Pregnancy and early childhood are two vulnerable times when immunological plasticity is at its peak and exposure to stress may substantially raise health risks. However, to separate the effects of adversity during vulnerable times of the lifetime from those across the entire lifespan, we require deeper phenotyping. Stress is one of the challenges which everyone can face with this issue. It is a type of feeling which contains mental pressure and comes from daily life matters. There are many research and investments regarding this problem to overcome or control this complication. Pregnancy is a susceptible period for the child and the mother taking stress can affect the child's health after birth. The following matter can happen based on natural disasters, war, death or separation of parents, etc. Early Life Stress (ELS) has a connection with psychological development and metabolic and cardiovascular diseases. In the following research, the main focus is on Early Life Stress control during pregnancy of a healthy group of women that are at risk of future disease during their pregnancy. This study looked at the relationship between retrospective recollections of childhood or pregnancy hardship and inflammatory imbalance in a group of 53 low-income, ethnically diverse women who were seeking family-based trauma treatment after experiencing interpersonal violence. Machine learning Convolutional Neural Networks (CNNs) are applied for stress detection using short-term physiological signals in terms of non-linear and for a short term. The focus concepts are heart rate, and hand and foot galvanic skin response.

Analysis of Physiological Signals for Stress Recognition with Different Car Handling Setups

When designing a car, the vehicle dynamics and handling are important aspects, as they can satisfy a purpose in professional racing, as well as contributing to driving pleasure and safety, real and perceived, in regular drivers. In this paper, we focus on the assessment of the emotional response in drivers while they are driving on a track with different car handling setups. The experiments were performed using a dynamic professional simulator prearranged with different car setups. We recorded various physiological signals, allowing us to analyze the response of the drivers and analyze which car setup is more influential in terms of stress arising in the subjects. We logged two skin potential responses (SPRs), the electrocardiogram (ECG) signal, and eye tracking information. In the experiments, three car setups were used (neutral, understeering, and oversteering). To evaluate how these affect the drivers, we analyzed their physiological signals using two statistical tests (t-test and Wilcoxon test) and various machine learning (ML) algorithms. The results of the Wilcoxon test show that SPR signals provide higher statistical significance when evaluating stress among different drivers, compared to the ECG and eye tracking signals. As for the ML classifiers, we count the number of positive or “stress” labels of 15 s SPR time intervals for each subject and each particular car setup. With the support vector machine classifier, the mean value of the number of positive labels for the four subjects is equal to 13.13% for the base setup, 44.16% for the oversteering setup, and 39.60% for the understeering setup. In the end, our findings show that the base car setup appears to be the least stressful, and that our system enables us to effectively recognize stress while the subjects are driving in the different car configurations.