Using Smartbands, Pupillometry and Body Motion to Detect Discomfort in Automated Driving

A Teenager Physical Fitness Evaluation Model Based on 1D-CNN with LSTM and Wearable Running PPG Recordings

People attach greater importance to the physical health of teenagers because adolescence is a critical period for the healthy development of the human body. With the progress of biosensing technologies and artificial intelligence, it is feasible to apply wearable devices to continuously record teenagers’ physiological signals and make analyses based on modern advanced methods. To solve the challenge that traditional methods of monitoring teenagers’ physical fitness lack accurate computational models and in-depth data analyses, we propose a novel evaluation model for predicting the physical fitness of teenagers. First, we collected 1024 teenagers’ PPGs under the guidance of the proposed three-stage running paradigm. Next, we applied the median filter and wavelet transform to denoise the original signals and obtain HR and SpO₂. Then, we used the Pearson correlation coefficient method to finalize the feature set, based on the extracted nine physical features. Finally, we built a 1D-CNN with LSTM model to classify teenagers’ physical fitness condition into four levels: excellent, good, medium, and poor, with an accuracy of 98.27% for boys’ physical fitness prediction, and 99.26% for girls’ physical fitness prediction. The experimental results provide evidence supporting the feasibility of predicting teenagers’ physical fitness levels by their running PPG recordings.

Detecting driver stress and hazard anticipation using real-time cardiac measurement: A simulator study

OBJECTIVES

In the context of growing interest in real-time driver stress detection systems, we question the value of using heart rate change over short time periods to detect driver stress and hazard anticipation.

METHODS

To this end, we explored changes in heart rate and speed as well as perceived stress in 27 drivers in a driving simulator. Driver stress was triggered by using hazardous road events, while hazard anticipation was manipulated using three levels of hazard predictability: unpredictable (U), predictable (P), and predictable and familiar (PF).

RESULTS

The main results indicate that using heart rate change (1) is a good indicator for detecting driver stress in real time, (2) provides a cardiac signature of hazard anticipation, and (3) was affected by perceived stress groups. Further investigation is needed to validate the lack of relationship between increased anticipation/predictability and strengthened cardiac signature.

CONCLUSIONS

These results support the use of heart rate change as an indicator of real-time driver stress and hazard anticipation.

An Integrated Model for User State Detection of Subjective Discomfort in Autonomous Vehicles

The quickly rising development of autonomous vehicle technology and increase of (semi-) autonomous vehicles on the road leads to an increased demand for more sophisticated human–machine-cooperation approaches to improve trust and acceptance of these new systems. In this work, we investigate the feeling of discomfort of human passengers while driving autonomously and the automatic detection of this discomfort with several model approaches, using the combination of different data sources. Based on a driving simulator study, we analyzed the discomfort reports of 50 participants for autonomous inner city driving. We found that perceived discomfort depends on the driving scenario (with discomfort generally peaking in complex situations) and on the passenger (resulting in interindividual differences in reported discomfort extend and duration). Further, we describe three different model approaches on how to predict the passenger discomfort using data from the vehicle’s sensors as well as physiological and behavioral data from the passenger. The model’s precision varies greatly across the approaches, the best approach having a precision of up to 80%. All of our presented model approaches use combinations of linear models and are thus fast, transparent, and safe. Lastly, we analyzed these models using the SHAP method, which enables explaining the models’ discomfort predictions. These explanations are used to infer the importance of our collected features and to create a scenario-based discomfort analysis. Our work demonstrates a novel approach on passenger state modelling with simple, safe, and transparent models and with explainable model predictions, which can be used to adapt the vehicles’ actions to the needs of the passenger.

The influence of experienced severe road traffic accidents on take-over reactions and non-driving-related tasks in an automated driving simulator study

Road traffic accidents (RTAs) are an ever-existing threat to all road users. Automated vehicles (AVs; SAE Level 3-5) are developed in many countries. They are promoted with numerous benefits such as increased safety yielding less RTAs, less congestion, less greenhouse gas emissions, and the possibility of enabling non-driving related tasks (NDRTs). However, there has been no study which has investigated different NDRT conditions, while comparing participants who experienced a severe RTA in the past with those who experienced no RTA. Therefore, we conducted a driving simulator study (N = 53) and compared two NDRT conditions (i.e., auditory-speech (ASD) vs. heads-up display (HUD)) and an accident (26 participants) with a non-accident group (27; between-subjects design). Although our results did not reveal any interaction effect, and no group difference between the accident and the non-accident group on NDRT, take-over request (TOR), and driving performance, we uncovered for both groups better performances for the HUD condition, whereas a lower cognitive workload was reported for the ASD condition. Nevertheless, there was no difference for technology trust between the two conditions. Albeit we observed higher self-ratings of PTSD symptoms for the accident than for the non-accident group, there were no group differences on depression and psychological resilience self-ratings. We conclude that severe RTA experiences do not undermine NDRT, TOR, and driving performance in a SAE Level 3 driving simulator study, although PTSD symptoms after an RTA may affect the psychological wellbeing.

Modeling Ethical and Operational Preferences in Automated Driving Systems

Whereas automated driving technology has made tremendous gains in the last decade, significant questions remain regarding its integration into society. Given its revolutionary nature, the use of automated driving systems (ADSs) is accompanied by myriad novel quandaries relating to both operational and ethical concerns that are relevant to numerous stakeholders (e.g., governments, manufacturers, and passengers). When considering any such problem, the ADS’s decision-making calculus is always a central component. This is true for concerns about public perception and trust to others regarding explainability and legal certainty. Therefore, in this manuscript, we set forth a general decision-analytic framework tailorable to multitudinous stakeholders. More specifically, we develop and validate a generic tree of ADS management objectives, explore potential attributes for their measurement, and provide multiattribute utility functions for implementation. Given the contention surrounding numerous ethical concerns in ADS operations, we explore how each of the aforementioned components can be tailored in accordance with the stakeholder’s desired ethical perspective. A simulation environment is developed upon which our framework is tested. Within this environment we illustrate how our approach can be leveraged by stakeholders to make strategic trade-offs regarding ADS behavior and to inform policymaking efforts. In so doing, our framework is demonstrated as a practical, tractable, and transparent means of modeling ADS decision making.

MEYE: Web App for Translational and Real-Time Pupillometry

Pupil dynamics alterations have been found in patients affected by a variety of neuropsychiatric conditions, including autism. Studies in mouse models have used pupillometry for phenotypic assessment and as a proxy for arousal. Both in mice and humans, pupillometry is noninvasive and allows for longitudinal experiments supporting temporal specificity; however, its measure requires dedicated setups. Here, we introduce a convolutional neural network that performs online pupillometry in both mice and humans in a web app format. This solution dramatically simplifies the usage of the tool for the nonspecialist and nontechnical operators. Because a modern web browser is the only software requirement, this choice is of great interest given its easy deployment and setup time reduction. The tested model performances indicate that the tool is sensitive enough to detect both locomotor-induced and stimulus-evoked pupillary changes, and its output is comparable to state-of-the-art commercial devices.

[Subjective certainty to increase the acceptance of automated and connected driving]

An important factor for the acceptance and thus the spread of automated and connected driving (ACD) is the degree of subjective uncertainty that users experience when interacting with automated vehicles. Subjective uncertainties always occur when people are not able to predict the further course of a situation or future events due to lack of experience or information. If such uncertainties occur during the use of automated vehicles, the development of trust and thus acceptance of this technology is impaired by the negative emotions accompanying subjective uncertainties. Within the AutoAkzept project (which full title translates to: Automation without uncertainty to increase the acceptance of automated and connected driving), solutions for user-focused automation have been developed that put vehicle occupants at the center of system development. User-focused systems take into account two basic human needs in human-machine interaction, the need to understand and the need to be understood. For this purpose, user-focused systems use different sensors to detect subjective uncertainties and their influencing factors in real time, integrate this information with context data and make adjustments that reduce subjective uncertainties. The systemic adaptations of user-focused systems follow a holistic approach that includes the levels of vehicle guidance, interior adaptation and information presentation as well as target guidance are included. By reducing or avoiding subjective uncertainties, the project developments contribute to a positive, comfortable user experience and help to increase the acceptance of ACD. This paper presents research results of AutoAkzept on the topics of user state and activity modelling as well as needs-based adaptation strategies, which represent key components for the implementation of user-focused automation.

Application of artificial intelligence in the dental field: A literature review

PURPOSE

The purpose of this study was to comprehensively review the literature regarding the application of artificial intelligence (AI) in the dental field,focusing on the evaluation criteria and architecture types.

STUDY SELECTION

Electronic databases (PubMed, Cochrane Library, Scopus) were searched. Full-text articles describing the clinical application of AI for the detection, diagnosis, and treatment of lesions and the AI method/architecture were included.

RESULTS

The primary search presented 422 studies from 1996 to 2019, and 58 studies were finally selected. Regarding the year of publication, the oldest study, which was reported in 1996, focused on "oral and maxillofacial surgery." Machine-learning architectures were employed in the selected studies, while approximately half of them (29/58) employed neural networks. Regarding the evaluation criteria, eight studies compared the results obtained by AI with the diagnoses formulated by dentists, while several studies compared two or more architectures in terms of performance. The following parameters were employed for evaluating the AI performance: accuracy, sensitivity, specificity, mean absolute error, root mean squared error, and area under the receiver operating characteristic curve.

CONCLUSIONS

Application of AI in the dental field has progressed; however, the criteria for evaluating the efficacy of AI have not been clarified. It is necessary to obtain better quality data for machine learning to achieve the effective diagnosis of lesions and suitable treatment planning.

Towards Mindless Stress Regulation in Advanced Driver Assistance Systems: A Systematic Review

Background: Stress can frequently occur in the driving context. Its cognitive effects can be deleterious and lead to uncomfortable or risky situations. While stress detection in this context is well developed, regulation using dedicated advanced driver-assistance systems (ADAS) is still emergent. Objectives: This systematic review focuses on stress regulation strategies that can be qualified as "subtle" or "mindless": the technology employed to perform regulation does not interfere with an ongoing task. The review goal is 2-fold: establishing the state of the art on such technological implementation in the driving context and identifying complementary technologies relying on subtle regulation that could be applied in driving. Methods: A systematic review was conducted using search operators previously identified through a concept analysis. The patents and scientific studies selected provide an overview of actual and potential mindless technology implementations. These are then analyzed from a scientific perspective. A classification of results was performed according to the different stages of emotion regulation proposed by the Gross model. Results: A total of 47 publications were retrieved, including 21 patents and 26 studies. Six of the studies investigated mindless stress regulation in the driving context. Patents implemented strategies mostly linked to attentional deployment, while studies tended to investigate response modulation strategies. Conclusions: This review allowed us to identify several ADAS relying on mindless computing technologies to reduce stress and better understand the underlying mechanisms allowing stress reduction. Further studies are necessary to better grasp the effect of mindless technologies on driving safety. However, we have established the feasibility of their implementation as ADAS and proposed directions for future research in this field.

Get Ready for Being Chauffeured : Passenger's Preferences and Trust While Being Driven by Human and Automation

OBJECTIVE

We investigated passenger's trust and preferences using subjective, qualitative, and psychophysiological measures while being driven either by human or automation in a field study and a driving simulator experiment.

BACKGROUND

The passenger's perspective has largely been neglected in autonomous driving research, although the change of roles from an active driver to a passive passenger is incontrovertible. Investigations of passenger's appraisals on self-driving vehicles often seem convoluted with active manual driving experiences instead of comparisons with being driven by humans.

METHOD

We conducted an exploratory field study using an autonomous research vehicle (N = 11) and a follow-up experimental driving simulation (N = 24). Participants were driven on the same course by a human and an autonomous agent sitting on a passenger seat. Skin conductance, trust, and qualitative characteristics of the perceived driving situation were assessed. In addition, the effect of driving style (defensive vs. sporty) was evaluated in the simulator.

RESULTS

Both investigations revealed a close relation between subjective trust ratings and skin conductance, with increased trust and by trend reduced arousal for human compared with automation in control. Even though driving behavior was equivalent in the simulator when being driven by human and automation, passengers most preferred and trusted the human-defensive driver.

CONCLUSION

Individual preferences for driving style and human or autonomous vehicle control influence trust and subjective driving characterizations.

APPLICATION

The findings are applicable in human-automation research, reminding to not neglect subjective attributions and psychophysiological reactions as a result of ascribed control duties in relation to specific execution characteristics.

Measuring Drivers’ Physiological Response to Different Vehicle Controllers in Highly Automated Driving (HAD): Opportunities for Establishing Real-Time Values of Driver Discomfort

This study investigated how driver discomfort was influenced by different types of automated vehicle (AV) controllers, compared to manual driving, and whether this response changed in different road environments, using heart-rate variability (HRV) and electrodermal activity (EDA). A total of 24 drivers were subjected to manual driving and four AV controllers: two modelled to depict “human-like” driving behaviour, one conventional lane-keeping assist controller, and a replay of their own manual drive. Each drive lasted for ~15 min and consisted of rural and urban environments, which differed in terms of average speed, road geometry and road-based furniture. Drivers showed higher skin conductance response (SCR) and lower HRV during manual driving, compared to the automated drives. There were no significant differences in discomfort between the AV controllers. SCRs and subjective discomfort ratings showed significantly higher discomfort in the faster rural environments, when compared to the urban environments. Our results suggest that SCR values are more sensitive than HRV-based measures to continuously evolving situations that induce discomfort. Further research may be warranted in investigating the value of this metric in assessing real-time driver discomfort levels, which may help improve acceptance of AV controllers.

Unobtrusive Health Monitoring in Private Spaces: The Smart Vehicle

Unobtrusive in-vehicle health monitoring has the potential to use the driving time to perform regular medical check-ups. This work intends to provide a guide to currently proposed sensor systems for in-vehicle monitoring and to answer, in particular, the questions: (1) Which sensors are suitable for in-vehicle data collection? (2) Where should the sensors be placed? (3) Which biosignals or vital signs can be monitored in the vehicle? (4) Which purposes can be supported with the health data? We reviewed retrospective literature systematically and summarized the up-to-date research on leveraging sensor technology for unobtrusive in-vehicle health monitoring. PubMed, IEEE Xplore, and Scopus delivered 959 articles. We firstly screened titles and abstracts for relevance. Thereafter, we assessed the entire articles. Finally, 46 papers were included and analyzed. A guide is provided to the currently proposed sensor systems. Through this guide, potential sensor information can be derived from the biomedical data needed for respective purposes. The suggested locations for the corresponding sensors are also linked. Fifteen types of sensors were found. Driver-centered locations, such as steering wheel, car seat, and windscreen, are frequently used for mounting unobtrusive sensors, through which some typical biosignals like heart rate and respiration rate are measured. To date, most research focuses on sensor technology development, and most application-driven research aims at driving safety. Health-oriented research on the medical use of sensor-derived physiological parameters is still of interest.