Can We Study Autonomous Driving Comfort in Moving-Base Driving Simulators? A Validation Study

Post-Takeover Proficiency in Conditionally Automated Driving: Understanding Stabilization Time with Driving and Physiological Signals

In the realm of conditionally automated driving, understanding the crucial transition phase after a takeover is paramount. This study delves into the concept of post-takeover stabilization by analyzing data recorded in two driving simulator experiments. By analyzing both driving and physiological signals, we investigate the time required for the driver to regain full control and adapt to the dynamic driving task following automation. Our findings show that the stabilization time varies between measured parameters. While the drivers achieved driving-related stabilization (winding, speed) in eight to ten seconds, physiological parameters (heart rate, phasic skin conductance) exhibited a prolonged response. By elucidating the temporal and cognitive dynamics underlying the stabilization process, our results pave the way for the development of more effective and user-friendly automated driving systems, ultimately enhancing safety and driving experience on the roads.

Modeling and Analysis of Human Comfort in Human-Robot Collaboration

The emergence and recent development of collaborative robots have introduced a safer and more efficient human-robot collaboration (HRC) manufacturing environment. Since the release of COBOTs, a great amount of research efforts have been focused on improving robot working efficiency, user safety, human intention detection, etc., while one significant factor-human comfort-has been frequently ignored. The comfort factor is critical to COBOT users due to its great impact on user acceptance. In previous studies, there is a lack of a mathematical-model-based approach to quantitatively describe and predict human comfort in HRC scenarios. Also, few studies have discussed the cases when multiple comfort factors take effect simultaneously. In this study, a multi-linear-regression-based general human comfort prediction model is proposed under human-robot collaboration scenarios, which is able to accurately predict the comfort levels of humans in multi-factor situations. The proposed method in this paper tackled these two gaps at the same time and also demonstrated the effectiveness of the approach with its high prediction accuracy. The overall average accuracy among all participants is 81.33%, while the overall maximum value is 88.94%, and the overall minimum value is 72.53%. The model uses subjective comfort rating feedback from human subjects as training and testing data. Experiments have been implemented, and the final results proved the effectiveness of the proposed approach in identifying human comfort levels in HRC.

Validation of a moving base driving simulator for motion sickness research

Increasing levels of vehicle automation are envisioned to allow drivers to engage in other activities but are also likely to increase the incidence of Carsickness or Motion Sickness (MS). Ideally, MS is studied in a safe and controlled environment, such as a driving simulator. However, only few studies address the suitability of driving simulators to assess MS. In this study, we validate a moving base driving simulator for MS research by comparing the symptoms and time course of MS between a real-road driving scenario and a rendition of this scenario in a driving simulator, using a within-subjects design. 25 participants took part as passengers in an experiment with alternating sections (slaloming, stop-and-go) with normal and provocative driving styles. Participants performed Sudoku puzzles (eyes-off-road) during both scenarios and reported MIsery SCale (MISC) scores at 30 s intervals. Motion Sickness Assessment Questionnaire (MSAQ) scores were collected upon completion of either scenario. Overall, the results indicate that MS was more severe in the car than in the simulator. Nevertheless, significant correlations were found between individual MS in the car and simulator for 3 out of 4 MSAQ symptom categories (0.48 < r < 0.73, p < 0.02), with a strong overall correlation (r = 0.57, p = 0.004). MS onset times were similar between the car and the simulator, and sickness fluctuations as a result of driving style showed a similar pattern between scenarios, albeit more pronounced in the car. Based on observed similarities in MS, we conclude these simulator results to have relative validity. We attribute the observed reduction of MS severity in the simulator to the downscaling of the motion by the Motion Cueing Algorithm (MCA). These results suggest that, at least in eyes-off-road conditions, findings on MS from simulator studies may generalize to real vehicles after application of a conversion factor. This conversion factor is likely to depend on simulator and MCA characteristics.

Phenomenological Modelling of Camera Performance for Road Marking Detection

With the development of autonomous driving technology, the requirements for machine perception have increased significantly. In particular, camera-based lane detection plays an essential role in autonomous vehicle trajectory planning. However, lane detection is subject to high complexity, and it is sensitive to illumination variation, appearance, and age of lane marking. In addition, the sheer infinite number of test cases for highly automated vehicles requires an increasing portion of test and validation to be performed in simulation and X-in-the-loop testing. To model the complexity of camera-based lane detection, physical models are often used, which consider the optical properties of the imager as well as image processing itself. This complexity results in high efforts for the simulation in terms of modelling as well as computational costs. This paper presents a Phenomenological Lane Detection Model (PLDM) to simulate camera performance. The innovation of the approach is the modelling technique using Multi-Layer Perceptron (MLP), which is a class of Neural Network (NN). In order to prepare input data for our neural network model, massive driving tests have been performed on the M86 highway road in Hungary. The model’s inputs include vehicle dynamics signals (such as speed and acceleration, etc.). In addition, the difference between the reference output from the digital-twin map of the highway and camera lane detection results is considered as the target of the NN. The network consists of four hidden layers, and scaled conjugate gradient backpropagation is used for training the network. The results demonstrate that PLDM can sufficiently replicate camera detection performance in the simulation. The modelling approach improves the realism of camera sensor simulation as well as computational effort for X-in-the-loop applications and thereby supports safety validation of camera-based functionality in automated driving, which decreases the energy consumption of vehicles.

Assessing subjective criticality of take-over situations: Validation of two rating scales

Assessing subjective criticality of take-over situations is crucial for understanding of take-over behavior and comparing studies. However, no validated rating scales exist that assess subjective criticality of take-over situations. In a driving simulator study, two rating scales, the Scale of Criticality Assessment of driving situations from Neukum et al. (2008) and the Criticality Rating Scale, were tested on their validity to assess the subjective criticality of take-over situations. Besides, the subjective and behavioral changes over the repeated experience of take-over situations were investigated. Twenty-five participants experienced a set of five take-over situations with varying time-to-collisions (TTC) at the moment of the take-over request, twice. After each of the first five take-over situations, participants rated the criticality on one scale, after each of the second five situations on the other scale. Correlation coefficients between TTCs and criticality ratings for each scale were calculated. Also, the changes of subjective and behavioral measures over the trials were investigated. Correlation coefficients indicated a strong correlation between criticality ratings and TTCs. Hence, both scales are equally valid for the assessment of the criticality of take-over situations. The repeated experience of the take-over situations did not affect effort ratings, take-over times, or steering wheel positions. But brake input decreased with increasing practice, indicating a safer take-over behavior. Hence, results of studies with repeated experience of take-over situations are relatively valid as only brake behavior changed with increasing practice.

Electrogastrography in Autonomous Vehicles-An Objective Method for Assessment of Motion Sickness in Simulated Driving Environments

Autonomous vehicles are expected to take complete control of the driving process, enabling the former drivers to act as passengers only. This could lead to increased sickness as they can be engaged in tasks other than driving. Adopting different sickness mitigation techniques gives us unique types of motion sickness in autonomous vehicles to be studied. In this paper, we report on a study where we explored the possibilities of assessing motion sickness with electrogastrography (EGG), a non-invasive method used to measure the myoelectric activity of the stomach, and its potential usage in autonomous vehicles (AVs). The study was conducted in a high-fidelity driving simulator with a virtual reality (VR) headset. There separate EGG measurements were performed: before, during and after the driving AV simulation video in VR. During the driving, the participants encountered two driving environments: a straight and less dynamic highway road and a highly dynamic and curvy countryside road. The EGG signal was recorded with a proprietary 3-channel recording device and Ag/AgCl cutaneous electrodes. In addition, participants were asked to signalize whenever they felt uncomfortable and nauseated by pressing a special button. After the drive they completed also the Simulator Sickness Questionnaire (SSQ) and reported on their overall subjective perception of sickness symptoms. The EGG results showed a significant increase of the dominant frequency (DF) and the percentage of the high power spectrum density (FSD) as well as a significant decrease of the power spectrum density Crest factor (CF) during the AV simulation. The vast majority of participants reported nausea during more dynamic conditions, accompanied by an increase in the amplitude and the RMS value of EGG. Reported nausea occurred simultaneously with the increase in EGG amplitude. Based on the results, we conclude that EGG could be used for assessment of motion sickness in autonomous vehicles. DF, CF and FSD can be used as overall sickness indicators, while the relative increase in amplitude of EGG signal and duration of that increase can be used as short-term sickness indicators where the driving environment may affect the driver.

Where We Come from and Where We Are Going: A Systematic Review of Human Factors Research in Driving Automation

During the last decade, research has brought forth a large amount of studies that investigated driving automation from a human factor perspective. Due to the multitude of possibilities for the study design with regard to the investigated constructs, data collection methods, and evaluated parameters, at present, the pool of findings is heterogeneous and nontransparent. This literature review applied a structured approach, where five reviewers investigated n = 161 scientific papers of relevant journals and conferences focusing on driving automation between 2010 and 2018. The aim was to present an overview of the status quo of existing methodological approaches and investigated constructs to help scientists in conducting research with established methods and advanced study setups. Results show that most studies focused on safety aspects, followed by trust and acceptance, which were mainly collected through self-report measures. Driving/Take-Over performance also marked a significant portion of the published papers; however, a wide range of different parameters were investigated by researchers. Based on our insights, we propose a set of recommendations for future studies. Amongst others, this includes validation of existing results on real roads, studying long-term effects on trust and acceptance (and of course other constructs), or triangulation of self-reported and behavioral data. We furthermore emphasize the need to establish a standardized set of parameters for recurring use cases to increase comparability. To assure a holistic contemplation of automated driving, we moreover encourage researchers to investigate other constructs that go beyond safety.

Maneuver-Based Objectification of User Comfort Affecting Aspects of Driving Style of Autonomous Vehicle Concepts

Driving maneuvers try to objectify user needs regarding the driving dynamics for a vehicle concept. As autonomous vehicles will not be driven by people, the driving style that merges the individual aspects of driving dynamics, like user comfort, will be part of the vehicle concept itself. New driving maneuvers are, therefore, necessary to objectify the driving style of autonomous vehicle concepts with all its interdependencies relating to the individual aspects. This paper presents a methodology to design such driving maneuvers and includes a pilot study and a user study. As an example, the methodology was applied to the parameters of user comfort and travel time. The driven maneuvers resulted in statistical equations to objectify the interdependencies of these two aspects. Finally, this paper provides an outlook for needed maneuvers in order to tackle the entire driving style with its multidimensional facets.

Moving base driving simulators' potential for carsickness research

We investigated whether motion sickness analogous to carsickness can be studied in a moving base simulator, despite the limited motion envelope. Importantly, to avoid simulator sickness, vision outside the simulator cabin was restricted. Participants (N = 16) were exposed blindfolded to 15-min lateral sinusoidal motion at 0.2 Hz and 0.35 Hz on separate days. These conditions were selected to realize optimal provocativeness of the stimulus given the simulator's maximum displacement and knowledge on frequency-acceleration interactions for motion sickness. Average motion sickness on an 11-point scale was 2.21 ± 1.97 for 0.2 Hz and 1.93 ± 1.94 for 0.35 Hz. The motion sickness increase over time was comparable to that found in studies using actual vehicles. We argue that motion base simulators can be used to incite motion sickness analogous to carsickness, provided considerable restrictions on vision. Future research on carsickness, potentially more prevalent in autonomous vehicles, could benefit from employing simulators.

The effect of steering-system linearity, simulator motion, and truck driving experience on steering of an articulated tractor-semitrailer combination

Steering systems of trucks consist of many linkages, which introduce nonlinearities that may negatively affect steering performance. Nowadays, it is possible to equip steering systems with actuators that provide artificial steering characteristics. However, before new steering systems are deployed in real vehicles, evaluation in a safe and controlled simulator environment is recommended. A much-debated question is whether experiments need to be performed in a motion-base simulator or whether a fixed-base simulator suffices. Furthermore, it is unknown whether simulator-based tests can be validly conducted with a convenience sample of university participants who have not driven a truck before. We investigated the effect of steering characteristic (i.e., nonlinear vs. linear) on drivers' subjective opinions about the ride and the steering system, and on their objective driving performance in an articulated tractor-semitrailer combination. Thirty-two participants (12 truck drivers and 20 university drivers) each completed eight 5.5-min drives in which the simulator's motion system was either turned on or off and the steering model either resembled a linear (i.e., artificial) or nonlinear (i.e., realistic) system. Per drive, participants performed a lane-keeping task, merged onto the highway, and completed four overtaking manoeuvers. Results showed that the linear steering system yielded less subjective and objective steering effort, and better lane-keeping performance, than the nonlinear system. Consistent with prior research, participants drove a wider path through curves when motion was on compared to when motion was off. Truck drivers exhibited higher steering activity than university drivers, but there were no significant differences between the two groups in lane keeping performance and steering effort. We conclude that for future truck steering systems, a linear system may be valuable for improving performance. Furthermore, the results suggest that on-centre evaluations of steering systems do not require a motion base, and should not be performed using a convenience sample of university students.

Lane change warning threshold based on driver perception characteristics

Lane Change Warning system (LCW) is exploited to alleviate driver workload and improve the safety performance of lane changes. Depending on the secure threshold, the lane change warning system could transmit caution to drivers. Although the system possesses substantial benefits, it may perturb the conventional operating of the driver and affect driver judgment if the warning threshold does not conform to the driver perception of safety. Therefore, it is essential to establish an appropriate warning threshold to enhance the accuracy rate and acceptability of the lane change warning system. This research aims to identify the threshold that conforms to the driver perception of the ability to safely change lanes with a rear vehicle fast approaching. We propose a theoretical warning model of lane change based on a safe minimum distance and deceleration of the rear vehicle. For the purpose of acquiring the different safety levels of lane changes, 30 licensed drivers are recruited and we obtain the extreme moments represented by driver perception characteristics from a Front Extremity Test and a Rear Extremity Test implemented on the freeway. The required deceleration of the rear vehicle corresponding to the extreme time is calculated according to the proposed model. In light of discrepancies in the deceleration in these extremity experiments, we determine two levels of a hierarchical warning system. The purpose of the primary warning is to remind drivers of the existence of potentially dangerous vehicles and the second warning is used to warn the driver to stop changing lanes immediately. We use the signal detection theory to analyze the data. Ultimately, we confirm that the first deceleration threshold is 1.5 m/s² and the second deceleration threshold is 2.7 m/s². The findings provide the basis for the algorithm design of LCW and enhance the acceptability of the intelligent system.