Vigilance and Automation Dependence in Operation of Multiple Unmanned Aerial Systems (UAS): A Simulation Study

An investigation of cardiac vagal tone over time and its relation to vigilance performance: a growth curve modeling approach

Introduction

Research over the last couple of decades has demonstrated a relationship between psychophysiological measures, specifically cardiac functions, and cognitive performance. Regulation of the cardiac system under parasympathetic control is commonly referred to as cardiac vagal tone and is associated with the regulation of cognitive and socioemotional states. The goal of the current study was to capture the dynamic relationship between cardiac vagal tone and performance in a vigilance task.

Method/Results

We implemented a longitudinal growth curve modeling approach which unveiled a relationship between cardiac vagal tone and vigilance that was non-monotonic and dependent upon each person.

Discussion

The findings suggest that cardiac vagal tone may be a process-based physiological measure that further explains how the vigilance decrement manifests over time and differs across individuals. This contributes to our understanding of vigilance by modeling individual differences in cardiac vagal tone changes that occur over the course of the vigilance task.

Gaming experience predicts UAS operator performance and workload in simulated search and rescue missions

Unmanned aircraft systems (UAS) operator training and selection procedures are still being refined to effectively address challenges related to performance, workload, and stress in UAS operation. Research suggests that experience with commercial videogames may test skills relevant to modern UAS operation. This study investigated the ability of videogame experience to predict operator performance, workload, and stress. Forty-nine participants performed 9 trials of a simulated search and rescue mission. It was expected that participants who more frequently played videogames would report lower levels of distress and workload, higher task engagement, and better overall performance. Results showed that gaming experience was negatively correlated with subjective workload and positively correlated with multiple measures of performance. Furthermore, nearly all observed gender-related differences were not present when gaming experience was controlled for. These results have implications for the role of gaming experience in remotely operated systems operator recruitment, selection, and training. Practitioner summary: This study examined how gaming experience influences UAS operator success in simulated search and rescue missions. Participants reported on their experience playing videogames before completing multiple experimental trials on a desktop computer. Results indicated that experience playing videogames significantly impacted performance, workload, and stress.

Teammates Instead of Tools: The Impacts of Level of Autonomy on Mission Performance and Human–Agent Teaming Dynamics in Multi-Agent Distributed Teams

Human–agent teaming (HAT) is becoming more commonplace across industry, military, and consumer settings. Agents are becoming more advanced, more integrated, and more responsible for tasks previously assigned to humans. In addition, the dyadic human–agent teaming nature is evolving from a one–one pair to one–many, in which the human is working with numerous agents to accomplish a task. As capabilities become more advanced and humanlike, the best method for humans and agents to effectively coordinate is still unknown. Therefore, current research must start diverting focus from how many agents can a human manage to how can agents and humans work together effectively. Levels of autonomy (LOAs), or varying levels of responsibility given to the agents, implemented specifically in the decision-making process could potentially address some of the issues related to workload, stress, performance, and trust. This study sought to explore the effects of different LOAs on human–machine team coordination, performance, trust, and decision making in hand with assessments of operator workload and stress in a simulated multi-unmanned aircraft vehicle (UAV) intelligence surveillance and reconnaissance (ISR) task. The results of the study can be used to identify human factor roadblocks to effective HAT and provide guidance for future designs of HAT. Additionally, the unique impacts of LOA and autonomous decision making by agents on trust are explored.

The ANT Executive Control Index: No Evidence for Temporal Decrement

OBJECTIVE

This study tested whether indices of executive control, alertness, and orienting measured with Attention Network Test (ANT) are vulnerable to temporal decrement in performance.

BACKGROUND

Developing the resource theory of sustained attention requires identifying neurocognitive processes vulnerable to decrement. Executive control processes may be prone to impairment in fatigue states. Such processes are also highlighted in alternative theories. Determining the role of executive control in vigilance can both advance theory and contribute to practical countermeasures for decrement in human factors contexts.

METHOD

In Study 1, 80 participants performed the standard ANT for an extended duration of about 55 to 60 min. Study 2 (160 participants) introduced manipulations of trial blocking and stimulus degradation intended to increase resource depletion. Reaction time and accuracy measures were analyzed. Subjective stress and workload were assessed in both studies.

RESULTS

In both studies, the ANT induced levels of subjective workload and task disengagement consistent with previous sustained attention studies. No systematic decrement in any performance measure was observed.

CONCLUSION

Executive control assessed by the ANT is not highly vulnerable to temporal decrement, even when task demands are elevated. Future work should differentiate executive control processes; proactive control may be more implicated in sustained attention decrement than in reactive control.

APPLICATION

Designing systems and interfaces to reduce executive control demands may be generally beneficial but will not directly mitigate temporal performance decrement. Enhancing design guidelines and neuroergonomic methods for monitoring operator attention requires further work to identify key neurocognitive processes for decrement.

Adaptive Human-Robot Interactions for Multiple Unmanned Aerial Vehicles

Advances in unmanned aircraft systems (UAS) have paved the way for progressively higher levels of intelligence and autonomy, supporting new modes of operation, such as the one-to-many (OTM) concept, where a single human operator is responsible for monitoring and coordinating the tasks of multiple unmanned aerial vehicles (UAVs). This paper presents the development and evaluation of cognitive human-machine interfaces and interactions (CHMI2) supporting adaptive automation in OTM applications. A CHMI2 system comprises a network of neurophysiological sensors and machine-learning based models for inferring user cognitive states, as well as the adaptation engine containing a set of transition logics for control/display functions and discrete autonomy levels. Models of the user’s cognitive states are trained on past performance and neurophysiological data during an offline calibration phase, and subsequently used in the online adaptation phase for real-time inference of these cognitive states. To investigate adaptive automation in OTM applications, a scenario involving bushfire detection was developed where a single human operator is responsible for tasking multiple UAV platforms to search for and localize bushfires over a wide area. We present the architecture and design of the UAS simulation environment that was developed, together with various human-machine interface (HMI) formats and functions, to evaluate the CHMI2 system’s feasibility through human-in-the-loop (HITL) experiments. The CHMI2 module was subsequently integrated into the simulation environment, providing the sensing, inference, and adaptation capabilities needed to realise adaptive automation. HITL experiments were performed to verify the CHMI2 module’s functionalities in the offline calibration and online adaptation phases. In particular, results from the online adaptation phase showed that the system was able to support real-time inference and human-machine interface and interaction (HMI2) adaptation. However, the accuracy of the inferred workload was variable across the different participants (with a root mean squared error (RMSE) ranging from 0.2 to 0.6), partly due to the reduced number of neurophysiological features available as real-time inputs and also due to limited training stages in the offline calibration phase. To improve the performance of the system, future work will investigate the use of alternative machine learning techniques, additional neurophysiological input features, and a more extensive training stage.

Sustained Attention to Science: A Tribute to the Life and Scholarship of Joel Warm

OBJECTIVE

To provide an evaluative synthesis of the life and scientific contributions of the late Joel Warm.

BACKGROUND

As the doyen of vigilance research, Joel Warm expanded our understanding and horizons concerning this critical response capacity. However, he also made widespread and profound contributions to many other areas of perception and applied psychology, as we elucidate here.

METHOD

Using archival sources, personal histories, and analysis of extant literature documenting Warm's own productivity, we articulate his life in science.

RESULTS

Our synthesis illustrates the continued, broad, influential, and expanding impact that one individual can exert on diverse fields of study. Whole bodies of understanding of human behavior have been illuminated by his exemplary career.

APPLICATION

By understanding his path to success in applied experimental psychology, we anticipate that others will be motivated, inspired, and guided to replicate and even outstrip a lifetime of such seminal and influential contributions. The presence of individuals such as Warm serves as a primary motive in enhancing Humans Factors/Ergonomics Science.

Metacognition, Hardiness, and Grit as Resilience Factors in Unmanned Aerial Systems (UAS) Operations: A Simulation Study

Operators of Unmanned Aerial Systems (UAS) face a variety of stress factors resulting from both the cognitive demands of the work and its broader social context. Dysfunctional metacognitions including those concerning worry may increase stress vulnerability, whereas personality traits including hardiness and grit may confer resilience. The present study utilized a simulation of UAS operation requiring control of multiple vehicles. Two stressors were manipulated independently in a within-subjects design: cognitive demands and negative evaluative feedback. Stress response was assessed using both subjective measures and a suite of psychophysiological sensors, including the electroencephalogram (EEG), electrocardiogram (ECG), and hemodynamic sensors. Both stress manipulations elevated subjective distress and elicited greater high-frequency activity in the EEG. However, predictors of stress response varied across the two stressors. The Anxious Thoughts Inventory (AnTI: Wells, 1994) was generally associated with higher state worry in both control and stressor conditions. It also predicted stress reactivity indexed by EEG and worry responses in the negative feedback condition. Measures of hardiness and grit were associated with somewhat different patterns of stress response. In addition, within the negative feedback condition, the AnTI meta-worry scale moderated relationships between state worry and objective performance and psychophysiological outcome measures. Under high state worry, AnTI meta-worry was associated with lower frontal oxygen saturation, but higher spectral power in high-frequency EEG bands. High meta-worry may block adaptive compensatory effort otherwise associated with worry. Findings support both the metacognitive theory of anxiety and negative emotions (Wells and Matthews, 2015), and the Trait-Stressor-Outcome (TSO: Matthews et al., 2017a) framework for resilience.