1
|
Grindley B, Phillips K, Parnell KJ, Cherrett T, Scanlan J, Plant KL. Avoiding automation surprise: Identifying requirements to support pilot intervention in automated Uncrewed Aerial Vehicle (UAV) flight. APPLIED ERGONOMICS 2025; 127:104516. [PMID: 40184779 DOI: 10.1016/j.apergo.2025.104516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2024] [Revised: 01/22/2025] [Accepted: 03/29/2025] [Indexed: 04/07/2025]
Abstract
The breadth and depth of Uncrewed Aerial Vehicle (UAV) operations are expanding at a considerable rate. With expansion comes challenges for the design of automation to support decision making. This research takes the perceptual cycle model (PCM) and the derived trust version of the Schema World Action Research Method (T-SWARM), to identify the issues and challenges of pilot intervention in UAVs operating during highly automated states. Nine UAV pilots with current experience operating medium to large UAVs were interviewed, using T-SWARM, about incidents in which they initiated an intervention in system operation (i.e. to avoid weather or collision) and an event where the system initiated the intervention (i.e. due to system failure). The coded responses highlighted the challenges with what information is displayed, how it is displayed and how it influences decision-making in the UAV context. In addition, the responses also identified aspects that influence trust in the system, including personal disposition, affect interventions with the automation. Against each of the key factors identified recommendations are made to increase safety and operational efficiency of UAV operations. This research adds to the growing body of literature that supports the application of T-SWARM for eliciting knowledge in the aviation domain and specifically within the UAV domain.
Collapse
Affiliation(s)
- Ben Grindley
- Transportation Research Group, Boldrewood Innovation Campus, University of Southampton, UK; Defence Science and Technology Laboratory (Dstl), Salisbury, UK.
| | - Katie Phillips
- Defence Science and Technology Laboratory (Dstl), Salisbury, UK
| | - Katie J Parnell
- Transportation Research Group, Boldrewood Innovation Campus, University of Southampton, UK
| | - Tom Cherrett
- Transportation Research Group, Boldrewood Innovation Campus, University of Southampton, UK
| | - James Scanlan
- Transportation Research Group, Boldrewood Innovation Campus, University of Southampton, UK
| | - Katherine L Plant
- Transportation Research Group, Boldrewood Innovation Campus, University of Southampton, UK
| |
Collapse
|
2
|
Han M, Wang Y, Liu X, Cheng X, Niu H, Liu T. Attention demands modulate brain electrical microstates and mental fatigue induced by simulated flight tasks. J Neural Eng 2024; 21:066024. [PMID: 39571279 DOI: 10.1088/1741-2552/ad95be] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2024] [Accepted: 11/21/2024] [Indexed: 12/06/2024]
Abstract
Objective.Prolonged engagement in tasks with varying attention demands is thought to elicit distinct forms of mental fatigue, potentially indicating variations in neural activity. This study aimed to investigate the association between mental fatigue and changes in electroencephalogram microstate dynamics during tasks with varying attention demands.Approach.In the present study, we employed a 2 × 2 repeated measures ANOVA to analyze the temporal parameters of four distinct microstates (A, B, C, and D) across different levels of attention demands (high vs. low) and mental fatigue (high vs. low) within a controlled flight simulation task involving 17 college students.Main results.Significant variations in mean durations were observed, with microstates A and B exhibiting shorter durations under high fatigue during low attention demands, while their durations increased under high attention demands. Microstate C showed increased occurrences with high fatigue under low attention demands and decreased occurrences under high attention demands. The duration and occurrence of the microstates exhibited different trends throughout the course of mental fatigue, potentially reflecting distinct fatigue-related processes.Significance.These findings establish a link between different types of mental fatigue and microstate dynamics, contributing to a comprehensive understanding of the neural processing mechanisms underlying mental fatigue.
Collapse
Affiliation(s)
- Mingxiu Han
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, People's Republic of China
| | - Yuwen Wang
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, People's Republic of China
| | - Xinyi Liu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, People's Republic of China
| | - Xiangxin Cheng
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, People's Republic of China
| | - Haijun Niu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, People's Republic of China
| | - Tao Liu
- Beijing Advanced Innovation Center for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing, People's Republic of China
| |
Collapse
|
3
|
Gao S, Wang L. How flight experience impacts pilots' decision-making and visual scanning pattern in low-visibility approaches: preliminary evidence from eye tracking. ERGONOMICS 2024; 67:1284-1300. [PMID: 38254322 DOI: 10.1080/00140139.2023.2298992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 12/19/2023] [Indexed: 01/24/2024]
Abstract
The visual approach is the most accident-prone phase of a flight, especially in low-visibility conditions. This preliminary study aimed to examine the effects of flight experience on pilots' decision-making and visual scanning pattern in low-visibility approaches. Twenty pilots were separated into two groups based on their flight experience and completed the high- and low-visibility approaches in balanced order using a high-fidelity flight simulator. Pilots' mental workload and visual scanning patterns were recorded via an eye tracker. The results showed that, compared to less flight-experienced pilots (20%, 3/15), experienced pilots (80%, 4/5) were more likely to make go-around decisions in the low-visibility approaches. Furthermore, they exhibited a more flexible and adaptable visual scanning pattern by quickly shifting their attention, as evidenced by decreased fixations and increased saccades. These findings suggest that the integration of visual scanning strategy and training solution with a marginally meteorological approach may enhance decision-making safety for novice pilots.
Collapse
Affiliation(s)
- Shan Gao
- College of Safety Science and Engineering, Civil Aviation University of China, Tianjin, China
| | - Lei Wang
- College of Safety Science and Engineering, Civil Aviation University of China, Tianjin, China
| |
Collapse
|
4
|
Yang J, Tang M, Cong L, Sun J, Guo D, Zhang T, Xiong K, Wang L, Cheng S, Ma J, Hu W. Development and validation of an assessment index for quantifying cognitive task load in pilots under simulated flight conditions using heart rate variability and principal component analysis. ERGONOMICS 2024; 67:515-525. [PMID: 37365918 DOI: 10.1080/00140139.2023.2229075] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Accepted: 06/20/2023] [Indexed: 06/28/2023]
Abstract
To investigate whether high cognitive task load (CTL) for aircraft pilots can be identified by analysing heart-rate variability, electrocardiograms were recorded while cadet pilots (n = 68) performed the plane tracking, anti-gravity pedalling, and reaction tasks during simulated flight missions. Data for standard electrocardiogram parameters were extracted from the R-R-interval series. In the research phase, low frequency power (LF), high frequency power (HF), normalised HF, and LF/HF differed significantly between high and low CTL conditions (p < .05 for all). A principal component analysis identified three components contributing 90.62% of cumulative heart-rate variance. These principal components were incorporated into a composite index. Validation in a separate group of cadet pilots (n = 139) under similar conditions showed that the index value significantly increased with increasing CTL (p < .05). The heart-rate variability index can be used to objectively identify high CTL flight conditions.Practitioner summary: We used principal component analysis of electrocardiogram data to construct a composite index for identifying high cognitive task load in pilots during simulated flight. We validated the index in a separate group of pilots under similar conditions. The index can be used to improve cadet training and flight safety.Abbreviations: ANOVA: a one-way analysis of variance; AP: anti-gravity pedaling task; CTL: cognitive task load; ECG: electrocardiograms; HR: heart rate; HRV: heart-rate variability; HRVI: heart-rate variability index; PT: plane-tracking task; RMSSD: root-mean square of differences between consecutive R-R intervals; RT: reaction task; SDNN: standard deviation of R-R intervals; HF: high frequency power; HFnu: normalized HF; LF: low frequency power; LFnu: normalized LF; PCA: principal component analysis.
Collapse
Affiliation(s)
- Jinghua Yang
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
- Department of Fundamentals, Air Force Engineering University, Xian, China
| | - Mengjun Tang
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
- Department of Orthopedic Medicine, The Hospital of the 967th, PLA, Dalian, China
| | - Lin Cong
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
| | - Jicheng Sun
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
| | - Dalong Guo
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
| | - Taihui Zhang
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
| | - Kaiwen Xiong
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
| | - Li Wang
- Department of Outpatient Medicine, Xian 11th Military Sanatorium of Shaanxi Provincial Military Reg, Xian, China
| | - Shan Cheng
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
| | - Jin Ma
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
| | - Wendong Hu
- Department of Aerospace Medical Equipment, School of Aerospace Medicine, Air Force Medical University, Xian, China
| |
Collapse
|
5
|
Masi G, Amprimo G, Ferraris C, Priano L. Stress and Workload Assessment in Aviation-A Narrative Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:3556. [PMID: 37050616 PMCID: PMC10098909 DOI: 10.3390/s23073556] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Revised: 03/24/2023] [Accepted: 03/27/2023] [Indexed: 06/19/2023]
Abstract
In aviation, any detail can have massive consequences. Among the potential sources of failure, human error is still the most troublesome to handle. Therefore, research concerning the management of mental workload, attention, and stress is of special interest in aviation. Recognizing conditions in which a pilot is over-challenged or cannot act lucidly could avoid serious outcomes. Furthermore, knowing in depth a pilot's neurophysiological and cognitive-behavioral responses could allow for the optimization of equipment and procedures to minimize risk and increase safety. In addition, it could translate into a general enhancement of both the physical and mental well-being of pilots, producing a healthier and more ergonomic work environment. This review brings together literature on the study of stress and workload in the specific case of pilots of both civil and military aircraft. The most common approaches for studying these phenomena in the avionic context are explored in this review, with a focus on objective methodologies (e.g., the collection and analysis of neurophysiological signals). This review aims to identify the pros, cons, and applicability of the various approaches, to enable the design of an optimal protocol for a comprehensive study of these issues.
Collapse
Affiliation(s)
- Giulia Masi
- Department of Neurosciences, University of Turin, Via Cherasco 15, 10100 Torino, Italy;
| | - Gianluca Amprimo
- Institute of Electronics, Information Engineering and Telecommunication, National Research Council, Corso Duca degli Abruzzi 24, 10129 Torino, Italy; (G.A.); (C.F.)
- Department of Control and Computer Engineering, Politecnico di Torino, Corso Duca degli Abruzzi 24, 10129 Torino, Italy
| | - Claudia Ferraris
- Institute of Electronics, Information Engineering and Telecommunication, National Research Council, Corso Duca degli Abruzzi 24, 10129 Torino, Italy; (G.A.); (C.F.)
| | - Lorenzo Priano
- Department of Neurosciences, University of Turin, Via Cherasco 15, 10100 Torino, Italy;
- Istituto Auxologico Italiano, IRCCS, Department of Neurology and Neurorehabilitation, S. Giuseppe Hospital, Oggebbio (Piancavallo), 28824 Verbania, Italy
| |
Collapse
|
6
|
He X, Nie X, Zhou R, Yang J, Wu R. The risk-taking behavioural intentions of pilots in adverse weather conditions: an application of the theory of planned behaviour. ERGONOMICS 2022:1-14. [PMID: 36165739 DOI: 10.1080/00140139.2022.2129804] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/22/2022] [Accepted: 09/21/2022] [Indexed: 06/16/2023]
Abstract
This paper examined pilots' risk-taking behavioural intentions based on the theory of planned behaviour, as well as the impact of experience on behavioural intentions in adverse weather conditions. Two hundred and seventy-three airline pilots and flying cadets were divided into two groups and asked to complete a questionnaire based on two decision-making scenarios. This questionnaire measured pilots' intentions to take risks, along with the attitude towards the behaviour, subjective norms, perceived behavioural control (PBC), risk perception, and self-identity. The results showed that attitude, subjective norm, PBC, and risk perception explained 52% of the variance in behavioural intentions. Additionally, pilots' risk-taking decisions can be influenced by experience. Inexperienced pilots had a relatively stronger intention to take risks and a more favourable attitude towards risky behaviour. Moreover, pilots were more likely to rely on their own direct experience in the decision-making process. Practitioner summary: This study examined the pilots' risk-taking intentions under adverse weather conditions using a questionnaire based on the TPB theory. Results demonstrated that the TPB model can be applied to the risk-taking scenario and that experience can influence pilots' decisions. These findings have implications for improving flight safety and lowering accident rates.
Collapse
Affiliation(s)
- Xiaohan He
- School of Economics and Management, Beihang University, Beijing, China
| | - Xiaofei Nie
- Hainan Airlines Holding Co., Ltd., Haikou, China
| | - Ronggang Zhou
- School of Economics and Management, Beihang University, Beijing, China
- Key Laboratory of Complex System Analysis, Management and Decision (Beihang University), Ministry of Education of the People's Republic of China, Beijing, China
| | - Jiazhong Yang
- Institute of Aviation Human Factors and Ergonomics, Civil Aviation Flight University of China, Guanghan, China
| | - Ruilin Wu
- School of Humanities and Social Sciences, Beihang University, Beijing, China
| |
Collapse
|