Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design

Comparing auditory distance perception in real and virtual environments and the role of the loudness cue: A study based on event-related potentials

The perception of the distance to a sound source is relevant in many everyday situations, not only in real spaces, but also in virtual reality (VR) environments. Where real rooms often reach their limits, VR offers far-reaching possibilities to simulate a wide range of acoustic scenarios. However, in virtual room acoustics a plausible reproduction of distance-related cues can be challenging. In the present study, we compared the detection of changes of the distance to a sound source and its neurocognitive correlates in a real and a virtual reverberant environment, using an active auditory oddball paradigm and EEG measures. The main goal was to test whether the experiments in the virtual and real environments produced equivalent behavioral and EEG results. Three loudspeakers were placed at ego-centric distances of 2 m (near), 4 m (center), and 8 m (far) in front of the participants (N = 20), each 66 cm below their ear level. Sequences of 500 ms noise stimuli were presented either from the center position (standards, 80 % of trials) or from the near or far position (targets, 10 % each). The participants had to indicate a target position via a joystick response ("near" or "far"). Sounds were emitted either by real loudspeakers in the real environment or rendered and played back for the corresponding positions via headphones in the virtual environment. In addition, within both environments, loudness of the auditory stimuli was either unaltered (natural loudness) or the loudness cue was manipulated, so that all three loudspeakers were perceived equally loud at the listener's position (matched loudness). The EEG analysis focused on the mismatch negativity (MMN), P3a, and P3b as correlates of deviance detection, attentional orientation, and context-updating/stimulus evaluation, respectively. Overall, behavioral data showed that detection of the target positions was reduced within the virtual environment, and especially when loudness was matched. Except for slight latency shifts in the virtual environment, EEG analysis indicated comparable patterns within both environments and independent of loudness settings. Thus, while the neurocognitive processing of changes in distance appears to be similar in virtual and real spaces, a proper representation of loudness appears to be crucial to achieve a good task performance in virtual acoustic environments.

Acute combined effects of concurrent physical activities on autonomic nervous activation during cognitive tasks

Backgrounds: The validity of heart rate variability (HRV) has been substantiated in mental workload assessments. However, cognitive tasks often coincide with physical exertion in practical mental work, but their synergic effects on HRV remains insufficiently established. The study aims were to investigate the combined effects of cognitive and physical load on autonomic nerve functions. Methods: Thirty-five healthy male subjects (aged 23.5 ± 3.3 years) were eligible and enrolled in the study. The subjects engaged in n-back cognitive tasks (1-back, 2-back, and 3-back) under three distinct physical conditions, involving isotonic contraction of the left upper limb with loads of 0 kg, 3 kg, and 5 kg. Electrocardiogram signals and cognitive task performance were recorded throughout the tasks, and post-task assessment of subjective experiences were conducted using the NASA-TLX scale. Results: The execution of n-back tasks resulted in enhanced perceptions of task-load feelings and increased reaction times among subjects, accompanied by a decline in the accuracy rate (p < 0.05). These effects were synchronously intensified by the imposition of physical load. Comparative analysis with a no-physical-load scenario revealed significant alterations in the HRV of the subjects during the cognitive task under moderate and high physical conditions. The main features were a decreased power of the high frequency component (p < 0.05) and an increased low frequency component (p < 0.05), signifying an elevation in sympathetic activity. This physiological response manifested similarly at both moderate and high physical levels. In addition, a discernible linear correlation was observed between HRV and task-load feelings, as well as task performance under the influence of physical load (p < 0.05). Conclusion: HRV can serve as a viable indicator for assessing mental workload in the context of physical activities, making it suitable for real-world mental work scenarios.

Blink-Related Oscillations Provide Naturalistic Assessments of Brain Function and Cognitive Workload within Complex Real-World Multitasking Environments

BACKGROUND

There is a significant need to monitor human cognitive performance in complex environments, with one example being pilot performance. However, existing assessments largely focus on subjective experiences (e.g., questionnaires) and the evaluation of behavior (e.g., aircraft handling) as surrogates for cognition or utilize brainwave measures which require artificial setups (e.g., simultaneous auditory stimuli) that intrude on the primary tasks. Blink-related oscillations (BROs) are a recently discovered neural phenomenon associated with spontaneous blinking that can be captured without artificial setups and are also modulated by cognitive loading and the external sensory environment-making them ideal for brain function assessment within complex operational settings.

METHODS

Electroencephalography (EEG) data were recorded from eight adult participants (five F, M = 21.1 years) while they completed the Multi-Attribute Task Battery under three different cognitive loading conditions. BRO responses in time and frequency domains were derived from the EEG data, and comparisons of BRO responses across cognitive loading conditions were undertaken. Simultaneously, assessments of blink behavior were also undertaken.

RESULTS

Blink behavior assessments revealed decreasing blink rate with increasing cognitive load (p < 0.001). Prototypical BRO responses were successfully captured in all participants (p < 0.001). BRO responses reflected differences in task-induced cognitive loading in both time and frequency domains (p < 0.05). Additionally, reduced pre-blink theta band desynchronization with increasing cognitive load was also observed (p < 0.05).

CONCLUSION

This study confirms the ability of BRO responses to capture cognitive loading effects as well as preparatory pre-blink cognitive processes in anticipation of the upcoming blink during a complex multitasking situation. These successful results suggest that blink-related neural processing could be a potential avenue for cognitive state evaluation in operational settings-both specialized environments such as cockpits, space exploration, military units, etc. and everyday situations such as driving, athletics, human-machine interactions, etc.-where human cognition needs to be seamlessly monitored and optimized.

Cognitive aging at work and in daily life-a narrative review on challenges due to age-related changes in central cognitive functions

Demographic change is leading to an increasing proportion of older employees in the labor market. At the same time, work activities are becoming more and more complex and require a high degree of flexibility, adaptability, and cognitive performance. Cognitive control mechanism, which is subject to age-related changes and is important in numerous everyday and work activities, plays a special role. Executive functions with its core functions updating, shifting, and inhibition comprises cognitive control mechanisms that serve to plan, coordinate, and achieve higher-level goals especially in inexperienced and conflicting actions. In this review, influences of age-related changes in cognitive control are demonstrated with reference to work and real-life activities, in which the selection of an information or response in the presence of competing but task-irrelevant stimuli or responses is particularly required. These activities comprise the understanding of spoken language under difficult listening conditions, dual-task walking, car driving in critical traffic situations, and coping with work interruptions. Mechanisms for compensating age-related limitations in cognitive control and their neurophysiological correlates are discussed with a focus on EEG measures. The examples illustrate how to access influences of age and cognitive control on and in everyday and work activities, focusing on its functional role for the work ability and well-being of older people.

Investigating the attentional focus to workplace-related soundscapes in a complex audio-visual-motor task using EEG

Introduction

In demanding work situations (e.g., during a surgery), the processing of complex soundscapes varies over time and can be a burden for medical personnel. Here we study, using mobile electroencephalography (EEG), how humans process workplace-related soundscapes while performing a complex audio-visual-motor task (3D Tetris). Specifically, we wanted to know how the attentional focus changes the processing of the soundscape as a whole.

Method

Participants played a game of 3D Tetris in which they had to use both hands to control falling blocks. At the same time, participants listened to a complex soundscape, similar to what is found in an operating room (i.e., the sound of machinery, people talking in the background, alarm sounds, and instructions). In this within-subject design, participants had to react to instructions (e.g., "place the next block in the upper left corner") and to sounds depending on the experimental condition, either to a specific alarm sound originating from a fixed location or to a beep sound that originated from varying locations. Attention to the alarm reflected a narrow attentional focus, as it was easy to detect and most of the soundscape could be ignored. Attention to the beep reflected a wide attentional focus, as it required the participants to monitor multiple different sound streams.

Results and discussion

Results show the robustness of the N1 and P3 event related potential response during this dynamic task with a complex auditory soundscape. Furthermore, we used temporal response functions to study auditory processing to the whole soundscape. This work is a step toward studying workplace-related sound processing in the operating room using mobile EEG.

Visual Demands of Walking Are Reflected in Eye-Blink-Evoked EEG-Activity

Blinking is a natural user-induced response which paces visual information processing. This study investigates whether blinks are viable for segmenting continuous electroencephalography (EEG) activity, for inferring cognitive demands in ecologically valid work environments. We report the blink-related EEG measures of participants who performed auditory tasks either standing, walking on grass, or whilst completing an obstacle course. Blink-related EEG activity discriminated between different levels of cognitive demand during walking. Both behavioral parameters (e.g., blink duration or head motion) and blink-related EEG activity varied with walking conditions. Larger occipital N1 was observed during walking, relative to standing and traversing an obstacle course, which reflects differences in bottom-up visual perception. In contrast, the amplitudes of top-down components (N2, P3) significantly decreased with increasing walking demands, which reflected narrowing attention. This is consistent with blink-related EEG, specifically in Theta and Alpha power that, respectively, increased and decreased with increasing demands of the walking task. This work presents a novel and robust analytical approach to evaluate the cognitive demands experienced in natural work settings, which precludes the use of artificial task manipulations for data segmentation.

Real-Time Audio Processing of Real-Life Soundscapes for EEG Analysis: ERPs Based on Natural Sound Onsets

With smartphone-based mobile electroencephalography (EEG), we can investigate sound perception beyond the lab. To understand sound perception in the real world, we need to relate naturally occurring sounds to EEG data. For this, EEG and audio information need to be synchronized precisely, only then it is possible to capture fast and transient evoked neural responses and relate them to individual sounds. We have developed Android applications (AFEx and Record-a) that allow for the concurrent acquisition of EEG data and audio features, i.e., sound onsets, average signal power (RMS), and power spectral density (PSD) on smartphone. In this paper, we evaluate these apps by computing event-related potentials (ERPs) evoked by everyday sounds. One participant listened to piano notes (played live by a pianist) and to a home-office soundscape. Timing tests showed a stable lag and a small jitter (< 3 ms) indicating a high temporal precision of the system. We calculated ERPs to sound onsets and observed the typical P1-N1-P2 complex of auditory processing. Furthermore, we show how to relate information on loudness (RMS) and spectra (PSD) to brain activity. In future studies, we can use this system to study sound processing in everyday life.

Pocketable Labs for Everyone: Synchronized Multi-Sensor Data Streaming and Recording on Smartphones with the Lab Streaming Layer

The streaming and recording of smartphone sensor signals is desirable for mHealth, telemedicine, environmental monitoring and other applications. Time series data gathered in these fields typically benefit from the time-synchronized integration of different sensor signals. However, solutions required for this synchronization are mostly available for stationary setups. We hope to contribute to the important emerging field of portable data acquisition by presenting open-source Android applications both for the synchronized streaming (Send-a) and recording (Record-a) of multiple sensor data streams. We validate the applications in terms of functionality, flexibility and precision in fully mobile setups and in hybrid setups combining mobile and desktop hardware. Our results show that the fully mobile solution is equivalent to well-established desktop versions. With the streaming application Send-a and the recording application Record-a, purely smartphone-based setups for mobile research and personal health settings can be realized on off-the-shelf Android devices.

Anodal tDCS augments and preserves working memory beyond time-on-task deficits

Transcranial direct current stimulation (tDCS) of the left dorsolateral prefrontal cortex (DLPFC) has been shown to promote working memory (WM), however, its efficacy against time-on-task-related performance decline and associated cognitive fatigue remains uncertain. This study examined the impact of anodal tDCS of the left DLPFC on performance during a fatiguing visuospatial WM test. We adopted a repeated measures design, where 32 healthy adults (16 female), underwent anodal, control and sham tDCS on separate days. They completed an hour long two-back test, with stimulation intensity, onset, and duration set at 1 mA, at the 20th minute for 10 minutes respectively. Task performance, subjective responses, and heart rate variability (HRV) were captured during the experiment. Anodal tDCS substantially improved WM relative to sham tDCS and control in both sexes. These benefits lasted beyond the stimulation interval, and were unique across performance measures. However, no perceptual changes in subjective effort or fatigue levels were noted between conditions, although participants reported greater discomfort during stimulation. While mood and sleepiness changed with time-on-task, reflecting fatigue, these were largely similar across conditions. HRV increased under anodal tDCS and control, and plateaued under sham tDCS. We found that short duration anodal tDCS at 1 mA was an effective countermeasure to time-on-task deficits during a visuospatial two-back task, with enhancement and preservation of WM capacity. However, these improvements were not available at a perceptual level. Therefore, wider investigations are necessary to determine “how” such solutions will be operationalized in the field, especially within human-centered systems.

Measuring Correlates of Mental Workload During Simulated Driving Using cEEGrid Electrodes: A Test-Retest Reliability Analysis

The EEG reflects mental processes, especially modulations in the alpha and theta frequency bands are associated with attention and the allocation of mental resources. EEG has also been used to study mental processes while driving, both in real environments and in virtual reality. However, conventional EEG methods are of limited use outside of controlled laboratory settings. While modern EEG technologies offer hardly any restrictions for the user, they often still have limitations in measurement reliability. We recently showed that low-density EEG methods using film-based round the ear electrodes (cEEGrids) are well-suited to map mental processes while driving a car in a driving simulator. In the present follow-up study, we explored aspects of ecological and internal validity of the cEEGrid measurements. We analyzed longitudinal data of 127 adults, who drove the same driving course in a virtual environment twice at intervals of 12-15 months while the EEG was recorded. Modulations in the alpha and theta frequency bands as well as within behavioral parameters (driving speed and steering wheel angular velocity) which were highly consistent over the two measurement time points were found to reflect the complexity of the driving task. At the intraindividual level, small to moderate (albeit significant) correlations were observed in about 2/3 of the participants, while other participants showed significant deviations between the two measurements. Thus, the test-retest reliability at the intra-individual level was rather low and challenges the value of the application for diagnostic purposes. However, across all participants the reliability and ecological validity of cEEGrid electrodes were satisfactory in the context of driving-related parameters.