Using spontaneous eye blink-related brain activity to investigate cognitive load during mobile map-assisted navigation

Fixation-related potentials during mobile map assisted navigation in the real world: The effect of landmark visualization style

An often-proposed enhancement for mobile maps to aid assisted navigation is the presentation of landmark information, yet understanding of the manner in which they should be displayed is limited. In this study, we investigated whether the visualization of landmarks as 3D map symbols with either an abstract or realistic style influenced the subsequent processing of those landmarks during route navigation. We utilized a real-world mobile electroencephalography approach to this question by combining several tools developed to overcome the challenges typically encountered in real-world neuroscience research. We coregistered eye-movement and EEG recordings from 45 participants as they navigated through a real-world environment using a mobile map. Analyses of fixation event-related potentials revealed that the amplitude of the parietal P200 component was enhanced when participants fixated landmarks in the real world that were visualized on the mobile map in a realistic style, and that frontal P200 latencies were prolonged for landmarks depicted in either a realistic or abstract style compared with features of the environment that were not presented on the map, but only for the male participants. In contrast, we did not observe any significant effects of landmark visualization style on visual P1-N1 peaks or the parietal late positive component. Overall, the findings indicate that the cognitive matching process between landmarks seen in the environment and those previously seen on a map is facilitated by more realistic map display, while low-level perceptual processing of landmarks and recall of associated information are unaffected by map visualization style.

Towards neuroadaptive navigation assistance to reduce spatial de-skilling

Maps have been invaluable navigation aids for millennia and thus have been critical for human survival. The increasing popularity of and high dependence on digital, location-aware assistive navigation technology, however, has been shown to divert our attention from the environment and to negatively influence innate spatial abilities. To mitigate this, neuroadaptive mobile geographic information displays (namGIDs) are proposed that respond in real-time to navigators' cognitive task demands and wayfinder's situated visuo-spatial attention needs. In doing so, namGIDs may not only help navigators maintain navigation efficiency but more importantly, also continuously scaffold spatial learning. To do this, the proposed navigation assistance must strike the appropriate balance between welcomed mobility efficiency gains while limiting human spatial deskilling. Leveraging neuroadaptive cartography, we can ensure to remain effective navigators, empowered to explore the world with confidence.

How Do In-Car Navigation Aids Impair Expert Navigators' Spatial Learning Ability?

Reliance on digital navigation aids has already shown negative impacts on navigators' innate spatial abilities. How this happens is still an open research question. We report on an empirical study with twenty-four experienced (male) taxi drivers to evaluate the long-term impacts of in-car navigation system use on the spatial learning ability of these navigation experts. Specifically, we measured cognitive load by means of electroencephalography (EEG) coupled with eye tracking to assess their visuospatial attention allocation during a video-based route-following task while driving through an unknown urban environment. We found that long-term reliance on in-car navigation aids did not affect participants' visual attention allocation during spatial learning but rather limited their ability to encode viewed geographic information into memory, which, in turn, led to greater cognitive load, especially along route segments between intersections. Participants with greater dependence on in-car navigation aids performed worse on the spatial knowledge tests. Our combined behavioral and neuropsychological findings provide evidence for the impairment of expert navigators' spatial learning ability when exposed to long-term use of digital in-car navigation aids.

Blink-Related Oscillations Provide Naturalistic Assessments of Brain Function and Cognitive Workload within Complex Real-World Multitasking Environments

BACKGROUND

There is a significant need to monitor human cognitive performance in complex environments, with one example being pilot performance. However, existing assessments largely focus on subjective experiences (e.g., questionnaires) and the evaluation of behavior (e.g., aircraft handling) as surrogates for cognition or utilize brainwave measures which require artificial setups (e.g., simultaneous auditory stimuli) that intrude on the primary tasks. Blink-related oscillations (BROs) are a recently discovered neural phenomenon associated with spontaneous blinking that can be captured without artificial setups and are also modulated by cognitive loading and the external sensory environment-making them ideal for brain function assessment within complex operational settings.

METHODS

Electroencephalography (EEG) data were recorded from eight adult participants (five F, M = 21.1 years) while they completed the Multi-Attribute Task Battery under three different cognitive loading conditions. BRO responses in time and frequency domains were derived from the EEG data, and comparisons of BRO responses across cognitive loading conditions were undertaken. Simultaneously, assessments of blink behavior were also undertaken.

RESULTS

Blink behavior assessments revealed decreasing blink rate with increasing cognitive load (p < 0.001). Prototypical BRO responses were successfully captured in all participants (p < 0.001). BRO responses reflected differences in task-induced cognitive loading in both time and frequency domains (p < 0.05). Additionally, reduced pre-blink theta band desynchronization with increasing cognitive load was also observed (p < 0.05).

CONCLUSION

This study confirms the ability of BRO responses to capture cognitive loading effects as well as preparatory pre-blink cognitive processes in anticipation of the upcoming blink during a complex multitasking situation. These successful results suggest that blink-related neural processing could be a potential avenue for cognitive state evaluation in operational settings-both specialized environments such as cockpits, space exploration, military units, etc. and everyday situations such as driving, athletics, human-machine interactions, etc.-where human cognition needs to be seamlessly monitored and optimized.

Neuroadaptive LBS: towards human-, context-, and task-adaptive mobile geographic information displays to support spatial learning for pedestrian navigation

Well-designed, neuroadaptive mobile geographic information displays (namGIDs) could improve the lives of millions of mobile citizens of the mostly urban information society who daily need to make time critical and societally relevant decisions while navigating. What are the basic perceptual and neurocognitive processes with which individuals make movement decisions when guided by human- and context-adaptive namGIDs? How can we study this in an ecologically valid way, also outside of the highly controlled laboratory? We report first ideas and results from our unique neuroadaptive research agenda that brings us closer to answering this fundamental empirical question. We present our first implemented methodological solutions of novel ambulatory evaluation methods to study and improve Location-based System (LBS) displays, by critical examination of how perceptual, neurocognitive, psychophysiological, and display design factors might influence decision-making and spatial learning in pedestrian mobility across broad ranges of users and mobility contexts.

Blink-related EEG activity measures cognitive load during proactive and reactive driving

Assessing drivers' cognitive load is crucial for driving safety in challenging situations. This research employed the occurrence of drivers' natural eye blinks as cues in continuously recorded EEG data to assess the cognitive workload while reactive or proactive driving. Twenty-eight participants performed either a lane-keeping task with varying levels of crosswind (reactive) or curve road (proactive). The blink event-related potentials (bERPs) and spectral perturbations (bERSPs) were analyzed to assess cognitive load variations. The study found that task load during reactive driving did not significantly impact bERPs or bERSPs, possibly due to enduring alertness for vehicle control. The proactive driving revealed significant differences in the occipital N1 component with task load, indicating the necessity to adapt the attentional resources allocation based on road demands. Also, increased steering complexity led to decreased frontal N2, parietal P3, occipital P2 amplitudes, and alpha power, requiring more cognitive resources for processing relevant information. Interestingly, the proactive and reactive driving scenarios demonstrated a significant interaction at the parietal P2 and occipital N1 for three difficulty levels. The study reveals that EEG measures related to natural eye blink behavior provide insights into the effect of cognitive load on different driving tasks, with implications for driver safety.

Neuroadaptive mobile geographic information displays: an emerging cartographic research frontier

Mobility, including navigation and wayfinding, is a basic human requirement for survival. For thousands of years maps have played a significant role for human mobility and survival. Increasing reliance on digital GNSS-enabled navigation assistance, however, is impacting human attentional resources and is limiting our innate cognitive spatial abilities. To mitigate human de-skilling, a neuroadaptive (mobile) cartographic research frontier is proposed and first steps towards creating well-designed mobile geographic information displays (mGIDs) that not only respond to navigators' cognitive load and visuo-spatial attentional resources during navigation in real-time but are also able to scaffold spatial learning while still maintaining navigation efficiency. This in turn, will help humans to remain as independent from geoinformation technology, as desired.