Mobile brain/body imaging of landmark-based navigation with high-density EEG

Consensus Paper: Cerebellum and Ageing

Given the key roles of the cerebellum in motor, cognitive, and affective operations and given the decline of brain functions with aging, cerebellar circuitry is attracting the attention of the scientific community. The cerebellum plays a key role in timing aspects of both motor and cognitive operations, including for complex tasks such as spatial navigation. Anatomically, the cerebellum is connected with the basal ganglia via disynaptic loops, and it receives inputs from nearly every region in the cerebral cortex. The current leading hypothesis is that the cerebellum builds internal models and facilitates automatic behaviors through multiple interactions with the cerebral cortex, basal ganglia and spinal cord. The cerebellum undergoes structural and functional changes with aging, being involved in mobility frailty and related cognitive impairment as observed in the physio-cognitive decline syndrome (PCDS) affecting older, functionally-preserved adults who show slowness and/or weakness. Reductions in cerebellar volume accompany aging and are at least correlated with cognitive decline. There is a strongly negative correlation between cerebellar volume and age in cross-sectional studies, often mirrored by a reduced performance in motor tasks. Still, predictive motor timing scores remain stable over various age groups despite marked cerebellar atrophy. The cerebello-frontal network could play a significant role in processing speed and impaired cerebellar function due to aging might be compensated by increasing frontal activity to optimize processing speed in the elderly. For cognitive operations, decreased functional connectivity of the default mode network (DMN) is correlated with lower performances. Neuroimaging studies highlight that the cerebellum might be involved in the cognitive decline occurring in Alzheimer's disease (AD), independently of contributions of the cerebral cortex. Grey matter volume loss in AD is distinct from that seen in normal aging, occurring initially in cerebellar posterior lobe regions, and is associated with neuronal, synaptic and beta-amyloid neuropathology. Regarding depression, structural imaging studies have identified a relationship between depressive symptoms and cerebellar gray matter volume. In particular, major depressive disorder (MDD) and higher depressive symptom burden are associated with smaller gray matter volumes in the total cerebellum as well as the posterior cerebellum, vermis, and posterior Crus I. From the genetic/epigenetic standpoint, prominent DNA methylation changes in the cerebellum with aging are both in the form of hypo- and hyper-methylation, and the presumably increased/decreased expression of certain genes might impact on motor coordination. Training influences motor skills and lifelong practice might contribute to structural maintenance of the cerebellum in old age, reducing loss of grey matter volume and therefore contributing to the maintenance of cerebellar reserve. Non-invasive cerebellar stimulation techniques are increasingly being applied to enhance cerebellar functions related to motor, cognitive, and affective operations. They might enhance cerebellar reserve in the elderly. In conclusion, macroscopic and microscopic changes occur in the cerebellum during the lifespan, with changes in structural and functional connectivity with both the cerebral cortex and basal ganglia. With the aging of the population and the impact of aging on quality of life, the panel of experts considers that there is a huge need to clarify how the effects of aging on the cerebellar circuitry modify specific motor, cognitive, and affective operations both in normal subjects and in brain disorders such as AD or MDD, with the goal of preventing symptoms or improving the motor, cognitive, and affective symptoms.

An ecological study protocol for the multimodal investigation of the neurophysiological underpinnings of dyadic joint action

A novel multimodal experimental setup and dyadic study protocol were designed to investigate the neurophysiological underpinnings of joint action through the synchronous acquisition of EEG, ECG, EMG, respiration and kinematic data from two individuals engaged in ecologic and naturalistic cooperative and competitive joint actions involving face-to-face real-time and real-space coordinated full body movements. Such studies are still missing because of difficulties encountered in recording reliable neurophysiological signals during gross body movements, in synchronizing multiple devices, and in defining suitable study protocols. The multimodal experimental setup includes the synchronous recording of EEG, ECG, EMG, respiration and kinematic signals of both individuals via two EEG amplifiers and a motion capture system that are synchronized via a single-board microcomputer and custom Python scripts. EEG is recorded using new dry sports electrode caps. The novel study protocol is designed to best exploit the multimodal data acquisitions. Table tennis is the dyadic motor task: it allows naturalistic and face-to-face interpersonal interactions, free in-time and in-space full body movement coordination, cooperative and competitive joint actions, and two task difficulty levels to mimic changing external conditions. Recording conditions-including minimum table tennis rally duration, sampling rate of kinematic data, total duration of neurophysiological recordings-were defined according to the requirements of a multilevel analytical approach including a neural level (hyperbrain functional connectivity, Graph Theoretical measures and Microstate analysis), a cognitive-behavioral level (integrated analysis of neural and kinematic data), and a social level (extending Network Physiology to neurophysiological data recorded from two interacting individuals). Four practical tests for table tennis skills were defined to select the study population, permitting to skill-match the dyad members and to form two groups of higher and lower skilled dyads to explore the influence of skill level on joint action performance. Psychometric instruments are included to assess personality traits and support interpretation of results. Studying joint action with our proposed protocol can advance the understanding of the neurophysiological mechanisms sustaining daily life joint actions and could help defining systems to predict cooperative or competitive behaviors before being overtly expressed, particularly useful in real-life contexts where social behavior is a main feature.

Can cognitive neuroscience solve the lab-dilemma by going wild?

Reproducibility, measurability, and refutability are the foundation of the scientific method applied to empirical work. In the study of animal and human behavior, experimental protocols conducted in the lab are the most reliable means by which scientists can operationalize behaviors using controlled and parameterized setups. However, whether observations in the lab fully generalize in the real world remain legitimately disputed. The notion of "experimental design" was originally intended to ensure the generalizability of experimental findings to real-world situations. Experiments in the wild are more frequently explored and significant technological advances have been made allowing mobile neuroimaging. Yet some methodological limitations remain when testing scientific hypotheses in ecological conditions. Herein, we discuss the limitations of inferential processes derive from empirical observations in the wild. The multi-causal property of an ecological situation often lacks controls, and this major concern may prevent the replication and the reliability of behavioral observations. We discuss the epistemological and historical grounds of the induction process for behavioral and cognitive neurosciences and provide some possible heuristics for In situ experimental designs compatible with psychophysics in the wild.

Effects of digital-based interventions on muscular strength in adults: a systematic review, meta-analysis and meta-regression of randomized controlled trials with quality of evidence assessment

BACKGROUND

In the last three decades, both medical and sports science professionals have recognized the considerable potential of digital-based interventions (DBI) to enhance the health-related outcomes of their practitioners.

OBJECTIVES

This study aimed to investigate the effectiveness and potential moderators of DBI on measures of muscular strength.

METHODS

Six databases (PubMed/MEDLINE, Web of Science, SportDiscus, Embase, Cochrane Register of Controlled Trials and Google Scholar) were searched for eligible studies up to June 2022. The GRADE, PEDRO, and TIDieR checklists were used to assess the quality of evidence, methodology, and completeness of intervention descriptions, respectively.

RESULTS

A total of 56 studies were included in the meta-analysis (n = 2346), and participants were classified as healthy (n = 918), stroke survivors (n = 572), diagnosed with other neurological disorders (n = 683), and frail (n = 173). The DBI showed a small effect (standardized mean difference [SMD] = 0.28, 95% CI 0.21 to 0.31; p < 0.001) on strength, regardless of the type of intervention, control group, or tested body part. More specifically, while splitting the studies into different subgroups, a meta-analysis of 19 studies (n = 918) showed a small effect (SMD = 0.38, 95% CI 0.12 to 0.63; p = 0.003) on strength in the asymptomatic population. Similarly, small but positive effects of DBI were observed for stroke survivors (SMD = 0.34, 95% CI 0.13 to 0.56; p = 0.002), patients diagnosed with other neurological disorders (SMD = 0.17, 95% CI 0.03 to 0.32; p = 0.021), and the frail population (SMD = 0.25, 95% CI 0.0 to 0.5; p = 0.051). Sub-group analysis and meta-regression revealed that neither variable modified the effects of the DBI on measures of strength.

CONCLUSIONS

Overall, DBI may serve as an effective method to improve measures of strength in adults, regardless of their health status as well as the type of digital device, the presence of human-computer interaction, and the age of participants. In addition, the DBI was found to be more effective than traditional training or rehabilitation methods.KEY MESSAGESDigital-based intervention (DBI) is effective in improving measures of muscular strength in adults regardless of participants' health statusDBIs were equally effective for strength improvements in lower and upper limbsAlthough, DBIs were found to be effective in improving muscular strength, most studies did not follow strength training guidelines when prescribing the interventions.

Theta oscillatory power decreases in humans are associated with spatial learning in a virtual water maze task

Theta oscillations (4-8 Hz) in humans play a role in navigation processes, including spatial encoding, retrieval and sensorimotor integration. Increased theta power at frontal and parietal midline regions is known to contribute to successful navigation. However, the dynamics of cortical theta and its role in spatial learning are not fully understood. This study aimed to investigate theta oscillations via electroencephalogram (EEG) during spatial learning in a virtual water maze. Participants were separated into a learning group (n = 25) who learned the location of a hidden goal across 12 trials, or a time-matched non-learning group (n = 25) who were required to simply navigate the same arena, but without a goal. We compared all trials, at two phases of learning, the trial start and the goal approach. We also compared the first six trials with the last six trials within-groups. The learning group showed reduced low-frequency theta power at the frontal and parietal midline during the start phase and largely reduced theta combined with a short increase at both midlines during the goal-approach phase. These patterns were not found in the non-learning group, who instead displayed extensive increases in low-frequency oscillations at both regions during the trial start and at the parietal midline during goal approach. Our results support the theory that theta plays a crucial role in spatial encoding during exploration, as opposed to sensorimotor integration. We suggest our findings provide evidence for a link between learning and a reduction of theta oscillations in humans.

Multisensory input modulates memory-guided spatial navigation in humans

Efficient navigation is supported by a cognitive map of space. The hippocampus plays a key role for this map by linking multimodal sensory information with spatial memory representations. However, in human navigation studies, the full range of sensory information is often unavailable due to the stationarity of experimental setups. We investigated the contribution of multisensory information to memory-guided spatial navigation by presenting a virtual version of the Morris water maze on a screen and in an immersive mobile virtual reality setup. Patients with hippocampal lesions and matched controls navigated to memorized object locations in relation to surrounding landmarks. Our results show that availability of multisensory input improves memory-guided spatial navigation in both groups. It has distinct effects on navigational behaviour, with greater improvement in spatial memory performance in patients. We conclude that congruent multisensory information shifts computations to extrahippocampal areas that support spatial navigation and compensates for spatial navigation deficits.

Context effects on object recognition in real-world environments: A study protocol

Background: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isolated from its environment. Moreover, it is not clear which components of the recognition process are impacted by the environment. In this experiment, we seek to examine the impact real world environments have on object recognition. Specifically, we will use mobile electroencephalography (mEEG) and augmented reality (AR) to investigate how the visual and semantic processing aspects of object recognition are changed by the environment. Methods: We will use AR to place congruent and incongruent virtual objects around indoor and outdoor environments. During the experiment a total of 34 participants will walk around the environments and find these objects while we record their eye movements and neural signals. We will perform two primary analyses. First, we will analyse the event-related potential (ERP) data using paired samples t-tests in the N300/400 time windows in an attempt to replicate congruency effects on the N300/400. Second, we will use representational similarity analysis (RSA) and computational models of vision and semantics to determine how visual and semantic processes are changed by congruency. Conclusions: Based on previous literature, we hypothesise that scene-object congruence would facilitate object recognition. For ERPs, we predict a congruency effect in the N300/N400, and for RSA we predict that higher level visual and semantic information will be represented earlier for congruent scenes than incongruent scenes. By collecting mEEG data while participants are exploring a real-world environment, we will be able to determine the impact of a natural context on object recognition, and the different processing stages of object recognition.

Mobile cognition: imaging the human brain in the 'real world'

Cognitive neuroscience studies in humans have enabled decades of impactful discoveries but have primarily been limited to recording the brain activity of immobile participants in a laboratory setting. In recent years, advances in neuroimaging technologies have enabled recordings of human brain activity to be obtained during freely moving behaviours in the real world. Here, we propose that these mobile neuroimaging methods can provide unique insights into the neural mechanisms of human cognition and contribute to the development of novel treatments for neurological and psychiatric disorders. We further discuss the challenges associated with studying naturalistic human behaviours in complex real-world settings as well as strategies for overcoming them. We conclude that mobile neuroimaging methods have the potential to bring about a new era of cognitive neuroscience in which neural mechanisms can be studied with increased ecological validity and with the ability to address questions about natural behaviour and cognitive processes in humans engaged in dynamic real-world experiences.

Virtual reality does not fool the brain only: spinal excitability changes during virtually simulated falling

Virtual reality (VR) is known to induce substantial activation of brain's motor regions. It remains unclear to what extent virtual reality can trigger the sensorimotor system, and more particularly, whether it can affect lower nervous levels. In this study, we aimed to assess whether VR simulation of challenging and stressful postural situations (Richie's plank experience) could interfere with spinal excitability of postural muscles in 15 healthy young participants. The H-reflex of the triceps surae muscles was elicited with electrical nerve stimulation while participants were standing and wearing a VR headset. Participants went through several conditions, during which stimulations were evoked: standing still (noVR), standing in VR on the ground (groundVR), standing on the edge of a building (plankVR), and falling from the building (fallingVR). Myoelectrical activity of the triceps surae muscles was measured throughout the experiment. Leg and head movements were also measured by means of accelerometers to account for body oscillations. First, no differences in head rotations and myoelectrical activity were to be noted between conditions. Second, triceps H-reflex (H_MAX/M_MAX) was not affected from noVR to groundVR and plankVR. The most significant finding was a drastic decrease in H-reflex during falling (-47 ± 26.9% between noVR and fallingVR, P = 0.015). It is suggested that experiencing a postural threat in VR efficiently modulates spinal excitability, despite remaining in a quiet standing posture. This study suggests that simulated falling mimics the neural adjustments observed during actual postural challenge tasks.NEW & NOTEWORTHY The present study showed a modulation of spinal excitability induced by virtual reality (VR). In the standing position, soleus H-reflex was downmodulated during a simulated falling, in the absence of apparent changes in body oscillations. Since the same behavior is usually observed during real falling, it was suggested that the visual cues provided by VR were sufficiently strong to lead the neuromuscular system to mimic the actual modulation.

Virtual Reality for Spatial Navigation

Immersive virtual reality (VR) allows its users to experience physical space in a non-physical world. It has developed into a powerful research tool to investigate the neural basis of human spatial navigation as an embodied experience. The task of wayfinding can be carried out by using a wide range of strategies, leading to the recruitment of various sensory modalities and brain areas in real-life scenarios. While traditional desktop-based VR setups primarily focus on vision-based navigation, immersive VR setups, especially mobile variants, can efficiently account for motor processes that constitute locomotion in the physical world, such as head-turning and walking. When used in combination with mobile neuroimaging methods, immersive VR affords a natural mode of locomotion and high immersion in experimental settings, designing an embodied spatial experience. This in turn facilitates ecologically valid investigation of the neural underpinnings of spatial navigation.

Predicting the Quality of Spatial Learning via Virtual Global Landmarks

Analyzing the effects landmarks have on spatial learning is an active area of research in the study of human navigation processes and one that is key to understanding the links between human brain dynamics, landmark encoding, and spatial learning outcomes. This article presents a study on whether electroencephalography (EEG) signals related to virtual global landmarks combined with deep learning can be used to predict the accuracy and efficacy of spatial learning. Virtual global landmarks are silhouettes of actual landmarks projected into the navigator's vision via a heads-up display. They serve as a notable frame of reference in addition to the local landmarks we all typically use for route navigation. From a mobile virtual reality scenario involving 55 participants, the results of the study suggest that the EEG data associated with those who were exposed to global landmarks shows a visibly better capacity for predicting the quality of spatial learning levels than those who were not. As such, the EEG features associated with processing VGLs have a greater functional relation to the quality of spatial learning. This finding opens up a future direction of enquiry into landmark encoding and navigational ability. It may also provide a potential avenue for the early diagnosis of Alzheimer's disease.

Redesigning navigational aids using virtual global landmarks to improve spatial knowledge retrieval

Although beacon- and map-based spatial strategies are the default strategies for navigation activities, today's navigational aids mostly follow a beacon-based design where one is provided with turn-by-turn instructions. Recent research, however, shows that our reliance on these navigational aids is causing a decline in our spatial skills. We are processing less of our surrounding environment and relying too heavily on the instructions given. To reverse this decline, we need to engage more in map-based learning, which encourages the user to process and integrate spatial knowledge into a cognitive map built to benefit flexible and independent spatial navigation behaviour. In an attempt to curb our loss of skills, we proposed a navigation assistant to support map-based learning during active navigation. Called the virtual global landmark (VGL) system, this augmented reality (AR) system is based on the kinds of techniques used in traditional orienteering. Specifically, a notable landmark is always present in the user's sight, allowing the user to continuously compute where they are in relation to that specific location. The efficacy of the unit as a navigational aid was tested in an experiment with 27 students from the University of Technology Sydney via a comparison of brain dynamics and behaviour. From an analysis of behaviour and event-related spectral perturbation, we found that participants were encouraged to process more spatial information with a map-based strategy where a silhouette of the compass-like landmark was perpetually in view. As a result of this technique, they consistently navigated with greater efficiency and better accuracy.

Context effects on object recognition in real-world environments: A study protocol

Background: The environments that we live in impact on our ability to recognise objects, with recognition being facilitated when objects appear in expected locations (congruent) compared to unexpected locations (incongruent). However, these findings are based on experiments where the object is isolated from its environment. Moreover, it is not clear which components of the recognition process are impacted by the environment. In this experiment, we seek to examine the impact real world environments have on object recognition. Specifically, we will use mobile electroencephalography (mEEG) and augmented reality (AR) to investigate how the visual and semantic processing aspects of object recognition are changed by the environment. Methods: We will use AR to place congruent and incongruent virtual objects around indoor and outdoor environments. During the experiment a total of 34 participants will walk around the environments and find these objects while we record their eye movements and neural signals. We will perform two primary analyses. First, we will analyse the event-related potential (ERP) data using paired samples t-tests in the N300/400 time windows in an attempt to replicate congruency effects on the N300/400. Second, we will use representational similarity analysis (RSA) and computational models of vision and semantics to determine how visual and semantic processes are changed by congruency. Conclusions: Based on previous literature, we hypothesise that scene-object congruence would facilitate object recognition. For ERPs, we predict a congruency effect in the N300/N400, and for RSA we predict that higher level visual and semantic information will be represented earlier for congruent scenes than incongruent scenes. By collecting mEEG data while participants are exploring a real-world environment, we will be able to determine the impact of a natural context on object recognition, and the different processing stages of object recognition.

Scalp recorded theta activity is modulated by reward, direction, and speed during virtual navigation in freely moving humans

Theta oscillations (~ 4–12 Hz) are dynamically modulated by speed and direction in freely moving animals. However, due to the paucity of electrophysiological recordings of freely moving humans, this mechanism remains poorly understood. Here, we combined mobile-EEG with fully immersive virtual-reality to investigate theta dynamics in 22 healthy adults (aged 18–29 years old) freely navigating a T-maze to find rewards. Our results revealed three dynamic periods of theta modulation: (1) theta power increases coincided with the participants’ decision-making period; (2) theta power increased for fast and leftward trials as subjects approached the goal location; and (3) feedback onset evoked two phase-locked theta bursts over the right temporal and frontal-midline channels. These results suggest that recording scalp EEG in freely moving humans navigating a simple virtual T-maze can be utilized as a powerful translational model by which to map theta dynamics during “real-life” goal-directed behavior in both health and disease.

Future trends in brain aging research: Visuo-cognitive functions at stake during mobility and spatial navigation

Aging leads to a complex pattern of structural and functional changes, gradually affecting sensorimotor, perceptual, and cognitive processes. These multiscale changes can hinder older adults' interaction with their environment, progressively reducing their autonomy in performing tasks relevant to everyday life. Autonomy loss can further be aggravated by the onset and progression of neurodegenerative disorders (e.g., age-related macular degeneration at the sensory input level; and Alzheimer's disease at the cognitive level). In this context, spatial cognition offers a representative case of high-level brain function that involves multimodal sensory processing, postural control, locomotion, spatial orientation, and wayfinding capabilities. Hence, studying spatial behavior and its neural bases can help identify early markers of pathogenic age-related processes. Until now, the neural correlates of spatial cognition have mostly been studied in static conditions thereby disregarding perceptual (other than visual) and motor aspects of natural navigation. In this review, we first demonstrate how visuo-motor integration and the allocation of cognitive resources during locomotion lie at the heart of real-world spatial navigation. Second, we present how technological advances such as immersive virtual reality and mobile neuroimaging solutions can enable researchers to explore the interplay between perception and action. Finally, we argue that the future of brain aging research in spatial navigation demands a widespread shift toward the use of naturalistic, ecologically valid experimental paradigms to address the challenges of mobility and autonomy decline across the lifespan.

Time to move: Brain dynamics underlying natural action and cognition

Advances in Mobile Brain/Body Imaging (MoBI) technology allows for real-time measurements of human brain dynamics during every day, natural, real-life situations. This special issue Time to Move brings together a collection of experimental papers, targeted reviews and opinion articles that lay out the latest MoBI findings. A wide range of topics across different fields are covered including art, athletics, virtual reality, and mobility. What unites these diverse topics is the common goal to enhance and restore human abilities by reaching a better understanding on how cognition is implemented by the brain-body relationship. The breadth and novelty of paradigms and findings reported here positions MoBI as a new frontier in the field of human cognitive neuroscience.

Correcting whole-body motion capture data using rigid body transformation

Using motion capture data as a part of mobile brain-body imaging (MoBI) recording has been increasing. With minimal linear algebra background, this paper explains how the rigid body transformation can be a useful preprocessing step for denoising and missing marker recovery. Such a transformation can provide insight and necessary-and-sufficient solutions requiring no assumption other than the minimum number of markers present. First, a simulation test using the empirical datasets from the AudioMaze project published from this journal's same volume demonstrates theoretical accuracy. The simulation results show that the rigid-body method perfectly recovers missing markers on a rigid body if a minimum of three marker positions is available. Second, the same transformation is applied to the empirical dataset. Before preprocessing, the raw data show that 15-80% of data frames had all markers present for rigid-body defined body parts. After using the rigid-body correction, most body parts recovered full markers in 90-95% of the data frames. The result also suggests the necessity for performing across-trial corrections for within-participant (42% missing detected in one of the body parts) and across-participants (11% missing). The discussion section introduces a solution and a performance summary for non-rigid-body marker correction using a neural network. Data support that the rigid body transformation is an intuitive and powerful correction method necessary for preprocessing motion capture data for neurocognitive experiments. The supporting information section contains a URL link to Matlab code and example data.