Predicting fixations and gaze location from EEG

Brain signals carry cognitive information that can be relevant in downstream tasks, but what about eye-gaze? Although this can be estimated with eye-trackers, it can be very convenient in practice to do it without extra equipment. We consider the challenging tasks of fixation prediction and gaze estimation from electroencephalography (EEG) using deep learning models. We argue that there are three critical design criteria when designing neural architectures for EEG: (1) the spatial and temporal dimensions of the data, (2) the local vs global nature of the data processing, and (3) the overall structure and order with which the steps (1) and (2) are orchestrated. We propose two model architectures, based on Transformers and LSTMs, with different variants in this large design space, and compare them with recent state-of-the-art (SOTA) approaches under two constraints: reduced EEG signal length and reduced set of EEG channels. Our Transformer-based model outperforms the LSTM-only model, but it turns out to be more sensitive with short signal lengths and with less number of channels. Interestingly, our results are similar or slightly better than SOTA, and the models are trained from scratch (i.e., without pre-training or fine-tuning). Our findings provide useful insights for advancing in eye-from-EEG tasks.

Non-invasive canine electroencephalography (EEG): a systematic review

The emerging field of canine cognitive neuroscience uses neuroimaging tools such as electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) to map the cognitive processes of dogs to neural substrates in their brain. Within the past decade, the non-invasive use of EEG has provided real-time, accessible, and portable neuroimaging insight into canine cognitive processes. To promote systematization and create an overview of framings, methods and findings for future work, we provide a systematic review of non-invasive canine EEG studies (N=22), dissecting their study makeup, technical setup, and analysis frameworks and highlighting emerging trends. We further propose new directions of development, such as the standardization of data structures and integrating predictive modeling with descriptive statistical approaches. Our review ends by underscoring the advances and advantages of EEG-based canine cognitive neuroscience and the potential for accessible canine neuroimaging to inform both fundamental sciences as well as practical applications for cognitive neuroscience, working dogs, and human-canine interactions.

Electrocortical activity during resistance exercises in healthy young adults-a systematic review

Introduction

Resistance training (RT) is known to induce both peripheral and central adaptations, resulting in enhanced strength, sports performance, and health benefits. These adaptations are specific to the training stimuli. The acute cortical mechanisms of single sessions resistance exercise (RE) are not yet understood. Therefore, this review investigates the electrocortical activity during acute RE regarding the specific RE stimuli.

Methods

A systematic literature search was conducted across three databases, focusing on the acute electrocortical activity associated with the muscle contraction type, load, and volume of RE in healthy young adults.

Results

Out of an initial 1,332 hits, 19 studies were included for data synthesis. The findings from these studies show that the RE load, contraction type, and volume during RE significantly affect brain activity. The current literature exhibits methodological heterogeneity attributed to variations in study quality, differences in the location of cortical sources, the cortical outcome parameter and the use of diverse training interventions.

Discussion

Despite inconsistencies in the current literature, this review highlights the need to investigate time and frequency-specific characteristics when examining electrocortical activity during RE. More research is necessary to further explore the acute cortical mechanisms related to resistance exercise. Future research could improve our understanding of acute neural responses to RE and provide insights into mechanism underlying more long-term neuroplastic adaptations to RT.

Motor interference on lateral pelvis shifting towards the paretic leg during walking and its cortical mechanisms in persons with stroke

Motor interference, where new skill acquisition disrupts the performance of a previously learned skill, is a critical yet underexplored factor in gait rehabilitation post-stroke. This study investigates the interference effects of two different practice schedules, applying interleaved (ABA condition) and intermittent (A-A condition) pulling force to the pelvis during treadmill walking, on lateral pelvis shifting towards the paretic leg in individuals with stroke. Task A involved applying resistive pelvis force (pulling towards the non-paretic side), and Task B applied assistive force (pulling towards the paretic side) at the stance phase of the paretic leg during walking. Sixteen individuals with chronic stroke were tested for gait pattern changes, including lateral pelvis shifting and spatiotemporal gait parameters, and neurophysiological changes, including muscle activity in the paretic leg and beta band absolute power in the lesioned cortical areas. A-A condition demonstrated increased lateral pelvis shifting towards the paretic side, extended paretic stance time and longer non-paretic step length after force release while ABA condition did not show any changes. These changes in gait pattern after A-A condition were accompanied by increased muscle activities of the ankle plantarflexors, and hip adductors/abductors. A-A condition demonstrated greater changes in beta band power in the sensorimotor regions compared to ABA condition. These findings suggest that while walking practice with external force to the pelvis can improve lateral pelvis shifting towards the paretic leg post-stroke, practicing a new pelvis shifting task in close succession may hinder the performance of a previously obtained lateral pelvis shifting pattern during walking.

Mobile EEG for the study of cognitive-motor interference during swimming?

Research on brain function in natural environments has become a new interest in cognitive science. In this study, we aim to advance mobile electroencephalography (EEG) participant and device mobility. We investigated the feasibility of measuring human brain activity using mobile EEG during a full-body motion task as swimming, by the example of cognitive-motor interference (CMI). Eleven participants were given an auditory oddball task while sitting and swimming, with mobile EEG recording ongoing brain activity. Measures of interest were event-related potentials (ERPs) elicited by experimental stimuli. While the auditory N100 was measured to verify signal quality, the P300 to task-relevant stimuli served as a marker of CMI effects. Analyzes were first performed within subjects, while binomial tests assessed the proportion of significant effects. Event-related changes in the time-frequency domain around turns during swimming were analyzed in an exploratory fashion. The successful recording of the N100 in all conditions shows that the setup was functional throughout the experiment. Regarding CMI, we did not find reliable changes in P300 amplitude in different motor settings in all subjects. However, we found plausible modulations in the alpha/mu and beta bands before and after turns. This study shows that it is generally feasible to measure mobile EEG in the time and time-frequency domain in an aquatic environment while subjects are freely moving. We see promising potential in the use of mobile EEG in extreme settings, advancing toward the application of mobile EEG in more real-life situations.

Evaluation of a headphones-fitted EEG system for the recording of auditory evoked potentials and mental workload assessment

Advancements in portable neuroimaging technologies open up new opportunities to gain insight into the neural dynamics and cognitive processes underlying day-to-day behaviors. In this study, we evaluated the relevance of a headphone- mounted electroencephalogram (EEG) system for monitoring mental workload. The participants (N = 12) were instructed to pay attention to auditory alarms presented sporadically while performing the Multi-Attribute Task Battery (MATB) whose difficulty was staged across three conditions to manipulate mental workload. The P300 Event-Related Potentials (ERP) elicited by the presentation of auditory alarms were used as probes of attentional resources available. The amplitude and latency of P300 ERPs were compared across experimental conditions. Our findings indicate that the P300 ERP component can be captured using a headphone-mounted EEG system. Moreover, neural responses to alarm could be used to classify mental workload with high accuracy (over 80%) at a single-trial level. Our analyses indicated that the signal-to-noise ratio acquired by the sponge-based sensors remained stable throughout the recordings. These results highlight the potential of portable neuroimaging technology for the development of neuroassistive applications while underscoring the current limitations and challenges associated with the integration of EEG sensors in everyday-life wearable technologies. Overall, our study contributes to the growing body of research exploring the feasibility and validity of wearable neuroimaging technologies for the study of human cognition and behavior in real-world settings.

A Dynamical Systems Approach to Characterizing Brain-Body Interactions during Movement: Challenges, Interpretations, and Recommendations

Brain-body interactions (BBIs) have been the focus of intense scrutiny since the inception of the scientific method, playing a foundational role in the earliest debates over the philosophy of science. Contemporary investigations of BBIs to elucidate the neural principles of motor control have benefited from advances in neuroimaging, device engineering, and signal processing. However, these studies generally suffer from two major limitations. First, they rely on interpretations of 'brain' activity that are behavioral in nature, rather than neuroanatomical or biophysical. Second, they employ methodological approaches that are inconsistent with a dynamical systems approach to neuromotor control. These limitations represent a fundamental challenge to the use of BBIs for answering basic and applied research questions in neuroimaging and neurorehabilitation. Thus, this review is written as a tutorial to address both limitations for those interested in studying BBIs through a dynamical systems lens. First, we outline current best practices for acquiring, interpreting, and cleaning scalp-measured electroencephalography (EEG) acquired during whole-body movement. Second, we discuss historical and current theories for modeling EEG and kinematic data as dynamical systems. Third, we provide worked examples from both canonical model systems and from empirical EEG and kinematic data collected from two subjects during an overground walking task.

Learning neural decoders without labels using multiple data streams

OBJECTIVE

Recent advances in neural decoding have accelerated the development of brain-computer interfaces aimed at assisting users with everyday tasks such as speaking, walking, and manipulating objects. However, current approaches for training neural decoders commonly require large quantities of labeled data, which can be laborious or infeasible to obtain in real-world settings. Alternatively, self-supervised models that share self-generated pseudo-labels between two data streams have shown exceptional performance on unlabeled audio and video data, but it remains unclear how well they extend to neural decoding.

APPROACH

We learn neural decoders without labels by leveraging multiple simultaneously recorded data streams, including neural, kinematic, and physiological signals. Specifically, we apply cross-modal, self-supervised deep clustering to train decoders that can classify movements from brain recordings. After training, we then isolate the decoders for each input data stream and compare the accuracy of decoders trained using cross-modal deep clustering against supervised and unimodal, self-supervised models.

MAIN RESULTS

We find that sharing pseudo-labels between two data streams during training substantially increases decoding performance compared to unimodal, self-supervised models, with accuracies approaching those of supervised decoders trained on labeled data. Next, we extend cross-modal decoder training to three or more modalities, achieving state-of-the-art neural decoding accuracy that matches or slightly exceeds the performance of supervised models. Significance: We demonstrate that cross-modal, self-supervised decoding can be applied to train neural decoders when few or no labels are available and extend the cross-modal framework to share information among three or more data streams, further improving self-supervised training.

Spatiotemporal patterns of spontaneous brain activity: a mini-review

The brain exists in a state of constant activity in the absence of any external sensory input. The spatiotemporal patterns of this spontaneous brain activity have been studied using various recording and imaging techniques. This has enabled considerable progress to be made in elucidating the cellular and network mechanisms that are involved in the observed spatiotemporal dynamics. This mini-review outlines different spatiotemporal dynamic patterns that have been identified in four commonly used modalities: electrophysiological recordings, optical imaging, functional magnetic resonance imaging, and electroencephalography. Signal sources for each modality, possible sources of the observed dynamics, and future directions are also discussed.

Removal of movement-induced EEG artifacts: current state of the art and guidelines

Electroencephalography (EEG) is a non-invasive technique used to record cortical neurons' electrical activity using electrodes placed on the scalp. It has become a promising avenue for research beyond state-of-the-art EEG research that is conducted under static conditions. EEG signals are always contaminated by artifacts and other physiological signals. Artifact contamination increases with the intensity of movement. In the last decade (since 2010), researchers have started to implement EEG measurements in dynamic setups to increase the overall ecological validity of the studies. Many different methods are used to remove non-brain activity from the EEG signal, and there are no clear guidelines on which method should be used in dynamic setups and for specific movement intensities. Currently, the most common methods for removing artifacts in movement studies are methods based on independent component analysis (ICA). However, the choice of method for artifact removal depends on the type and intensity of movement, which affects the characteristics of the artifacts and the EEG parameters of interest. When dealing with EEG under non-static conditions, special care must be taken already in the designing period of an experiment. Software and hardware solutions must be combined to achieve sufficient removal of unwanted signals from EEG measurements. We have provided recommendations for the use of each method depending on the intensity of the movement and highlighted the advantages and disadvantages of the methods. However, due to the current gap in the literature, further development and evaluation of methods for artifact removal in EEG data during locomotion is needed.

Scalp recorded theta activity is modulated by reward, direction, and speed during virtual navigation in freely moving humans

Theta oscillations (~ 4–12 Hz) are dynamically modulated by speed and direction in freely moving animals. However, due to the paucity of electrophysiological recordings of freely moving humans, this mechanism remains poorly understood. Here, we combined mobile-EEG with fully immersive virtual-reality to investigate theta dynamics in 22 healthy adults (aged 18–29 years old) freely navigating a T-maze to find rewards. Our results revealed three dynamic periods of theta modulation: (1) theta power increases coincided with the participants’ decision-making period; (2) theta power increased for fast and leftward trials as subjects approached the goal location; and (3) feedback onset evoked two phase-locked theta bursts over the right temporal and frontal-midline channels. These results suggest that recording scalp EEG in freely moving humans navigating a simple virtual T-maze can be utilized as a powerful translational model by which to map theta dynamics during “real-life” goal-directed behavior in both health and disease.

Do Histories of Painful Life Experiences Affect the Expression of Empathy Among Young Adults? An Electroencephalography Study

Previous research suggests that prior experience of pain affects the expression of empathy. However, most of these studies attended to physical pain despite evidence indicating that other forms of pain may also affect brain activity and emotional states in similar ways. To address this limitation, we compared empathic responses of 33 participants, some of whom had experienced a personal loss, across three conditions: observing strangers in physical pain, psychological pain, and a non-painful condition. We also examined the effect of presence of prior painful experience on empathic reactions. In addition, we examined the stimulation type, prior experience, and ERPs in the early Late Positive Potential (300-550 ms), late Late Positive Potential (550-800 ms), and very late Late Positive Potential (VLLPP; 800-1,050 ms) time windows. Behavioral data indicated that participants who had personally experienced a loss scored significantly higher on perspective taking in the psychological-pain condition. ERP results also indicated significantly lower intensity in Fp2, an electrode in the prefrontal region, within VLLPP time window for participants experiencing a loss in the psychological-pain condition. The results of both behavioral and ERP analysis indicated that prior experience of psychological pain is related to cognitive empathy, but not affective empathy. The implication of these findings for research on empathy, for the study of psychological pain, and the moderating influence of prior painful experiences are discussed.

Uncovering biomarkers during therapeutic neuromodulation with PARRM: Period-based Artifact Reconstruction and Removal Method

Advances in therapeutic neuromodulation devices have enabled concurrent stimulation and electrophysiology in the central nervous system. However, stimulation artifacts often obscure the sensed underlying neural activity. Here, we develop a method, termed Period-based Artifact Reconstruction and Removal Method (PARRM), to remove stimulation artifacts from neural recordings by leveraging the exact period of stimulation to construct and subtract a high-fidelity template of the artifact. Benchtop saline experiments, computational simulations, five unique in vivo paradigms across animal and human studies, and an obscured movement biomarker are used for validation. Performance is found to exceed that of state-of-the-art filters in recovering complex signals without introducing contamination. PARRM has several advantages: (1) it is superior in signal recovery; (2) it is easily adaptable to several neurostimulation paradigms; and (3) it has low complexity for future on-device implementation. Real-time artifact removal via PARRM will enable unbiased exploration and detection of neural biomarkers to enhance efficacy of closed-loop therapies.

An Analysis of the External Validity of EEG Spectral Power in an Uncontrolled Outdoor Environment during Default and Complex Neurocognitive States

Traditionally, quantitative electroencephalography (QEEG) studies collect data within controlled laboratory environments that limit the external validity of scientific conclusions. To probe these validity limits, we used a mobile EEG system to record electrophysiological signals from human participants while they were located within a controlled laboratory environment and an uncontrolled outdoor environment exhibiting several moderate background influences. Participants performed two tasks during these recordings, one engaging brain activity related to several complex cognitive functions (number sense, attention, memory, executive function) and the other engaging two default brain states. We computed EEG spectral power over three frequency bands (theta: 4-7 Hz, alpha: 8-13 Hz, low beta: 14-20 Hz) where EEG oscillatory activity is known to correlate with the neurocognitive states engaged by these tasks. Null hypothesis significance testing yielded significant EEG power effects typical of the neurocognitive states engaged by each task, but only a beta-band power difference between the two background recording environments during the default brain state. Bayesian analysis showed that the remaining environment null effects were unlikely to reflect measurement insensitivities. This overall pattern of results supports the external validity of laboratory EEG power findings for complex and default neurocognitive states engaged within moderately uncontrolled environments.

Overground Walking Decreases Alpha Activity and Entrains Eye Movements in Humans

Experiments in animal models have shown that running increases neuronal activity in early visual areas in light as well as in darkness. This suggests that visual processing is influenced by locomotion independent of visual input. Combining mobile electroencephalography, motion- and eye-tracking, we investigated the influence of overground free walking on cortical alpha activity (~10 Hz) and eye movements in healthy humans. Alpha activity has been considered a valuable marker of inhibition of sensory processing and shown to negatively correlate with neuronal firing rates. We found that walking led to a decrease in alpha activity over occipital cortex compared to standing. This decrease was present during walking in darkness as well as during light. Importantly, eye movements could not explain the change in alpha activity. Nevertheless, we found that walking and eye related movements were linked. While the blink rate increased with increasing walking speed independent of light or darkness, saccade rate was only significantly linked to walking speed in the light. Pupil size, on the other hand, was larger during darkness than during light, but only showed a modulation by walking in darkness. Analyzing the effect of walking with respect to the stride cycle, we further found that blinks and saccades preferentially occurred during the double support phase of walking. Alpha power, as shown previously, was lower during the swing phase than during the double support phase. We however could exclude the possibility that the alpha modulation was introduced by a walking movement induced change in electrode impedance. Overall, our work indicates that the human visual system is influenced by the current locomotion state of the body. This influence affects eye movement pattern as well as neuronal activity in sensory areas and might form part of an implicit strategy to optimally extract sensory information during locomotion.

A Bipolar-Channel Hybrid Brain-Computer Interface System for Home Automation Control Utilizing Steady-State Visually Evoked Potential and Eye-Blink Signals

The goal of this study was to develop and validate a hybrid brain-computer interface (BCI) system for home automation control. Over the past decade, BCIs represent a promising possibility in the field of medical (e.g., neuronal rehabilitation), educational, mind reading, and remote communication. However, BCI is still difficult to use in daily life because of the challenges of the unfriendly head device, lower classification accuracy, high cost, and complex operation. In this study, we propose a hybrid BCI system for home automation control with two brain signals acquiring electrodes and simple tasks, which only requires the subject to focus on the stimulus and eye blink. The stimulus is utilized to select commands by generating steady-state visually evoked potential (SSVEP). The single eye blinks (i.e., confirm the selection) and double eye blinks (i.e., deny and re-selection) are employed to calibrate the SSVEP command. Besides that, the short-time Fourier transform and convolution neural network algorithms are utilized for feature extraction and classification, respectively. The results show that the proposed system could provide 38 control commands with a 2 s time window and a good accuracy (i.e., 96.92%) using one bipolar electroencephalogram (EEG) channel. This work presents a novel BCI approach for the home automation application based on SSVEP and eye blink signals, which could be useful for the disabled. In addition, the provided strategy of this study—a friendly channel configuration (i.e., one bipolar EEG channel), high accuracy, multiple commands, and short response time—might also offer a reference for the other BCI controlled applications.

Effect of the Neurofeedback-EEG Training During Physical Exercise on the Range of Mental Work Performance and Individual Physiological Parameters in Swimmers

The aim of the study was to demonstrate the effects of the Neurofeedback-EEG training during physical exercise on the improvements in mental work performance and physiological parameters. The study examined seven swimmers based on the following anthropometric measurements: body height, body mass and body composition. The Kraepelin's work curve test, EEG and EMG during physical exercise were also performed. The athletes followed 20 Neurofeedback-EEG training sessions on the swimming ergometer for 4 months. Most mean indices of partial measures of the work curve were significantly modified (p < 0.05) following the Neurofeedback-EEG training. Mean level of maximal oxygen uptake in study participants was over 55 ml/kg/min, with statistically significant differences documented between the first and the second measurements. No significant differences were found in the fatigue rate between the measurements 1 and 2. The improved mental work performance following the Neurofeedback-EEG training facilitates optimization of psychomotor activities.

Corticomuscular control of walking in older people and people with Parkinson's disease

Changes in human gait resulting from ageing or neurodegenerative diseases are multifactorial. Here we assess the effects of age and Parkinson’s disease (PD) on corticospinal activity recorded during treadmill and overground walking. Electroencephalography (EEG) from 10 electrodes and electromyography (EMG) from bilateral tibialis anterior muscles were acquired from 22 healthy young, 24 healthy older and 20 adults with PD. Event-related power, corticomuscular coherence (CMC) and inter-trial coherence were assessed for EEG from bilateral sensorimotor cortices and EMG during the double-support phase of the gait cycle. CMC and EMG power at low beta frequencies (13–21 Hz) was significantly decreased in older and PD participants compared to young people, but there was no difference between older and PD groups. Older and PD participants spent shorter time in the swing phase than young individuals. These findings indicate age-related changes in the temporal coordination of gait. The decrease in low-beta CMC suggests reduced cortical input to spinal motor neurons in older people during the double-support phase. We also observed multiple changes in electrophysiological measures at low-gamma frequencies during treadmill compared to overground walking, indicating task-dependent differences in corticospinal locomotor control. These findings may be affected by artefacts and should be interpreted with caution.

Extensive Analysis of a Real-Time Dense Wired Sensor Network Based on Traffic Shaping

XDense is a novel wired 2D mesh grid sensor network system for application scenarios that benefit from densely deployed sensing (e.g., thousands of sensors per square meter). It was conceived for cyber-physical systems that require real-time sensing and actuation, like active flow control on aircraft wing surfaces. XDense communication and distributed processing capabilities are designed to enable complex feature extraction within bounded time and in a responsive manner. In this article, we tackle the issue of deterministic behavior of XDense. We present a methodology that uses traffic-shaping heuristics to guarantee bounded communication delays and the fulfillment of memory requirements. We evaluate the model for varied network configurations and workload, and present a comparative performance analysis in terms of link utilization, queue size, and execution time. With the proposed traffic-shaping heuristics, we endow XDense with the capabilities required for real-time applications.

The Cognitive Demands of Gait Retraining in Runners: An EEG Study

High impact forces during running have been associated with tibial stress injuries. Previous research has demonstrated increasing step rate will decrease impact forces during running. However, no research has determined the cognitive demand of gait retraining. The primary purpose was to determine the cognitive demand and effectiveness of field-based gait retraining. We hypothesized that in-field gait retraining would alter running mechanics without increasing cognitive workload as measured by EEG following learning. Runners with a history of tibial injury completed a gait retraining protocol which included a baseline run, retraining phase, practice phase, and re-assessment following retraining protocol. Results demonstrated an increase in the theta, beta, and gamma power within prefrontal cortex during new learning and corresponding return to baseline following skill acquisition and changes across alpha, beta, gamma, mu, and theta in the motor cortex (p < .05). In the midline superior parietal cortex, spectral power was greater for theta activity during new learning with a corresponding alpha suppression. Overall, the results demonstrated the use of EEG as an effective tool to measure cognitive demand for implicit motor learning and the effectiveness of in-field gait retraining.

EEG time-frequency analysis provides arguments for arm swing support in human gait control

BACKGROUND

Human gait benefits from arm swing, which requires four-limb co-ordination. The Supplementary Motor Area (SMA) is involved in multi-limb coordination. With its location anterior to the leg motor cortex and the pattern of its connections, this suggests a distinct role in gait control.

RESEARCH QUESTION

Is the SMA functionally implicated in gait-related arm swing?

METHODS

Ambulant electroencephalography (EEG) was employed during walking with and without arm swing in twenty healthy subjects (mean age: 64.9yrs, SD 7.2). Power changes across the EEG frequency spectrum were assessed by Event Related Spectral Perturbation (ERSP) analysis over both the putative SMA at electrode position Fz and additional sensorimotor regions.

RESULTS

During walking with arm swing, midline electrodes Fz and Cz showed a step-related pattern of Event Related Desynchronization (ERD) followed by Event Related Synchronization (ERS). Walking without arm swing was associated with significant ERD-ERS power reduction in the high-beta/low-gamma band over Fz and a power increase over Cz. Electrodes C3 and C4 revealed a pattern of ERD during contralateral- and ERS during ipsilateral leg swing. This ERD power decreased in gait without arm swing (low-frequency band). The ERSP pattern during walking with arm swing was similar at CP1 and CP2: ERD was seen during double support and the initial swing phase of the right leg, while a strong ERS emerged during the second half of the left leg's swing. Walking without arm swing showed a significant power reduction of this ERD-ERS pattern over CP2, while over CP1, ERS during left leg's swing turned into ERD.

CONCLUSION

The relation between arm swing in walking and a step-related ERD-ERS pattern in the high-beta/low-gamma band over the putative SMA, points at an SMA contribution to integrated cyclic anti-phase movements of upper- and lower limbs. This supports a cortical underpinning of arm swing support in gait control.

Individual EEG measures of attention, memory, and motivation predict population level TV viewership and Twitter engagement

Television (TV) programming attracts ever-growing audiences and dominates the cultural zeitgeist. Viewership and social media engagement have become standard indices of programming success. However, accurately predicting individual episode success or future show performance using traditional metrics remains a challenge. Here we examine whether TV viewership and Twitter activity can be predicted using electroencephalography (EEG) measures, which are less affected by reporting biases and which are commonly associated with different cognitive processes. 331 participants watched an hour-long episode from one of nine prime-time shows (~36 participants per episode). Three frequency-based measures were extracted: fronto-central alpha/beta asymmetry (indexing approach motivation), fronto-central alpha/theta power (indexing attention), and fronto-central theta/gamma power (indexing memory processing). All three EEG measures and the composite EEG score significantly correlated across episode segments with the two behavioral measures of TV viewership and Twitter volume. EEG measures explained more variance than either of the behavioral metrics and mediated the relationship between the two. Attentional focus was integral for both audience retention and Twitter activity, while emotional motivation was specifically linked with social engagement and program segments with high TV viewership. These findings highlight the viability of using EEG measures to predict success of TV programming and identify cognitive processes that contribute to audience engagement with television shows.

Tracking Economic Value of Products in Natural Settings: A Wireless EEG Study

Economic decision making refers to the process of individuals translating their preference into subjective value (SV). Little is known about the dynamics of the neural processes that underpin this form of value-based decision making and no studies have investigated these processes outside of controlled laboratory settings. The current study investigated the spatio-temporal dynamics that accompany economic valuation of products using mobile electroencephalography (EEG) and eye tracking techniques. Participants viewed and rated images of household products in a gallery setting while EEG and eye tracking data were collected wirelessly. A Becker-DeGroot-Marschak (BDM) auction task was subsequently used to quantify the individual's willingness to pay (WTP) for each product. WTP was used to classify products into low, low medium, high medium and high economic value conditions. Eye movement related potentials (EMRP) were examined, and independent component analysis (ICA) was used to separate sources of activity from grand averaged EEG data. Four independent components (ICs) of EMRPs were modulated by WTP (i.e., SV) in the latency range of 150-250 ms. Of the four value-sensitive ICs, one IC displayed enhanced amplitude for all value conditions excluding low value, and another IC presented enhanced amplitude for low value products only. The remaining two value-sensitive ICs resolved inter-mediate levels of SV. Our study quantified, for the first time, the neural processes involved in economic value based decisions in a natural setting. Results suggest that multiple spatio-temporal brain activation patterns mediate the attention and aversion of products which could reflect an early valuation system. The EMRP parietal P200 component could reflect an attention allocation mechanism that separates the lowest-value products (IC7) from products of all other value (IC4), suggesting that low-value items are categorized early on as being aversive. While none of the ICs showed linear amplitude changes that parallel SV's of products, results suggest that a combination of multiple components may sub-serve a fine-grained resolution of the SV of products.

Cortical activity during walking and balance tasks in older adults and in people with Parkinson's disease: A structured review

An emerging body of literature has examined cortical activity during walking and balance tasks in older adults and in people with Parkinson's disease, specifically using functional near infrared spectroscopy (fNIRS) or electroencephalography (EEG). This review provides an overview of this developing area, and examines the disease-specific mechanisms underlying walking or balance deficits. Medline, PubMed, PsychInfo and Scopus databases were searched. Articles that described cortical activity during walking and balance tasks in older adults and in those with PD were screened by the reviewers. Thirty-seven full-text articles were included for review, following an initial yield of 566 studies. This review summarizes study findings, where increased cortical activity appears to be required for older adults and further for participants with PD to perform walking and balance tasks, but specific activation patterns vary with the demands of the particular task. Studies attributed cortical activation to compensatory mechanisms for underlying age- or PD-related deficits in automatic movement control. However, a lack of standardization within the reviewed studies was evident from the wide range of study protocols, instruments, regions of interest, outcomes and interpretation of outcomes that were reported. Unstandardized data collection, processing and reporting limited the clinical relevance and interpretation of study findings. Future work to standardize approaches to the measurement of cortical activity during walking and balance tasks in older adults and people with PD with fNIRS and EEG systems is needed, which will allow direct comparison of results and ensure robust data collection/reporting. Based on the reviewed articles we provide clinical and future research recommendations.

EEG correlates of sensorimotor processing: independent components involved in sensory and motor processing

Sensorimotor processing is a critical function of the human brain with multiple cortical areas specialised for sensory recognition or motor execution. Although there has been considerable research into sensorimotor control in humans, the steps between sensory recognition and motor execution are not fully understood. To provide insight into brain areas responsible for sensorimotor computation, we used complex categorization-response tasks (variations of a Stroop task requiring recognition, decision-making, and motor responses) to test the hypothesis that some functional modules are participating in both sensory as well as motor processing. We operationalize functional modules as independent components (ICs) yielded by an independent component analysis (ICA) of EEG data and measured event-related responses by means of inter-trial coherence (ITC). Our results consistently found ICs with event-related ITC responses related to both sensory stimulation and motor response onsets (on average 5.8 ICs per session). These findings reveal EEG correlates of tightly coupled sensorimotor processing in the human brain, and support frameworks like embodied cognition, common coding, and sensorimotor contingency that do not sequentially separate sensory and motor brain processes.

Independent Component Analysis and Source Localization on Mobile EEG Data Can Identify Increased Levels of Acute Stress

Mobile electroencephalography (EEG) is a very useful tool to investigate the physiological basis of cognition under real-world conditions. However, as we move experimentation into less-constrained environments, the influence of state changes increases. The influence of stress on cortical activity and cognition is an important example. Monitoring of modulation of cortical activity by EEG measurements is a promising tool for assessing acute stress. In this study, we test this hypothesis and combine EEG with independent component analysis and source localization to identify cortical differences between a control condition and a stressful condition. Subjects performed a stationary shooting task using an airsoft rifle with and without the threat of an experimenter firing a different airsoft rifle in their direction. We observed significantly higher skin conductance responses and salivary cortisol levels (p < 0.05 for both) during the stressful conditions, indicating that we had successfully induced an adequate level of acute stress. We located independent components in five regions throughout the cortex, most notably in the dorsolateral prefrontal cortex, a region previously shown to be affected by increased levels of stress. This area showed a significant decrease in spectral power in the theta and alpha bands less than a second after the subjects pulled the trigger. Overall, our results suggest that EEG with independent component analysis and source localization has the potential of monitoring acute stress in real-world environments.

Discriminative Ocular Artifact Correction for Feature Learning in EEG Analysis

Electrooculogram (EOG) artifact contamination is a common critical issue in general electroencephalogram (EEG) studies as well as in brain-computer interface (BCI) research. It is especially challenging when dedicated EOG channels are unavailable or when there are very few EEG channels available for independent component analysis based ocular artifact removal. It is even more challenging to avoid loss of the signal of interest during the artifact correction process, where the signal of interest can be multiple magnitudes weaker than the artifact. To address these issues, we propose a novel discriminative ocular artifact correction approach for feature learning in EEG analysis. Without extra ocular movement measurements, the artifact is extracted from raw EEG data, which is totally automatic and requires no visual inspection of artifacts. Then, artifact correction is optimized jointly with feature extraction by maximizing oscillatory correlations between trials from the same class and minimizing them between trials from different classes. We evaluate this approach on a real-world EEG dataset comprising 68 subjects performing cognitive tasks. The results showed that the approach is capable of not only suppressing the artifact components but also improving the discriminative power of a classifier with statistical significance. We also demonstrate that the proposed method addresses the confounding issues induced by ocular movements in cognitive EEG study.

Identifying auditory attention with ear-EEG: cEEGrid versus high-density cap-EEG comparison

OBJECTIVE

This study presents a direct comparison of a classical EEG cap setup with a new around-the-ear electrode array (cEEGrid) to gain a better understanding of the potential of ear-centered EEG.

APPROACH

Concurrent EEG was recorded from a classical scalp EEG cap and two cEEGrids that were placed around the left and the right ear. Twenty participants performed a spatial auditory attention task in which three sound streams were presented simultaneously. The sound streams were three seconds long and differed in the direction of origin (front, left, right) and the number of beats (3, 4, 5 respectively), as well as the timbre and pitch. The participants had to attend to either the left or the right sound stream.

MAIN RESULTS

We found clear attention modulated ERP effects reflecting the attended sound stream for both electrode setups, which agreed in morphology and effect size. A single-trial template matching classification showed that the direction of attention could be decoded significantly above chance (50%) for at least 16 out of 20 participants for both systems. The comparably high classification results of the single trial analysis underline the quality of the signal recorded with the cEEGrids.

SIGNIFICANCE

These findings are further evidence for the feasibility of around the-ear EEG recordings and demonstrate that well described ERPs can be measured. We conclude that concealed behind-the-ear EEG recordings can be an alternative to classical cap EEG acquisition for auditory attention monitoring.

Direction and viewing area-sensitive influence of EOG artifacts revealed in the EEG topographic pattern analysis

The influence of eye movement-related artifacts on electroencephalography (EEG) signals of human subjects, who were requested to perform a direction or viewing area dependent saccade task, was investigated by using a simultaneous recording with ocular potentials as electro-oculography (EOG). In the past, EOG artifact removals have been studied in tasks with a single fixation point in the screen center, with less attention to the sensitivity of cornea-retinal dipole orientations to the EEG head map. In the present study, we hypothesized the existence of a systematic EOG influence that differs according to coupling conditions of eye-movement directions with viewing areas including different fixation points. The effect was validated in the linear regression analysis by using 12 task conditions combining horizontal/vertical eye-movement direction and three segregated zones of gaze in the screen. In the first place, event-related potential topographic patterns were analyzed to compare the 12 conditions and propagation coefficients of the linear regression analysis were successively calculated in each condition. As a result, the EOG influences were significantly different in a large number of EEG channels, especially in the case of horizontal eye-movements. In the cross validation, the linear regression analysis using the appropriate dataset of the target direction/viewing area combination demonstrated an improved performance compared with the traditional methods using a single fixation at the center. This result may open a potential way to improve artifact correction methods by considering the systematic EOG influence that can be predicted according to the view angle such as using eye-tracker systems.

SME2EM: Smart mobile end-to-end monitoring architecture for life-long diseases

Monitoring life-long diseases requires continuous measurements and recording of physical vital signs. Most of these diseases are manifested through unexpected and non-uniform occurrences and behaviors. It is impractical to keep patients in hospitals, health-care institutions, or even at home for long periods of time. Monitoring solutions based on smartphones combined with mobile sensors and wireless communication technologies are a potential candidate to support complete mobility-freedom, not only for patients, but also for physicians. However, existing monitoring architectures based on smartphones and modern communication technologies are not suitable to address some challenging issues, such as intensive and big data, resource constraints, data integration, and context awareness in an integrated framework. This manuscript provides a novel mobile-based end-to-end architecture for live monitoring and visualization of life-long diseases. The proposed architecture provides smartness features to cope with continuous monitoring, data explosion, dynamic adaptation, unlimited mobility, and constrained devices resources. The integration of the architecture׳s components provides information about diseases׳ recurrences as soon as they occur to expedite taking necessary actions, and thus prevent severe consequences. Our architecture system is formally model-checked to automatically verify its correctness against designers׳ desirable properties at design time. Its components are fully implemented as Web services with respect to the SOA architecture to be easy to deploy and integrate, and supported by Cloud infrastructure and services to allow high scalability, availability of processes and data being stored and exchanged. The architecture׳s applicability is evaluated through concrete experimental scenarios on monitoring and visualizing states of epileptic diseases. The obtained theoretical and experimental results are very promising and efficiently satisfy the proposed architecture׳s objectives, including resource awareness, smart data integration and visualization, cost reduction, and performance guarantee.

Emotional Reactivity to Visual Content as Revealed by ERP Component Clustering

Abstract. In the study, the neural basis of emotional reactivity was investigated. Reactivity was operationalized as the impact of emotional pictures on the self-reported ongoing affective state. It was used to divide the subjects into high- and low-responders groups. Independent sources of brain activity were identified, localized with the DIPFIT method, and clustered across subjects to analyse the visual evoked potentials to affective pictures. Four of the identified clusters revealed effects of reactivity. The earliest two started about 120 ms from the stimulus onset and were located in the occipital lobe and the right temporoparietal junction. Another two with a latency of 200 ms were found in the orbitofrontal and the right dorsolateral cortices. Additionally, differences in pre-stimulus alpha level over the visual cortex were observed between the groups. The attentional modulation of perceptual processes is proposed as an early source of emotional reactivity, which forms an automatic mechanism of affective control. The role of top-down processes in affective appraisal and, finally, the experience of ongoing emotional states is also discussed.

Human-Robot Interaction: Does Robotic Guidance Force Affect Gait-Related Brain Dynamics during Robot-Assisted Treadmill Walking?

In order to determine optimal training parameters for robot-assisted treadmill walking, it is essential to understand how a robotic device interacts with its wearer, and thus, how parameter settings of the device affect locomotor control. The aim of this study was to assess the effect of different levels of guidance force during robot-assisted treadmill walking on cortical activity. Eighteen healthy subjects walked at 2 km.h-1 on a treadmill with and without assistance of the Lokomat robotic gait orthosis. Event-related spectral perturbations and changes in power spectral density were investigated during unassisted treadmill walking as well as during robot-assisted treadmill walking at 30%, 60% and 100% guidance force (with 0% body weight support). Clustering of independent components revealed three clusters of activity in the sensorimotor cortex during treadmill walking and robot-assisted treadmill walking in healthy subjects. These clusters demonstrated gait-related spectral modulations in the mu, beta and low gamma bands over the sensorimotor cortex related to specific phases of the gait cycle. Moreover, mu and beta rhythms were suppressed in the right primary sensory cortex during treadmill walking compared to robot-assisted treadmill walking with 100% guidance force, indicating significantly larger involvement of the sensorimotor area during treadmill walking compared to robot-assisted treadmill walking. Only marginal differences in the spectral power of the mu, beta and low gamma bands could be identified between robot-assisted treadmill walking with different levels of guidance force. From these results it can be concluded that a high level of guidance force (i.e., 100% guidance force) and thus a less active participation during locomotion should be avoided during robot-assisted treadmill walking. This will optimize the involvement of the sensorimotor cortex which is known to be crucial for motor learning.

Methodological aspects of EEG and body dynamics measurements during motion

EEG involves the recording, analysis, and interpretation of voltages recorded on the human scalp which originate from brain gray matter. EEG is one of the most popular methods of studying and understanding the processes that underlie behavior. This is so, because EEG is relatively cheap, easy to wear, light weight and has high temporal resolution. In terms of behavior, this encompasses actions, such as movements that are performed in response to the environment. However, there are methodological difficulties which can occur when recording EEG during movement such as movement artifacts. Thus, most studies about the human brain have examined activations during static conditions. This article attempts to compile and describe relevant methodological solutions that emerged in order to measure body and brain dynamics during motion. These descriptions cover suggestions on how to avoid and reduce motion artifacts, hardware, software and techniques for synchronously recording EEG, EMG, kinematics, kinetics, and eye movements during motion. Additionally, we present various recording systems, EEG electrodes, caps and methods for determinating real/custom electrode positions. In the end we will conclude that it is possible to record and analyze synchronized brain and body dynamics related to movement or exercise tasks.

Forward and inverse electroencephalographic modeling in health and in acute traumatic brain injury

OBJECTIVE

EEG source localization is demonstrated in three cases of acute traumatic brain injury (TBI) with progressive lesion loads using anatomically faithful models of the head which account for pathology.

METHODS

Multimodal magnetic resonance imaging (MRI) volumes were used to generate head models via the finite element method (FEM). A total of 25 tissue types-including 6 types accounting for pathology-were included. To determine the effects of TBI upon source localization accuracy, a minimum-norm operator was used to perform inverse localization and to determine the accuracy of the latter.

RESULTS

The importance of using a more comprehensive number of tissue types is confirmed in both health and in TBI. Pathology omission is found to cause substantial inaccuracies in EEG forward matrix calculations, with lead field sensitivity being underestimated by as much as ≈ 200% in (peri-) contusional regions when TBI-related changes are ignored. Failing to account for such conductivity changes is found to misestimate substantial localization error by up to 35 mm.

CONCLUSIONS

Changes in head conductivity profiles should be accounted for when performing EEG modeling in acute TBI.

SIGNIFICANCE

Given the challenges of inverse localization in TBI, this framework can benefit neurotrauma patients by providing useful insights on pathophysiology.