Real-Time Neuroimaging and Cognitive Monitoring Using Wearable Dry EEG

Integrated Gait Triggered Mixed Reality and Neurophysiological Monitoring as a Framework for Next-Generation Ambulatory Stroke Rehabilitation

Brain stroke affects millions of people in the world every year, with 50 to 60 percent of stroke survivors suffering from functional disabilities, for which early and sustained post-stroke rehabilitation is highly recommended. However, approximately one third of stroke patients do not receive early in hospital rehabilitation programs due to insufficient medical facilities or lack of motivation. Gait triggered mixed reality (GTMR) is a cognitive-motor dual task with multisensory feedback tailored for lower-limb post-stroke rehabilitation, which we propose as a potential method for addressing these rehabilitation challenges. Simultaneous gait and EEG data from nine stroke patients was recorded and analyzed to assess the applicability of GTMR to different stroke patients, determine any impacts of GTMR on patients, and better understand brain dynamics as stroke patients perform different rehabilitation tasks. Walking cadence improved significantly for stroke patients and lower-limb movement induced alpha band power suppression during GTMR tasks. The brain dynamics and gait performance across different severities of stroke motor deficits was also assessed; the intensity of walking induced event related desynchronization (ERD) was found to be related to motor deficits, as classified by Brunnstrom stage. In particular, stronger lower-limb movement induced ERD during GTMR rehabilitation tasks was found for patients with moderate motor deficits (Brunnstrom stage IV). This investigation demonstrates the efficacy of the GTMR paradigm for enhancing lower-limb rehabilitation, explores the neural activities of cognitive-motor tasks in different stages of stroke, and highlights the potential for joining enhanced rehabilitation and real-time neural monitoring for superior stroke rehabilitation.

The Arch Electrode: A Novel Dry Electrode Concept for Improved Wearing Comfort

Electroencephalography (EEG) is increasingly used for repetitive and prolonged applications like neurofeedback, brain computer interfacing, and long-term intermittent monitoring. Dry-contact electrodes enable rapid self-application. A common drawback of existing dry electrodes is the limited wearing comfort during prolonged application. We propose a novel dry Arch electrode. Five semi-circular arches are arranged parallelly on a common baseplate. The electrode substrate material is a flexible thermoplastic polyurethane (TPU) produced by additive manufacturing. A chemical coating of Silver/Silver-Chloride (Ag/AgCl) is applied by electroless plating using a novel surface functionalization method. Arch electrodes were manufactured and validated in terms of mechanical durability, electrochemical stability, in vivo applicability, and signal characteristics. We compare the results of the dry arch electrodes with dry pin-shaped and conventional gel-based electrodes. 21-channel EEG recordings were acquired on 10 male and 5 female volunteers. The tests included resting state EEG, alpha activity, and a visual evoked potential. Wearing comfort was rated by the subjects directly after application, as well as at 30 min and 60 min of wearing. Our results show that the novel plating technique provides a well-adhering electrically conductive and electrochemically stable coating, withstanding repetitive strain and bending tests. The signal quality of the Arch electrodes is comparable to pin-shaped dry electrodes. The average channel reliability of the Arch electrode setup was 91.9 ± 9.5%. No considerable differences in signal characteristics have been observed for the gel-based, dry pin-shaped, and arch-shaped electrodes after the identification and exclusion of bad channels. The comfort was improved in comparison to pin-shaped electrodes and enabled applications of over 60 min duration. Arch electrodes required individual adaptation of the electrodes to the orientation and hairstyle of the volunteers. This initial preparation time of the 21-channel cap increased from an average of 5 min for pin-like electrodes to 15 min for Arch electrodes and 22 min for gel-based electrodes. However, when re-applying the arch electrode cap on the same volunteer, preparation times of pin-shaped and arch-shaped electrodes were comparable. In summary, our results indicate the applicability of the novel Arch electrode and coating for EEG acquisition. The novel electrode enables increased comfort for prolonged dry-contact measurement.

Deep Convolutional Neural Network Applied to Electroencephalography: Raw Data vs Spectral Features

The success of deep learning in computer vision has inspired the scientific community to explore new analysis methods. Within the field of neuroscience, specifically in electrophysiological neuroimaging, researchers are starting to explore leveraging deep learning to make predictions on EEG data. Research remains open on the network architecture and the feature space that is most effective for EEG decoding. This paper compares deep learning using minimally processed EEG raw data versus deep learning using EEG spectral features using two different deep convolutional neural architectures. One of them from Putten et al. (2018) is tailored to process raw data; the other was derived from the VGG16 vision network (Simonyan and Zisserman, 2015) which is designed to process EEG spectral features. We apply them to classify sex on 24-channel EEG from a large corpus of 1,574 participants. Not only do we improve on state-of-the-art classification performance for this type of classification problem, but we also show that in all cases, raw data classification leads to superior performance as compared to spectral EEG features. Interestingly we show that the neural network tailored to process EEG spectral features has increased performance when applied to raw data classification. Our approach suggests that the same convolutional networks used to process EEG spectral features yield superior performance when applied to EEG raw data.

Artefact subspace reconstruction for both EEG and fNIRS co-registred signals

Combining electroencephalography (EEG) to functional near-infrared spectroscopy (fNIRS) is a promising technique that has gained momentum thanks to their complementarity. While EEG measures the electrical activity of the brain, fNIRS records the variations in cerebral blood flow and related hemoglobin concentrations. However, both modalities are typically contaminated with artefacts. Muscle and eye artefacts, affect the EEG signals, while hemodynamic and oxygenation changes in the extracerebral compartment due to systemic changes (superficial layer) corrupt the fNIRS signals. Moreover, both signals are sensitive to sensor motion artefacts characterized by large amplitude. There are several well-established methods for removing artefacts for both modalities. The objective of this paper is to apply a common approach to denoise both EEG and fNIRS signals. Indeed Artifact Subspace Reconstruction (ASR) method, which is an automatic, online-capable and efficient method for deleting transient or large-amplitude EEG artefacts, can be a good alternative to also denoise fNIRS signals. In this paper, we first propose, a new more comprehensive formulation of ASR. Then, we study the effectiveness of the method in denoising both the EEG and fNIRS signals.

Odor valence modulates cortico-cortical interactions: a preliminary study using DCM for EEG

Olfaction and emotions share common networks in the brain. However, little is known on how the emotional content of odors modulate dynamically the cortico-cortical interactions within these networks. In this preliminary study, we investigated the effect of odor valence on effective connectivity through the use of Dynamic Causal Modeling (DCM). We recorded electroencephalographic (EEG) data from healthy subjects performing a passive odor task of odorants with different valence. Once defined a fully-connected a priori network comprising the pyriform cortex (PC), orbitofrontal cortex (OFC), and entorhinal cortex (EC), we tested the modulatory effect of odor valence on their causal interactions at the group level using the parametric empirical bayes (PEB) framework. Results show that both pleasant and the unpleasant odors have an inhibitory effect on the connection from EC to PC, whereas we did not observe any effect for the neutral odor. Moreover, the odor with positive valence has a stronger influence on connectivity dynamics compared to the negative odor. Although preliminary, our results suggest that odor valence can modulate brain connectivity.

Efficient Artifact Removal from Low-Density Wearable EEG using Artifacts Subspace Reconstruction

Light-weight, minimally-obtrusive mobile EEG systems with a small number of electrodes (i.e., low-density) allow for convenient monitoring of the brain activity in out-of-the-lab conditions. However, they pose a higher risk for signal contamination with non-stereotypical artifacts due to hardware limitations and the challenging environment where signals are collected. A promising solution is Artifacts Subspace Reconstruction (ASR), a component-based approach that can automatically remove non-stationary transient-like artifacts in EEG data. Since ASR has only been validated with high-density systems, it is unclear whether it is equally efficient on low-density portable EEG. This paper presents a complete analysis of ASR performance based on clean and contaminated datasets acquired with BioWolf, an Ultra-Low-Power system featuring only eight channels, during SSVEP sessions recorded from six adults. Empirical results show that even with such few channels, ASR efficiently corrects artifacts, enabling an overall enhancement of up to 40% in SSVEP response. Furthermore, by choosing the optimal ASR parameters on a single-subject basis, SSVEP response can be further increased to more than 45%. These results suggest that ASR is a viable and robust method for online automatic artifact correction with low-density BCI systems in real-life scenarios.

Validation of Soft Multipin Dry EEG Electrodes

Current developments towards multipin, dry electrodes in electroencephalography (EEG) are promising for applications in non-laboratory environments. Dry electrodes do not require the application of conductive gel, which mostly confines the use of gel EEG systems to the laboratory environment. The aim of this study is to validate soft, multipin, dry EEG electrodes by comparing their performance to conventional gel EEG electrodes. Fifteen healthy volunteers performed three tasks, with a 32-channel gel EEG system and a 32-channel dry EEG system: the 40 Hz Auditory Steady-State Response (ASSR), the checkerboard paradigm, and an eyes open/closed task. Within-subject analyses were performed to compare the signal quality in the time, frequency, and spatial domains. The results showed strong similarities between the two systems in the time and frequency domains, with strong correlations of the visual (ρ = 0.89) and auditory evoked potential (ρ = 0.81), and moderate to strong correlations for the alpha band during eye closure (ρ = 0.81–0.86) and the 40 Hz-ASSR power (ρ = 0.66–0.72), respectively. However, delta and theta band power was significantly increased, and the signal-to-noise ratio was significantly decreased for the dry EEG system. Topographical distributions were comparable for both systems. Moreover, the application time of the dry EEG system was significantly shorter (8 min). It can be concluded that the soft, multipin dry EEG system can be used in brain activity research with similar accuracy as conventional gel electrodes.

Motor Learning Promotes the Coupling between Fast Spindles and Slow Oscillations Locally over the Contralateral Motor Network

Recent studies from us and others suggest that traditionally declarative structures mediate some aspects of the encoding and consolidation of procedural memories. This evidence points to the existence of converging physiological pathways across memory systems. Here, we examined whether the coupling between slow oscillations (SO) and spindles, a mechanism well established in the consolidation of declarative memories, is relevant for the stabilization of human motor memories. To this aim, we conducted an electroencephalography study in which we quantified various parameters of these oscillations during a night of sleep that took place immediately after learning a visuomotor adaptation (VMA) task. We found that VMA increased the overall density of fast (≥12 Hz), but not slow (<12 Hz), spindles during nonrapid eye movement sleep, stage 3 (NREM3). This modulation occurred rather locally over the hemisphere contralateral to the trained hand. Although adaptation learning did not affect the density of SOs, it substantially enhanced the number of fast spindles locked to the active phase of SOs. The fact that only coupled spindles predicted overnight memory retention points to the relevance of this association in motor memory consolidation. Our work provides evidence in favor of a common mechanism at the basis of the stabilization of declarative and motor memories.

Cortical network and connectivity underlying hedonic olfactory perception

Objective.The emotional response to olfactory stimuli implies the activation of a complex cascade of events triggered by structures lying in the limbic system. However, little is known about how this activation is projected up to cerebral cortex and how different cortical areas dynamically interact each other.Approach.In this study, we acquired EEG from human participants performing a passive odor-perception task with odorants conveying positive, neutral and negative valence. A novel methodological pipeline integrating global field power (GFP), independent component analysis (ICA), dipole source localization was applied to estimate effective connectivity in the challenging scenario of single-trial low-synchronized stimulation.Main results.We identified the brain network and the neural paths, elicited at different frequency bands, i.e.θ(4-7Hz),α(8-12Hz)andβ(13-30Hz), involved in odor valence processing. This brain network includes the orbitofrontal cortex (OFC), the cingulate gyrus (CgG), the superior temporal gyrus (STG), the posterior cingulate cortex/precuneus (PCC/PCu) and the parahippocampal gyrus (PHG). It was analyzed using a time-varying multivariate autoregressive model to resolve time-frequency causal interactions. Specifically, the OFC acts as the main node for odor perception and evaluation of pleasant and unpleasant stimuli, whereas no specific path was observed for a neutral stimulus.Significance.The results introduce new evidences on the role of the OFC during hedonic perception and underpin its specificity during the odor valence assessment. Our findings suggest that, after the odor onset different, bidirectional interactions occur between the OFC and other brain regions associated with emotion recognition/categorization and memory according to the stimulus valence. This outcome unveils how the hedonic olfactory network dynamically changes based on odor valence.

Recognition of EEG Signals from Imagined Vowels Using Deep Learning Methods

The use of imagined speech with electroencephalographic (EEG) signals is a promising field of brain-computer interfaces (BCI) that seeks communication between areas of the cerebral cortex related to language and devices or machines. However, the complexity of this brain process makes the analysis and classification of this type of signals a relevant topic of research. The goals of this study were: to develop a new algorithm based on Deep Learning (DL), referred to as CNNeeg1-1, to recognize EEG signals in imagined vowel tasks; to create an imagined speech database with 50 subjects specialized in imagined vowels from the Spanish language (/a/,/e/,/i/,/o/,/u/); and to contrast the performance of the CNNeeg1-1 algorithm with the DL Shallow CNN and EEGNet benchmark algorithms using an open access database (BD1) and the newly developed database (BD2). In this study, a mixed variance analysis of variance was conducted to assess the intra-subject and inter-subject training of the proposed algorithms. The results show that for intra-subject training analysis, the best performance among the Shallow CNN, EEGNet, and CNNeeg1-1 methods in classifying imagined vowels (/a/,/e/,/i/,/o/,/u/) was exhibited by CNNeeg1-1, with an accuracy of 65.62% for BD1 database and 85.66% for BD2 database.

Effects of Task Demands on Neural Correlates of Acoustic and Semantic Processing in Challenging Listening Conditions

Purpose Listeners shift their listening strategies between lower level acoustic information and higher level semantic information to prioritize maximum speech intelligibility in challenging listening conditions. Although increasing task demands via acoustic degradation modulates lexical-semantic processing, the neural mechanisms underlying different listening strategies are unclear. The current study examined the extent to which encoding of lower level acoustic cues is modulated by task demand and associations with lexical-semantic processes. Method Electroencephalography was acquired while participants listened to sentences in the presence of four-talker babble that contained either higher or lower probability final words. Task difficulty was modulated by time available to process responses. Cortical tracking of speech-neural correlates of acoustic temporal envelope processing-were estimated using temporal response functions. Results Task difficulty did not affect cortical tracking of temporal envelope of speech under challenging listening conditions. Neural indices of lexical-semantic processing (N400 amplitudes) were larger with increased task difficulty. No correlations were observed between the cortical tracking of temporal envelope of speech and lexical-semantic processes, even after controlling for the effect of individualized signal-to-noise ratios. Conclusions Cortical tracking of the temporal envelope of speech and semantic processing are differentially influenced by task difficulty. While increased task demands modulated higher level semantic processing, cortical tracking of the temporal envelope of speech may be influenced by task difficulty primarily when the demand is manipulated in terms of acoustic properties of the stimulus, consistent with an emerging perspective in speech perception.

Measuring Correlates of Mental Workload During Simulated Driving Using cEEGrid Electrodes: A Test-Retest Reliability Analysis

The EEG reflects mental processes, especially modulations in the alpha and theta frequency bands are associated with attention and the allocation of mental resources. EEG has also been used to study mental processes while driving, both in real environments and in virtual reality. However, conventional EEG methods are of limited use outside of controlled laboratory settings. While modern EEG technologies offer hardly any restrictions for the user, they often still have limitations in measurement reliability. We recently showed that low-density EEG methods using film-based round the ear electrodes (cEEGrids) are well-suited to map mental processes while driving a car in a driving simulator. In the present follow-up study, we explored aspects of ecological and internal validity of the cEEGrid measurements. We analyzed longitudinal data of 127 adults, who drove the same driving course in a virtual environment twice at intervals of 12-15 months while the EEG was recorded. Modulations in the alpha and theta frequency bands as well as within behavioral parameters (driving speed and steering wheel angular velocity) which were highly consistent over the two measurement time points were found to reflect the complexity of the driving task. At the intraindividual level, small to moderate (albeit significant) correlations were observed in about 2/3 of the participants, while other participants showed significant deviations between the two measurements. Thus, the test-retest reliability at the intra-individual level was rather low and challenges the value of the application for diagnostic purposes. However, across all participants the reliability and ecological validity of cEEGrid electrodes were satisfactory in the context of driving-related parameters.

EEG-Based Brain-Computer Interfaces (BCIs): A Survey of Recent Studies on Signal Sensing Technologies and Computational Intelligence Approaches and Their Applications

Brain-Computer interfaces (BCIs) enhance the capability of human brain activities to interact with the environment. Recent advancements in technology and machine learning algorithms have increased interest in electroencephalographic (EEG)-based BCI applications. EEG-based intelligent BCI systems can facilitate continuous monitoring of fluctuations in human cognitive states under monotonous tasks, which is both beneficial for people in need of healthcare support and general researchers in different domain areas. In this review, we survey the recent literature on EEG signal sensing technologies and computational intelligence approaches in BCI applications, compensating for the gaps in the systematic summary of the past five years. Specifically, we first review the current status of BCI and signal sensing technologies for collecting reliable EEG signals. Then, we demonstrate state-of-the-art computational intelligence techniques, including fuzzy models and transfer learning in machine learning and deep learning algorithms, to detect, monitor, and maintain human cognitive states and task performance in prevalent applications. Finally, we present a couple of innovative BCI-inspired healthcare applications and discuss future research directions in EEG-based BCI research.

Connectivity of EEG synchronization networks increases for Parkinson's disease patients with freezing of gait

Freezing of gait (FoG), a paroxysmal gait disturbance commonly experienced by patients with Parkinson's disease (PD), is characterized by sudden episodes of inability to generate effective forward stepping. Recent studies have shown an increase in beta frequency of local-field potentials in the basal-ganglia during FoG, however, comprehensive research on the synchronization between different brain locations and frequency bands in PD patients is scarce. Here, by developing tools based on network science and non-linear dynamics, we analyze synchronization networks of electroencephalography (EEG) brain waves of three PD patient groups with different FoG severity. We find higher EEG amplitude synchronization (stronger network links) between different brain locations as PD and FoG severity increase. These results are consistent across frequency bands (theta, alpha, beta, gamma) and independent of the specific motor task (walking, still standing, hand tapping) suggesting that an increase in severity of PD and FoG is associated with stronger EEG networks over a broad range of brain frequencies. This observation of a direct relationship of PD/FoG severity with overall EEG synchronization together with our proposed EEG synchronization network approach may be used for evaluating FoG propensity and help to gain further insight into PD and the pathophysiology leading to FoG.

Brain Dynamics of Spatial Reference Frame Proclivity in Active Navigation

Recent research into navigation strategy of different spatial reference frames (self-centered egocentric reference frame and environment-centered allocentric reference frame) has revealed that the parietal cortex plays an important role in processing allocentric information to provide a translation function between egocentric and allocentric spatial reference frames. However, most studies merely focused on a passive experimental environment, which is not truly representative of our daily spatial learning/navigation tasks. This study investigated the factor associated with brain dynamics that causes people to switch their preferred spatial strategy in both active and passive navigations to bridge the gap. Virtual reality (VR) technique and Omni treadmill are applied to realize actively walking for active navigation, and for passive navigation, participants were sitting while conducting the same task. Electroencephalography (EEG) signals were recorded to monitor spectral perturbations on transitions between egocentric and allocentric frames during a path integration task. Forty-one right-handed male participants from authors' university participated this study. Our brain dynamics results showed navigation involved areas including the parietal cortex with modulation in the alpha band, the occipital cortex with beta and low gamma band perturbations, and the frontal cortex with theta perturbation. Differences were found between two different turning-angle paths in the alpha band in parietal cluster event-related spectral perturbations (ERSPs). In small turning-angle paths, allocentric participants showed stronger alpha desynchronization than egocentric participants; in large turning-angle paths, participants for two reference frames had a smaller difference in the alpha frequency band. Behavior results of homing errors also corresponded to brain dynamic results, indicating that a larger angle path caused the allocentric to have a higher tendency to become egocentric navigators in the active navigation environment.

Differences in Mechanical Parameters of Keyboard Switches Modulate Motor Preparation: A Wearable EEG Study

The mechanical parameters of keyboard switches affect the psychological sense of pressing. The effects of different mechanical parameters on psychological sense have been quantified using questionnaires, but these subjective evaluations are unable to fully clarify the modulation of information processing in the brain due to these differences. This study aimed to elucidate the ability of electroencephalography (EEG) measurements to detect the modulation of subconscious information processing according to mechanical parameter values. To this end, we prepared five mechanical switches with linearly increasing values of pretravel (PT: the distance from the free position until the operating position). We hypothesized that the differences in PTs would subconsciously affect the motor preparation prior to pressing switches because switches with PTs that deviated from those commonly used were predicted to increase the users' attention level when pressing. Differences in motor preparation were quantified using the mean amplitudes of the late contingent negative variation (CNV). We recorded EEGs of 25 gamers during a reaction task for fast switch pressing after a response cue preceded by a pre-cue for response preparation; we also measured the reaction time feedback on each switch pressing trial. Participants performed five sessions (60 trials per session) in total. For the analysis, trials were divided into first (session 1, 2, and 3) and second half sessions (session 4 and 5). In the latter session, CNV amplitudes were significantly higher for the switch with the highest PT than for that with a medium PT, which is closest to that commonly used in commercial mechanical switches. On the other hand, the questionnaire did not detect any significant differences between PTs in their subjective rankings of the psychological effects of switch pressing. These results suggest that differences in PTs modulate motor preparation to press switches, and that EEG measurements may provide a novel objective evaluation of the mechanical parameters of keyboard switches.

Hybrid Harmony: A Multi-Person Neurofeedback Application for Interpersonal Synchrony

Recent years have seen a dramatic increase in studies measuring brain activity, physiological responses, and/or movement data from multiple individuals during social interaction. For example, so-called "hyperscanning" research has demonstrated that brain activity may become synchronized across people as a function of a range of factors. Such findings not only underscore the potential of hyperscanning techniques to capture meaningful aspects of naturalistic interactions, but also raise the possibility that hyperscanning can be leveraged as a tool to help improve such naturalistic interactions. Building on our previous work showing that exposing dyads to real-time inter-brain synchrony neurofeedback may help boost their interpersonal connectedness, we describe the biofeedback application Hybrid Harmony, a Brain-Computer Interface (BCI) that supports the simultaneous recording of multiple neurophysiological datastreams and the real-time visualization and sonification of inter-subject synchrony. We report results from 236 dyads experiencing synchrony neurofeedback during naturalistic face-to-face interactions, and show that pairs' social closeness and affective personality traits can be reliably captured with the inter-brain synchrony neurofeedback protocol, which incorporates several different online inter-subject connectivity analyses that can be applied interchangeably. Hybrid Harmony can be used by researchers who wish to study the effects of synchrony biofeedback, and by biofeedback artists and serious game developers who wish to incorporate multiplayer situations into their practice.

Linear and Nonlinear Quantitative EEG Analysis during Neutral Hypnosis following an Opened/Closed Eye Paradigm

Hypnotic susceptibility is a major factor influencing the study of the neural correlates of hypnosis using EEG. In this context, while its effects on the response to hypnotic suggestions are undisputed, less attention has been paid to “neutral hypnosis” (i.e., the hypnotic condition in absence of suggestions). Furthermore, although an influence of opened and closed eye condition onto hypnotizability has been reported, a systematic investigation is still missing. Here, we analyzed EEG signals from 34 healthy subjects with low (LS), medium (MS), and (HS) hypnotic susceptibility using power spectral measures (i.e., TPSD, PSD) and Lempel-Ziv-Complexity (i.e., LZC, fLZC). Indeed, LZC was found to be more suitable than other complexity measures for EEG analysis, while it has been never used in the study of hypnosis. Accordingly, for each measure, we investigated within-group differences between rest and neutral hypnosis, and between opened-eye/closed-eye conditions under both rest and neutral hypnosis. Then, we evaluated between-group differences for each experimental condition. We observed that, while power estimates did not reveal notable differences between groups, LZC and fLZC were able to distinguish between HS, MS, and LS. In particular, we found a left frontal difference between HS and LS during closed-eye rest. Moreover, we observed a symmetric pattern distinguishing HS and LS during closed-eye hypnosis. Our results suggest that LZC is better capable of discriminating subjects with different hypnotic susceptibility, as compared to standard power analysis.

Graph-theoretical analysis of EEG functional connectivity during balance perturbation in traumatic brain injury: A pilot study

Traumatic brain injury (TBI) often results in balance impairment, increasing the risk of falls, and the chances of further injuries. However, the underlying neural mechanisms of postural control after TBI are not well understood. To this end, we conducted a pilot study to explore the neural mechanisms of unpredictable balance perturbations in 17 chronic TBI participants and 15 matched healthy controls (HC) using the EEG, MRI, and diffusion tensor imaging (DTI) data. As quantitative measures of the functional integration and segregation of the brain networks during the postural task, we computed the global graph-theoretic network measures (global efficiency and modularity) of brain functional connectivity derived from source-space EEG in different frequency bands. We observed that the TBI group showed a lower balance performance as measured by the center of pressure displacement during the task, and the Berg Balance Scale (BBS). They also showed reduced brain activation and connectivity during the balance task. Furthermore, the decrease in brain network segregation in alpha-band from baseline to task was smaller in TBI than HC. The DTI findings revealed widespread structural damage. In terms of the neural correlates, we observed a distinct role played by different frequency bands: theta-band modularity during the task was negatively correlated with the BBS in the TBI group; lower beta-band network connectivity was associated with the reduction in white matter structural integrity. Our future studies will focus on how postural training will modulate the functional brain networks in TBI.

Multiscale criticality measures as general-purpose gauges of proper brain function

The brain is universally regarded as a system for processing information. If so, any behavioral or cognitive dysfunction should lend itself to depiction in terms of information processing deficiencies. Information is characterized by recursive, hierarchical complexity. The brain accommodates this complexity by a hierarchy of large/slow and small/fast spatiotemporal loops of activity. Thus, successful information processing hinges upon tightly regulating the spatiotemporal makeup of activity, to optimally match the underlying multiscale delay structure of such hierarchical networks. Reduced capacity for information processing will then be expressed as deviance from this requisite multiscale character of spatiotemporal activity. This deviance is captured by a general family of multiscale criticality measures (MsCr). MsCr measures reflect the behavior of conventional criticality measures (such as the branching parameter) across temporal scale. We applied MsCr to MEG and EEG data in several telling degraded information processing scenarios. Consistently with our previous modeling work, MsCr measures systematically varied with information processing capacity: MsCr fingerprints showed deviance in the four states of compromised information processing examined in this study, disorders of consciousness, mild cognitive impairment, schizophrenia and even during pre-ictal activity. MsCr measures might thus be able to serve as general gauges of information processing capacity and, therefore, as normative measures of brain health.

Objective assessment of impulse control disorder in patients with Parkinson's disease using a low-cost LEGO-like EEG headset: a feasibility study

Background

Patients with Parkinson’s disease (PD) can develop impulse control disorders (ICDs) while undergoing a pharmacological treatment for motor control dysfunctions with a dopamine agonist (DA). Conventional clinical interviews or questionnaires can be biased and may not accurately diagnose at the early stage. A wearable electroencephalogram (EEG)-sensing headset paired with an examination procedure can be a potential user-friendly method to explore ICD-related signatures that can detect its early signs and progression by reflecting brain activity.

Methods

A stereotypical Go/NoGo test that targets impulse inhibition was performed on 59 individuals, including healthy controls, patients with PD, and patients with PD diagnosed by ICDs. We conducted two Go/NoGo sessions before and after the DA-pharmacological treatment for the PD and ICD groups. A low-cost LEGO-like EEG headset was used to record concurrent EEG signals. Then, we used the event-related potential (ERP) analytical framework to explore ICD-related EEG abnormalities after DA treatment.

Results

After the DA treatment, only the ICD-diagnosed PD patients made more behavioral errors and tended to exhibit the deterioration for the NoGo N2 and P3 peak amplitudes at fronto-central electrodes in contrast to the HC and PD groups. Particularly, the extent of the diminished NoGo-N2 amplitude was prone to be modulated by the ICD scores at Fz with marginal statistical significance (r = − 0.34, p = 0.07).

Conclusions

The low-cost LEGO-like EEG headset successfully captured ERP waveforms and objectively assessed ICD in patients with PD undergoing DA treatment. This objective neuro-evidence could provide complementary information to conventional clinical scales used to diagnose ICD adverse effects.

Closed-Loop Neurofeedback of α Synchrony during Goal-Directed Attention

α Oscillations in sensory cortex, under frontal control, desynchronize during attentive preparation. Here, in a selective attention study with simultaneous EEG in humans of either sex, we first demonstrate that diminished anticipatory α synchrony between the mid-frontal region of the dorsal attention network and ventral visual sensory cortex [frontal-sensory synchrony (FSS)] significantly correlates with greater task performance. Then, in a double-blind, randomized controlled study in healthy adults, we implement closed-loop neurofeedback (NF) of the anticipatory α FSS signal over 10 d of training. We refer to this closed-loop experimental approach of rapid NF integrated within a cognitive task as cognitive NF (cNF). We show that cNF results in significant trial-by-trial modulation of the anticipatory α FSS measure during training, concomitant plasticity of stimulus-evoked α/θ responses, as well as transfer of benefits to response time (RT) improvements on a standard test of sustained attention. In a third study, we implement cNF training in children with attention deficit hyperactivity disorder (ADHD), replicating trial-by-trial modulation of the anticipatory α FSS signal as well as significant improvement of sustained attention RTs. These first findings demonstrate the basic mechanisms and translational utility of rapid cognitive-task-integrated NF.SIGNIFICANCE STATEMENT When humans prepare to attend to incoming sensory information, neural oscillations in the α band (8-14 Hz) undergo desynchronization under the control of prefrontal cortex. Here, in an attention study with electroencephalography, we first show that frontal-sensory synchrony (FSS) of α oscillations during attentive preparation significantly correlates with task performance. Then, in a randomized controlled study in healthy adults, we show that neurofeedback (NF) training of this α FSS signal within the attention task is feasible. We show that this rapid cognitive NF (cNF) approach engenders plasticity of stimulus-evoked neural responses, and improves performance on a standard test of sustained attention. In a final study, we implement cNF in children with attention deficit hyperactivity disorder (ADHD), replicating the improvement of sustained attention found in adults.

EEG-Based Intersubject Correlations Reflect Selective Attention in a Competing Speaker Scenario

Several solutions have been proposed to study the relationship between ongoing brain activity and natural sensory stimuli, such as running speech. Computing the intersubject correlation (ISC) has been proposed as one possible approach. Previous evidence suggests that ISCs between the participants' electroencephalogram (EEG) may be modulated by attention. The current study addressed this question in a competing-speaker paradigm, where participants (N = 41) had to attend to one of two concurrently presented speech streams. ISCs between participants' EEG were higher for participants attending to the same story compared to participants attending to different stories. Furthermore, we found that ISCs between individual and group data predicted whether an individual attended to the left or right speech stream. Interestingly, the magnitude of the shared neural response with others attending to the same story was related to the individual neural representation of the attended and ignored speech envelope. Overall, our findings indicate that ISC differences reflect the magnitude of selective attentional engagement to speech.

About time: Ageing influences neural markers of temporal predictability

Timing abilities help organizing the temporal structure of events but are known to change systematically with age. Yet, how the neuronal signature of temporal predictability changes across the age span remains unclear. Younger (n = 21; 23.1 years) and older adults (n = 21; 68.5 years) performed an auditory oddball task, consisting of isochronous and random sound sequences. Results confirm an altered P50 response in the older compared to younger participants. P50 amplitudes differed between the isochronous and random temporal structures in younger, and for P200 in the older group. These results suggest less efficient sensory gating in older adults in both isochronous and random auditory sequences. N100 amplitudes were more negative for deviant tones. P300 amplitudes were parietally enhanced in younger, but not in older adults. In younger participants, the P50 results confirm that this component marks temporal predictability, indicating sensitive gating of temporally regular sound sequences.

Proactive inhibition is not modified by deep brain stimulation for Parkinson's disease: An electrical neuroimaging study

In predictable contexts, motor inhibitory control can be deployed before the actual need for response suppression. The brain functional underpinnings of proactive inhibition, and notably the role of basal ganglia, are not entirely identified. We investigated the effects of deep brain stimulation of the subthalamic nucleus or internal globus pallidus on proactive inhibition in patients with Parkinson's disease. They completed a cued go/no-go proactive inhibition task ON and (unilateral) OFF stimulation while EEG was recorded. We found no behavioural effect of either subthalamic nucleus or internal globus pallidus deep brain stimulation on proactive inhibition, despite a general improvement of motor performance with subthalamic nucleus stimulation. In the non-operated and subthalamic nucleus group, we identified periods of topographic EEG modulation by the level of proactive inhibition. In the subthalamic nucleus group, source estimation analysis suggested the initial involvement of bilateral frontal and occipital areas, followed by a right lateralized fronto-basal network, and finally of right premotor and left parietal regions. Our results confirm the overall preservation of proactive inhibition capacities in both subthalamic nucleus and internal globus pallidus deep brain stimulation, and suggest a partly segregated network for proactive inhibition, with a preferential recruitment of the indirect pathway.

Parieto-Occipital Alpha and Low-Beta EEG Power Reflect Sense of Agency

The sense of agency (SoA) is part of psychophysiological modules related to the self. Disturbed SoA is found in several clinical conditions, hence understanding the neural correlates of the SoA is useful for the diagnosis and determining the proper treatment strategies. Although there are several neuroimaging studies on SoA, it is desirable to translate the knowledge to more accessible and inexpensive EEG-based biomarkers for the sake of applicability. However, SoA has not been widely investigated using EEG. To address this issue, we designed an EEG experiment on healthy adults (n = 15) to determine the sensitivity of EEG on the SoA paradigm using hand movement with parametrically delayed visual feedback. We calculated the power spectral density over the traditional EEG frequency bands for ten delay conditions relative to no delay condition. Independent component analysis and equivalent current dipole modeling were applied to address artifact rejection, volume conduction, and source localization to determine the effect of interest. The results revealed that the alpha and low-beta EEG power increased in the parieto-occipital regions in proportion to the reduced SoA reported by the subjects. We conclude that the parieto-occipital alpha and low-beta EEG power reflect the sense of agency.

Sensitive period for the plasticity of alpha activity in humans

Visual experience is crucial for the development of neural processing. For example, alpha activity development is a vision-dependent mechanism. Indeed, studies report no alpha activity is present in blind adults. Nevertheless, studies have not investigated the developmental trajectory of this activity in infants and children with blindness. Here, we hypothesize that the difference in neural activity of blind compared to sighted subjects is: absent at birth, progressive with age, specifically occipital and linked to a gradual motor impairment. Therefore, we consider spectral power of resting-state EEG and its association with motor impairment indices, in blind subjects and in sighted controls between 0 and 11 years of age. Blind subjects show posterior alpha activity during the first three years of life, although weaker and slower maturing compared to sighted subjects. The first great differentiation between blind and sighted subjects occurs between 3 and 6 years of age. Starting in this period, reduced alpha activity increases the probability of motor impairment in blind subjects, likely because of impaired perception/interaction. These results show that visual experience mediates the neural mechanisms generating alpha oscillations during the first years of life, suggesting that it is a sensitive period for the plasticity of this process.

How predictability affects habituation to novelty

One becomes accustomed to repeated exposures, even for a novel event. In the present study, we investigated how predictability affects habituation to novelty by applying a mathematical model of arousal that we previously developed, and through the use of psychophysiological experiments to test the model's prediction. We formalized habituation to novelty as a decrement in Kullback-Leibler divergence from Bayesian prior to posterior (i.e., information gain) representing arousal evoked from a novel event through Bayesian update. The model predicted an interaction effect between initial uncertainty and initial prediction error (i.e., predictability) on habituation to novelty: the greater the initial uncertainty, the faster the decrease in information gain (i.e., the sooner habituation occurs). This prediction was supported by experimental results using subjective reports of surprise and event-related potential (P300) evoked by visual-auditory incongruity. Our findings suggest that in highly uncertain situations, repeated exposure to stimuli can enhance habituation to novel stimuli.

Long-Lasting Event-Related Beta Synchronizations of Electroencephalographic Activity in Response to Support-Surface Perturbations During Upright Stance: A Pilot Study Associating Beta Rebound and Active Monitoring in the Intermittent Postural Control

Movement related beta band cortical oscillations, including beta rebound after execution and/or suppression of movement, have drawn attention in upper extremity motor control literature. However, fewer studies focused on beta band oscillations during postural control in upright stance. In this preliminary study, we examined beta rebound and other components of electroencephalogram (EEG) activity during perturbed upright stance to investigate supraspinal contributions to postural stabilization. Particularly, we aimed to clarify the timing and duration of beta rebound within a non-sustained, but long-lasting postural recovery process that occurs more slowly compared to upper extremities. To this end, EEG signals were acquired from nine healthy young adults in response to a brief support-surface perturbation, together with the center of pressure, the center of mass and electromyogram (EMG) activities of ankle muscles. Event-related potentials (ERPs) and event-related spectral perturbations were computed from EEG data using the perturbation-onset as a triggering event. After short-latency (<0.3 s) ERPs, our results showed a decrease in high-beta band oscillations (event-related desynchronization), which was followed by a significant increase (event-related synchronization) in the same band, as well as a decrease in theta band oscillations. Unlike during upper extremity motor tasks, the beta rebound in this case was initiated before the postural recovery was completed, and sustained for as long as 3 s with small EMG responses for the first half period, followed by no excessive EMG activities for the second half period. We speculate that those novel characteristics of beta rebound might be caused by slow postural dynamics along a stable manifold of the unstable saddle-type upright equilibrium of the postural control system without active feedback control, but with active monitoring of the postural state, in the framework of the intermittent control.

Left Frontal EEG Power Responds to Stock Price Changes in a Simulated Asset Bubble Market

Financial bubbles are a result of aggregate irrational behavior and cannot be explained by standard economic pricing theory. Research in neuroeconomics can improve our understanding of their causes. We conducted an experiment in which 28 healthy subjects traded in a simulated market bubble, while scalp EEG was recorded using a low-cost, BCI-friendly desktop device with 14 electrodes. Independent component (IC) analysis was performed to decompose brain signals and the obtained scalp topography was used to cluster the ICs. We computed single-trial time-frequency power relative to the onset of stock price display and estimated the correlation between EEG power and stock price across trials using a general linear model. We found that delta band (1-4 Hz) EEG power within the left frontal region negatively correlated with the trial-by-trial stock prices including the financial bubble. We interpreted the result as stimulus-preceding negativity (SPN) occurring as a dis-inhibition of the resting state network. We conclude that the combination between the desktop-BCI-friendly EEG, the simulated financial bubble and advanced signal processing and statistical approaches could successfully identify the neural correlate of the financial bubble. We add to the neuroeconomics literature a complementary EEG neurometric as a bubble predictor, which can further be explored in future decision-making experiments.

Modality-specific frequency band activity during neural entrainment to auditory and visual rhythms

Rhythm perception depends on the ability to predict the onset of rhythmic events. Previous studies indicate beta band modulation is involved in predicting the onset of auditory rhythmic events (Fujioka et al., 2009, 2012; Snyder & Large, 2005). We sought to determine if similar processes are recruited for prediction of visual rhythms by investigating whether beta band activity plays a role in a modality-dependent manner for rhythm perception. We looked at electroencephalography time-frequency neural correlates of prediction using an omission paradigm with auditory and visual rhythms. By using omissions, we can separate out predictive timing activity from stimulus-driven activity. We hypothesized that there would be modality-independent markers of rhythm prediction in induced beta band oscillatory activity, and our results support this hypothesis. We find induced and evoked predictive timing in both auditory and visual modalities. Additionally, we performed an exploratory-independent components-based spatial clustering analysis, and describe all resulting clusters. This analysis reveals that there may be overlapping networks of predictive beta activity based on common activation in the parietal and right frontal regions, auditory-specific predictive beta in bilateral sensorimotor regions, and visually specific predictive beta in midline central, and bilateral temporal/parietal regions. This analysis also shows evoked predictive beta activity in the left sensorimotor region specific to auditory rhythms and implicates modality-dependent networks for auditory and visual rhythm perception.

Estimation of Granger causality through Artificial Neural Networks: applications to physiological systems and chaotic electronic oscillators

One of the most challenging problems in the study of complex dynamical systems is to find the statistical interdependencies among the system components. Granger causality (GC) represents one of the most employed approaches, based on modeling the system dynamics with a linear vector autoregressive (VAR) model and on evaluating the information flow between two processes in terms of prediction error variances. In its most advanced setting, GC analysis is performed through a state-space (SS) representation of the VAR model that allows to compute both conditional and unconditional forms of GC by solving only one regression problem. While this problem is typically solved through Ordinary Least Square (OLS) estimation, a viable alternative is to use Artificial Neural Networks (ANNs) implemented in a simple structure with one input and one output layer and trained in a way such that the weights matrix corresponds to the matrix of VAR parameters. In this work, we introduce an ANN combined with SS models for the computation of GC. The ANN is trained through the Stochastic Gradient Descent L1 (SGD-L1) algorithm, and a cumulative penalty inspired from penalized regression is applied to the network weights to encourage sparsity. Simulating networks of coupled Gaussian systems, we show how the combination of ANNs and SGD-L1 allows to mitigate the strong reduction in accuracy of OLS identification in settings of low ratio between number of time series points and of VAR parameters. We also report how the performances in GC estimation are influenced by the number of iterations of gradient descent and by the learning rate used for training the ANN. We recommend using some specific combinations for these parameters to optimize the performance of GC estimation. Then, the performances of ANN and OLS are compared in terms of GC magnitude and statistical significance to highlight the potential of the new approach to reconstruct causal coupling strength and network topology even in challenging conditions of data paucity. The results highlight the importance of of a proper selection of regularization parameter which determines the degree of sparsity in the estimated network. Furthermore, we apply the two approaches to real data scenarios, to study the physiological network of brain and peripheral interactions in humans under different conditions of rest and mental stress, and the effects of the newly emerged concept of remote synchronization on the information exchanged in a ring of electronic oscillators. The results highlight how ANNs provide a mesoscopic description of the information exchanged in networks of multiple interacting physiological systems, preserving the most active causal interactions between cardiovascular, respiratory and brain systems. Moreover, ANNs can reconstruct the flow of directed information in a ring of oscillators whose statistical properties can be related to those of physiological networks.

Source decomposition of the frontocentral auditory steady-state gamma band response in schizophrenia patients and healthy subjects

AIM

Gamma-band auditory steady-state response (ASSR) is a neurophysiologic index that is increasingly used as a translational biomarker in the development of treatments of neuropsychiatric disorders. While gamma-band ASSR is generated by distributed networks of highly interactive temporal and frontal cortical sources, the majority of human gamma-band ASSR studies using electroencephalography (EEG) highlight activity from only a single frontocentral scalp site, Fz, where responses tend to be largest and reductions in schizophrenia patients are most evident. However, no previous study has characterized the relative source contributions to Fz, which is a necessary step to improve the concordance of preclinical and clinical EEG studies.

METHODS

A novel method to back-project the contributions of independent cortical source components was applied to assess the independent sources and their proportional contributions to Fz as well as source-resolved responses in 432 schizophrenia patients and 294 healthy subjects.

RESULTS

Independent contributions of gamma-band ASSR to Fz were detected from orbitofrontal, bilateral superior/middle/inferior temporal, bilateral middle frontal, and posterior cingulate gyri in both groups. In contrast to expectations, the groups showed comparable source contribution weight to gamma-band ASSR at Fz. While gamma-band ASSR reductions at Fz were present in schizophrenia patients consistent with previous studies, no group differences in individual source-level responses to Fz were detected.

CONCLUSION

Small differences in multiple independent sources summate to produce scalp-level differences at Fz. The identification of independent source contributions to a single scalp sensor represents a promising methodology for measuring dissociable and homologous biomarker targets in future translational studies.

Abnormal phase discontinuity of alpha- and theta-frequency oscillations in schizophrenia

BACKGROUND

Schizophrenia patients have abnormal electroencephalographic (EEG) power over multiple frequency bands, even at rest, though the primary neural generators and spatiotemporal dynamics of these abnormalities are largely unknown. Disturbances in the precise synchronization of oscillations within and across cortical sources may underlie abnormal resting-state EEG activity in schizophrenia patients.

METHODS

A novel assessment method was applied to identify the independent contributing sources of resting-state EEG and assess the phase discontinuity in schizophrenia patients (N = 148) and healthy subjects (N = 143).

RESULTS

A network of 11 primary contributing sources of scalp EEG was identified in both groups. Schizophrenia patients showed abnormal elevations of EEG power in the temporal region in the theta, beta, and gamma-bands, as well as the posterior cingulate gyrus in the delta, theta, alpha, and beta-bands. The higher theta-band power in the middle temporal gyrus was significantly correlated with verbal memory impairment in patients. The peak frequency of alpha was lower in patients in the cingulate and temporal regions. Furthermore, patients showed a higher rate of alpha phase discontinuity in the temporal region as well as a lower rate of theta phase discontinuity in the temporal and posterior cingulate regions.

CONCLUSIONS

Abnormal rates of phase discontinuity of alpha- and theta-band, abnormal elevations of EEG power in multiple bands, and a lower peak frequency of alpha were identified in schizophrenia patients at rest. Clarification of the mechanistic substrates of abnormal phase discontinuity may clarify core pathophysiologic abnormalities of schizophrenia and contribute to the development of novel biomarkers for therapeutic interventions.

Effective Connectivity in Default Mode Network for Alcoholism Diagnosis

Alcohol Use Disorder (AUD) is a chronic relapsing brain disease characterized by excessive alcohol use, loss of control over alcohol intake, and negative emotional states under no alcohol consumption. The key factor in successful treatment of AUD is the accurate diagnosis for better medical and therapy management. Conventionally, for individuals to be diagnosed with AUD, certain criteria as outlined in the Diagnostic and Statistical Manual of Mental Disorders (DSM) should be met. However, this process is subjective in nature and could be misleading due to memory problems and dishonesty of some AUD patients. In this paper, an assessment scheme for objective diagnosis of AUD is proposed. For this purpose, EEG recording of 31 healthy controls and 31 AUD patients are used for the calculation of effective connectivity (EC) between the various regions of the brain Default Mode Network (DMN). The EC is estimated using partial directed coherence (PDC) which are then used as input to a 3D Convolutional Neural Network (CNN) for binary classification of AUD cases. Using 5-fold cross validation, the classification of AUD vs. HC effective connectivity matrices using the proposed 3D-CNN gives an accuracy of 87.85 ± 4.64 %. For further validation, 32 and 30 subjects are randomly selected for training and testing, respectively, giving 100% correct classification of all the testing subjects.

Neural network dynamics underlying gamma synchronization deficits in schizophrenia

Gamma-band (40-Hz) activity is critical for cortico-cortical transmission and the integration of information across neural networks during sensory and cognitive processing. Patients with schizophrenia show selective reductions in the capacity to support synchronized gamma-band oscillations in response to auditory stimulation presented 40-Hz. Despite widespread application of this 40-Hz auditory steady-state response (ASSR) as a translational electroencephalographic biomarker for therapeutic development for neuropsychiatric disorders, the spatiotemporal dynamics underlying the ASSR have not been fully characterized. In this study, a novel Granger causality analysis was applied to assess the propagation of gamma oscillations in response to 40-Hz steady-state stimulation across cortical sources in schizophrenia patients (n = 426) and healthy comparison subjects (n = 293). Both groups showed multiple ASSR source interactions that were broadly distributed across brain regions. Schizophrenia patients showed distinct, hierarchically sequenced connectivity abnormalities. During the response onset interval, patients exhibited abnormal increased connectivity from the inferior frontal gyrus to the superior temporal gyrus, followed by decreased connectivity from the superior temporal to the middle cingulate gyrus. In the later portion of the ASSR response (300-500 ms), patients showed significantly increased connectivity from the superior temporal to the middle frontal gyrus followed by decreased connectivity from the left superior frontal gyrus to the right superior and middle frontal gyri. These findings highlight both the orchestration of distributed multiple sources in response to simple gamma-frequency stimulation in healthy subjects as well as the patterns of deficits in the generation and maintenance of gamma-band oscillations across the temporo-frontal sources in schizophrenia patients.

Inhibitory control in children with tic disorder: aberrant fronto-parietal network activity and connectivity

Chronic tic disorders, including Tourette syndrome, are typically thought to have deficits in cognitive inhibition and top down cognitive control due to the frequent and repetitive occurrence of tics, yet studies reporting task performance results have been equivocal. Despite similar behavioural performance, individuals with chronic tic disorder have exhibited aberrant patterns of neural activation in multiple frontal and parietal regions relative to healthy controls during inhibitory control paradigms. In addition to these top down attentional control regions, widespread alterations in brain activity across multiple neural networks have been reported. There is a dearth, however, of studies examining event-related connectivity during cognitive inhibitory paradigms among affected individuals. The goal of this study was to characterize neural oscillatory activity and effective connectivity, using a case–control design, among children with and without chronic tic disorder during performance of a cognitive inhibition task. Electroencephalogram data were recorded in a cohort of children aged 8–12 years old (60 with chronic tic disorder, 35 typically developing controls) while they performed a flanker task. While task accuracy did not differ by diagnosis, children with chronic tic disorder displayed significant cortical source-level, event-related spectral power differences during incongruent flanker trials, which required inhibitory control. Specifically, attenuated broad band oscillatory power modulation within the anterior cingulate cortex was observed relative to controls. Whole brain effective connectivity analyses indicated that children with chronic tic disorder exhibit greater information flow between the anterior cingulate and other fronto-parietal network hubs (midcingulate cortex and precuneus) relative to controls, who instead showed stronger connectivity between central and posterior nodes. Spectral power within the anterior cingulate was not significantly correlated with any connectivity edges, suggesting lower power and higher connectivity are independent (versus resultant) neural mechanisms. Significant correlations between clinical features, task performance and anterior cingulate spectral power and connectivity suggest this region is associated with tic impairment (r = −0.31, P = 0.03) and flanker task incongruent trial accuracy (r’s = −0.27 to −0.42, P’s = 0.0008–0.04). Attenuated activation of the anterior cingulate along with dysregulated information flow between and among nodes within the fronto-parietal attention network may be neural adaptations that result from frequent engagement of neural pathways needed for inhibitory control in chronic tic disorder.

Adaptive Filtering for Improved EEG-Based Mental Workload Assessment of Ambulant Users

Recently, due to the emergence of mobile electroencephalography (EEG) devices, assessment of mental workload in highly ecological settings has gained popularity. In such settings, however, motion and other common artifacts have been shown to severely hamper signal quality and to degrade mental workload assessment performance. Here, we show that classical EEG enhancement algorithms, conventionally developed to remove ocular and muscle artifacts, are not optimal in settings where participant movement (e.g., walking or running) is expected. As such, an adaptive filter is proposed that relies on an accelerometer-based referential signal. We show that when combined with classical algorithms, accurate mental workload assessment is achieved. To test the proposed algorithm, data from 48 participants was collected as they performed the Revised Multi-Attribute Task Battery-II (MATB-II) under a low and a high workload setting, either while walking/jogging on a treadmill, or using a stationary exercise bicycle. Accuracy as high as 95% could be achieved with a random forest based mental workload classifier with ambulant users. Moreover, an increase in gamma activity was found in the parietal cortex, suggesting a connection between sensorimotor integration, attention, and workload in ambulant users.

Discussion on the Rehabilitation of Stroke Hemiplegia Based on Interdisciplinary Combination of Medicine and Engineering

Interdisciplinary combinations of medicine and engineering are part of the strategic plan of many universities aiming to be world-class institutions. One area in which these interactions have been prominent is rehabilitation of stroke hemiplegia. This article reviews advances in the last five years of stroke hemiplegia rehabilitation via interdisciplinary combination of medicine and engineering. Examples of these technologies include VR, RT, mHealth, BCI, tDCS, rTMS, and TCM rehabilitation. In this article, we will summarize the latest research in these areas and discuss the advantages and disadvantages of each to examine the frontiers of interdisciplinary medicine and engineering advances.

Coordinated Reset Vibrotactile Stimulation Induces Sustained Cumulative Benefits in Parkinson's Disease

BACKGROUND

Abnormal synchronization of neuronal activity in dopaminergic circuits is related to motor impairment in Parkinson's disease (PD). Vibrotactile coordinated reset (vCR) fingertip stimulation aims to counteract excessive synchronization and induce sustained unlearning of pathologic synaptic connectivity and neuronal synchrony. Here, we report two clinical feasibility studies that examine the effect of regular and noisy vCR stimulation on PD motor symptoms. Additionally, in one clinical study (study 1), we examine cortical beta band power changes in the sensorimotor cortex. Lastly, we compare these clinical results in relation to our computational findings.

METHODS

Study 1 examines six PD patients receiving noisy vCR stimulation and their cortical beta power changes after 3 months of daily therapy. Motor evaluations and at-rest electroencephalographic (EEG) recordings were assessed off medication pre- and post-noisy vCR. Study 2 follows three patients for 6+ months, two of whom received daily regular vCR and one patient from study 1 who received daily noisy vCR. Motor evaluations were taken at baseline, and follow-up visits were done approximately every 3 months. Computationally, in a network of leaky integrate-and-fire (LIF) neurons with spike timing-dependent plasticity, we study the differences between regular and noisy vCR by using a stimulus model that reproduces experimentally observed central neuronal phase locking.

RESULTS

Clinically, in both studies, we observed significantly improved motor ability. EEG recordings observed from study 1 indicated a significant decrease in off-medication cortical sensorimotor high beta power (21-30 Hz) at rest after 3 months of daily noisy vCR therapy. Computationally, vCR and noisy vCR cause comparable parameter-robust long-lasting synaptic decoupling and neuronal desynchronization.

CONCLUSION

In these feasibility studies of eight PD patients, regular vCR and noisy vCR were well tolerated, produced no side effects, and delivered sustained cumulative improvement of motor performance, which is congruent with our computational findings. In study 1, reduction of high beta band power over the sensorimotor cortex may suggest noisy vCR is effectively modulating the beta band at the cortical level, which may play a role in improved motor ability. These encouraging therapeutic results enable us to properly plan a proof-of-concept study.

Mind Wandering Influences EEG Signal in Complex Multimodal Environments

The phenomenon of mind wandering (MW), as a family of experiences related to internally directed cognition, heavily influences vigilance evolution. In particular, humans in teleoperations monitoring partially automated fleet before assuming manual control whenever necessary may see their attention drift due to internal sources; as such, it could play an important role in the emergence of out-of-the-loop (OOTL) situations and associated performance problems. To follow, quantify, and mitigate this phenomenon, electroencephalogram (EEG) systems already demonstrated robust results. As MW creates an attentional decoupling, both ERPs and brain oscillations are impacted. However, the factors influencing these markers in complex environments are still not fully understood. In this paper, we specifically addressed the possibility of gradual emergence of attentional decoupling and the differences created by the sensory modality used to convey targets. Eighteen participants were asked to (1) supervise an automated drone performing an obstacle avoidance task (visual task) and (2) respond to infrequent beeps as fast as possible (auditory task). We measured event-related potentials and alpha waves through EEG. We also added a 40-Hz amplitude modulated brown noise to evoke steady-state auditory response (ASSR). Reported MW episodes were categorized between task-related and task-unrelated episodes. We found that N1 ERP component elicited by beeps had lower amplitude during task-unrelated MW, whereas P3 component had higher amplitude during task-related MW, compared with other attentional states. Focusing on parieto-occipital regions, alpha-wave activity was higher during task-unrelated MW compared with others. These results support the decoupling hypothesis for task-unrelated MW but not task-related MW, highlighting possible variations in the "depth" of decoupling depending on MW episodes. Finally, we found no influence of attentional states on ASSR amplitude. We discuss possible reasons explaining why. Results underline both the ability of EEG to track and study MW in laboratory tasks mimicking ecological environments, as well as the complex influence of perceptual decoupling on operators' behavior and, in particular, EEG measures.

An EEG Analysis of Honorification in Japanese: Human Hierarchical Relationships Coded in Language

This study examines the neural substrate of the understanding of human relationships in verbal communication with Japanese honorific sentences as experimental materials. We manipulated two types of Japanese verbs specifically used to represent respect for others, i.e., exalted and humble verbs, which represent respect for the person in the subject and the person in the object, respectively. We visually presented appropriate and anomalous sentences containing the two types of verbs and analyzed the electroencephalogram elicited by the verbs. We observed significant parietal negativity at a latency of approximately 400 ms for anomalous verbs compared with appropriate verbs. This parietal negativity could be a manifestation of the pragmatic process used to integrate the linguistic forms with the human relationships represented in the sentences. The topographies of these event-related potentials (ERPs) corresponded well with those of ERPs for two second-person pronouns in Chinese (plain ni and respectful nin). This correspondence suggests that the pragmatic integration process in honorific expressions is cross-linguistically common in part. Furthermore, we assessed the source localization by means of independent component (IC) analysis and dipole fitting and observed a significant difference in ERP between the honorific and control sentences in the IC cluster centered in the precentral gyrus and in the cluster centered in the medial part of the occipital lobe, which corresponded well with the functional magnetic resonance imaging findings for Japanese honorification. We also found several significant differences in the time-frequency analyses for the medial occipital cluster. These significant differences in the medial occipital cluster suggested that the circuit of the theory of mind was involved in the processing of Japanese honorification. Our results suggest that pragmatic and syntactic processing are performed in parallel because the person to be respected must fulfill the grammatical function appropriate for the honorific verb.

Effect of Static Posture on Online Performance of P300-Based BCIs for TV Control

To implement a practical brain–computer interface (BCI) for daily use, continuing changes in postures while performing daily tasks must be considered in the design of BCIs. To examine whether the performance of a BCI could depend on postures, we compared the online performance of P300-based BCIs built to select TV channels when subjects took sitting, recline, supine, and right lateral recumbent postures during BCI use. Subjects self-reported the degrees of interference, comfort, and familiarity after BCI control in each posture. We found no significant difference in the BCI performance as well as the amplitude and latency of P300 and N200 among the four postures. However, when we compared BCI accuracy outcomes normalized within individuals between two cases where subjects reported relatively more positively or more negatively about using the BCI in a particular posture, we found higher BCI accuracy in those postures for which individual subjects reported more positively. As a result, although the change of postures did not affect the overall performance of P300-based BCIs, the BCI performance varied depending on the degree of postural comfort felt by individual subjects. Our results suggest considering the postural comfort felt by individual BCI users when using a P300-based BCI at home.

Mobile ear-EEG to study auditory attention in everyday life

Most research investigating auditory perception is conducted in controlled laboratory settings, potentially restricting its generalizability to the complex acoustic environment outside the lab. The present study, in contrast, investigated auditory attention with long-term recordings (> 6 h) beyond the lab using a fully mobile, smartphone-based ear-centered electroencephalography (EEG) setup with minimal restrictions for participants. Twelve participants completed iterations of two variants of an oddball task where they had to react to target tones and to ignore standard tones. A rapid variant of the task (tones every 2 s, 5 min total time) was performed seated and with full focus in the morning, around noon and in the afternoon under controlled conditions. A sporadic variant (tones every minute, 160 min total time) was performed once in the morning and once in the afternoon while participants followed their normal office day routine. EEG data, behavioral data, and movement data (with a gyroscope) were recorded and analyzed. The expected increased amplitude of the P3 component in response to the target tone was observed for both the rapid and the sporadic oddball. Miss rates were lower and reaction times were faster in the rapid oddball compared to the sporadic one. The movement data indicated that participants spent most of their office day at relative rest. Overall, this study demonstrated that it is feasible to study auditory perception in everyday life with long-term ear-EEG.

A Comparative Study of Window Size and Channel Arrangement on EEG-Emotion Recognition Using Deep CNN

Emotion recognition based on electroencephalograms has become an active research area. Yet, identifying emotions using only brainwaves is still very challenging, especially the subject-independent task. Numerous studies have tried to propose methods to recognize emotions, including machine learning techniques like convolutional neural network (CNN). Since CNN has shown its potential in generalization to unseen subjects, manipulating CNN hyperparameters like the window size and electrode order might be beneficial. To our knowledge, this is the first work that extensively observed the parameter selection effect on the CNN. The temporal information in distinct window sizes was found to significantly affect the recognition performance, and CNN was found to be more responsive to changing window sizes than the support vector machine. Classifying the arousal achieved the best performance with a window size of ten seconds, obtaining 56.85% accuracy and a Matthews correlation coefficient (MCC) of 0.1369. Valence recognition had the best performance with a window length of eight seconds at 73.34% accuracy and an MCC value of 0.4669. Spatial information from varying the electrode orders had a small effect on the classification. Overall, valence results had a much more superior performance than arousal results, which were, perhaps, influenced by features related to brain activity asymmetry between the left and right hemispheres.

Effects of Emotional Stimulations on the Online Operation of a P300-Based Brain-Computer Interface

Using P300-based brain-computer interfaces (BCIs) in daily life should take into account the user's emotional state because various emotional conditions are likely to influence event-related potentials (ERPs) and consequently the performance of P300-based BCIs. This study aimed at investigating whether external emotional stimuli affect the performance of a P300-based BCI, particularly built for controlling home appliances. We presented a set of emotional auditory stimuli to subjects, which had been selected for each subject based on individual valence scores evaluated a priori, while they were controlling an electric light device using a P300-based BCI. There were four conditions regarding the auditory stimuli, including high valence, low valence, noise, and no sound. As a result, subjects controlled the electric light device using the BCI in real time with a mean accuracy of 88.14%. The overall accuracy and P300 features over most EEG channels did not show a significant difference between the four auditory conditions (p > 0.05). When we measured emotional states using frontal alpha asymmetry (FAA) and compared FAA across the auditory conditions, we also found no significant difference (p > 0.05). Our results suggest that there is no clear evidence to support a hypothesis that external emotional stimuli influence the P300-based BCI performance or the P300 features while people are controlling devices using the BCI in real time. This study may provide useful information for those who are concerned with the implementation of a P300-based BCI in practice.

Behavioral and ERP Correlates of Long-Term Physical and Mental Training on a Demanding Switch Task

Physical and mental training are associated with positive effects on executive functions throughout the lifespan. However, evidence of the benefits of combined physical and mental regimes over a sedentary lifestyle remain sparse. The goal of this study was to investigate potential mechanisms, from a source-resolved event-related-potential perspective, that could explain how practicing long-term physical and mental exercise can benefit neural processing during the execution of an attention switching task. Fifty-three healthy community volunteers who self-reported long-term practice of Tai Chi (n = 10), meditation + exercise (n = 16), simple aerobics (n = 15), or a sedentary lifestyle (n = 12), aged 47.8 ± 14.6 (SD) were included in this analysis. All participants undertook high-density electroencephalography recording during a switch paradigm. Our results indicate that people who practice physical and mental exercise perform better in a task-switching paradigm. Our analysis revealed an additive effect of the combined practice of physical and mental exercise over physical exercise only. In addition, we confirmed the participation of frontal, parietal and cingulate areas as generators of event-related-potential components (N2-like and P3-like) commonly associated to the performance of switch tasks. Particularly, the N2-like component of the parietal and frontal domains showed significantly greater amplitudes in the exercise and mental training groups compared with aerobics and sedentary groups. Furthermore, we showed better performance associated with greater N2-like amplitudes. Our multivariate analysis revealed that activity type was the most relevant factor to explain the difference between groups, with an important influence of age, and body mass index, and with small effects of educational years, cardiovascular capacity, and sex. These results suggest that chronic combined physical and mental training may confer significant benefits to executive function in normally aging adults, probably through more efficient early attentional processing. Future experimental studies are needed to confirm our results and understand the mechanisms on parieto-frontal networks that contribute to the cognitive improvement associated with practicing combined mental and aerobic exercise, while carefully controlling confounding factors, such as age and body mass index.