Predicting Inter-session Performance of SMR-Based Brain-Computer Interface Using the Spectral Entropy of Resting-State EEG

Detection of Alzheimer and mild cognitive impairment patients by Poincare and Entropy methods based on electroencephalography signals

Alzheimer's disease (AD) is characterized by deficits in cognition, behavior, and intellectual functioning, and Mild Cognitive Impairment (MCI) refers to individuals whose cognitive impairment deviates from what is expected for their age but does not significantly interfere with daily activities. Because there is no treatment for AD, early prediction of AD can be helpful to reducing the progression of this disease. This study examines the Electroencephalography (EEG) signal of 3 distinct groups, including AD, MCI, and healthy individuals. Recognizing the non-stationary nature of EEG signals, two nonlinear approaches, Poincare and Entropy, are employed for meaningful feature extraction. Data should be segmented into epochs to extract features from EEG signals, and feature extraction approaches should be implemented for each one. The obtained features are given to machine learning algorithms to classify the subjects. Extensive experiments were conducted to analyze the features comprehensively. The results demonstrate that our proposed method surpasses previous studies in terms of accuracy, sensitivity, and specificity, indicating its effectiveness in classifying individuals with AD, MCI, and those without cognitive impairment.

Reliable predictor of BCI motor imagery performance using median nerve stimulation

Objective.Predicting performance in brain-computer interfaces (BCIs) is crucial for enhancing user experience, optimizing training and identifying the most efficient BCI approach for each individual.Approach.This study explores the use of median nerve stimulation (MNS) as a predictor of motor imagery (MI)-BCI performance. MNS induces event related (de)synchronization (ERD/ERS) patterns in the brain that are similar to those generated during MI tasks, providing a non-invasive, user-independent, and easy-to-setup method for performance prediction.Main results.Our proposed predictor, based on the minimum value of the ERD induced by the MNS, not only exhibits a robust correlation with the MI-BCI performance accuracy (rho = -0.71,p<0.001), but also effectively predicts this performance with a significant correlation (rho = 0.61, mean absolute error = 9.0,p<0.01). These results demonstrate its validity as a reliable predictor of MI-BCI performance.Significance.By systematically analyzing patterns induced by MNS and correlating them with subsequent MI-BCI task performance, we aim to establish a robust predictive method of motor activity to each individual only based on MNS, making it possible, among other things, to passively predict BCI deficiency or proficiency, and to potentially adapt BCI parameters for an efficient BCI experience or BCI-based recovery.

Enhancing multiple sclerosis diagnosis: A comparative study of electroencephalogram signal processing and entropy methods

As one of the most common neurodegenerative diseases, Multiple sclerosis (MS) is a chronic immune-driven disorder that affects the central nervous system (CNS). Due to the variety of symptoms, accurately diagnosing MS demands rigorous attention to differential diagnosis, as various disorders can closely mimic its clinical and paraclinical features. Although MR imaging techniques are gold standards in diagnosing MS, the feasibility of advanced Electroencephalogram (EEG) signal processing methods is discussed in this study to detect patients with MS disorder. EEG signals from 50 individuals were evaluated through entropy-based methods. Sixteen distinct entropy methods were employed to extract features, which were used to train several machine-learning algorithms for classifying MS patients. Furthermore, each entropy method was individually evaluated to identify the most effective approach for MS diagnosis. A regional analysis of the EEG channels was conducted to determine the most informative regions for classification. The results indicated that the proposed method outperformed previous studies and achieved highly effective results in the classification of MS patients.

Sensorimotor brain-computer interface performance depends on signal-to-noise ratio but not connectivity of the mu rhythm in a multiverse analysis of longitudinal data

Objective.Serving as a channel for communication with locked-in patients or control of prostheses, sensorimotor brain-computer interfaces (BCIs) decode imaginary movements from the recorded activity of the user's brain. However, many individuals remain unable to control the BCI, and the underlying mechanisms are unclear. The user's BCI performance was previously shown to correlate with the resting-state signal-to-noise ratio (SNR) of the mu rhythm and the phase synchronization (PS) of the mu rhythm between sensorimotor areas. Yet, these predictors of performance were primarily evaluated in a single BCI session, while the longitudinal aspect remains rather uninvestigated. In addition, different analysis pipelines were used to estimate PS in source space, potentially hindering the reproducibility of the results.Approach.To systematically address these issues, we performed an extensive validation of the relationship between pre-stimulus SNR, PS, and session-wise BCI performance using a publicly available dataset of 62 human participants performing up to 11 sessions of BCI training. We performed the analysis in sensor space using the surface Laplacian and in source space by combining 24 processing pipelines in a multiverse analysis. This way, we could investigate how robust the observed effects were to the selection of the pipeline.Main results.Our results show that SNR had both between- and within-subject effects on BCI performance for the majority of the pipelines. In contrast, the effect of PS on BCI performance was less robust to the selection of the pipeline and became non-significant after controlling for SNR.Significance.Taken together, our results demonstrate that changes in neuronal connectivity within the sensorimotor system are not critical for learning to control a BCI, and interventions that increase the SNR of the mu rhythm might lead to improvements in the user's BCI performance.

Connectivity study on resting-state EEG between motor imagery BCI-literate and BCI-illiterate groups

Objective.Although motor imagery-based brain-computer interface (MI-BCI) holds significant potential, its practical application faces challenges such as BCI-illiteracy. To mitigate this issue, researchers have attempted to predict BCI-illiteracy by using the resting state, as this was found to be associated with BCI performance. As connectivity's significance in neuroscience has grown, BCI researchers have applied connectivity to it. However, the issues of connectivity have not been considered fully. First, although various connectivity metrics exist, only some have been used to predict BCI-illiteracy. This is problematic because each metric has a distinct hypothesis and perspective to estimate connectivity, resulting in different outcomes according to the metric. Second, the frequency range affects the connectivity estimation. In addition, it is still unknown whether each metric has its own optimal frequency range. Third, the way that estimating connectivity may vary depending upon the dataset has not been investigated. Meanwhile, we still do not know a great deal about how the resting state electroencephalography (EEG) network differs between BCI-literacy and -illiteracy.Approach.To address the issues above, we analyzed three large public EEG datasets using three functional connectivity and three effective connectivity metrics by employing diverse graph theory measures. Our analysis revealed that the appropriate frequency range to predict BCI-illiteracy varies depending upon the metric. The alpha range was found to be suitable for the metrics of the frequency domain, while alpha + theta were found to be appropriate for multivariate Granger causality. The difference in network efficiency between BCI-literate and -illiterate groups was constant regardless of the metrics and datasets used. Although we observed that BCI-literacy had stronger connectivity, no other significant constructional differences were found.Significance.Based upon our findings, we predicted MI-BCI performance for the entire dataset. We discovered that combining several graph features could improve the prediction's accuracy.

The EEG-Based Fusion Entropy-Featured Identification of Isometric Contraction Forces under the Same Action

This study explores the important role of assessing force levels in accurately controlling upper limb movements in human-computer interfaces. It uses a new method that combines entropy to improve the recognition of force levels. This research aims to differentiate between different levels of isometric contraction forces using electroencephalogram (EEG) signal analysis. It integrates eight different entropy measures: power spectrum entropy (PSE), singular spectrum entropy (SSE), logarithmic energy entropy (LEE), approximation entropy (AE), sample entropy (SE), fuzzy entropy (FE), alignment entropy (PE), and envelope entropy (EE). The findings emphasize two important advances: first, including a wide range of entropy features significantly improves classification efficiency; second, the fusion entropy method shows exceptional accuracy in classifying isometric contraction forces. It achieves an accuracy rate of 91.73% in distinguishing between 15% and 60% maximum voluntary contraction (MVC) forces, along with 69.59% accuracy in identifying variations across 15%, 30%, 45%, and 60% MVC. These results illuminate the efficacy of employing fusion entropy in EEG signal analysis for isometric contraction detection, heralding new opportunities for advancing motor control and facilitating fine motor movements through sophisticated human-computer interface technologies.

Upper extremity training followed by lower extremity training with a brain-computer interface rehabilitation system

Introduction

Brain-computer interfaces (BCIs) based on functional electrical stimulation have been used for upper extremity motor rehabilitation after stroke. However, little is known about their efficacy for multiple BCI treatments. In this study, 19 stroke patients participated in 25 upper extremity followed by 25 lower extremity BCI training sessions.

Methods

Patients' functional state was assessed using two sets of clinical scales for the two BCI treatments. The Upper Extremity Fugl-Meyer Assessment (FMA-UE) and the 10-Meter Walk Test (10MWT) were the primary outcome measures for the upper and lower extremity BCI treatments, respectively.

Results

Patients' motor function as assessed by the FMA-UE improved by an average of 4.2 points (p < 0.001) following upper extremity BCI treatment. In addition, improvements in activities of daily living and clinically relevant improvements in hand and finger spasticity were observed. Patients showed further improvements after the lower extremity BCI treatment, with walking speed as measured by the 10MWT increasing by 0.15 m/s (p = 0.001), reflecting a substantial meaningful change. Furthermore, a clinically relevant improvement in ankle spasticity and balance and mobility were observed.

Discussion

The results of the current study provide evidence that both upper and lower extremity BCI treatments, as well as their combination, are effective in facilitating functional improvements after stroke. In addition, and most importantly improvements did not stop after the first 25 upper extremity BCI sessions.

MEANSP: How Many Channels are Needed to Predict the Performance of a SMR-Based BCI?

Predicting whether a particular individual would reach an adequate control of a Brain-Computer Interface (BCI) has many practical advantages. On the one hand, participants with low predicted performance could be trained with specifically designed sessions and avoid frustrating experiments; on the other hand, planning time and resources would be more efficient; and finally, the variables related to an accurate prediction could be manipulated to improve the prospective BCI performance. To this end, several predictors have been proposed in the literature, most of them based on the power estimation of EEG signals at the specific frequency bands. Many of these studies evaluate their predictors in relatively small datasets and/or using a relatively high number of channels. In this manuscript, we propose a novel predictor called [Formula: see text] to predict the performance of participants using BCIs that are based on the modulation of sensorimotor rhythms. This novel predictor has been positively evaluated using only 2, 3, 4 or 5 channels. [Formula: see text] has shown to perform as well as or better than other state-of-the-art predictors. The best sets of different number of channels are also provided, which have been tested in two different settings to prove their robustness. The proposed predictor has been successfully evaluated using two large-scale datasets containing 150 and 80 participants, respectively. We also discuss predictor thresholds for users to expect good performance in feedback experiments and show the advantages in comparison to a competing algorithm.

Predicting Motor Imagery BCI Performance Based on EEG Microstate Analysis

Motor imagery (MI) electroencephalography (EEG) is natural and comfortable for controllers, and has become a research hotspot in the field of the brain-computer interface (BCI). Exploring the inter-subject MI-BCI performance variation is one of the fundamental problems in MI-BCI application. EEG microstates with high spatiotemporal resolution and multichannel information can represent brain cognitive function. In this paper, four EEG microstates (MS1, MS2, MS3, MS4) were used in the analysis of the differences in the subjects' MI-BCI performance, and the four microstate feature parameters (the mean duration, the occurrences per second, the time coverage ratio, and the transition probability) were calculated. The correlation between the resting-state EEG microstate feature parameters and the subjects' MI-BCI performance was measured. Based on the negative correlation of the occurrence of MS1 and the positive correlation of the mean duration of MS3, a resting-state microstate predictor was proposed. Twenty-eight subjects were recruited to participate in our MI experiments to assess the performance of our resting-state microstate predictor. The experimental results show that the average area under curve (AUC) value of our resting-state microstate predictor was 0.83, and increased by 17.9% compared with the spectral entropy predictor, representing that the microstate feature parameters can better fit the subjects' MI-BCI performance than spectral entropy predictor. Moreover, the AUC of microstate predictor is higher than that of spectral entropy predictor at both the single-session level and average level. Overall, our resting-state microstate predictor can help MI-BCI researchers better select subjects, save time, and promote MI-BCI development.

Virtual reality and motor imagery for early post-stroke rehabilitation

BACKGROUND

Motor impairment is a common consequence of stroke causing difficulty in independent movement. The first month of post-stroke rehabilitation is the most effective period for recovery. Movement imagination, known as motor imagery, in combination with virtual reality may provide a way for stroke patients with severe motor disabilities to begin rehabilitation.

METHODS

The aim of this study is to verify whether motor imagery and virtual reality help to activate stroke patients' motor cortex. 16 acute/subacute (< 6 months) stroke patients participated in this study. All participants performed motor imagery of basketball shooting which involved the following tasks: listening to audio instruction only, watching a basketball shooting animation in 3D with audio, and also performing motor imagery afterwards. Electroencephalogram (EEG) was recorded for analysis of motor-related features of the brain such as power spectral analysis in the [Formula: see text] and [Formula: see text] frequency bands and spectral entropy. 18 EEG channels over the motor cortex were used for all stroke patients.

RESULTS

All results are normalised relative to all tasks for each participant. The power spectral densities peak near the [Formula: see text] band for all participants and also the [Formula: see text] band for some participants. Tasks with instructions during motor imagery generally show greater power spectral peaks. The p-values of the Wilcoxon signed-rank test for band power comparison from the 18 EEG channels between different pairs of tasks show a 0.01 significance of rejecting the band powers being the same for most tasks done by stroke subjects. The motor cortex of most stroke patients is more active when virtual reality is involved during motor imagery as indicated by their respective scalp maps of band power and spectral entropy.

CONCLUSION

The resulting activation of stroke patient's motor cortices in this study reveals evidence that it is induced by imagination of movement and virtual reality supports motor imagery. The framework of the current study also provides an efficient way to investigate motor imagery and virtual reality during post-stroke rehabilitation.

Detection of motor imagery based on short-term entropy of time-frequency representations

BACKGROUND

Motor imagery is a cognitive process of imagining a performance of a motor task without employing the actual movement of muscles. It is often used in rehabilitation and utilized in assistive technologies to control a brain-computer interface (BCI). This paper provides a comparison of different time-frequency representations (TFR) and their Rényi and Shannon entropies for sensorimotor rhythm (SMR) based motor imagery control signals in electroencephalographic (EEG) data. The motor imagery task was guided by visual guidance, visual and vibrotactile (somatosensory) guidance or visual cue only.

RESULTS

When using TFR-based entropy features as an input for classification of different interaction intentions, higher accuracies were achieved (up to 99.87%) in comparison to regular time-series amplitude features (for which accuracy was up to 85.91%), which is an increase when compared to existing methods. In particular, the highest accuracy was achieved for the classification of the motor imagery versus the baseline (rest state) when using Shannon entropy with Reassigned Pseudo Wigner-Ville time-frequency representation.

CONCLUSIONS

Our findings suggest that the quantity of useful classifiable motor imagery information (entropy output) changes during the period of motor imagery in comparison to baseline period; as a result, there is an increase in the accuracy and F1 score of classification when using entropy features in comparison to the accuracy and the F1 of classification when using amplitude features, hence, it is manifested as an improvement of the ability to detect motor imagery.

Riemannian geometry-based metrics to measure and reinforce user performance changes during brain-computer interface user training

Despite growing interest and research into brain-computer interfaces (BCI), their usage remains limited outside of research laboratories. One reason for this is BCI inefficiency, the phenomenon where a significant number of potential users are unable to produce machine-discernible brain signal patterns to control the devices. To reduce the prevalence of BCI inefficiency, some have advocated for novel user-training protocols that enable users to more effectively modulate their neural activity. Important considerations for the design of these protocols are the assessment measures that are used for evaluating user performance and for providing feedback that guides skill acquisition. Herein, we present three trial-wise adaptations (running, sliding window and weighted average) of Riemannian geometry-based user-performance metrics (classDistinct reflecting the degree of class separability and classStability reflecting the level of within-class consistency) to enable feedback to the user following each individual trial. We evaluated these metrics, along with conventional classifier feedback, using simulated and previously recorded sensorimotor rhythm-BCI data to assess their correlation with and discrimination of broader trends in user performance. Analysis revealed that the sliding window and weighted average variants of our proposed trial-wise Riemannian geometry-based metrics more accurately reflected performance changes during BCI sessions compared to conventional classifier output. The results indicate the metrics are a viable method for evaluating and tracking user performance changes during BCI-user training and, therefore, further investigation into how these metrics may be presented to users during training is warranted.

Resting-State EEG in Alpha Rhythm May Be Indicative of the Performance of Motor Imagery-Based Brain-Computer Interface

Motor imagery-based brain-computer interfaces (MI-BCIs) have great application prospects in motor enhancement and rehabilitation. However, the capacity to control a MI-BCI varies among persons. Predicting the MI ability of a user remains challenging in BCI studies. We first calculated the relative power level (RPL), power spectral entropy (PSE) and Lempel-Ziv complexity (LZC) of the resting-state open and closed-eye EEG of different frequency bands and investigated their correlations with the upper and lower limbs MI performance (left hand, right hand, both hands and feet MI tasks) on as many as 105 subjects. Then, the most significant related features were used to construct a classifier to separate the high MI performance group from the low MI performance group. The results showed that the features of open-eye resting alpha-band EEG had the strongest significant correlations with MI performance. The PSE performed the best among all features for the screening of the MI performance, with the classification accuracy of 85.24%. These findings demonstrated that the alpha bands might offer information related to the user's MI ability, which could be used to explore more effective and general neural markers to screen subjects and design individual MI training strategies.

EEG Mental Stress Assessment Using Hybrid Multi-Domain Feature Sets of Functional Connectivity Network and Time-Frequency Features

Exposure to mental stress for long period leads to serious accidents and health problems. To avoid negative consequences on health and safety, it is very important to detect mental stress at its early stages, i.e., when it is still limited to acute or episodic stress. In this study, we developed an experimental protocol to induce two different levels of stress by utilizing a mental arithmetic task with time pressure and negative feedback as the stressors. We assessed the levels of stress on 22 healthy subjects using frontal electroencephalogram (EEG) signals, salivary alpha-amylase level (AAL), and multiple machine learning (ML) classifiers. The EEG signals were analyzed using a fusion of functional connectivity networks estimated by the Phase Locking Value (PLV) and temporal and spectral domain features. A total of 210 different features were extracted from all domains. Only the optimum multi-domain features were used for classification. We then quantified stress levels using statistical analysis and seven ML classifiers. Our result showed that the AAL level was significantly increased (p < 0.01) under stress condition in all subjects. Likewise, the functional connectivity network demonstrated a significant decrease under stress, p < 0.05. Moreover, we achieved the highest stress classification accuracy of 93.2% using the Support Vector Machine (SVM) classifier. Other classifiers produced relatively similar results.

Relative Power Correlates With the Decoding Performance of Motor Imagery Both Across Time and Subjects

One of the most significant challenges in the application of brain-computer interfaces (BCI) is the large performance variation, which often occurs over time or across users. Recent evidence suggests that the physiological states may explain this performance variation in BCI, however, the underlying neurophysiological mechanism is unclear. In this study, we conducted a seven-session motor-imagery (MI) experiment on 20 healthy subjects to investigate the neurophysiological mechanism on the performance variation. The classification accuracy was calculated offline by common spatial pattern (CSP) and support vector machine (SVM) algorithms to measure the MI performance of each subject and session. Relative Power (RP) values from different rhythms and task stages were used to reflect the physiological states and their correlation with the BCI performance was investigated. Results showed that the alpha band RP from the supplementary motor area (SMA) within a few seconds before MI was positively correlated with performance. Besides, the changes of RP between task and pre-task stage from theta, alpha, and gamma band were also found to be correlated with performance both across time and subjects. These findings reveal a neurophysiological manifestation of the performance variations, and would further provide a way to improve the BCI performance.

An overlapping sliding window and combined features based emotion recognition system for EEG signals

Purpose

The purpose of this study is to propose an alternative efficient 3D emotion recognition model for variable-length electroencephalogram (EEG) data.

Design/methodology/approach

Classical AMIGOS data set which comprises of multimodal records of varying lengths on mood, personality and other physiological aspects on emotional response is used for empirical assessment of the proposed overlapping sliding window (OSW) modelling framework. Two features are extracted using Fourier and Wavelet transforms: normalised band power (NBP) and normalised wavelet energy (NWE), respectively. The arousal, valence and dominance (AVD) emotions are predicted using one-dimension (1D) and two-dimensional (2D) convolution neural network (CNN) for both single and combined features.

Findings

The two-dimensional convolution neural network (2D CNN) outcomes on EEG signals of AMIGOS data set are observed to yield the highest accuracy, that is 96.63%, 95.87% and 96.30% for AVD, respectively, which is evidenced to be at least 6% higher as compared to the other available competitive approaches.

Originality/value

The present work is focussed on the less explored, complex AMIGOS (2018) data set which is imbalanced and of variable length. EEG emotion recognition-based work is widely available on simpler data sets. The following are the challenges of the AMIGOS data set addressed in the present work: handling of tensor form data; proposing an efficient method for generating sufficient equal-length samples corresponding to imbalanced and variable-length data.; selecting a suitable machine learning/deep learning model; improving the accuracy of the applied model.

Success of Hand Movement Imagination Depends on Personality Traits, Brain Asymmetry, and Degree of Handedness

Brain-computer interfaces (BCIs), based on motor imagery, are increasingly used in neurorehabilitation. However, some people cannot control BCI, predictors of this are the features of brain activity and personality traits. It is not known whether the success of BCI control is related to interhemispheric asymmetry. The study was conducted on 44 BCI-naive subjects and included one BCI session, EEG-analysis, 16PF Cattell Questionnaire, estimation of latent left-handedness, and of subjective complexity of real and imagery movements. The success of brain states recognition during imagination of left hand (LH) movement compared to the rest is higher in reserved, practical, skeptical, and not very sociable individuals. Extraversion, liveliness, and dominance are significant for the imagination of right hand (RH) movements in "pure" right-handers, and sensitivity in latent left-handers. Subjective complexity of real LH and of imagery RH movements correlates with the success of brain states recognition in the imagination of movement of LH compared to RH and depends on the level of handedness. Thus, the level of handedness is the factor influencing the success of BCI control. The data are supposed to be connected with hemispheric differences in motor control, lateralization of dopamine, and may be important for rehabilitation of patients after a stroke.

A novel spectral entropy-based index for assessing the depth of anaesthesia

Anaesthesia is a state of temporary controlled loss of awareness induced for medical operations. An accurate assessment of the depth of anaesthesia (DoA) helps anesthesiologists to avoid awareness during surgery and keep the recovery period short. However, the existing DoA algorithms have limitations, such as not robust enough for different patients and having time delay in assessment. In this study, to develop a reliable DoA measurement method, pre-denoised electroencephalograph (EEG) signals are divided into ten frequency bands (α, β1, β2, β3, β4, β, βγ, γ, δ and θ), and the features are extracted from different frequency bands using spectral entropy (SE) methods. SE from the beta-gamma frequency band (21.5–38.5 Hz) and SE from the beta frequency band show the highest correlation (R-squared value: 0.8458 and 0.7312, respectively) with the most popular DoA index, bispectral index (BIS). In this research, a new DoA index is developed based on these two SE features for monitoring the DoA. The highest Pearson correlation coefficient by comparing the BIS index for testing data is 0.918, and the average is 0.80. In addition, the proposed index shows an earlier reaction than the BIS index when the patient goes from deep anaesthesia to moderate anaesthesia, which means it is more suitable for the real-time DoA assessment. In the case of poor signal quality (SQ), while the BIS index exhibits inflexibility with cases of poor SQ, the new proposed index shows reliable assessment results that reflect the clinical observations.

The influence of motivation and emotion on sensorimotor rhythm-based brain-computer interface performance

While decades of research have investigated and technically improved brain-computer interface (BCI)-controlled applications, relatively little is known about the psychological aspects of brain-computer interfacing. In 35 healthy students, we investigated whether extrinsic motivation manipulated via monetary reward and emotional state manipulated via video and music would influence behavioral and psychophysiological measures of performance with a sensorimotor rhythm (SMR)-based BCI. We found increased task-related brain activity in extrinsically motivated (rewarded) as compared with nonmotivated participants but no clear effect of emotional state manipulation. Our experiment investigated the short-term effect of motivation and emotion manipulation in a group of young healthy subjects, and thus, the significance for patients in the locked-in state, who may be in need of a BCI, remains to be investigated.

A Comprehensive Review on Critical Issues and Possible Solutions of Motor Imagery Based Electroencephalography Brain-Computer Interface

Motor imagery (MI) based brain–computer interface (BCI) aims to provide a means of communication through the utilization of neural activity generated due to kinesthetic imagination of limbs. Every year, a significant number of publications that are related to new improvements, challenges, and breakthrough in MI-BCI are made. This paper provides a comprehensive review of the electroencephalogram (EEG) based MI-BCI system. It describes the current state of the art in different stages of the MI-BCI (data acquisition, MI training, preprocessing, feature extraction, channel and feature selection, and classification) pipeline. Although MI-BCI research has been going for many years, this technology is mostly confined to controlled lab environments. We discuss recent developments and critical algorithmic issues in MI-based BCI for commercial deployment.

Deep Neural Regression Prediction of Motor Imagery Skills Using EEG Functional Connectivity Indicators

Motor imaging (MI) induces recovery and neuroplasticity in neurophysical regulation. However, a non-negligible portion of users presents insufficient coordination skills of sensorimotor cortex control. Assessments of the relationship between wakefulness and tasks states are conducted to foster neurophysiological and mechanistic interpretation in MI-related applications. Thus, to understand the organization of information processing, measures of functional connectivity are used. Also, models of neural network regression prediction are becoming popular, These intend to reduce the need for extracting features manually. However, predicting MI practicing's neurophysiological inefficiency raises several problems, like enhancing network regression performance because of the overfitting risk. Here, to increase the prediction performance, we develop a deep network regression model that includes three procedures: leave-one-out cross-validation combined with Monte Carlo dropout layers, subject clustering of MI inefficiency, and transfer learning between neighboring runs. Validation is performed using functional connectivity predictors extracted from two electroencephalographic databases acquired in conditions close to real MI applications (150 users), resulting in a high prediction of pretraining desynchronization and initial training synchronization with adequate physiological interpretability.

Progress in Brain Computer Interface: Challenges and Opportunities

Brain computer interfaces (BCI) provide a direct communication link between the brain and a computer or other external devices. They offer an extended degree of freedom either by strengthening or by substituting human peripheral working capacity and have potential applications in various fields such as rehabilitation, affective computing, robotics, gaming, and neuroscience. Significant research efforts on a global scale have delivered common platforms for technology standardization and help tackle highly complex and non-linear brain dynamics and related feature extraction and classification challenges. Time-variant psycho-neurophysiological fluctuations and their impact on brain signals impose another challenge for BCI researchers to transform the technology from laboratory experiments to plug-and-play daily life. This review summarizes state-of-the-art progress in the BCI field over the last decades and highlights critical challenges.

Subject inefficiency phenomenon of motor imagery brain-computer interface: Influence factors and potential solutions

Motor imagery brain–computer interfaces (MI‐BCIs) have great potential value in prosthetics control, neurorehabilitation, and gaming; however, currently, most such systems only operate in controlled laboratory environments. One of the most important obstacles is the MI‐BCI inefficiency phenomenon. The accuracy of MI‐BCI control varies significantly (from chance level to 100% accuracy) across subjects due to the not easily induced and unstable MI‐related EEG features. An MI‐BCI inefficient subject is defined as a subject who cannot achieve greater than 70% accuracy after sufficient training time, and multiple survey results indicate that inefficient subjects account for 10%–50% of the experimental population. The widespread use of MI‐BCI has been seriously limited due to these large percentages of inefficient subjects. In this review, we summarize recent findings of the cause of MI‐BCI inefficiency from resting‐state brain function, task‐related brain activity, brain structure, and psychological perspectives. These factors help understand the reasons for inter‐subject MI‐BCI control performance variability, and it can be concluded that the lower resting‐state sensorimotor rhythm (SMR) is the key factor in MI‐BCI inefficiency, which has been confirmed by multiple independent laboratories. We then propose to divide MI‐BCI inefficient subjects into three categories according to the resting‐state SMR and offline/online accuracy to apply more accurate approaches to solve the inefficiency problem. The potential solutions include developing transfer learning algorithms, new experimental paradigms, mindfulness meditation practice, novel training strategies, and identifying new motor imagery‐related EEG features. To date, few studies have focused on improving the control accuracy of MI‐BCI inefficient subjects; thus, we appeal to the BCI community to focus more on this research area. Only by reducing the percentage of inefficient subjects can we create the opportunity to expand the value and influence of MI‐BCI.

Sensorimotor Functional Connectivity: A Neurophysiological Factor Related to BCI Performance

Brain-Computer Interfaces (BCIs) are systems that allow users to control devices using brain activity alone. However, the ability of participants to command BCIs varies from subject to subject. About 20% of potential users of sensorimotor BCIs do not gain reliable control of the system. The inefficiency to decode user's intentions requires the identification of neurophysiological factors determining “good” and “poor” BCI performers. One of the important neurophysiological aspects in BCI research is that the neuronal oscillations, used to control these systems, show a rich repertoire of spatial sensorimotor interactions. Considering this, we hypothesized that neuronal connectivity in sensorimotor areas would define BCI performance. Analyses for this study were performed on a large dataset of 80 inexperienced participants. They took part in a calibration and an online feedback session recorded on the same day. Undirected functional connectivity was computed over sensorimotor areas by means of the imaginary part of coherency. The results show that post- as well as pre-stimulus connectivity in the calibration recording is significantly correlated to online feedback performance in μ and feedback frequency bands. Importantly, the significance of the correlation between connectivity and BCI feedback accuracy was not due to the signal-to-noise ratio of the oscillations in the corresponding post and pre-stimulus intervals. Thus, this study demonstrates that BCI performance is not only dependent on the amplitude of sensorimotor oscillations as shown previously, but that it also relates to sensorimotor connectivity measured during the preceding training session. The presence of such connectivity between motor and somatosensory systems is likely to facilitate motor imagery, which in turn is associated with the generation of a more pronounced modulation of sensorimotor oscillations (manifested in ERD/ERS) required for the adequate BCI performance. We also discuss strategies for the up-regulation of such connectivity in order to enhance BCI performance.

Predicting Motor Imagery Performance From Resting-State EEG Using Dynamic Causal Modeling

Motor imagery-based brain–computer interfaces (MI-BCIs) send commands to a computer using the brain activity registered when a subject imagines—but does not perform—a given movement. However, inconsistent MI-BCI performance occurs in variations of brain signals across subjects and experiments; this is considered to be a significant problem in practical BCI. Moreover, some subjects exhibit a phenomenon referred to as “BCI-inefficiency,” in which they are unable to generate brain signals for BCI control. These subjects have significant difficulties in using BCI. The primary goal of this study is to identify the connections of the resting-state network that affect MI performance and predict MI performance using these connections. We used a public database of MI, which includes the results of psychological questionnaires and pre-experimental resting-state taken over two sessions on different days. A dynamic causal model was used to calculate the coupling strengths between brain regions with directionality. Specifically, we investigated the motor network in resting-state, including the dorsolateral prefrontal cortex, which performs motor planning. As a result, we observed a significant difference in the connectivity strength from the supplementary motor area to the right dorsolateral prefrontal cortex between the low- and high-MI performance groups. This coupling, measured in the resting-state, is significantly stronger in the high-MI performance group than the low-MI performance group. The connection strength is positively correlated with MI-BCI performance (Session 1: r = 0.54; Session 2: r = 0.42). We also predicted MI performance using linear regression based on this connection (r-squared = 0.31). The proposed predictors, based on dynamic causal modeling, can develop new strategies for improving BCI performance. These findings can further our understanding of BCI-inefficiency and help BCI users to lower costs and save time.

Use of Both Eyes-Open and Eyes-Closed Resting States May Yield a More Robust Predictor of Motor Imagery BCI Performance

Motor-imagery brain-computer interface (MI-BCI) is a technique that manipulates external machines using brain activities, and is highly useful to amyotrophic lateral sclerosis patients who cannot move their limbs. However, it is reported that approximately 15–30% of users cannot modulate their brain signals, which results in the inability to operate motor imagery BCI systems. Thus, advance prediction of BCI performance has drawn researchers’ attention, and some predictors have been proposed using the alpha band’s power, as well as other spectral bands’ powers, or spectral entropy from resting state electroencephalography (EEG). However, these predictors rely on a single state alone, such as the eyes-closed or eyes-open state; thus, they may often be less stable or unable to explain inter-/intra-subject variability. In this work, a modified predictor of MI-BCI performance that considered both brain states (eyes-open and eyes-closed resting states) was investigated with 41 online MI-BCI session datasets acquired from 15 subjects. The results showed that our proposed predictor and online MI-BCI classification accuracy were positively and highly significantly correlated (r = 0.71, p < 0.1 × 10 − 7 ), which indicates that the use of multiple brain states may yield a more robust predictor than the use of a single state alone.

Efficacy, Trainability, and Neuroplasticity of SMR vs. Alpha Rhythm Shooting Performance Neurofeedback Training

Previous literature on shooting performance neurofeedback training (SP-NFT) to enhance performance usually focused on changes in behavioral indicators, but research on the physiological features of SP-NFT is lacking. To explore the effects of SP-NFT on trainability and neuroplasticity, we conducted a study in which 45 healthy participants were randomly divided into three groups: based on sensory-motor rhythm of C3, Cz and C4 (SMR group), based on alpha rhythm of T3 and T4 (Alpha group), and no NFT (control group). The training was performed for six sessions for 3 weeks. Before and after the SP-NFT, we evaluated changes in shooting performance and resting electroencephalography (EEG) frequency power, participant's subjective task appraisal, neurofeedback trainability score, and EEG feature. Statistical analysis showed that the shooting performance of the participants in the SMR group improved significantly, the participants in the Alpha group decreased, and that of participants in the control group have no change. Meanwhile, the resting EEG power features of the two NFT groups changed specifically after training. The training process data showed that the training difficulty was significantly lower in the SMR group than in the Alpha group. Both NFT groups could improve the neurofeedback trainability scores and change the feedback features by means of their mind strategy. These results may provide evidence of trainability and neuroplasticity for SP-NFT, suggesting that the SP-NFT is effective in brain regulation and thus provide a potential method to improve shooting performance.

Capturing the Forest but Missing the Trees: Microstates Inadequate for Characterizing Shorter-Scale EEG Dynamics

The brain is known to be active even when not performing any overt cognitive tasks, and often it engages in involuntary mind wandering. This resting state has been extensively characterized in terms of fMRI-derived brain networks. However, an alternate method has recently gained popularity: EEG microstate analysis. Proponents of microstates postulate that the brain discontinuously switches between four quasi-stable states defined by specific EEG scalp topologies at peaks in the global field potential (GFP). These microstates are thought to be “atoms of thought,” involved with visual, auditory, salience, and attention processing. However, this method makes some major assumptions by excluding EEG data outside the GFP peaks and then clustering the EEG scalp topologies at the GFP peaks, assuming that only one microstate is active at any given time. This study explores the evidence surrounding these assumptions by studying the temporal dynamics of microstates and its clustering space using tools from dynamical systems analysis, fractal, and chaos theory to highlight the shortcomings in microstate analysis. The results show evidence of complex and chaotic EEG dynamics outside the GFP peaks, which is being missed by microstate analysis. Furthermore, the winner-takes-all approach of only one microstate being active at a time is found to be inadequate since the dynamic EEG scalp topology does not always resemble that of the assigned microstate, and there is competition among the different microstate classes. Finally, clustering space analysis shows that the four microstates do not cluster into four distinct and separable clusters. Taken collectively, these results show that the discontinuous description of EEG microstates is inadequate when looking at nonstationary short-scale EEG dynamics.

Wavelet Entropy-Based Inter-subject Associative Cortical Source Localization for Sensorimotor BCI

We propose event-related cortical sources estimation from subject-independent electroencephalography (EEG) recordings for motor imagery brain computer interface (BCI). By using wavelet-based maximum entropy on the mean (wMEM), task-specific EEG channels are selected to predict right hand and right foot sensorimotor tasks, employing common spatial pattern (CSP) and regularized common spatial pattern (RCSP). EEG from five healthy individuals (Dataset IVa, BCI Competition III) were evaluated by a cross-subject paradigm. Prediction performance was evaluated via a two-layer feed-forward neural network, where the classifier was trained and tested by data from two subjects independently. On average, the overall mean prediction accuracies obtained using all 118 channels are (55.98±6.53) and (71.20±5.32) in cases of CSP and RCSP, respectively, which are slightly lower than the accuracies obtained using only the selected channels, i.e., (58.95±6.90) and (71.41±6.65), respectively. The highest mean prediction accuracy achieved for a specific subject pair by using selected EEG channels was on average (90.36±5.59) and outperformed that achieved by using all available channels (86.07 ± 10.71). Spatially projected cortical sources approximated using wMEM may be useful for capturing inter-subject associative sensorimotor brain dynamics and pave the way toward an enhanced subject-independent BCI.

Week-long visuomotor coordination and relaxation trainings do not increase sensorimotor rhythms (SMR) based brain-computer interface performance

Brain-computer interfaces (BCI) translate brain activity into control signals or commands for a device. Motor imagery of the limbs allows for modulating the sensorimotor rhythms (SMR), but there are up to 30% of the participants for whom electroencephalography (EEG) based SMR-BCI cannot detect any imagery-related changes. Individual variables, such as ability to concentrate on a task and error duration in a two-hand visuomotor coordination (VMC) task have been previously found to predict accuracy in an SMR-BCI. A first study attempted to substantiate those predictors by introducing a 30 min relaxation or VMC training period prior to an SMR-BCI session, but performance did not increase when compared to a control group. As the predictor training may have been too short, we applied 4 such training sessions on consecutive days in the current study. In a pre-post design, SMR-BCI accuracy of n = 39 participants increased from session 1 before to session 2 after the predictor training. While the manipulation of the predictor variables was successful, there was no effect on SMR-BCI performance. BCI accuracy correlated positively with the neurophysiological SMR predictor identified by Blankertz et al. [3], consolidating its predictive value, and with the state mindfulness scale. No other psychological predictor could be identified or replicated. Further studies should therefore focus more on delineating (partially) replicated or potential predictors such as VMC or mindfulness to help refining a sound model to predict SMR-BCI accuracy.

Embodying the camera: An EEG study on the effect of camera movements on film spectators´ sensorimotor cortex activation

One key feature of film consists in its power to bodily engage the viewer. Previous research has suggested lens and camera movements to be among the most effective stylistic devices involved in such engagement. In an EEG experiment we assessed the role of such movements in modulating specific spectators´ neural and experiential responses, likely reflecting such engagement. We produced short video clips of an empty room with a still, a zooming and a moving camera (steadicam) that might simulate the movement of an observer in different ways. We found an event related desynchronization of the beta components of the rolandic mu rhythm that was stronger for the clips produced with steadicam than for those produced with a still or zooming camera. No equivalent modulation in the attention related occipital areas was found, thus confirming the sensorimotor nature of spectators´ neural responses to the film clips. The present study provides the first empirical evidence that filmic means such as camera movements alone can modulate spectators’ bodily engagement with film.

Cortical Classification with Rhythm Entropy for Error Processing in Cocktail Party Environment Based on Scalp EEG Recording

Using single-trial cortical signals calculated by weighted minimum norm solution estimation (WMNE), the present study explored a feature extraction method based on rhythm entropy to classify the scalp electroencephalography (EEG) signals of error response from that of correct response during performing auditory-track tasks in cocktail party environment. The classification rate achieved 89.7% with single-trial (≈700 ms) when using support vector machine(SVM) with the leave-one-out-cross-validation (LOOCV). And high discriminative regions mainly distributed at the medial frontal cortex (MFC), the left supplementary motor area (lSMA) and the right supplementary motor area (rSMA). The mean entropy value for error trials was significantly lower than that for correct trials in the discriminative cortices. By time-varying network analysis, different information flows changed among these discriminative regions with time, i.e. error processing showed a left-bias information flow, and correct processing presented a right-bias information flow. These findings revealed that the rhythm information based on single cortical signals could be well used to describe characteristics of error-related EEG signals and further provided a novel application about auditory attention for brain computer interfaces (BCIs).

Correlation Between Resting-state Electroencephalographic Characteristics and Shooting Performance

According to the theories of neural plasticity and neural efficiency, professional skill training improves performance by strengthening the underlying neural mechanisms. Therefore, subjects trained professionally may exhibit changes in resting-state neurophysiological characteristics closely related to performance. To test this notion, the resting-state electroencephalogram (EEG) was measured from 35 rifle shooters after the same training regimen, and resting-state EEG characteristics were analyzed for correlations with shooting performance. The results showed a significant linear correlation between shooting performance and the coherence of electrode channels C3 and T3 in the beta1 band (r = 0.74, P < 4.2 × 10^-6). There was also a significant linear correlation between the characteristic path length of the resting-state theta band brain network and shooting performance (r = 0.56, P < 0.0005). This study identifies potential neural mechanisms underlying successful shooting and a new method for predicting and evaluating performance based on EEG characteristics.

Spectral Entropy Can Predict Changes of Working Memory Performance Reduced by Short-Time Training in the Delayed-Match-to-Sample Task

Spectral entropy, which was generated by applying the Shannon entropy concept to the power distribution of the Fourier-transformed electroencephalograph (EEG), was utilized to measure the uniformity of power spectral density underlying EEG when subjects performed the working memory tasks twice, i.e., before and after training. According to Signed Residual Time (SRT) scores based on response speed and accuracy trade-off, 20 subjects were divided into two groups, namely high-performance and low-performance groups, to undertake working memory (WM) tasks. We found that spectral entropy derived from the retention period of WM on channel FC4 exhibited a high correlation with SRT scores. To this end, spectral entropy was used in support vector machine classifier with linear kernel to differentiate these two groups. Receiver operating characteristics analysis and leave-one out cross-validation (LOOCV) demonstrated that the averaged classification accuracy (CA) was 90.0 and 92.5% for intra-session and inter-session, respectively, indicating that spectral entropy could be used to distinguish these two different WM performance groups successfully. Furthermore, the support vector regression prediction model with radial basis function kernel and the root-mean-square error of prediction revealed that spectral entropy could be utilized to predict SRT scores on individual WM performance. After testing the changes in SRT scores and spectral entropy for each subject by short-time training, we found that 16 in 20 subjects’ SRT scores were clearly promoted after training and 15 in 20 subjects’ SRT scores showed consistent changes with spectral entropy before and after training. The findings revealed that spectral entropy could be a promising indicator to predict individual’s WM changes by training and further provide a novel application about WM for brain–computer interfaces.

White Matter Connectivity Pattern Associate with Characteristics of Scalp EEG Signals

The rhythm of electroencephalogram (EEG) depends on the neuroanatomical-based parameters such as white matter (WM) connectivity. However, the impacts of these parameters on the specific characteristics of EEG have not been clearly understood. Previous studies demonstrated that, these parameters contribute the inter-subject differences of EEG during performance of specific task such as motor imagery (MI). Though researchers have worked on this phenomenon, the idea is yet to be understood in terms of the mechanism that underlies such differences. Here, to tackle this issue, we began our investigations by first examining the structural features related to scalp EEG characteristics, which are event-related desynchronizations (ERDs), during MI using diffusion MRI. Twenty-four right-handed subjects were recruited to accomplish MI tasks and MRI scans. Based on the high spatial resolution of the structural and diffusion images, the motor-related WM links, such as basal ganglia (BG)-primary somatosensory cortex (SM1) pathway and supplementary motor area (SMA)-SM1 connection, were reconstructed by using probabilistic white matter tractography. Subsequently, the relationships of WM characteristics with EEG signals were investigated. These analyses demonstrated that WM pathway characteristics, including the connectivity strength and the positional characteristics of WM connectivity on SM1 (defined by the gyrus-sulcus ratio of connectivity, GSR), have a significant impact on ERDs when doing MI. Interestingly, the high GSR of WM connections between SM1 and BG were linked to the better ERDs. These results therefore, indicated that the connectivity in the gyrus of SM1 interacted with MI network which played the critical role for the scalp EEG signal extraction of MI to a great extent. The study provided the coupling mechanism between structural and dynamic physiological features of human brain, which would also contribute to understanding individual differences of EEG in MI-brain computer interface.

A Pilot Study on the Effects of Transcranial Direct Current Stimulation on Brain Rhythms and Entropy during Self-Paced Finger Movement using the Epoc Helmet

Transcranial direct current stimulation (tDCS) of the cerebellum is emerging as a novel non-invasive tool to modulate the activity of the cerebellar circuitry. In a single blinded study, we applied anodal tDCS (atDCS) of the cerebellum to assess its effects on brain entropy and brain rhythms during self-paced sequential finger movements in a group of healthy volunteers. Although wearable electroencephalogram (EEG) systems cannot compete with traditional clinical/laboratory set-ups in terms of accuracy and channel density, they have now reached a sufficient maturity to envision daily life applications. Therefore, the EEG was recorded with a comfortable and easy to wear 14 channels wireless helmet (Epoc headset; electrode location was based on the 10-20 system). Cerebellar neurostimulation modified brain rhythmicity with a decrease in the delta band (electrode F3 and T8, p < 0.05). By contrast, our study did not show any significant change in entropy ratios and laterality coefficients (LC) after atDCS of the cerebellum in the 14 channels. The cerebellum is heavily connected with the cerebral cortex including the frontal lobes and parietal lobes via the cerebello-thalamo-cortical pathway. We propose that the effects of anodal stimulation of the cerebellar cortex upon cerebral cortical rhythms are mediated by this key-pathway. Additional studies using high-density EEG recordings and behavioral correlates are now required to confirm our findings, especially given the limited coverage of Epoc headset.

Imagined Hand Clenching Force and Speed Modulate Brain Activity and Are Classified by NIRS Combined With EEG

Simultaneous acquisition of brain activity signals from the sensorimotor area using NIRS combined with EEG, imagined hand clenching force and speed modulation of brain activity, as well as 6-class classification of these imagined motor parameters by NIRS-EEG were explored. Near infrared probes were aligned with C3 and C4, and EEG electrodes were placed midway between the NIRS probes. NIRS and EEG signals were acquired from six healthy subjects during six imagined hand clenching force and speed tasks involving the right hand. The results showed that NIRS combined with EEG is effective for simultaneously measuring brain activity of the sensorimotor area. The study also showed that in the duration of (0, 10) s for imagined force and speed of hand clenching, HbO first exhibited a negative variation trend, which was followed by a negative peak. After the negative peak, it exhibited a positive variation trend with a positive peak about 6-8 s after termination of imagined movement. During (-2, 1) s, the EEG may have indicated neural processing during the preparation, execution, and monitoring of a given imagined force and speed of hand clenching. The instantaneous phase, frequency, and amplitude feature of the EEG were calculated by Hilbert transform; HbO and the difference between HbO and Hb concentrations were extracted. The features of NIRS and EEG were combined to classify three levels of imagined force [at 20/50/80% MVGF (maximum voluntary grip force)] and speed (at 0.5/1/2 Hz) of hand clenching by SVM. The average classification accuracy of the NIRS-EEG fusion feature was 0.74 ± 0.02. These results may provide increased control commands of force and speed for a brain-controlled robot based on NIRS-EEG.

Python Executable Script for Estimating Two Effective Parameters to Individualize Brain-Computer Interfaces: Individual Alpha Frequency and Neurophysiological Predictor

A brain-computer interface (BCI) aims to establish communication between the human brain and a computing system so as to enable the interaction between an individual and his environment without using the brain output pathways. Individuals control a BCI system by modulating their brain signals through mental tasks (e.g., motor imagery or mental calculation) or sensory stimulation (e.g., auditory, visual, or tactile). As users modulate their brain signals at different frequencies and at different levels, the appropriate characterization of those signals is necessary. The modulation of brain signals through mental tasks is furthermore a skill that requires training. Unfortunately, not all the users acquire such skill. A practical solution to this problem is to assess the user probability of controlling a BCI system. Another possible solution is to set the bandwidth of the brain oscillations, which is highly sensitive to the users' age, sex and anatomy. With this in mind, NeuroIndex, a Python executable script, estimates a neurophysiological prediction index and the individual alpha frequency (IAF) of the user in question. These two parameters are useful to characterize the user EEG signals, and decide how to go through the complex process of adapting the human brain and the computing system on the basis of previously proposed methods. NeuroIndeX is not only the implementation of those methods, but it also complements the methods each other and provides an alternative way to obtain the prediction parameter. However, an important limitation of this application is its dependency on the IAF value, and some results should be interpreted with caution. The script along with some electroencephalographic datasets are available on a GitHub repository in order to corroborate the functionality and usability of this application.

Generation Mechanism and Prediction Model for Low Frequency Noise Induced by Energy Dissipating Submerged Jets during Flood Discharge from a High Dam

As flood water is discharged from a high dam, low frequency (i.e., lower than 10 Hz) noise (LFN) associated with air pulsation is generated and propagated in the surrounding areas, causing environmental problems such as vibrations of windows and doors and discomfort of residents and construction workers. To study the generation mechanisms and key influencing factors of LFN induced by energy dissipation through submerged jets at a high dam, detailed prototype observations and analyses of LFN are conducted. The discharge flow field is simulated using a gas-liquid turbulent flow model, and the vorticity fluctuation characteristics are then analyzed. The mathematical model for the LFN intensity is developed based on vortex sound theory and a turbulent flow model, verified by prototype observations. The model results reveal that the vorticity fluctuation in strong shear layers around the high-velocity submerged jets is highly correlated with the on-site LFN, and the strong shear layers are the main regions of acoustic source for the LFN. In addition, the predicted and observed magnitudes of LFN intensity agree quite well. This is the first time that the LFN intensity has been shown to be able to be predicted quantitatively.

Structural and functional correlates of motor imagery BCI performance: Insights from the patterns of fronto-parietal attention network

Motor imagery (MI)-based brain-computer interfaces (BCIs) have been widely used for rehabilitation of motor abilities and prosthesis control for patients with motor impairments. However, MI-BCI performance exhibits a wide variability across subjects, and the underlying neural mechanism remains unclear. Several studies have demonstrated that both the fronto-parietal attention network (FPAN) and MI are involved in high-level cognitive processes that are crucial for the control of BCIs. Therefore, we hypothesized that the FPAN may play an important role in MI-BCI performance. In our study, we recorded multi-modal datasets consisting of MI electroencephalography (EEG) signals, T1-weighted structural and resting-state functional MRI data for each subject. MI-BCI performance was evaluated using the common spatial pattern to extract the MI features from EEG signals. One cortical structural feature (cortical thickness (CT)) and two measurements (degree centrality (DC) and eigenvector centrality (EC)) of node centrality were derived from the structural and functional MRI data, respectively. Based on the information extracted from the EEG and MRI, a correlation analysis was used to elucidate the relationships between the FPAN and MI-BCI performance. Our results show that the DC of the right ventral intraparietal sulcus, the EC and CT of the left inferior parietal lobe, and the CT of the right dorsolateral prefrontal cortex were significantly associated with MI-BCI performance. Moreover, the receiver operating characteristic analysis and machine learning classification revealed that the EC and CT of the left IPL could effectively predict the low-aptitude BCI users from the high-aptitude BCI users with 83.3% accuracy. Those findings consistently reveal that the individuals who have efficient FPAN would perform better on MI-BCI. Our findings may deepen the understanding of individual variability in MI-BCI performance, and also may provide a new biomarker to predict individual MI-BCI performance.

Large-Scale Assessment of a Fully Automatic Co-Adaptive Motor Imagery-Based Brain Computer Interface

In the last years Brain Computer Interface (BCI) technology has benefited from the development of sophisticated machine leaning methods that let the user operate the BCI after a few trials of calibration. One remarkable example is the recent development of co-adaptive techniques that proved to extend the use of BCIs also to people not able to achieve successful control with the standard BCI procedure. Especially for BCIs based on the modulation of the Sensorimotor Rhythm (SMR) these improvements are essential, since a not negligible percentage of users is unable to operate SMR-BCIs efficiently. In this study we evaluated for the first time a fully automatic co-adaptive BCI system on a large scale. A pool of 168 participants naive to BCIs operated the co-adaptive SMR-BCI in one single session. Different psychological interventions were performed prior the BCI session in order to investigate how motor coordination training and relaxation could influence BCI performance. A neurophysiological indicator based on the Power Spectral Density (PSD) was extracted by the recording of few minutes of resting state brain activity and tested as predictor of BCI performances. Results show that high accuracies in operating the BCI could be reached by the majority of the participants before the end of the session. BCI performances could be significantly predicted by the neurophysiological indicator, consolidating the validity of the model previously developed. Anyway, we still found about 22% of users with performance significantly lower than the threshold of efficient BCI control at the end of the session. Being the inter-subject variability still the major problem of BCI technology, we pointed out crucial issues for those who did not achieve sufficient control. Finally, we propose valid developments to move a step forward to the applicability of the promising co-adaptive methods.

Efficient resting-state EEG network facilitates motor imagery performance

OBJECTIVE

Motor imagery-based brain-computer interface (MI-BCI) systems hold promise in motor function rehabilitation and assistance for motor function impaired people. But the ability to operate an MI-BCI varies across subjects, which becomes a substantial problem for practical BCI applications beyond the laboratory.

APPROACH

Several previous studies have demonstrated that individual MI-BCI performance is related to the resting state of brain. In this study, we further investigate offline MI-BCI performance variations through the perspective of resting-state electroencephalography (EEG) network.

MAIN RESULTS

Spatial topologies and statistical measures of the network have close relationships with MI classification accuracy. Specifically, mean functional connectivity, node degrees, edge strengths, clustering coefficient, local efficiency and global efficiency are positively correlated with MI classification accuracy, whereas the characteristic path length is negatively correlated with MI classification accuracy. The above results indicate that an efficient background EEG network may facilitate MI-BCI performance. Finally, a multiple linear regression model was adopted to predict subjects' MI classification accuracy based on the efficiency measures of the resting-state EEG network, resulting in a reliable prediction.

SIGNIFICANCE

This study reveals the network mechanisms of the MI-BCI and may help to find new strategies for improving MI-BCI performance.