Rapid prototyping of an EEG-based brain-computer interface (BCI)

A deep learning approach for diagnosis of schizophrenia disorder via data augmentation based on convolutional neural network and long short-term memory

Schizophrenia (SZ) is a severe, chronic mental disorder without specific treatment. Due to the increasing prevalence of SZ in societies and the similarity of the characteristics of this disease with other mental illnesses such as bipolar disorder, most people are not aware of having it in their daily lives. Therefore, early detection of this disease will allow the sufferer to seek treatment or at least control it. Previous SZ detection studies through machine learning methods, require the extraction and selection of features before the classification process. This study attempts to develop a novel, end-to-end approach based on a 15-layers convolutional neural network (CNN) and a 16-layers CNN- long short-term memory (LSTM) to help psychiatrists automatically diagnose SZ from electroencephalogram (EEG) signals. The deep model uses CNN layers to learn the temporal properties of the signals, while LSTM layers provide the sequence learning mechanism. Also, data augmentation method based on generative adversarial networks is employed over the training set to increase the diversity of the data. Results on a large EEG dataset show the high diagnostic potential of both proposed methods, achieving remarkable accuracy of 98% and 99%. This study shows that the proposed framework is able to accurately discriminate SZ from healthy subject and is potentially useful for developing diagnostic tools for SZ disorder.

Effect of 3D paradigm synchronous motion for SSVEP-based hybrid BCI-VR system

A brain-computer interface (BCI) system and virtual reality (VR) are integrated as a more interactive hybrid system (BCI-VR) that allows the user to manipulate the car. A virtual scene in the VR system that is the same as the physical environment is built, and the object's movement can be observed in the VR scene. The four-class three-dimensional (3D) paradigm is designed and moves synchronously in virtual reality. The dynamic paradigm may affect their attention according to the experimenters' feedback. Fifteen subjects in our experiment steered the car according to a specified motion trajectory. According to our online experimental result, different motion trajectories of the paradigm have various effects on the system's performance, and training can mitigate this adverse effect. Moreover, the hybrid system using frequencies between 5 and 10 Hz indicates better performance than those using lower or higher stimulation frequencies. The experiment results show a maximum average accuracy of 0.956 and a maximum information transfer rate (ITR) of 41.033 bits/min. It suggests that a hybrid system provides a high-performance way of brain-computer interaction. This research could encourage more interesting applications involving BCI and VR technologies.

Improving Performance of Motor Imagery-Based Brain-Computer Interface in Poorly Performing Subjects Using a Hybrid-Imagery Method Utilizing Combined Motor and Somatosensory Activity

The phenomena of brain-computer interface-inefficiency in transfer rates and reliability can hinder development and use of brain-computer interface technology. This study aimed to enhance the classification performance of motor imagery-based brain-computer interface (three-class: left hand, right hand, and right foot) of poor performers using a hybrid-imagery approach that combined motor and somatosensory activity. Twenty healthy subjects participated in these experiments involving the following three paradigms: (1) Control-condition: motor imagery only, (2) Hybrid-condition I: combined motor and somatosensory stimuli (same stimulus: rough ball), and (3) Hybrid-condition II: combined motor and somatosensory stimuli (different stimulus: hard and rough, soft and smooth, and hard and rough ball). The three paradigms for all participants, achieved an average accuracy of 63.60± 21.62%, 71.25± 19.53%, and 84.09± 12.79% using the filter bank common spatial pattern algorithm (5-fold cross-validation), respectively. In the poor performance group, the Hybrid-condition II paradigm achieved an accuracy of 81.82%, showing a significant increase of 38.86% and 21.04% in accuracy compared to the control-condition (42.96%) and Hybrid-condition I (60.78%), respectively. Conversely, the good performance group showed a pattern of increasing accuracy, with no significant difference between the three paradigms. The Hybrid-condition II paradigm provided high concentration and discrimination to poor performers in the motor imagery-based brain-computer interface and generated the enhanced event-related desynchronization pattern in three modalities corresponding to different types of somatosensory stimuli in motor and somatosensory regions compared to the Control-condition and Hybrid-condition I. The hybrid-imagery approach can help improve motor imagery-based brain-computer interface performance, especially for poorly performing users, thus contributing to the practical use and uptake of brain-computer interface.

Use of artificial intelligence as an instrument of evaluation after stroke: a scoping review based on international classification of functioning, disability and health concept

INTRODUCTION

To understand the current practices in stroke evaluation, the main clinical decision support system and artificial intelligence (AI) technologies need to be understood to assist the therapist in obtaining better insights about impairments and level of activity and participation in persons with stroke during rehabilitation.

METHODS

This scoping review maps the use of AI for the functional evaluation of persons with stroke; the context involves any setting of rehabilitation. Data were extracted from CENTRAL, MEDLINE, EMBASE, LILACS, CINAHL, PEDRO Web of Science, IEEE Xplore, AAAI Publications, ACM Digital Library, MathSciNet, and arXiv up to January 2021. The data obtained from the literature review were summarized in a single dataset in which each reference paper was considered as an instance, and the study characteristics were considered as attributes. The attributes used for the multiple correspondence analysis were publication year, study type, sample size, age, stroke phase, stroke type, functional status, AI type, and AI function.

RESULTS

Forty-four studies were included. The analysis showed that spasticity analysis based on ML techniques was used for the cases of stroke with moderate functional status. The techniques of deep learning and pressure sensors were used for gait analysis. Machine learning techniques and algorithms were used for upper limb and reaching analyses. The inertial measurement unit technique was applied in studies where the functional status was between mild and severe. The fuzzy logic technique was used for activity classifiers.

CONCLUSION

The prevailing research themes demonstrated the growing utility of AI algorithms for stroke evaluation.

EEG-Based Identification of Emotional Neural State Evoked by Virtual Environment Interaction

Classifying emotional states is critical for brain–computer interfaces and psychology-related domains. In previous studies, researchers have tried to identify emotions using neural data such as electroencephalography (EEG) signals or brain functional magnetic resonance imaging (fMRI). In this study, we propose a machine learning framework for emotion state classification using EEG signals in virtual reality (VR) environments. To arouse emotional neural states in brain signals, we provided three VR stimuli scenarios to 15 participants. Fifty-four features were extracted from the collected EEG signals under each scenario. To find the optimal classification in our research design, three machine learning algorithms (XGBoost classifier, support vector classifier, and logistic regression) were applied. Additionally, various class conditions were used in machine learning classifiers to validate the performance of our framework. To evaluate the classification performance, we utilized five evaluation metrics (precision, recall, f1-score, accuracy, and AUROC). Among the three classifiers, the XGBoost classifiers showed the best performance under all experimental conditions. Furthermore, the usability of features, including differential asymmetry and frequency band pass categories, were checked from the feature importance of XGBoost classifiers. We expect that our framework can be applied widely not only to psychological research but also to mental health-related issues.

Workshops of the Eighth International Brain-Computer Interface Meeting: BCIs: The Next Frontier

The Eighth International Brain-Computer Interface (BCI) Meeting was held June 7-9th, 2021 in a virtual format. The conference continued the BCI Meeting series' interactive nature with 21 workshops covering topics in BCI (also called brain-machine interface) research. As in the past, workshops covered the breadth of topics in BCI. Some workshops provided detailed examinations of specific methods, hardware, or processes. Others focused on specific BCI applications or user groups. Several workshops continued consensus building efforts designed to create BCI standards and increase the ease of comparisons between studies and the potential for meta-analysis and large multi-site clinical trials. Ethical and translational considerations were both the primary topic for some workshops or an important secondary consideration for others. The range of BCI applications continues to expand, with more workshops focusing on approaches that can extend beyond the needs of those with physical impairments. This paper summarizes each workshop, provides background information and references for further study, presents an overview of the discussion topics, and describes the conclusion, challenges, or initiatives that resulted from the interactions and discussion at the workshop.

Assessing the Effect of the Refresh Rate of a Device on Various Motion Stimulation Frequencies Based on Steady-State Motion Visual Evoked Potentials

The refresh rate is one of the important parameters of visual presentation devices, and assessing the effect of the refresh rate of a device on motion perception has always been an important direction in the field of visual research. This study examined the effect of the refresh rate of a device on the motion perception response at different stimulation frequencies and provided an objective visual electrophysiological assessment method for the correct selection of display parameters in a visual perception experiment. In this study, a flicker-free steady-state motion visual stimulation with continuous scanning frequency and different forms (sinusoidal or triangular) was presented on a low-latency LCD monitor at different refresh rates. Seventeen participants were asked to observe the visual stimulation without head movement or eye movement, and the effect of the refresh rate was assessed by analyzing the changes in the intensity of their visual evoked potentials. The results demonstrated that an increased refresh rate significantly improved the intensity of motion visual evoked potentials at stimulation frequency ranges of 7-28 Hz, and there was a significant interaction between the refresh rate and motion frequency. Furthermore, the increased refresh rate also had the potential to enhance the ability to perceive similar motion. Therefore, we recommended using a refresh rate of at least 120 Hz in motion visual perception experiments to ensure a better stimulation effect. If the motion frequency or velocity is high, a refresh rate of≥240 Hz is also recommended.

Multi-scale noise transfer and feature frequency detection in SSVEP based on FitzHugh-Nagumo neuron system

Objective. The steady-state visual evoked potential (SSVEP) is one of the most commonly used control signals for brain-computer interfaces (BCIs) due to its excellent interactive potential, such as high tolerance to noises and robust performance across users. In addition, it has a stable cycle, obvious characteristics and minimal training requirements. However, the SSVEP is extremely weak and companied with strong and multi-scale noise, resulting in a poor signal-to-noise ratio in practice. Common algorithms for classification are based on the principle of template matching and spatial filtering, which cannot obtain satisfied performance of SSVEP detection under the multi-scale noise. Therefore, using linear methods to extract SSVEP with obvious nonlinear and non-stationary characteristics, the useful signal will be attenuated or lost.Approach.To address this issue, two novel frameworks based on a two-dimensional nonlinear FitzHugh-Nagumo (FHN) neuron system are proposed to extract feature frequency of SSVEP.Results.In order to evaluate the effectiveness of the proposed methods, this research recruit 22 subjects to participate the experiment. Experimental results show that nonlinear FHN neuron model can force the energy of noise to be transferred into SSVEP and hence amplifying the amplitude of the target frequency. Compared with the traditional methods, the FHN and FHNCCA methods can achieve higher classification accuracy and faster processing speed, which effectively improves the information transmission rate of SSVEP-based BCI.

Waveform feature extraction and signal recovery in single-channel TVEP based on Fitzhugh-Nagumo stochastic resonance

Objective. Transient visual evoked potential (TVEP) can reflect the condition of the visual pathway and has been widely used in brain-computer interface. TVEP signals are typically obtained by averaging the time-locked brain responses across dozens or even hundreds of stimulations, in order to remove different kinds of interferences. However, this procedure increases the time needed to detect the brain status in realistic applications. Meanwhile, long repeated stimuli can vary the evoked potentials and discomfort the subjects. Therefore, a novel unsupervised framework was developed in this study to realize the fast extraction of single-channel TVEP signals with a high signal-to-noise ratio.Approach.Using the principle of nonlinear aperiodic FitzHugh-Nagumo (FHN) model, a fast extraction and signal restoration technology of TVEP waveform based on FHN stochastic resonance is proposed to achieve high-quality acquisition of signal features with less average times.Results:A synergistic effect produced by noise, aperiodic signal and nonlinear system can force the energy of noise to be transferred into TVEP and hence amplifying the useful P100 feature while suppressing multi-scale noise.Significance. Compared with the conventional average and average-singular spectrum analysis-independent component analysis(average-SSA-ICA) method, the average-FHN method has a shorter stimulation time which can greatly improve the comfort of patients in clinical TVEP detection and a better performance of TVEP waveform i.e. a higher accuracy of P100 latency. The FHN recovery method is not only highly correlated with the original signal, but also can better highlight the P100 amplitude, which has high clinical application value.

Long-Term Mutual Training for the CYBATHLON BCI Race With a Tetraplegic Pilot: A Case Study on Inter-Session Transfer and Intra-Session Adaptation

CYBATHLON is an international championship where people with severe physical disabilities compete with the aid of state-of-the-art assistive technology. In one of the disciplines, the BCI Race, tetraplegic pilots compete in a computer game race by controlling an avatar with a brain-computer interface (BCI). This competition offers a perfect opportunity for BCI researchers to study long-term training effects in potential end-users, and to evaluate BCI performance in a realistic environment. In this work, we describe the BCI system designed by the team Mirage91 for participation in the CYBATHLON BCI Series 2019, as well as in the CYBATHLON 2020 Global Edition. Furthermore, we present the BCI’s interface with the game and the main methodological strategies, along with a detailed evaluation of its performance over the course of the training period, which lasted 14 months. The developed system was a 4-class BCI relying on task-specific modulations of brain rhythms. We implemented inter-session transfer learning to reduce calibration time, and to reinforce the stability of the brain patterns. Additionally, in order to compensate for potential intra-session shifts in the features’ distribution, normalization parameters were continuously adapted in an unsupervised fashion. Across the aforementioned 14 months, we recorded 26 game-based training sessions. Between the first eight sessions, and the final eight sessions leading up to the CYBATHLON 2020 Global Edition, the runtimes significantly improved from 255 ± 23 s (mean ± std) to 225 ± 22 s, respectively. Moreover, we observed a significant increase in the classifier’s accuracy from 46 to 53%, driven by more distinguishable brain patterns. Compared to conventional single session, non-adaptive BCIs, the inter-session transfer learning and unsupervised intra-session adaptation techniques significantly improved the performance. This long-term study demonstrates that regular training helped the pilot to significantly increase the distance between task-specific patterns, which resulted in an improvement of performance, both with respect to class separability in the calibration data, and with respect to the game. Furthermore, it shows that our methodological approaches were beneficial in transferring the performance across sessions, and most importantly to the CYBATHLON competitions.

Nano Foldaway Skin-like E-interface for Detecting Human Bioelectrical Signals

Flexible electrodes applied to different positions of the human body to detect bioelectrical signals need to be conductive with respect to both the skin and the external circuit. However, electrodes fabricated with micromachining can only be made conductive on one side, which requires inserting connection wires, thus affecting skin adhesion and leading to a more fragile circuit on the soft substrate. This paper proposes an e-interface designed with an innovative folding transfer process, which can fold nanometer thick electrodes in a macroscopic way. Avoiding the difficulties of fabricating double layer as well as an insulation layer, the e-interface is not only skin-conformable for long-term wear but also provides a stable connecting pad for the subsequent circuit by its double-sided conductivity. The e-interface can be stretched to more than 25% of its original length and achieve electrical stability in the long-term signal acquisition. A responsive ECG signal is obtained by the e-interface, and the signal remains stable during exercise.

Kinesthetic illusion induced by visual stimulation influences sensorimotor event-related desynchronization in stroke patients with severe upper-limb paralysis: A pilot study

BACKGROUND

Repetition of motor imagery improves the motor function of patients with stroke. However, patients who develop severe upper-limb paralysis after chronic stroke often have an impaired ability to induce motor imagery. We have developed a method to passively induce kinesthetic perception using visual stimulation (kinesthetic illusion induced by visual stimulation [KINVIS]).

OBJECTIVE

This pilot study further investigated the effectiveness of KINVIS in improving the induction of kinesthetic motor imagery in patients with severe upper-limb paralysis after stroke.

METHODS

Twenty participants (11 with right hemiplegia and 9 with left hemiplegia; mean time from onset [±standard deviation], 67.0±57.2 months) with severe upper-limb paralysis who could not extend their paretic fingers were included in this study. The ability to induce motor imagery was evaluated using the event-related desynchronization (ERD) recorded during motor imagery before and after the application of KINVIS for 20 min. The alpha- and beta-band ERDs around the premotor, primary sensorimotor, and posterior parietal cortices of the affected and unaffected hemispheres were evaluated during kinesthetic motor imagery of finger extension and before and after the intervention.

RESULTS

Beta-band ERD recorded from the affected hemisphere around the sensorimotor area showed a significant increase after the intervention, while the other ERDs remained unchanged.

CONCLUSIONS

In patients with chronic stroke who were unable to extend their paretic fingers for a prolonged period of time, the application of KINVIS, which evokes kinesthetic perception, improved their ability to induce motor imagery. Our findings suggest that although KINVIS is a passive intervention, its short-term application can induce changes related to the motor output system.

An empirical survey of electroencephalography-based brain-computer interfaces

Objectives

The Electroencephalogram (EEG) signal is modified using the Motor Imagery (MI) and it is utilized for patients with high motor impairments. Hence, the direct relationship between the computer and brain is termed as an EEG-based brain-computer interface (BCI). The objective of this survey is to presents an analysis of the existing distinct BCIs based on EEG.

Methods

This survey provides a detailed review of more than 60 research papers presenting the BCI-based EEG, like motor imagery-based techniques, spatial filtering-based techniques, Steady-State Visual Evoked Potential (SSVEP)-based techniques, machine learning-based techniques, Event-Related Potential (ERP)-based techniques, and online EEG-based techniques. Subsequently, the research gaps and issues of several EEG-based BCI systems are adopted to help the researchers for better future scope.

Results

An elaborative analyses as well as discussion have been provided by concerning the parameters, like evaluation metrics, year of publication, accuracy, implementation tool, and utilized datasets obtained by various techniques.

Conclusions

This survey paper exposes research topics on BCI-based EEG, which helps the researchers and scholars, who are interested in this domain.

Optimizing SSVEP-Based BCI System towards Practical High-Speed Spelling

The brain–computer interface (BCI) spellers based on steady-state visual evoked potentials (SSVEPs) have recently been widely investigated for their high information transfer rates (ITRs). This paper aims to improve the practicability of the SSVEP-BCIs for high-speed spelling. The system acquired the electroencephalogram (EEG) data from a self-developed dedicated EEG device and the stimulation was arranged as a keyboard. The task-related component analysis (TRCA) spatial filter was modified (mTRCA) for target classification and showed significantly higher performance compared with the original TRCA in the offline analysis. In the online system, the dynamic stopping (DS) strategy based on Bayesian posterior probability was utilized to realize alterable stimulating time. In addition, the temporal filtering process and the programs were optimized to facilitate the online DS operation. Notably, the online ITR reached 330.4 ± 45.4 bits/min on average, which is significantly higher than that of fixed stopping (FS) strategy, and the peak value of 420.2 bits/min is the highest online spelling ITR with a SSVEP-BCI up to now. The proposed system with portable EEG acquisition, friendly interaction, and alterable time of command output provides more flexibility for SSVEP-based BCIs and is promising for practical high-speed spelling.

Feature selection for classification in Steady state visually evoked potentials (SSVEP)-based brain-computer interfaces with genetic algorithm

Objectives

Optimization of Brain-Computer Interface by detecting the minimal number of morphological features of signal that maximize accuracy.

Methods

System of signal processing and morphological features extractor was designed, then the genetic algorithm was used to select such characteristics that maximize the accuracy of the signal’s frequency recognition in offline Brain-Computer Interface (BCI).

Results

The designed system provides higher accuracy results than a previously developed system that uses the same preprocessing methods, however, different results were achieved for various subjects.

Conclusions

It is possible to enhance the previously developed BCI by combining it with morphological features extraction, however, it’s performance is dependent on subject variability.

Review on motor imagery based BCI systems for upper limb post-stroke neurorehabilitation: From designing to application

Strokes are a growing cause of mortality and many stroke survivors suffer from motor impairment as well as other types of disabilities in their daily life activities. To treat these sequelae, motor imagery (MI) based brain-computer interface (BCI) systems have shown potential to serve as an effective neurorehabilitation tool for post-stroke rehabilitation therapy. In this review, different MI-BCI based strategies, including "Functional Electric Stimulation, Robotics Assistance and Hybrid Virtual Reality based Models," have been comprehensively reported for upper-limb neurorehabilitation. Each of these approaches have been presented to illustrate the in-depth advantages and challenges of the respective BCI systems. Additionally, the current state-of-the-art and main concerns regarding BCI based post-stroke neurorehabilitation devices have also been discussed. Finally, recommendations for future developments have been proposed while discussing the BCI neurorehabilitation systems.

SimBSI: An open-source Simulink library for developing closed-loop brain signal interfaces in animals and humans

OBJECTIVE

A promising application of BCI technology is in the development of personalized therapies that can target neural circuits linked to mental or physical disabilities. Typical BCIs, however, offer limited value due to simplistic designs and poor understanding of the conditions being treated. Building BCIs on more solid grounds may require the characterization of the brain dynamics supporting cognition and behavior at multiple scales, from single-cell and local field potential (LFP) recordings in animals to non-invasive electroencephalography (EEG) in humans. Despite recent efforts, a unifying software framework to support closed-loop studies in both animals and humans is still lacking. The objective of this paper is to develop such a unifying neurotechnological software framework.

APPROACH

Here we develop the Simulink for Brain Signal Interfaces library (SimBSI). Simulink is a mature graphical programming environment within MATLAB that has gained traction for processing electrophysiological data. SimBSI adds to this ecosystem: 1) advanced human EEG source imaging, 2) cross-species multimodal data acquisition based on the Lab Streaming Layer library, and 3) a graphical experimental design platform.

MAIN RESULTS

We use several examples to demonstrate the capabilities of the library, ranging from simple signal processing, to online EEG source imaging, cognitive task design, and closed-loop neuromodulation. We further demonstrate the simplicity of developing a sophisticated experimental environment for rodents within this environment.

SIGNIFICANCE

With the SimBSI library we hope to aid BCI practitioners of dissimilar backgrounds in the development of, much needed, single and cross-species closed-loop neuroscientific experiments. These experiments may provide the necessary mechanistic data for BCIs to become effective therapeutic tools.

Real-Time EMG Based Pattern Recognition Control for Hand Prostheses: A Review on Existing Methods, Challenges and Future Implementation

Upper limb amputation is a condition that significantly restricts the amputees from performing their daily activities. The myoelectric prosthesis, using signals from residual stump muscles, is aimed at restoring the function of such lost limbs seamlessly. Unfortunately, the acquisition and use of such myosignals are cumbersome and complicated. Furthermore, once acquired, it usually requires heavy computational power to turn it into a user control signal. Its transition to a practical prosthesis solution is still being challenged by various factors particularly those related to the fact that each amputee has different mobility, muscle contraction forces, limb positional variations and electrode placements. Thus, a solution that can adapt or otherwise tailor itself to each individual is required for maximum utility across amputees. Modified machine learning schemes for pattern recognition have the potential to significantly reduce the factors (movement of users and contraction of the muscle) affecting the traditional electromyography (EMG)-pattern recognition methods. Although recent developments of intelligent pattern recognition techniques could discriminate multiple degrees of freedom with high-level accuracy, their efficiency level was less accessible and revealed in real-world (amputee) applications. This review paper examined the suitability of upper limb prosthesis (ULP) inventions in the healthcare sector from their technical control perspective. More focus was given to the review of real-world applications and the use of pattern recognition control on amputees. We first reviewed the overall structure of pattern recognition schemes for myo-control prosthetic systems and then discussed their real-time use on amputee upper limbs. Finally, we concluded the paper with a discussion of the existing challenges and future research recommendations.

Augmentative and Alternative Communication (AAC) Advances: A Review of Configurations for Individuals with a Speech Disability

High-tech augmentative and alternative communication (AAC) methods are on a constant rise; however, the interaction between the user and the assistive technology is still challenged for an optimal user experience centered around the desired activity. This review presents a range of signal sensing and acquisition methods utilized in conjunction with the existing high-tech AAC platforms for individuals with a speech disability, including imaging methods, touch-enabled systems, mechanical and electro-mechanical access, breath-activated methods, and brain-computer interfaces (BCI). The listed AAC sensing modalities are compared in terms of ease of access, affordability, complexity, portability, and typical conversational speeds. A revelation of the associated AAC signal processing, encoding, and retrieval highlights the roles of machine learning (ML) and deep learning (DL) in the development of intelligent AAC solutions. The demands and the affordability of most systems hinder the scale of usage of high-tech AAC. Further research is indeed needed for the development of intelligent AAC applications reducing the associated costs and enhancing the portability of the solutions for a real user's environment. The consolidation of natural language processing with current solutions also needs to be further explored for the amelioration of the conversational speeds. The recommendations for prospective advances in coming high-tech AAC are addressed in terms of developments to support mobile health communicative applications.

Fully Open-Access Passive Dry Electrodes BIOADC: Open-Electroencephalography (EEG) Re-Invented

The Open-electroencephalography (EEG) framework is a popular platform to enable EEG measurements and general purposes Brain Computer Interface experimentations. However, the current platform is limited by the number of available channels and electrode compatibility. In this paper we present a fully configurable platform with up to 32 EEG channels and compatibility with virtually any kind of passive electrodes including textile, rubber and contactless electrodes. Together with the full hardware details, results and performance on a single volunteer participant (limited to alpha wave elicitation), we present the brain computer interface (BCI)2000 EEG source driver together with source code as well as the compiled (.exe). In addition, all the necessary device firmware, gerbers and bill of materials for the full reproducibility of the presented hardware is included. Furthermore, the end user can vary the dry-electrode reference circuitry, circuit bandwidth as well as sample rate to adapt the device to other generalized biopotential measurements. Although, not implemented in the tested prototype, the Biomedical Analogue to Digital Converter BIOADC naturally supports SPI communication for an additional 32 channels including the gain controller. In the appendix we describe the necessary modification to the presented hardware to enable this function.

A Shaping Procedure to Modulate Two Cognitive Tasks to Improve a Sensorimotor Rhythm-Based Brain-Computer Interface System

This study aimed to propose an adapted feedback using a psychological learning technique based on Skinner's shaping method to help the users to modulate two cognitive tasks (right-hand motor imagination and relaxed state) and improve better control in a Brain-Computer Interface. In the first experiment, a comparative study between performance in standard feedback (N = 9) and shaping method (N = 10) was conducted. The NASA Task Load Index questionnaire was applied to measure the user's workload. In the second experiment, a single case study was performed (N = 5) to verify the continuous learning by the shaping method. The first experiment showed significant interaction effect between sessions and group (F(1, 17) = 5.565; p = .031) which the shaping paradigm was applied. A second interaction effect demonstrates a higher performance increase in the relax state task with shaping procedure (F(1, 17) = 5. 038; p = .038). In NASA-TXL an interaction effect was obtained between the group and the cognitive task in Mental Demand (F(1, 17) = 6, 809; p = .018), Performance (F(1, 17) = 5, 725; p = .029), and Frustration (F(1, 17) = 9, 735; p = .006), no significance was found in Effort. In the second experiment, a trial-by-trial analysis shows an ascendant trend learning curve for the cognitive task with the lowest initial acquisition (relax state). The results suggest the effectiveness of the shaping procedure to modulate brain rhythms, improving mainly the cognitive task with greater initial difficulty and provide better interaction perception.

Highly Efficient Compression Algorithms for Multichannel EEG

The difficulty associated with processing and understanding the high dimensionality of electroencephalogram (EEG) data requires developing efficient and robust compression algorithms. In this paper, different lossless compression techniques of single and multichannel EEG data, including Huffman coding, arithmetic coding, Markov predictor, linear predictor, context-based error modeling, multivariate autoregression (MVAR), and a low complexity bivariate model have been examined and their performances have been compared. Furthermore, a high compression algorithm named general MVAR and a modified context-based error modeling for multichannel EEG have been proposed. The resulting compression algorithm produces a higher relative compression ratio of 70.64% on average compared with the existing methods, and in some cases, it goes up to 83.06%. The proposed methods are designed to compress a large amount of multichannel EEG data efficiently so that the data storage and transmission bandwidth can be effectively used. These methods have been validated using several experimental multichannel EEG recordings of different subjects and publicly available standard databases. The satisfactory parametric measures of these methods, namely percent-root-mean square distortion, peak signal-to-noise ratio, root-mean-square error, and cross correlation, show their superiority over the state-of-the-art compression methods.

Day-to-day variability in hybrid, passive brain-computer interfaces: comparing two studies assessing cognitive workload

As hybrid, passive brain-computer interface systems become more advanced, it is important to grow our understanding of how to produce generalizable pattern classifiers of physiological data. One of the most difficult problems in applying machine learning algorithms to these data types is nonstationarity, which can evolve over the course of hours and days, and is more susceptible to changes resulting from complex cognitive function in comparison to simple, stimulus-based processes. This nonstationarity, referenced as day-to-day variability, results in the inability of many learning algorithms to generalize to new data. In previous work, we have shown that increasing the number of unique testing sessions used to form a learning set can improve the accuracy of classifying mental workload in a binary state paradigm. While this result was very promising, we did not address whether the additional discriminability was the result of a larger learning set or the uniqueness contributed by the testing sessions being spread over multiple days. Further, the simulation task used in this prior analysis was low-fidelity with respect to the task it attempted to model; whether these methods extend to more realistic task simulation environments has not been comparatively investigated. In this work, we compare these previous results to a second study, with a similar multi-day paradigm, that required participants to perform a more realistic simulation task. Comparative analysis of these two studies reveals that the improved generalization of the multi-day learning set is attributable, in large part, to the uniqueness of the multi-day paradigm. Further, this multi-day effect was also observed in the higher fidelity simulation study. These results help to validate the use of the multi-day learning set approach for improving overall system classification accuracy. Future studies should consider the use of multi-day designs for improving generalizability over other interesting dimensions.

Comparison Analysis: Granger Causality and New Causality and Their Applications to Motor Imagery

In this paper we first point out a fatal drawback that the widely used Granger causality (GC) needs to estimate the autoregressive model, which is equivalent to taking a series of backward recursive operations which are infeasible in many irreversible chemical reaction models. Thus, new causality (NC) proposed by Hu et al. (2011) is theoretically shown to be more sensitive to reveal true causality than GC. We then apply GC and NC to motor imagery (MI) which is an important mental process in cognitive neuroscience and psychology and has received growing attention for a long time. We study causality flow during MI using scalp electroencephalograms from nine subjects in Brain-computer interface competition IV held in 2008. We are interested in three regions: Cz (central area of the cerebral cortex), C3 (left area of the cerebral cortex), and C4 (right area of the cerebral cortex) which are considered to be optimal locations for recognizing MI states in the literature. Our results show that: 1) there is strong directional connectivity from Cz to C3/C4 during left- and right-hand MIs based on GC and NC; 2) during left-hand MI, there is directional connectivity from C4 to C3 based on GC and NC; 3) during right-hand MI, there is strong directional connectivity from C3 to C4 which is much clearly revealed by NC than by GC, i.e., NC largely improves the classification rate; and 4) NC is demonstrated to be much more sensitive to reveal causal influence between different brain regions than GC.

Single-trial EEG analysis using similarity measure

Single-trial electroencephalogram (EEG) data are analyzed with similarity measure. Time-frequency representation is constructed from EEG signals. It is then weighted with t-statistics. Finally, the test data are discriminated with similarity measure. Compared with non-weighted version, the experimental results indicate that the proposed method obtains better results in classification accuracy.

Assembling A Multi-Feature EEG Classifier for Left–Right Motor Imagery Data Using Wavelet-Based Fuzzy Approximate Entropy for Improved Accuracy

An EEG classifier is proposed for application in the analysis of motor imagery (MI) EEG data from a brain–computer interface (BCI) competition in this study. Applying subject-action-related brainwave data acquired from the sensorimotor cortices, the system primarily consists of artifact and background removal, feature extraction, feature selection and classification. In addition to background noise, the electrooculographic (EOG) artifacts are also automatically removed to further improve the analysis of EEG signals. Several potential features, including amplitude modulation, spectral power and asymmetry ratio, adaptive autoregressive model, and wavelet fuzzy approximate entropy (wfApEn) that can measure and quantify the complexity or irregularity of EEG signals, are then extracted for subsequent classification. Finally, the significant sub-features are selected from feature combination by quantum-behaved particle swarm optimization and then classified by support vector machine (SVM). Compared with feature extraction without wfApEn on MI data from two data sets for nine subjects, the results indicate that the proposed system including wfApEn obtains better performance in average classification accuracy of 88.2% and average number of commands per minute of 12.1, which is promising in the BCI work applications.

Using a brain-machine interface to control a hybrid upper limb exoskeleton during rehabilitation of patients with neurological conditions

Background

As a consequence of the increase of cerebro-vascular accidents, the number of people suffering from motor disabilities is raising. Exoskeletons, Functional Electrical Stimulation (FES) devices and Brain-Machine Interfaces (BMIs) could be combined for rehabilitation purposes in order to improve therapy outcomes.

Methods

In this work, a system based on a hybrid upper limb exoskeleton is used for neurological rehabilitation. Reaching movements are supported by the passive exoskeleton ArmeoSpring and FES. The movement execution is triggered by an EEG-based BMI. The BMI uses two different methods to interact with the exoskeleton from the user’s brain activity. The first method relies on motor imagery tasks classification, whilst the second one is based on movement intention detection.

Results

Three healthy users and five patients with neurological conditions participated in the experiments to verify the usability of the system. Using the BMI based on motor imagery, healthy volunteers obtained an average accuracy of 82.9 ± 14.5 %, and patients obtained an accuracy of 65.3 ± 9.0 %, with a low False Positives rate (FP) (19.2 ± 10.4 % and 15.0 ± 8.4 %, respectively). On the other hand, by using the BMI based on detecting the arm movement intention, the average accuracy was 76.7 ± 13.2 % for healthy users and 71.6 ± 15.8 % for patients, with 28.7 ± 19.9 % and 21.2 ± 13.3 % of FP rate (healthy users and patients, respectively).

Conclusions

The accuracy of the results shows that the combined use of a hybrid upper limb exoskeleton and a BMI could be used for rehabilitation therapies. The advantage of this system is that the user is an active part of the rehabilitation procedure. The next step will be to verify what are the clinical benefits for the patients using this new rehabilitation procedure.

Enhancing the performance of motor imagery EEG classification using phase features

An electroencephalogram recognition system considering phase features is proposed to enhance the performance of motor imagery classification in this study. It mainly consists of feature extraction, feature selection and classification. Surface Laplacian filter is used for background removal. Several potential features, including phase features, are then extracted to enhance the classification accuracy. Next, genetic algorithm is used to select sub-features from feature combination. Finally, selected features are classified by extreme learning machine. Compared with "without phase features" and linear discriminant analysis on motor imagery data from 2 data sets, the results denote that the proposed system achieves enhanced performance, which is suitable for the brain-computer interface applications.

Motor imagery EEG discrimination using the correlation of wavelet features

A novel method for motor imagery (MI) electroencephalogram (EEG) data classification is proposed in this study. Time-frequency representation is constructed by means of continuous wavelet transform from EEG signals and then weighted with 2-sample t-statistics, which are also used to automatically select the area of interest in advance. Finally, normalized cross-correlation is used to discriminate the test MI data. Compared with the nonweighted version on MI data, the experimental results indicate that the proposed system achieves satisfactory results in the applications of brain-computer interface (BCI).

Electrode replacement does not affect classification accuracy in dual-session use of a passive brain-computer interface for assessing cognitive workload

The passive brain-computer interface (pBCI) framework has been shown to be a very promising construct for assessing cognitive and affective state in both individuals and teams. There is a growing body of work that focuses on solving the challenges of transitioning pBCI systems from the research laboratory environment to practical, everyday use. An interesting issue is what impact methodological variability may have on the ability to reliably identify (neuro)physiological patterns that are useful for state assessment. This work aimed at quantifying the effects of methodological variability in a pBCI design for detecting changes in cognitive workload. Specific focus was directed toward the effects of replacing electrodes over dual sessions (thus inducing changes in placement, electromechanical properties, and/or impedance between the electrode and skin surface) on the accuracy of several machine learning approaches in a binary classification problem. In investigating these methodological variables, it was determined that the removal and replacement of the electrode suite between sessions does not impact the accuracy of a number of learning approaches when trained on one session and tested on a second. This finding was confirmed by comparing to a control group for which the electrode suite was not replaced between sessions. This result suggests that sensors (both neurological and peripheral) may be removed and replaced over the course of many interactions with a pBCI system without affecting its performance. Future work on multi-session and multi-day pBCI system use should seek to replicate this (lack of) effect between sessions in other tasks, temporal time courses, and data analytic approaches while also focusing on non-stationarity and variable classification performance due to intrinsic factors.

Brain-computer interfaces using sensorimotor rhythms: current state and future perspectives

Many studies over the past two decades have shown that people can use brain signals to convey their intent to a computer using brain-computer interfaces (BCIs). BCI systems extract specific features of brain activity and translate them into control signals that drive an output. Recently, a category of BCIs that are built on the rhythmic activity recorded over the sensorimotor cortex, i.e., the sensorimotor rhythm (SMR), has attracted considerable attention among the BCIs that use noninvasive neural recordings, e.g., electroencephalography (EEG), and have demonstrated the capability of multidimensional prosthesis control. This paper reviews the current state and future perspectives of SMR-based BCI and its clinical applications, in particular focusing on the EEG SMR. The characteristic features of SMR from the human brain are described and their underlying neural sources are discussed. The functional components of SMR-based BCI, together with its current clinical applications, are reviewed. Finally, limitations of SMR-BCIs and future outlooks are also discussed.

Application of BCI systems in neurorehabilitation: a scoping review

PURPOSE

To review various types of electroencephalographic activities of the brain and present an overview of brain-computer interface (BCI) systems' history and their applications in rehabilitation.

METHODS

A scoping review of published English literature on BCI application in the field of rehabilitation was undertaken. IEEE Xplore, ScienceDirect, Google Scholar and Scopus databases were searched since inception up to August 2012. All experimental studies published in English and discussed complete cycle of the BCI process was included in the review.

RESULTS AND DISCUSSION

In total, 90 articles met the inclusion criteria and were reviewed. Various approaches that improve the accuracy and performance of BCI systems were discussed. Based on BCI's clinical application, reviewed articles were categorized into three groups: motion rehabilitation, speech rehabilitation and virtual reality control (VRC). Almost half of the reviewed papers (48%) concentrated on VRC. Speech rehabilitation and motion rehabilitation made up 33% and 19% of the reviewed papers, respectively. Among different types of electroencephalography signals, P300, steady state visual evoked potentials and motor imagery signals were the most common.

CONCLUSIONS

This review discussed various applications of BCI in rehabilitation and showed how BCI can be used to improve the quality of life for people with neurological disabilities. It will develop and promote new models of communication and finally, will create an accurate, reliable, online communication between human brain and computer and reduces the negative effects of external stimuli on BCI performance. Implications for Rehabilitation The field of brain-computer interfaces (BCI) is rapidly advancing and it is expected to fulfill a critical role in rehabilitation of neurological disorders and in movement restoration in the forthcoming years. In the near future, BCI has notable potential to become a major tool used by people with disabilities to control locomotion and communicate with surrounding environment and, consequently, improve the quality of life for many affected persons. Electrical field recording at the scalp (i.e. electroencephalography) is the most likely method to be of practical value for clinical use as it is simple and non-invasive. However, some aspects need future improvements, such as the ability to separate close imagery signal (motion of extremities and phalanges that are close together).

Predicting the performance of motor imagery in stroke patients: multivariate pattern analysis of functional MRI data

BACKGROUND

In a brain-computer interface for stroke rehabilitation, motor imagery is a preferred means for providing a gateway to an effector action or behavior. However, stroke patients often exhibit failure to comply with motor imagery, and therefore their motor imagery performance is highly variable.

OBJECTIVE

We sought to identify motor cortical areas responsible for motor imagery performance in stroke patients, specifically by using a multivariate pattern analysis of functional magnetic resonance imaging data.

METHODS

We adopted an imaginary finger tapping task in which motor imagery performance could be monitored for 12 chronic stroke patients with subcortical infarcts and 12 age- and sex-matched healthy controls. We identified the typical activation pattern elicited for motor imagery in healthy controls, as computed over the voxels within each searchlight in the motor cortex. Then we measured the similarity of each individual's activation pattern to the typical activation pattern.

RESULTS

In terms of activation levels, the stroke patients showed no activation in the ipsilesional primary motor cortex (M1); in terms of activation patterns, they showed lower similarity to the typical activation pattern in the area than the healthy controls. Furthermore, the stroke patients were better able to perform motor imagery if their activation patterns in the bilateral supplementary motor areas and ipsilesional M1 were close to the typical activation pattern.

CONCLUSIONS

These findings suggest functional roles of the motor cortical areas for compliance with motor imagery in stroke, which can be applied to the implementation of motor imagery-based brain-computer interface for stroke rehabilitation.

Improving classification accuracy of motor imagery EEG using genetic feature selection

In this study, an electroencephalogram (EEG) analysis system combined with feature selection, is proposed to enhance the classification of motor imagery (MI) data. It principally comprises feature extraction, feature selection, and classification. First, several features, including adaptive autoregressive (AAR) parameters, spectral power, asymmetry ratio, coherence and phase-locking value are extracted for subsequent classification. A genetic algorithm is then used to select features from the combination of the aforementioned features. Finally, the selected features are classified by support vector machine (SVM). Compared with "without feature selection" and back-propagation neural network (BPNN) on MI data from 2 data sets, the proposed system achieves better classification accuracy and is suitable for the applications of brain-computer interface (BCI).

Modified CC-LR algorithm with three diverse feature sets for motor imagery tasks classification in EEG based brain-computer interface

Motor imagery (MI) tasks classification provides an important basis for designing brain-computer interface (BCI) systems. If the MI tasks are reliably distinguished through identifying typical patterns in electroencephalography (EEG) data, a motor disabled people could communicate with a device by composing sequences of these mental states. In our earlier study, we developed a cross-correlation based logistic regression (CC-LR) algorithm for the classification of MI tasks for BCI applications, but its performance was not satisfactory. This study develops a modified version of the CC-LR algorithm exploring a suitable feature set that can improve the performance. The modified CC-LR algorithm uses the C3 electrode channel (in the international 10-20 system) as a reference channel for the cross-correlation (CC) technique and applies three diverse feature sets separately, as the input to the logistic regression (LR) classifier. The present algorithm investigates which feature set is the best to characterize the distribution of MI tasks based EEG data. This study also provides an insight into how to select a reference channel for the CC technique with EEG signals considering the anatomical structure of the human brain. The proposed algorithm is compared with eight of the most recently reported well-known methods including the BCI III Winner algorithm. The findings of this study indicate that the modified CC-LR algorithm has potential to improve the identification performance of MI tasks in BCI systems. The results demonstrate that the proposed technique provides a classification improvement over the existing methods tested.

Complexity and familiarity enhance single-trial detectability of imagined movements with electroencephalography

OBJECTIVE

We sought to determine whether the sensorimotor rhythms (SMR) elicited during motor imagery (MI) of complex and familiar actions could be more reliably detected with electroencephalography (EEG), and subsequently classified on a single-trial basis, than those elicited during relatively simpler imagined actions.

METHODS

Groups of healthy volunteers, including experienced pianists and ice hockey players, performed MI of varying complexity and familiarity. Their electroencephalograms were recorded and compared using brain-computer interface (BCI) approaches and spectral analyses.

RESULTS

Relative to simple MI, significantly more participants produced classifiable SMR for complex MI. During MI of performance of a complex musical piece, the EEG of the experienced pianists was classified significantly more accurately than during MI of performance of a simpler musical piece. The accuracy of EEG classification was also significantly more sustained during complex MI.

CONCLUSION

MI of complex actions results in EEG responses that are more reliably classified for more individuals than MI of relatively simpler actions, and familiarity with actions enhances these responses in some cases.

SIGNIFICANCE

The accuracy of SMR-based BCIs in non-communicative patients may be improved by employing familiar and complex actions. Increased sensitivity to MI may also improve diagnostic accuracy for severely brain-injured patients in a vegetative state.

Endogenous brain-machine interface based on the correlation of EEG maps

In this paper, a non-invasive endogenous brain-machine interface (BMI) based on the correlation of EEG maps has been developed to work in real-time applications. The classifier is able to detect two mental tasks related to motor imagery with good success rates and stability. The BMI has been tested with four able-bodied volunteers. First, the users performed a training with visual feedback to adjust the classifier. Afterwards, the users carried out several trajectories in a visual interface controlling the cursor position with the BMI. In these tests, score and accuracy were measured. The results showed that the participants were able to follow the targets during the performed trajectory, proving that the EEG mapping correlation classifier is ready to work in more complex real-time applications aimed at helping people with a severe disability in their daily life.

Poor performance in SSVEP BCIs: are worse subjects just slower?

Brain-computer interface (BCI) systems translate brain activity into messages or commands. BCI studies that record from a dozen or more subjects typically report substantial variations in performance, as measured by accuracy. Usually, some subjects attain excellent (even perfect) accuracy, while at least one subject performs so poorly that effective communication would not be possible with that BCI. This study aims to further explore the differences between the best and worst performers by studying the changes in estimated accuracy within each trial in an offline simulation of an SSVEP BCI. Results showed that the worst performers not only attained lower accuracies, but needed more time after cue onset before their accuracies improved substantially. This outcome suggests that poor performance may be partly (though not completely) explained by the latency between cue onset and improved accuracy.

EEG-based classification of imaginary left and right foot movements using beta rebound

OBJECTIVE

The purpose of this study was to investigate cortical lateralization of event-related (de)synchronization during left and right foot motor imagery tasks and to determine classification accuracy of the two imaginary movements in a brain-computer interface (BCI) paradigm.

METHODS

We recorded 31-channel scalp electroencephalograms (EEGs) from nine healthy subjects during brisk imagery tasks of left and right foot movements. EEG was analyzed with time-frequency maps and topographies, and the accuracy rate of classification between left and right foot movements was calculated.

RESULTS

Beta rebound at the end of imagination (increase of EEG beta rhythm amplitude) was identified from the two EEGs derived from the right-shift and left-shift bipolar pairs at the vertex. This process enabled discrimination between right or left foot imagery at a high accuracy rate (maximum 81.6% in single trial analysis).

CONCLUSION

These data suggest that foot motor imagery has potential to elicit left-right differences in EEG, while BCI using the unilateral foot imagery can achieve high classification accuracy, similar to ordinary BCI, based on hand motor imagery.

SIGNIFICANCE

By combining conventional discrimination techniques, the left-right discrimination of unilateral foot motor imagery provides a novel BCI system that could control a foot neuroprosthesis or a robotic foot.