CSP-TSM: Optimizing the performance of Riemannian tangent space mapping using common spatial pattern for MI-BCI

EEG rhythm separation and time-frequency analysis of fast multivariate empirical mode decomposition for motor imagery BCI

Motor imagery electroencephalogram (EEG) is widely employed in brain-computer interface (BCI) systems. As a time-frequency analysis method for nonlinear and non-stationary signals, multivariate empirical mode decomposition (MEMD) and its noise-assisted version (NA-MEMD) has been widely used in the preprocessing step of BCI systems for separating EEG rhythms corresponding to specific brain activities. However, when applied to multichannel EEG signals, MEMD or NA-MEMD often demonstrate low robustness to noise and high computational complexity. To address these issues, we have explored the advantages of our recently proposed fast multivariate empirical mode decomposition (FMEMD) and its noise-assisted version (NA-FMEMD) for analyzing motor imagery data. We emphasize that FMEMD enables a more accurate estimation of EEG frequency information and exhibits a more noise-robust decomposition performance with improved computational efficiency. Comparative analysis with MEMD on simulation data and real-world EEG validates the above assertions. The joint average frequency measure is employed to automatically select intrinsic mode functions that correspond to specific frequency bands. Thus, FMEMD-based classification architecture is proposed. Using FMEMD as a preprocessing algorithm instead of MEMD can improve the classification accuracy by 2.3% on the BCI Competition IV dataset. On the Physiobank Motor/Mental Imagery dataset and BCI Competition IV Dataset 2a, FMEMD-based architecture also attained a comparable performance to complex algorithms. The results indicate that FMEMD proficiently extracts feature information from small benchmark datasets while mitigating dimensionality constraints resulting from computational complexity. Hence, FMEMD or NA-FMEMD can be a powerful time-frequency preprocessing method for BCI.

Attentional State Classification Using Amplitude and Phase Feature Extraction Method Based on Filter Bank and Riemannian Manifold

As a significant aspect of cognition, attention has been extensively studied and numerous measurements have been developed based on brain signal processing. Although existing attentional state classification methods have achieved good accuracy by extracting a variety of handcrafted features, spatial features have not been fully explored. This paper proposes an attentional state classification method based on Riemannian manifold to utilize spatial information. Based on the concept of Riemannian manifold of symmetric positive definite (SPD) matrix, the proposed method exploits the structure of covariance matrix to extract spatial features instead of using spatial filters. Specifically, Riemannian distances from intra-class Riemannian means are extracted as features for their robustness. To fully extend the potential of electroencephalograph (EEG) signal, both amplitude and phase information is utilized. In addition, to solve the variance of frequency bands, a filter bank is employed to process the signal of different frequency bands separately. Finally, features are fed into a support vector machine with a polynomial kernel to obtain classification results. The proposed attentional state classification using amplitude and phase feature extraction method based on filter bank and Riemannian manifold (AP-FBRM) method is evaluated on two open datasets including EEG data of 29 and 26 subjects. According to the experimental results, the optimal set of filter bank and the optimal technique to extract features containing both amplitude and phase information are determined. The proposed method respectively achieves accuracies of 88.06% and 80.00% and outperforms 8 baseline methods, which manifests that the proposed method creates an efficient way to recognize attentional state.

A large EEG dataset for studying cross-session variability in motor imagery brain-computer interface

In building a practical and robust brain-computer interface (BCI), the classification of motor imagery (MI) from electroencephalography (EEG) across multiple days is a long-standing challenge due to the large variability of the EEG signals. We collected a large dataset of MI from 5 different days with 25 subjects, the first open-access dataset to address BCI issues across 5 different days with a large number of subjects. The dataset includes 5 session data from 5 different days (2–3 days apart) for each subject. Each session contains 100 trials of left-hand and right-hand MI. In this report, we provide the benchmarking classification accuracy for three conditions, namely, within-session classification (WS), cross-session classification (CS), and cross-session adaptation (CSA), with subject-specific models. WS achieves an average classification accuracy of up to 68.8%, while CS degrades the accuracy to 53.7% due to the cross-session variability. However, by adaptation, CSA improves the accuracy to 78.9%. We anticipate this new dataset will significantly push further progress in MI BCI research in addressing the cross-session and cross-subject challenge.

Measurement(s)	Electroencephalography
Technology Type(s)	motor imagery

Motor Imagery Classification via Kernel-Based Domain Adaptation on an SPD Manifold

Background: Recording the calibration data of a brain–computer interface is a laborious process and is an unpleasant experience for the subjects. Domain adaptation is an effective technology to remedy the shortage of target data by leveraging rich labeled data from the sources. However, most prior methods have needed to extract the features of the EEG signal first, which triggers another challenge in BCI classification, due to small sample sets or a lack of labels for the target. Methods: In this paper, we propose a novel domain adaptation framework, referred to as kernel-based Riemannian manifold domain adaptation (KMDA). KMDA circumvents the tedious feature extraction process by analyzing the covariance matrices of electroencephalogram (EEG) signals. Covariance matrices define a symmetric positive definite space (SPD) that can be described by Riemannian metrics. In KMDA, the covariance matrices are aligned in the Riemannian manifold, and then are mapped to a high dimensional space by a log-Euclidean metric Gaussian kernel, where subspace learning is performed by minimizing the conditional distribution distance between the sources and the target while preserving the target discriminative information. We also present an approach to convert the EEG trials into 2D frames (E-frames) to further lower the dimension of covariance descriptors. Results: Experiments on three EEG datasets demonstrated that KMDA outperforms several state-of-the-art domain adaptation methods in classification accuracy, with an average Kappa of 0.56 for BCI competition IV dataset IIa, 0.75 for BCI competition IV dataset IIIa, and an average accuracy of 81.56% for BCI competition III dataset IVa. Additionally, the overall accuracy was further improved by 5.28% with the E-frames. KMDA showed potential in addressing subject dependence and shortening the calibration time of motor imagery-based brain–computer interfaces.

Alzheimer's Disease Analysis Algorithm Based on No-threshold Recurrence Plot Convolution Network

Alzheimer's disease is a neurological disorder characterized by progressive cognitive dysfunction and behavioral impairment that occurs in old. Early diagnosis and treatment of Alzheimer's disease is great significance. Electroencephalography (EEG) signals can be used to detect Alzheimer's disease due to its non-invasive advantage. To solve the problem of insufficient analysis by single-channel EEG signal, we analyze the relationship between multiple channels and build PLV framework. To solve the problem of insufficient representation of 1D signal, a threshold-free recursive plot convolution network was constructed to realize 2D representation. To solve the problem of insufficient EEG signal characterization, a fusion algorithm of clinical features and imaging features was proposed to detect Alzheimer's disease. Experimental results show that the algorithm has good performance and robustness.

A framework for motor imagery with LSTM neural network

BACKGROUND AND OBJECTIVE

How to learn robust representations from brain activities and to improve algorithm performance are the most significant issues for brain-computer interface systems.

METHODS

This study introduces a long short-term memory recurrent neural network to decode the multichannel electroencephalogram or electrocorticogram for implementing an effective motor imagery-based brain-computer interface system. The unique information processing mechanism of the long short-term memory network characterizes spatio-temporal dynamics in time sequences. This study evaluates the proposed method using publically available electroencephalogram/electrocorticogram datasets.

RESULTS

The decoded features coupled with a gradient boosting classifier could obtain high recognition accuracies of 99% for electroencephalogram and 100% for electrocorticogram, respectively.

CONCLUSIONS

The results demonstrated that the proposed model can estimate robust spatial-temporal features and obtain significant performance improvement for motor imagery-based brain-computer interface systems. Further, the proposed method is of low computational complexity.

Internal Feature Selection Method of CSP Based on L1-Norm and Dempster-Shafer Theory

The common spatial pattern (CSP) algorithm is a well-recognized spatial filtering method for feature extraction in motor imagery (MI)-based brain-computer interfaces (BCIs). However, due to the influence of nonstationary in electroencephalography (EEG) and inherent defects of the CSP objective function, the spatial filters, and their corresponding features are not necessarily optimal in the feature space used within CSP. In this work, we design a new feature selection method to address this issue by selecting features based on an improved objective function. Especially, improvements are made in suppressing outliers and discovering features with larger interclass distances. Moreover, a fusion algorithm based on the Dempster-Shafer theory is proposed, which takes into consideration the distribution of features. With two competition data sets, we first evaluate the performance of the improved objective functions in terms of classification accuracy, feature distribution, and embeddability. Then, a comparison with other feature selection methods is carried out in both accuracy and computational time. Experimental results show that the proposed methods consume less additional computational cost and result in a significant increase in the performance of MI-based BCI systems.

SPECTRA: a tool for enhanced brain wave signal recognition

Background

Brain wave signal recognition has gained increased attention in neuro-rehabilitation applications. This has driven the development of brain–computer interface (BCI) systems. Brain wave signals are acquired using electroencephalography (EEG) sensors, processed and decoded to identify the category to which the signal belongs. Once the signal category is determined, it can be used to control external devices. However, the success of such a system essentially relies on significant feature extraction and classification algorithms. One of the commonly used feature extraction technique for BCI systems is common spatial pattern (CSP).

Results

The performance of the proposed spatial-frequency-temporal feature extraction (SPECTRA) predictor is analysed using three public benchmark datasets. Our proposed predictor outperformed other competing methods achieving lowest average error rates of 8.55%, 17.90% and 20.26%, and highest average kappa coefficient values of 0.829, 0.643 and 0.595 for BCI Competition III dataset IVa, BCI Competition IV dataset I and BCI Competition IV dataset IIb, respectively.

Conclusions

Our proposed SPECTRA predictor effectively finds features that are more separable and shows improvement in brain wave signal recognition that can be instrumental in developing improved real-time BCI systems that are computationally efficient.

OPTICAL+: a frequency-based deep learning scheme for recognizing brain wave signals

A human-computer interaction (HCI) system can be used to detect different categories of the brain wave signals that can be beneficial for neurorehabilitation, seizure detection and sleep stage classification. Research on developing HCI systems using brain wave signals has progressed a lot over the years. However, real-time implementation, computational complexity and accuracy are still a concern. In this work, we address the problem of selecting the appropriate filtering frequency band while also achieving a good system performance by proposing a frequency-based approach using long short-term memory network (LSTM) for recognizing different brain wave signals. Adaptive filtering using genetic algorithm is incorporated for a hybrid system utilizing common spatial pattern and LSTM network. The proposed method (OPTICAL+) achieved an overall average classification error rate of 30.41% and a kappa coefficient value of 0.398, outperforming the state-of-the-art methods. The proposed OPTICAL+ predictor can be used to develop improved HCI systems that will aid in neurorehabilitation and may also be beneficial for sleep stage classification and seizure detection.

BCI-Based Rehabilitation on the Stroke in Sequela Stage

Background

Stroke is the leading cause of serious and long-term disability worldwide. Survivors may recover some motor functions after rehabilitation therapy. However, many stroke patients missed the best time period for recovery and entered into the sequela stage of chronic stroke.

Method

Studies have shown that motor imagery- (MI-) based brain-computer interface (BCI) has a positive effect on poststroke rehabilitation. This study used both virtual limbs and functional electrical stimulation (FES) as feedback to provide patients with a closed-loop sensorimotor integration for motor rehabilitation. An MI-based BCI system acquired, analyzed, and classified motor attempts from electroencephalogram (EEG) signals. The FES system would be activated if the BCI detected that the user was imagining wrist dorsiflexion on the instructed side of the body. Sixteen stroke patients in the sequela stage were randomly assigned to a BCI group and a control group. All of them participated in rehabilitation training for four weeks and were assessed by the Fugl-Meyer Assessment (FMA) of motor function.

Results

The average improvement score of the BCI group was 3.5, which was higher than that of the control group (0.9). The active EEG patterns of the four patients in the BCI group whose FMA scores increased gradually became centralized and shifted to sensorimotor areas and premotor areas throughout the study.

Conclusions

Study results showed evidence that patients in the BCI group achieved larger functional improvements than those in the control group and that the BCI-FES system is effective in restoring motor function to upper extremities in stroke patients. This study provides a more autonomous approach than traditional treatments used in stroke rehabilitation.

Riemann-Based Algorithms Assessment for Single- and Multiple-Trial P300 Classification in Non-Optimal Environments

The P300 wave is commonly used in Brain-Computer Interface technology due to its higher bit rates when compared to other BCI paradigms. P300 classification pipelines based on Riemannian Geometry provide accuracies on par with state-of-the-art pipelines, without having the need for spatial filters, and also possess the ability to be calibrated with little data. In this study, five different P300 detection pipelines are compared, with three of them using Riemannian Geometry as either feature extraction or classification algorithms. The goal of this study is to assess the viability of Riemannian Geometry-based methods in non-optimal environments with sudden background noise changes, rather than maximizing classification accuracy values. For fifteen subjects, the average single-trial accuracy obtained for each pipeline was: 56.06% for Linear Discriminant Analysis (LDA), 72.13% for Bayesian Linear Discriminant Analysis (BLDA), 63.56% for Riemannian Minimum Distance to Mean (MDM), 69.22% for Riemannian Tangent Space with Logistic Regression (TS-LogR), and 63.30% for Riemannian Tangent Space with Support Vector Machine (TS-SVM). The results are higher for the pipelines based on BLDA and TS-LogR, suggesting that they could be viable methods for the detection of the P300 component when maximizing the bit rate is needed. For multiple-trial classification, the BLDA pipeline converged faster towards higher average values, closely followed by the TS-LogR pipeline. The two remaining Riemannian methods' accuracy also increases with the number of trials, but towards a lower value compared to the aforementioned ones. Single-stimulus detection metrics revealed that the TS-LogR pipeline can be a viable classification method, as its results are only slightly lower than those obtained with BLDA. P300 waveforms were also analyzed to check for evidence of the component being elicited. Finally, a questionnaire was used to retrieve the most intuitive focusing methods employed by the subjects.

Motor-Imagery Classification Using Riemannian Geometry with Median Absolute Deviation

Motor imagery (MI) from human brain signals can diagnose or aid specific physical activities for rehabilitation, recreation, device control, and technology assistance. It is a dynamic state in learning and practicing movement tracking when a person mentally imitates physical activity. Recently, it has been determined that a brain–computer interface (BCI) can support this kind of neurological rehabilitation or mental practice of action. In this context, MI data have been captured via non-invasive electroencephalogram (EEGs), and EEG-based BCIs are expected to become clinically and recreationally ground-breaking technology. However, determining a set of efficient and relevant features for the classification step was a challenge. In this paper, we specifically focus on feature extraction, feature selection, and classification strategies based on MI-EEG data. In an MI-based BCI domain, covariance metrics can play important roles in extracting discriminatory features from EEG datasets. To explore efficient and discriminatory features for the enhancement of MI classification, we introduced a median absolute deviation (MAD) strategy that calculates the average sample covariance matrices (SCMs) to select optimal accurate reference metrics in a tangent space mapping (TSM)-based MI-EEG. Furthermore, all data from SCM were projected using TSM according to the reference matrix that represents the featured vector. To increase performance, we reduced the dimensions and selected an optimum number of features using principal component analysis (PCA) along with an analysis of variance (ANOVA) that could classify MI tasks. Then, the selected features were used to develop linear discriminant analysis (LDA) training for classification. The benchmark datasets were considered for the evaluation and the results show that it provides better accuracy than more sophisticated methods.

Motor imagery EEG classification based on ensemble support vector learning

BACKGROUND AND OBJECTIVE

Brain-computer interfaces build a communication pathway from the human brain to a computer. Motor imagery-based electroencephalogram (EEG) classification is a widely applied paradigm in brain-computer interfaces. The common spatial pattern, based on the event-related desynchronization (ERD)/event-related synchronization (ERS) phenomenon, is one of the most popular algorithms for motor imagery-based EEG classification. Moreover, the spatiotemporal discrepancy feature based on the event-related potential phenomenon has been demonstrated to provide complementary information to ERD/ERS-based features. In this paper, aiming to improve the performance of motor imagery-based EEG classification in a few-channel situation, an ensemble support vector learning (ESVL)-based approach is proposed to combine the advantages of the ERD/ERS-based features and the event-related potential-based features in motor imagery-based EEG classification.

METHODS

ESVL is an ensemble learning algorithm based on support vector machine classifier. Specifically, the decision boundary with the largest interclass margin is obtained using the support vector machine algorithm, and the distances between sample points and the decision boundary are mapped to posterior probabilities. The probabilities obtained from different support vector machine classifiers are combined to make prediction. Thus, ESVL leverages the advantages of multiple trained support vector machine classifiers and makes a better prediction based on the posterior probabilities. The class discrepancy-guided sub-band-based common spatial pattern and the spatiotemporal discrepancy feature are applied to extract discriminative features, and then, the extracted features are used to train the ESVL classifier and make predictions.

RESULTS

The BCI Competition IV datasets 2a and 2b are employed to evaluate the performance of the proposed ESVL algorithm. Experimental comparisons with the state-of-the-art methods are performed, and the proposed ESVL-based approach achieves an average max kappa value of 0.60 and 0.71 on BCI Competition IV datasets 2a and 2b respectively. The results show that the proposed ESVL-based approach improves the performance of motor imagery-based brain-computer interfaces.

CONCLUSION

The proposed ESVL classifier could use the posterior probabilities to realize ensemble learning and the ESVL-based motor imagery classification approach takes advantage of the merits of ERD/ERS based feature and event-related potential based feature to improve the experimental performance.

Temporal Combination Pattern Optimization Based on Feature Selection Method for Motor Imagery BCIs

Common spatial pattern (CSP) method is widely used for spatial filtering and brain pattern extraction from electroencephalogram (EEG) signals in motor imagery (MI)-based brain-computer interfaces (BCIs). The participant-specific time window relative to the visual cue has a significant impact on the effectiveness of the CSP. However, the time window is usually selected experientially or manually. To solve this problem, we propose a novel feature selection approach for MI-based BCIs. Specifically, multiple time segments were obtained by decomposing each EEG sample of the MI task. Furthermore, the features were extracted by CSP from each time segment and were combined to form a new feature vector. Finally, the optimal temporal combination patterns for the new feature vector were selected based on four feature selection algorithms, i.e., mutual information, least absolute shrinkage and selection operator, principal component analysis and stepwise linear discriminant analysis (denoted as MUIN, LASSO, PCA, and SWLDA, respectively), and the classification algorithm was employed to evaluate the average classification accuracy. With three BCI competition datasets, the results of the four proposed algorithms were compared with traditional CSP algorithm in classification accuracy. Experimental results show that compared with traditional algorithm, the proposed methods significantly improve performance. Specifically, the LASSO achieved the highest accuracy (88.58%) among the proposed methods. Importantly, the average classification accuracies using the proposed approaches significantly improved 10.14% (MUIN), 11.40% (LASSO), 6.08% (PCA), and 10.25% (SWLDA) compared to that using CSP. These results indicate that the proposed approach is expected to be practical in MI-based BCIs.

Epilepsy Seizure Prediction on EEG Using Common Spatial Pattern and Convolutional Neural Network

Epilepsy seizure prediction paves the way of timely warning for patients to take more active and effective intervention measures. Compared to seizure detection that only identifies the inter-ictal state and the ictal state, far fewer researches have been conducted on seizure prediction because the high similarity makes it challenging to distinguish between the pre-ictal state and the inter-ictal state. In this paper, a novel solution on seizure prediction is proposed using common spatial pattern (CSP) and convolutional neural network (CNN). Firstly, artificial pre-ictal EEG signals based on the original ones are generated by combining the segmented pre-ictal signals to solve the trial imbalance problem between the two states. Secondly, a feature extractor employing wavelet packet decomposition and CSP is designed to extract the distinguishing features in both the time domain and the frequency domain. It can improve overall accuracy while reducing the training time. Finally, a shallow CNN is applied to discriminate between the pre-ictal state and the inter-ictal state. Our proposed solution is evaluated on 23 patients' data from Boston Children's Hospital-MIT scalp EEG dataset by employing a leave-one-out cross-validation, and it achieves a sensitivity of 92.2% and false prediction rate of 0.12/h. Experimental result demonstrates that the proposed approach outperforms most state-of-the-art methods.

Brain wave classification using long short-term memory network based OPTICAL predictor

Brain-computer interface (BCI) systems having the ability to classify brain waves with greater accuracy are highly desirable. To this end, a number of techniques have been proposed aiming to be able to classify brain waves with high accuracy. However, the ability to classify brain waves and its implementation in real-time is still limited. In this study, we introduce a novel scheme for classifying motor imagery (MI) tasks using electroencephalography (EEG) signal that can be implemented in real-time having high classification accuracy between different MI tasks. We propose a new predictor, OPTICAL, that uses a combination of common spatial pattern (CSP) and long short-term memory (LSTM) network for obtaining improved MI EEG signal classification. A sliding window approach is proposed to obtain the time-series input from the spatially filtered data, which becomes input to the LSTM network. Moreover, instead of using LSTM directly for classification, we use regression based output of the LSTM network as one of the features for classification. On the other hand, linear discriminant analysis (LDA) is used to reduce the dimensionality of the CSP variance based features. The features in the reduced dimensional plane after performing LDA are used as input to the support vector machine (SVM) classifier together with the regression based feature obtained from the LSTM network. The regression based feature further boosts the performance of the proposed OPTICAL predictor. OPTICAL showed significant improvement in the ability to accurately classify left and right-hand MI tasks on two publically available datasets. The improvements in the average misclassification rates are 3.09% and 2.07% for BCI Competition IV Dataset I and GigaDB dataset, respectively. The Matlab code is available at https://github.com/ShiuKumar/OPTICAL .

sefOri: selecting the best-engineered sequence features to predict DNA replication origins

Motivation

Cell divisions start from replicating the double-stranded DNA, and the DNA replication process needs to be precisely regulated both spatially and temporally. The DNA is replicated starting from the DNA replication origins. A few successful prediction models were generated based on the assumption that the DNA replication origin regions have sequence level features like physicochemical properties significantly different from the other DNA regions.

Results

This study proposed a feature selection procedure to further refine the classification model of the DNA replication origins. The experimental data demonstrated that as large as 26% improvement in the prediction accuracy may be achieved on the yeast Saccharomyces cerevisiae. Moreover, the prediction accuracies of the DNA replication origins were improved for all the four yeast genomes investigated in this study.

Availability and implementation

The software sefOri version 1.0 was available at http://www.healthinformaticslab.org/supp/resources.php. An online server was also provided for the convenience of the users, and its web link may be found in the above-mentioned web page.

Supplementary information

Supplementary data are available at Bioinformatics online.

Frequency-Optimized Local Region Common Spatial Pattern Approach for Motor Imagery Classification

This paper presents a novel feature extraction approach for motor imagery classification overcoming the weakness of conventional common spatial pattern (CSP) methods, especially for small sample settings. We consider local CSPs generated from individual channels and their neighbors (termed "local regions") rather than a global CSP generated from all channels. The novelty is to select a few good local regions using interquartile range (IQR) or an "above the mean" rule based on variance ratio dispersion score (VRDS) and inter-class feature distance (ICFD); instead of computationally expensive cross-validation method. Furthermore, we develop frequency optimization using filter banks by extending the VRDS and ICFD to frequency-optimized local CSPs. The proposed methods are tested on three publicly available brain-computer interface (BCI) datasets: BCI competition III dataset IVa, BCI competition IV dataset I, and BCI competition IV dataset IIb. The proposed method exhibits substantially improved classification accuracy compared to recent related motor imagery (MI) classification methods.

Class discrepancy-guided sub-band filter-based common spatial pattern for motor imagery classification

BACKGROUND

Motor imagery classification, an important branch of brain-computer interface (BCI), recognizes the intention of subjects to control external auxiliary equipment. Therefore, EEG-based motor imagery classification has received increasing attention in the fields of neuroscience. The common spatial pattern (CSP) algorithm has recently achieved great success in motor imagery classification. However, varying discriminative frequency bands and few-channel EEG limit the performance of CSP.

NEW METHOD

A class discrepancy-guided sub-band filter-based CSP (CDFCSP) algorithm is proposed to automatically recognize and augment the discriminative frequency bands for CSP algorithms. Specifically, a priori knowledge and templates obtained from the training set were applied as the design guidelines of the class discrepancy-guided sub-band filter (CDF). Second, a filter bank CSP was used to extract features from EEG traces filtered by the CDF. Finally, the CSP features of multiple frequency bands were leveraged to train linear support vector machine classifier and generate prediction.

RESULTS

BCI competition IV datasets 2a and 2b, which include EEGs from 18 subjects, were used to validate the performance improvement provided by the CDF. Student's t-tests of the CDFCSP versus the filter bank CSP without the CDF showed that the performance improvement was significant (i.e., p-values of 0.040 and 0.032 for the ratio and normalization mode CDFCSP, respectively).

COMPARISON WITH EXISTING METHOD(S)

The experiments show that the proposed CDFCSP improves the CSP algorithm and outperforms the other state-of-the-art algorithms evaluated in this paper.

CONCLUSIONS

The increased performance of the proposed CDFCSP algorithm can promote the application of BCI systems.

Human Mind Control of Rat Cyborg's Continuous Locomotion with Wireless Brain-to-Brain Interface

Brain-machine interfaces (BMIs) provide a promising information channel between the biological brain and external devices and are applied in building brain-to-device control. Prior studies have explored the feasibility of establishing a brain-brain interface (BBI) across various brains via the combination of BMIs. However, using BBI to realize the efficient multidegree control of a living creature, such as a rat, to complete a navigation task in a complex environment has yet to be shown. In this study, we developed a BBI from the human brain to a rat implanted with microelectrodes (i.e., rat cyborg), which integrated electroencephalogram-based motor imagery and brain stimulation to realize human mind control of the rat’s continuous locomotion. Control instructions were transferred from continuous motor imagery decoding results with the proposed control models and were wirelessly sent to the rat cyborg through brain micro-electrical stimulation. The results showed that rat cyborgs could be smoothly and successfully navigated by the human mind to complete a navigation task in a complex maze. Our experiments indicated that the cooperation through transmitting multidimensional information between two brains by computer-assisted BBI is promising.

Motor Imagery EEG Classification Based on Decision Tree Framework and Riemannian Geometry

This paper proposes a novel classification framework and a novel data reduction method to distinguish multiclass motor imagery (MI) electroencephalography (EEG) for brain computer interface (BCI) based on the manifold of covariance matrices in a Riemannian perspective. For method 1, a subject-specific decision tree (SSDT) framework with filter geodesic minimum distance to Riemannian mean (FGMDRM) is designed to identify MI tasks and reduce the classification error in the nonseparable region of FGMDRM. Method 2 includes a feature extraction algorithm and a classification algorithm. The feature extraction algorithm combines semisupervised joint mutual information (semi-JMI) with general discriminate analysis (GDA), namely, SJGDA, to reduce the dimension of vectors in the Riemannian tangent plane. And the classification algorithm replaces the FGMDRM in method 1 with k-nearest neighbor (KNN), named SSDT-KNN. By applying method 2 on BCI competition IV dataset 2a, the kappa value has been improved from 0.57 to 0.607 compared to the winner of dataset 2a. And method 2 also obtains high recognition rate on the other two datasets.

Reduce Calibration Time in Motor Imagery Using Spatially Regularized Symmetric Positives-Definite Matrices Based Classification

Electroencephalogram (EEG) based motor imagery brain⁻computer interface (BCI) requires large number of subject specific training trials to calibrate the system for a new subject. This results in long calibration time that limits the BCI usage in practice. One major challenge in the development of a brain⁻computer interface is to reduce calibration time or completely eliminate it. To address this problem, existing approaches use covariance matrices of electroencephalography (EEG) trials as descriptors for decoding BCI but do not consider the geometry of the covariance matrices, which lies in the space of Symmetric Positive Definite (SPD) matrices. This inevitably limits their performance. We focus on reducing calibration time by introducing SPD based classification approach. However, SPD-based classification has limited applicability in small training sets because the dimensionality of covariance matrices is large in proportion to the number of trials. To overcome this drawback, our paper proposes a new framework that transforms SPD matrices in lower dimension through spatial filter regularized by prior information of EEG channels. The efficacy of the proposed approach was validated on the small sample scenario through Dataset IVa from BCI Competition III. The proposed approach achieved mean accuracy of 86.13 % and mean kappa of 0.72 on Dataset IVa. The proposed method outperformed other approaches in existing studies on Dataset IVa. Finally, to ensure the robustness of the proposed method, we evaluated it on Dataset IIIa from BCI Competition III and Dataset IIa from BCI Competition IV. The proposed method achieved mean accuracy 92.22 % and 81.21 % on Dataset IIIa and Dataset IIa, respectively.

A Dual Stimuli Approach Combined with Convolutional Neural Network to Improve Information Transfer Rate of Event-Related Potential-Based Brain-Computer Interface

Increasing command generation rate of an event-related potential-based brain-robot system is challenging, because of limited information transfer rate of a brain-computer interface system. To improve the rate, we propose a dual stimuli approach that is flashing a robot image and is scanning another robot image simultaneously. Two kinds of event-related potentials, N200 and P300 potentials, evoked in this dual stimuli condition are decoded by a convolutional neural network. Compared with the traditional approaches, this proposed approach significantly improves the online information transfer rate from 23.0 or 17.8 to 39.1 bits/min at an accuracy of 91.7%. These results suggest that combining multiple types of stimuli to evoke distinguishable ERPs might be a promising direction to improve the command generation rate in the brain-computer interface.

A robust and subject-specific sequential forward search method for effective channel selection in brain computer interfaces

BACKGROUND

The input signals of electroencephalography (EEG) based brain computer interfaces (BCI) are extensively acquired from scalp with a multi-channel system. However, multi-channel signals might contain redundant information and increase computational complexity. Furthermore, using only effective channels, rather than all channels, may enhance the performance of the BCI in terms of classification accuracy (CA).

NEW METHOD

We proposed a robust and subject-specific sequential forward search method (RSS-SFSM) for effective channel selection (ECS). The ECS procedure executes a sequential search among each of the candidate channels in order to find the channels which maximize the CA performance of the validation set. It should be noted that in order to avoid the problems of random selections in the validation set, we applied the ECS procedure for 100 times. Then, the total numbers of the selection of each channel present the effective ones. To demonstrate its reliability and robustness, the proposed method was applied to two data sets.

RESULTS

The achieved results showed that the proposed method not only improved the average CA by 15.98%, but also decreased the considered number of channels and computational complexity by 71.53% on average.

COMPARISON WITH EXISTING METHOD(S)

Compared with the existing methods, we achieved better results in terms of both the classification accuracy improvement and channel reduction rates.

CONCLUSIONS

Features extracted by Hilbert transform and sum derivative methods were effectively classified by support vector machine. In conclusion, the results obtained proved that the RSS-SFSM shows great potential for determining effective channel(s).

A new parameter tuning approach for enhanced motor imagery EEG signal classification

A brain-computer interface (BCI) system allows direct communication between the brain and the external world. Common spatial pattern (CSP) has been used effectively for feature extraction of data used in BCI systems. However, many studies show that the performance of a BCI system using CSP largely depends on the filter parameters. The filter parameters that yield most discriminating information vary from subject to subject and manually tuning of the filter parameters is a difficult and time-consuming exercise. In this paper, we propose a new automated filter tuning approach for motor imagery electroencephalography (EEG) signal classification, which automatically and flexibly finds the filter parameters for optimal performance. We have evaluated the performance of our proposed method on two public benchmark datasets. Compared to the existing conventional CSP approach, our method reduces the average classification error rate by 2.89% and 3.61% for BCI Competition III dataset IVa and BCI Competition IV dataset I, respectively. Moreover, our proposed approach also achieved lowest average classification error rate compared to state-of-the-art methods studied in this paper. Thus, our proposed method can be potentially used for developing improved BCI systems, which can assist people with disabilities to recover their environmental control. It can also be used for enhanced disease recognition such as epileptic seizure detection using EEG signals. Graphical abstract ᅟ.