101
|
Using a low correlation high orthogonality feature set and machine learning methods to identify plant pentatricopeptide repeat coding gene/protein. Neurocomputing 2021. [DOI: 10.1016/j.neucom.2020.02.079] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
102
|
Zuo C, Jin J, Xu R, Wu L, Liu C, Miao Y, Wang X. Cluster decomposing and multi-objective optimization based-ensemble learning framework for motor imagery-based brain-computer interfaces. J Neural Eng 2021; 18. [PMID: 33524961 DOI: 10.1088/1741-2552/abe20f] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2020] [Accepted: 02/01/2021] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Motor imagery (MI) is a mental representation of motor behavior and a widely used pattern in electroencephalogram (EEG) based brain-computer interface (BCI) systems. EEG is known for its non-stationary, non-linear features and sensitivity to artifacts from various sources. This study aimed to design a powerful classifier with a strong generalization capability for MI based BCIs. APPROACH In this study, we proposed a cluster decomposing based ensemble learning framework (CDECL) for EEG classification of MI based BCIs. The EEG data was decomposed into sub-data sets with different distributions by clustering decomposition. Then a set of heterogeneous classifiers was trained on each sub-data set for generating a diversified classifier search space. To obtain the optimal classifier combination, the ensemble learning was formulated as a multi-objective optimization problem and a stochastic fractal based binary multi-objective fruit fly optimization algorithm was proposed for solving the ensemble learning problem. MAIN RESULTS The proposed method was validated on two public EEG datasets (BCI Competition IV datasets IIb and BCI Competition IV dataset IIa) and compared with several other competing classification methods. Experimental results showed that the proposed CDECL based methods can effectively construct a diversity ensemble classifier and exhibits superior classification performance in comparison with several competing methods. SIGNIFICANCE The proposed method is promising for improving the performance of MI-based BCIs.
Collapse
Affiliation(s)
- Cili Zuo
- East China University of Science and Technology, 130 Meilong road, Shanghai, Shanghai, 200237, CHINA
| | - Jing Jin
- Key Laboratory of Advanced Control and Optimization for Chemical Processes Ministry of Education, East China University of Science and Technology, 130 Meilong Road, Xuhui District, Shanghai 200237, SHANGHAI, 200237, CHINA
| | - Ren Xu
- Guger Technologies OG, Sierningstrasse 14, Graz, 8020, AUSTRIA
| | - Lianghong Wu
- Hunan University of Science and Technology, Tiaoyuan Road, Xiangtan, 411201, CHINA
| | - Chang Liu
- East China University of Science and Technology, 130 Meilong Road, Shanghai, Shanghai, 200237, CHINA
| | - Yangyang Miao
- East China University of Science and Technology, 130 Meilong raod, Shanghai, Shanghai, 200237, CHINA
| | - Xingyu Wang
- East China University of Science and Technology, 130 Meilong Road, Shanghai, Shanghai, 200237, CHINA
| |
Collapse
|
103
|
Jiao Y, Zhou T, Yao L, Zhou G, Wang X, Zhang Y. Multi-View Multi-Scale Optimization of Feature Representation for EEG Classification Improvement. IEEE Trans Neural Syst Rehabil Eng 2021; 28:2589-2597. [PMID: 33245696 DOI: 10.1109/tnsre.2020.3040984] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Effectively extracting common space pattern (CSP) features from motor imagery (MI) EEG signals is often highly dependent on the filter band selection. At the same time, optimizing the EEG channel combinations is another key issue that substantially affects the SMR feature representations. Although numerous algorithms have been developed to find channels that record important characteristics of MI, most of them select channels in a cumbersome way with low computational efficiency, thereby limiting the practicality of MI-based BCI systems. In this study, we propose the multi-scale optimization (MSO) of spatial patterns, optimizing filter bands over multiple channel sets within CSPs to further improve the performance of MI-based BCI. Specifically, several channel subsets are first heuristically predefined, and then raw EEG data specific to each of these subsets bandpass-filtered at the overlap between a set of filter bands. Further, instead of solving learning problems for each channel subset independently, we propose a multi-view learning based sparse optimization to jointly extract robust CSP features with L2,1 -norm regularization, aiming to capture the shared salient information across multiple related spatial patterns for enhanced classification performance. A support vector machine (SVM) classifier is then trained on these optimized EEG features for accurate recognition of MI tasks. Experimental results on three public EEG datasets validate the effectiveness of MSO compared to several other competing methods and their variants. These superior experimental results demonstrate that the proposed MSO method has promising potential in MI-based BCIs.
Collapse
|
104
|
Fathima S, Kore SK. Formulation of the Challenges in Brain-Computer Interfaces as Optimization Problems-A Review. Front Neurosci 2021; 14:546656. [PMID: 33551716 PMCID: PMC7859253 DOI: 10.3389/fnins.2020.546656] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2020] [Accepted: 12/18/2020] [Indexed: 11/13/2022] Open
Abstract
Electroencephalogram (EEG) is one of the common modalities of monitoring the mental activities. Owing to the non-invasive availability of this system, its applicability has seen remarkable developments beyond medical use-cases. One such use case is brain-computer interfaces (BCI). Such systems require the usage of high resolution-based multi-channel EEG devices so that the data collection spans multiple locations of the brain like the occipital, frontal, temporal, and so on. This results in huge data (with high sampling rates) and with multiple EEG channels with inherent artifacts. Several challenges exist in analyzing data of this nature, for instance, selecting the optimal number of EEG channels or deciding what best features to rely on for achieving better performance. The selection of these variables is complicated and requires a lot of domain knowledge and non-invasive EEG monitoring, which is not feasible always. Hence, optimization serves to be an easy to access tool in deriving such parameters. Considerable efforts in formulating these issues as an optimization problem have been laid. As a result, various multi-objective and constrained optimization functions have been developed in BCI that has achieved reliable outcomes in device control like neuro-prosthetic arms, application control, gaming, and so on. This paper makes an attempt to study the usage of optimization techniques in formulating the issues in BCI. The outcomes, challenges, and major observations of these approaches are discussed in detail.
Collapse
Affiliation(s)
- Shireen Fathima
- Department of Electronics and Communication Engineering, HKBK College of Engineering, Bengaluru, India
| | - Sheela Kiran Kore
- Department of Electronics and Communication Engineering, KLE Dr. M. S. Sheshagiri College of Engineering and Technology, Belgaum, India
| |
Collapse
|
105
|
Mao Y, Jin J, Xu R, Li S, Miao Y, Cichocki A. The Influence of Visual Attention on The Performance of A Novel Tactile P300 Brain-Computer Interface with Cheeks-Stim Paradigm. Int J Neural Syst 2021; 31:2150004. [PMID: 33438531 DOI: 10.1142/s0129065721500040] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Tactile P300 brain-computer interface (BCI) generally has a worse accuracy and information transfer rate (ITR) than the visual-based BCI. It may be due to the fact that human beings have a relatively poor tactile perception. This study investigated the influence of visual attention on the performance of a tactile P300 BCI. We designed our paradigms based on a novel cheeks-stim paradigm which attached the stimulators on the subject's cheeks. Two paradigms were designed as follows: a paradigm with no visual attention and another paradigm with visual attention to the target position. Eleven subjects were invited to perform the two paradigms. We also recorded and analyzed the eyeball movement data during the paradigm with visual attention to explore whether the eyeball movement would have an effect on the BCI classification. The average online accuracy was 89.09% for the paradigm with visual attention, which was significantly higher than that of the paradigm with no visual attention (70.45%). Significant difference in ITR was also found between the two paradigms ([Formula: see text]). The results demonstrated that visual attention was an effective method to improve the performance of tactile P300 BCI. Our findings suggested that it may be feasible to complete an efficient tactile BCI system by adding visual attention.
Collapse
Affiliation(s)
- Ying Mao
- Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China
| | - Jing Jin
- Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China
| | - Ren Xu
- Guger Technologies OG, Graz, Austria
| | - Shurui Li
- Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China
| | - Yangyang Miao
- Key Laboratory for Advanced Control and Optimization for Chemical Processes, East China University of Science and Technology, Shanghai, P. R. China
| | - Andrzej Cichocki
- Center for Computational and Data-Intensive Science and Engineering Skolkovo Institute of Science and Technology (Skoltech), 121205 Moscow, Russia.,Department of Applied Computer Science, Nicolaus Copernicus University (UMK), 87-100 Torun, Poland
| |
Collapse
|
106
|
Miladinović A, Ajčević M, Jarmolowska J, Marusic U, Colussi M, Silveri G, Battaglini PP, Accardo A. Effect of power feature covariance shift on BCI spatial-filtering techniques: A comparative study. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 198:105808. [PMID: 33157470 DOI: 10.1016/j.cmpb.2020.105808] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Accepted: 10/12/2020] [Indexed: 06/11/2023]
Abstract
BACKGROUND AND OBJECTIVE The input data distributions of EEG-based BCI systems can change during intra-session transitions due to nonstationarity caused by features covariate shifts, thus compromising BCI performance. We aimed to identify the most robust spatial filtering approach, among most used methods, testing them on calibration dataset, and test dataset recorded 30 min afterwards. In addition, we also investigated if their performance improved after application of Stationary Subspace Analysis (SSA). METHODS We have recorded, in 17 healthy subjects, the calibration set at the beginning of the upper limb motor imagery BCI experiment and testing set separately 30 min afterwards. Both the calibration and test data were pre-processed and the BCI models were produced by using several spatial filtering approaches on the calibration set. Those models were subsequently evaluated on a test set. The differences between the accuracy estimated by cross-validation on the calibration dataset and the accuracy on the test dataset were investigated. The same procedure was performed with, and without SSA pre-processing step. RESULTS A significant reduction in accuracy on the test dataset was observed for CSP, SPoC and SpecRCSP approaches. For SLap and SpecCSP only a slight decreasing trend was observed, while FBCSP and FBCSPT largely maintained moderately high median accuracy >70%. In the case of application of SSA pre-processing, the differences between accuracy observed on calibration and test dataset were reduced. In addition, accuracy values both on calibration and test set were slightly higher in case of SSA pre-processing and also in this case FBCSP and FBCSPT presented slightly better performance compared to other methods. CONCLUSION The intrinsic signal nonstationarity characteristics, caused by covariance shifts of power features, reduced the accuracy of BCI model, therefore, suggesting that this evaluation framework should be considered for testing and simulating real life performance. FBCSP and FBSCPT approaches showed to be more robust to feature covariance shift. SSA can improve the models performance and reduce accuracy decline from calibration to test set.
Collapse
Affiliation(s)
- Aleksandar Miladinović
- Department of Engineering and Architecture, University of Trieste, Via Alfonso Valerio 10, 34127, Trieste, Italy.
| | - Miloš Ajčević
- Department of Engineering and Architecture, University of Trieste, Via Alfonso Valerio 10, 34127, Trieste, Italy
| | - Joanna Jarmolowska
- Department of Life Sciences, B.R.A.I.N. Center for Neuroscience, University of Trieste, Via Alexander Fleming 22, 34127 Trieste, Italy
| | - Uros Marusic
- Science and Research Centre Koper, Institute for Kinesiology Research, Garibaldijeva 1, 6000, Koper, Slovenia; Department of Health Sciences, Alma Mater Europaea - ECM, Slovenska ulica 17, 2000, Maribor, Slovenia
| | - Marco Colussi
- Department of Life Sciences, B.R.A.I.N. Center for Neuroscience, University of Trieste, Via Alexander Fleming 22, 34127 Trieste, Italy
| | - Giulia Silveri
- Department of Engineering and Architecture, University of Trieste, Via Alfonso Valerio 10, 34127, Trieste, Italy
| | - Piero Paolo Battaglini
- Department of Life Sciences, B.R.A.I.N. Center for Neuroscience, University of Trieste, Via Alexander Fleming 22, 34127 Trieste, Italy
| | - Agostino Accardo
- Department of Engineering and Architecture, University of Trieste, Via Alfonso Valerio 10, 34127, Trieste, Italy
| |
Collapse
|
107
|
Task Transfer Learning for EEG Classification in Motor Imagery-Based BCI System. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2020:6056383. [PMID: 33381220 PMCID: PMC7755477 DOI: 10.1155/2020/6056383] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/17/2020] [Revised: 06/25/2020] [Accepted: 07/27/2020] [Indexed: 11/30/2022]
Abstract
The motor-imagery brain-computer interface system (MI-BCI) has a board prospect for development. However, long calibration time and lack of enough MI commands limit its use in practice. In order to enlarge the command set, we add the combinations of traditional MI commands as new commands into the command set. We also design an algorithm based on transfer learning so as to decrease the calibration time for collecting EEG signal and training model. We create feature extractor based on data from traditional commands and transfer patterns through the data from new commands. Through the comparison of the average accuracy between our algorithm and traditional algorithms and the visualization of spatial patterns in our algorithm, we find that the accuracy of our algorithm is much higher than traditional algorithms, especially as for the low-quality datasets. Besides, the visualization of spatial patterns is meaningful. The algorithm based on transfer learning takes the advantage of the information from source data. We enlarge the command set while shortening the calibration time, which is of significant importance to the MI-BCI application.
Collapse
|
108
|
Malan N, Sharma S. Motor Imagery EEG Spectral-Spatial Feature Optimization Using Dual-Tree Complex Wavelet and Neighbourhood Component Analysis. Ing Rech Biomed 2021. [DOI: 10.1016/j.irbm.2021.01.002] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
109
|
Liu X, Shen Y, Liu J, Yang J, Xiong P, Lin F. Parallel Spatial-Temporal Self-Attention CNN-Based Motor Imagery Classification for BCI. Front Neurosci 2020; 14:587520. [PMID: 33362458 PMCID: PMC7759669 DOI: 10.3389/fnins.2020.587520] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Accepted: 10/14/2020] [Indexed: 11/29/2022] Open
Abstract
Motor imagery (MI) electroencephalography (EEG) classification is an important part of the brain-computer interface (BCI), allowing people with mobility problems to communicate with the outside world via assistive devices. However, EEG decoding is a challenging task because of its complexity, dynamic nature, and low signal-to-noise ratio. Designing an end-to-end framework that fully extracts the high-level features of EEG signals remains a challenge. In this study, we present a parallel spatial–temporal self-attention-based convolutional neural network for four-class MI EEG signal classification. This study is the first to define a new spatial-temporal representation of raw EEG signals that uses the self-attention mechanism to extract distinguishable spatial–temporal features. Specifically, we use the spatial self-attention module to capture the spatial dependencies between the channels of MI EEG signals. This module updates each channel by aggregating features over all channels with a weighted summation, thus improving the classification accuracy and eliminating the artifacts caused by manual channel selection. Furthermore, the temporal self-attention module encodes the global temporal information into features for each sampling time step, so that the high-level temporal features of the MI EEG signals can be extracted in the time domain. Quantitative analysis shows that our method outperforms state-of-the-art methods for intra-subject and inter-subject classification, demonstrating its robustness and effectiveness. In terms of qualitative analysis, we perform a visual inspection of the new spatial–temporal representation estimated from the learned architecture. Finally, the proposed method is employed to realize control of drones based on EEG signal, verifying its feasibility in real-time applications.
Collapse
Affiliation(s)
- Xiuling Liu
- College of Electronic Information Engineering, Hebei University, Baoding, China.,Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding, China
| | - Yonglong Shen
- College of Electronic Information Engineering, Hebei University, Baoding, China.,Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding, China
| | - Jing Liu
- Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding, China.,College of Computer and Cyber Security, Hebei Normal University, Shijiazhuang, China.,Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China
| | - Jianli Yang
- College of Electronic Information Engineering, Hebei University, Baoding, China.,Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding, China
| | - Peng Xiong
- College of Electronic Information Engineering, Hebei University, Baoding, China.,Key Laboratory of Digital Medical Engineering of Hebei Province, Hebei University, Baoding, China
| | - Feng Lin
- School of Computer Science and Engineering, Nanyang Technological University, Singapore, Singapore
| |
Collapse
|
110
|
Arpaia P, Donnarumma F, Esposito A, Parvis M. Channel Selection for Optimal EEG Measurement in Motor Imagery-Based Brain-Computer Interfaces. Int J Neural Syst 2020; 31:2150003. [PMID: 33353529 DOI: 10.1142/s0129065721500039] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
A method for selecting electroencephalographic (EEG) signals in motor imagery-based brain-computer interfaces (MI-BCI) is proposed for enhancing the online interoperability and portability of BCI systems, as well as user comfort. The attempt is also to reduce variability and noise of MI-BCI, which could be affected by a large number of EEG channels. The relation between selected channels and MI-BCI performance is therefore analyzed. The proposed method is able to select acquisition channels common to all subjects, while achieving a performance compatible with the use of all the channels. Results are reported with reference to a standard benchmark dataset, the BCI competition IV dataset 2a. They prove that a performance compatible with the best state-of-the-art approaches can be achieved, while adopting a significantly smaller number of channels, both in two and in four tasks classification. In particular, classification accuracy is about 77-83% in binary classification with down to 6 EEG channels, and above 60% for the four-classes case when 10 channels are employed. This gives a contribution in optimizing the EEG measurement while developing non-invasive and wearable MI-based brain-computer interfaces.
Collapse
Affiliation(s)
- Pasquale Arpaia
- Department of Electrical Engineering and Information Technology (DIETI), Universita' degli Studi di Napoli Federico II, Naples, Italy.,Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Italy
| | - Francesco Donnarumma
- Institute of Cognitive Sciences and Technologies, National Research Council (ISTC-CNR), Rome, Italy.,Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Italy
| | - Antonio Esposito
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, Turin, Italy.,Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Italy
| | - Marco Parvis
- Department of Electronics and Telecommunications (DET), Politecnico di Torino, Turin, Italy.,Augmented Reality for Health Monitoring Laboratory (ARHeMLab), Italy
| |
Collapse
|
111
|
Xue J, Ren F, Sun X, Yin M, Wu J, Ma C, Gao Z. A Multifrequency Brain Network-Based Deep Learning Framework for Motor Imagery Decoding. Neural Plast 2020; 2020:8863223. [PMID: 33505456 PMCID: PMC7787825 DOI: 10.1155/2020/8863223] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2020] [Revised: 10/22/2020] [Accepted: 11/04/2020] [Indexed: 12/11/2022] Open
Abstract
Motor imagery (MI) is an important part of brain-computer interface (BCI) research, which could decode the subject's intention and help remodel the neural system of stroke patients. Therefore, accurate decoding of electroencephalography- (EEG-) based motion imagination has received a lot of attention, especially in the research of rehabilitation training. We propose a novel multifrequency brain network-based deep learning framework for motor imagery decoding. Firstly, a multifrequency brain network is constructed from the multichannel MI-related EEG signals, and each layer corresponds to a specific brain frequency band. The structure of the multifrequency brain network matches the activity profile of the brain properly, which combines the information of channel and multifrequency. The filter bank common spatial pattern (FBCSP) algorithm filters the MI-based EEG signals in the spatial domain to extract features. Further, a multilayer convolutional network model is designed to distinguish different MI tasks accurately, which allows extracting and exploiting the topology in the multifrequency brain network. We use the public BCI competition IV dataset 2a and the public BCI competition III dataset IIIa to evaluate our framework and get state-of-the-art results in the first dataset, i.e., the average accuracy is 83.83% and the value of kappa is 0.784 for the BCI competition IV dataset 2a, and the accuracy is 89.45% and the value of kappa is 0.859 for the BCI competition III dataset IIIa. All these results demonstrate that our framework can classify different MI tasks from multichannel EEG signals effectively and show great potential in the study of remodelling the neural system of stroke patients.
Collapse
Affiliation(s)
- Juntao Xue
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| | - Feiyue Ren
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| | - Xinlin Sun
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| | - Miaomiao Yin
- Department of Neurorehabilitation and Neurology, Tianjin Huanhu Hospital, Tianjin Key Laboratory of Cerebral Vascular and Neurodegenerative Diseases, Tianjin Neurosurgical Institute, Tianjin 300350, China
| | - Jialing Wu
- Department of Neurorehabilitation and Neurology, Tianjin Huanhu Hospital, Tianjin Key Laboratory of Cerebral Vascular and Neurodegenerative Diseases, Tianjin Neurosurgical Institute, Tianjin 300350, China
| | - Chao Ma
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| | - Zhongke Gao
- School of Electrical and Information Engineering, Tianjin University, Tianjin 300072, China
| |
Collapse
|
112
|
An EEG channel selection method for motor imagery based brain-computer interface and neurofeedback using Granger causality. Neural Netw 2020; 133:193-206. [PMID: 33220643 DOI: 10.1016/j.neunet.2020.11.002] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2020] [Revised: 10/08/2020] [Accepted: 11/05/2020] [Indexed: 11/21/2022]
Abstract
Motor imagery (MI) brain-computer interface (BCI) and neurofeedback (NF) with electroencephalogram (EEG) signals are commonly used for motor function improvement in healthy subjects and to restore neurological functions in stroke patients. Generally, in order to decrease noisy and redundant information in unrelated EEG channels, channel selection methods are used which provide feasible BCI and NF implementations with better performances. Our assumption is that there are causal interactions between the channels of EEG signal in MI tasks that are repeated in different trials of a BCI and NF experiment. Therefore, a novel method for EEG channel selection is proposed which is based on Granger causality (GC) analysis. Additionally, the machine-learning approach is used to cluster independent component analysis (ICA) components of the EEG signal into artifact and normal EEG clusters. After channel selection, using the common spatial pattern (CSP) and regularized CSP (RCSP), features are extracted and with the k-nearest neighbor (k-NN), support vector machine (SVM) and linear discriminant analysis (LDA) classifiers, MI tasks are classified into left and right hand MI. The goal of this study is to achieve a method resulting in lower EEG channels with higher classification performance in MI-based BCI and NF by causal constraint. The proposed method based on GC, with only eight selected channels, results in 93.03% accuracy, 92.93% sensitivity, and 93.12% specificity, with RCSP feature extractor and best classifier for each subject, after being applied on Physionet MI dataset, which is increased by 3.95%, 3.73%, and 4.13%, in comparison with correlation-based channel selection method.
Collapse
|
113
|
Li W, Hu X, Long X, Tang L, Chen J, Wang F, Zhang D. EEG responses to emotional videos can quantitatively predict big-five personality traits. Neurocomputing 2020. [DOI: 10.1016/j.neucom.2020.07.123] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|
114
|
Dai C, Pi D, Becker SI. Shapelet-transformed Multi-channel EEG Channel Selection. ACM T INTEL SYST TEC 2020. [DOI: 10.1145/3397850] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
Abstract
This article proposes an approach to select EEG channels based on EEG shapelet transformation, aiming to reduce the setup time and inconvenience for subjects and to improve the applicable performance of Brain-Computer Interfaces (BCIs). In detail, the method selects top-
k
EEG channels by solving a logistic loss-embedded minimization problem with respect to EEG shapelet learning, hyperplane learning, and EEG channel weight learning simultaneously. Especially, to learn distinguished EEG shapelets for weighting contributions of each EEG channel to the logistic loss, EEG shapelet similarity is also minimized during the procedure. Furthermore, the gradient descent strategy is adopted in the article to solve the non-convex optimization problem, which finally leads to the algorithm termed StEEGCS. In a result, classification accuracy, with those EEG channels selected by StEEGCS, is improved compared to that with all EEG channels, and classification time consumption is reduced as well. Additionally, the comparisons with several state-of-the-art EEG channel selection methods on several real-world EEG datasets also demonstrate the efficacy and superiority of StEEGCS.
Collapse
Affiliation(s)
- Chenglong Dai
- Nanjing University of Aeronautics and Astronautics, Jiangjun Avenue, Nanjing, Jiangsu Province, China
| | - Dechang Pi
- Nanjing University of Aeronautics and Astronautics, Jiangjun Avenue, Nanjing, Jiangsu Province, China
| | | |
Collapse
|
115
|
Chen X, Zhang Y, Yang Y, Li X, Xie P. Beta-Range Corticomuscular Coupling Reflects Asymmetries in Hand Movement. IEEE Trans Neural Syst Rehabil Eng 2020; 28:2575-2585. [PMID: 32894717 DOI: 10.1109/tnsre.2020.3022364] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Hand movement in humans is verified as asymmetries and lateralization, and two hemispheres make some distinct but complementary contributions in the control of hand movement. However, little research has been done on whether the information transfer of the motor system is different between left and right hand movement. Considering the importance of functional corticomuscular coupling (FCMC) between the motor cortex and contralateral muscle in movement assessment, this study aimed to explore the differences between left and right hand by investigating the interaction between muscle and brain activity. Here, we applied the transfer spectral entropy (TSE) algorithm to quantize the connection between electroencephalogram (EEG) over the brain scalp and electromyogram (EMG) from extensor digitorum (ED) and flexor digitorum superficialis (FDS) muscles recorded simultaneously during a gripping task. Eight healthy subjects were enrolled in this study. Results showed that left hand yielded narrower and lower beta synchronization compared to the right. Further analysis indicated coupling strength in EEG-EMG(FDS) combination was higher at beta band than that in EEG-EMG(ED) combination, and exhibited distinct differences between descending (EEG to EMG direction) and ascending (EMG to EEG direction) direction. This study presents the distinctions of beta-range FCMC between left and right hand, and confirms the importance of beta synchronization in understanding the mechanism of motor stability control. The cortex-muscle FCMC might be used as an evaluation approach to explore the difference between left and right movement system.
Collapse
|
116
|
Jin J, Liu C, Daly I, Miao Y, Li S, Wang X, Cichocki A. Bispectrum-Based Channel Selection for Motor Imagery Based Brain-Computer Interfacing. IEEE Trans Neural Syst Rehabil Eng 2020; 28:2153-2163. [PMID: 32870796 DOI: 10.1109/tnsre.2020.3020975] [Citation(s) in RCA: 50] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The performance of motor imagery (MI) based Brain-computer interfacing (BCI) is easily affected by noise and redundant information that exists in the multi-channel electroencephalogram (EEG). To solve this problem, many temporal and spatial feature based channel selection methods have been proposed. However, temporal and spatial features do not accurately reflect changes in the power of the oscillatory EEG. Thus, spectral features of MI-related EEG signals may be useful for channel selection. Bispectrum analysis is a technique developed for extracting non-linear and non-Gaussian information from non-linear and non-Gaussian signals. The features extracted from bispectrum analysis can provide frequency domain information about the EEG. Therefore, in this study, we propose a bispectrum-based channel selection (BCS) method for MI-based BCI. The proposed method uses the sum of logarithmic amplitudes (SLA) and the first order spectral moment (FOSM) features extracted from bispectrum analysis to select EEG channels without redundant information. Three public BCI competition datasets (BCI competition IV dataset 1, BCI competition III dataset IVa and BCI competition III dataset IIIa) were used to validate the effectiveness of our proposed method. The results indicate that our BCS method outperforms use of all channels (83.8% vs 69.4%, 86.3% vs 82.9% and 77.8% vs 68.2%, respectively). Furthermore, compared to the other state-of-the-art methods, our BCS method also can achieve significantly better classification accuracies for MI-based BCI (Wilcoxon signed test, p < 0.05).
Collapse
|
117
|
Wen D, Yuan J, Zhou Y, Xu J, Song H, Liu Y, Xu Y, Jung TP. The EEG Signal Analysis for Spatial Cognitive Ability Evaluation Based on Multivariate Permutation Conditional Mutual Information-Multi-Spectral Image. IEEE Trans Neural Syst Rehabil Eng 2020; 28:2113-2122. [PMID: 32833638 DOI: 10.1109/tnsre.2020.3018959] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
This study aims to find an effective method to evaluate the efficacy of cognitive training of spatial memory under a virtual reality environment, by classifying the EEG signals of subjects in the early and late stages of spatial cognitive training. This study proposes a new EEG signal analysis method based on Multivariate Permutation Conditional Mutual Information-Multi-Spectral Image (MPCMIMSI). This method mainly considers the relationship between the coupled features of EEG signals in different channel pairs and transforms the multivariate permutation conditional mutual information features into multi-spectral images. Then, a convolutional neural networks (CNN) model classifies the resultant image data into different stages of cognitive training to objectively assess the efficacy of the training. Compared to the multi-spectral image transformation method based on Granger causality analysis (GCA) and permutation conditional mutual information (PCMI), the MPCMIMSI led to better classification performance, which can be as high as 95% accuracy. More specifically, the Theta-Beta2-Gamma-band combination has the best accuracy. The proposed MPCMIMSI method outperforms the multi-spectral image transformation methods based on GCA and PCMI in terms of classification performance. The MPCMIMSI feature in the Theta-Beta2-Gamma band is an effective biomarker for assessing the efficacy of spatial memory training. The proposed EEG feature-extraction method based on MPCMIMSI offers a new window to characterize spatial information of the noninvasive EEG recordings and might apply to assessing other brain functions.
Collapse
|
118
|
A Computationally Efficient Method for Hybrid EEG-fNIRS BCI Based on the Pearson Correlation. BIOMED RESEARCH INTERNATIONAL 2020; 2020:1838140. [PMID: 32923476 PMCID: PMC7453261 DOI: 10.1155/2020/1838140] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/11/2020] [Revised: 06/29/2020] [Accepted: 07/31/2020] [Indexed: 11/17/2022]
Abstract
A hybrid brain computer interface (BCI) system considered here is a combination of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). EEG-fNIRS signals are simultaneously recorded to achieve high motor imagery task classification. This integration helps to achieve better system performance, but at the cost of an increase in system complexity and computational time. In hybrid BCI studies, channel selection is recognized as the key element that directly affects the system's performance. In this paper, we propose a novel channel selection approach using the Pearson product-moment correlation coefficient, where only highly correlated channels are selected from each hemisphere. Then, four different statistical features are extracted, and their different combinations are used for the classification through KNN and Tree classifiers. As far as we know, there is no report available that explored the Pearson product-moment correlation coefficient for hybrid EEG-fNIRS BCI channel selection. The results demonstrate that our hybrid system significantly reduces computational burden while achieving a classification accuracy with high reliability comparable to the existing literature.
Collapse
|
119
|
Channel and Feature Selection for a Motor Imagery-Based BCI System Using Multilevel Particle Swarm Optimization. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2020; 2020:8890477. [PMID: 32802031 PMCID: PMC7416234 DOI: 10.1155/2020/8890477] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Revised: 07/08/2020] [Accepted: 07/11/2020] [Indexed: 11/18/2022]
Abstract
Brain-computer interface (BCI) is a communication and control system linking the human brain and computers or other electronic devices. However, irrelevant channels and misleading features unrelated to tasks limit classification performance. To address these problems, we propose an efficient signal processing framework based on particle swarm optimization (PSO) for channel and feature selection, channel selection, and feature selection. Modified Stockwell transforms were used for a feature extraction, and multilevel hybrid PSO-Bayesian linear discriminant analysis was applied to optimization and classification. The BCI Competition III dataset I was used here to confirm the superiority of the proposed scheme. Compared to a method without optimization (89% accuracy), the best classification accuracy of the PSO-based scheme was 99% when less than 10.5% of the original features were used, the test time was reduced by more than 90%, and it achieved Kappa values and F-score of 0.98 and 98.99%, respectively, and better signal-to-noise ratio, thereby outperforming existing algorithms. The results show that the channel and feature selection scheme can accelerate the speed of convergence to the global optimum and reduce the training time. As the proposed framework can significantly improve classification performance, effectively reduce the number of features, and greatly shorten the test time, it can serve as a reference for related real-time BCI application system research.
Collapse
|
120
|
Li M, Yang G, Xu G. The Effect of the Graphic Structures of Humanoid Robot on N200 and P300 Potentials. IEEE Trans Neural Syst Rehabil Eng 2020; 28:1944-1954. [PMID: 32746323 DOI: 10.1109/tnsre.2020.3010250] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Humanoid robots are widely used in brain computer interface (BCI). Using a humanoid robot stimulus could increase the amplitude of event-related potentials (ERPs), which improves BCI performance. Since a humanoid robot contains many human elements, the element that increases the ERPs amplitude is unclear, and how to test the effect of it on the brain is a problem. This study used different graphic structures of an NAO humanoid robot to design three types of robot stimuli: a global robot, its local information, and its topological action. Ten subjects first conducted an odd-ball-based BCI (OD-BCI) by applying these stimuli. Then, they accomplished a delayed matching-to-sample task (DMST) that was used to specialize the encoding and retrieval phases of the OD-BCI task. In the retrieval phase of the DMST, the global stimulus induces the largest N200 and P300 potentials with the shortest latencies in the frontal, central, and occipital areas. This finding is in accordance with the P300 and classification performance of the OD-BCI task. When induced by the local stimulus, the subjects responded faster and more accurately in the retrieval phase of the DMST than in the other two conditions, indicating that the local stimulus improved the subject's responses. These results indicate that the OD-BCI task causes subject's retrieval work when the subject recognizes and outputs the stimulus. The global stimulus that contains topological and local elements could make brain react faster and induce larger ERPs, this finding could be used during the development of visual stimuli to improve BCI performance.
Collapse
|
121
|
An adaptive multi-domain feature joint optimization framework based on composite kernels and ant colony optimization for motor imagery EEG classification. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101994] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022]
|
122
|
Fu R, Han M, Tian Y, Shi P. Improvement motor imagery EEG classification based on sparse common spatial pattern and regularized discriminant analysis. J Neurosci Methods 2020; 343:108833. [PMID: 32619588 DOI: 10.1016/j.jneumeth.2020.108833] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2020] [Revised: 06/24/2020] [Accepted: 06/25/2020] [Indexed: 11/16/2022]
Abstract
BACKGROUND The classification of psychological tasks such as motor imagery based on electroencephalography (EEG) signals is an essential issue in the brain computer interface (BCI) system. The feature extraction is an important issue for improving classification accuracy of BCI system. NEW METHOD For extracting discriminative features, common spatial pattern (CSP) is an effective feature extraction method. However, features extracted by CSP are dense, and even feature patterns are repeatedly selected in the feature space. A sparse CSP algorithm is proposed, which embeds the sparse techniques and iterative search into the CSP. To improve the classification performance, two regularization parameters are added to the traditional linear discriminant analysis (LDA). RESULTS The sparse CSP algorithm can select several channels of EEG signals with the most obvious features. The improved regularized discriminant analysis is used to solve the singularity problem and improve the feature classification accuracy. Comparison with Existing Method(s): The proposed algorithm was evaluated by the data set I of the IVth BCI competition and our dataset. The experimental results of the BCI competition dataset show that accuracy of the improved algorithm is 10.75 % higher than that of the traditional algorithm. Comparing with the currently existing methods for the same data, it also shows excellent classification performance. The effectiveness of the improved algorithm is also shown in experiments on our dataset. CONCLUSIONS It sufficiently proves that the improved algorithm proposed in this paper improves the classification performance of motor intent recognition.
Collapse
Affiliation(s)
- Rongrong Fu
- Yanshan University School of Electrical Engineering, 066004, China
| | - Mengmeng Han
- Yanshan University School of Electrical Engineering, 066004, China
| | - Yongsheng Tian
- Yanshan University School of Electrical Engineering, 066004, China.
| | - Peiming Shi
- Yanshan University School of Electrical Engineering, 066004, China
| |
Collapse
|
123
|
Novel channel selection method based on position priori weighted permutation entropy and binary gravity search algorithm. Cogn Neurodyn 2020; 15:141-156. [PMID: 33786085 DOI: 10.1007/s11571-020-09608-3] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2019] [Revised: 05/09/2020] [Accepted: 06/13/2020] [Indexed: 11/27/2022] Open
Abstract
Brain-computer interface (BCI) system based on motor imagery (MI) usually adopts multichannel Electroencephalograph (EEG) signal recording method. However, EEG signals recorded in multi-channel mode usually contain many redundant and artifact information. Therefore, selecting a few effective channels from whole channels may be a means to improve the performance of MI-based BCI systems. We proposed a channel evaluation parameter called position priori weight-permutation entropy (PPWPE), which include amplitude information and position information of a channel. According to the order of PPWPE values, we initially selected half of the channels with large PPWPE value from all sampling electrode channels. Then, the binary gravitational search algorithm (BGSA) was used in searching a channel combination that will be used in determining an optimal channel combination. The features were extracted by common spatial pattern (CSP) method from the final selected channels, and the classifier was trained by support vector machine. The PPWPE + BGSA + CSP channel selection method is validated on two data sets. Results showed that the PPWPE + BGSA + CSP method obtained better mean classification accuracy (88.0% vs. 57.5% for Data set 1 and 91.1% vs. 79.4% for Data set 2) than All-C + CSP method. The PPWPE + BGSA + CSP method can achieve higher classification in fewer channels selected. This method has great potential to improve the performance of MI-based BCI systems.
Collapse
|
124
|
Wen D, Li P, Zhou Y, Sun Y, Xu J, Liu Y, Li X, Li J, Bian Z, Wang L. Feature Classification Method of Resting-State EEG Signals From Amnestic Mild Cognitive Impairment With Type 2 Diabetes Mellitus Based on Multi-View Convolutional Neural Network. IEEE Trans Neural Syst Rehabil Eng 2020; 28:1702-1709. [PMID: 32746302 DOI: 10.1109/tnsre.2020.3004462] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
The convolutional neural network (CNN) model is an active research topic in the field of EEG signals analysis. However, the classification effect of CNN on EEG signals of amnestic mild cognitive impairment (aMCI) with type 2 diabetes mellitus (T2DM) is not ideal. Even if EEG signals are transformed into multispectral images that are more closely matched with the model, the best classification performance can not be achieved. Therefore, to improve the performance of CNN toward EEG multispectral image classification, a multi-view convolutional neural network (MVCNN) classification model based on inceptionV1 is designed in this study. This model mainly improves and optimizes the convolutional layers and stochastic gradient descent (SGD) in the convolutional architecture model. Firstly, based on the discreteness of EEG multispectral image features, the multi-view convolutional layer structure was proposed. Then the learning rate change function of the SGD was optimized to increase the classification performance. The multi-view convolutional nerve was used in an EEG multispectral classification task involving 19 aMCI with T2DM and 20 normal controls. The results showed that compared with the traditional classification models, MVCNN had a better stability and accuracy. Therefore, MVCNN could be used as an effective feature classification method for aMCI with T2DM.
Collapse
|
125
|
Rahman MA, Khanam F, Ahmad M, Uddin MS. Multiclass EEG signal classification utilizing Rényi min-entropy-based feature selection from wavelet packet transformation. Brain Inform 2020; 7:7. [PMID: 32548772 PMCID: PMC7297893 DOI: 10.1186/s40708-020-00108-y] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Accepted: 06/10/2020] [Indexed: 12/02/2022] Open
Abstract
This paper proposes a novel feature selection method utilizing Rényi min-entropy-based algorithm for achieving a highly efficient brain–computer interface (BCI). Usually, wavelet packet transformation (WPT) is extensively used for feature extraction from electro-encephalogram (EEG) signals. For the case of multiple-class problem, classification accuracy solely depends on the effective feature selection from the WPT features. In conventional approaches, Shannon entropy and mutual information methods are often used to select the features. In this work, we have shown that our proposed Rényi min-entropy-based approach outperforms the conventional methods for multiple EEG signal classification. The dataset of BCI competition-IV (contains 4-class motor imagery EEG signal) is used for this experiment. The data are preprocessed and separated as the classes and used for the feature extraction using WPT. Then, for feature selection Shannon entropy, mutual information, and Rényi min-entropy methods are applied. With the selected features, four-class motor imagery EEG signals are classified using several machine learning algorithms. The results suggest that the proposed method is better than the conventional approaches for multiple-class BCI.
Collapse
Affiliation(s)
- Md Asadur Rahman
- Department of Biomedical Engineering, Military Institute of Science & Technology (MIST), Mirpur Cantonment, Dhaka, 1216, Bangladesh.
| | - Farzana Khanam
- Department of Biomedical Engineering, Jashore University of Science and Technology (JUST), Jashore, 7408, Bangladesh
| | - Mohiuddin Ahmad
- Department of Electrical and Electronic Engineering, Khulna University of Engineering & Technology (KUET), Khulna, 9203, Bangladesh
| | - Mohammad Shorif Uddin
- Department of Computer Science and Engineering, Jahangirnagar University, Dhaka, Bangladesh
| |
Collapse
|
126
|
Rashid M, Sulaiman N, P P Abdul Majeed A, Musa RM, Ab Nasir AF, Bari BS, Khatun S. Current Status, Challenges, and Possible Solutions of EEG-Based Brain-Computer Interface: A Comprehensive Review. Front Neurorobot 2020; 14:25. [PMID: 32581758 PMCID: PMC7283463 DOI: 10.3389/fnbot.2020.00025] [Citation(s) in RCA: 99] [Impact Index Per Article: 24.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2019] [Accepted: 04/08/2020] [Indexed: 12/12/2022] Open
Abstract
Brain-Computer Interface (BCI), in essence, aims at controlling different assistive devices through the utilization of brain waves. It is worth noting that the application of BCI is not limited to medical applications, and hence, the research in this field has gained due attention. Moreover, the significant number of related publications over the past two decades further indicates the consistent improvements and breakthroughs that have been made in this particular field. Nonetheless, it is also worth mentioning that with these improvements, new challenges are constantly discovered. This article provides a comprehensive review of the state-of-the-art of a complete BCI system. First, a brief overview of electroencephalogram (EEG)-based BCI systems is given. Secondly, a considerable number of popular BCI applications are reviewed in terms of electrophysiological control signals, feature extraction, classification algorithms, and performance evaluation metrics. Finally, the challenges to the recent BCI systems are discussed, and possible solutions to mitigate the issues are recommended.
Collapse
Affiliation(s)
- Mamunur Rashid
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Norizam Sulaiman
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Anwar P P Abdul Majeed
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Rabiu Muazu Musa
- Centre for Fundamental and Continuing Education, Universiti Malaysia Terengganu, Kuala Nerus, Malaysia
| | - Ahmad Fakhri Ab Nasir
- Innovative Manufacturing, Mechatronics and Sports Laboratory, Faculty of Manufacturing and Mechatronic Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Bifta Sama Bari
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| | - Sabira Khatun
- Faculty of Electrical & Electronics Engineering Technology, Universiti Malaysia Pahang, Pekan, Malaysia
| |
Collapse
|
127
|
Shen L, Dong X, Li Y. Analysis and classification of hybrid EEG features based on the depth DRDS videos. J Neurosci Methods 2020; 338:108690. [PMID: 32194131 DOI: 10.1016/j.jneumeth.2020.108690] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2020] [Revised: 02/28/2020] [Accepted: 03/15/2020] [Indexed: 01/24/2023]
Abstract
BACKGROUND Stereo vision cognition is a crucial advanced function of human beings, and stereoscopic acuity is an important index to detect stereo vision. Electroencephalograph (EEG) is an effective method of detection. Therefore, it has great significance to research the relationship between stereoscopic acuity and EEG signals for the development of 3D technology. NEW METHOD This paper proposes a multi-channel selection sparse time window common spatial group (MCS-STWCSG) multi-classification method. Firstly, a channel selection method based on improved common spatial pattern- (CSP-) rank is applied to select optimal channels to reduce redundant signal. Secondly, based on the one vs. one (OVO) computational model, we extend traditional CSP to the common spatial group (CSG) to implement three-classification. Finally, this paper optimizes time-frequency characteristics and hybrid signal features by sparse regression and utilizes a support vector machine (SVM) with radial basis function (RBF) kernel to identify depth dynamic random dot stereogram (DRDS) video tasks. RESULTS The selected channels are all located in and near the occipital region and time-frequency characteristics can acquire better classification results compared with frequency characteristics. The highest classification result can reach 94.67%. COMPARISON WITH EXISTING METHODS The MCS-STWCSG multi-classification method optimizes features from multiple aspects and its performance is obviously better than other methods for hybrid EEG signals of depth DRDS. CONCLUSIONS Channel selection and time-frequency segmentation for feature extraction and classification algorithm of EEG signals can increase the classification accuracy. It proves the feasibility and accuracy of the proposed method.
Collapse
Affiliation(s)
- Lili Shen
- Tianjin University, Shool of Electrical and Information Engineering, Weijin Road, Tianjin 300072, China.
| | - Xinxin Dong
- Tianjin University, Shool of Electrical and Information Engineering, Weijin Road, Tianjin 300072, China
| | - Yueping Li
- Tianjin Eye Hospital, Clinical College of Ophthalmology of Tianjin Medical University, Tianjin Key Laboratory of Ophthalmology and Vision Science, Tianjin 300020, China.
| |
Collapse
|
128
|
Feng C, Ma Z, Yang D, Li X, Zhang J, Li Y. A Method for Prediction of Thermophilic Protein Based on Reduced Amino Acids and Mixed Features. Front Bioeng Biotechnol 2020; 8:285. [PMID: 32432088 PMCID: PMC7214540 DOI: 10.3389/fbioe.2020.00285] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2020] [Accepted: 03/18/2020] [Indexed: 11/13/2022] Open
Abstract
The thermostability of proteins is a key factor considered during enzyme engineering, and finding a method that can identify thermophilic and non-thermophilic proteins will be helpful for enzyme design. In this study, we established a novel method combining mixed features and machine learning to achieve this recognition task. In this method, an amino acid reduction scheme was adopted to recode the amino acid sequence. Then, the physicochemical characteristics, auto-cross covariance (ACC), and reduced dipeptides were calculated and integrated to form a mixed feature set, which was processed using correlation analysis, feature selection, and principal component analysis (PCA) to remove redundant information. Finally, four machine learning methods and a dataset containing 500 random observations out of 915 thermophilic proteins and 500 random samples out of 793 non-thermophilic proteins were used to train and predict the data. The experimental results showed that 98.2% of thermophilic and non-thermophilic proteins were correctly identified using 10-fold cross-validation. Moreover, our analysis of the final reserved features and removed features yielded information about the crucial, unimportant and insensitive elements, it also provided essential information for enzyme design.
Collapse
Affiliation(s)
- Changli Feng
- College of Information Science and Technology, Taishan University, Tai’an, China
| | - Zhaogui Ma
- College of Information Science and Technology, Taishan University, Tai’an, China
| | - Deyun Yang
- College of Information Science and Technology, Taishan University, Tai’an, China
| | - Xin Li
- College of Information Science and Technology, Taishan University, Tai’an, China
| | - Jun Zhang
- Department of Rehabilitation, General Hospital of Heilongjiang Province Land Reclamation Bureau, Harbin, China
| | - Yanjuan Li
- Information and Computer Engineering College, Northeast Forestry University, Harbin, China
| |
Collapse
|
129
|
Katyal A, Singla R. A novel hybrid paradigm based on steady state visually evoked potential & P300 to enhance information transfer rate. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101884] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
|
130
|
Zhang X, Guo Y, Gao B, Long J. Alpha Frequency Intervention by Electrical Stimulation to Improve Performance in Mu-Based BCI. IEEE Trans Neural Syst Rehabil Eng 2020; 28:1262-1270. [PMID: 32305926 DOI: 10.1109/tnsre.2020.2987529] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
The accuracy of brain-computer interfaces (BCIs) is important for effective communication and control. The mu-based BCI is one of the most widely used systems, of which the related methods to improve users' accuracy are still poorly studied, especially for the BCI illiteracy. Here, we examined a way to enhance mu-based BCI performance by electrically stimulating the ulnar nerve of the contralateral wrist at the alpha frequency (10 Hz) during left- and right-hand motor imagination in two BCI groups (literate and illiterate). We demonstrate that this alpha frequency intervention enhances the classification accuracy between left- and right-hand motor imagery from 66.41% to 81.57% immediately after intervention and to 75.28% two days after intervention in the BCI illiteracy group, while classification accuracy improves from 82.12% to 91.84% immediately after intervention and to 89.03% two days after intervention in the BCI literacy group. However, the classification accuracy did not change before and after the sham intervention (no electrical stimulation). Furthermore, the ERD on the primary sensorimotor cortex during left- or right-hand motor imagery tasks was more visible at the mu-rhythm (8-13 Hz) after alpha frequency intervention. Alpha frequency intervention increases the mu-rhythm power difference between left- and right-hand motor imagery tasks. These results provide evidence that alpha frequency intervention is an effective way to improve BCI performance by regulating the mu-rhythm which might provide a way to reduce BCI illiteracy.
Collapse
|
131
|
Bacomics: a comprehensive cross area originating in the studies of various brain-apparatus conversations. Cogn Neurodyn 2020; 14:425-442. [PMID: 32655708 DOI: 10.1007/s11571-020-09577-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Revised: 02/17/2020] [Accepted: 03/05/2020] [Indexed: 12/20/2022] Open
Abstract
The brain is the most important organ of the human body, and the conversations between the brain and an apparatus can not only reveal a normally functioning or a dysfunctional brain but also can modulate the brain. Here, the apparatus may be a nonbiological instrument, such as a computer, and the consequent brain-computer interface is now a very popular research area with various applications. The apparatus may also be a biological organ or system, such as the gut and muscle, and their efficient conversations with the brain are vital for a healthy life. Are there any common bases that bind these different scenarios? Here, we propose a new comprehensive cross area: Bacomics, which comes from brain-apparatus conversations (BAC) + omics. We take Bacomics to cover at least three situations: (1) The brain is normal, but the conversation channel is disabled, as in amyotrophic lateral sclerosis. The task is to reconstruct or open up new channels to reactivate the brain function. (2) The brain is in disorder, such as in Parkinson's disease, and the work is to utilize existing or open up new channels to intervene, repair and modulate the brain by medications or stimulation. (3) Both the brain and channels are in order, and the goal is to enhance coordinated development between the brain and apparatus. In this paper, we elaborate the connotation of BAC into three aspects according to the information flow: the issue of output to the outside (BAC-1), the issue of input to the brain (BAC-2) and the issue of unity of brain and apparatus (BAC-3). More importantly, there are no less than five principles that may be taken as the cornerstones of Bacomics, such as feedforward and feedback control, brain plasticity, harmony, the unity of opposites and systems principles. Clearly, Bacomics integrates these seemingly disparate domains, but more importantly, opens a much wider door for the research and development of the brain, and the principles further provide the general framework in which to realize or optimize these various conversations.
Collapse
|
132
|
K V, A D, J M, M S, A A, Iraj SA. A novel method of motor imagery classification using eeg signal. Artif Intell Med 2020; 103:101787. [PMID: 32143794 DOI: 10.1016/j.artmed.2019.101787] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2019] [Revised: 11/05/2019] [Accepted: 12/30/2019] [Indexed: 10/25/2022]
Abstract
A subject of extensive research interest in the Brain Computer Interfaces (BCIs) niche is motor imagery (MI), where users imagine limb movements to control the system. This interest is owed to the immense potential for its applicability in gaming, neuro-prosthetics and neuro-rehabilitation, where the user's thoughts of imagined movements need to be decoded. Electroencephalography (EEG) equipment is commonly used for keeping track of cerebrum movement in BCI systems. The EEG signals are recognized by feature extraction and classification. The current research proposes a Hybrid-KELM (Kernel Extreme Learning Machine) method based on PCA (Principal Component Analysis) and FLD (Fisher's Linear Discriminant) for MI BCI classification of EEG data. The performance and results of the method are demonstrated using BCI competition dataset III, and compared with those of contemporary methods. The proposed method generated an accuracy of 96.54%.
Collapse
Affiliation(s)
| | - Devipriya A
- Department of IT, Sri Krishna College of Engineering and Technology, Coimbatore, India.
| | - Maniraj J
- Department of Mechanical Engineering, KIT, Coimbatore, India.
| | - Sivaram M
- Department of Computer Networking, Lebanese French University, Erbil, Kurdistan Region, Iraq.
| | - Ambikapathy A
- Department of EEE, Galgotias College of Engineering and Technology, Greater Noida, India.
| | - S Amiri Iraj
- Computational Optics Research Group, Advanced Institute of Materials Science, Ton Duc Thang University, Ho Chi Minh City, Viet Nam; Faculty of Applied Sciences, Ton Duc Thang University, Ho Chi Minh City, Viet Nam.
| |
Collapse
|
133
|
LaRocco J, Paeng DG. Optimizing Computer-Brain Interface Parameters for Non-invasive Brain-to-Brain Interface. Front Neuroinform 2020; 14:1. [PMID: 32116625 PMCID: PMC7020695 DOI: 10.3389/fninf.2020.00001] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2019] [Accepted: 01/07/2020] [Indexed: 11/29/2022] Open
Abstract
A non-invasive, brain-to-brain interface (BBI) requires precision neuromodulation and high temporal resolution as well as portability to increase accessibility. A BBI is a combination of the brain-computer interface (BCI) and the computer-brain interface (CBI). The optimization of BCI parameters has been extensively researched, but CBI has not. Parameters taken from the BCI and CBI literature were used to simulate a two-class medical monitoring BBI system under a wide range of conditions. BBI function was assessed using the information transfer rate (ITR), measured in bits per trial and bits per minute. The BBI ITR was a function of classifier accuracy, window update rate, system latency, stimulation failure rate (SFR), and timeout threshold. The BCI parameters, including window length, update rate, and classifier accuracy, were kept constant to investigate the effects of varying the CBI parameters, including system latency, SFR, and timeout threshold. Based on passively monitoring BCI parameters, a base ITR of 1 bit/trial was used. The optimal latency was found to be 100 ms or less, with a threshold no more than twice its value. With the optimal latency and timeout parameters, the system was able to maintain near-maximum efficiency, even with a 25% SFR. When the CBI and BCI parameters are compared, the CBI's system latency and timeout threshold should be reflected in the BCI's update rate. This would maximize the number of trials, even at a high SFR. These findings suggested that a higher number of trials per minute optimizes the ITR of a non-invasive BBI. The delays innate to each BCI protocol and CBI stimulation method must also be accounted for. The high latencies in each are the primary constraints of non-invasive BBI for the foreseeable future.
Collapse
Affiliation(s)
| | - Dong-Guk Paeng
- Laboratory of Biomedical Ultrasound, Department of Ocean System Engineering, Jeju National University, Jeju City, South Korea
| |
Collapse
|
134
|
Sadiq MT, Yu X, Yuan Z, Aziz MZ, Siuly S, Ding W. A Matrix Determinant Feature Extraction Approach for Decoding Motor and Mental Imagery EEG in Subject Specific Tasks. IEEE Trans Cogn Dev Syst 2020. [DOI: 10.1109/tcds.2020.3040438] [Citation(s) in RCA: 27] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
|
135
|
Evaluating a Semiautonomous Brain-Computer Interface Based on Conformal Geometric Algebra and Artificial Vision. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2019; 2019:9374802. [PMID: 31885534 PMCID: PMC6925707 DOI: 10.1155/2019/9374802] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/10/2019] [Accepted: 10/30/2019] [Indexed: 11/18/2022]
Abstract
In this paper, we evaluate a semiautonomous brain-computer interface (BCI) for manipulation tasks. In such a system, the user controls a robotic arm through motor imagery commands. In traditional process-control BCI systems, the user has to provide those commands continuously in order to manipulate the effector of the robot step-by-step, which results in a tiresome process for simple tasks such as pick and replace an item from a surface. Here, we take a semiautonomous approach based on a conformal geometric algebra model that solves the inverse kinematics of the robot on the fly, and then the user only has to decide on the start of the movement and the final position of the effector (goal-selection approach). Under these conditions, we implemented pick-and-place tasks with a disk as an item and two target areas placed on the table at arbitrary positions. An artificial vision (AV) algorithm was used to obtain the positions of the items expressed in the robot frame through images captured with a webcam. Then, the AV algorithm is integrated into the inverse kinematics model to perform the manipulation tasks. As proof-of-concept, different users were trained to control the pick-and-place tasks through the process-control and semiautonomous goal-selection approaches so that the performance of both schemes could be compared. Our results show the superiority in performance of the semiautonomous approach as well as evidence of less mental fatigue with it.
Collapse
|