1
|
Xu G, Wang Z, Zhao X, Li R, Zhou T, Xu T, Hu H. Attentional State Classification Using Amplitude and Phase Feature Extraction Method Based on Filter Bank and Riemannian Manifold. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4402-4412. [PMID: 37917520 DOI: 10.1109/tnsre.2023.3329482] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2023]
Abstract
As a significant aspect of cognition, attention has been extensively studied and numerous measurements have been developed based on brain signal processing. Although existing attentional state classification methods have achieved good accuracy by extracting a variety of handcrafted features, spatial features have not been fully explored. This paper proposes an attentional state classification method based on Riemannian manifold to utilize spatial information. Based on the concept of Riemannian manifold of symmetric positive definite (SPD) matrix, the proposed method exploits the structure of covariance matrix to extract spatial features instead of using spatial filters. Specifically, Riemannian distances from intra-class Riemannian means are extracted as features for their robustness. To fully extend the potential of electroencephalograph (EEG) signal, both amplitude and phase information is utilized. In addition, to solve the variance of frequency bands, a filter bank is employed to process the signal of different frequency bands separately. Finally, features are fed into a support vector machine with a polynomial kernel to obtain classification results. The proposed attentional state classification using amplitude and phase feature extraction method based on filter bank and Riemannian manifold (AP-FBRM) method is evaluated on two open datasets including EEG data of 29 and 26 subjects. According to the experimental results, the optimal set of filter bank and the optimal technique to extract features containing both amplitude and phase information are determined. The proposed method respectively achieves accuracies of 88.06% and 80.00% and outperforms 8 baseline methods, which manifests that the proposed method creates an efficient way to recognize attentional state.
Collapse
|
2
|
Mirjalili S, Powell P, Strunk J, James T, Duarte A. Evaluation of classification approaches for distinguishing brain states predictive of episodic memory performance from electroencephalography: Abbreviated Title: Evaluating methods of classifying memory states from EEG. Neuroimage 2022; 247:118851. [PMID: 34954026 PMCID: PMC8824531 DOI: 10.1016/j.neuroimage.2021.118851] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 12/20/2021] [Accepted: 12/21/2021] [Indexed: 11/21/2022] Open
Abstract
Previous studies have attempted to separate single trial neural responses for events a person is likely to remember from those they are likely to forget using machine learning classification methods. Successful single trial classification holds potential for translation into the clinical realm for real-time detection of memory and other cognitive states to provide real-time interventions (i.e., brain-computer interfaces). However, most of these studies-and classification analyses in general- do not make clear if the chosen methodology is optimally suited for the classification of memory-related brain states. To address this problem, we systematically compared different methods for every step of classification (i.e., feature extraction, feature selection, classifier selection) to investigate which methods work best for decoding episodic memory brain states-the first analysis of its kind. Using an adult lifespan sample EEG dataset collected during performance of an episodic context encoding and retrieval task, we found that no specific feature type (including Common Spatial Pattern (CSP)-based features, mean, variance, correlation, features based on AR model, entropy, phase, and phase synchronization) outperformed others consistently in distinguishing different memory classes. However, extracting all of these feature types consistently outperformed extracting only one type of feature. Additionally, the combination of filtering and sequential forward selection was the optimal method to select the effective features compared to filtering alone or performing no feature selection at all. Moreover, although all classifiers performed at a fairly similar level, LASSO was consistently the highest performing classifier compared to other commonly used options (i.e., naïve Bayes, SVM, and logistic regression) while naïve Bayes was the fastest classifier. Lastly, for multiclass classification (i.e., levels of context memory confidence and context feature perception), generalizing the binary classification using the binary decision tree performed better than the voting or one versus rest method. These methods were shown to outperform alternative approaches for three orthogonal datasets (i.e., EEG working memory, EEG motor imagery, and MEG working memory), supporting their generalizability. Our results provide an optimized methodological process for classifying single-trial neural data and provide important insight and recommendations for a cognitive neuroscientist's ability to make informed choices at all stages of the classification process for predicting memory and other cognitive states.
Collapse
Affiliation(s)
| | | | | | - Taylor James
- School of Psychology, Georgia Institute of Technology; Department of Neurology, Emory University, Atlanta, GA, USA.
| | - Audrey Duarte
- Department of Psychology, University of Texas at Austin.
| |
Collapse
|
3
|
Radman M, Chaibakhsh A, Nariman-zadeh N, He H. Feature fusion for improving performance of motor imagery brain-computer interface system. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102763] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
4
|
A comprehensive assessment of Brain Computer Interfaces: Recent trends and challenges. J Neurosci Methods 2020; 346:108918. [PMID: 32853592 DOI: 10.1016/j.jneumeth.2020.108918] [Citation(s) in RCA: 20] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2020] [Revised: 07/15/2020] [Accepted: 08/19/2020] [Indexed: 12/23/2022]
Abstract
BACKGROUND An uninterrupted channel of communication and control between the human brain and electronic processing units has led to an increased use of Brain Computer Interfaces (BCIs). This article attempts to present an all-encompassing review on BCI and the scientific advancements associated with it. The ultimate goal of this review is to provide a general overview of the BCI technology and to shed light on different aspects of BCIs. This review also underscores the applications, practical challenges and opportunities associated with BCI technology, which can be used to accelerate future developments in this field. METHODS This review is based on a systematic literature search for tracking down the relevant research annals and proceedings. Using a methodical search strategy, the search was carried out across major technical databases. The retrieved records were screened for their relevance and a total of 369 research chronicles were engulfed in this review based on the inclusion criteria. RESULTS This review describes the present scenario and recent advancements in BCI technology. It also identifies several application areas of BCI technology. This comprehensive review provides evidence that, while we are getting ever closer, significant challenges still exist for the development of BCIs that can seamlessly integrate with the user's biological system. CONCLUSION The findings of this review confirm the importance of BCI technology in various applications. It is concluded that BCI technology, still in its sprouting phase, requires significant explorations for further development.
Collapse
|
5
|
Gupta A, Kumar D. Fuzzy clustering-based feature extraction method for mental task classification. Brain Inform 2016; 4:135-145. [PMID: 27747824 PMCID: PMC5413590 DOI: 10.1007/s40708-016-0056-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2016] [Accepted: 08/22/2016] [Indexed: 12/02/2022] Open
Abstract
A brain computer interface (BCI) is a communication system by which a person can send messages or requests for basic necessities without using peripheral nerves and muscles. Response to mental task-based BCI is one of the privileged areas of investigation. Electroencephalography (EEG) signals are used to represent the brain activities in the BCI domain. For any mental task classification model, the performance of the learning model depends on the extraction of features from EEG signal. In literature, wavelet transform and empirical mode decomposition are two popular feature extraction methods used to analyze a signal having non-linear and non-stationary property. By adopting the virtue of both techniques, a theoretical adaptive filter-based method to decompose non-linear and non-stationary signal has been proposed known as empirical wavelet transform (EWT) in recent past. EWT does not work well for the signals having overlapped in frequency and time domain and failed to provide good features for further classification. In this work, Fuzzy c-means algorithm is utilized along with EWT to handle this problem. It has been observed from the experimental results that EWT along with fuzzy clustering outperforms in comparison to EWT for the EEG-based response to mental task problem. Further, in case of mental task classification, the ratio of samples to features is very small. To handle the problem of small ratio of samples to features, in this paper, we have also utilized three well-known multivariate feature selection methods viz. Bhattacharyya distance (BD), ratio of scatter matrices (SR), and linear regression (LR). The results of experiment demonstrate that the performance of mental task classification has improved considerably by aforesaid methods. Ranking method and Friedman’s statistical test are also performed to rank and compare different combinations of feature extraction methods and feature selection methods which endorse the efficacy of the proposed approach.
Collapse
Affiliation(s)
- Akshansh Gupta
- School of Computational and Integrative Sciences, Jawaharlal Nehru University, New Delhi, 110067, India.
| | - Dhirendra Kumar
- School of Computer and Systems Sciences, Jawaharlal Nehru University, New Delhi, 110067, India
| |
Collapse
|
6
|
Geronimo A, Kamrunnahar M, Schiff SJ. Single Trial Predictors for Gating Motor-Imagery Brain-Computer Interfaces Based on Sensorimotor Rhythm and Visual Evoked Potentials. Front Neurosci 2016; 10:164. [PMID: 27199630 PMCID: PMC4844920 DOI: 10.3389/fnins.2016.00164] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2016] [Accepted: 04/01/2016] [Indexed: 11/24/2022] Open
Abstract
For brain-computer interfaces (BCIs) that utilize visual cues to direct the user, the neural signals extracted by the computer are representative of ongoing processes, visual evoked responses, and voluntary modulation. We proposed to use three brain signatures for predicting success on a single trial of a BCI task. The first two features, the amplitude and phase of the pre-trial mu amplitude, were chosen as a correlate for cortical excitability. The remaining feature, related to the visually evoked response to the cue, served as a possible measure of fixation and attention to the task. Of these three features, mu rhythm amplitude over the central electrodes at the time of cue presentation and to a lesser extent the single trial visual evoked response were correlated with the success on the subsequent imagery task. Despite the potential for gating trials using these features, an offline gating simulation was limited in its ability to produce an increase in device throughput. This discrepancy highlights a distinction between the identification of predictive features, and the use of this knowledge in an online BCI. Using such a system, we cannot assume that the user will respond similarly when faced with a scenario where feedback is altered by trials that are gated on a regular basis. The results of this study suggest the possibility of using individualized, pre-task neural signatures for personalized, and asynchronous (self-paced) BCI applications, although these effects need to be quantified in a real-time adaptive scenario in a future study.
Collapse
Affiliation(s)
- Andrew Geronimo
- Department of Engineering Science and Mechanics, Center for Neural Engineering, The Pennsylvania State UniversityUniversity Park, PA, USA; Department of Neurosurgery, Penn State College of MedicineHershey, PA, USA
| | - Mst Kamrunnahar
- Department of Engineering Science and Mechanics, Center for Neural Engineering, The Pennsylvania State University University Park, PA, USA
| | - Steven J Schiff
- Department of Engineering Science and Mechanics, Center for Neural Engineering, The Pennsylvania State UniversityUniversity Park, PA, USA; Department of Neurosurgery, Penn State College of MedicineHershey, PA, USA; Department of Physics, The Pennsylvania State UniversityUniversity Park, PA, USA
| |
Collapse
|
7
|
Abstract
The crucial problem that has to be solved when designing an effective brain–computer interface (BCI) is: how to reduce the huge space of features extracted from raw electroencephalography (EEG) signals. One of the strategies for feature selection that is often applied by BCI researchers is based on genetic algorithms (GAs). The two types of GAs that are most commonly used in BCI research are the classic algorithm and the Culling algorithm. This paper presents both algorithms and their application for selecting features crucial for the correct classification of EEG signals recorded during imagery movements of the left and right hand. The results returned by both algorithms are compared to those returned by an algorithm with aggressive mutation and an algorithm with melting individuals, both of which have been proposed by the author of this paper. While the aggressive mutation algorithm has been published previously, the melting individuals algorithm is presented here for the first time.
Collapse
Affiliation(s)
- Izabela Rejer
- Faculty of Computer Science, West Pomeranian University of Technology, Szczecin 71-210, Poland
| |
Collapse
|
8
|
Chen Y, Zhou W, Wang H, Yuan Z. Prediction of O-glycosylation sites based on multi-scale composition of amino acids and feature selection. Med Biol Eng Comput 2015; 53:535-44. [PMID: 25752770 DOI: 10.1007/s11517-015-1268-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2014] [Accepted: 03/02/2015] [Indexed: 12/21/2022]
Abstract
Protein glycosylation is one of the most important and complex post-translational modification that provides greater proteomic diversity than any other post-translational modification. Fast and reliable computational methods to identify glycosylation sites are in great demand. Two key issues, feature encoding and feature selection, can critically affect the accuracy of a computational method. We present a new O-glycosylation sites prediction method using only amino acid sequence information. The method includes the following components: (1) on the basis of multi-scale theory, features based on multi-scale composition of amino acids were extracted from the training sequences with identified glycosylation sites; (2) perform a two-stage feature selection to remove features that had adverse effects on the prediction, including a stage one preliminary filtering with Student's t test, and a second stage screening through iterative elimination using novel pairwise comparisons conducted in random subspace using support vector machine. Important features retained are used to build prediction model. The method is evaluated with sequence-based tenfold cross-validation tests on balanced datasets. The results of our experiments show that our method significantly outperforms those reported in the literature in terms of sensitivity, specificity, accuracy, Matthew's correlation coefficient. The prediction accuracy of serine and threonine residues sites reached 95.7 and 92.7%. The Matthew correlation coefficient of our method for S and T sites is 0.914 and 0.873, respectively. This method can evaluate each feature with the interactions of the rest of the features, which are still included in the model and have the advantage of high efficiency.
Collapse
Affiliation(s)
- Yuan Chen
- Hunan Provincial Key Laboratory of Crop Germplasm Innovation and Utilization, Hunan Agricultural University, Changsha, 410128, China
| | | | | | | |
Collapse
|
9
|
Feature selection and classification of leukocytes using random forest. Med Biol Eng Comput 2014; 52:1041-52. [PMID: 25284218 DOI: 10.1007/s11517-014-1200-8] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2013] [Accepted: 09/22/2014] [Indexed: 01/30/2023]
Abstract
In automatic segmentation of leukocytes from the complex morphological background of tissue section images, a vast number of artifacts/noise are also extracted causing large amount of multivariate data generation. This multivariate data degrades the performance of a classifier to discriminate between leukocytes and artifacts/noise. However, the selection of prominent features plays an important role in reducing the computational complexity and increasing the performance of the classifier as compared to a high-dimensional features space. Therefore, this paper introduces a novel Gini importance-based binary random forest feature selection method. Moreover, the random forest classifier is used to classify the extracted objects into artifacts, mononuclear cells, and polymorphonuclear cells. The experimental results establish that the proposed method effectively eliminates the irrelevant features, maintaining the high classification accuracy as compared to other feature reduction methods.
Collapse
|
10
|
Performance enhancement of mental task classification using EEG signal: a study of multivariate feature selection methods. Soft comput 2014. [DOI: 10.1007/s00500-014-1443-1] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
11
|
McCann MT, Thompson DE, Syed ZH, Huggins JE. Electrode subset selection methods for an EEG-based P300 brain-computer interface. Disabil Rehabil Assist Technol 2014; 10:216-20. [PMID: 24506528 DOI: 10.3109/17483107.2014.884174] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
Abstract
PURPOSE An electroencephalography (EEG)-based P300 speller is a type of brain-computer interface (BCI) that uses EEG to allow a user to select characters without physical movement. In general, using fewer electrodes for such a system makes it easier to set up and less expensive. This study addresses the question of electrode selection for EEG-based P300 systems. METHODS Data from 13 subjects collected with a 16-electrode cap was analyzed. The optimal subsets of electrodes of sizes 1-15 were calculated for each subject and for the group as a whole. The methods of exhaustive search, forward selection, and backward elimination were then compared to each other and to these optimal subsets. RESULTS The results show that, while none of the methods consistently picked the best-performing electrode subsets, all methods were able to find small electrode subsets that provided acceptable accuracy both for individuals and for the whole group. The computationally intensive exhaustive search method provided no statistically significant increase in performance over the much quicker forward and backward selection methods. CONCLUSIONS The forward and backward selection methods are preferred for electrode selection. IMPLICATIONS FOR REHABILITATION A P300 speller is a type of brain-computer interface that allows a user to select characters without physical movement. Using fewer electrodes reduces setup time and cost for an EEG-based P300 speller. We show that acceptable P300 speller performance can be achieved with as few as four electrodes. We compare methods of selecting electrode sets and identify fast and efficient methods for customizing electrode sets for individuals.
Collapse
Affiliation(s)
- Michael T McCann
- Department of Biomedical Engineering, University of Michigan , Ann Arbor, MI , USA
| | | | | | | |
Collapse
|
12
|
Han M, Liu X. Feature selection techniques with class separability for multivariate time series. Neurocomputing 2013. [DOI: 10.1016/j.neucom.2012.12.006] [Citation(s) in RCA: 31] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
13
|
Targeting an efficient target-to-target interval for P300 speller brain-computer interfaces. Med Biol Eng Comput 2012; 50:289-96. [PMID: 22350331 DOI: 10.1007/s11517-012-0868-x] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2011] [Accepted: 02/06/2012] [Indexed: 10/28/2022]
Abstract
Longer target-to-target intervals (TTI) produce greater P300 event-related potential amplitude, which can increase brain-computer interface (BCI) classification accuracy and decrease the number of flashes needed for accurate character classification. However, longer TTIs requires more time for each trial, which will decrease the information transfer rate of BCI. In this paper, a P300 BCI using a 7 × 12 matrix explored new flash patterns (16-, 18- and 21-flash pattern) with different TTIs to assess the effects of TTI on P300 BCI performance. The new flash patterns were designed to minimize TTI, decrease repetition blindness, and examine the temporal relationship between each flash of a given stimulus by placing a minimum of one (16-flash pattern), two (18-flash pattern), or three (21-flash pattern) non-target flashes between each target flashes. Online results showed that the 16-flash pattern yielded the lowest classification accuracy among the three patterns. The results also showed that the 18-flash pattern provides a significantly higher information transfer rate (ITR) than the 21-flash pattern; both patterns provide high ITR and high accuracy for all subjects.
Collapse
|
14
|
Brain computer interfaces, a review. SENSORS 2012; 12:1211-79. [PMID: 22438708 PMCID: PMC3304110 DOI: 10.3390/s120201211] [Citation(s) in RCA: 706] [Impact Index Per Article: 58.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2011] [Revised: 01/16/2012] [Accepted: 01/29/2012] [Indexed: 11/16/2022]
Abstract
A brain-computer interface (BCI) is a hardware and software communications system that permits cerebral activity alone to control computers or external devices. The immediate goal of BCI research is to provide communications capabilities to severely disabled people who are totally paralyzed or 'locked in' by neurological neuromuscular disorders, such as amyotrophic lateral sclerosis, brain stem stroke, or spinal cord injury. Here, we review the state-of-the-art of BCIs, looking at the different steps that form a standard BCI: signal acquisition, preprocessing or signal enhancement, feature extraction, classification and the control interface. We discuss their advantages, drawbacks, and latest advances, and we survey the numerous technologies reported in the scientific literature to design each step of a BCI. First, the review examines the neuroimaging modalities used in the signal acquisition step, each of which monitors a different functional brain activity such as electrical, magnetic or metabolic activity. Second, the review discusses different electrophysiological control signals that determine user intentions, which can be detected in brain activity. Third, the review includes some techniques used in the signal enhancement step to deal with the artifacts in the control signals and improve the performance. Fourth, the review studies some mathematic algorithms used in the feature extraction and classification steps which translate the information in the control signals into commands that operate a computer or other device. Finally, the review provides an overview of various BCI applications that control a range of devices.
Collapse
|
15
|
Khan OI, Farooq F, Akram F, Choi MT, Han SM, Kim TS. Robust extraction of P300 using constrained ICA for BCI applications. Med Biol Eng Comput 2012; 50:231-41. [DOI: 10.1007/s11517-012-0861-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2010] [Accepted: 01/02/2012] [Indexed: 10/14/2022]
|
16
|
Error potential detection during continuous movement of an artificial arm controlled by brain–computer interface. Med Biol Eng Comput 2012; 50:223-30. [DOI: 10.1007/s11517-011-0858-4] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2011] [Accepted: 12/06/2011] [Indexed: 10/14/2022]
|
17
|
Brunner C, Billinger M, Vidaurre C, Neuper C. A comparison of univariate, vector, bilinear autoregressive, and band power features for brain-computer interfaces. Med Biol Eng Comput 2011; 49:1337-46. [PMID: 21947797 PMCID: PMC3208819 DOI: 10.1007/s11517-011-0828-x] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2011] [Accepted: 09/08/2011] [Indexed: 11/24/2022]
Abstract
Selecting suitable feature types is crucial to obtain good overall brain-computer interface performance. Popular feature types include logarithmic band power (logBP), autoregressive (AR) parameters, time-domain parameters, and wavelet-based methods. In this study, we focused on different variants of AR models and compare performance with logBP features. In particular, we analyzed univariate, vector, and bilinear AR models. We used four-class motor imagery data from nine healthy users over two sessions. We used the first session to optimize parameters such as model order and frequency bands. We then evaluated optimized feature extraction methods on the unseen second session. We found that band power yields significantly higher classification accuracies than AR methods. However, we did not update the bias of the classifiers for the second session in our analysis procedure. When updating the bias at the beginning of a new session, we found no significant differences between all methods anymore. Furthermore, our results indicate that subject-specific optimization is not better than globally optimized parameters. The comparison within the AR methods showed that the vector model is significantly better than both univariate and bilinear variants. Finally, adding the prediction error variance to the feature space significantly improved classification results.
Collapse
Affiliation(s)
- Clemens Brunner
- Laboratory of Brain-Computer Interfaces, Institute for Knowledge Discovery, Graz University of Technology, Krenngasse 37, 8010 Graz, Austria.
| | | | | | | |
Collapse
|