1
|
Gu J, Jiang J, Ge S, Wang H. Capped L21-norm-based common spatial patterns for EEG signals classification applicable to BCI systems. Med Biol Eng Comput 2023; 61:1083-1092. [PMID: 36658415 DOI: 10.1007/s11517-023-02782-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2022] [Accepted: 01/06/2023] [Indexed: 01/21/2023]
Abstract
The common spatial patterns (CSP) technique is an effective strategy for the classification of multichannel electroencephalogram (EEG) signals. However, the objective function expression of the conventional CSP algorithm is based on the L2-norm, which makes the performance of the method easily affected by outliers and noise. In this paper, we consider a new extension to CSP, which is termed capped L21-norm-based common spatial patterns (CCSP-L21), by using the capped L21-norm rather than the L2-norm for robust modeling. L21-norm considers the L1-norm sum which largely alleviates the influence of outliers and noise for the sake of robustness. The capped norm is further used to mitigate the effects of extreme outliers whose signal amplitude is much higher than that of the normal signal. Moreover, a non-greedy iterative procedure is derived to solve the proposed objective function. The experimental results show that the proposed method achieves the highest average recognition rates on the three real data sets of BCI competitions, which are 91.67%, 85.07%, and 82.04%, respectively. Capped L21-norm-based common spatial patterns-a robust model for EEG signals classification.
Collapse
Affiliation(s)
- Jingyu Gu
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China
| | - Jiuchuan Jiang
- School of Information Engineering, Nanjing University of Finance and Economics, Nanjing, 210003, Jiangsu, People's Republic of China
| | - Sheng Ge
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China
| | - Haixian Wang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China.
| |
Collapse
|
2
|
Sun J, Wang H, Jiang J. Euler common spatial pattern modulated with cross-frequency coupling. Knowl Inf Syst 2022. [DOI: 10.1007/s10115-022-01750-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
|
3
|
Li C, Qi Y, Zhao D, Guo T, Bai L. F $F$‐norm two‐dimensional linear discriminant analysis and its application on face recognition. INT J INTELL SYST 2022. [DOI: 10.1002/int.22941] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
Affiliation(s)
- Chun‐Na Li
- Management School Hainan University Haikou China
| | - Yi‐Fan Qi
- Management School Hainan University Haikou China
| | - Da Zhao
- Management School Hainan University Haikou China
| | - Tingting Guo
- General Department of Communication and Navigation Satellite China Academy of Space Technology Beijing China
| | - Lan Bai
- School of Mathematics Inner Mongolia University Hohhot China
| |
Collapse
|
4
|
Sun J, Wei M, Luo N, Li Z, Wang H. Euler common spatial patterns for EEG classification. Med Biol Eng Comput 2022; 60:753-767. [PMID: 35064439 DOI: 10.1007/s11517-021-02488-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Accepted: 11/15/2021] [Indexed: 11/28/2022]
Abstract
The technique of common spatial patterns (CSP) is a widely used method in the field of feature extraction of electroencephalogram (EEG) signals. Motivated by the fact that a cosine distance can enlarge the distance between samples of different classes, we propose the Euler CSP (e-CSP) for the feature extraction of EEG signals, and it is then used for EEG classification. The e-CSP is essentially the conventional CSP with the Euler representation. It includes the following two stages: each sample value is first mapped into a complex space by using the Euler representation, and then the conventional CSP is performed in the Euler space. Thus, the e-CSP is equivalent to applying the Euler representation as a kernel function to the input of the CSP. It is computationally as straightforward as the CSP. However, it extracts more discriminative features from the EEG signals. Extensive experimental results illustrate the discrimination ability of the e-CSP.
Collapse
Affiliation(s)
- Jing Sun
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China.,Institute of Artificial Intelligence of Hefei Comprehensive National Science Center, Hefei, 230094, Anhui, People's Republic of China
| | - Mengting Wei
- Institute of Psychology, Chinese Academy of Sciences, Beijing, 100101, People's Republic of China
| | - Ning Luo
- Institute of Software, Chinese Academy of Sciences, Beijing, 100190, People's Republic of China
| | - Zhanli Li
- College of Computer Science and Technology, Xi'an University of Science and Technology, Xi'an, 710054, Shanxi, People's Republic of China
| | - Haixian Wang
- Key Laboratory of Child Development and Learning Science of Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, 210096, Jiangsu, People's Republic of China. .,Institute of Artificial Intelligence of Hefei Comprehensive National Science Center, Hefei, 230094, Anhui, People's Republic of China.
| |
Collapse
|
5
|
Fu L, Li Z, Ye Q, Yin H, Liu Q, Chen X, Fan X, Yang W, Yang G. Learning Robust Discriminant Subspace Based on Joint L₂,ₚ- and L₂,ₛ-Norm Distance Metrics. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 2022; 33:130-144. [PMID: 33180734 DOI: 10.1109/tnnls.2020.3027588] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Recently, there are many works on discriminant analysis, which promote the robustness of models against outliers by using L1- or L2,1-norm as the distance metric. However, both of their robustness and discriminant power are limited. In this article, we present a new robust discriminant subspace (RDS) learning method for feature extraction, with an objective function formulated in a different form. To guarantee the subspace to be robust and discriminative, we measure the within-class distances based on [Formula: see text]-norm and use [Formula: see text]-norm to measure the between-class distances. This also makes our method include rotational invariance. Since the proposed model involves both [Formula: see text]-norm maximization and [Formula: see text]-norm minimization, it is very challenging to solve. To address this problem, we present an efficient nongreedy iterative algorithm. Besides, motivated by trace ratio criterion, a mechanism of automatically balancing the contributions of different terms in our objective is found. RDS is very flexible, as it can be extended to other existing feature extraction techniques. An in-depth theoretical analysis of the algorithm's convergence is presented in this article. Experiments are conducted on several typical databases for image classification, and the promising results indicate the effectiveness of RDS.
Collapse
|
6
|
Xia W, Wang S, Yang M, Gao Q, Han J, Gao X. Multi-view graph embedding clustering network: Joint self-supervision and block diagonal representation. Neural Netw 2021; 145:1-9. [PMID: 34710786 DOI: 10.1016/j.neunet.2021.10.006] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2021] [Revised: 08/25/2021] [Accepted: 10/04/2021] [Indexed: 11/18/2022]
Abstract
Multi-view clustering has become an active topic in artificial intelligence. Yet, similar investigation for graph-structured data clustering has been absent so far. To fill this gap, we present a Multi-View Graph embedding Clustering network (MVGC). Specifically, unlike traditional multi-view construction methods, which are only suitable to describe Euclidean structure data, we leverage Euler transform to augment the node attribute, as a new view descriptor, for non-Euclidean structure data. Meanwhile, we impose block diagonal representation constraint, which is measured by the ℓ1,2-norm, on self-expression coefficient matrix to well explore the cluster structure. By doing so, the learned view-consensus coefficient matrix well encodes the discriminative information. Moreover, we make use of the learned clustering labels to guide the learnings of node representation and coefficient matrix, where the latter is used in turn to conduct the subsequent clustering. In this way, clustering and representation learning are seamlessly connected, with the aim to achieve better clustering performance. Extensive experimental results indicate that MVGC is superior to 11 state-of-the-art methods on four benchmark datasets. In particular, MVGC achieves an Accuracy of 96.17% (53.31%) on the ACM (IMDB) dataset, which is an up to 2.85% (1.97%) clustering performance improvement compared with the strongest baseline.
Collapse
Affiliation(s)
- Wei Xia
- State Key Laboratory of Integrated Services Networks, Xidian University, Shaanxi 710071, China
| | - Sen Wang
- Beijing Aerospace Automatic Control Institute, Beijing 100854, China
| | - Ming Yang
- Departments of Mathematics and Computer & Information Science, Westfield State University, Westfield, MA 01086, United States of America
| | - Quanxue Gao
- State Key Laboratory of Integrated Services Networks, Xidian University, Shaanxi 710071, China.
| | - Jungong Han
- Computer Science Department, Aberystwyth University, SY23 3FL, United Kingdom
| | - Xinbo Gao
- Chongqing Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications, Chongqing 400065, China
| |
Collapse
|
7
|
|
8
|
Zhou G, Xu G, Hao J, Chen S, Xu J, Zheng X. Generalized Centered 2-D Principal Component Analysis. IEEE TRANSACTIONS ON CYBERNETICS 2021; 51:1666-1677. [PMID: 31425137 DOI: 10.1109/tcyb.2019.2931957] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Most existing robust principal component analysis (PCA) and 2-D PCA (2DPCA) methods involving the l2 -norm can mitigate the sensitivity to outliers in the domains of image analysis and pattern recognition. However, existing approaches neither preserve the structural information of data in the optimization objective nor have the robustness of generalized performance. To address the above problems, we propose two novel center-weight-based models, namely, centered PCA (C-PCA) and generalized centered 2DPCA with l2,p -norm minimization (GC-2DPCA), which are developed for vector- and matrix-based data, respectively. The C-PCA can preserve the structural information of data by measuring the similarity between the data points and can also retain the PCA's original desirable properties such as the rotational invariance. Furthermore, GC-2DPCA can learn efficient and robust projection matrices to suppress outliers by utilizing the variations between each row of the image matrix and employing power p of l2,1 -norm. We also propose an efficient algorithm to solve the C-PCA model and an iterative optimization algorithm to solve the GC-2DPCA model, and we theoretically analyze their convergence properties. Experiments on three public databases show that our models yield significant improvements over the state-of-the-art PCA and 2DPCA approaches.
Collapse
|
9
|
|
10
|
Preeti, Bala R, Dagar A, Singh RP. A novel online sequential extreme learning machine with L2,1-norm regularization for prediction problems. APPL INTELL 2020. [DOI: 10.1007/s10489-020-01890-2] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
11
|
Gao Q, Wan Z, Liang Y, Wang Q, Liu Y, Shao L. Multi-view projected clustering with graph learning. Neural Netw 2020; 126:335-346. [DOI: 10.1016/j.neunet.2020.03.020] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2019] [Revised: 01/14/2020] [Accepted: 03/23/2020] [Indexed: 10/24/2022]
|
12
|
Hyperspectral image denoising via minimizing the partial sum of singular values and superpixel segmentation. Neurocomputing 2019. [DOI: 10.1016/j.neucom.2018.11.039] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|