1
|
N GR, Guha D, Mahadevappa M. EEG Artifact Removal using Stacked Multi-Head Attention Transformer Architecture. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-6. [PMID: 40039452 DOI: 10.1109/embc53108.2024.10782044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
This study presents a transformer attention model with stacked multi-head attention layer designed to remove noise from electroencephalogram (EEG) signals, specifically addressing the problem of signal distortion caused by artifacts such as ocular and muscular noise. This is a crucial step in improving the efficacy of EEG, for disease diagnostics and BCI applications. Deep learning (DL) models have been increasingly employed for denoising EEG data in recent years, demonstrating comparable performance to classical approaches. However, the current models have been unsuccessful in capturing temporal long-term dependencies to efficiently eliminating ocular and muscular abnormalities. In this study, we address those challenges faced in the DL models by introducing multiple multi-head attention layers in the transformer model, which surpass the performance measures of previous works in EEGdenoiseNet dataset.
Collapse
|
2
|
Lei D, Dong C, Guo H, Ma P, Liu H, Bao N, Kang H, Chen X, Wu Y. A fused multi-subfrequency bands and CBAM SSVEP-BCI classification method based on convolutional neural network. Sci Rep 2024; 14:8616. [PMID: 38616204 PMCID: PMC11016546 DOI: 10.1038/s41598-024-59348-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2024] [Accepted: 04/09/2024] [Indexed: 04/16/2024] Open
Abstract
For the brain-computer interface (BCI) system based on steady-state visual evoked potential (SSVEP), it is difficult to obtain satisfactory classification performance for short-time window SSVEP signals by traditional methods. In this paper, a fused multi-subfrequency bands and convolutional block attention module (CBAM) classification method based on convolutional neural network (CBAM-CNN) is proposed for discerning SSVEP-BCI tasks. This method extracts multi-subfrequency bands SSVEP signals as the initial input of the network model, and then carries out feature fusion on all feature inputs. In addition, CBAM is embedded in both parts of the initial input and feature fusion for adaptive feature refinement. To verify the effectiveness of the proposed method, this study uses the datasets of Inner Mongolia University of Technology (IMUT) and Tsinghua University (THU) to evaluate the performance of the proposed method. The experimental results show that the highest accuracy of CBAM-CNN reaches 0.9813 percentage point (pp). Within 0.1-2 s time window, the accuracy of CBAM-CNN is 0.0201-0.5388 (pp) higher than that of CNN, CCA-CWT-SVM, CCA-SVM, CCA-GNB, FBCCA, and CCA. Especially in the short-time window range of 0.1-1 s, the performance advantage of CBAM-CNN is more significant. The maximum information transmission rate (ITR) of CBAM-CNN is 503.87 bit/min, which is 227.53 bit/min-503.41 bit/min higher than the above six EEG decoding methods. The study further results show that CBAM-CNN has potential application value in SSVEP decoding.
Collapse
Affiliation(s)
- Dongyang Lei
- College of Electric Power, Inner Mongolia University of Technology, Hohhot, 010080, China
- Intelligent Energy Technology and Equipment Engineering Research Centre of Colleges and Universities in Inner Mongolia Autonomous Region, Hohhot, 010051, China
| | - Chaoyi Dong
- College of Electric Power, Inner Mongolia University of Technology, Hohhot, 010080, China.
- Intelligent Energy Technology and Equipment Engineering Research Centre of Colleges and Universities in Inner Mongolia Autonomous Region, Hohhot, 010051, China.
- Engineering Research Center of Large Energy Storage Technology, Ministry of Education, Hohhot, 010080, China.
- Inner Mongolia Academy of Science and Technology, Hohhot, 010010, China.
| | - Hongfei Guo
- Inner Mongolia Academy of Science and Technology, Hohhot, 010010, China.
| | - Pengfei Ma
- College of Electric Power, Inner Mongolia University of Technology, Hohhot, 010080, China
- Intelligent Energy Technology and Equipment Engineering Research Centre of Colleges and Universities in Inner Mongolia Autonomous Region, Hohhot, 010051, China
| | - Huanzi Liu
- College of Electric Power, Inner Mongolia University of Technology, Hohhot, 010080, China
- Intelligent Energy Technology and Equipment Engineering Research Centre of Colleges and Universities in Inner Mongolia Autonomous Region, Hohhot, 010051, China
| | - Naqin Bao
- College of Electric Power, Inner Mongolia University of Technology, Hohhot, 010080, China
- Intelligent Energy Technology and Equipment Engineering Research Centre of Colleges and Universities in Inner Mongolia Autonomous Region, Hohhot, 010051, China
| | - Hongzhuo Kang
- College of Electric Power, Inner Mongolia University of Technology, Hohhot, 010080, China
- Intelligent Energy Technology and Equipment Engineering Research Centre of Colleges and Universities in Inner Mongolia Autonomous Region, Hohhot, 010051, China
| | - Xiaoyan Chen
- College of Electric Power, Inner Mongolia University of Technology, Hohhot, 010080, China
- Intelligent Energy Technology and Equipment Engineering Research Centre of Colleges and Universities in Inner Mongolia Autonomous Region, Hohhot, 010051, China
- Engineering Research Center of Large Energy Storage Technology, Ministry of Education, Hohhot, 010080, China
- Inner Mongolia Academy of Science and Technology, Hohhot, 010010, China
| | - Yi Wu
- Inner Mongolia Academy of Science and Technology, Hohhot, 010010, China
| |
Collapse
|
3
|
Xiong X, Sun Z, Wang A, Zhang J, Zhang J, Wang C, He J. Research on Ocular Artifacts Removal from Single-Channel Electroencephalogram Signals in Obstructive Sleep Apnea Patients Based on Support Vector Machine, Improved Variational Mode Decomposition, and Second-Order Blind Identification. SENSORS (BASEL, SWITZERLAND) 2024; 24:1642. [PMID: 38475177 DOI: 10.3390/s24051642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/12/2024] [Revised: 02/28/2024] [Accepted: 02/29/2024] [Indexed: 03/14/2024]
Abstract
The electroencephalogram (EEG) has recently emerged as a pivotal tool in brain imaging analysis, playing a crucial role in accurately interpreting brain functions and states. To address the problem that the presence of ocular artifacts in the EEG signals of patients with obstructive sleep apnea syndrome (OSAS) severely affects the accuracy of sleep staging recognition, we propose a method that integrates a support vector machine (SVM) with genetic algorithm (GA)-optimized variational mode decomposition (VMD) and second-order blind identification (SOBI) for the removal of ocular artifacts from single-channel EEG signals. The SVM is utilized to identify artifact-contaminated segments within preprocessed single-channel EEG signals. Subsequently, these signals are decomposed into variational modal components across different frequency bands using the GA-optimized VMD algorithm. These components undergo further decomposition via the SOBI algorithm, followed by the computation of their approximate entropy. An approximate entropy threshold is set to identify and remove components laden with ocular artifacts. Finally, the signal is reconstructed using the inverse SOBI and VMD algorithms. To validate the efficacy of our proposed method, we conducted experiments utilizing both simulated data and real OSAS sleep EEG data. The experimental results demonstrate that our algorithm not only effectively mitigates the presence of ocular artifacts but also minimizes EEG signal distortion, thereby enhancing the precision of sleep staging recognition based on the EEG signals of OSAS patients.
Collapse
Affiliation(s)
- Xin Xiong
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
| | - Zhiran Sun
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
| | - Aikun Wang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
| | - Jiancong Zhang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
| | - Jing Zhang
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
| | - Chunwu Wang
- College of Physics and Electronic Engineering, Hanshan Normal University, Chaozhou 521041, China
| | - Jianfeng He
- Faculty of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China
| |
Collapse
|
4
|
Gao W, Liu D, Wang Q, Zhao Y, Sun J. FBLPF-ABOW: An Effective Method for Blink Artifact Removal in Single-Channel EEG Signal. IEEE J Biomed Health Inform 2023; 27:5722-5733. [PMID: 37695963 DOI: 10.1109/jbhi.2023.3314197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/13/2023]
Abstract
OBJECTIVE The latest development in low-cost single-channel Electroencephalography (EEG) devices is gaining widespread attention because it reduces hardware complexity. Discrete wavelet transform (DWT) has been a popular solution to eliminate the blink artifacts in EEG signals. However, the existing DWT-based methods share the same wavelet function among subjects, which ignores the individual difference. To remedy this deficiency, this article proposes a novel approach to eliminate the blink artifacts in single-channel EEG signals. METHODS Firstly, the forward-backward low-pass filter (FBLPF) and a fixed-length window are used to detect blink artifact intervals. Secondly, the adaptive bi-orthogonal wavelet (ABOW) is constructed based on the most representative blink signal. Thirdly, these detected signals are filtered by ABOW-DWT. The DWT's decomposition depth is automatically chosen by a similarity-based method. RESULTS Compared to eight state-of-the-art methods, experiments on semi-simulated and real EEG signals demonstrate the proposed method's superiority in removing the blink artifacts with less neural information loss. SIGNIFICANCE To filter the blink artifacts in single-channel EEG signals, the innovative idea of constructing an adaptive wavelet function based on the signal characteristics rather than using the conventional wavelet is proposed for the first time.
Collapse
|
5
|
Chaddad A, Wu Y, Kateb R, Bouridane A. Electroencephalography Signal Processing: A Comprehensive Review and Analysis of Methods and Techniques. SENSORS (BASEL, SWITZERLAND) 2023; 23:6434. [PMID: 37514728 PMCID: PMC10385593 DOI: 10.3390/s23146434] [Citation(s) in RCA: 24] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Revised: 06/16/2023] [Accepted: 07/13/2023] [Indexed: 07/30/2023]
Abstract
The electroencephalography (EEG) signal is a noninvasive and complex signal that has numerous applications in biomedical fields, including sleep and the brain-computer interface. Given its complexity, researchers have proposed several advanced preprocessing and feature extraction methods to analyze EEG signals. In this study, we analyze a comprehensive review of numerous articles related to EEG signal processing. We searched the major scientific and engineering databases and summarized the results of our findings. Our survey encompassed the entire process of EEG signal processing, from acquisition and pretreatment (denoising) to feature extraction, classification, and application. We present a detailed discussion and comparison of various methods and techniques used for EEG signal processing. Additionally, we identify the current limitations of these techniques and analyze their future development trends. We conclude by offering some suggestions for future research in the field of EEG signal processing.
Collapse
Affiliation(s)
- Ahmad Chaddad
- School of Artificial Intelligence, Guilin University of Electronic Technology, Guilin 541004, China
- The Laboratory for Imagery, Vision and Artificial Intelligence, Ecole de Technologie Supérieure, Montreal, QC H3C 1K3, Canada
| | - Yihang Wu
- School of Artificial Intelligence, Guilin University of Electronic Technology, Guilin 541004, China
| | - Reem Kateb
- College of Computer Science and Engineering, Taibah University, Madinah 41477, Saudi Arabia
| | - Ahmed Bouridane
- Centre for Data Analytics and Cybersecurity, University of Sharjah, Sharjah 27272, United Arab Emirates
| |
Collapse
|
6
|
Gao X, Zhang S, Liu K, Tan Z, Zhao G, Han Y, Cheng Y, Li C, Li F, Tian Y, Li P. An Adaptive Joint CCA-ICA Method for Ocular Artifact Removal and its Application to Emotion Classification. J Neurosci Methods 2023; 390:109841. [PMID: 36948359 DOI: 10.1016/j.jneumeth.2023.109841] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2023] [Revised: 03/10/2023] [Accepted: 03/19/2023] [Indexed: 03/24/2023]
Abstract
BACKGROUND The quality of Electroencephalogram (EEG) signals is critical for revealing the neural mechanism of emotions. However, ocular artifacts decreased the signal to noise ratio (SNR) and covered the inherent cognitive component of EEGs, which pose a great challenge in neuroscience research. NEW METHOD We proposed a novel unsupervised learning algorithm to adaptively remove the ocular artifacts by combining canonical correlation analysis (CCA), independent component analysis (ICA), higher-order statistics, empirical mode decomposition (EMD), and wavelet denoising techniques. Specifically, the combination of CCA and ICA aimed to improve the quality of source separation, while the higher-order statistics further located the source of ocular artifacts. Subsequently, these noised sources were further corrected by EMD and wavelet denoising to improve SNR of EEG signals. RESULTS We evaluated the performance of our proposed method with simulation studies and real EEG applications. The results of simulation study showed our proposed method could significantly improve the quality of signals under almost all noise conditions compared to four state-of-art methods. Consistently, the experiments of real EEG applications showed that the proposed methods could efficiently restrict the components of ocular artifacts and preserve the inherent information of cognition processing to improve the reliability of related analysis such as power spectral density (PSD) and emotion recognition. COMPARISON WITH EXISTING METHODS Our proposed model outperforms the comparative methods in EEG recovery, which further improve the application performance such as PSD analysis and emotion recognition. CONCLUSIONS The superior performance of our proposed method suggests that it is promising for removing ocular artifacts from EEG signals, which offers an efficient EEG preprocessing technology for the development of brain computer interface such as emotion recognition.
Collapse
Affiliation(s)
- Xiaohui Gao
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications
| | - Shilai Zhang
- the Clinical Hospital of Chengdu Brain Science In-stitute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, China
| | - Ke Liu
- the Chongqing University of Posts and Telecommunications Chongqing Key Laboratory of Computational Intelligence Chongqing, 400065, China
| | - Ziqin Tan
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications
| | - Guanyi Zhao
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications
| | - Yumeng Han
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications
| | - Yue Cheng
- the Key Laboratory of Intelligent Analysis and Decision on Complex Systems, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China
| | - Cunbo Li
- the Clinical Hospital of Chengdu Brain Science In-stitute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, China
| | - Fali Li
- the Clinical Hospital of Chengdu Brain Science In-stitute, MOE Key Lab for Neuroinformation and School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, 610054, China.
| | - Yin Tian
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications.
| | - Peiyang Li
- the School of Bioinformatics, Chongqing University of Posts and Telecommunications, Chongqing, 400065, China; Chongqing Institute for Brain and Intelligence, Guangyang Bay Laboratory, Chongqing 400064, China; Institute for Advanced Sciences, Chongqing University of Posts and Communications.
| |
Collapse
|