1
|
Yang Y, Li M, Liu J. Generative Diffusion-Based Task Incremental Learning Method for Decoding Motor Imagery EEG. Brain Sci 2025; 15:98. [PMID: 40002431 PMCID: PMC11852499 DOI: 10.3390/brainsci15020098] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2024] [Revised: 01/16/2025] [Accepted: 01/18/2025] [Indexed: 02/27/2025] Open
Abstract
BACKGROUND/OBJECTIVES Motor neurorehabilitation can be realized by gradually learning diverse motor imagery (MI) tasks. EEG-based brain-computer interfaces (BCIs) provide an effective solution. Nevertheless, existing MI decoding methods cannot balance plasticity for unseen tasks and stability for old tasks. This paper proposes a generative diffusion-based task Incremental Learning (IL) method called GD-TIL. METHODS First, data augmentation is employed to increase data diversity by segmenting and recombining EEG signals. Second, to capture temporal-spatial features (TSFs) from different temporal resolutions, a multi-scale temporal-spatial feature extractor (MTSFE) is developed via integrating multiscale temporal-spatial convolutions, a dual-branch pooling operation, multiple multi-head self-attention mechanisms, and a dynamic convolutional encoder. The proposed self-supervised task generalization (SSTG) mechanism introduces a regularization constraint to guide MTSFE and unified classifier updating, which combines labels and semantic similarity between the augmentation with original views to enhance model generalizability for unseen tasks. In the IL phase, a prototype-guided generative replay module (PGGR) is used to generate old tasks' TSFs by training a lightweight diffusion model based on the prototype and label of each task. Furthermore, the generated TSF is merged with a new TSF to fine-tune the convolutional encoder and update the classifier and PGGR. Finally, GD-TIL is evaluated on a self-collected ADL-MI dataset with two MI pairs and a public dataset with four MI tasks. RESULTS The continuous decoding accuracy reaches 80.20% and 81.32%, respectively. The experimental results exhibit the excellent plasticity and stability of GD-TIL, even beating the state-of-the-art IL methods. CONCLUSIONS Our work illustrates the potential of MI-based BCI and generative AI for continuous neurorehabilitation.
Collapse
Affiliation(s)
- Yufei Yang
- School of Information Science and Technology, Beijing University of Technology, Beijing 100124, China; (Y.Y.); (J.L.)
| | - Mingai Li
- School of Information Science and Technology, Beijing University of Technology, Beijing 100124, China; (Y.Y.); (J.L.)
- Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing 100124, China
- Engineering Research Center of Digital Community, Ministry of Education, Beijing 100124, China
| | - Jianhang Liu
- School of Information Science and Technology, Beijing University of Technology, Beijing 100124, China; (Y.Y.); (J.L.)
| |
Collapse
|
2
|
Jia H, Yu S, Yin S, Liu L, Yi C, Xue K, Li F, Yao D, Xu P, Zhang T. A Model Combining Multi Branch Spectral-Temporal CNN, Efficient Channel Attention, and LightGBM for MI-BCI Classification. IEEE Trans Neural Syst Rehabil Eng 2023; 31:1311-1320. [PMID: 37022898 DOI: 10.1109/tnsre.2023.3243992] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/12/2023]
Abstract
Accurately decoding motor imagery (MI) brain-computer interface (BCI) tasks has remained a challenge for both neuroscience research and clinical diagnosis. Unfortunately, less subject information and low signal-to-noise ratio of MI electroencephalography (EEG) signals make it difficult to decode the movement intentions of users. In this study, we proposed an end-to-end deep learning model, a multi-branch spectral-temporal convolutional neural network with channel attention and LightGBM model (MBSTCNN-ECA-LightGBM), to decode MI-EEG tasks. We first constructed a multi branch CNN module to learn spectral-temporal domain features. Subsequently, we added an efficient channel attention mechanism module to obtain more discriminative features. Finally, LightGBM was applied to decode the MI multi-classification tasks. The within-subject cross-session training strategy was used to validate classification results. The experimental results showed that the model achieved an average accuracy of 86% on the two-class MI-BCI data and an average accuracy of 74% on the four-class MI-BCI data, which outperformed current state-of-the-art methods. The proposed MBSTCNN-ECA-LightGBM can efficiently decode the spectral and temporal domain information of EEG, improving the performance of MI-based BCIs.
Collapse
|
3
|
Multi-classification for EEG motor imagery signals using data evaluation-based auto-selected regularized FBCSP and convolutional neural network. Neural Comput Appl 2023. [DOI: 10.1007/s00521-023-08336-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/25/2023]
Abstract
AbstractIn recent years, there has been a renewal of interest in brain–computer interface (BCI). One of the BCI tasks is to classify the EEG motor imagery (MI). A great deal of effort has been made on MI classification. What seems to be lacking, however, is multiple MI classification. This paper develops a single-channel-based convolutional neural network to tackle multi-classification motor imagery tasks. For multi-classification, a single-channel learning strategy can extract effective information from each independent channel, making the information between adjacent channels not affect each other. A data evaluation method and a mutual information-based regularization parameters auto-selection algorithm are also proposed to generate effective spatial filters. The proposed method can be used to tackle the problem of an inaccurate mixed covariance matrix caused by fixed regularization parameters and invalid training data. To illustrate the merits of the proposed methods, we used the tenfold cross-validation accuracy and kappa as the evaluation measures to test two data sets. BCI4-2a and BCI3a data sets have four mental classes. For the BCI4-2a data set, the average accuracy is 79.01%, and the kappa is 0.7202 using data evaluation-based auto-selected filter bank regularized common spatial pattern voting (D-ACSP-V) and single-channel series convolutional neural network (SCS-CNN). Compared to traditional FBRCSP, the proposed method improved accuracy by 7.14% for the BCI4-2a data set. By using the BCI3a data set, the proposed method improved accuracy by 9.54% compared with traditional FBRCSP, the average accuracy of the proposed method is 83.70%, and the kappa is 0.7827.
Collapse
|
4
|
Rajesh Kumar DT, Mahalaxmi U, MM R, Bhatt DD. Optimization enabled deep residual neural network for motor imagery EEG signal classification. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
5
|
Performance Analysis of Ovarian Cancer Detection and Classification for Microarray Gene Data. BIOMED RESEARCH INTERNATIONAL 2022; 2022:6750457. [PMID: 35872866 PMCID: PMC9307352 DOI: 10.1155/2022/6750457] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 06/30/2022] [Indexed: 11/18/2022]
Abstract
The most common gynecologic cancer, behind cervical and uterine, is ovarian cancer. Ovarian cancer is a severe concern for women. Abnormal cells form and spread throughout the body. Ovarian cancer microarray data can diagnose and prognosis. Typically, ovarian cancer microarray data contains tens of thousands of genes. In order to reduce computational complexity, selecting the most critical genes or attributes in the entire dataset is necessary. Because microarray datasets have limited samples and many characteristics, classifier detection lags. So, dimensionality reduction measures are essential to protect disease classification genes. In this research, initially the ANOVA method is used for gene selection and then two clustering-based and three transform-based feature extraction methods, namely, Fuzzy C Means, Softmax Discriminant Algorithm (SDA), Hilbert Transform, Fast Fourier Transform (FFT), and Discrete Cosine Transform (DCT), respectively, are used to select relevant genes further. Six classifiers further classify the features as normal and abnormal. The NLR classifier gives the highest accuracy for SDA features at 92%, and KNN gives the lowest accuracy of 55% for SDA, Hilbert, and DCT features. With correlation distance feature selection, the NLR classifier attains the lowest accuracy of 53%, and the highest accuracy of 88% is obtained by the GMM classifier.
Collapse
|
6
|
The Ensemble Machine Learning-Based Classification of Motor Imagery Tasks in Brain-Computer Interface. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:1970769. [PMID: 34795879 PMCID: PMC8595002 DOI: 10.1155/2021/1970769] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 09/30/2021] [Accepted: 10/25/2021] [Indexed: 12/02/2022]
Abstract
The Brain-Computer Interface (BCI) permits persons with impairments to interact with the real world without using the neuromuscular pathways. BCIs are based on artificial intelligence piloted systems. They collect brain activity patterns linked to the mental process and transform them into commands for actuators. The potential application of BCI systems is in the rehabilitation centres. In this context, a novel method is devised for automated identification of the Motor Imagery (MI) tasks. The contribution is an effective hybridization of the Multiscale Principal Component Analysis (MSPCA), Wavelet Packet Decomposition (WPD), statistical features extraction from subbands, and ensemble learning-based classifiers for categorization of the MI tasks. The intended electroencephalogram (EEG) signals are segmented and denoised. The denoising is achieved with a Daubechies algorithm-based wavelet transform (WT) incorporated in the MSPCA. The WT with the 5th level of decomposition is used. Onward, the Wavelet Packet Decomposition (WPD), with the 4th level of decomposition, is used for subbands formation. The statistical features are selected from each subband, namely, mean absolute value, average power, standard deviation, skewness, and kurtosis. Also, ratios of absolute mean values of adjacent subbands are computed and concatenated with other extracted features. Finally, the ensemble machine learning approach is used for the classification of MI tasks. The usefulness is evaluated by using the BCI competition III, MI dataset IVa. Results revealed that the suggested ensemble learning approach yields the highest classification accuracies of 98.69% and 94.83%, respectively, for the cases of subject-dependent and subject-independent problems.
Collapse
|
7
|
Li H, Fan K, Ma J, Wang B, Qiao X, Yan Y, Du W, Wang L. Massage Therapy's Effectiveness on the Decoding EEG Rhythms of Left/Right Motor Imagery and Motion Execution in Patients With Skeletal Muscle Pain. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE-JTEHM 2021; 9:2100320. [PMID: 33738147 PMCID: PMC7965939 DOI: 10.1109/jtehm.2021.3056911] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/15/2020] [Revised: 12/18/2020] [Accepted: 01/27/2021] [Indexed: 11/09/2022]
Abstract
Objective: Most of effectiveness assessments of the widely-used Massage therapy were based on subjective routine clinical assessment tools, such as Visual Analogue Scale (VAS) score. However, few studies demonstrated the impact of massage on the Electroencephalograph (EEG) rhythm decoding of Motor imagery (MI) and motion execution (ME) with trunk left/right bending in patients with skeletal muscle pain. Method: We used the sample entropy (SampEn), permutation entropy (PermuEn), common spatial pattern (CSP) features, support vector machine (SVM) and logic regression (LR) classifiers. We also used the convolutional neural network (CNN) and attention-based bi-directional long short-term memory (BiLSTM) for classification. Results: The averaged SampEn and PermuEn values of alpha rhythm decreased in almost fourteen channels for five statuses (quiet, MI with left/right bending, ME with left/right bending). It indicated that massage alleviates the pain for the patients of skeletal pain. Furthermore, compared with the SVM and LR classifiers, the BiLSTM method achieved a better area under curve (AUC) of 0.89 for the classification of MI with trunk left/right bending before massage. The AUC became smaller after massage than that before massage for the classification of MI with trunk left/right bending using CNN and BiLSTM methods. The Permutation direct indicator (PDI) score showed the significant difference for patients in different statuses (before vs after massage, and MI vs ME). Conclusions: Massage not only affects the quiet status, but also affects the MI and ME. Clinical Impact: Massage therapy may affect a bit on the accuracy of MI with trunk left/right bending and it change the topography of MI and ME with trunk left/right bending for the patients with skeletal muscle pain.
Collapse
Affiliation(s)
- Huihui Li
- Shenzhen Institute of Advanced TechnologyChinese Academy of SciencesShenzhen518055China
| | - Kai Fan
- North China Institute of Aerospace EngineeringLangfang065000China
| | - Junsong Ma
- School of Electronic Engineering and AutomationGuilin University of Electronic TechnologyGuilin541004China
| | - Bo Wang
- Electronic and Communication Engineering DepartmentWuhan University of TechnologyWuhan430070China
| | - Xiaohao Qiao
- Electronic and Communication Engineering DepartmentWuhan University of TechnologyWuhan430070China
| | - Yan Yan
- Shenzhen Institute of Advanced TechnologyChinese Academy of SciencesShenzhen518055China
| | - Wenjing Du
- Shenzhen Institute of Advanced TechnologyChinese Academy of SciencesShenzhen518055China
| | - Lei Wang
- Shenzhen Institute of Advanced TechnologyChinese Academy of SciencesShenzhen518055China
| |
Collapse
|
8
|
Gupta GS, Dave GB, Tripathi PR, Mohanta DK, Ghosh S, Sinha RK. Brain computer interface controlled automatic electric drive for neuro-aid system. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102175] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
9
|
2-[ 18F]FDG PET/CT radiomics in lung cancer: An overview of the technical aspect and its emerging role in management of the disease. Methods 2020; 188:84-97. [PMID: 32497604 DOI: 10.1016/j.ymeth.2020.05.023] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Revised: 05/22/2020] [Accepted: 05/27/2020] [Indexed: 12/15/2022] Open
Abstract
Lung cancer is the most common cancer, worldwide, and a major health issue with a remarkable mortality rate. 2-[18F]fluoro-2-deoxy-D-glucose positron emission tomography/computed tomography (2-[18F]FDG PET/CT) plays an indispensable role in the management of lung cancer patients. Long-established quantitative parameters such as size, density, and metabolic activity have been and are being employed in the current practice to enhance interpretation and improve diagnostic and prognostic value. The introduction of radiomics analysis revolutionized the quantitative evaluation of medical imaging, revealing data within images beyond visual interpretation. The "big data" are extracted from high-quality images and are converted into information that correlates to relevant genetic, pathologic, clinical, or prognostic features. Technically advanced, diverse methods have been implemented in different studies. The standardization of image acquisition, segmentation and features analysis is still a debated issue. Importantly, a body of features has been extracted and employed for diagnosis, staging, risk stratification, prognostication, and therapeutic response. 2-[18F]FDG PET/CT-derived features show promising value in non-invasively diagnosing the malignant nature of pulmonary nodules, differentiating lung cancer subtypes, and predicting response to different therapies as well as survival. In this review article, we aimed to provide an overview of the technical aspects used in radiomics analysis in non-small cell lung cancer (NSCLC) and elucidate the role of 2-[18F]FDG PET/CT-derived radiomics in the diagnosis, prognostication, and therapeutic response.
Collapse
|
10
|
|
11
|
Guan S, Zhao K, Yang S. Motor Imagery EEG Classification Based on Decision Tree Framework and Riemannian Geometry. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2019; 2019:5627156. [PMID: 30804988 PMCID: PMC6360593 DOI: 10.1155/2019/5627156] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/24/2018] [Revised: 12/20/2018] [Accepted: 01/03/2019] [Indexed: 11/30/2022]
Abstract
This paper proposes a novel classification framework and a novel data reduction method to distinguish multiclass motor imagery (MI) electroencephalography (EEG) for brain computer interface (BCI) based on the manifold of covariance matrices in a Riemannian perspective. For method 1, a subject-specific decision tree (SSDT) framework with filter geodesic minimum distance to Riemannian mean (FGMDRM) is designed to identify MI tasks and reduce the classification error in the nonseparable region of FGMDRM. Method 2 includes a feature extraction algorithm and a classification algorithm. The feature extraction algorithm combines semisupervised joint mutual information (semi-JMI) with general discriminate analysis (GDA), namely, SJGDA, to reduce the dimension of vectors in the Riemannian tangent plane. And the classification algorithm replaces the FGMDRM in method 1 with k-nearest neighbor (KNN), named SSDT-KNN. By applying method 2 on BCI competition IV dataset 2a, the kappa value has been improved from 0.57 to 0.607 compared to the winner of dataset 2a. And method 2 also obtains high recognition rate on the other two datasets.
Collapse
Affiliation(s)
- Shan Guan
- School of Mechanical Engineering, Northeast Electric Power University, 132012 Jilin, China
| | - Kai Zhao
- School of Mechanical Engineering, Northeast Electric Power University, 132012 Jilin, China
| | - Shuning Yang
- School of Mechanical Engineering, Northeast Electric Power University, 132012 Jilin, China
| |
Collapse
|
12
|
Sampanna R, Mitaim S. Noise benefits in the array of brain-computer interface classification systems. INFORMATICS IN MEDICINE UNLOCKED 2018. [DOI: 10.1016/j.imu.2018.07.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022] Open
|
13
|
Yang Y, Chevallier S, Wiart J, Bloch I. Subject-specific time-frequency selection for multi-class motor imagery-based BCIs using few Laplacian EEG channels. Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2017.06.016] [Citation(s) in RCA: 44] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
14
|
Khorshidtalab A, Salami MJ, Akmeliawati R. Motor imagery task classification using transformation based features. Biomed Signal Process Control 2017. [DOI: 10.1016/j.bspc.2016.12.006] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022]
|