1
|
Amin HU, Ullah R, Reza MF, Malik AS. Single-trial extraction of event-related potentials (ERPs) and classification of visual stimuli by ensemble use of discrete wavelet transform with Huffman coding and machine learning techniques. J Neuroeng Rehabil 2023; 20:70. [PMID: 37269019 DOI: 10.1186/s12984-023-01179-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Accepted: 04/19/2023] [Indexed: 06/04/2023] Open
Abstract
BACKGROUND Presentation of visual stimuli can induce changes in EEG signals that are typically detectable by averaging together data from multiple trials for individual participant analysis as well as for groups or conditions analysis of multiple participants. This study proposes a new method based on the discrete wavelet transform with Huffman coding and machine learning for single-trial analysis of evenal (ERPs) and classification of different visual events in the visual object detection task. METHODS EEG single trials are decomposed with discrete wavelet transform (DWT) up to the [Formula: see text] level of decomposition using a biorthogonal B-spline wavelet. The coefficients of DWT in each trial are thresholded to discard sparse wavelet coefficients, while the quality of the signal is well maintained. The remaining optimum coefficients in each trial are encoded into bitstreams using Huffman coding, and the codewords are represented as a feature of the ERP signal. The performance of this method is tested with real visual ERPs of sixty-eight subjects. RESULTS The proposed method significantly discards the spontaneous EEG activity, extracts the single-trial visual ERPs, represents the ERP waveform into a compact bitstream as a feature, and achieves promising results in classifying the visual objects with classification performance metrics: accuracies 93.60[Formula: see text], sensitivities 93.55[Formula: see text], specificities 94.85[Formula: see text], precisions 92.50[Formula: see text], and area under the curve (AUC) 0.93[Formula: see text] using SVM and k-NN machine learning classifiers. CONCLUSION The proposed method suggests that the joint use of discrete wavelet transform (DWT) with Huffman coding has the potential to efficiently extract ERPs from background EEG for studying evoked responses in single-trial ERPs and classifying visual stimuli. The proposed approach has O(N) time complexity and could be implemented in real-time systems, such as the brain-computer interface (BCI), where fast detection of mental events is desired to smoothly operate a machine with minds.
Collapse
Affiliation(s)
- Hafeez Ullah Amin
- School of Computer Science, Faculty of Science and Engineering, University of Nottingham, Jalan Broga, 43500, Semenyih, Malaysia
| | - Rafi Ullah
- Department of Computer and Information Sciences, Universiti Teknologi PETRONAS, 32610, Seri Iskandar, Malaysia
| | - Mohammed Faruque Reza
- Department of Neurosciences, School of Medical Sciences, Hospital Universiti Sains Malaysia, Kubang Kerian, 16150, Kota Bharu, Malaysia
| | - Aamir Saeed Malik
- Faculty of Information Technology, Brno University of Technology, Brno, Czech Republic.
| |
Collapse
|
2
|
Chen X, Xie H, Li Z, Cheng G, Leng M, Wang FL. Information fusion and artificial intelligence for smart healthcare: a bibliometric study. Inf Process Manag 2023. [DOI: 10.1016/j.ipm.2022.103113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
3
|
Dai P, Xiong T, Zhou X, Ou Y, Li Y, Kui X, Chen Z, Zou B, Li W, Huang Z, The Rest-Meta-Mdd Consortium. The alterations of brain functional connectivity networks in major depressive disorder detected by machine learning through multisite rs-fMRI data. Behav Brain Res 2022; 435:114058. [PMID: 35995263 DOI: 10.1016/j.bbr.2022.114058] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 08/07/2022] [Accepted: 08/10/2022] [Indexed: 11/27/2022]
Abstract
BACKGROUND The current diagnosis of major depressive disorder (MDD) is mainly based on the patient's self-report and clinical symptoms. Machine learning methods are used to identify MDD using resting-state functional magnetic resonance imaging (rs-fMRI) data. However, due to large site differences in multisite rs-fMRI data and the difficulty of sample collection, most of the current machine learning studies use small sample sizes of rs-fMRI datasets to detect the alterations of functional connectivity (FC) or network attribute (NA), which may affect the reliability of the experimental results. METHODS Multisite rs-fMRI data were used to increase the size of the sample, and then we extracted the functional connectivity (FC) and network attribute (NA) features from 1611 rs-fMRI data (832 patients with MDD (MDDs) and 779 healthy controls (HCs)). ComBat algorithm was used to harmonize the data variances caused by the multisite effect, and multivariate linear regression was used to remove age and sex covariates. Two-sample t-test and wrapper-based feature selection methods (support vector machine recursive feature elimination with cross-validation (SVM-RFECV) and LightGBM's "feature_importances_" function) were used to select important features. The Shapley additive explanations (SHAP) method was used to assign the contribution of features to the best classification effect model. RESULTS The best result was obtained from the LinearSVM model trained with the 136 important features selected by SVMRFE-CV. In the nested five-fold cross-validation (consisting of an outer and an inner loop of five-fold cross-validation) of 1611 data, the model achieved the accuracy, sensitivity, and specificity of 68.90 %, 71.75 %, and 65.84 %, respectively. The 136 important features were tested in a small dataset and obtained excellent classification results after balancing the ratio between patients with depression and HCs. CONCLUSIONS The combined use of FC and NA features is effective for classifying MDDs and HCs. The important FC and NA features extracted from the large sample dataset have some generalization performance and may be used as a reference for the altered brain functional connectivity networks in MDD.
Collapse
Affiliation(s)
- Peishan Dai
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
| | - Tong Xiong
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
| | - Xiaoyan Zhou
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
| | - Yilin Ou
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
| | - Yang Li
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
| | - Xiaoyan Kui
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
| | - Zailiang Chen
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
| | - Beiji Zou
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China.
| | - Weihui Li
- Department of Psychiatry, and National Clinical Research Center for Mental Disorders, The Second Xiangya Hospital of Central South University, Changsha, Hunan, China.
| | - Zhongchao Huang
- Department of Biomedical Engineering, School of Basic Medical Science, Central South University, Changsha, Hunan, China.
| | - The Rest-Meta-Mdd Consortium
- School of Computer Science and Engineering, Central South University, Changsha, Hunan, China; Department of Psychiatry, and National Clinical Research Center for Mental Disorders, The Second Xiangya Hospital of Central South University, Changsha, Hunan, China; Department of Biomedical Engineering, School of Basic Medical Science, Central South University, Changsha, Hunan, China
| |
Collapse
|
4
|
Yang B, Cao J, Zhou T, Dong L, Zou L, Xiang J. Exploration of Neural Activity under Cognitive Reappraisal Using Simultaneous EEG-fMRI Data and Kernel Canonical Correlation Analysis. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2018; 2018:3018356. [PMID: 30065778 PMCID: PMC6051320 DOI: 10.1155/2018/3018356] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/05/2018] [Accepted: 05/21/2018] [Indexed: 01/09/2023]
Abstract
BACKGROUND Neural activity under cognitive reappraisal can be more accurately investigated using simultaneous EEG- (electroencephalography) fMRI (functional magnetic resonance imaging) than using EEG or fMRI only. Complementary spatiotemporal information can be found from simultaneous EEG-fMRI data to study brain function. METHOD An effective EEG-fMRI fusion framework is proposed in this work. EEG-fMRI data is simultaneously sampled on fifteen visually stimulated healthy adult participants. Net-station toolbox and empirical mode decomposition are employed for EEG denoising. Sparse spectral clustering is used to construct fMRI masks that are used to constrain fMRI activated regions. A kernel-based canonical correlation analysis is utilized to fuse nonlinear EEG-fMRI data. RESULTS The experimental results show a distinct late positive potential (LPP, latency 200-700ms) from the correlated EEG components that are reconstructed from nonlinear EEG-fMRI data. Peak value of LPP under reappraisal state is smaller than that under negative state, however, larger than that under neutral state. For correlated fMRI components, obvious activation can be observed in cerebral regions, e.g., the amygdala, temporal lobe, cingulate gyrus, hippocampus, and frontal lobe. Meanwhile, in these regions, activated intensity under reappraisal state is obviously smaller than that under negative state and larger than that under neutral state. CONCLUSIONS The proposed EEG-fMRI fusion approach provides an effective way to study the neural activities of cognitive reappraisal with high spatiotemporal resolution. It is also suitable for other neuroimaging technologies using simultaneous EEG-fMRI data.
Collapse
Affiliation(s)
- Biao Yang
- School of Information Science and Engineering, Changzhou University, Changzhou, Jiangsu 213164, China
- Changzhou Key Laboratory of Biomedical Information Technology, Changzhou, Jiangsu 213164, China
| | - Jinmeng Cao
- School of Information Science and Engineering, Changzhou University, Changzhou, Jiangsu 213164, China
- Changzhou Key Laboratory of Biomedical Information Technology, Changzhou, Jiangsu 213164, China
| | - Tiantong Zhou
- School of Information Science and Engineering, Changzhou University, Changzhou, Jiangsu 213164, China
- Changzhou Key Laboratory of Biomedical Information Technology, Changzhou, Jiangsu 213164, China
| | - Li Dong
- School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, Sichuan 610054, China
| | - Ling Zou
- School of Information Science and Engineering, Changzhou University, Changzhou, Jiangsu 213164, China
- Changzhou Key Laboratory of Biomedical Information Technology, Changzhou, Jiangsu 213164, China
| | - Jianbo Xiang
- Changzhou No. 2 People's Hospital Affiliated with Nanjing Medical University, Changzhou, Jiangsu 213164, China
| |
Collapse
|