Classification of hand movements from EEG using a FusionNet based LSTM network

Objective. Accurate classification of electroencephalogram (EEG) signals is crucial for advancing brain-computer interface (BCI) technology. However, current methods face significant challenges in classifying hand movement EEG signals, including effective spatial feature extraction, capturing temporal dependencies, and representing underlying signal dynamics.Approach. This paper introduces a novel multi-model fusion approach, FusionNet-Long Short-Term Memory (LSTM), designed to address these issues. Specifically, it integrates Convolutional Neural Networks for spatial feature extraction, Gated Recurrent Units and LSTM networks for capturing temporal dependencies, and Autoregressive (AR) models for representing signal dynamics.Main results. Compared to single models and state-of-the-art methods, this fusion approach demonstrates substantial improvements in classification accuracy. Experimental results show that the proposed model achieves an accuracy of 87.1% in cross-subject data classification and 99.1% in within-subject data classification. Additionally, Gradient Boosting Trees were employed to evaluate the significance of various EEG features to the model.Significance. This study highlights the advantages of integrating multiple models and introduces a superior classification model, which is pivotal for the advancement of BCI systems.

Filter Bank-Driven Multivariate Synchronization Index for Training-Free SSVEP BCI

In recent years, multivariate synchronization index (MSI) algorithm, as a novel frequency detection method, has attracted increasing attentions in the study of brain-computer interfaces (BCIs) based on steady state visual evoked potential (SSVEP). However, MSI algorithm is hard to fully exploit SSVEP-related harmonic components in the electroencephalogram (EEG), which limits the application of MSI algorithm in BCI systems. In this paper, we propose a novel filter bank-driven MSI algorithm (FBMSI) to overcome the limitation and further improve the accuracy of SSVEP recognition. We evaluate the efficacy of the FBMSI method by developing a 6-command SSVEP-NAO robot system with extensive experimental analyses. An offline experimental study is first performed with EEG collected from nine subjects to investigate the effects of varying parameters on the model performance. Offline results show that the proposed method has achieved a stable improvement effect. We further conduct an online experiment with six subjects to assess the efficacy of the developed FBMSI algorithm in a real-time BCI application. The online experimental results show that the FBMSI algorithm yields a promising average accuracy of 83.56% using a data length of even only one second, which was 12.26% higher than the standard MSI algorithm. These extensive experimental results confirmed the effectiveness of the FBMSI algorithm in SSVEP recognition and demonstrated its potential application in the development of improved BCI systems.

Estimating aortic thoracic aneurysm rupture risk using tension-strain data in physiological pressure range: an in vitro study

Previous studies have shown that the rupture properties of an ascending thoracic aortic aneurysm (ATAA) are strongly correlated with the pre-rupture response features. In this work, we present a two-step machine learning method to predict where the rupture is likely to occur in ATAA and what safety reserve the structure may have. The study was carried out using ATAA specimens from 15 patients who underwent surgical intervention. Through inflation test, full-field deformation data and post-rupture images were collected, from which the wall tension and surface strain distributions were computed. The tension-strain data in the pressure range of 9-18 kPa were fitted to a third-order polynomial to characterize the response properties. It is hypothesized that the region where rupture is prone to initiate is associated with a high level of tension buildup. A machine learning method is devised to predict the peak risk region. The predicted regions were found to match the actual rupture sites in 13 samples out of the total 15. In the second step, another machine learning model is utilized to predict the tissue's rupture strength in the peak risk region. Results suggest that the ATAA rupture risk can be reasonably predicted using tension-strain response in the physiological range. This may open a pathway for evaluating the ATAA rupture propensity using information of in vivo response.

Filter bank temporally local canonical correlation analysis for short time window SSVEPs classification

Canonical correlation analysis (CCA) method and its extended methods have been widely and successfully applied to the frequency recognition in SSVEP-based BCI systems. As a state-of-the-art extended method, filter bank canonical correlation analysis has higher accuracy and information transmission rate (ITR) than CCA. However, in the CCA method, the temporally local structure of samples has not been well considered. In this correspondence, we proposed termed temporally local canonical correlation analysis (TCCA). In this new method, the original covariance matrix was replaced by the temporally local covariance matrix. Furthermore, we proposed an improved frequency identification method of filter bank based on TCCA, named filter bank temporally local canonical correlation analysis (FBTCCA). In the offline environment, we used a leave-one-subject-out validation strategy on datasets of ten testees to optimize the parameters of TCCA and FBTCCA and evaluate the two algorithms. The experimental results affirm that TCCA markedly outperformed CCA, and FBTCCA obtained the highest accuracy among the four methods. This study corroborates that TCCA-based approaches have great potential for implementing short time window SSVEP-based BCI systems.

Robust frequency recognition for SSVEP-based BCI with temporally local multivariate synchronization index

Multivariate synchronization index (MSI) has been proved to be an efficient method for frequency recognition in SSVEP-BCI systems. It measures the correlation according to the entropy of the normalized eigenvalues of the covariance matrix of multichannel signals. In the MSI method, the estimation of covariance matrix omits the temporally local structure of samples. In this study, a new spatio-temporal method, termed temporally local MSI (TMSI), was presented. This new method explicitly exploits temporally local information in modelling the covariance matrix. In order to evaluate the performance of the TMSI, we performs a comparison between the two methods on the real SSVEP datasets from eleven subjects. The results show that the TMSI outperforms the standard MSI. TMSI benefits from exploiting the temporally local structure of EEG signals, and could be a potential method for robust performance of SSVEP-based BCI.

Regularized common spatial patterns with subject-to-subject transfer of EEG signals

In the context of brain-computer interface (BCI) system, the common spatial patterns (CSP) method has been used to extract discriminative spatial filters for the classification of electroencephalogram (EEG) signals. However, the classification performance of CSP typically deteriorates when a few training samples are collected from a new BCI user. In this paper, we propose an approach that maintains or improves the recognition accuracy of the system with only a small size of training data set. The proposed approach is formulated by regularizing the classical CSP technique with the strategy of transfer learning. Specifically, we incorporate into the CSP analysis inter-subject information involving the same task, by minimizing the difference between the inter-subject features. Experimental results on two data sets from BCI competitions show that the proposed approach greatly improves the classification performance over that of the conventional CSP method; the transformed variant proved to be successful in almost every case, based on a small number of available training samples.

Review of Sparse Representation-Based Classification Methods on EEG Signal Processing for Epilepsy Detection, Brain-Computer Interface and Cognitive Impairment

At present, the sparse representation-based classification (SRC) has become an important approach in electroencephalograph (EEG) signal analysis, by which the data is sparsely represented on the basis of a fixed dictionary or learned dictionary and classified based on the reconstruction criteria. SRC methods have been used to analyze the EEG signals of epilepsy, cognitive impairment and brain computer interface (BCI), which made rapid progress including the improvement in computational accuracy, efficiency and robustness. However, these methods have deficiencies in real-time performance, generalization ability and the dependence of labeled sample in the analysis of the EEG signals. This mini review described the advantages and disadvantages of the SRC methods in the EEG signal analysis with the expectation that these methods can provide the better tools for analyzing EEG signals.

Abnormal dynamics of EEG oscillations in schizophrenia patients on multiple time scales

Neuronal oscillations reflect the activity of neuronal ensembles engaged in integrative cognition, and may serve as a functional measure for the cognitive impairment in schizophrenia. This study aims to reveal the abnormal amplitude dynamics of electroencephalogram (EEG) oscillations in schizophrenia patients on multiple time scales. EEGs were recorded from schizophrenia patients ( n = 19) and healthy controls ( n = 16) while they were at resting state with eyes closed, at resting state with eyes open, and at watching video. Detrended fluctuation analysis and measures of life-time and waiting-time were used to characterize the abnormal dynamics of EEG oscillations on both long (1-20 s) and short (≤1 s) time scales. Abnormal dynamics of EEG oscillations in alpha and beta bands were observed. In particular, compared with healthy controls, schizophrenia patients have smaller DFA exponent (implying weaker long-range temporal correlation) in the left fronto-temporal area and smaller DFA exponent, smaller life-time (indicating shorter oscillation burst), and smaller waiting-time in the occipital area in beta band at resting state with eyes open. In addition, schizophrenia patients have larger DFA exponent, larger life-time, and larger waiting-time at some clustered channels in the temporo-parietal area in alpha band at watching video. The present results provide new insights for cognitive deficits and the underlying neuronal dysfunction in schizophrenia.

The synergy between complex channel-specific FIR filter and spatial filter for single-trial EEG classification

The common spatial pattern analysis (CSP), a frequently utilized feature extraction method in brain-computer-interface applications, is believed to be time-invariant and sensitive to noises, mainly due to an inherent shortcoming of purely relying on spatial filtering. Therefore, temporal/spectral filtering which can be very effective to counteract the unfavorable influence of noises is usually used as a supplement. This work integrates the CSP spatial filters with complex channel-specific finite impulse response (FIR) filters in a natural and intuitive manner. Each hybrid spatial-FIR filter is of high-order, data-driven and is unique to its corresponding channel. They are derived by introducing multiple time delays and regularization into conventional CSP. The general framework of the method follows that of CSP but performs better, as proven in single-trial classification tasks like event-related potential detection and motor imagery.