Cross-Subject Transfer Learning for Boosting Recognition Performance in SSVEP-Based BCIs

High-Frequency SSVEP-BCI With Row-Column Dual-Frequency Encoding and Decoding Strategy for Reduced Training Data

Steady-state visual evoked potentials (SSVEP)-based brain-computer interfaces (BCIs) have the potential to be utilized in various fields due to their high accuracies and information transfer rates (ITR). High-frequency (HF) visual stimuli have shown promise in reducing visual fatigue and enhancing user comfort. However, these HF-SSVEP-BCIs often face limitations in the number of commands and typically require extensive individual training data to achieve high performance. In this study, we proposed a row-column dual-frequency encoding and decoding method using HF stimulation to develop a comfortable BCI system that supports multiple commands and reduces training costs. We arranged 20 targets in a matrix of five rows and four columns, with each target modulated by left-and-right field stimulation using two frequency-phase combinations. Targets in each row or column share a unique frequency-phase combination, allowing EEG data from the same row or column to be used collectively to train a row/column index decoding model for target identification. To evaluate the performance of our method, we constructed a 20-target asynchronous robotic arm control system with the adaptive window method. With only four training trials per target, the online system achieved an ITR of 105.14 ± 14.15 bits/min, a true positive rate of 98.18 ± 2.87%, a false positive rate of 7.39 ± 6.73%, and a classification accuracy of 91.88 ± 5.75%, with an average data length of 925.70 ± 45.44 ms. These results indicate that the proposed protocol can deliver accurate and rapid command outputs for a comfortable SSVEP-based BCI with minimal training data and fewer frequencies.

Leveraging Transfer Superposition Theory for Stable-State Visual Evoked Potential Cross-Subject Frequency Recognition

In steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), various spatial filtering methods based on individual calibration data have been proposed to alleviate the interference of spontaneous activities in SSVEP signals for enhancing the SSVEP detection performance. However, the necessary calibration procedures take time, cause visual fatigue and reduce usability. For the calibration-free scenario, we propose a cross-subject frequency identification method based on transfer superimposed theory for SSVEP frequency decoding. First, a multi-channel signal decomposition model was constructed. Next, we used the cross least squares iterative method to create individual specific transfer spatial filters as well as source subject transfer superposition templates in the source subject. Then, we identified common knowledge among source subjects using a prototype spatial filter to make common transfer spatial filters and common impulse responses. Following, we reconstructed a global transfer superimposition template with SSVEP frequency characteristics. Finally, an ensemble cross-subject transfer learning method was proposed for SSVEP frequency recognition by combining the source-subject transfer mode, the global transfer mode, and the sine-cosine reference template. Offline tests on two public datasets show that the proposed method significantly outperforms the FBCCA, TTCCA, and CSSFT methods. More importantly, the proposed method can be directly used in online SSVEP recognition without calibration. The proposed algorithm was robust, which is important for a practical BCI.

Riemannian Locality Preserving Method for Transfer Learning With Applications on Brain-Computer Interface

Brain-computer interfaces (BCIs) have been widely focused and extensively studied in recent years for their huge prospect of medical rehabilitation and commercial applications. Transfer learning exploits the information in the source domain and applies in another different but related domain (target domain), and is therefore introduced into the BCIs to figure out the inter-subject variances of electroencephalography (EEG) signals. In this article, a novel transfer learning method is proposed to preserve the Riemannian locality of data structure in both the source and target domains and simultaneously realize the joint distribution adaptation of both domains to enhance the effectiveness of transfer learning. Specifically, a Riemannian graph is first defined and constructed based on the Riemannian distance to represent the Riemannian geometry information. To simultaneously align the marginal and conditional distribution of source and target domains and preserve the Riemannian locality of data structure in both domains, the Riemannian graph is embedded in the joint distribution adaptation (JDA) framework and forms the proposed Riemannian locality preserving-based transfer learning (RLPTL). To validate the effect of the proposed method, it is compared with several existing methods on two open motor imagery datasets, and both multi-source domains (MSD) and single-source domains (SSD) experiments are considered. Experimental results show that the proposed method achieves the highest accuracies in MSD and SSD experiments on three datasets and outperforms eight baseline methods, which demonstrates that the proposed method creates a feasible and efficient way to realize transfer learning.

Temporally Local Weighting-Based Phase-Locked Time-Shift Data Augmentation Method for Fast-Calibration SSVEP-BCI

Various training-based spatial filtering methods have been proposed to decode steady-state visual evoked potentials (SSVEPs) efficiently. However, these methods require extensive calibration data to obtain valid spatial filters and temporal templates. The time-consuming data collection and calibration process would reduce the practicality of SSVEP-based brain-computer interfaces (BCIs). Therefore, we propose a temporally local weighting-based phase-locked time-shift (TLW-PLTS) data augmentation method to augment training data for calculating valid spatial filters and temporal templates. In this method, the sliding window strategy using the SSVEP response period as a time-shift step is to generate the augmented data, and the time filter which maximises the temporally local covariance between the original template signal and the sine-cosine reference signal is used to suppress the temporal noise in the augmented data. For the performance evaluation, the TLW-PLTS method was incorporated with state-of-the-art training-based spatial filtering methods to calculate classification accuracies and information transfer rates (ITRs) using three SSVEP datasets. Compared with state-of-the-art training-based spatial filtering methods and other data augmentation methods, the proposed TLW-PLTS method demonstrates superior decoding performance with fewer calibration data, which is promising for the development of fast-calibration BCIs.

A Method of Cross-Subject Transfer Learning for Ultra Short Time SSVEP Classification

The steady-state visual evoked potentials (SSVEP) based brain-computer interfaces (BCIs) require extensive training data for efficient classification, but existing algorithms struggle with ultra short time inputs (less than 0.2 seconds), limiting the feasibility of real-time systems. This paper proposes a novel method CSA-GSDANN consisting of CSA and GSDANN. GSDANN improves SSVEP feature extraction performance in ultra short time input scenarios by applying cross-subject transfer learning techniques, combining a Global Attention Mechanism (GAM) and an optimized SSVEPNet and pre-training method CSA selects the most suitable source subject based on accuracy and aligns it with the target subject to address the inter-subject variability. The proposed CSA-GSDANN method adopts a Domain Adversarial Neural Network (DANN) framework, which integrates an enhanced SSVEPNet algorithm with an attention mechanism to extract features from electroencephalogram (EEG) data within and across subjects. The extracted features undergo domain-adversarial transfer learning. The final stage involves frequency signal classification using a constrained convolutional network. The evaluation of the CSA-GSDANN method on the IMUT dataset containing 12 subjects shows significant improvements. A comparative analysis against eight mainstream deep learning and traditional algorithms demonstrates an average accuracy enhancement of 4.23% and an average Information Transfer Rate (ITR) improvement of 50.482 bits/min compared to state-of-the-art classification algorithms under short time (0.2s) EEG inputs, substantially improving SSVEP classification performance.

Enhancing SSVEP Identification With Less Individual Calibration Data Using Periodically Repeated Component Analysis

OBJECTIVE

Spatial filtering and template matching-based steady-state visually evoked potentials (SSVEP) identification methods usually underperform in SSVEP identification with small-sample-size calibration data, especially when a single trial of data is available for each stimulation frequency.

METHODS

In contrast to the state-of-the-art task-related component analysis (TRCA)-based methods, which construct spatial filters and SSVEP templates based on the inter-trial task-related components in SSVEP, this study proposes a method called periodically repeated component analysis (PRCA), which constructs spatial filters to maximize the reproducibility across periods and constructs synthetic SSVEP templates by replicating the periodically repeated components (PRCs). We also introduced PRCs into two improved variants of TRCA. Performance evaluation was conducted in a self-collected 16-target dataset, a public 40-target dataset, and an online experiment.

RESULTS

The proposed methods show significant performance improvements with less training data and can achieve comparable performance to the baseline methods with 5 trials by using 2 or 3 training trials. Using a single trial of calibration data for each frequency, the PRCA-based methods achieved the highest average accuracies of over 95% and 90% with a data length of 1 s and maximum average information transfer rates (ITR) of 198.8±57.3 bits/min and 191.2±48.1 bits/min for the two datasets, respectively. Averaged online accuracy of 94.00 ± 7.35% and ITR of 139.73±21.04 bits/min were achieved with 0.5-s calibration data per frequency.

SIGNIFICANCE

Our results demonstrate the effectiveness and robustness of PRCA-based methods for SSVEP identification with reduced calibration effort and suggest its potential for practical applications in SSVEP-BCIs.

Enhancing SSVEP-BCI Performance Under Fatigue State Using Dynamic Stopping Strategy

Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have emerged as a prominent technology due to their high information transfer rate, rapid calibration time, and robust signal-to-noise ratio. However, a critical challenge for practical applications is performance degradation caused by user fatigue during prolonged use. This work proposes novel methods to address this challenge by dynamically adjusting data acquisition length and updating detection models based on a fatigue-aware stopping strategy. Two 16-target SSVEP-BCIs were employed, one using low-frequency and the other using high-frequency stimulation. A self-recorded fatigue dataset from 24 subjects was utilized for extensive evaluation. A simulated online experiment demonstrated that the proposed methods outperform the conventional fixed stopping strategy in terms of classification accuracy, information transfer rate, and selection time, irrespective of stimulation frequency. These findings suggest that the proposed approach can significantly improve SSVEP-BCI performance under fatigue conditions, leading to superior performance during extended use.

Phase-Locked Time-Shift Data Augmentation Method for SSVEP Brain-Computer Interfaces

Steady-state visual evoked potential (SSVEP) based brain-computer interfaces (BCIs) have achieved an information transfer rate (ITR) of over 300 bits/min, but abundant training data is required. The performance of SSVEP algorithms deteriorates greatly under limited data, and the existing time-shift data augmentation method fails to improve it because the phase-locked requirement between training samples is violated. To address this issue, this study proposes a novel augmentation method, namely phase-locked time-shift (PLTS), for SSVEP-BCI. The similarity between epochs at different time moments was evaluated, and a unique time-shift step was calculated for each class to augment additional data epochs in each trial. The results showed that the PLTS significantly improved the classification performance of SSVEP algorithms on the BETA SSVEP datasets. Moreover, under the condition of one calibration block, by slightly prolonging the calibration duration (from 48 s to 51.5 s), the ITR increased from 40.88±4.54 bits/min to 122.61±7.05 bits/min with the PLTS. This study provides a new perspective on augmenting data epochs for training-based SSVEP-BCI, promotes the classification accuracy and ITR under limited training data, and thus facilitates the real-life applications of SSVEP-based brain spellers.

SSVEP-Based Brain-Computer Interface Controlled Robotic Platform With Velocity Modulation

Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have been extensively studied due to many benefits, such as non-invasiveness, high information transfer rate, and ease of use. SSVEP-based BCI has been investigated in various applications by projecting brain signals to robot control commands. However, the movement direction and speed are generally fixed and prescribed, neglecting the user's requirement for velocity changes during practical implementations. In this study, we proposed a velocity modulation method based on stimulus brightness for controlling the robotic arm in the SSVEP-based BCI system. A stimulation interface was designed, incorporating flickers, target and a cursor workspace. The synchronization of the cursor and robotic arm does not require the subject's eye switch between the stimuli and the robot. The feature vector consists of the characteristics of the signal and the classification result. Subsequently, the Gaussian mixture model (GMM) and Bayesian inference were used to calculate the posterior probabilities that the signal came from a high or low brightness flicker. A brain-actuated speed function was designed by incorporating the posterior probability difference. Finally, the historical velocity was considered to determine the final velocity. To demonstrate the effectiveness of the proposed method, online experiments, including single- and multi-target reaching tasks, were conducted. The extensive experimental results validated the feasibility of the proposed method in reducing reaching time and achieving proximity to the target.

Cross-Subject Transfer Method Based on Domain Generalization for Facilitating Calibration of SSVEP-Based BCIs

In steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), various spatial filtering methods based on individual calibration data have been proposed to alleviate the interference of spontaneous activities in SSVEP signals for enhancing the SSVEP detection performance. However, the time-consuming calibration session would increase the visual fatigue of subjects and reduce the usability of the BCI system. The key idea of this study is to propose a cross-subject transfer method based on domain generalization, which transfers the domain-invariant spatial filters and templates learned from source subjects to the target subject with no access to the EEG data from the target subject. The transferred spatial filters and templates are obtained by maximizing the intra- and inter-subject correlations using the SSVEP data corresponding to the target and its neighboring stimuli. For SSVEP detection of the target subject, four types of correlation coefficients are calculated to construct the feature vector. Experimental results estimated with three SSVEP datasets show that the proposed cross-subject transfer method improves the SSVEP detection performance compared to state-of-art methods. The satisfactory results demonstrate that the proposed method provides an effective transfer learning strategy requiring no tedious data collection process for new users, holding the potential of promoting practical applications of SSVEP-based BCI.