Frequency detection with stability coefficient for steady-state visual evoked potential (SSVEP)-based BCIs

RMKD: Relaxed matching knowledge distillation for short-length SSVEP-based brain-computer interfaces

Accurate decoding of electroencephalogram (EEG) signals in the shortest possible time is essential for the realization of a high-performance brain-computer interface (BCI) system based on the steady-state visual evoked potential (SSVEP). However, the degradation of decoding performance of short-length EEG signals is often unavoidable due to the reduced information, which hinders the development of BCI systems in real-world applications. In this paper, we propose a relaxed matching knowledge distillation (RMKD) method to transfer both feature-level and logit-level knowledge in a relaxed manner to improve the decoding performance of short-length EEG signals. Specifically, the long-length EEG signals and short-length EEG signals are decoded into the frequency representation by the teacher and student models, respectively. At the feature-level, the frequency-masked generation distillation is designed to improve the representation ability of student features by forcing the randomly masked student features to generate full teacher features. At the logit-level, the non-target class knowledge distillation and the inter-class relation distillation are combined to mitigate loss conflicts by imitating the distribution of non-target classes and preserve the inter-class relation in the prediction vectors of the teacher and student models. We conduct comprehensive experiments on two public SSVEP datasets in the subject-independent scenario with six different signal lengths. The extensive experimental results demonstrate that the proposed RMKD method has significantly improved the decoding performance of short-length EEG signals in SSVEP-based BCI systems.

Independent bilateral-eye stimulation for gaze pattern recognition based on steady-state pupil light reflex

Objective:recently, pupil oscillations synchronized with steady visual stimuli were used as input for an interface. The proposed system, inspired by a brain-computer interface based on steady-state visual evoked potentials, does not require contact with the participant. However, the pupil oscillation mechanism limits the stimulus frequency to 2.5 Hz or less, making it hard to enhance the information transfer rate (ITR).Approach:here, we compared multiple conditions for stimulation to increase the ITR of the pupil vibration-based interface, which were called monocular-single, monocular-superposed, and binocular-independent conditions. The binocular-independent condition stimulates each eye at different frequencies respectively and mixes them by using the visual stereoscopic perception of users. The monocular-superposed condition stimulates both eyes by a mixed signal of two different frequencies. We selected the shape of the stimulation signal, evaluated the amount of spectral leakage in the monocular-superposed and binocular-independent conditions, and compared the power spectrum density at the stimulation frequency. Moreover, 5, 10, and 15 patterns of stimuli were classified in each condition.Main results:a square wave, which causes an efficient pupil response, was used as the stimulus. Spectral leakage at the beat frequency was higher in the monocular-superposed condition than in the binocular-independent one. The power spectral density of stimulus frequencies was greatest in the monocular-single condition. Finally, we could classify the 15-stimulus pattern, with ITRs of 14.4 (binocular-independent, using five frequencies), 14.5 (monocular-superimposed, using five frequencies), and 23.7 bits min^-1(monocular-single, using 15 frequencies). There were no significant differences for the binocular-independent and monocular-superposed conditions.Significance:this paper shows a way to increase the number of stimuli that can be simultaneously displayed without decreasing ITR, even when only a small number of frequencies are available. This could lead to the provision of an interface based on pupil oscillation to a wider range of users.

An MVMD-CCA Recognition Algorithm in SSVEP-Based BCI and Its Application in Robot Control

This article proposes a novel recognition algorithm for the steady-state visual evoked potentials (SSVEP)-based brain-computer interface (BCI) system. By combining the advantages of multivariate variational mode decomposition (MVMD) and canonical correlation analysis (CCA), an MVMD-CCA algorithm is investigated to improve the detection ability of SSVEP electroencephalogram (EEG) signals. In comparison with the classical filter bank canonical correlation analysis (FBCCA), the nonlinear and non-stationary EEG signals are decomposed into a fixed number of sub-bands by MVMD, which can enhance the effect of SSVEP-related sub-bands. The experimental results show that MVMD-CCA can effectively reduce the influence of noise and EEG artifacts and improve the performance of SSVEP-based BCI. The offline experiments show that the average accuracies of MVMD-CCA in the training dataset and testing dataset are improved by 3.08% and 1.67%, respectively. In the SSVEP-based online robotic manipulator grasping experiment, the recognition accuracies of the four subjects are 92.5%, 93.33%, 90.83%, and 91.67%, respectively.

A Noninvasive BCI System for 2D Cursor Control Using a Spectral-Temporal Long Short-Term Memory Network

Two-dimensional cursor control is an important and challenging problem in the field of electroencephalography (EEG)-based brain computer interfaces (BCIs) applications. However, most BCIs based on categorical outputs are incapable of generating accurate and smooth control trajectories. In this article, a novel EEG decoding framework based on a spectral-temporal long short-term memory (stLSTM) network is proposed to generate control signals in the horizontal and vertical directions for accurate cursor control. Precisely, the spectral information is used to decode the subject's motor imagery intention, and the error-related P300 information is used to detect a deviation in the movement trajectory. The concatenated spectral and temporal features are fed into the stLSTM network and mapped to the velocities in vertical and horizontal directions of the 2D cursor under the velocity-constrained (VC) strategy, which enables the decoding network to fit the velocity in the imaginary direction and simultaneously suppress the velocity in the non-imaginary direction. This proposed framework was validated on a public real BCI control dataset. Results show that compared with the state-of-the-art method, the RMSE of the proposed method in the non-imaginary directions on the testing sets of 2D control tasks is reduced by an average of 63.45%. Besides, the visualization of the actual trajectories distribution of the cursor also demonstrates that the decoupling of velocity is capable of yielding accurate cursor control in complex path tracking tasks and significantly improves the control accuracy.

Optimal Approach for Signal Detection in Steady-State Visual Evoked Potentials in Humans Using Single-Channel EEG and Stereoscopic Stimuli

In EEG studies, one of the most common ways to detect a weak periodic signal in the steady-state visual evoked potential (SSVEP) is spectral evaluation, a process that detects peaks of power present at notable temporal frequencies. However, the presence of noise decreases the signal-to-noise ratio (SNR), which in turn lowers the probability of successful detection of these spectral peaks. In this paper, using a single EEG channel, we compare the detection performance of four different metrics to analyse the SSVEP: two metrics that use spectral power density, and two other metrics that use phase coherency. We employ these metrics find weak signals with a known temporal frequency hidden in the SSVEP, using both simulation and real data from a stereoscopic apparent depth movement perception task. We demonstrate that out of these metrics, the phase coherency analysis is the most sensitive way to find weak signals in the SSVEP, provided that the phase information of the stimulus eliciting the SSVEP is preserved.

Multiscale noise suppression and feature frequency extraction in SSVEP based on underdamped second-order stochastic resonance

OBJECTIVE

As one of the commonly used control signals of brain-computer interface (BCI), steady-state visual evoked potential (SSVEP) exhibits advantages of stability, periodicity and minimal training requirements. However, SSVEP retains the non-linear, non-stationary and low signal-to-noise ratio (SNR) characteristics of EEG. The traditional SSVEP extraction methods regard noise as harmful information and highlight the useful signal by suppressing the noise. In the collected EEG, noise and SSVEP are usually coupled together, the useful signal is inevitably attenuated while the noise is suppressed. Also, an additional band-pass filter is needed to eliminate the multi-scale noise, which causes the edge effect.

APPROACH

To address this issue, a novel method based on underdamped second-order stochastic resonance (USSR) is proposed in this paper for SSVEP extraction.

MAIN RESULTS

A synergistic effect produced by noise, useful signal and the nonlinear system can force the energy of noise to be transferred into SSVEP, and hence amplifying the useful signal while suppressing multi-scale noise. The recognition performances of detection are compared with the widely-used canonical coefficient analysis (CCA) and multivariate synchronization index (MSI).

SIGNIFICANCE

The comparison results indicate that USSR exhibits increased accuracy and faster processing speed, which effectively improves the information transmission rate (ITR) of SSVEP-based BCI.

SSVEP recognition by modeling brain activity using system identification based on Box-Jenkins model

The steady-state visual evoked potential (SSVEP) based brain-computer interface (BCI) has received increasing attention in recent years. The present study proposes a new method for recognition based on system identification. The method relies on modeling the electroencephalogram (EEG) signals using the Box-Jenkins model. In this approach, the recorded EEG signal is considered as a combination of an SSVEP signal evoked by periodic visual stimulation and a background EEG signal whose components are modeled by a moving average (MA) process and an auto-regressive moving average (ARMA) process, respectively. Then, the target frequency is determined by comparing the modeled SSVEP signals for all stimulation frequencies. The experimental results of the proposed method for recorded EEG signals from five subjects (each subject with four stimulation frequencies) demonstrated a significant improvement in the accuracy of the SSVEP recognition in contrast to canonical correlation analysis, least absolute shrinkage and selection operator, and multivariate linear regression methods. The proposed method exhibits enhanced accuracy especially for short data length and a small number of channels. This superiority suggests that the proposed method is an appropriate choice for the implementation of real-time SSVEP based BCI systems.

A new multivariate empirical mode decomposition method for improving the performance of SSVEP-based brain-computer interface

OBJECTIVE

Accurate and efficient detection of steady-state visual evoked potentials (SSVEP) in electroencephalogram (EEG) is essential for the related brain-computer interface (BCI) applications.

APPROACH

Although the canonical correlation analysis (CCA) has been applied extensively and successfully to SSVEP recognition, the spontaneous EEG activities and artifacts that often occur during data recording can deteriorate the recognition performance. Therefore, it is meaningful to extract a few frequency sub-bands of interest to avoid or reduce the influence of unrelated brain activity and artifacts. This paper presents an improved method to detect the frequency component associated with SSVEP using multivariate empirical mode decomposition (MEMD) and CCA (MEMD-CCA). EEG signals from nine healthy volunteers were recorded to evaluate the performance of the proposed method for SSVEP recognition.

MAIN RESULTS

We compared our method with CCA and temporally local multivariate synchronization index (TMSI). The results suggest that the MEMD-CCA achieved significantly higher accuracy in contrast to standard CCA and TMSI. It gave the improvements of 1.34%, 3.11%, 3.33%, 10.45%, 15.78%, 18.45%, 15.00% and 14.22% on average over CCA at time windows from 0.5 s to 5 s and 0.55%, 1.56%, 7.78%, 14.67%, 13.67%, 7.33% and 7.78% over TMSI from 0.75 s to 5 s. The method outperformed the filter-based decomposition (FB), empirical mode decomposition (EMD) and wavelet decomposition (WT) based CCA for SSVEP recognition.

SIGNIFICANCE

The results demonstrate the ability of our proposed MEMD-CCA to improve the performance of SSVEP-based BCI.

A Ferroelectric Ceramic/Polymer Composite-Based Capacitive Electrode Array for In Vivo Recordings

A new implantable capacitive electrode array for electrocorticography signal recording is developed with ferroelectric ceramic/polymer composite. This ultrathin and electrically safe capacitive electrode array is capable of attaching to the biological tissue conformably. The barium titanate/polyimide (BaTiO₃ /PI) nanocomposite with high dielectric constant is successfully synthesized and employed as the ultrathin dielectric layer of the capacitive BaTiO₃ /PI electrode array. The performance of the capacitive BaTiO₃ /PI electrode array is evaluated by electrical characterization and 3D finite-element modeling. In vivo, neural experiments on the visual cortex of rats show the reliability of the capacitive BaTiO₃ /PI electrode array. This work shows the potentials of capacitive BaTiO₃ /PI electrode array in the field of brain/computer interfaces.

Polychromatic SSVEP stimuli with subtle flickering adapted to brain-display interactions

OBJECTIVE

Interactive displays armed with natural user interfaces (NUIs) will likely lead the next breakthrough in consumer electronics, and brain-computer interfaces (BCIs) are often regarded as the ultimate NUI-enabling machines to respond to human emotions and mental states. Steady-state visual evoked potentials (SSVEPs) are a commonly used BCI modality due to the ease of detection and high information transfer rates. However, the presence of flickering stimuli may cause user discomfort and can even induce migraines and seizures. With the aim of designing visual stimuli that can be embedded into video images, this study developed a novel approach to induce detectable SSVEPs using a composition of red/green/blue flickering lights.

APPROACH

Based on the opponent theory of colour vision, this study used 32 Hz/40 Hz rectangular red-green or red-blue LED light pulses with a 50% duty cycle, balanced/equal luminance and 0°/180° phase shifts as the stimulating light sources and tested their efficacy in producing SSVEP responses with high signal-to-noise ratios (SNRs) while reducing the perceived flickering sensation.

MAIN RESULTS

The empirical results from ten healthy subjects showed that dual-colour lights flickering at 32 Hz/40 Hz with a 50% duty cycle and 180° phase shift achieved a greater than 90% detection accuracy with little or no flickering sensation.

SIGNIFICANCE

As a first step in developing an embedded SSVEP stimulus in commercial displays, this study provides a foundation for developing a combination of three primary colour flickering backlights with adjustable luminance proportions to create a subtle flickering polychromatic light that can elicit SSVEPs at the basic flickering frequency.

Robust frequency recognition for SSVEP-based BCI with temporally local multivariate synchronization index

Multivariate synchronization index (MSI) has been proved to be an efficient method for frequency recognition in SSVEP-BCI systems. It measures the correlation according to the entropy of the normalized eigenvalues of the covariance matrix of multichannel signals. In the MSI method, the estimation of covariance matrix omits the temporally local structure of samples. In this study, a new spatio-temporal method, termed temporally local MSI (TMSI), was presented. This new method explicitly exploits temporally local information in modelling the covariance matrix. In order to evaluate the performance of the TMSI, we performs a comparison between the two methods on the real SSVEP datasets from eleven subjects. The results show that the TMSI outperforms the standard MSI. TMSI benefits from exploiting the temporally local structure of EEG signals, and could be a potential method for robust performance of SSVEP-based BCI.

Sequence detection analysis based on canonical correlation for steady-state visual evoked potential brain computer interfaces

BACKGROUND

Steady-state visual evoked potential (SSVEP) has been widely applied to develop brain computer interface (BCI) systems. The essence of SSVEP recognition is to recognize the frequency component of target stimulus focused by a subject significantly present in EEG spectrum.

NEW METHOD

In this paper, a novel statistical approach based on sequence detection (SD) is proposed for improving the performance of SSVEP recognition. This method uses canonical correlation analysis (CCA) coefficients to observe SSVEP signal sequence. And then, a threshold strategy is utilized for SSVEP recognition.

RESULTS

The result showed the classification performance with the longer duration of time window achieved the higher accuracy for most subjects. And the average time costing per trial was lower than the predefined recognition time. It was implicated that our approach could improve the speed of BCI system in contrast to other methods. Comparison with existing method(s): In comparison with other resultful algorithms, experimental accuracy of SD approach was better than those using a widely used CCA-based method and two newly proposed algorithms, least absolute shrinkage and selection operator (LASSO) recognition model as well as multivariate synchronization index (MSI) method. Furthermore, the information transfer rate (ITR) obtained by SD approach was higher than those using other three methods for most participants.

CONCLUSIONS

These conclusions demonstrated that our proposed method was promising for a high-speed online BCI.

An efficient frequency recognition method based on likelihood ratio test for SSVEP-based BCI

An efficient frequency recognition method is very important for SSVEP-based BCI systems to improve the information transfer rate (ITR). To address this aspect, for the first time, likelihood ratio test (LRT) was utilized to propose a novel multichannel frequency recognition method for SSVEP data. The essence of this new method is to calculate the association between multichannel EEG signals and the reference signals which were constructed according to the stimulus frequency with LRT. For the simulation and real SSVEP data, the proposed method yielded higher recognition accuracy with shorter time window length and was more robust against noise in comparison with the popular canonical correlation analysis- (CCA-) based method and the least absolute shrinkage and selection operator- (LASSO-) based method. The recognition accuracy and information transfer rate (ITR) obtained by the proposed method was higher than those of the CCA-based method and LASSO-based method. The superior results indicate that the LRT method is a promising candidate for reliable frequency recognition in future SSVEP-BCI.

A dynamic selection method for reference electrode in SSVEP-based BCI

In SSVEP-based Brain-Computer Interface (BCI), it is very important to get an evoked EEG with a high signal to noise ratio (SNR). The SNR of SSVEP is fundamentally related to the characteristics of stimulus, such as its intensity and frequency, and it is also related to both the reference electrode and the active electrode. In the past, with SSVEP-based BCI, often the potential at ‘Cz’, the average potential at all electrodes or the average mastoid potential, were statically selected as the reference. In conjunction, a certain electrode in the occipital area was statically selected as the active electrode for all stimuli. This work proposed a dynamic selection method for the reference electrode, in which all electrodes can be looked upon as active electrodes, while an electrode which can result in the maximum sum relative-power of a specific frequency SSVEP can be confirmed dynamically and considered as the optimum reference electrode for that specific frequency stimulus. Comparing this dynamic selection method with previous methods, in which ‘Cz’, the average potential at all electrodes or the average mastoid potential were selected as the reference electrode, it is demonstrated that the SNR of SSVEP is improved significantly as is the accuracy of SSVEP detection.

SSVEP extraction based on the similarity of background EEG

Steady-state Visual Evoked Potential (SSVEP) outperforms the other types of ERPs for Brain-computer Interface (BCI), and thus it is widely employed. In order to apply SSVEP-based BCI to real life situations, it is important to improve the accuracy and transfer rate of the system. Aimed at this target, many SSVEP extraction methods have been proposed. All these methods are based directly on the properties of SSVEP, such as power and phase. In this study, we first filtered out the target frequencies from the original EEG to get a new signal and then computed the similarity between the original EEG and the new signal. Based on this similarity, SSVEP in the original EEG can be identified. This method is referred to as SOB (Similarity of Background). The SOB method is used to detect SSVEP in 1s-length and 3s-length EEG segments respectively. The accuracy of detection is compared with its peers computed by the widely-used Power Spectrum (PS) method and the Canonical Coefficient (CC) method. The comparison results illustrate that the SOB method can lead to a higher accuracy than the PS method and CC method when detecting a short period SSVEP signal.

FREQUENCY RECOGNITION IN SSVEP-BASED BCI USING MULTISET CANONICAL CORRELATION ANALYSIS

Canonical correlation analysis (CCA) has been one of the most popular methods for frequency recognition in steady-state visual evoked potential (SSVEP)-based brain–computer interfaces (BCIs). Despite its efficiency, a potential problem is that using pre-constructed sine-cosine waves as the required reference signals in the CCA method often does not result in the optimal recognition accuracy due to their lack of features from the real electro-encephalo-gram (EEG) data. To address this problem, this study proposes a novel method based on multiset canonical correlation analysis (MsetCCA) to optimize the reference signals used in the CCA method for SSVEP frequency recognition. The MsetCCA method learns multiple linear transforms that implement joint spatial filtering to maximize the overall correlation among canonical variates, and hence extracts SSVEP common features from multiple sets of EEG data recorded at the same stimulus frequency. The optimized reference signals are formed by combination of the common features and completely based on training data. Experimental study with EEG data from 10 healthy subjects demonstrates that the MsetCCA method improves the recognition accuracy of SSVEP frequency in comparison with the CCA method and other two competing methods (multiway CCA (MwayCCA) and phase constrained CCA (PCCA)), especially for a small number of channels and a short time window length. The superiority indicates that the proposed MsetCCA method is a new promising candidate for frequency recognition in SSVEP-based BCIs.

Cortical network properties revealed by SSVEP in anesthetized rats

Steady state visual evoked potentials (SSVEP) are assumed to be regulated by multiple brain areas, yet the underlying mechanisms are not well understood. In this study, we utilized multi-channel intracranial recordings together with network analysis to investigate the underlying relationships between SSVEP and brain networks in anesthetized rat. We examined the relationship between SSVEP amplitude and the network topological properties for different stimulation frequencies, the synergetic dynamic changes of the amplitude and topological properties in each rat, the network properties of the control state, and the individual difference of SSVEP network attributes existing among rats. All these aspects consistently indicate that SSVEP response is closely correlated with network properties, the reorganization of the background network plays a crucial role in SSVEP production, and the background network may provide a physiological marker for evaluating the potential of SSVEP generation.

L1-regularized Multiway canonical correlation analysis for SSVEP-based BCI

Canonical correlation analysis (CCA) between recorded electroencephalogram (EEG) and designed reference signals of sine-cosine waves usually works well for steady-state visual evoked potential (SSVEP) recognition in brain-computer interface (BCI) application. However, using the reference signals of sine- cosine waves without subject-specific and inter-trial information can hardly give the optimal recognition accuracy, due to possible overfitting, especially within a short time window length. This paper introduces an L1-regularized multiway canonical correlation analysis (L1-MCCA) for reference signal optimization to improve the SSVEP recognition performance further. A multiway extension of the CCA, called MCCA, is first presented, in which collaborative CCAs are exploited to optimize the reference signals in correlation analysis for SSVEP recognition alternatingly from the channel-way and trial-way arrays of constructed EEG tensor. L1-regularization is subsequently imposed on the trial-way array optimization in the MCCA, and hence results in the more powerful L1-MCCA with function of effective trial selection. Both the proposed MCCA and L1-MCCA methods are validated for SSVEP recognition with EEG data from 10 healthy subjects, and compared to the ordinary CCA without reference signal optimization. Experimental results show that the MCCA significantly outperforms the CCA for SSVEP recognition. The L1-MCCA further improves the recognition accuracy which is significantly higher than that of the MCCA.

SSVEP response is related to functional brain network topology entrained by the flickering stimulus

Previous studies have shown that the brain network topology correlates with the cognitive function. However, few studies have investigated the relationship between functional brain networks that process sensory inputs and outputs. In this study, we focus on steady-state paradigms using a periodic visual stimulus, which are increasingly being used in both brain-computer interface (BCI) and cognitive neuroscience researches. Using the graph theoretical analysis, we investigated the relationship between the topology of functional networks entrained by periodic stimuli and steady state visually evoked potentials (SSVEP) using two frequencies and eleven subjects. First, the entire functional network (Network 0) of each frequency for each subject was constructed according to the coherence between electrode pairs. Next, Network 0 was divided into three sub-networks, in which the connection strengths were either significantly (positively for Network 1, negatively for Network 3) or non-significantly (Network 2) correlated with the SSVEP responses. Our results revealed that the SSVEP responses were positively correlated to the mean functional connectivity, clustering coefficient, and global and local efficiencies, while these responses were negatively correlated with the characteristic path length of Networks 0, 1 and 2. Furthermore, the strengths of these connections that significantly correlated with the SSVEP (both positively and negatively) were mainly found to be long-range connections between the parietal-occipital and frontal regions. These results indicate that larger SSVEP responses correspond with better functional network topology structures. This study may provide new insights for understanding brain mechanisms when using SSVEPs as frequency tags.

Improvement of classification accuracy in a phase-tagged steady-state visual evoked potential-based brain computer interface using multiclass support vector machine

BACKGROUND

Brain computer interface (BCI) is an emerging technology for paralyzed patients to communicate with external environments. Among current BCIs, the steady-state visual evoked potential (SSVEP)-based BCI has drawn great attention due to its characteristics of easy preparation, high information transfer rate (ITR), high accuracy, and low cost. However, electroencephalogram (EEG) signals are electrophysiological responses reflecting the underlying neural activities which are dependent upon subject's physiological states (e.g., emotion, attention, etc.) and usually variant among different individuals. The development of classification approaches to account for each individual's difference in SSVEP is needed but was seldom reported.

METHODS

This paper presents a multiclass support vector machine (SVM)-based classification approach for gaze-target detections in a phase-tagged SSVEP-based BCI. In the training steps, the amplitude and phase features of SSVEP from off-line recordings were used to train a multiclass SVM for each subject. In the on-line application study, effective epochs which contained sufficient SSVEP information of gaze targets were first determined using Kolmogorov-Smirnov (K-S) test, and the amplitude and phase features of effective epochs were subsequently inputted to the multiclass SVM to recognize user's gaze targets.

RESULTS

The on-line performance using the proposed approach has achieved high accuracy (89.88 ± 4.76%), fast responding time (effective epoch length = 1.13 ± 0.02 s), and the information transfer rate (ITR) was 50.91 ± 8.70 bits/min.

CONCLUSIONS

The multiclass SVM-based classification approach has been successfully implemented to improve the classification accuracy in a phase-tagged SSVEP-based BCI. The present study has shown the multiclass SVM can be effectively adapted to each subject's SSVEPs to discriminate SSVEP phase information from gazing at different gazed targets.

Adaptive Laplacian filtering for sensorimotor rhythm-based brain-computer interfaces

OBJECTIVE

Sensorimotor rhythms (SMRs) are 8-30 Hz oscillations in the electroencephalogram (EEG) recorded from the scalp over sensorimotor cortex that change with movement and/or movement imagery. Many brain-computer interface (BCI) studies have shown that people can learn to control SMR amplitudes and can use that control to move cursors and other objects in one, two or three dimensions. At the same time, if SMR-based BCIs are to be useful for people with neuromuscular disabilities, their accuracy and reliability must be improved substantially. These BCIs often use spatial filtering methods such as common average reference (CAR), Laplacian (LAP) filter or common spatial pattern (CSP) filter to enhance the signal-to-noise ratio of EEG. Here, we test the hypothesis that a new filter design, called an 'adaptive Laplacian (ALAP) filter', can provide better performance for SMR-based BCIs.

APPROACH

An ALAP filter employs a Gaussian kernel to construct a smooth spatial gradient of channel weights and then simultaneously seeks the optimal kernel radius of this spatial filter and the regularization parameter of linear ridge regression. This optimization is based on minimizing the leave-one-out cross-validation error through a gradient descent method and is computationally feasible.

MAIN RESULTS

Using a variety of kinds of BCI data from a total of 22 individuals, we compare the performances of ALAP filter to CAR, small LAP, large LAP and CSP filters. With a large number of channels and limited data, ALAP performs significantly better than CSP, CAR, small LAP and large LAP both in classification accuracy and in mean-squared error. Using fewer channels restricted to motor areas, ALAP is still superior to CAR, small LAP and large LAP, but equally matched to CSP.

SIGNIFICANCE

Thus, ALAP may help to improve the accuracy and robustness of SMR-based BCIs.

Multiple frequencies sequential coding for SSVEP-based brain-computer interface

BACKGROUND

Steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) has become one of the most promising modalities for a practical noninvasive BCI system. Owing to both the limitation of refresh rate of liquid crystal display (LCD) or cathode ray tube (CRT) monitor, and the specific physiological response property that only a very small number of stimuli at certain frequencies could evoke strong SSVEPs, the available frequencies for SSVEP stimuli are limited. Therefore, it may not be enough to code multiple targets with the traditional frequencies coding protocols, which poses a big challenge for the design of a practical SSVEP-based BCI. This study aimed to provide an innovative coding method to tackle this problem.

METHODOLOGY/PRINCIPAL FINDINGS

In this study, we present a novel protocol termed multiple frequencies sequential coding (MFSC) for SSVEP-based BCI. In MFSC, multiple frequencies are sequentially used in each cycle to code the targets. To fulfill the sequential coding, each cycle is divided into several coding epochs, and during each epoch, certain frequency is used. Obviously, different frequencies or the same frequency can be presented in the coding epochs, and the different epoch sequence corresponds to the different targets. To show the feasibility of MFSC, we used two frequencies to realize four targets and carried on an offline experiment. The current study shows that: 1) MFSC is feasible and efficient; 2) the performance of SSVEP-based BCI based on MFSC can be comparable to some existed systems.

CONCLUSIONS/SIGNIFICANCE

The proposed protocol could potentially implement much more targets with the limited available frequencies compared with the traditional frequencies coding protocol. The efficiency of the new protocol was confirmed by real data experiment. We propose that the SSVEP-based BCI under MFSC might be a promising choice in the future.

Toward functioning and usable brain-computer interfaces (BCIs): a literature review

PURPOSE

The aim of this paper is to provide an exhaustive review of the literature about brain-computer interfaces (BCIs) that could be used with these paralysed patients. The electroencephalography (EEG) is the best candidate for the continuous use in the environment of patients' houses, due to its portability and ease of use. For this reason, the present paper will focus on this kind of BCI. Moreover, it is our aim to focus more on the patients, regarding their active role in the modulation of the brain activity. This leads to a differentiation between studies that use an active regulation and studies that use a non-active regulation.

METHOD

Relevant articles in the BCIs field were selected using MEDLINE and PsycINFO.

RESULTS

Research through data banks produced 980 results, which were reduced to 127 after exclusion criteria selection. These references were divided in four categories, based on the use of active or non-active regulation, and on the event related potential used.

CONCLUSIONS

In most of the examined works, the focus was on the development of systems and algorithms able to recognise and classify brain events. Although this kind of research is fundamental, a user-centred point of view was rarely adopted. [Box: see text].

An SSVEP-based BCI using high duty-cycle visual flicker

Steady-state visual-evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have generated significant interest due to their high information transfer rate (ITR). Due to the amplitude-frequency characteristic of the SSVEP, the flickering frequency of an SSVEP-based BCI is typically lower than 20  Hz to achieve a high SNR. However, a visual flicker with a flashing frequency below the critical flicker-fusion frequency often makes subjects feel flicker jerky and causes visual discomfort. This study presents a novel technique using high duty-cycle visual flicker to decrease user's visual discomfort. The proposed design uses LEDs flashing at 13.16  Hz, driven by flickering sequences consisting of repetitive stimulus cycles with a duration T (T = 76 ms). Each stimulus cycle included an ON state with a duration T(ON) and an OFF state with a duration T(OFF) (T = T(ON) + T(OFF)), and the duty cycle, defined as T(ON)/T, varied from 10.5% to 89.5%. This study also includes a questionnaire survey and analyzes the SSVEPs induced by different duty-cycle flickers. An 89.5% duty-cycle flicker, reported as a comfortable flicker, was adopted in a phase-tagged SSVEP system. Six subjects were asked to sequentially input a sequence of cursor commands with the 25.08-bits/min ITR.

Dual-frequency steady-state visual evoked potential for brain computer interface

This study presents a new steady-state visual evoked potential (SSVEP) for brain computer interface (BCI) systems. The goal of this study is to increase the number of selections using fewer stimulation frequencies. This study analyzes the SSVEPs induced by six groups of light-emitting diodes (LEDs). The proposed method produces more selections than the number of stimulation frequencies through a suitable combination of dual frequencies for stimulation. Further, the six groups of LEDs are generated by four frequencies. The symmetric harmonic phenomena in this study helps increase recognition efficiency. This study tests seven subjects to verify the feasibility of the proposed method.

A survey of stimulation methods used in SSVEP-based BCIs

Brain-computer interface (BCI) systems based on the steady-state visual evoked potential (SSVEP) provide higher information throughput and require shorter training than BCI systems using other brain signals. To elicit an SSVEP, a repetitive visual stimulus (RVS) has to be presented to the user. The RVS can be rendered on a computer screen by alternating graphical patterns, or with external light sources able to emit modulated light. The properties of an RVS (e.g., frequency, color) depend on the rendering device and influence the SSVEP characteristics. This affects the BCI information throughput and the levels of user safety and comfort. Literature on SSVEP-based BCIs does not generally provide reasons for the selection of the used rendering devices or RVS properties. In this paper, we review the literature on SSVEP-based BCIs and comprehensively report on the different RVS choices in terms of rendering devices, properties, and their potential influence on BCI performance, user safety and comfort.

Steady-state visually evoked potentials: focus on essential paradigms and future perspectives

After 40 years of investigation, steady-state visually evoked potentials (SSVEPs) have been shown to be useful for many paradigms in cognitive (visual attention, binocular rivalry, working memory, and brain rhythms) and clinical neuroscience (aging, neurodegenerative disorders, schizophrenia, ophthalmic pathologies, migraine, autism, depression, anxiety, stress, and epilepsy). Recently, in engineering, SSVEPs found a novel application for SSVEP-driven brain-computer interface (BCI) systems. Although some SSVEP properties are well documented, many questions are still hotly debated. We provide an overview of recent SSVEP studies in neuroscience (using implanted and scalp EEG, fMRI, or PET), with the perspective of modern theories about the visual pathway. We investigate the steady-state evoked activity, its properties, and the mechanisms behind SSVEP generation. Next, we describe the SSVEP-BCI paradigm and review recently developed SSVEP-based BCI systems. Lastly, we outline future research directions related to basic and applied aspects of SSVEPs.

Amplitude modulation of steady-state visual evoked potentials by event-related potentials in a working memory task

Previous studies have shown that the amplitude and phase of the steady-state visual-evoked potential (SSVEP) can be influenced by a cognitive task, yet the mechanism of this influence has not been understood. As the event-related potential (ERP) is the direct neural electric response to a cognitive task, studying the relationship between the SSVEP and ERP would be meaningful in understanding this underlying mechanism. In this work, the traditional average method was applied to extract the ERP directly, following the stimulus of a working memory task, while a technique named steady-state probe topography was utilized to estimate the SSVEP under the simultaneous stimulus of an 8.3-Hz flicker and a working memory task; a comparison between the ERP and SSVEP was completed. The results show that the ERP can modulate the SSVEP amplitude, and for regions where both SSVEP and ERP are strong, the modulation depth is large.

An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method

In recent years, there has been increasing interest in using steady-state visual evoked potential (SSVEP) in brain-computer interface (BCI) systems. However, several aspects of current SSVEP-based BCI systems need improvement, specifically in relation to speed, user variation and ease of use. With these improvements in mind, this paper presents an online multi-channel SSVEP-based BCI system using a canonical correlation analysis (CCA) method for extraction of frequency information associated with the SSVEP. The key parameters, channel location, window length and the number of harmonics, are investigated using offline data, and the result used to guide the design of the online system. An SSVEP-based BCI system with six targets, which use nine channel locations in the occipital and parietal lobes, a window length of 2 s and the first harmonic, is used for online testing on 12 subjects. The results show that the proposed BCI system has a high performance, achieving an average accuracy of 95.3% and an information transfer rate of 58 +/- 9.6 bit min(-1). The positive characteristics of the proposed system are that channel selection and parameter optimization are not required, the possible use of harmonic frequencies, low user variation and easy setup.