A survey of stimulation methods used in SSVEP-based BCIs

The use of happy faces as visual stimuli improves the performance of the hybrid SSVEP+P300 brain computer interface

BACKGROUND

This study illustrates a hybrid brain-computer interface (BCI) in which steady-state visual evoked potentials (SSVEP) and event-related potentials (P300) are evoked simultaneously. The goal of this study was to improve the performance of the current hybrid SSVEP+P300 BCI systems by incorporating a happy face into visual stimuli.

NEW METHOD

In this study, happy and sad faces were added to a visual stimulus to induce stronger cortical signals in a hybrid SSVEP+P300 BCI. Additionally, we developed a paradigm in which SSVEP responses were triggered by non-face stimuli, whereas P300 responses were triggered by face stimuli. We tested four paradigms: happy face paradigm (HF), sad face paradigm (SF), happy face and flicker paradigm (HFF), and sad face and flicker paradigm (SFF).

RESULTS AND CONCLUSIONS

The results demonstrated that the HFF paradigm elicited more robust cortical responses, which resulted in enhanced system accuracy and information transfer rate (ITR). The HFF paradigm has a system communication rate of 25.9 bits per second and an average accuracy of 96.1%. Compared with other paradigms, the HFF paradigm is the best choice for BCI applications because it has the highest ITR and maximum level of comfort.

A Brain-Controlled and User-Centered Intelligent Wheelchair: A Feasibility Study

Recently, due to physical aging, diseases, accidents, and other factors, the population with lower limb disabilities has been increasing, and there is consequently a growing demand for wheelchair products. Modern product design tends to be more intelligent and multi-functional than in the past, with the popularization of intelligent concepts. This supports the design of a new, fully functional, intelligent wheelchair that can assist people with lower limb disabilities in their day-to-day life. Based on the UCD (user-centered design) concept, this study focused on the needs of people with lower limb disabilities. Accordingly, the demand for different functions of intelligent wheelchair products was studied through a questionnaire survey, interview survey, literature review, expert consultation, etc., and the function and appearance of the intelligent wheelchair were then defined. A brain-machine interface system was developed for controlling the motion of the intelligent wheelchair, catering to the needs of disabled individuals. Furthermore, ergonomics theory was used as a guide to determine the size of the intelligent wheelchair seat, and eventually, a new intelligent wheelchair with the features of climbing stairs, posture adjustment, seat elevation, easy interaction, etc., was developed. This paper provides a reference for the design upgrade of the subsequently developed intelligent wheelchair products.

Assessment of visual fatigue in SSVEP-based brain-computer interface: a comprehensive study

Fatigue deteriorates the performance of a brain-computer interface (BCI) system; thus, reliable detection of fatigue is the first step to counter this problem. The fatigue evaluated by means of electroencephalographic (EEG) signals has been studied in many research projects, but widely different results have been reported. Moreover, there is scant research when considering the fatigue on steady-state visually evoked potential (SSVEP)-based BCI. Therefore, nowadays, fatigue detection is not a completely solved topic. In the current work, the issues found in the literature that led to the differences in the results are identified and saved by performing a new experiment on an SSVEP-based BCI system. The experiment was long enough to produce fatigue in the users, and different SSVEP stimulation ranges were used. Additionally, the EEG features commonly reported in the literature (EEG rhythms powers, SNR, etc.) were calculated as well as newly proposed features (spectral features and Lempel-Ziv complexity). The analysis was carried out on O1, Oz and O2 channels. This work found a tendency of displacement from high-frequency rhythms to low-frequency ones, and thus, better EEG features should present a similar behaviour. Then, the 'relative power' of EEG rhythms, the rates (θ + α)/β, α/β and θ/β, some spectral features (central and mean frequencies, asymmetry and kurtosis coefficients, etc.) and Lempel-Ziv complexity are proposed as reliable EEG features for fatigue detection. Hence, this set of features may be used to construct a more trustworthy fatigue index.

Frequency-dependent dynamics of steady-state visual evoked potentials under sustained flicker stimulation

Steady-state visual evoked potentials (SSVEP) are electroencephalographic signals elicited when the brain is exposed to a visual stimulus with a steady frequency. We analyzed the temporal dynamics of SSVEP during sustained flicker stimulation at 5, 10, 15, 20 and 40 Hz. We found that the amplitudes of the responses were not stable over time. For a 5 Hz stimulus, the responses progressively increased, while, for higher flicker frequencies, the amplitude increased during the first few seconds and often showed a continuous decline afterward. We hypothesize that these two distinct sets of frequency-dependent SSVEP signal properties reflect the contribution of parvocellular and magnocellular visual pathways generating sustained and transient responses, respectively. These results may have important applications for SSVEP signals used in research and brain-computer interface technology and may contribute to a better understanding of the frequency-dependent temporal mechanisms involved in the processing of prolonged periodic visual stimuli.

Recruiting neural field theory for data augmentation in a motor imagery brain-computer interface

We introduce a novel approach to training data augmentation in brain-computer interfaces (BCIs) using neural field theory (NFT) applied to EEG data from motor imagery tasks. BCIs often suffer from limited accuracy due to a limited amount of training data. To address this, we leveraged a corticothalamic NFT model to generate artificial EEG time series as supplemental training data. We employed the BCI competition IV '2a' dataset to evaluate this augmentation technique. For each individual, we fitted the model to common spatial patterns of each motor imagery class, jittered the fitted parameters, and generated time series for data augmentation. Our method led to significant accuracy improvements of over 2% in classifying the "total power" feature, but not in the case of the "Higuchi fractal dimension" feature. This suggests that the fit NFT model may more favorably represent one feature than the other. These findings pave the way for further exploration of NFT-based data augmentation, highlighting the benefits of biophysically accurate artificial data.

Epileptic seizure suppression: A computational approach for identification and control using real data

Epilepsy affects millions of people worldwide every year and remains an open subject for research. Current development on this field has focused on obtaining computational models to better understand its triggering mechanisms, attain realistic descriptions and study seizure suppression. Controllers have been successfully applied to mitigate epileptiform activity in dynamic models written in state-space notation, whose applicability is, however, restricted to signatures that are accurately described by them. Alternatively, autoregressive modeling (AR), a typical data-driven tool related to system identification (SI), can be directly applied to signals to generate more realistic models, and since it is inherently convertible into state-space representation, it can thus be used for the artificial reconstruction and attenuation of seizures as well. Considering this, the first objective of this work is to propose an SI approach using AR models to describe real epileptiform activity. The second objective is to provide a strategy for reconstructing and mitigating such activity artificially, considering non-hybrid and hybrid controllers - designed from ictal and interictal events, respectively. The results show that AR models of relatively low order represent epileptiform activities fairly well and both controllers are effective in attenuating the undesired activity while simultaneously driving the signal to an interictal condition. These findings may lead to customized models based on each signal, brain region or patient, from which it is possible to better define shape, frequency and duration of external stimuli that are necessary to attenuate seizures.

Distinct patterns of spatial attentional modulation of steady-state visual evoked magnetic fields (SSVEFs) in subdivisions of the human early visual cortex

In recent years, steady-state visual evoked potentials (SSVEPs) became an increasingly valuable tool to investigate neural dynamics of competitive attentional interactions and brain-computer interfaces. This is due to their good signal-to-noise ratio, allowing for single-trial analysis, and their ongoing oscillating nature that enables to analyze temporal dynamics of facilitation and suppression. Given the popularity of SSVEPs, it is surprising that only a few studies looked at the cortical sources of these responses. This is in particular the case when searching for studies that assessed the cortical sources of attentional SSVEP amplitude modulations. To address this issue, we used a typical spatial attention task and recorded neuromagnetic fields (MEG) while presenting frequency-tagged stimuli in the left and right visual fields, respectively. Importantly, we controlled for attentional deployment in a baseline period before the shifting cue. Subjects either attended to a central fixation cross or to two peripheral stimuli simultaneously. Results clearly showed that signal sources and attention effects were restricted to the early visual cortex: V1, V2, hMT+, precuneus, occipital-parietal, and inferior-temporal cortex. When subjects attended to central fixation first, shifting attention to one of the peripheral stimuli resulted in a significant activation increase for the to-be-attended stimulus with no activation decrease for the to-be-ignored stimulus in hMT+ and inferio-temporal cortex, but significant SSVEF decreases from V1 to occipito-parietal cortex. When attention was first deployed to both rings, shifting attention away from one ring basically resulted in a significant activation decrease in all areas for the then-to-be-ignored stimulus.

[Design of flexible wearable sensing systems]

The aging population and the increasing prevalence of chronic diseases in the elderly have brought a significant economic burden to families and society. The non-invasive wearable sensing system can continuously and real-time monitor important physiological signs of the human body and evaluate health status. In addition, it can provide efficient and convenient information feedback, thereby reducing the health risks caused by chronic diseases in the elderly. A wearable system for detecting physiological and behavioral signals was developed in this study. We explored the design of flexible wearable sensing technology and its application in sensing systems. The wearable system included smart hats, smart clothes, smart gloves, and smart insoles, achieving long-term continuous monitoring of physiological and motion signals. The performance of the system was verified, and the new sensing system was compared with commercial equipment. The evaluation results demonstrated that the proposed system presented a comparable performance with the existing system. In summary, the proposed flexible sensor system provides an accurate, detachable, expandable, user-friendly and comfortable solution for physiological and motion signal monitoring. It is expected to be used in remote healthcare monitoring and provide personalized information monitoring, disease prediction, and diagnosis for doctors/patients.

Burst c-VEP Based BCI: Optimizing stimulus design for enhanced classification with minimal calibration data and improved user experience

The utilization of aperiodic flickering visual stimuli under the form of code-modulated Visual Evoked Potentials (c-VEP) represents a pivotal advancement in the field of reactive Brain-Computer Interface (rBCI). A major advantage of the c-VEP approach is that the training of the model is independent of the number and complexity of targets, which helps reduce calibration time. Nevertheless, the existing designs of c-VEP stimuli can be further improved in terms of visual user experience but also to achieve a higher signal-to-noise ratio, while shortening the selection time and calibration process. In this study, we introduce an innovative variant of code-VEP, referred to as "Burst c-VEP". This original approach involves the presentation of short bursts of aperiodic visual flashes at a deliberately slow rate, typically ranging from two to four flashes per second. The rationale behind this design is to leverage the sensitivity of the primary visual cortex to transient changes in low-level stimuli features to reliably elicit distinctive series of visual evoked potentials. In comparison to other types of faster-paced code sequences, burst c-VEP exhibit favorable properties to achieve high bitwise decoding performance using convolutional neural networks (CNN), which yields potential to attain faster selection time with the need for less calibration data. Furthermore, our investigation focuses on reducing the perceptual saliency of c-VEP through the attenuation of visual stimuli contrast and intensity to significantly improve users' visual comfort. The proposed solutions were tested through an offline 4-classes c-VEP protocol involving 12 participants. Following a factorial design, participants were instructed to focus on c-VEP targets whose pattern (burst and maximum-length sequences) and amplitude (100% or 40% amplitude depth modulations) were manipulated across experimental conditions. Firstly, the full amplitude burst c-VEP sequences exhibited higher accuracy, ranging from 90.5% (with 17.6s of calibration data) to 95.6% (with 52.8s of calibration data), compared to its m-sequence counterpart (71.4% to 85.0%). The mean selection time for both types of codes (1.5 s) compared favorably to reports from previous studies. Secondly, our findings revealed that lowering the intensity of the stimuli only slightly decreased the accuracy of the burst code sequences to 94.2% while leading to substantial improvements in terms of user experience. Taken together, these results demonstrate the high potential of the proposed burst codes to advance reactive BCI both in terms of performance and usability. The collected dataset, along with the proposed CNN architecture implementation, are shared through open-access repositories.

Fatigue factors and fatigue indices in SSVEP-based brain-computer interfaces: a systematic review and meta-analysis

Background

Fatigue is a serious challenge when applying a steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) in the real world. Many researchers have used quantitative indices to study the effect of visual stimuli on fatigue. According to a wide range of studies in fatigue analysis, there are contradictions and inconsistencies in the behavior of fatigue indicators.

New method

In this study, for the first time, a systematic review and meta-analysis were performed on fatigue indices and fatigue caused by stimulation paradigm. We queried three scientific search engines for studies published between 2000 and 2022. The inclusion criteria were papers investigating mental and visual fatigue from performing a visual task using electroencephalogram (EEG) signals.

Results

Attractiveness and variation are the most effective ways to reduce BCI fatigue. Therefore, zoom motion, Newton's ring motion, and cue patterns reduce fatigue. While the color of the cue could effectively reduce fatigue, its shape and background had no effect on fatigue. Additionally, the questionnaire and quantitative indicators such as frequency indices, signal-to-noise ratio (SNR), SSVEP amplitude, and multiscale entropy were utilized to assess fatigue. Meta-analysis indicated that when a person is fatigued, the spectrum amplitude of alpha, theta, and α + θ / β increase significantly, while SNR and SSVEP amplitude decrease significantly.

Conclusion

The outcomes of this study can be used to design more optimal stimulation protocols that cause less fatigue. Moreover, the level of fatigue can be quantitatively assessed with indicators without the participant's self-reports.

A Novel Asynchronous Brain Signals-Based Driver-Vehicle Interface for Brain-Controlled Vehicles

Directly applying brain signals to operate a mobile manned platform, such as a vehicle, may help people with neuromuscular disorders regain their driving ability. In this paper, we developed a novel electroencephalogram (EEG) signal-based driver-vehicle interface (DVI) for the continuous and asynchronous control of brain-controlled vehicles. The proposed DVI consists of the user interface, the command decoding algorithm, and the control model. The user interface is designed to present the control commands and induce the corresponding brain patterns. The command decoding algorithm is developed to decode the control command. The control model is built to convert the decoded commands to control signals. Offline experimental results show that the developed DVI can generate a motion control command with an accuracy of 83.59% and a detection time of about 2 s, while it has a recognition accuracy of 90.06% in idle states. A real-time brain-controlled simulated vehicle based on the DVI was developed and tested on a U-turn road. Experimental results show the feasibility of the DVI for continuously and asynchronously controlling a vehicle. This work not only advances the research on brain-controlled vehicles but also provides valuable insights into driver-vehicle interfaces, multimodal interaction, and intelligent vehicles.

SSVEP detection assessment by combining visual stimuli paradigms and no-training detection methods

Introduction

Brain-Computer Interfaces (BCI) based on Steady-State Visually Evoked Potentials (SSVEP) have great potential for use in communication applications because of their relatively simple assembly and in some cases the possibility of bypassing the time-consuming training stage. However, among multiple factors, the efficient performance of this technology is highly dependent on the stimulation paradigm applied in combination with the SSVEP detection algorithm employed. This paper proposes the performance assessment of the classification of target events with respect to non-target events by applying four types of visual paradigms, rectangular modulated On-Off (OOR), sinusoidal modulated On-Off (OOS), rectangular modulated Checkerboard (CBR), and sinusoidal modulated Checkerboard (CBS), with three types of SSVEP detection methods, Canonical Correlation Analysis (CCA), Filter-Bank CCA (FBCCA), and Minimum Energy Combination (MEC).

Methods

We set up an experimental protocol in which the four types of visual stimuli were presented randomly to twenty-seven participants and after acquiring their electroencephalographic responses to five stimulation frequencies (8.57, 10.909, 15, 20, and 24 Hz), the three detection methods were applied to the collected data.

Results

The results are conclusive, obtaining the best performance with the combination of either OOR or OOS visual stimulus and the FBCCA as a detection method, however, this finding contrasts with the opinion of almost half of the participants in terms of visual comfort, where the 51.9% of the subjects felt more comfortable and focused with CBR or CBS stimulation.

Discussion

Finally, the EEG recordings correspond to the SSVEP response of 27 subjects to four visual paradigms when selecting five items on a screen, which is useful in BCI navigation applications. The dataset is available to anyone interested in studying and evaluating signal processing and machine-learning algorithms for SSVEP-BCI systems.

Review of public motor imagery and execution datasets in brain-computer interfaces

The demand for public datasets has increased as data-driven methodologies have been introduced in the field of brain-computer interfaces (BCIs). Indeed, many BCI datasets are available in various platforms or repositories on the web, and the studies that have employed these datasets appear to be increasing. Motor imagery is one of the significant control paradigms in the BCI field, and many datasets related to motor tasks are open to the public already. However, to the best of our knowledge, these studies have yet to investigate and evaluate the datasets, although data quality is essential for reliable results and the design of subject- or system-independent BCIs. In this study, we conducted a thorough investigation of motor imagery/execution EEG datasets recorded from healthy participants published over the past 13 years. The 25 datasets were collected from six repositories and subjected to a meta-analysis. In particular, we reviewed the specifications of the recording settings and experimental design, and evaluated the data quality measured by classification accuracy from standard algorithms such as Common Spatial Pattern (CSP) and Linear Discriminant Analysis (LDA) for comparison and compatibility across the datasets. As a result, we found that various stimulation types, such as text, figure, or arrow, were used to instruct subjects what to imagine and the length of each trial also differed, ranging from 2.5 to 29 s with a mean of 9.8 s. Typically, each trial consisted of multiple sections: pre-rest (2.38 s), imagination ready (1.64 s), imagination (4.26 s, ranging from 1 to 10 s), the post-rest (3.38 s). In a meta-analysis of the total of 861 sessions from all datasets, the mean classification accuracy of the two-class (left-hand vs. right-hand motor imagery) problem was 66.53%, and the population of the BCI poor performers, those who are unable to reach proficiency in using a BCI system, was 36.27% according to the estimated accuracy distribution. Further, we analyzed the CSP features and found that each dataset forms a cluster, and some datasets overlap in the feature space, indicating a greater similarity among them. Finally, we checked the minimal essential information (continuous signals, event type/latency, and channel information) that should be included in the datasets for convenient use, and found that only 71% of the datasets met those criteria. Our attempts to evaluate and compare the public datasets are timely, and these results will contribute to understanding the dataset's quality and recording settings as well as the use of using public datasets for future work on BCIs.

A new grid stimulus with subtle flicker perception for user-friendly SSVEP-based BCIs

Objective.The traditional uniform flickering stimulation pattern shows strong steady-state visual evoked potential (SSVEP) responses and poor user experience with intense flicker perception. To achieve a balance between performance and comfort in SSVEP-based brain-computer interface (BCI) systems, this study proposed a new grid stimulation pattern with reduced stimulation area and low spatial contrast.Approach.A spatial contrast scanning experiment was conducted first to clarify the relationship between the SSVEP characteristics and the signs and values of spatial contrast. Four stimulation patterns were involved in the experiment: the ON and OFF grid stimulation patterns that separately activated the positive or negative contrast information processing pathways, the ON-OFF grid stimulation pattern that simultaneously activated both pathways, and the uniform flickering stimulation pattern that served as a control group. The contrast-intensity and contrast-user experience curves were obtained for each stimulation pattern. Accordingly, the optimized stimulation schemes with low spatial contrast (the ON-50% grid stimulus, the OFF-50% grid stimulus, and the Flicker-30% stimulus) were applied in a 12-target and a 40-target BCI speller and compared with the traditional uniform flickering stimulus (the Flicker-500% stimulus) in the evaluation of BCI performance and subjective experience.Main results.The OFF-50% grid stimulus showed comparable online performance (12-target, 2 s: 69.87 ± 0.74 vs. 69.76 ± 0.58 bits min^-1, 40-target, 4 s: 57.02 ± 2.53 vs. 60.79 ± 1.08 bits min^-1) and improved user experience (better comfortable level, weaker flicker perception and higher preference level) compared to the traditional Flicker-500% stimulus in both multi-targets BCI spellers.Significance.Selective activation of the negative contrast information processing pathway using the new OFF-50% grid stimulus evoked robust SSVEP responses. On this basis, high-performance and user-friendly SSVEP-based BCIs have been developed and implemented, which has important theoretical significance and application value in promoting the development of the visual BCI technology.

Higher amplitudes in steady-state visual evoked potentials driven by square-wave versus sine-wave contrast modulation - A dual-laboratory study

Steady-state visual evoked potentials (ssVEPs) are an established tool for assessing visuocortical responses in visual perception and attention. They have the same temporal frequency characteristics as a periodically modulated stimulus (e.g., in contrast or luminance) that drives them. It has been hypothesized that the amplitude of a given ssVEP may depend on the shape of the stimulus modulation function, but the size and robustness of these effects is not well established. The current study systematically compared the effect of the two most common functions in the ssVEP literature, square-wave and sine-wave functions. Across two laboratories, we presented mid-complex color patterns to 30 participants with square-wave or sine-wave contrast modulation and at different driving frequencies (6 Hz, 8.57 Hz, 15 Hz). When ssVEPs were analyzed independently for the samples, with each laboratory's standard processing pipeline, ssVEP amplitudes in both samples decreased at higher driving frequencies and square-wave modulation evoked higher amplitudes at lower frequencies (i.e., 6 Hz, 8.57 Hz) compared to sine-wave modulation. These effects were replicated when samples were aggregated and analyzed with the same processing pipeline. In addition, when using signal-to-noise ratios as outcome measures, this joint analysis indicated a somewhat weaker effect of increased ssVEP amplitudes to square-wave modulation at 15 Hz. The present study suggests that square-wave modulation should be used in ssVEP research when the goal is to maximize signal amplitude or signal-to-noise ratio. Given effects of modulation function across laboratories, and data processing pipelines, the findings appear robust to differences in data collection and analysis.

Robust Motor Imagery Tasks Classification Approach Using Bayesian Neural Network

The development of Brain-Computer Interfaces based on Motor Imagery (MI) tasks is a relevant research topic worldwide. The design of accurate and reliable BCI systems remains a challenge, mainly in terms of increasing performance and usability. Classifiers based on Bayesian Neural Networks are proposed in this work by using the variational inference, aiming to analyze the uncertainty during the MI prediction. An adaptive threshold scheme is proposed here for MI classification with a reject option, and its performance on both datasets 2a and 2b from BCI Competition IV is compared with other approaches based on thresholds. The results using subject-specific and non-subject-specific training strategies are encouraging. From the uncertainty analysis, considerations for reducing computational cost are proposed for future work.

Independent bilateral-eye stimulation for gaze pattern recognition based on steady-state pupil light reflex

Objective:recently, pupil oscillations synchronized with steady visual stimuli were used as input for an interface. The proposed system, inspired by a brain-computer interface based on steady-state visual evoked potentials, does not require contact with the participant. However, the pupil oscillation mechanism limits the stimulus frequency to 2.5 Hz or less, making it hard to enhance the information transfer rate (ITR).Approach:here, we compared multiple conditions for stimulation to increase the ITR of the pupil vibration-based interface, which were called monocular-single, monocular-superposed, and binocular-independent conditions. The binocular-independent condition stimulates each eye at different frequencies respectively and mixes them by using the visual stereoscopic perception of users. The monocular-superposed condition stimulates both eyes by a mixed signal of two different frequencies. We selected the shape of the stimulation signal, evaluated the amount of spectral leakage in the monocular-superposed and binocular-independent conditions, and compared the power spectrum density at the stimulation frequency. Moreover, 5, 10, and 15 patterns of stimuli were classified in each condition.Main results:a square wave, which causes an efficient pupil response, was used as the stimulus. Spectral leakage at the beat frequency was higher in the monocular-superposed condition than in the binocular-independent one. The power spectral density of stimulus frequencies was greatest in the monocular-single condition. Finally, we could classify the 15-stimulus pattern, with ITRs of 14.4 (binocular-independent, using five frequencies), 14.5 (monocular-superimposed, using five frequencies), and 23.7 bits min^-1(monocular-single, using 15 frequencies). There were no significant differences for the binocular-independent and monocular-superposed conditions.Significance:this paper shows a way to increase the number of stimuli that can be simultaneously displayed without decreasing ITR, even when only a small number of frequencies are available. This could lead to the provision of an interface based on pupil oscillation to a wider range of users.

Frequency set selection for multi-frequency steady-state visual evoked potential-based brain-computer interfaces

Objective

Multi-frequency steady-state visual evoked potential (SSVEP) stimulation and decoding methods enable the representation of a large number of visual targets in brain-computer interfaces (BCIs). However, unlike traditional single-frequency SSVEP, multi-frequency SSVEP is not yet widely used. One of the key reasons is that the redundancy in the input options requires an additional selection process to define an effective set of frequencies for the interface. This study investigates systematic frequency set selection methods.

Methods

An optimization strategy based on the analysis of the frequency components in the resulting multi-frequency SSVEP is proposed, investigated and compared to existing methods, which are constructed based on the analysis of the stimulation (input) signals. We hypothesized that minimizing the occurrence of common sums in the multi-frequency SSVEP improves the performance of the interface, and that selection by pairs further increases the accuracy compared to selection by frequencies. An experiment with 12 participants was conducted to validate the hypotheses.

Results

Our results demonstrated a statistically significant improvement in decoding accuracy with the proposed optimization strategy based on multi-frequency SSVEP features compared to conventional techniques. Both hypotheses were validated by the experiments.

Conclusion

Performing selection by pairs and minimizing the number of common sums in selection by pairs are effective ways to select suitable frequency sets that improve multi-frequency SSVEP-based BCI accuracies.

Significance

This study provides guidance on frequency set selection in multi-frequency SSVEP. The proposed method in this study shows significant improvement in BCI performance (decoding accuracy) compared to existing methods in the literature.

Efficient Low-Frequency SSVEP Detection with Wearable EEG Using Normalized Canonical Correlation Analysis

Recent studies show that the integrity of core perceptual and cognitive functions may be tested in a short time with Steady-State Visual Evoked Potentials (SSVEP) with low stimulation frequencies, between 1 and 10 Hz. Wearable EEG systems provide unique opportunities to test these brain functions on diverse populations in out-of-the-lab conditions. However, they also pose significant challenges as the number of EEG channels is typically limited, and the recording conditions might induce high noise levels, particularly for low frequencies. Here we tested the performance of Normalized Canonical Correlation Analysis (NCCA), a frequency-normalized version of CCA, to quantify SSVEP from wearable EEG data with stimulation frequencies ranging from 1 to 10 Hz. We validated NCCA on data collected with an 8-channel wearable wireless EEG system based on BioWolf, a compact, ultra-light, ultra-low-power recording platform. The results show that NCCA correctly and rapidly detects SSVEP at the stimulation frequency within a few cycles of stimulation, even at the lowest frequency (4 s recordings are sufficient for a stimulation frequency of 1 Hz), outperforming a state-of-the-art normalized power spectral measure. Importantly, no preliminary artifact correction or channel selection was required. Potential applications of these results to research and clinical studies are discussed.

Estimating the Parameters of the Epileptor Model for Epileptic Seizure Suppression

Epilepsy is one of the most common brain disorders worldwide, affecting millions of people every year. Given the partially successful existing treatments for epileptiform activity suppression, dynamic mathematical models have been proposed with the purpose of better understanding the factors that might trigger an epileptic seizure and how to mitigate it, among which Epileptor stands out, due to its relative simplicity and consistency with experimental observations. Recent studies using this model have provided evidence that establishing a feedback-based control approach is possible. However, for this strategy to work properly, Epileptor's parameters, which describe the dynamic characteristics of a seizure, must be known beforehand. Therefore, this work proposes a methodology for estimating such parameters based on a successive optimization technique. The results show that it is feasible to approximate their values as they converge to reference values based on different initial conditions, which are modeled by an uncertainty factor or noise addition. Also, interictal (healthy) and ictal (ongoing seizure) conditions, as well as time resolution, must be taken into account for an appropriate estimation. At last, integrating such a parameter estimation approach with observers and controllers for purposes of seizure suppression is carried out, which might provide an interesting alternative for seizure suppression in practice in the future.

Novel hybrid visual stimuli incorporating periodic motions into conventional flickering or pattern-reversal visual stimuli for steady-state visual evoked potential-based brain-computer interfaces

In this study, we proposed a new type of hybrid visual stimuli for steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs), which incorporate various periodic motions into conventional flickering stimuli (FS) or pattern reversal stimuli (PRS). Furthermore, we investigated optimal periodic motions for each FS and PRS to enhance the performance of SSVEP-based BCIs. Periodic motions were implemented by changing the size of the stimulus according to four different temporal functions denoted by none, square, triangular, and sine, yielding a total of eight hybrid visual stimuli. Additionally, we developed the extended version of filter bank canonical correlation analysis (FBCCA), which is a state-of-the-art training-free classification algorithm for SSVEP-based BCIs, to enhance the classification accuracy for PRS-based hybrid visual stimuli. Twenty healthy individuals participated in the SSVEP-based BCI experiment to discriminate four visual stimuli with different frequencies. An average classification accuracy and information transfer rate (ITR) were evaluated to compare the performances of SSVEP-based BCIs for different hybrid visual stimuli. Additionally, the user's visual fatigue for each of the hybrid visual stimuli was also evaluated. As the result, for FS, the highest performances were reported when the periodic motion of the sine waveform was incorporated for all window sizes except for 3 s. For PRS, the periodic motion of the square waveform showed the highest classification accuracies for all tested window sizes. A significant statistical difference in the performance between the two best stimuli was not observed. The averaged fatigue scores were reported to be 5.3 ± 2.05 and 4.05 ± 1.28 for FS with sine-wave periodic motion and PRS with square-wave periodic motion, respectively. Consequently, our results demonstrated that FS with sine-wave periodic motion and PRS with square-wave periodic motion could effectively improve the BCI performances compared to conventional FS and PRS. In addition, thanks to its low visual fatigue, PRS with square-wave periodic motion can be regarded as the most appropriate visual stimulus for the long-term use of SSVEP-based BCIs, particularly for window sizes equal to or larger than 2 s.

Exploring the effects of head movements and accompanying gaze fixation switch on steady-state visual evoked potential

In a realistic steady-state visual evoked potential (SSVEP) based brain-computer interface (BCI) application like driving a car or controlling a quadrotor, observing the surrounding environment while simultaneously gazing at the stimulus is necessary. This kind of application inevitably could cause head movements and variation of the accompanying gaze fixation point, which might affect the SSVEP and BCI’s performance. However, few papers studied the effects of head movements and gaze fixation switch on SSVEP response, and the corresponding BCI performance. This study aimed to explore these effects by designing a new ball tracking paradigm in a virtual reality (VR) environment with two different moving tasks, i.e., the following and free moving tasks, and three moving patterns, pitch, yaw, and static. Sixteen subjects were recruited to conduct a BCI VR experiment. The offline data analysis showed that head moving patterns [F(2, 30) = 9.369, p = 0.001, effect size = 0.384] resulted in significantly different BCI decoding performance but the moving tasks had no effect on the results [F(1, 15) = 3.484, p = 0.082, effect size = 0.188]. Besides, the canonical correlation analysis (CCA) and filter bank canonical correlation analysis (FBCCA) accuracy were better than the PSDA and MEC methods in all of the conditions. These results implied that head movement could significantly affect the SSVEP performance but it was possible to switch gaze fixation to interact with the surroundings in a realistic BCI application.

Effects of Low Mental Energy from Long Periods of Work on Brain-Computer Interfaces

Brain-computer interfaces (BCIs) provide novel hands-free interaction strategies. However, the performance of BCIs is affected by the user’s mental energy to some extent. In this study, we aimed to analyze the combined effects of decreased mental energy and lack of sleep on BCI performance and how to reduce these effects. We defined the low-mental-energy (LME) condition as a combined condition of decreased mental energy and lack of sleep. We used a long period of work (>=18 h) to induce the LME condition, and then P300- and SSVEP-based BCI tasks were conducted in LME or normal conditions. Ten subjects were recruited in this study. Each subject participated in the LME- and normal-condition experiments within one week. For the P300-based BCI, we used two decoding algorithms: stepwise linear discriminant (SWLDA) and least square regression (LSR). For the SSVEP-based BCI, we used two decoding algorithms: canonical correlation analysis (CCA) and filter bank canonical correlation analysis (FBCCA). Accuracy and information transfer rate (ITR) were used as performance metrics. The experimental results showed that for the P300-based BCI, the average accuracy was reduced by approximately 35% (with a SWLDA classifier) and approximately 40% (with a LSR classifier); the average ITR was reduced by approximately 6 bits/min (with a SWLDA classifier) and approximately 7 bits/min (with an LSR classifier). For the SSVEP-based BCI, the average accuracy was reduced by approximately 40% (with a CCA classifier) and approximately 40% (with a FBCCA classifier); the average ITR was reduced by approximately 20 bits/min (with a CCA classifier) and approximately 19 bits/min (with a FBCCA classifier). Additionally, the amplitude and signal-to-noise ratio of the evoked electroencephalogram signals were lower in the LME condition, while the degree of fatigue and the task load of each subject were higher. Further experiments suggested that increasing stimulus size, flash duration, and flash number could improve BCI performance in LME conditions to some extent. Our experiments showed that the LME condition reduced BCI performance, the effects of LME on BCI did not rely on specific BCI types and specific decoding algorithms, and optimizing BCI parameters (e.g., stimulus size) can reduce these effects.

Channel selection from source localization: A review of four EEG-based brain-computer interfaces paradigms

Channel selection is a critical part of the classification procedure for multichannel electroencephalogram (EEG)-based brain-computer interfaces (BCI). An optimized subset of electrodes reduces computational complexity and optimizes accuracy. Different tasks activate different sources in the brain and are characterized by distinctive channels. The goal of the current review is to define a subset of electrodes for each of four popular BCI paradigms: motor imagery, motor execution, steady-state visual evoked potentials and P300. Twenty-one studies have been reviewed to identify the most significant activations of cortical sources. The relevant EEG sensors are determined from the reported 3D Talairach coordinates. They are scored by their weighted mean Cohen's d and its confidence interval, providing the magnitude of the corresponding effect size and its statistical significance. Our goal is to create a knowledge-based channel selection framework with a sufficient statistical power. The core channel selection (CCS) could be used as a reference by EEG researchers and would have the advantages of practicality and rapidity, allowing for an easy implementation of semiparametric algorithms.

Cross-Platform Implementation of an SSVEP-Based BCI for the Control of a 6-DOF Robotic Arm

Robotics has been successfully applied in the design of collaborative robots for assistance to people with motor disabilities. However, man-machine interaction is difficult for those who suffer severe motor disabilities. The aim of this study was to test the feasibility of a low-cost robotic arm control system with an EEG-based brain-computer interface (BCI). The BCI system relays on the Steady State Visually Evoked Potentials (SSVEP) paradigm. A cross-platform application was obtained in C++. This C++ platform, together with the open-source software Openvibe was used to control a Stäubli robot arm model TX60. Communication between Openvibe and the robot was carried out through the Virtual Reality Peripheral Network (VRPN) protocol. EEG signals were acquired with the 8-channel Enobio amplifier from Neuroelectrics. For the processing of the EEG signals, Common Spatial Pattern (CSP) filters and a Linear Discriminant Analysis classifier (LDA) were used. Five healthy subjects tried the BCI. This work allowed the communication and integration of a well-known BCI development platform such as Openvibe with the specific control software of a robot arm such as Stäubli TX60 using the VRPN protocol. It can be concluded from this study that it is possible to control the robotic arm with an SSVEP-based BCI with a reduced number of dry electrodes to facilitate the use of the system.

Brain-Computer Interfaces: Investigating the Transition from Visually Evoked to Purely Imagined Steady-State Potentials

Brain-Computer Interfaces (BCIs) based on Steady State Visually Evoked Potentials (SSVEPs) have proven effective and provide significant accuracy and information-transfer rates. This family of strategies, however, requires external devices that provide the frequency stimuli required by the technique. This limits the scenarios in which they can be applied, especially when compared to other BCI approaches. In this work, we have investigated the possibility of obtaining frequency responses in the EEG output based on the pure visual imagination of SSVEP-eliciting stimuli. Our results show that not only that EEG signals present frequency-specific peaks related to the frequency the user is focusing on, but also that promising classification accuracy can be achieved, paving the way for a robust and reliable visual imagery BCI modality. Clinical relevance-Brain computer interfaces play a fundamental role in enhancing the quality of life of patients with severe motor impairments. Strategies based on purely imagined stimuli, like the one presented here, are particularly impacting, especially in the most severe cases.

Cortical mechanisms of visual hypersensitivity in women at risk for chronic pelvic pain

ABSTRACT

Increased sensory sensitivity across non-nociceptive modalities is a common symptom of chronic pain conditions and is associated with chronic pain development. Providing a better understanding of the brain-behavior relationships that underlie multimodal hypersensitivity (MMH) may clarify the role of MMH in the development of chronic pain. We studied sensory hypersensitivity in a cohort of women (n = 147) who had diary confirmation of menstrual status and were enriched with risk factors for chronic pelvic pain, such as dysmenorrhea and increased bladder sensitivity. We administered 2 experimental tasks to evaluate the cross-modal relationship between visual and visceral sensitivity. Visual sensitivity was probed by presenting participants with a periodic pattern-reversal checkerboard stimulus presented across 5 brightness intensities during electroencephalography recording. Self-reported visual unpleasantness ratings for each brightness intensity were simultaneously assessed. Visceral sensitivity was evaluated with an experimental bladder-filling task associated with early clinical symptoms of chronic pelvic pain. Visually evoked cortical activity increased with brightness intensity across the entire scalp, especially at occipital electrode sites. Visual stimulation-induced unpleasantness was associated with provoked bladder pain and evoked primary visual cortex activity. However, the relationship between unpleasantness and cortical activity was moderated by provoked bladder pain. These results demonstrate that activity in the primary visual cortex is not greater in individuals with greater visceral sensitivity. We hypothesize that downstream interpretation or integration of this signal is amplified in individuals with visceral hypersensitivity. Future studies aimed at reducing MMH in chronic pain conditions should prioritize targeting of cortical mechanisms responsible for aberrant downstream sensory integration.

Improving user experience of SSVEP BCI through low amplitude depth and high frequency stimuli design

Steady-States Visually Evoked Potentials (SSVEP) refer to the sustained rhythmic activity observed in surface electroencephalography (EEG) in response to the presentation of repetitive visual stimuli (RVS). Due to their robustness and rapid onset, SSVEP have been widely used in Brain Computer Interfaces (BCI). However, typical SSVEP stimuli are straining to the eyes and present risks of triggering epileptic seizures. Reducing visual stimuli contrast or extending their frequency range both appear as relevant solutions to address these issues. It however remains sparsely documented how BCI performance is impacted by these features and to which extent user experience can be improved. We conducted two studies to systematically characterize the effects of frequency and amplitude depth reduction on SSVEP response. The results revealed that although high frequency stimuli improve visual comfort, their classification performance were not competitive enough to design a reliable/responsive BCI. Importantly, we found that the amplitude depth reduction of low frequency RVS is an effective solution to improve user experience while maintaining high classification performance. These findings were further validated by an online T9 SSVEP-BCI in which stimuli with 40% amplitude depth reduction achieved comparable results (>90% accuracy) to full amplitude stimuli while significantly improving user experience.

Dual Passive Reactive Brain-Computer Interface: A Novel Approach to Human-Machine Symbiosis

The present study proposes a novel concept of neuroadaptive technology, namely a dual passive-reactive Brain-Computer Interface (BCI), that enables bi-directional interaction between humans and machines. We have implemented such a system in a realistic flight simulator using the NextMind classification algorithms and framework to decode pilots' intention (reactive BCI) and to infer their level of attention (passive BCI). Twelve pilots used the reactive BCI to perform checklists along with an anti-collision radar monitoring task that was supervised by the passive BCI. The latter simulated an automatic avoidance maneuver when it detected that pilots missed an incoming collision. The reactive BCI reached 100% classification accuracy with a mean reaction time of 1.6 s when exclusively performing the checklist task. Accuracy was up to 98.5% with a mean reaction time of 2.5 s when pilots also had to fly the aircraft and monitor the anti-collision radar. The passive BCI achieved a F1-score of 0.94. This first demonstration shows the potential of a dual BCI to improve human-machine teaming which could be applied to a variety of applications.

Steady-State Visual Evoked Potential-Based Brain–Computer Interface Using a Novel Visual Stimulus with Quick Response (QR) Code Pattern

Steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) systems suffer from low SSVEP response intensity and visual fatigue, resulting in lower accuracy when operating the system for continuous commands, such as an electric wheelchair control. This study proposes two SSVEP improvements to create a practical BCI for communication and control in disabled people. The first is flicker pattern modification for increasing SSVEP response through mixing (1) fundamental and first harmonic frequencies, and (2) two fundamental frequencies for an additional number of commands. The second method utilizes a quick response (QR) code for visual stimulus patterns to increase the SSVEP response and reduce visual fatigue. Eight different stimulus patterns from three flickering frequencies (7, 13, and 17 Hz) were presented to twelve participants for the test and score levels of visual fatigue. Two popular SSVEP methods, i.e., power spectral density (PSD) with Welch periodogram and canonical correlation analysis (CCA) with overlapping sliding window, are used to detect SSVEP intensity and response, compared to the checkerboard pattern. The results suggest that the QR code patterns can yield higher accuracy than checkerboard patterns for both PSD and CCA methods. Moreover, a QR code pattern with low frequency can reduce visual fatigue; however, visual fatigue can be easily affected by high flickering frequency. The findings can be used in the future to implement a real-time, SSVEP-based BCI for verifying user and system performance in actual environments.

A Hybrid Brain-Computer Interface Based on Visual Evoked Potential and Pupillary Response

Brain-computer interface (BCI) based on steady-state visual evoked potential (SSVEP) has been widely studied due to the high information transfer rate (ITR), little user training, and wide subject applicability. However, there are also disadvantages such as visual discomfort and “BCI illiteracy.” To address these problems, this study proposes to use low-frequency stimulations (12 classes, 0.8–2.12 Hz with an interval of 0.12 Hz), which can simultaneously elicit visual evoked potential (VEP) and pupillary response (PR) to construct a hybrid BCI (h-BCI) system. Classification accuracy was calculated using supervised and unsupervised methods, respectively, and the hybrid accuracy was obtained using a decision fusion method to combine the information of VEP and PR. Online experimental results from 10 subjects showed that the averaged accuracy was 94.90 ± 2.34% (data length 1.5 s) for the supervised method and 91.88 ± 3.68% (data length 4 s) for the unsupervised method, which correspond to the ITR of 64.35 ± 3.07 bits/min (bpm) and 33.19 ± 2.38 bpm, respectively. Notably, the hybrid method achieved higher accuracy and ITR than that of VEP and PR for most subjects, especially for the short data length. Together with the subjects’ feedback on user experience, these results indicate that the proposed h-BCI with the low-frequency stimulation paradigm is more comfortable and favorable than the traditional SSVEP-BCI paradigm using the alpha frequency range.

Validation of a Novel Wearable Multistream Data Acquisition and Analysis System for Ergonomic Studies

Nowadays, the growing interest in gathering physiological data and human behavior in everyday life scenarios is paralleled by an increase in wireless devices recording brain and body signals. However, the technical issues that characterize these solutions often limit the full brain-related assessments in real-life scenarios. Here we introduce the Biohub platform, a hardware/software (HW/SW) integrated wearable system for multistream synchronized acquisitions. This system consists of off-the-shelf hardware and state-of-art open-source software components, which are highly integrated into a high-tech low-cost solution, complete, yet easy to use outside conventional labs. It flexibly cooperates with several devices, regardless of the manufacturer, and overcomes the possibly limited resources of recording devices. The Biohub was validated through the characterization of the quality of (i) multistream synchronization, (ii) in-lab electroencephalographic (EEG) recordings compared with a medical-grade high-density device, and (iii) a Brain-Computer-Interface (BCI) in a real driving condition. Results show that this system can reliably acquire multiple data streams with high time accuracy and record standard quality EEG signals, becoming a valid device to be used for advanced ergonomics studies such as driving, telerehabilitation, and occupational safety.

Burster Reconstruction Considering Unmeasurable Variables in the Epileptor Model

Epilepsy is one of the most common brain disorders worldwide, affecting millions of people every year. Although significant effort has been put into better understanding it and mitigating its effects, the conventional treatments are not fully effective. Advances in computational neuroscience, using mathematical dynamic models that represent brain activities at different scales, have enabled addressing epilepsy from a more theoretical standpoint. In particular, the recently proposed Epileptor model stands out among these models, because it represents well the main features of seizures, and the results from its simulations have been consistent with experimental observations. In addition, there has been an increasing interest in designing control techniques for Epileptor that might lead to possible realistic feedback controllers in the future. However, such approaches rely on knowing all of the states of the model, which is not the case in practice. The work explored in this letter aims to develop a state observer to estimate Epileptor's unmeasurable variables, as well as reconstruct the respective so-called bursters. Furthermore, an alternative modeling is presented for enhancing the convergence speed of an observer. The results show that the proposed approach is efficient under two main conditions: when the brain is undergoing a seizure and when a transition from the healthy to the epileptiform activity occurs.

Influence of the Number of Channels and Classification Algorithm on the Performance Robustness to Electrode Shift in Steady-State Visual Evoked Potential-Based Brain-Computer Interfaces

There remains an active investigation on elevating the classification accuracy and information transfer rate of brain-computer interfaces based on steady-state visual evoked potential. However, it has often been ignored that the performance of steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) can be affected through the minor displacement of the electrodes from their optimal locations in practical applications because of the mislocation of electrodes and/or concurrent use of electroencephalography (EEG) devices with external devices, such as virtual reality headsets. In this study, we evaluated the performance robustness of SSVEP-based BCIs with respect to the changes in electrode locations for various channel configurations and classification algorithms. Our experiments involved 21 participants, where EEG signals were recorded from the scalp electrodes densely attached to the occipital area of the participants. The classification accuracies for all the possible cases of electrode location shifts for various channel configurations (1–3 channels) were calculated using five training-free SSVEP classification algorithms, i.e., the canonical correlation analysis (CCA), extended CCA, filter bank CCA, multivariate synchronization index (MSI), and extended MSI (EMSI). Then, the performances of the BCIs were evaluated using two measures, i.e., the average classification accuracy (ACA) across the electrode shifts and robustness to the electrode shift (RES). Our results showed that the ACA increased with an increase in the number of channels regardless of the algorithm. However, the RES was enhanced with an increase in the number of channels only when MSI and EMSI were employed. While both ACA and RES values for the five algorithms were similar under the single-channel condition, both ACA and RES values for MSI and EMSI were higher than those of the other algorithms under the multichannel (i.e., two or three electrodes) conditions. In addition, EMSI outperformed MSI when comparing the ACA and RES values under the multichannel conditions. In conclusion, our results suggested that the use of multichannel configuration and employment of EMSI could make the performance of SSVEP-based BCIs more robust to the electrode shift from the optimal locations.

SSVEP based Wheelchair Navigation in Outdoor Environments. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021;2021:6424-6427. [PMID: 34892582 DOI: 10.1109/embc46164.2021.9629516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

A promising application of Brain Computer Interfaces (BCIs), and in particular of Steady-State Visually Evoked Potentials (SSVEP) is wheelchair navigation which can facilitate the daily life of patients suffering from severe paralysis. However, the outdoor performance of such a system is highly affected by uncontrolled environmental factors. In this paper, we present an SSVEP-based wheelchair navigation system and propose incremental learning as a method of adapting the system to changing environmental conditions.

Use of Force Feedback Device in a Hybrid Brain-Computer Interface Based on SSVEP, EOG and Eye Tracking for Sorting Items

Research focused on signals derived from the human organism is becoming increasingly popular. In this field, a special role is played by brain-computer interfaces based on brainwaves. They are becoming increasingly popular due to the downsizing of EEG signal recording devices and ever-lower set prices. Unfortunately, such systems are substantially limited in terms of the number of generated commands. This especially applies to sets that are not medical devices. This article proposes a hybrid brain-computer system based on the Steady-State Visual Evoked Potential (SSVEP), EOG, eye tracking, and force feedback system. Such an expanded system eliminates many of the particular system shortcomings and provides much better results. The first part of the paper presents information on the methods applied in the hybrid brain-computer system. The presented system was tested in terms of the ability of the operator to place the robot’s tip to a designated position. A virtual model of an industrial robot was proposed, which was used in the testing. The tests were repeated on a real-life industrial robot. Positioning accuracy of system was verified with the feedback system both enabled and disabled. The results of tests conducted both on the model and on the real object clearly demonstrate that force feedback improves the positioning accuracy of the robot’s tip when controlled by the operator. In addition, the results for the model and the real-life industrial model are very similar. In the next stage, research was carried out on the possibility of sorting items using the BCI system. The research was carried out on a model and a real robot. The results show that it is possible to sort using bio signals from the human body.

A hybrid environment control system combining EMG and SSVEP signal based on brain-computer interface technology

The patients who are impaired with neurodegenerative disorders cannot command their muscles through the neural pathways. These patients are given an alternative from their neural path through Brain-Computer Interface (BCI) systems, which are the explicit use of brain impulses without any need for a computer's vocal muscle. Nowadays, the steady-state visual evoked potential (SSVEP) modality offers a robust communication pathway to introduce a non-invasive BCI. There are some crucial constituents, including window length of SSVEP response, the number of electrodes in the acquisition device and system accuracy, which are the critical performance components in any BCI system based on SSVEP signal. In this study, a real-time hybrid BCI system consists of SSVEP and EMG has been proposed for the environmental control system. The feature in terms of the common spatial pattern (CSP) has been extracted from four classes of SSVEP response, and extracted feature has been classified using K-nearest neighbors (k-NN) based classification algorithm. The obtained classification accuracy of eight participants was 97.41%. Finally, a control mechanism that aims to apply for the environmental control system has also been developed. The proposed system can identify 18 commands (i.e., 16 control commands using SSVEP and two commands using EMG). This result represents very encouraging performance to handle real-time SSVEP based BCI system consists of a small number of electrodes. The proposed framework can offer a convenient user interface and a reliable control method for realistic BCI technology.

Brain-Computer Interface: Advancement and Challenges

Brain-Computer Interface (BCI) is an advanced and multidisciplinary active research domain based on neuroscience, signal processing, biomedical sensors, hardware, etc. Since the last decades, several groundbreaking research has been conducted in this domain. Still, no comprehensive review that covers the BCI domain completely has been conducted yet. Hence, a comprehensive overview of the BCI domain is presented in this study. This study covers several applications of BCI and upholds the significance of this domain. Then, each element of BCI systems, including techniques, datasets, feature extraction methods, evaluation measurement matrices, existing BCI algorithms, and classifiers, are explained concisely. In addition, a brief overview of the technologies or hardware, mostly sensors used in BCI, is appended. Finally, the paper investigates several unsolved challenges of the BCI and explains them with possible solutions.

Universal adversarial perturbations for CNN classifiers in EEG-based BCIs

Objective. Multiple convolutional neural network (CNN) classifiers have been proposed for electroencephalogram (EEG) based brain-computer interfaces (BCIs). However, CNN models have been found vulnerable to universal adversarial perturbations (UAPs), which are small and example-independent, yet powerful enough to degrade the performance of a CNN model, when added to a benign example.Approach. This paper proposes a novel total loss minimization (TLM) approach to generate UAPs for EEG-based BCIs.Main results. Experimental results demonstrated the effectiveness of TLM on three popular CNN classifiers for both target and non-target attacks. We also verified the transferability of UAPs in EEG-based BCI systems.Significance. To our knowledge, this is the first study on UAPs of CNN classifiers in EEG-based BCIs. UAPs are easy to construct, and can attack BCIs in real-time, exposing a potentially critical security concern of BCIs.

SSVEP-Based Brain-Computer Interface With a Limited Number of Frequencies Based on Dual-Frequency Biased Coding

How to encode as many targets as possible with a limited-frequency resource is a difficult problem in the practical use of a steady-state visual evoked potential (SSVEP) based brain-computer interface (BCI) speller. To solve this problem, this study developed a novel method called dual-frequency biased coding (DFBC) to tag targets in a SSVEP-based 48-character virtual speller, in which each target is encoded with a permutation sequence consisting of two permuted flickering periods that flash at different frequencies. The proposed paradigm was validated by 11 participants in an offline experiment and 7 participants in an online experiment. Three occipital channels (O1, Oz, and O2) were used to obtain the SSVEP signals for identifying the targets. Based on the coding characteristics of the DFBC method, the proposed approach has the ability of self-correction and thus achieves an accuracy of 76.6% and 79.3% for offline and online experiments, respectively, which outperforms the traditional multiple frequencies sequential coding (MFSC) method. This study demonstrates that DFBC is an efficient method for coding a high number of SSVEP targets with a small number of available frequencies.

Review of Riemannian Distances and Divergences, Applied to SSVEP-based BCI

The firstgeneration of brain-computer interfaces (BCI) classifies multi-channel electroencephalographic (EEG) signals, enhanced by optimized spatial filters.The second generation directly classifies covariance matrices estimated on EEG signals, based on straightforward algorithms such as the minimum-distance-to-Riemannian-mean (MDRM). Classification results vary greatly depending on the chosen Riemannian distance or divergence, whose definitions and reference implementations are spread across a wide mathematical literature. This paper reviews all the Riemannian distances and divergences to process covariance matrices, with an implementation compatible with BCI constraints. The impact of using different metrics is assessed on a steady-state visually evoked potentials (SSVEP) dataset, evaluating centers of classes and classification accuracy. Riemannian approaches embed crucial properties to process EEG data. The Riemannian centers of classes outperform Euclidean ones both in offline and online setups. Some Riemannian distances and divergences have better performances in terms of classification accuracy, while others have appealing computational efficiency.

Steady-State Visually Evoked Potentials and Feature-based Attention: Preregistered Null Results and a Focused Review of Methodological Considerations

Feature-based attention is the ability to selectively attend to a particular feature (e.g., attend to red but not green items while looking for the ketchup bottle in your refrigerator), and steady-state visually evoked potentials (SSVEPs) measured from the human EEG signal have been used to track the neural deployment of feature-based attention. Although many published studies suggest that we can use trial-by-trial cues to enhance relevant feature information (i.e., greater SSVEP response to the cued color), there is ongoing debate about whether participants may likewise use trial-by-trial cues to voluntarily ignore a particular feature. Here, we report the results of a preregistered study in which participants either were cued to attend or to ignore a color. Counter to prior work, we found no attention-related modulation of the SSVEP response in either cue condition. However, positive control analyses revealed that participants paid some degree of attention to the cued color (i.e., we observed a greater P300 component to targets in the attended vs. the unattended color). In light of these unexpected null results, we conducted a focused review of methodological considerations for studies of feature-based attention using SSVEPs. In the review, we quantify potentially important stimulus parameters that have been used in the past (e.g., stimulation frequency, trial counts) and we discuss the potential importance of these and other task factors (e.g., feature-based priming) for SSVEP studies.