Reducing the Calibration Time in Somatosensory BCI by Using Tactile ERD

A Human-Machine Joint Learning Framework to Boost Endogenous BCI Training

Brain-computer interfaces (BCIs) provide a direct pathway from the brain to external devices and have demonstrated great potential for assistive and rehabilitation technologies. Endogenous BCIs based on electroencephalogram (EEG) signals, such as motor imagery (MI) BCIs, can provide some level of control. However, mastering spontaneous BCI control requires the users to generate discriminative and stable brain signal patterns by imagery, which is challenging and is usually achieved over a very long training time (weeks/months). Here, we propose a human-machine joint learning framework to boost the learning process in endogenous BCIs, by guiding the user to generate brain signals toward an optimal distribution estimated by the decoder, given the historical brain signals of the user. To this end, we first model the human-machine joint learning process in a uniform formulation. Then a human-machine joint learning framework is proposed: 1) for the human side, we model the learning process in a sequential trial-and-error scenario and propose a novel "copy/new" feedback paradigm to help shape the signal generation of the subject toward the optimal distribution and 2) for the machine side, we propose a novel adaptive learning algorithm to learn an optimal signal distribution along with the subject's learning process. Specifically, the decoder reweighs the brain signals generated by the subject to focus more on "good" samples to cope with the learning process of the subject. Online and psuedo-online BCI experiments with 18 healthy subjects demonstrated the advantages of the proposed joint learning process over coadaptive approaches in both learning efficiency and effectiveness.

Electrotactile BCI for Top-Down Somatosensory Training: Clinical Feasibility Trial of Online BCI Control in Subacute Stroke Patients

This study investigates the feasibility of a novel brain-computer interface (BCI) device designed for sensory training following stroke. The BCI system administers electrotactile stimuli to the user's forearm, mirroring classical sensory training interventions. Concurrently, selective attention tasks are employed to modulate electrophysiological brain responses (somatosensory event-related potentials-sERPs), reflecting cortical excitability in related sensorimotor areas. The BCI identifies attention-induced changes in the brain's reactions to stimulation in an online manner. The study protocol assesses the feasibility of online binary classification of selective attention focus in ten subacute stroke patients. Each experimental session includes a BCI training phase for data collection and classifier training, followed by a BCI test phase to evaluate online classification of selective tactile attention based on sERP. During online classification tests, patients complete 20 repetitions of selective attention tasks with feedback on attention focus recognition. Using a single electroencephalographic channel, attention classification accuracy ranges from 70% to 100% across all patients. The significance of this novel BCI paradigm lies in its ability to quantitatively measure selective tactile attention resources throughout the therapy session, introducing a top-down approach to classical sensory training interventions based on repeated neuromuscular electrical stimulation.

Efficient Estimation of Directed Connectivity in Nonlinear and Nonstationary Spiking Neuron Networks

OBJECTIVE

Studying directed connectivity within spiking neuron networks can help understand neural mechanisms. Existing methods assume linear time-invariant neural dynamics with a fixed time lag in information transmission, while spiking networks usually involve complex dynamics that are nonlinear and nonstationary, and have varying time lags.

METHODS

We develop a Gated Recurrent Unit (GRU)-Point Process (PP) method to estimate directed connectivity within spiking networks. We use a GRU to describe the dependency of the target neuron's current firing rate on the source neurons' past spiking events and a PP to relate the target neuron's firing rate to its current 0-1 spiking event. The GRU model uses recurrent states and gate/activation functions to deal with varying time lags, nonlinearity, and nonstationarity in a parameter-efficient manner. We estimate the model using maximum likelihood and compute directed information as our measure of directed connectivity.

RESULTS

We conduct simulations using artificial spiking networks and a biophysical model of Parkinson's disease to show that GRU-PP systematically addresses varying time lags, nonlinearity, and nonstationarity, and estimates directed connectivity with high accuracy and data efficiency. We also use a non-human-primate dataset to show that GRU-PP correctly identifies the biophysically-plausible stronger PMd-to-M1 connectivity than M1-to-PMd connectivity during reaching. In all experiments, the GRU-PP consistently outperforms state-of-the-art methods.

CONCLUSION

The GRU-PP method efficiently estimates directed connectivity in varying time lag, nonlinear, and nonstationary spiking neuron networks.

SIGNIFICANCE

The proposed method can serve as a directed connectivity analysis tool for investigating complex spiking neuron network dynamics.

TSANet: multibranch attention deep neural network for classifying tactile selective attention in brain-computer interfaces

Brain-computer interfaces (BCIs) enable communication between the brain and a computer and electroencephalography (EEG) has been widely used to implement BCIs because of its high temporal resolution and noninvasiveness. Recently, a tactile-based EEG task was introduced to overcome the current limitations of visual-based tasks, such as visual fatigue from sustained attention. However, the classification performance of tactile-based BCIs as control signals is unsatisfactory. Therefore, a novel classification approach is required for this purpose. Here, we propose TSANet, a deep neural network, that uses multibranch convolutional neural networks and a feature-attention mechanism to classify tactile selective attention (TSA) in a tactile-based BCI system. We tested TSANet under three evaluation conditions, namely, within-subject, leave-one-out, and cross-subject. We found that TSANet achieved the highest classification performance compared with conventional deep neural network models under all evaluation conditions. Additionally, we show that TSANet extracts reasonable features for TSA by investigating the weights of spatial filters. Our results demonstrate that TSANet has the potential to be used as an efficient end-to-end learning approach in tactile-based BCIs.

Supplementary Information

The online version contains supplementary material available at 10.1007/s13534-023-00309-4.

Enhanced Motor Imagery Decoding by Calibration Model-Assisted With Tactile ERD

OBJECTIVE

In this study, we propose a tactile-assisted calibration method for a motor imagery (MI) based Brain-Computer Interface (BCI) system.

METHOD

In the proposed calibration, tactile stimulation was applied to the hand wrist to assist the subjects in the MI task, which is named SA-MI task. Then, classifier training in the SA-MI Calibration was performed using the SA-MI data, while the Conventional Calibration employed the MI data. After the classifiers were trained, the performance was evaluated on a common MI dataset.

RESULTS

Our study demonstrated that the SA-MI Calibration significantly improved the performance as compared with the Conventional Calibration, with a decoding accuracy of (78.3% vs. 71.3%). Moreover, the average calibration time could be reduced by 40%. This benefit of the SA-MI Calibration effect was further validated by an independent control group, which showed no improvement when tactile stimulation was not applied during the calibration phase. Further analysis showed that when compared with MI, greater motor-related cortical activation and higher R 2 value in the alpha-beta frequency band were induced in SA-MI.

CONCLUSION

Indeed, the SA-MI Calibration could significantly improve the performance and reduce the calibration time as compared with the Conventional Calibration.

SIGNIFICANCE

The proposed tactile stimulation-assisted MI Calibration method holds great potential for a faster and more accurate system setup at the beginning of BCI usage.

Novel electrotactile brain-computer interface with somatosensory event-related potential based control

Objective

A brain computer interface (BCI) allows users to control external devices using non-invasive brain recordings, such as electroencephalography (EEG). We developed and tested a novel electrotactile BCI prototype based on somatosensory event-related potentials (sERP) as control signals, paired with a tactile attention task as a control paradigm.

Approach

A novel electrotactile BCI comprises commercial EEG device, an electrical stimulator and custom software for EEG recordings, electrical stimulation control, synchronization between devices, signal processing, feature extraction, selection, and classification. We tested a novel BCI control paradigm based on tactile attention on a sensation at a target stimulation location on the forearm. Tactile stimuli were electrical pulses delivered at two proximal locations on the user's forearm for stimulating branches of radial and median nerves, with equal probability of the target and distractor stimuli occurrence, unlike in any other ERP-based BCI design. We proposed a compact electrical stimulation electrodes configuration for delivering electrotactile stimuli (target and distractor) using 2 stimulation channels and 3 stimulation electrodes. We tested the feasibility of a single EEG channel BCI control, to determine pseudo-online BCI performance, in ten healthy subjects. For optimizing the BCI performance we compared the results for two classifiers, sERP averaging approaches, and novel dedicated feature extraction/selection methods via cross-validation procedures.

Main results

We achieved a single EEG channel BCI classification accuracy in the range of 75.1 to 88.1% for all subjects. We have established an optimal combination of: single trial averaging to obtain sERP, feature extraction/selection methods and classification approach.

Significance

The obtained results demonstrate that a novel electrotactile BCI paradigm with equal probability of attended (target) and unattended (distractor) stimuli and proximal stimulation sites is feasible. This method may be used to drive restorative BCIs for sensory retraining in stroke or brain injury, or assistive BCIs for communication in severely disabled users.

Cortico-muscular coupling to control a hybrid brain-computer interface for upper limb motor rehabilitation: A pseudo-online study on stroke patients

Brain-Computer Interface (BCI) systems for motor rehabilitation after stroke have proven their efficacy to enhance upper limb motor recovery by reinforcing motor related brain activity. Hybrid BCIs (h-BCIs) exploit both central and peripheral activation and are frequently used in assistive BCIs to improve classification performances. However, in a rehabilitative context, brain and muscular features should be extracted to promote a favorable motor outcome, reinforcing not only the volitional control in the central motor system, but also the effective projection of motor commands to target muscles, i.e., central-to-peripheral communication. For this reason, we considered cortico-muscular coupling (CMC) as a feature for a h-BCI devoted to post-stroke upper limb motor rehabilitation. In this study, we performed a pseudo-online analysis on 13 healthy participants (CTRL) and 12 stroke patients (EXP) during executed (CTRL, EXP unaffected arm) and attempted (EXP affected arm) hand grasping and extension to optimize the translation of CMC computation and CMC-based movement detection from offline to online. Results showed that updating the CMC computation every 125 ms (shift of the sliding window) and accumulating two predictions before a final classification decision were the best trade-off between accuracy and speed in movement classification, independently from the movement type. The pseudo-online analysis on stroke participants revealed that both attempted and executed grasping/extension can be classified through a CMC-based movement detection with high performances in terms of classification speed (mean delay between movement detection and EMG onset around 580 ms) and accuracy (hit rate around 85%). The results obtained by means of this analysis will ground the design of a novel non-invasive h-BCI in which the control feature is derived from a combined EEG and EMG connectivity pattern estimated during upper limb movement attempts.