Directional Decoding From EEG in a Center-Out Motor Imagery Task With Visual and Vibrotactile Guidance

Improved motor imagery skills after repetitive passive somatosensory stimulation: a parallel-group, pre-registered study

Introduction

Motor-imagery-based Brain-Machine Interface (MI-BMI) has been established as an effective treatment for post-stroke hemiplegia. However, the need for long-term intervention can represent a significant burden on patients. Here, we demonstrate that motor imagery (MI) instructions for BMI training, when supplemented with somatosensory stimulation in addition to conventional verbal instructions, can help enhance MI capabilities of healthy participants.

Methods

Sixteen participants performed MI during scalp EEG signal acquisition before and after somatosensory stimulation to assess MI-induced cortical excitability, as measured using the event-related desynchronization (ERD) of the sensorimotor rhythm (SMR). The non-dominant left hand was subjected to neuromuscular electrical stimulation above the sensory threshold but below the motor threshold (St-NMES), along with passive movement stimulation using an exoskeleton. Participants were randomly divided into an intervention group, which received somatosensory stimulation, and a control group, which remained at rest without stimulation.

Results

The intervention group exhibited a significant increase in SMR-ERD compared to the control group, indicating that somatosensory stimulation contributed to improving MI ability.

Discussion

This study demonstrates that somatosensory stimulation, combining electrical and mechanical stimuli, can improve MI capability and enhance the excitability of the sensorimotor cortex in healthy individuals.

Towards unlocking motor control in spinal cord injured by applying an online EEG-based framework to decode motor intention, trajectory and error processing

Brain-computer interfaces (BCIs) can translate brain signals directly into commands for external devices. Electroencephalography (EEG)-based BCIs mostly rely on the classification of discrete mental states, leading to unintuitive control. The ERC-funded project "Feel Your Reach" aimed to establish a novel framework based on continuous decoding of hand/arm movement intention, for a more natural and intuitive control. Over the years, we investigated various aspects of natural control, however, the individual components had not yet been integrated. Here, we present a first implementation of the framework in a comprehensive online study, combining (i) goal-directed movement intention, (ii) trajectory decoding, and (iii) error processing in a unique closed-loop control paradigm. Testing involved twelve able-bodied volunteers, performing attempted movements, and one spinal cord injured (SCI) participant. Similar movement-related cortical potentials and error potentials to previous studies were revealed, and the attempted movement trajectories were overall reconstructed. Source analysis confirmed the involvement of sensorimotor and posterior parietal areas for goal-directed movement intention and trajectory decoding. The increased experiment complexity and duration led to a decreased performance than each single BCI. Nevertheless, the study contributes to understanding natural motor control, providing insights for more intuitive strategies for individuals with motor impairments.

Motor Imagery Classification Based on EEG Sensing with Visual and Vibrotactile Guidance

Motor imagery (MI) is a technique of imagining the performance of a motor task without actually using the muscles. When employed in a brain-computer interface (BCI) supported by electroencephalographic (EEG) sensors, it can be used as a successful method of human-computer interaction. In this paper, the performance of six different classifiers, namely linear discriminant analysis (LDA), support vector machine (SVM), random forest (RF), and three classifiers from the family of convolutional neural networks (CNN), is evaluated using EEG MI datasets. The study investigates the effectiveness of these classifiers on MI, guided by a static visual cue, dynamic visual guidance, and a combination of dynamic visual and vibrotactile (somatosensory) guidance. The effect of filtering passband during data preprocessing was also investigated. The results show that the ResNet-based CNN significantly outperforms the competing classifiers on both vibrotactile and visually guided data when detecting different directions of MI. Preprocessing the data using low-frequency signal features proves to be a better solution to achieve higher classification accuracy. It has also been shown that vibrotactile guidance has a significant impact on classification accuracy, with the associated improvement particularly evident for architecturally simpler classifiers. These findings have important implications for the development of EEG-based BCIs, as they provide valuable insight into the suitability of different classifiers for different contexts of use.

Detection of motor imagery based on short-term entropy of time-frequency representations

BACKGROUND

Motor imagery is a cognitive process of imagining a performance of a motor task without employing the actual movement of muscles. It is often used in rehabilitation and utilized in assistive technologies to control a brain-computer interface (BCI). This paper provides a comparison of different time-frequency representations (TFR) and their Rényi and Shannon entropies for sensorimotor rhythm (SMR) based motor imagery control signals in electroencephalographic (EEG) data. The motor imagery task was guided by visual guidance, visual and vibrotactile (somatosensory) guidance or visual cue only.

RESULTS

When using TFR-based entropy features as an input for classification of different interaction intentions, higher accuracies were achieved (up to 99.87%) in comparison to regular time-series amplitude features (for which accuracy was up to 85.91%), which is an increase when compared to existing methods. In particular, the highest accuracy was achieved for the classification of the motor imagery versus the baseline (rest state) when using Shannon entropy with Reassigned Pseudo Wigner-Ville time-frequency representation.

CONCLUSIONS

Our findings suggest that the quantity of useful classifiable motor imagery information (entropy output) changes during the period of motor imagery in comparison to baseline period; as a result, there is an increase in the accuracy and F1 score of classification when using entropy features in comparison to the accuracy and the F1 of classification when using amplitude features, hence, it is manifested as an improvement of the ability to detect motor imagery.

Feel Your Reach: An EEG-Based Framework to Continuously Detect Goal-Directed Movements and Error Processing to Gate Kinesthetic Feedback Informed Artificial Arm Control

Establishing the basic knowledge, methodology, and technology for a framework for the continuous decoding of hand/arm movement intention was the aim of the ERC-funded project "Feel Your Reach". In this work, we review the studies and methods we performed and implemented in the last 6 years, which build the basis for enabling severely paralyzed people to non-invasively control a robotic arm in real-time from electroencephalogram (EEG). In detail, we investigated goal-directed movement detection, decoding of executed and attempted movement trajectories, grasping correlates, error processing, and kinesthetic feedback. Although we have tested some of our approaches already with the target populations, we still need to transfer the "Feel Your Reach" framework to people with cervical spinal cord injury and evaluate the decoders' performance while participants attempt to perform upper-limb movements. While on the one hand, we made major progress towards this ambitious goal, we also critically discuss current limitations.