Neurophysiological predictors and spectro-spatial discriminative features for enhancing SMR-BCI

Analyzing and computing humans by means of the brain using Brain-Computer Interfaces - understanding the user - previous evidence, self-relevance and the user's self-concept as potential superordinate human factors of relevance

Brain-computer interfaces (BCIs) are well-known instances of how technology can convert a user's brain activity taken from non-invasive electroencephalography (EEG) into computer commands for the purpose of computer-assisted communication and interaction. However, not all users are attaining the accuracy required to use a BCI consistently, despite advancements in technology. Accordingly, previous research suggests that human factors could be responsible for the variance in BCI performance among users. Therefore, the user's internal mental states and traits including motivation, affect or cognition, personality traits, or the user's satisfaction, beliefs or trust in the technology have been investigated. Going a step further, this manuscript aims to discuss which human factors could be potential superordinate factors that influence BCI performance, implicitly, explicitly as well as inter- and intraindividually. Based on the results of previous studies that used comparable protocols to examine the motivational, affective, cognitive state or personality traits of healthy and vulnerable EEG-BCI users within and across well-investigated BCIs (P300-BCIs or SMR-BCIs, respectively), it is proposed that the self-relevance of tasks and stimuli and the user's self-concept provide a huge potential for BCI applications. As potential key human factors self-relevance and the user's self-concept (self-referential knowledge and beliefs about one's self) guide information processing and modulate the user's motivation, attention, or feelings of ownership, agency, and autonomy. Changes in the self-relevance of tasks and stimuli as well as self-referential processing related to one's self (self-concept) trigger changes in neurophysiological activity in specific brain networks relevant to BCI. Accordingly, concrete examples will be provided to discuss how past and future research could incorporate self-relevance and the user's self-concept in the BCI setting - including paradigms, user instructions, and training sessions.

Functional-oriented, portable brain-computer interface training for hand motor recovery after stroke: a randomized controlled study

Background

Brain-computer interfaces (BCIs) have been proven to be effective for hand motor recovery after stroke. Facing kinds of dysfunction of the paretic hand, the motor task of BCIs for hand rehabilitation is relatively single, and the operation of many BCI devices is complex for clinical use. Therefore, we proposed a functional-oriented, portable BCI equipment and explored the efficiency of hand motor recovery after a stroke.

Materials and methods

Stroke patients were randomly assigned to the BCI group and the control group. The BCI group received BCI-based grasp/open motor training, while the control group received task-oriented guidance training. Both groups received 20 sessions of motor training in 4 weeks, and each session lasted for 30 min. The Fugl-Meyer assessment of the upper limb (FMA-UE) was applied for the assessment of rehabilitation outcomes, and the EEG signals were obtained for processing.

Results

The progress of FMA-UE between the BCI group [10.50 (5.75, 16.50)] and the control group [5.00 (4.00, 8.00)] was significantly different (Z = -2.834, P = 0.005). Meanwhile, the FMA-UE of both groups improved significantly (P < 0.001). A total of 24 patients in the BCI group achieved the minimal clinically important difference (MCID) of FMA-UE with an effective rate of 80%, and 16 in the control group achieved the MCID, with an effective rate of 51.6%. The lateral index of the open task in the BCI group was significantly decreased (Z = -2.704, P = 0.007). The average BCI accuracy for 24 stroke patients in 20 sessions was 70.7%, which was improved by 5.0% in the final session compared with the first session.

Conclusion

Targeted hand movement and two motor task modes, namely grasp and open, to be applied in a BCI design may be suitable in stroke patients with hand dysfunction. The functional-oriented, portable BCI training can promote hand recovery after a stroke, and it is expected to be widely used in clinical practice. The lateral index change of inter-hemispheric balance may be the mechanism of motor recovery.

Trial registration number

ChiCTR2100044492.

Correlation between the ERD in grasp/open tasks of BCIs and hand function of stroke patients: a cross-sectional study

BACKGROUND AND AIMS

Brain-computer interfaces (BCIs) are emerging as a promising tool for upper limb recovery after stroke, and motor tasks are an essential part of BCIs for patient training and control of rehabilitative/assistive BCIs. However, the correlation between brain activation with different levels of motor impairment and motor tasks in BCIs is still not so clear. Thus, we aim to compare the brain activation of different levels of motor impairment in performing the hand grasping and opening tasks in BCIs.

METHODS

We instructed stroke patients to perform motor attempts (MA) to grasp and open the affected hand for 30 trials, respectively. During this period, they underwent EEG acquisition and BCIs accuracy recordings. They also received detailed history records and behavioral scale assessments (the Fugl-Meyer assessment of upper limb, FMA-UE).

RESULTS

The FMA-UE was negatively correlated with the event-related desynchronization (ERD) of the affected hemisphere during open MA (R = - 0.423, P = 0.009) but not with grasp MA (R = - 0.058, P = 0.733). Then we divided the stroke patients into group 1 (Brunnstrom recovery stages between I to II, n = 19) and group 2 (Brunnstrom recovery stages between III to VI, n = 23). No difference during the grasping task (t = 0.091, P = 0.928), but a significant difference during the open task (t = 2.156, P = 0.037) was found between the two groups on the affected hemisphere. No significant difference was found in the unaffected hemisphere.

CONCLUSIONS

The study indicated that brain activation is positively correlated with the hand function of stroke in open-hand tasks. In the grasping task, the patients in the different groups have a similar brain response, while in the open task, mildly injured patients have more brain activation in open the hand than the poor hand function patients.

Sensorimotor Rhythm-Based Brain-Computer Interfaces for Motor Tasks Used in Hand Upper Extremity Rehabilitation after Stroke: A Systematic Review

Brain-computer interfaces (BCIs) are becoming more popular in the neurological rehabilitation field, and sensorimotor rhythm (SMR) is a type of brain oscillation rhythm that can be captured and analyzed in BCIs. Previous reviews have testified to the efficacy of the BCIs, but seldom have they discussed the motor task adopted in BCIs experiments in detail, as well as whether the feedback is suitable for them. We focused on the motor tasks adopted in SMR-based BCIs, as well as the corresponding feedback, and searched articles in PubMed, Embase, Cochrane library, Web of Science, and Scopus and found 442 articles. After a series of screenings, 15 randomized controlled studies were eligible for analysis. We found motor imagery (MI) or motor attempt (MA) are common experimental paradigms in EEG-based BCIs trials. Imagining/attempting to grasp and extend the fingers is the most common, and there were multi-joint movements, including wrist, elbow, and shoulder. There were various types of feedback in MI or MA tasks for hand grasping and extension. Proprioception was used more frequently in a variety of forms. Orthosis, robot, exoskeleton, and functional electrical stimulation can assist the paretic limb movement, and visual feedback can be used as primary feedback or combined forms. However, during the recovery process, there are many bottleneck problems for hand recovery, such as flaccid paralysis or opening the fingers. In practice, we should mainly focus on patients' difficulties, and design one or more motor tasks for patients, with the assistance of the robot, FES, or other combined feedback, to help them to complete a grasp, finger extension, thumb opposition, or other motion. Future research should focus on neurophysiological changes and functional improvements and further elaboration on the changes in neurophysiology during the recovery of motor function.

Direction decoding of imagined hand movements using subject-specific features from parietal EEG

OBJECTIVE

Research on decoding brain signals for controlling external devices is rapidly emerging, owing to its versatile potential applications including neuro-prosthetic control and neurorehabilitation. Electroencephalogram (EEG)-based non-invasive Brain Computer Interface (BCI) systems decode brain signals to establish an augmented communication and control pathway between the brain and the computer. The development of an efficient BCI system requires accurate decoding of neural activity underlying user's intentions. This study investigates the directional tuning of Electroencephalogram (EEG) characteristics from posterior parietal region, associated with bidirectional hand movement imagination (motor imagery) in left and right directions.

APPROACH

The imagined movement directions of the chosen hand were decoded using a combination of envelope and phase features derived from parietal EEG of both hemispheres. The proposed algorithm uses wavelet for spectral decomposition, and discriminative subject-specific subband levels are identified based on Fisher analysis of envelope and phase features. The selected features from the discriminative subband levels are used for classifying left and right motor imagery directions of the hand using Support Vector Machine Classifier. Furthermore, the performance of the proposed algorithm is evaluated by incorporating a maximum variance-based EEG time bin selection algorithm.

MAIN RESULTS

With the time bin selection approach using subject-specific features, the proposed algorithm yielded an average left vs right motor imagery direction decoding accuracy of 73.33% across 15 healthy subjects. In addition, decoding accuracy offered by the phase features was higher than that of the envelope features, indicating the importance of phase features in MI kinematics decoding.

SIGNIFICANCE

The results reveal the significance of parietal EEG in decoding imagined kinematics and open new possibilities for future BCI research.

Deep Neural Regression Prediction of Motor Imagery Skills Using EEG Functional Connectivity Indicators

Motor imaging (MI) induces recovery and neuroplasticity in neurophysical regulation. However, a non-negligible portion of users presents insufficient coordination skills of sensorimotor cortex control. Assessments of the relationship between wakefulness and tasks states are conducted to foster neurophysiological and mechanistic interpretation in MI-related applications. Thus, to understand the organization of information processing, measures of functional connectivity are used. Also, models of neural network regression prediction are becoming popular, These intend to reduce the need for extracting features manually. However, predicting MI practicing's neurophysiological inefficiency raises several problems, like enhancing network regression performance because of the overfitting risk. Here, to increase the prediction performance, we develop a deep network regression model that includes three procedures: leave-one-out cross-validation combined with Monte Carlo dropout layers, subject clustering of MI inefficiency, and transfer learning between neighboring runs. Validation is performed using functional connectivity predictors extracted from two electroencephalographic databases acquired in conditions close to real MI applications (150 users), resulting in a high prediction of pretraining desynchronization and initial training synchronization with adequate physiological interpretability.

Sensorimotor Functional Connectivity: A Neurophysiological Factor Related to BCI Performance

Brain-Computer Interfaces (BCIs) are systems that allow users to control devices using brain activity alone. However, the ability of participants to command BCIs varies from subject to subject. About 20% of potential users of sensorimotor BCIs do not gain reliable control of the system. The inefficiency to decode user's intentions requires the identification of neurophysiological factors determining “good” and “poor” BCI performers. One of the important neurophysiological aspects in BCI research is that the neuronal oscillations, used to control these systems, show a rich repertoire of spatial sensorimotor interactions. Considering this, we hypothesized that neuronal connectivity in sensorimotor areas would define BCI performance. Analyses for this study were performed on a large dataset of 80 inexperienced participants. They took part in a calibration and an online feedback session recorded on the same day. Undirected functional connectivity was computed over sensorimotor areas by means of the imaginary part of coherency. The results show that post- as well as pre-stimulus connectivity in the calibration recording is significantly correlated to online feedback performance in μ and feedback frequency bands. Importantly, the significance of the correlation between connectivity and BCI feedback accuracy was not due to the signal-to-noise ratio of the oscillations in the corresponding post and pre-stimulus intervals. Thus, this study demonstrates that BCI performance is not only dependent on the amplitude of sensorimotor oscillations as shown previously, but that it also relates to sensorimotor connectivity measured during the preceding training session. The presence of such connectivity between motor and somatosensory systems is likely to facilitate motor imagery, which in turn is associated with the generation of a more pronounced modulation of sensorimotor oscillations (manifested in ERD/ERS) required for the adequate BCI performance. We also discuss strategies for the up-regulation of such connectivity in order to enhance BCI performance.