Decoding of voluntary and involuntary upper-limb motor imagery based on graph fourier transform and cross-frequency coupling coefficients

Deep learning-based framework for real-time upper limb motion intention classification using combined bio-signals

This research study proposes a unique framework that takes input from a surface electromyogram (sEMG) and functional near-infrared spectroscopy (fNIRS) bio-signals. These signals are trained using convolutional neural networks (CNN). The framework entails a real-time neuro-machine interface to decode the human intention of upper limb motions. The bio-signals from the two modalities are recorded for eight movements simultaneously for prosthetic arm functions focusing on trans-humeral amputees. The fNIRS signals are acquired from the human motor cortex, while sEMG is recorded from the human bicep muscles. The selected classification and command generation features are the peak, minimum, and mean ΔHbO and ΔHbR values within a 2-s moving window. In the case of sEMG, wavelength, peak, and mean were extracted with a 150-ms moving window. It was found that this scheme generates eight motions with an enhanced average accuracy of 94.5%. The obtained results validate the adopted research methodology and potential for future real-time neural-machine interfaces to control prosthetic arms.

Using linear parameter varying autoregressive models to measure cross frequency couplings in EEG signals

For years now, phase-amplitude cross frequency coupling (CFC) has been observed across multiple brain regions under different physiological and pathological conditions. It has been suggested that CFC serves as a mechanism that facilitates communication and information transfer between local and spatially separated neuronal populations. In non-invasive brain computer interfaces (BCI), CFC has not been thoroughly explored. In this work, we propose a CFC estimation method based on Linear Parameter Varying Autoregressive (LPV-AR) models and we assess its performance using both synthetic data and electroencephalographic (EEG) data recorded during attempted arm/hand movements of spinal cord injured (SCI) participants. Our results corroborate the potentiality of CFC as a feature for movement attempt decoding and provide evidence of the superiority of our proposed CFC estimation approach compared to other commonly used techniques.

Motor imagery evokes strengthened activation in sensorimotor areas and its effective connectivity related to cognitive regions in patients with complete spinal cord injury

The objective of this study was to investigate the alterations of brain activation and effective connectivity during motor imagery (MI) in complete spinal cord injury (CSCI) patients and to reveal a potential mechanism of MI in motor rehabilitation of CSCI patients. Fifteen CSCI patients and twenty healthy controls underwent the MI task-related fMRI scan, and the motor execution (ME) task only for healthy controls. The brain activation patterns of the two groups during MI, and CSCI patients during the MI task and healthy controls during the ME task were compared. Then the significantly changed brain activation areas in CSCI patients during the MI task were used as regions of interest for effective connectivity analysis, using a voxel-wise granger causality analysis (GCA) method. Compared with healthy controls, increased activations in left primary sensorimotor cortex and bilateral cerebellar lobules IV-VI were detected in CSCI patients during the MI task, and the activation level of these areas even equaled that of healthy controls during the ME task. Furthermore, GCA revealed decreased effective connectivity from sensorimotor related areas (primary sensorimotor cortex and cerebellar lobules IV-VI) to cognitive related areas (prefrontal cortex, precuneus, middle temporal gyrus, and inferior temporal gyrus) in CSCI patients. Our findings demonstrated that motor related brain areas can be functionally preserved and activated through MI after CSCI, it maybe the potential mechanism of MI in the motor rehabilitation of CSCI patients. In addition, Sensorimotor related brain regions have less influence on the cognitive related regions in CSCI patients during MI (The trial registration number: ChiCTR2000032793).

fNIRS-Based Upper Limb Motion Intention Recognition Using an Artificial Neural Network for Transhumeral Amputees

Prosthetic arms are designed to assist amputated individuals in the performance of the activities of daily life. Brain machine interfaces are currently employed to enhance the accuracy as well as number of control commands for upper limb prostheses. However, the motion prediction for prosthetic arms and the rehabilitation of amputees suffering from transhumeral amputations is limited. In this paper, functional near-infrared spectroscopy (fNIRS)-based approach for the recognition of human intention for six upper limb motions is proposed. The data were extracted from the study of fifteen healthy subjects and three transhumeral amputees for elbow extension, elbow flexion, wrist pronation, wrist supination, hand open, and hand close. The fNIRS signals were acquired from the motor cortex region of the brain by the commercial NIRSport device. The acquired data samples were filtered using finite impulse response (FIR) filter. Furthermore, signal mean, signal peak and minimum values were computed as feature set. An artificial neural network (ANN) was applied to these data samples. The results show the likelihood of classifying the six arm actions with an accuracy of 78%. The attained results have not yet been reported in any identical study. These achieved fNIRS results for intention detection are promising and suggest that they can be applied for the real-time control of the transhumeral prosthesis.

Motor Intention Decoding from the Upper Limb by Graph Convolutional Network Based on Functional Connectivity

Decoding brain intention from noninvasively measured neural signals has recently been a hot topic in brain-computer interface (BCI). The motor commands about the movements of fine parts can increase the degrees of freedom under control and be applied to external equipment without stimulus. In the decoding process, the classifier is one of the key factors, and the graph information of the EEG was ignored by most researchers. In this paper, a graph convolutional network (GCN) based on functional connectivity was proposed to decode the motor intention of four fine parts movements (shoulder, elbow, wrist, hand). First, event-related desynchronization was analyzed to reveal the differences between the four classes. Second, functional connectivity was constructed by using synchronization likelihood (SL), phase-locking value (PLV), H index (H), mutual information (MI), and weighted phase-lag index (WPLI) to acquire the electrode pairs with a difference. Subsequently, a GCN and convolutional neural networks (CNN) were performed based on functional topological structures and time points, respectively. The results demonstrated that the proposed method achieved a decoding accuracy of up to 92.81% in the four-class task. Besides, the combination of GCN and functional connectivity can promote the development of BCI.