Single trial analysis of slow cortical potentials: a study on anticipation related potentials

Neuro-motor controlled wearable augmentations: current research and emerging trends

Wearable augmentations (WAs) designed for movement and manipulation, such as exoskeletons and supernumerary robotic limbs, are used to enhance the physical abilities of healthy individuals and substitute or restore lost functionality for impaired individuals. Non-invasive neuro-motor (NM) technologies, including electroencephalography (EEG) and sufrace electromyography (sEMG), promise direct and intuitive communication between the brain and the WA. After presenting a historical perspective, this review proposes a conceptual model for NM-controlled WAs, analyzes key design aspects, such as hardware design, mounting methods, control paradigms, and sensory feedback, that have direct implications on the user experience, and in the long term, on the embodiment of WAs. The literature is surveyed and categorized into three main areas: hand WAs, upper body WAs, and lower body WAs. The review concludes by highlighting the primary findings, challenges, and trends in NM-controlled WAs. This review motivates researchers and practitioners to further explore and evaluate the development of WAs, ensuring a better quality of life.

Cross-domain prediction approach of human lower limb voluntary movement intention for exoskeleton robot based on EEG signals

Background and Objective

Exoskeleton robot control should ideally be based on human voluntary movement intention. The readiness potential (RP) component of the motion-related cortical potential is observed before movement in the electroencephalogram and can be used for intention prediction. However, its single-trial features are weak and highly variable, and existing methods cannot achieve high cross-temporal and cross-subject accuracies in practical online applications. Therefore, this work aimed to combine a deep convolutional neural network (CNN) framework with a transfer learning (TL) strategy to predict the lower limb voluntary movement intention, thereby improving the accuracy while enhancing the model generalization capability; this would also provide sufficient processing time for the response of the exoskeleton robotic system and help realize robot control based on the intention of the human body.

Methods

The signal characteristics of the RP for lower limb movement were analyzed, and a parameter TL strategy based on CNN was proposed to predict the intention of voluntary lower limb movements. We recruited 10 subjects for offline and online experiments. Multivariate empirical-mode decomposition was used to remove the artifacts, and the moment of onset of voluntary movement was labeled using lower limb electromyography signals during network training.

Results

The RP features can be observed from multiple data overlays before the onset of voluntary lower limb movements, and these features have long latency periods. The offline experimental results showed that the average movement intention prediction accuracy was 95.23% ± 1.25% for the right leg and 91.21% ± 1.48% for the left leg, which showed good cross-temporal and cross-subject generalization while greatly reducing the training time. Online movement intention prediction can predict results about 483.9 ± 11.9 ms before movement onset with an average accuracy of 82.75%.

Conclusion

The proposed method has a higher prediction accuracy with a lower training time, has good generalization performance for cross-temporal and cross-subject aspects, and is well-prioritized in terms of the temporal responses; these features are expected to lay the foundation for further investigations on exoskeleton robot control.

Convolutional spiking neural networks for intent detection based on anticipatory brain potentials using electroencephalogram

Spiking neural networks (SNNs) are receiving increased attention because they mimic synaptic connections in biological systems and produce spike trains, which can be approximated by binary values for computational efficiency. Recently, the addition of convolutional layers to combine the feature extraction power of convolutional networks with the computational efficiency of SNNs has been introduced. This paper studies the feasibility of using a convolutional spiking neural network (CSNN) to detect anticipatory slow cortical potentials (SCPs) related to braking intention in human participants using an electroencephalogram (EEG). Data was collected during an experiment wherein participants operated a remote-controlled vehicle on a testbed designed to simulate an urban environment. Participants were alerted to an incoming braking event via an audio countdown to elicit anticipatory potentials that were measured using an EEG. The CSNN's performance was compared to a standard CNN, EEGNet and three graph neural networks via 10-fold cross-validation. The CSNN outperformed all the other neural networks, and had a predictive accuracy of 99.06% with a true positive rate of 98.50%, a true negative rate of 99.20% and an F1-score of 0.98. Performance of the CSNN was comparable to the CNN in an ablation study using a subset of EEG channels that localized SCPs. Classification performance of the CSNN degraded only slightly when the floating-point EEG data were converted into spike trains via delta modulation to mimic synaptic connections.

Exploring EEG-based motor imagery decoding: a dual approach using spatial features and spectro-spatial Deep Learning model IFNet

Introduction

In recent years, the decoding of motor imagery (MI) from electroencephalography (EEG) signals has become a focus of research for brain-machine interfaces (BMIs) and neurorehabilitation. However, EEG signals present challenges due to their non-stationarity and the substantial presence of noise commonly found in recordings, making it difficult to design highly effective decoding algorithms. These algorithms are vital for controlling devices in neurorehabilitation tasks, as they activate the patient's motor cortex and contribute to their recovery.

Methods

This study proposes a novel approach for decoding MI during pedalling tasks using EEG signals. A widespread approach is based on feature extraction using Common Spatial Patterns (CSP) followed by a linear discriminant analysis (LDA) as a classifier. The first approach covered in this work aims to investigate the efficacy of a task-discriminative feature extraction method based on CSP filter and LDA classifier. Additionally, the second alternative hypothesis explores the potential of a spectro-spatial Convolutional Neural Network (CNN) to further enhance the performance of the first approach. The proposed CNN architecture combines a preprocessing pipeline based on filter banks in the frequency domain with a convolutional neural network for spectro-temporal and spectro-spatial feature extraction.

Results and discussion

To evaluate the approaches and their advantages and disadvantages, EEG data has been recorded from several able-bodied users while pedalling in a cycle ergometer in order to train motor imagery decoding models. The results show levels of accuracy up to 80% in some cases. The CNN approach shows greater accuracy despite higher instability.

Predicting Tacit Coordination Success Using Electroencephalogram Trajectories: The Impact of Task Difficulty

In this study, we aim to develop a machine learning model to predict the level of coordination between two players in tacit coordination games by analyzing the similarity of their spatial EEG features. We present an analysis, demonstrating the model's sensitivity, which was assessed through three conventional measures (precision, recall, and f1 score) based on the EEG patterns. These measures are evaluated in relation to the coordination task difficulty, as determined by the coordination index (CI). Tacit coordination games are games in which two individuals are requested to select the same option out of a closed set without the ability to communicate. This study aims to examine the effect of the difficulty of a semantic coordination task on the ability to predict a successful coordination between two players based on the compatibility between their EEG signals. The difficulty of each of the coordination tasks was estimated based on the degree of dispersion of the different answers given by the players reflected by the CI. The classification of the spatial distance between each pair of individual brain patterns, analyzed using the random walk algorithm, was used to predict whether successful coordination occurred or not. The classification performance was obtained for each game individually, i.e., for each different complexity level, via recall and precision indices. The results showed that the classifier performance depended on the CI, that is, on the level of coordination difficulty. These results, along with possibilities for future research, are discussed.

Human-robot collaborative task planning using anticipatory brain responses

Human-robot interaction (HRI) describes scenarios in which both human and robot work as partners, sharing the same environment or complementing each other on a joint task. HRI is characterized by the need for high adaptability and flexibility of robotic systems toward their human interaction partners. One of the major challenges in HRI is task planning with dynamic subtask assignment, which is particularly challenging when subtask choices of the human are not readily accessible by the robot. In the present work, we explore the feasibility of using electroencephalogram (EEG) based neuro-cognitive measures for online robot learning of dynamic subtask assignment. To this end, we demonstrate in an experimental human subject study, featuring a joint HRI task with a UR10 robotic manipulator, the presence of EEG measures indicative of a human partner anticipating a takeover situation from human to robot or vice-versa. The present work further proposes a reinforcement learning based algorithm employing these measures as a neuronal feedback signal from the human to the robot for dynamic learning of subtask-assignment. The efficacy of this algorithm is validated in a simulation-based study. The simulation results reveal that even with relatively low decoding accuracies, successful robot learning of subtask-assignment is feasible, with around 80% choice accuracy among four subtasks within 17 minutes of collaboration. The simulation results further reveal that scalability to more subtasks is feasible and mainly accompanied with longer robot learning times. These findings demonstrate the usability of EEG-based neuro-cognitive measures to mediate the complex and largely unsolved problem of human-robot collaborative task planning.

A comprehensive review on motion trajectory reconstruction for EEG-based brain-computer interface

The advance in neuroscience and computer technology over the past decades have made brain-computer interface (BCI) a most promising area of neurorehabilitation and neurophysiology research. Limb motion decoding has gradually become a hot topic in the field of BCI. Decoding neural activity related to limb movement trajectory is considered to be of great help to the development of assistive and rehabilitation strategies for motor-impaired users. Although a variety of decoding methods have been proposed for limb trajectory reconstruction, there does not yet exist a review that covers the performance evaluation of these decoding methods. To alleviate this vacancy, in this paper, we evaluate EEG-based limb trajectory decoding methods regarding their advantages and disadvantages from a variety of perspectives. Specifically, we first introduce the differences in motor execution and motor imagery in limb trajectory reconstruction with different spaces (2D and 3D). Then, we discuss the limb motion trajectory reconstruction methods including experiment paradigm, EEG pre-processing, feature extraction and selection, decoding methods, and result evaluation. Finally, we expound on the open problem and future outlooks.

Movement-Related Cortical Potentials in Embodied Virtual Mirror Visual Feedback

Background: Mirror therapy is thought to drive interhemispheric communication, resulting in a balanced activation. We hypothesized that embodied virtual mirror visual feedback (VR-MVF) presented on a computer screen may produce a similar activation. In this proof-of-concept study, we investigated differences in movement-related cortical potentials (MRCPs) in the electroencephalogram (EEG) from different visual feedback of user movements in 1 stroke patient and 13 age-matched adults. Methods: A 60-year-old right-handed (Edinburgh score >95) male ischemic stroke [left paramedian pontine, National Institutes of Health Stroke Scale (NIHSS) = 6] patient and 13 age-matched right-handed (Edinburgh score >80) healthy adults (58 ± 9 years; six female) participated in the study. We recorded 16-electrode electroencephalogram (EEG), while participants performed planar center-out movements in two embodied visual feedback conditions: (i) direct (movements translated to the avatar's ipsilateral side) and (ii) mirror (movements translated to the avatar's contralateral side) with left (direct left/mirror left) or right (direct right/mirror right) arms. Results: As hypothesized, we observed more balanced MRCP hemispheric negativity in the mirror right compared to the direct right condition [statistically significant at the FC4 electrode; 99.9% CI, (0.81, 13)]. MRCPs in the stroke participant showed reduced lateralized negativity in the direct left (non-paretic) situation compared to healthy participants. Interestingly, the potentials were stronger in the mirror left (non-paretic) compared to direct left case, with significantly more bilateral negativity at FC3 [95% CI (0.758 13.2)] and C2 [95% CI (0.04 9.52)]. Conclusions: Embodied mirror visual feedback is likely to influence bilateral sensorimotor cortical subthreshold activity during movement preparation and execution observed in MRCPs in both healthy participants and a stroke patient.

Influential Factors of an Asynchronous BCI for Movement Intention Detection

In recent years, asynchronous brain computer interface (BCI) systems have been utilized in many domains such as robot controlling, assistive technology, and rehabilitation. In such BCI systems, movement intention detection algorithms are used to detect movement desires. In recent years, movement-related cortical potential (MRCP), an electroencephalogram (EEG) pattern representing voluntary movement intention, attracts wide attention in movement intention detection. Unfortunately, low MRCP detection accuracy makes the asynchronous BCI system impractical for real usage. In order to develop an effective MRCP detection algorithm, EEG data have to be properly preprocessed. In this work, we investigate the relationship and effects of three factors including frequency bands, spatial filters, and classifiers on MRCP classification performance to determine best settings. In particular, we performed a systematic performance investigation on combinations of five frequency bands, five spatial filters, and six classifiers. The EEG data were acquired from subjects performing series of self-paced ankle dorsiflexions. Analysis of variance (ANOVA) statistical test was performed on F1 scores to investigate effects of these three factors. The results show that frequency bands and spatial filters depend on each other. The combinations directly affect the F1 scores, so they have to be chosen carefully. The results can be used as guidelines for BCI researchers to effectively design a preprocessing method for an advanced asynchronous BCI system, which can assist the stroke rehabilitation.

Distance- and speed-informed kinematics decoding improves M/EEG based upper-limb movement decoder accuracy

OBJECTIVE

One of the main goals in brain-computer interface (BCI) research is the replacement or restoration of lost function in individuals with paralysis. One line of research investigates the inference of movement kinematics from brain activity during different volitional states. A growing number of electroencephalography (EEG) and magnetoencephalography (MEG) studies suggest that information about directional (e.g. velocity) and nondirectional (e.g. speed) movement kinematics is accessible noninvasively. We sought to assess if the neural information associated with both types of kinematics can be combined to improve the decoding accuracy.

APPROACH

In an offline analysis, we reanalyzed the data of two previous experiments containing the recordings of 34 healthy participants (15 EEG, 19 MEG). We decoded 2D movement trajectories from low-frequency M/EEG signals in executed and observed tracking movements, and compared the accuracy of an unscented Kalman filter (UKF) that explicitly modeled the nonlinear relation between directional and nondirectional kinematics to the accuracies of linear Kalman (KF) and Wiener filters which did not combine both types of kinematics.

MAIN RESULTS

At the group level, posterior-parietal and parieto-occipital (executed and observed movements) and sensorimotor areas (executed movements) encoded kinematic information. Correlations between the recorded position and velocity trajectories and the UKF decoded ones were on average 0.49 during executed and 0.36 during observed movements. Compared to the other filters, the UKF could achieve the best trade-off between maximizing the signal to noise ratio and minimizing the amplitude mismatch between the recorded and decoded trajectories.

SIGNIFICANCE

We present direct evidence that directional and nondirectional kinematic information is simultaneously detectable in low-frequency M/EEG signals. Moreover, combining directional and nondirectional kinematic information significantly improves the decoding accuracy upon a linear KF.

Decoding Movement-Related Cortical Potentials Based on Subject-Dependent and Section-Wise Spectral Filtering

An important challenge in developing a movement-related cortical potential (MRCP)-based brain-machine interface (BMI) is an accurate decoding of the user intention for real-world environments. However, the performance remains insufficient for real-time decoding owing to the endogenous signal characteristics compared to other BMI paradigms. This study aims to enhance the MRCP decoding performance from the perspective of preprocessing techniques (i.e., spectral filtering). To the best of our knowledge, existing MRCP studies have used spectral filters with a fixed frequency bandwidth for all subjects. Hence, we propose a subject-dependent and section-wise spectral filtering (SSSF) method that considers the subjects' individual MRCP characteristics for two different temporal sections. In this study, MRCP data were acquired under a powered exoskeleton environments in which the subjects conducted self-initiated walking. We evaluated our method using both our experimental data and a public dataset (BNCI Horizon 2020). The decoding performance using the SSSF was 0.86 (±0.09), and the performance on the public dataset was 0.73 (±0.06) across all subjects. The experimental results showed a statistically significant enhancement ( ) compared with the fixed frequency bands used in previous methods on both datasets. In addition, we presented successful decoding results from a pseudo-online analysis. Therefore, we demonstrated that the proposed SSSF method can involve more meaningful MRCP information than conventional methods.

Contingent negative variation during a modified cueing task in simulated driving

The obscured pedestrian-motor vehicle crash has become a serious danger to driving safety. The present study aims to investigate the contingent negative variation (CNV) during the anticipation of an obscured pedestrian-motor vehicle crash in simulated driving. We adopted two cueing tasks: (i) a traditional cognitive paradigm of cueing task that has been widely used to study anticipatory process, and (ii) a modified cueing task in simulated driving scenes, in which Electroencephalogram (EEG) signals of 32 participants were recorded to detect the CNV. Simulated car following and pedestrian crossing tasks were designed to measure anticipation-related driving behaviors. The results showed that both early and late CNVs were observed in two cueing tasks. The mean amplitude of the late CNV during a modified cueing task in simulated driving was significantly larger than that in a traditional cueing task, which was not the case for the early CNV potentials. In addition, both early and late CNVs elicited in simulated driving were significantly correlated with anticipatory driving behaviors (e.g., the minimum time to collision). These findings show that CNV potentials during the anticipation of an obscured pedestrian-motor vehicle crash might predict anticipation-related risky driving behaviors.

Detection of reaching intention using EEG signals and nonlinear dynamic system identification

BACKGROUND AND OBJECTIVES

Low frequency electroencephalography (EEG) signals are associated with preparation of movement and thus provide valuable information for brain-machine interface applications. The purpose of this study was to detect movement intention from EEG signals before execution of self-paced arm reaching movements.

METHODS

Ten healthy individuals were recruited. Movement onset was determined from surface electromyography recordings time-locked with EEG signals. Unlike previous studies, which employed feature extraction and classification for decoding, a nonlinear dynamic multiple-input/single output (MISO) model was developed. The MISO model consisted of a cascade of Volterra structures and a threshold block, generating the binary output corresponding to intention/no-intention. The modeling process included input selection from a pool of different EEG channels. The predictive performance of the model was evaluated using the receiver operating characteristics curve, from which the optimum threshold was also selected. The Mann-Whitney statistics was employed to select the significant EEG channels for the output by examining the statistical significance of improvement in the predictive capability of the model when the respective channels were included.

RESULTS

With the proposed approach, movement intention was detected approximately 500 ms before the movement onset and on average, with an accuracy of 96.37 ± 0.94%, a sensitivity of 77.93 ± 4.40% and a specificity of 98.52 ± 1.19%.

CONCLUSIONS

The model output can be converted to motion commands for neuroprosthetic devices and exoskeletons in future applications.

Neural anticipatory mechanisms predict faster reaction times and higher fluid intelligence

Higher cognitive ability is reliably linked to better performance on chronometric tasks (i.e., faster reaction times, RT), yet the neural basis of these effects remains unclear. Anticipatory processes represent compelling yet understudied potential mechanisms of these effects, which may facilitate performance through reducing the uncertainty surrounding the temporal onset of stimuli (temporal uncertainty) and/or facilitating motor readiness despite uncertainty about impending target locations (target uncertainty). Specifically, the contingent negative variation (CNV) represents a compelling candidate mechanism of anticipatory motor planning, while the alpha oscillation is thought to be sensitive to temporal contingencies in perceptual systems. The current study undertook a secondary analysis of a large data set (n = 91) containing choice RT, cognitive ability, and EEG measurements to help clarify these issues. Single-trial EEG analysis in conjunction with mixed-effects modeling revealed that higher fluid intelligence corresponded to faster RT on average. When considered together, temporal and target uncertainty moderated the RT-ability relationship, with higher ability being associated with greater resilience to both types of uncertainty. Target uncertainty attenuated the amplitude of the CNV for all participants, but higher ability individuals were more resilient to this effect. Similarly, only higher ability individuals showed increased prestimulus alpha power (at left-lateralized sites) during longer, more easily anticipated interstimulus intervals. Collectively, these findings emphasize top-down anticipatory processes as likely contributors to chronometry-ability correlations.

Synchronization of Slow Cortical Rhythms During Motor Imagery-Based Brain–Machine Interface Control

Modulation of sensorimotor rhythm (SMR) power, a rhythmic brain oscillation physiologically linked to motor imagery, is a popular Brain–Machine Interface (BMI) paradigm, but its interplay with slower cortical rhythms, also involved in movement preparation and cognitive processing, is not entirely understood. In this study, we evaluated the changes in phase and power of slow cortical activity in delta and theta bands, during a motor imagery task controlled by an SMR-based BMI system. In Experiment I, EEG of 20 right-handed healthy volunteers was recorded performing a motor-imagery task using an SMR-based BMI controlling a visual animation, and during task-free intervals. In Experiment II, 10 subjects were evaluated along five daily sessions, while BMI-controlling same visual animation, a buzzer, and a robotic hand exoskeleton. In both experiments, feedback received from the controlled device was proportional to SMR power (11–14[Formula: see text]Hz) detected by a real-time EEG-based system. Synchronization of slow EEG frequencies along the trials was evaluated using inter-trial-phase coherence (ITPC). Results: cortical oscillations of EEG in delta and theta frequencies synchronized at the onset and at the end of both active and task-free trials; ITPC was significantly modulated by feedback sensory modality received during the tasks; and ITPC synchronization progressively increased along the training. These findings suggest that phase-locking of slow rhythms and resetting by sensory afferences might be a functionally relevant mechanism in cortical control of motor function. We propose that analysis of phase synchronization of slow cortical rhythms might also improve identification of temporal edges in BMI tasks and might help to develop physiological markers for identification of context task switching and practice-related changes in brain function, with potentially important implications for design and monitoring of motor imagery-based BMI systems, an emerging tool in neurorehabilitation of stroke.

Neural Oscillations and the Initiation of Voluntary Movement

The brain processes involved in the planning and initiation of voluntary action are of great interest for understanding the relationship between conscious awareness of decisions and the neural control of movement. Voluntary motor behavior has generally been considered to occur when conscious decisions trigger movements. However, several studies now provide compelling evidence that brain states indicative of forthcoming movements take place before a person becomes aware of a conscious decision to act. While such studies have created much debate over the nature of ‘free will,’ at the very least they suggest that unconscious brain processes are predictive of forthcoming movements. Recent studies suggest that slow changes in neuroelectric potentials may play a role in the timing of movement onset by pushing brain activity above a threshold to trigger the initiation of action. Indeed, recent studies have shown relationships between the phase of low frequency oscillatory activity of the brain and the onset of voluntary action. Such studies, however, cannot determine whether this underlying neural activity plays a causal role in the initiation of movement or is only associated with the intentional behavior. Non-invasive transcranial alternating current brain stimulation can entrain neural activity at particular frequencies in order to assess whether underlying brain processes are causally related to associated behaviors. In this review, we examine the evidence for neural coding of action as well as the brain states prior to action initiation and discuss whether low frequency alternating current brain stimulation could influence the timing of a persons’ decision to act.

EEG-Based Lower-Limb Movement Onset Decoding: Continuous Classification and Asynchronous Detection

Brain-machine interfaces have been used to incorporate the user intention to trigger robotic devices by decoding movement onset from electroencephalography. Active neural participation is crucial to promote brain plasticity thus to enhance the opportunity of motor recovery. This paper presents the decoding of lower-limb movement-related cortical potentials with continuous classification and asynchronous detection. We executed experiments in a customized gait trainer, where 10 healthy subjects performed self-initiated ankle plantar flexion. We further analyzed the features, evaluated the impact of the limb side, and compared the proposed framework with other typical decoding methods. No significant differences were observed between the left and right legs in terms of neural signatures of movement and classification performance. We obtained a higher true positive rate, lower false positives, and comparable latencies with respect to the existing online detection methods. This paper demonstrates the feasibility of the proposed framework to build a closed-loop gait trainer. Potential applications include gait training neurorehabilitation in clinical trials.

How Electroencephalogram Reference Influences the Movement Readiness Potential?

Readiness potential (RP) based on electroencephalograms (EEG) has been studied extensively in recent years, but no studies have investigated the influence of the reference electrode on RP. In order to investigate the reference effect, 10 subjects were recruited and the original vertex reference (Cz) was used to record the raw EEG signal when the subjects performed a motor preparation task. The EEG was then transformed to the common average reference (CAR) and reference electrode standardization technique (REST) reference, and we analyzed the RP waveform and voltage topographies and calculated the classification accuracy of idle and RP EEG segments. Our results showed that the RP waveform and voltage topographies were greatly influenced by the reference, but the classification accuracy was less affected if proper channels were selected as features. Since the Cz channel is near the primary motor cortex, where the source of RP is located, using the REST and CAR references is recommended to get accurate RP waveforms and voltage topographies.

Decoding of Self-paced Lower-Limb Movement Intention: A Case Study on the Influence Factors

Brain-machine interfaces (BMIs) have been applied as new rehabilitation tools for motor disabled individuals. Active involvement of cerebral activity has been shown to enhance neuroplasticity and thus to restore mobility. Various studies have focused on the detection of upper-limb movement intention, while the fewer study has investigated the lower-limb movement intention decoding. This study presents a BMI to decode the self-paced lower-limb movement intention, with 10 healthy subjects participating in the experiment. We varied four influence factors including the movement type (dorsiflexion or plantar flexion), the limb side (left or right leg), the processing method (time-series analysis based on MRCP, i.e., movement-related cortical potential or frequency-domain estimation based on SMR, i.e., sensory motor rhythm) and the frequency band (e.g., delta, theta, mu, beta and MRCP band at [0.1 1] Hz), to estimate both single-trial and sample-based performance. Feature analysis was then conducted to show the discriminant power (DP) and brain modulations. The average detection latency was -0.334 ± 0.216 s in single-trial basis across all conditions. An average area under the curve (AUC) of 91.0 ± 3.5% and 68.2 ± 4.6% was obtained for the MRCP-based and SMR-based method in the classification, respectively. The best performance was yielded from plantar flexion with left leg using time-series analysis on the MRCP band. The feature analysis indicated a cross-subject consistency of DP with the MRCP-based method and subject-specific variance of DP with the SMR-based method. The results presented here might be further exploited in a rehabilitation scenario. The comprehensive factor analysis might be used to shed light on the design of an effective brain switch to trigger external robotic devices.

Deployment of Mobile EEG Technology in an Art Museum Setting: Evaluation of Signal Quality and Usability

Electroencephalography (EEG) has emerged as a powerful tool for quantitatively studying the brain that enables natural and mobile experiments. Recent advances in EEG have allowed for the use of dry electrodes that do not require a conductive medium between the recording electrode and the scalp. The overall goal of this research was to gain an understanding of the overall usability and signal quality of dry EEG headsets compared to traditional gel-based systems in an unconstrained environment. EEG was used to collect Mobile Brain-body Imaging (MoBI) data from 432 people as they experienced an art exhibit in a public museum. The subjects were instrumented with either one of four dry electrode EEG systems or a conventional gel electrode EEG system. Each of the systems was evaluated based on the signal quality and usability in a real-world setting. First, we describe the various artifacts that were characteristic of each of the systems. Second, we report on each system's usability and their limitations in a mobile setting. Third, to evaluate signal quality for task discrimination and characterization, we employed a data driven clustering approach on the data from 134 of the 432 subjects (those with reliable location tracking information and usable EEG data) to evaluate the power spectral density (PSD) content of the EEG recordings. The experiment consisted of a baseline condition in which the subjects sat quietly facing a white wall for 1 min. Subsequently, the participants were encouraged to explore the exhibit for as long as they wished (piece-viewing). No constraints were placed upon the individual in relation to action, time, or navigation of the exhibit. In this freely-behaving approach, the EEG systems varied in their capacity to record characteristic modulations in the EEG data, with the gel-based system more clearly capturing stereotypical alpha and beta-band modulations.

Evaluation of filtering techniques to extract movement intention information from low-frequency EEG activity

Low-frequency electroencephalographic (EEG) activity provides relevant information for decoding movement commands in healthy subjects and paralyzed patients. Brainmachine interfaces (BMI) exploiting these signals have been developed to provide closed-loop feedback and induce neuroplasticity. Several offline and online studies have already demonstrated that discriminable information related to movement can be decoded from low-frequency EEG activity. However, there is still not a well-established procedure to guarantee that this activity is optimally filtered from the background noise. This work compares different configurations of non-causal (i.e., offline) and causal (i.e., online) filters to classify movement-related cortical potentials (MRCP) with six healthy subjects during reaching movements. Our results reveal important differences in MRCP decoding accuracy dependent on the selected frequency band for both offline and online approaches. In summary, this paper underlines the importance of optimally choosing filter parameters, since their variable response has an impact on the classification of low EEG frequencies for BMI.

Detection of Movement Related Cortical Potentials from EEG Using Constrained ICA for Brain-Computer Interface Applications

The movement related cortical potential (MRCP), a slow cortical potential from the scalp electroencephalogram (EEG), has been used in real-time brain-computer-interface (BCI) systems designed for neurorehabilitation. Detecting MPCPs in real time with high accuracy and low latency is essential in these applications. In this study, we propose a new MRCP detection method based on constrained independent component analysis (cICA). The method was tested for MRCP detection during executed and imagined ankle dorsiflexion of 24 healthy participants, and compared with four commonly used spatial filters for MRCP detection in an offline experiment. The effect of cICA and the compared spatial filters on the morphology of the extracted MRCP was evaluated by two indices quantifying the signal-to-noise ratio and variability of the extracted MRCP. The performance of the filters for detection was then directly compared for accuracy and latency. The latency obtained with cICA (-34 ± 29 ms motor execution (ME) and 28 ± 16 ms for motor imagery (MI) dataset) was significantly smaller than with all other spatial filters. Moreover, cICA resulted in greater true positive rates (87.11 ± 11.73 for ME and 86.66 ± 6.96 for MI dataset) and lower false positive rates (20.69 ± 13.68 for ME and 19.31 ± 12.60 for MI dataset) compared to the other methods. These results confirm the superiority of cICA in MRCP detection with respect to previously proposed EEG filtering approaches.

Advantages of EEG phase patterns for the detection of gait intention in healthy and stroke subjects

OBJECTIVE

One use of EEG-based brain-computer interfaces (BCIs) in rehabilitation is the detection of movement intention. In this paper we investigate for the first time the instantaneous phase of movement related cortical potential (MRCP) and its application to the detection of gait intention.

APPROACH

We demonstrate the utility of MRCP phase in two independent datasets, in which 10 healthy subjects and 9 chronic stroke patients executed a self-initiated gait task in three sessions. Phase features were compared to more conventional amplitude and power features.

MAIN RESULTS

The neurophysiology analysis showed that phase features have higher signal-to-noise ratio than the other features. Also, BCI detectors of gait intention based on phase, amplitude, and their combination were evaluated under three conditions: session-specific calibration, intersession transfer, and intersubject transfer. Results show that the phase based detector is the most accurate for session-specific calibration (movement intention was correctly detected in 66.5% of trials in healthy subjects, and in 63.3% in stroke patients). However, in intersession and intersubject transfer, the detector that combines amplitude and phase features is the most accurate one and the only that retains its accuracy (62.5% in healthy subjects and 59% in stroke patients) w.r.t. session-specific calibration.

SIGNIFICANCE

MRCP phase features improve the detection of gait intention and could be used in practice to remove time-consuming BCI recalibration.

Classification of upper limb center-out reaching tasks by means of EEG-based continuous decoding techniques

Background

One of the current challenges in brain-machine interfacing is to characterize and decode upper limb kinematics from brain signals, e.g. to control a prosthetic device. Recent research work states that it is possible to do so based on low frequency EEG components. However, the validity of these results is still a matter of discussion. In this paper, we assess the feasibility of decoding upper limb kinematics from EEG signals in center-out reaching tasks during passive and active movements.

Methods

The decoding of arm movement was performed using a multidimensional linear regression. Passive movements were analyzed using the same methodology to study the influence of proprioceptive sensory feedback in the decoding. Finally, we evaluated the possible advantages of classifying reaching targets, instead of continuous trajectories.

Results

The results showed that arm movement decoding was significantly above chance levels. The results also indicated that EEG slow cortical potentials carry significant information to decode active center-out movements. The classification of reached targets allowed obtaining the same conclusions with a very high accuracy. Additionally, the low decoding performance obtained from passive movements suggests that discriminant modulations of low-frequency neural activity are mainly related to the execution of movement while proprioceptive feedback is not sufficient to decode upper limb kinematics.

Conclusions

This paper contributes to the assessment of feasibility of using linear regression methods to decode upper limb kinematics from EEG signals. From our findings, it can be concluded that low frequency bands concentrate most of the information extracted from upper limb kinematics decoding and that decoding performance of active movements is above chance levels and mainly related to the activation of cortical motor areas. We also show that the classification of reached targets from decoding approaches may be a more suitable real-time methodology than a direct decoding of hand position.

Active Electrodes for Wearable EEG Acquisition: Review and Electronics Design Methodology

Active electrodes (AEs), i.e., electrodes with built-in readout circuitry, are increasingly being implemented in wearable healthcare and lifestyle applications due to AEs' robustness to environmental interference. An AE locally amplifies and buffers μV-level EEG signals before driving any cabling. The low output impedance of an AE mitigates cable motion artifacts, thus enabling the use of high-impedance dry electrodes for greater user comfort. However, developing a wearable EEG system, with medical grade signal quality on noise, electrode offset tolerance, common-mode rejection ratio, input impedance, and power dissipation, remains a challenging task. This paper reviews state-of-the-art bio-amplifier architectures and low-power analog circuits design techniques intended for wearable EEG acquisition, with a special focus on an AE system interfaced with dry electrodes.

Detection of movement related cortical potential: effects of causal vs. non-causal processing

Movement Related Cortical Potentials (MRCP) have been the subject of numerous studies. They accompany many self-initiated movements and this makes them a good candidate for incorporation in BCI paradigms. In this work we propose a novel experimental protocol involving natural controlling of a computer mouse and based on EEG recordings from 5 subjects, show that it elicits MRCP. We also show the feasibility of online detection of MRCP by implementing a classification based detection framework. Additionally, we discuss the adverse effects of causality restriction on detection performance by implementing an additional offline approach relaxing those restrictions and comparing the results. The best MRCP detection performance achieved on the recorded data with the offline approach has an average maximum accuracy of 0.76 and with the online approach an average AUC of 0.953.

Design and Optimization of an EEG-Based Brain Machine Interface (BMI) to an Upper-Limb Exoskeleton for Stroke Survivors

This study demonstrates the feasibility of detecting motor intent from brain activity of chronic stroke patients using an asynchronous electroencephalography (EEG)-based brain machine interface (BMI). Intent was inferred from movement related cortical potentials (MRCPs) measured over an optimized set of EEG electrodes. Successful intent detection triggered the motion of an upper-limb exoskeleton (MAHI Exo-II), to guide movement and to encourage active user participation by providing instantaneous sensory feedback. Several BMI design features were optimized to increase system performance in the presence of single-trial variability of MRCPs in the injured brain: (1) an adaptive time window was used for extracting features during BMI calibration; (2) training data from two consecutive days were pooled for BMI calibration to increase robustness to handle the day-to-day variations typical of EEG, and (3) BMI predictions were gated by residual electromyography (EMG) activity from the impaired arm, to reduce the number of false positives. This patient-specific BMI calibration approach can accommodate a broad spectrum of stroke patients with diverse motor capabilities. Following BMI optimization on day 3, testing of the closed-loop BMI-MAHI exoskeleton, on 4th and 5th days of the study, showed consistent BMI performance with overall mean true positive rate (TPR) = 62.7 ± 21.4% on day 4 and 67.1 ± 14.6% on day 5. The overall false positive rate (FPR) across subjects was 27.74 ± 37.46% on day 4 and 27.5 ± 35.64% on day 5; however for two subjects who had residual motor function and could benefit from the EMG-gated BMI, the mean FPR was quite low (< 10%). On average, motor intent was detected -367 ± 328 ms before movement onset during closed-loop operation. These findings provide evidence that closed-loop EEG-based BMI for stroke patients can be designed and optimized to perform well across multiple days without system recalibration.

Factors of Influence on the Performance of a Short-Latency Non-Invasive Brain Switch: Evidence in Healthy Individuals and Implication for Motor Function Rehabilitation

Brain-computer interfacing (BCI) has recently been applied as a rehabilitation approach for patients with motor disorders, such as stroke. In these closed-loop applications, a brain switch detects the motor intention from brain signals, e.g., scalp EEG, and triggers a neuroprosthetic device, either to deliver sensory feedback or to mimic real movements, thus re-establishing the compromised sensory-motor control loop and promoting neural plasticity. In this context, single trial detection of motor intention with short latency is a prerequisite. The performance of the event detection from EEG recordings is mainly determined by three factors: the type of motor imagery (e.g., repetitive, ballistic), the frequency band (or signal modality) used for discrimination (e.g., alpha, beta, gamma, and MRCP, i.e., movement-related cortical potential), and the processing technique (e.g., time-series analysis, sub-band power estimation). In this study, we investigated single trial EEG traces during movement imagination on healthy individuals, and provided a comprehensive analysis of the performance of a short-latency brain switch when varying these three factors. The morphological investigation showed a cross-subject consistency of a prolonged negative phase in MRCP, and a delayed beta rebound in sensory-motor rhythms during repetitive tasks. The detection performance had the greatest accuracy when using ballistic MRCP with time-series analysis. In this case, the true positive rate (TPR) was ~70% for a detection latency of ~200 ms. The results presented here are of practical relevance for designing BCI systems for motor function rehabilitation.

Detecting intention to walk in stroke patients from pre-movement EEG correlates

BACKGROUND

Most studies in the field of brain-computer interfacing (BCI) for lower limbs rehabilitation are carried out with healthy subjects, even though insights gained from healthy populations may not generalize to patients in need of a BCI.

METHODS

We investigate the ability of a BCI to detect the intention to walk in stroke patients from pre-movement EEG correlates. Moreover, we also investigated how the motivation of the patients to execute a task related to the rehabilitation therapy affects the BCI accuracy. Nine chronic stroke patients performed a self-initiated walking task during three sessions, with an intersession interval of one week.

RESULTS

Using a decoder that combines temporal and spectral sparse classifiers we detected pre-movement state with an accuracy of 64 % in a range between 18 % and 85.2 %, with the chance level at 4 %. Furthermore, we found a significantly strong positive correlation (r = 0.561, p = 0.048) between the motivation of the patients to perform the rehabilitation related task and the accuracy of the BCI detector of their intention to walk.

CONCLUSIONS

We show that a detector based on temporal and spectral features can be used to classify pre-movement state in stroke patients. Additionally, we found that patients' motivation to perform the task showed a strong correlation to the attained detection rate of their walking intention.

Your Brain on Art: Emergent Cortical Dynamics During Aesthetic Experiences

The brain response to conceptual art was studied with mobile electroencephalography (EEG) to examine the neural basis of aesthetic experiences. In contrast to most studies of perceptual phenomena, participants were moving and thinking freely as they viewed the exhibit The Boundary of Life is Quietly Crossed by Dario Robleto at the Menil Collection-Houston. The brain activity of over 400 subjects was recorded using dry-electrode and one reference gel-based EEG systems over a period of 3 months. Here, we report initial findings based on the reference system. EEG segments corresponding to each art piece were grouped into one of three classes (complex, moderate, and baseline) based on analysis of a digital image of each piece. Time, frequency, and wavelet features extracted from EEG were used to classify patterns associated with viewing art, and ranked based on their relevance for classification. The maximum classification accuracy was 55% (chance = 33%) with delta and gamma features the most relevant for classification. Functional analysis revealed a significant increase in connection strength in localized brain networks while subjects viewed the most aesthetically pleasing art compared to viewing a blank wall. The direction of signal flow showed early recruitment of broad posterior areas followed by focal anterior activation. Significant differences in the strength of connections were also observed across age and gender. This work provides evidence that EEG, deployed on freely behaving subjects, can detect selective signal flow in neural networks, identify significant differences between subject groups, and report with greater-than-chance accuracy the complexity of a subject's visual percept of aesthetically pleasing art. Our approach, which allows acquisition of neural activity “in action and context,” could lead to understanding of how the brain integrates sensory input and its ongoing internal state to produce the phenomenon which we term aesthetic experience.

Detecting movement intent from scalp EEG in a novel upper limb robotic rehabilitation system for stroke

Stroke can be a source of significant upper extremity dysfunction and affect the quality of life (QoL) in survivors. In this context, novel rehabilitation approaches employing robotic rehabilitation devices combined with brain-machine interfaces can greatly help in expediting functional recovery in these individuals by actively engaging the user during therapy. However, optimal training conditions and parameters for these novel therapeutic systems are still unknown. Here, we present preliminary findings demonstrating successful movement intent detection from scalp electroencephalography (EEG) during robotic rehabilitation using the MAHI Exo-II in an individual with hemiparesis following stroke. These findings have strong clinical implications for the development of closed-loop brain-machine interfaces to robotic rehabilitation systems.

Teaching brain-machine interfaces as an alternative paradigm to neuroprosthetics control

Brain-machine interfaces (BMI) usually decode movement parameters from cortical activity to control neuroprostheses. This requires subjects to learn to modulate their brain activity to convey all necessary information, thus imposing natural limits on the complexity of tasks that can be performed. Here we demonstrate an alternative and complementary BMI paradigm that overcomes that limitation by decoding cognitive brain signals associated with monitoring processes relevant for achieving goals. In our approach the neuroprosthesis executes actions that the subject evaluates as erroneous or correct, and exploits the brain correlates of this assessment to learn suitable motor behaviours. Results show that, after a short user's training period, this teaching BMI paradigm operated three different neuroprostheses and generalized across several targets. Our results further support that these error-related signals reflect a task-independent monitoring mechanism in the brain, making this teaching paradigm scalable. We anticipate this BMI approach to become a key component of any neuroprosthesis that mimics natural motor control as it enables continuous adaptation in the absence of explicit information about goals. Furthermore, our paradigm can seamlessly incorporate other cognitive signals and conventional neuroprosthetic approaches, invasive or non-invasive, to enlarge the range and complexity of tasks that can be accomplished.

Comparison of Features for Movement Prediction from Single-Trial Movement-Related Cortical Potentials in Healthy Subjects and Stroke Patients

Detection of movement intention from the movement-related cortical potential (MRCP) derived from the electroencephalogram (EEG) signals has shown to be important in combination with assistive devices for effective neurofeedback in rehabilitation. In this study, we compare time and frequency domain features to detect movement intention from EEG signals prior to movement execution. Data were recoded from 24 able-bodied subjects, 12 performing real movements, and 12 performing imaginary movements. Furthermore, six stroke patients with lower limb paresis were included. Temporal and spectral features were investigated in combination with linear discriminant analysis and compared with template matching. The results showed that spectral features were best suited for differentiating between movement intention and noise across different tasks. The ensemble average across tasks when using spectral features was (error = 3.4 ± 0.8%, sensitivity = 97.2 ± 0.9%, and specificity = 97 ± 1%) significantly better (P < 0.01) than temporal features (error = 15 ± 1.4%, sensitivity: 85 ± 1.3%, and specificity: 84 ± 2%). The proposed approach also (error = 3.4 ± 0.8%) outperformed template matching (error = 26.9 ± 2.3%) significantly (P > 0.001). Results imply that frequency information is important for detecting movement intention, which is promising for the application of this approach to provide patient-driven real-time neurofeedback.

Global cortical activity predicts shape of hand during grasping

Recent studies show that the amplitude of cortical field potentials is modulated in the time domain by grasping kinematics. However, it is unknown if these low frequency modulations persist and contain enough information to decode grasp kinematics in macro-scale activity measured at the scalp via electroencephalography (EEG). Further, it is unclear as to whether joint angle velocities or movement synergies are the optimal kinematics spaces to decode. In this offline decoding study, we infer from human EEG, hand joint angular velocities as well as synergistic trajectories as subjects perform natural reach-to-grasp movements. Decoding accuracy, measured as the correlation coefficient (r) between the predicted and actual movement kinematics, was r = 0.49 ± 0.02 across 15 hand joints. Across the first three kinematic synergies, decoding accuracies were r = 0.59 ± 0.04, 0.47 ± 0.06, and 0.32 ± 0.05. The spatial-temporal pattern of EEG channel recruitment showed early involvement of contralateral frontal-central scalp areas followed by later activation of central electrodes over primary sensorimotor cortical areas. Information content in EEG about the grasp type peaked at 250 ms after movement onset. The high decoding accuracies in this study are significant not only as evidence for time-domain modulation in macro-scale brain activity, but for the field of brain-machine interfaces as well. Our decoding strategy, which harnesses the neural “symphony” as opposed to local members of the neural ensemble (as in intracranial approaches), may provide a means of extracting information about motor intent for grasping without the need for penetrating electrodes and suggests that it may be soon possible to develop non-invasive neural interfaces for the control of prosthetic limbs.

Electrode fusion for the prediction of self-initiated fine movements from single-trial readiness potentials

Current human-machine interfaces (HMIs) for users with severe disabilities often have difficulty distinguishing between intentional and inadvertent activations. Pre-movement neuro-cortical activity may aid in this elusive discrimination task but has not been exploited in HMIs. This work investigates the utility of the readiness potential (RP), a slow negative cortical potential preceding voluntary movement, for detecting the intention of self-initiated fine movements prior to their motoric realization. We recorded electroencephalography from the frontal, central, parietal and occipital lobes of 10 participants using a self-initiated switch activation protocol. Eye movement artifacts were removed by regression and the RP was detected on a single-trial basis, in a narrow frequency range (0.1-1 Hz). Common average reference was applied prior to windowed-averaging for feature extraction. Electrodes were selected according to a separability measure based on Fisher projection. Our findings demonstrate that feature fusion from an optimal number of electrodes achieves a statistically significant lower classification error than the best single classifier. Finally, voluntary fine movement intention was detected on a single-trial basis at above-chance levels approximately 396 ms before physical switch activation. These findings encourage the development of rapid-response, intention-aware HMIs for individuals with severe disabilities who struggle with executing voluntary fine motor movements.

Continuous decoding of movement intention of upper limb self-initiated analytic movements from pre-movement EEG correlates

BACKGROUND

Brain-machine interfaces (BMI) have recently been integrated within motor rehabilitation therapies by actively involving the central nervous system (CNS) within the exercises. For instance, the online decoding of intention of motion of a limb from pre-movement EEG correlates is being used to convert passive rehabilitation strategies into active ones mediated by robotics. As early stages of upper limb motor rehabilitation usually focus on analytic single-joint mobilizations, this paper investigates the feasibility of building BMI decoders for these specific types of movements.

METHODS

Two different experiments were performed within this study. For the first one, six healthy subjects performed seven self-initiated upper-limb analytic movements, involving from proximal to distal articulations. For the second experiment, three spinal cord injury patients performed two of the previously studied movements with their healthy elbow and paralyzed wrist. In both cases EEG neural correlates such as the event-related desynchronization (ERD) and movement related cortical potentials (MRCP) were analyzed, as well as the accuracies of continuous decoders built using the pre-movement features of these correlates (i.e., the intention of motion was decoded before movement onset).

RESULTS

The studied movements could be decoded in both healthy subjects and patients. For healthy subjects there were significant differences in the EEG correlates and decoding accuracies, dependent on the moving joint. Percentages of correctly anticipated trials ranged from 75% to 40% (with chance level being around 20%), with better performances for proximal than for distal movements. For the movements studied for the SCI patients the accuracies were similar to the ones of the healthy subjects.

CONCLUSIONS

This paper shows how it is possible to build continuous decoders to detect movement intention from EEG correlates for seven different upper-limb analytic movements. Furthermore we report differences in accuracies among movements, which might have an impact on the design of the rehabilitation technologies that will integrate this new type of information. The applicability of the decoders was shown in a clinical population, with similar performances between healthy subjects and patients.

Enhanced low-latency detection of motor intention from EEG for closed-loop brain-computer interface applications

In recent years, the detection of voluntary motor intentions from electroencephalogram (EEG) has been used for triggering external devices in closed-loop brain-computer interface (BCI) research. Movement-related cortical potentials (MRCP), a type of slow cortical potentials, have been recently used for detection. In order to enhance the efficacy of closed-loop BCI systems based on MRCPs, a manifold method called Locality Preserving Projection, followed by a linear discriminant analysis (LDA) classifier (LPP-LDA) is proposed in this paper to detect MRCPs from scalp EEG in real time. In an online experiment on nine healthy subjects, LPP-LDA statistically outperformed the classic matched filter approach with greater true positive rate (79 ± 11% versus 68 ± 10%; p = 0.007) and less false positives (1.4 ± 0.8/min versus 2.3 ± 1.1/min; p = 0.016 ). Moreover, the proposed system performed detections with significantly shorter latency (315 ± 165 ms versus 460 ± 123 ms; p = 0.013), which is a fundamental characteristics to induce neuroplastic changes in closed-loop BCIs, following the Hebbian principle. In conclusion, the proposed system works as a generic brain switch, with high accuracy, low latency, and easy online implementation. It can thus be used as a fundamental element of BCI systems for neuromodulation and motor function rehabilitation.

Single trial prediction of self-paced reaching directions from EEG signals

Early detection of movement intention could possibly minimize the delays in the activation of neuroprosthetic devices. As yet, single trial analysis using non-invasive approaches for understanding such movement preparation remains a challenging task. We studied the feasibility of predicting movement directions in self-paced upper limb center-out reaching tasks, i.e., spontaneous movements executed without an external cue that can better reflect natural motor behavior in humans. We reported results of non-invasive electroencephalography (EEG) recorded from mild stroke patients and able-bodied participants. Previous studies have shown that low frequency EEG oscillations are modulated by the intent to move and therefore, can be decoded prior to the movement execution. Motivated by these results, we investigated whether slow cortical potentials (SCPs) preceding movement onset can be used to classify reaching directions and evaluated the performance using 5-fold cross-validation. For able-bodied subjects, we obtained an average decoding accuracy of 76% (chance level of 25%) at 62.5 ms before onset using the amplitude of on-going SCPs with above chance level performances between 875 to 437.5 ms prior to onset. The decoding accuracy for the stroke patients was on average 47% with their paretic arms. Comparison of the decoding accuracy across different frequency ranges (i.e., SCPs, delta, theta, alpha, and gamma) yielded the best accuracy using SCPs filtered between 0.1 to 1 Hz. Across all the subjects, including stroke subjects, the best selected features were obtained mostly from the fronto-parietal regions, hence consistent with previous neurophysiological studies on arm reaching tasks. In summary, we concluded that SCPs allow the possibility of single trial decoding of reaching directions at least 312.5 ms before onset of reach.

Detection of the onset of upper-limb movements based on the combined analysis of changes in the sensorimotor rhythms and slow cortical potentials

OBJECTIVE

Characterizing the intention to move by means of electroencephalographic activity can be used in rehabilitation protocols with patients' cortical activity taking an active role during the intervention. In such applications, the reliability of the intention estimation is critical both in terms of specificity 'number of misclassifications' and temporal accuracy. Here, a detector of the onset of voluntary upper-limb reaching movements based on the cortical rhythms and the slow cortical potentials is proposed. The improvement in detections due to the combination of these two cortical patterns is also studied.

APPROACH

Upper-limb movements and cortical activity were recorded in healthy subjects and stroke patients performing self-paced reaching movements. A logistic regression combined the output of two classifiers: (i) a naïve Bayes classifier trained to detect the event-related desynchronization preceding the movement onset and (ii) a matched filter detecting the bereitschaftspotential. The proposed detector was compared with the detectors by using each one of these cortical patterns separately. In addition, differences between the patients and healthy subjects were analysed.

MAIN RESULTS

On average, 74.5 ± 13.8% and 82.2 ± 10.4% of the movements were detected with 1.32 ± 0.87 and 1.50 ± 1.09 false detections generated per minute in the healthy subjects and the patients, respectively. A significantly better performance was achieved by the combined detector (as compared to the detectors of the two cortical patterns separately) in terms of true detections (p = 0.099) and false positives (p = 0.0083).

SIGNIFICANCE

A rationale is provided for combining information from cortical rhythms and slow cortical potentials to detect the onsets of voluntary upper-limb movements. It is demonstrated that the two cortical processes supply complementary information that can be summed up to boost the performance of the detector. Successful results have been also obtained with stroke patients, which supports the use of the proposed system in brain-computer interface applications with this group of patients.

Current Trends in Robot-Assisted Upper-Limb Stroke Rehabilitation: Promoting Patient Engagement in Therapy

Stroke is one of the leading causes of long-term disability today; therefore, many research efforts are focused on designing maximally effective and efficient treatment methods. In particular, robotic stroke rehabilitation has received significant attention for upper-limb therapy due to its ability to provide high-intensity repetitive movement therapy with less effort than would be required for traditional methods. Recent research has focused on increasing patient engagement in therapy, which has been shown to be important for inducing neural plasticity to facilitate recovery. Robotic therapy devices enable unique methods for promoting patient engagement by providing assistance only as needed and by detecting patient movement intent to drive to the device. Use of these methods has demonstrated improvements in functional outcomes, but careful comparisons between methods remain to be done. Future work should include controlled clinical trials and comparisons of effectiveness of different methods for patients with different abilities and needs in order to inform future development of patient-specific therapeutic protocols.

Potential of a smartphone as a stress-free sensor of daily human behaviour

Behaviour is one of the most powerful objective signals that connotes psychological functions regulated by neuronal network systems. This study searched for simple behaviours using smartphone sensors with three axes for measuring acceleration, angular speed and direction. We used quantitative analytic methodology of pattern recognition for work contexts, individual workers and seasonal effects in our own longitudinally recorded data. Our 13 laboratory members were involved in the care of common marmosets and domestic chicks, which lived in separate rooms. They attached a smartphone to their front waist-belts during feeding and cleaning in five care tasks. Behavioural characteristics such as speed, acceleration and azimuth, pitch, and roll angles were monitored. Afterwards, participants noted subjective scores of warmth sensation and work efficiency. The multivariate time series behavioral data were characterized by the subjective scores and environmental factors such as room temperature, season, and humidity, using the linear mixed model. In contrast to high-precision but stress-inducing sensors, the mobile sensors measuring daily behaviours allowed us to quantify the effects of the psychological states and environmental factors on the behavioural traits.

A brain-computer interface for single-trial detection of gait initiation from movement related cortical potentials

OBJECTIVE

Applications of brain-computer interfacing (BCI) in neurorehabilitation have received increasing attention. The intention to perform a motor task can be detected from scalp EEG and used to control rehabilitation devices, resulting in a patient-driven rehabilitation paradigm. In this study, we present and validate a BCI system for detection of gait initiation using movement related cortical potentials (MRCP).

METHODS

The templates of MRCP were extracted from 9-channel scalp EEG during gait initiation in 9 healthy subjects. Independent component analysis (ICA) was used to remove artifacts, and the Laplacian spatial filter was applied to enhance the signal-to-noise ratio of MRCP. Following these pre-processing steps, a matched filter was used to perform single-trial detection of gait initiation.

RESULTS

ICA preprocessing was shown to significantly improve the detection performance. With ICA preprocessing, across all subjects, the true positive rate (TPR) of the detection was 76.9±8.97%, and the false positive rate was 2.93±1.09 per minute.

CONCLUSION

The results demonstrate the feasibility of detecting the intention of gait initiation from EEG signals, on a single trial basis.

SIGNIFICANCE

The results are important for the development of new gait rehabilitation strategies, either for recovery/replacement of function or for neuromodulation.