Applications of Brain-Machine Interface Systems in Stroke Recovery and Rehabilitation

Recent Progress in Flexible Microelectrode Arrays for Combined Electrophysiological and Electrochemical Sensing

Understanding brain function requires advanced neural probes to monitor electrical and chemical signaling across multiple timescales and brain regions. Microelectrode arrays (MEAs) are widely used to record neurophysiological activity across various depths and brain regions, providing single-unit resolution for extended periods. Recent advancements in flexible MEAs, built on micrometer-thick polymer substrates, have improved integration with brain tissue by mimicking the brain's soft nature, reducing mechanical trauma and inflammation. These flexible, subcellular-scale MEAs can record stable neural signals for months, making them ideal for long-term studies. In addition to electrical recording, MEAs have been functionalized for electrochemical neurotransmitter detection. Electroactive neurotransmitters, such as dopamine, serotonin, and adenosine, can be directly measured via electrochemical methods, particularly on carbon-based surfaces. For non-electroactive neurotransmitters like acetylcholine, glutamate, and γ-aminobutyric acid, alternative strategies, such as enzyme immobilization and aptamer-based recognition, are employed to generate electrochemical signals. This review highlights recent developments in flexible MEA fabrication and functionalization to achieve both electrochemical and electrophysiological recordings, minimizing sensor fowling and brain damage when implanted long-term. It covers multi-time scale neurotransmitter detection, development of conducting polymer and nanomaterial composite coatings to enhance sensitivity, incorporation of enzyme and aptamer-based recognition methods, and the integration of carbon electrodes on flexible MEAs. Finally, it summarizes strategies to acquire electrochemical and electrophysiological measurements from the same device.

NSF DARE-transforming modeling in neurorehabilitation: a patient-in-the-loop framework

In 2023, the National Science Foundation (NSF) and the National Institute of Health (NIH) brought together engineers, scientists, and clinicians by sponsoring a conference on computational modelling in neurorehabiilitation. To facilitate multidisciplinary collaborations and improve patient care, in this perspective piece we identify where and how computational modelling can support neurorehabilitation. To address the where, we developed a patient-in-the-loop framework that uses multiple and/or continual measurements to update diagnostic and treatment model parameters, treatment type, and treatment prescription, with the goal of maximizing clinically-relevant functional outcomes. This patient-in-the-loop framework has several key features: (i) it includes diagnostic and treatment models, (ii) it is clinically-grounded with the International Classification of Functioning, Disability and Health (ICF) and patient involvement, (iii) it uses multiple or continual data measurements over time, and (iv) it is applicable to a range of neurological and neurodevelopmental conditions. To address the how, we identify state-of-the-art and highlight promising avenues of future research across the realms of sensorimotor adaptation, neuroplasticity, musculoskeletal, and sensory & pain computational modelling. We also discuss both the importance of and how to perform model validation, as well as challenges to overcome when implementing computational models within a clinical setting. The patient-in-the-loop approach offers a unifying framework to guide multidisciplinary collaboration between computational and clinical stakeholders in the field of neurorehabilitation.

Extracorporeal shock wave treatment for post‑surgical fracture nonunion: Insight into its mechanism, efficacy, safety and prognostic factors (Review)

Post-surgical fracture nonunion (PSFN) represents the failure to achieve cortical continuity at radiological examination after an orthopedic operation, which causes a considerable disease burden in patients with fractures. As one of the traditional treatment modalities, surgical therapy is associated with a high fracture union rate; however, post-surgical complications are not negligible. Therefore, less invasive therapies are needed to improve the prognosis of patients with PSFN. Extracorporeal shock wave treatment (ESWT) is a noninvasive method that presents a similar efficacy profile and favorable safety profile compared with surgical treatment. However, the application and detailed mechanism of ESWT in patients with PSFN remain unclear. The present review focuses on the mechanism, efficacy, safety and prognostic factors of ESWT in patients with PSFN, aiming to provide a theoretical basis for its application and improve the prognosis of these patients.

Research on two-class and four-class action recognition based on EEG signals

BMI has attracted widespread attention in the past decade, which has greatly improved the living conditions of patients with motor disorders. The application of EEG signals in lower limb rehabilitation robots and human exoskeleton has also been gradually applied by researchers. Therefore, the recognition of EEG signals is of great significance. In this paper, a CNN-LSTM neural network model is designed to study the two-class and four-class motion recognition of EEG signals. In this paper, a brain-computer interface experimental scheme is designed. Combining the characteristics of EEG signals, the time-frequency characteristics of EEG signals and event-related potential phenomena are analyzed, and the ERD/ERS characteristics are obtained. Pre-process EEG signals, and propose a CNN-LSTM neural network model to classify the collected binary and four-class EEG signals. The experimental results show that the CNN-LSTM neural network model has a good effect, and its average accuracy and kappa coefficient are higher than the other two classification algorithms, which also shows that the classification algorithm selected in this paper has a good classification effect.

Multibranch convolutional neural network with contrastive representation learning for decoding same limb motor imagery tasks

Introduction

Emerging deep learning approaches to decode motor imagery (MI) tasks have significantly boosted the performance of brain-computer interfaces. Although recent studies have produced satisfactory results in decoding MI tasks of different body parts, the classification of such tasks within the same limb remains challenging due to the activation of overlapping brain regions. A single deep learning model may be insufficient to effectively learn discriminative features among tasks.

Methods

The present study proposes a framework to enhance the decoding of multiple hand-MI tasks from the same limb using a multi-branch convolutional neural network. The CNN framework utilizes feature extractors from established deep learning models, as well as contrastive representation learning, to derive meaningful feature representations for classification.

Results

The experimental results suggest that the proposed method outperforms several state-of-the-art methods by obtaining a classification accuracy of 62.98% with six MI classes and 76.15 % with four MI classes on the Tohoku University MI-BCI and BCI Competition IV datasets IIa, respectively.

Discussion

Despite requiring heavy data augmentation and multiple optimization steps, resulting in a relatively long training time, this scheme is still suitable for online use. However, the trade-of between the number of base learners, training time, prediction time, and system performance should be carefully considered.

Brain-Computer Interface-Controlled Exoskeletons in Clinical Neurorehabilitation: Ready or Not?

The development of brain-computer interface-controlled exoskeletons promises new treatment strategies for neurorehabilitation after stroke or spinal cord injury. By converting brain/neural activity into control signals of wearable actuators, brain/neural exoskeletons (B/NEs) enable the execution of movements despite impaired motor function. Beyond the use as assistive devices, it was shown that-upon repeated use over several weeks-B/NEs can trigger motor recovery, even in chronic paralysis. Recent development of lightweight robotic actuators, comfortable and portable real-world brain recordings, as well as reliable brain/neural control strategies have paved the way for B/NEs to enter clinical care. Although B/NEs are now technically ready for broader clinical use, their promotion will critically depend on early adopters, for example, research-oriented physiotherapists or clinicians who are open for innovation. Data collected by early adopters will further elucidate the underlying mechanisms of B/NE-triggered motor recovery and play a key role in increasing efficacy of personalized treatment strategies. Moreover, early adopters will provide indispensable feedback to the manufacturers necessary to further improve robustness, applicability, and adoption of B/NEs into existing therapy plans.

Exploring user perspectives on a robotic arm with brain-machine interface: A qualitative focus group study

Brain-machine Interface (BMI) is a system that translates neuronal data into an output variable to control external devices such as a robotic arm. A robotic arm can be used as an assistive living device for individuals with tetraplegia. To reflect users' needs in the development process of the BMI robotic arm, our team followed an interactive approach to system development, human-centered design, and Human Activity Assistive Technology model. This study aims to explore the perspectives of people with tetraplegia about activities they want to participate in, their opinions, and the usability of the BMI robotic arm. Eight people with tetraplegia participated in a focus group interview in a semistructured interview format. A general inductive analysis method was used to analyze the qualitative data. The 3 overarching themes that emerged from this analysis were: 1) activities, 2) acceptance, and 3) usability. Activities that the users wanted to do using the robotic arm were categorized into the following 5 activity domains: activities of daily living (ADL), instrumental ADL, health management, education, and leisure. Participants provided their opinions on the needs and acceptance of the BMI technology. Participants answered usability and expected standards of the BMI robotic arm within 7 categories such as accuracy, setup, cost, etc. Participants with tetraplegia have a strong interest in the robotic arm and BMI technology to restore their mobility and independence. Creating BMI features appropriate to users' needs, such as safety and high accuracy, will be the key to acceptance. These findings from the perspectives of potential users should be taken into account when developing the BMI robotic arm.

Tracking the Effect of Therapy With Single-Trial Based Classification After Stroke

Stroke is a debilitating disease that leads, in the 50% of cases, to permanent motor or cognitive impairments. The effectiveness of therapies that promote recovery after stroke depends on indicators of the disease state that can measure the degree of recovery or predict treatment response or both. Here, we propose to use single-trial classification of task dependent neural activity to assess the disease state and track recovery after stroke. We tested this idea on calcium imaging data of the dorsal cortex of healthy, spontaneously recovered and rehabilitated mice while performing a forelimb retraction task. Results show that, at a single-trial level for the three experimental groups, neural activation during the reward pull can be detected with high accuracy with respect to the background activity in all cortical areas of the field of view and this activation is quite stable across trials and subjects of the same group. Moreover, single-trial responses during the reward pull can be used to discriminate between healthy and stroke subjects with areas closer to the injury site displaying higher discrimination capability than areas closer to this site. Finally, a classifier built to discriminate between controls and stroke at the single-trial level can be used to generate an index of the disease state, the therapeutic score, which is validated on the group of rehabilitated mice. In conclusion, task-related neural activity can be used as an indicator of disease state and track recovery without selecting a peculiar feature of the neural responses. This novel method can be used in both the development and assessment of different therapeutic strategies.

Wireless Soft Scalp Electronics and Virtual Reality System for Motor Imagery-Based Brain-Machine Interfaces

Motor imagery offers an excellent opportunity as a stimulus-free paradigm for brain-machine interfaces. Conventional electroencephalography (EEG) for motor imagery requires a hair cap with multiple wired electrodes and messy gels, causing motion artifacts. Here, a wireless scalp electronic system with virtual reality for real-time, continuous classification of motor imagery brain signals is introduced. This low-profile, portable system integrates imperceptible microneedle electrodes and soft wireless circuits. Virtual reality addresses subject variance in detectable EEG response to motor imagery by providing clear, consistent visuals and instant biofeedback. The wearable soft system offers advantageous contact surface area and reduced electrode impedance density, resulting in significantly enhanced EEG signals and classification accuracy. The combination with convolutional neural network-machine learning provides a real-time, continuous motor imagery-based brain-machine interface. With four human subjects, the scalp electronic system offers a high classification accuracy (93.22 ± 1.33% for four classes), allowing wireless, real-time control of a virtual reality game.

Face-Computer Interface (FCI): Intent Recognition Based on Facial Electromyography (fEMG) and Online Human-Computer Interface With Audiovisual Feedback

Patients who have lost limb control ability, such as upper limb amputation and high paraplegia, are usually unable to take care of themselves. Establishing a natural, stable, and comfortable human-computer interface (HCI) for controlling rehabilitation assistance robots and other controllable equipments will solve a lot of their troubles. In this study, a complete limbs-free face-computer interface (FCI) framework based on facial electromyography (fEMG) including offline analysis and online control of mechanical equipments was proposed. Six facial movements related to eyebrows, eyes, and mouth were used in this FCI. In the offline stage, 12 models, eight types of features, and three different feature combination methods for model inputing were studied and compared in detail. In the online stage, four well-designed sessions were introduced to control a robotic arm to complete drinking water task in three ways (by touch screen, by fEMG with and without audio feedback) for verification and performance comparison of proposed FCI framework. Three features and one model with an average offline recognition accuracy of 95.3%, a maximum of 98.8%, and a minimum of 91.4% were selected for use in online scenarios. In contrast, the way with audio feedback performed better than that without audio feedback. All subjects completed the drinking task in a few minutes with FCI. The average and smallest time difference between touch screen and fEMG under audio feedback were only 1.24 and 0.37 min, respectively.

Concerns in the Blurred Divisions between Medical and Consumer Neurotechnology

Neurotechnology has traditionally been central to the diagnosis and treatment of neurological disorders. While these devices have initially been utilized in clinical and research settings, recent advancements in neurotechnology have yielded devices that are more portable, user-friendly, and less expensive. These improvements allow laypeople to monitor their brain waves and interface their brains with external devices. Such improvements have led to the rise of wearable neurotechnology that is marketed to the consumer. While many of the consumer devices are marketed for innocuous applications, such as use in video games, there is potential for them to be repurposed for medical use. How do we manage neurotechnologies that skirt the line between medical and consumer applications and what can be done to ensure consumer safety? Here, we characterize neurotechnology based on medical and consumer applications and summarize currently marketed uses of consumer-grade wearable headsets. We lay out concerns that may arise due to the similar claims associated with both medical and consumer devices, the possibility of consumer devices being repurposed for medical uses, and the potential for medical uses of neurotechnology to influence commercial markets related to employment and self-enhancement.

Neural activity modulations and motor recovery following brain-exoskeleton interface mediated stroke rehabilitation

•

Motor intention based arm training targets activity-dependent neuroplasticity.

•

80% of stroke participants recovered clinically relevant functional movements.

•

Ipsi-lesional, delta-band EEG activity was highly correlated with motor recovery.

•

Results suggest higher activation of ipsi-lesional hemisphere post-intervention.

Brain-machine interfaces (BMI) based on scalp EEG have the potential to promote cortical plasticity following stroke, which has been shown to improve motor recovery outcomes. However, the efficacy of BMI enabled robotic training for upper-limb recovery is seldom quantified using clinical, EEG-based, and kinematics-based metrics. Further, a movement related neural correlate that can predict the extent of motor recovery still remains elusive, which impedes the clinical translation of BMI-based stroke rehabilitation.

To address above knowledge gaps, 10 chronic stroke individuals with stable baseline clinical scores were recruited to participate in 12 therapy sessions involving a BMI enabled powered exoskeleton for elbow training. On average, 132 ± 22 repetitions were performed per participant, per session. BMI accuracy across all sessions and subjects was 79 ± 18% with a false positives rate of 23 ± 20%.

Post-training clinical assessments found that FMA for upper extremity and ARAT scores significantly improved over baseline by 3.92 ± 3.73 and 5.35 ± 4.62 points, respectively. Also, 80% participants (7 with moderate-mild impairment, 1 with severe impairment) achieved minimal clinically important difference (MCID: FMA-UE >5.2 or ARAT >5.7) during the course of the study. Kinematic measures indicate that, on average, participants’ movements became faster and smoother. Moreover, modulations in movement related cortical potentials, an EEG-based neural correlate measured contralateral to the impaired arm, were significantly correlated with ARAT scores (ρ = 0.72, p < 0.05) and marginally correlated with FMA-UE (ρ = 0.63, p = 0.051). This suggests higher activation of ipsi-lesional hemisphere post-intervention or inhibition of competing contra-lesional hemisphere, which may be evidence of neuroplasticity and cortical reorganization following BMI mediated rehabilitation therapy.

A walk in the park? Characterizing gait-related artifacts in mobile EEG recordings

Brain activity during natural walking outdoors can be captured using mobile electroencephalography (EEG). However, EEG recorded during gait is confounded with artifacts from various sources, possibly obstructing the interpretation of brain activity patterns. Currently, there is no consensus on how the amount of artifact present in these recordings should be quantified, or is there a systematic description of gait artifact properties. In the current study, we expand several features into a seven-dimensional footprint of gait-related artifacts, combining features of time, time-frequency, spatial, and source domains. EEG of N = 26 participants was recorded while standing and walking outdoors. Footprints of gait-related artifacts before and after two different artifact attenuation strategies (after artifact subspace reconstruction (ASR) and after subsequent independent component analysis [ICA]) were systematically different. We also evaluated topographies, morphologies, and signal-to-noise ratios (SNR) of button-press event-related potentials (ERP) before and after artifact handling, to confirm gait-artifact reduction specificity. Morphologies and SNR remained unchanged after artifact attenuation, whereas topographies improved in quality. Our results show that the footprint can provide a detailed assessment of gait-related artifacts and can be used to estimate the sensitivity of different artifact reduction strategies. Moreover, the analysis of button-press ERPs demonstrated its specificity, as processing did not only reduce gait-related artifacts but ERPs of interest remained largely unchanged. We conclude that the proposed footprint is well suited to characterize individual differences in gait-related artifact extent. In the future, it could be used to compare and optimize recording setups and processing pipelines comprehensively.

Cortical Tasks-Based Optimal Filter Selection: An fNIRS Study

Functional near-infrared spectroscopy (fNIRS) is one of the latest noninvasive brain function measuring technique that has been used for the purpose of brain-computer interfacing (BCI). In this paper, we compare and analyze the effect of six most commonly used filtering techniques (i.e., Gaussian, Butterworth, Kalman, hemodynamic response filter (hrf), Wiener, and finite impulse response) on classification accuracies of fNIRS-BCI. To conclude with the best optimal filter for a specific cortical task owing to a specific cortical region, we divided our experimental tasks according to the three main cortical regions: prefrontal, motor, and visual cortex. Three different experiments were performed for prefrontal and motor execution tasks while one for visual stimuli. The tasks performed for prefrontal include rest (R) vs mental arithmetic (MA), R vs object rotation (OB), and OB vs MA. Similarly, for motor execution, R vs left finger tapping (LFT), R vs right finger tapping (RFT), and LFT vs RFT. Likewise, for the visual cortex, R vs visual stimuli (VS) task. These experiments were performed for ten trials with five subjects. For consistency among extracted data, six statistical features were evaluated using oxygenated hemoglobin, namely, slope, mean, peak, kurtosis, skewness, and variance. Combination of these six features was used to classify data by the nonlinear support vector machine (SVM). The classification accuracies obtained from SVM by using hrf and Gaussian were significantly higher for R vs MA, R vs OB, R vs RFT, and R vs VS and Wiener filter for OB vs MA. Similarly, for R vs LFT and LFT vs RFT, hrf was found to be significant p<0.05. These results show the feasibility of using hrf for effective removal of noises from fNIRS data.

A Review of Robot-Assisted Lower-Limb Stroke Therapy: Unexplored Paths and Future Directions in Gait Rehabilitation

Stroke affects one out of every six people on Earth. Approximately 90% of stroke survivors have some functional disability with mobility being a major impairment, which not only affects important daily activities but also increases the likelihood of falling. Originally intended to supplement traditional post-stroke gait rehabilitation, robotic systems have gained remarkable attention in recent years as a tool to decrease the strain on physical therapists while increasing the precision and repeatability of the therapy. While some of the current methods for robot-assisted rehabilitation have had many positive and promising outcomes, there is moderate evidence of improvement in walking and motor recovery using robotic devices compared to traditional practice. In order to better understand how and where robot-assisted rehabilitation has been effective, it is imperative to identify the main schools of thought that have prevailed. This review intends to observe those perspectives through three different lenses: the goal and type of interaction, the physical implementation, and the sensorimotor pathways targeted by robotic devices. The ways that researchers approach the problem of restoring gait function are grouped together in an intuitive way. Seeing robot-assisted rehabilitation in this unique light can naturally provoke the development of new directions to potentially fill the current research gaps and eventually discover more effective ways to provide therapy. In particular, the idea of utilizing the human inter-limb coordination mechanisms is brought up as an especially promising area for rehabilitation and is extensively discussed.

Towards a Unified Framework for De-noising Neural Signals

Neural signals provide key information for decision-making processes in multiple disciplines including medicine, engineering, and neuroscience. The correct interpretation of these signals, however, requires substantial processing, especially when the signals exhibit low Signal to Noise Ratio (SNR). Electroencephalographic (EEG) signals are considered among this group and require effective handling of multiple types of artifactual components. Unfortunately, most available de-noising tools are suitable only for offline signal processing. For some artifacts (e.g., EEG motion artifacts), no established method of effective denoising exists for offline or real-time applications. Thus, there is a critical need for methods that can handle artifacts in neural signals with high performance, reliability and real-time capability. Here, we propose novel methods for handling some of the most challenging artifacts that exhibit highly complex dynamics, including motion artifacts. Having the same core sample-adaptive processing tool used for handling different types of artifacts, we present our efforts towards a unified framework for neural data artifact denoising with real-time compatibility.

Applications of brain-computer interfaces to the control of robotic and prosthetic arms

Brain-computer interfaces (BCIs) have the potential to improve the quality of life of individuals with severe motor disabilities. BCIs capture the user's brain activity and translate it into commands for the control of an effector, such as a computer cursor, robotic limb, or functional electrical stimulation device. Full dexterous manipulation of robotic and prosthetic arms via a BCI system has been a challenge because of the inherent need to decode high dimensional and preferably real-time control commands from the user's neural activity. Nevertheless, such functionality is fundamental if BCI-controlled robotic or prosthetic limbs are to be used for daily activities. In this chapter, we review how this challenge has been addressed by BCI researchers and how new solutions may improve the BCI user experience with robotic effectors.

Brain Computer Interfaces in Rehabilitation Medicine

One innovation currently influencing physical medicine and rehabilitation is brain-computer interface (BCI) technology. BCI systems used for motor control record neural activity associated with thoughts, perceptions, and motor intent; decode brain signals into commands for output devices; and perform the user's intended action through an output device. BCI systems used for sensory augmentation transduce environmental stimuli into neural signals interpretable by the central nervous system. Both types of systems have potential for reducing disability by facilitating a user's interaction with the environment. Investigational BCI systems are being used in the rehabilitation setting both as neuroprostheses to replace lost function and as potential plasticity-enhancing therapy tools aimed at accelerating neurorecovery. Populations benefitting from motor and somatosensory BCI systems include those with spinal cord injury, motor neuron disease, limb amputation, and stroke. This article discusses the basic components of BCI for rehabilitation, including recording systems and locations, signal processing and translation algorithms, and external devices controlled through BCI commands. An overview of applications in motor and sensory restoration is provided, along with ethical questions and user perspectives regarding BCI technology.

Perspectives and Challenges in Robotic Neurorehabilitation

The development of robotic devices for rehabilitation is a fast-growing field. Nowadays, thanks to novel technologies that have improved robots’ capabilities and offered more cost-effective solutions, robotic devices are increasingly being employed during clinical practice, with the goal of boosting patients’ recovery. Robotic rehabilitation is also widely used in the context of neurological disorders, where it is often provided in a variety of different fashions, depending on the specific function to be restored. Indeed, the effect of robot-aided neurorehabilitation can be maximized when used in combination with a proper training regimen (based on motor control paradigms) or with non-invasive brain machine interfaces. Therapy-induced changes in neural activity and behavioral performance, which may suggest underlying changes in neural plasticity, can be quantified by multimodal assessments of both sensorimotor performance and brain/muscular activity pre/post or during intervention. Here, we provide an overview of the most common robotic devices for upper and lower limb rehabilitation and we describe the aforementioned neurorehabilitation scenarios. We also review assessment techniques for the evaluation of robotic therapy. Additional exploitation of these research areas will highlight the crucial contribution of rehabilitation robotics for promoting recovery and answering questions about reorganization of brain functions in response to disease.

Neural Decoding of Robot-Assisted Gait During Rehabilitation After Stroke

OBJECTIVE

Advancements in robot-assisted gait rehabilitation and brain-machine interfaces may enhance stroke physiotherapy by engaging patients while providing information about robot-induced cortical adaptations. We investigate the feasibility of decoding walking from brain activity in stroke survivors during therapy using a powered exoskeleton integrated with an electroencephalography-based brain-machine interface.

DESIGN

The H2 powered exoskeleton was designed for overground gait training with actuated hip, knee, and ankle joints. It was integrated with active-electrode electroencephalography and evaluated in hemiparetic stroke survivors for 12 sessions per 4 wks. A continuous-time Kalman decoder operating on delta-band electroencephalography was designed to estimate gait kinematics.

RESULTS

Five chronic stroke patients completed the study with improvements in walking distance and speed training for 4 wks, correlating with increased offline decoding accuracy. Accuracies of predicted joint angles improved with session and gait speed, suggesting an improved neural representation for gait, and the feasibility to design an electroencephalography-based brain-machine interface to monitor brain activity or control a rehabilitative exoskeleton.

CONCLUSIONS

The Kalman decoder showed increased accuracies as the longitudinal training intervention progressed in the stroke participants. These results demonstrate the feasibility of studying changes in patterns of neuroelectric cortical activity during poststroke rehabilitation and represent the first step in developing a brain-machine interface for controlling powered exoskeletons.

Improving robotic stroke rehabilitation by incorporating neural intent detection: Preliminary results from a clinical trial

This paper presents the preliminary findings of a multi-year clinical study evaluating the effectiveness of adding a brain-machine interface (BMI) to the MAHI-Exo II, a robotic upper limb exoskeleton, for elbow flexion/extension rehabilitation in chronic stroke survivors. The BMI was used to trigger robot motion when movement intention was detected from subjects' neural signals, thus requiring that subjects be mentally engaged during robotic therapy. The first six subjects to complete the program have shown improvements in both Fugl-Meyer Upper-Extremity scores as well as in kinematic movement quality measures that relate to movement planning, coordination, and control. These results are encouraging and suggest that increasing subject engagement during therapy through the addition of an intent-detecting BMI enhances the effectiveness of standard robotic rehabilitation.

The Development and Preliminary Test of a Powered Alternately Walking Exoskeleton With the Wheeled Foot for Paraplegic Patients

Upright walking has both physical and social meanings for paraplegic patients. The main purpose of this paper is to reduce the automatic functioning of the powered exoskeleton and enable the user to fully control the walking procedure in real-time, aiming to further improve the engagement of the patient during rehabilitation training. For this prototype, a custom-made hub motor was placed at the bottom of the exoskeleton's foot, and a pair of crutches with the embedded wireless controller were utilized as the auxiliary device. The user could alternatively press the button of the crutch to control the movement of the leg and by repeating this procedure, the user could complete a continuous walking motion. For safety, an automatic brake and mechanical limitation for maximum step length were implemented. A gait analysis was performed to evaluate the exoskeleton's motion capability and corresponding response of user's major muscles. The kinematic results of this paper showed that this exoskeleton could assist the user to walk in a motion trend close to the normally walk, especially for ankle joint. The electromyography results indicated that this exoskeleton could decrease the loading burden of the user's lower limb while requiring more involvements of upper-limb muscles to maintain balance while walking.

fNIRS-based Neurorobotic Interface for gait rehabilitation

BACKGROUND

In this paper, a novel functional near-infrared spectroscopy (fNIRS)-based brain-computer interface (BCI) framework for control of prosthetic legs and rehabilitation of patients suffering from locomotive disorders is presented.

METHODS

fNIRS signals are used to initiate and stop the gait cycle, while a nonlinear proportional derivative computed torque controller (PD-CTC) with gravity compensation is used to control the torques of hip and knee joints for minimization of position error. In the present study, the brain signals of walking intention and rest tasks were acquired from the left hemisphere's primary motor cortex for nine subjects. Thereafter, for removal of motion artifacts and physiological noises, the performances of six different filters (i.e. Kalman, Wiener, Gaussian, hemodynamic response filter (hrf), Band-pass, finite impulse response) were evaluated. Then, six different features were extracted from oxygenated hemoglobin signals, and their different combinations were used for classification. Also, the classification performances of five different classifiers (i.e. k-Nearest Neighbour, quadratic discriminant analysis, linear discriminant analysis (LDA), Naïve Bayes, support vector machine (SVM)) were tested.

RESULTS

The classification accuracies obtained from SVM using the hrf were significantly higher (p < 0.01) than those of the other classifier/ filter combinations. Those accuracies were 77.5, 72.5, 68.3, 74.2, 73.3, 80.8, 65, 76.7, and 86.7% for the nine subjects, respectively.

CONCLUSION

The control commands generated using the classifiers initiated and stopped the gait cycle of the prosthetic leg, the knee and hip torques of which were controlled using the PD-CTC to minimize the position error. The proposed scheme can be effectively used for neurofeedback training and rehabilitation of lower-limb amputees and paralyzed patients.

Brain-Machine Interfaces: From Basic Science to Neuroprostheses and Neurorehabilitation

Brain-machine interfaces (BMIs) combine methods, approaches, and concepts derived from neurophysiology, computer science, and engineering in an effort to establish real-time bidirectional links between living brains and artificial actuators. Although theoretical propositions and some proof of concept experiments on directly linking the brains with machines date back to the early 1960s, BMI research only took off in earnest at the end of the 1990s, when this approach became intimately linked to new neurophysiological methods for sampling large-scale brain activity. The classic goals of BMIs are 1) to unveil and utilize principles of operation and plastic properties of the distributed and dynamic circuits of the brain and 2) to create new therapies to restore mobility and sensations to severely disabled patients. Over the past decade, a wide range of BMI applications have emerged, which considerably expanded these original goals. BMI studies have shown neural control over the movements of robotic and virtual actuators that enact both upper and lower limb functions. Furthermore, BMIs have also incorporated ways to deliver sensory feedback, generated from external actuators, back to the brain. BMI research has been at the forefront of many neurophysiological discoveries, including the demonstration that, through continuous use, artificial tools can be assimilated by the primate brain's body schema. Work on BMIs has also led to the introduction of novel neurorehabilitation strategies. As a result of these efforts, long-term continuous BMI use has been recently implicated with the induction of partial neurological recovery in spinal cord injury patients.

Multiple Kernel Based Region Importance Learning for Neural Classification of Gait States from EEG Signals

With the development of Brain Machine Interface (BMI) systems, people with motor disabilities are able to control external devices to help them restore movement abilities. Longitudinal validation of these systems is critical not only to assess long-term performance reliability but also to investigate adaptations in electrocortical patterns due to learning to use the BMI system. In this paper, we decode the patterns of user's intended gait states (e.g., stop, walk, turn left, and turn right) from scalp electroencephalography (EEG) signals and simultaneously learn the relative importance of different brain areas by using the multiple kernel learning (MKL) algorithm. The region of importance (ROI) is identified during training the MKL for classification. The efficacy of the proposed method is validated by classifying different movement intentions from two subjects—an able-bodied and a spinal cord injury (SCI) subject. The preliminary results demonstrate that frontal and fronto-central regions are the most important regions for the tested subjects performing gait movements, which is consistent with the brain regions hypothesized to be involved in the control of lower-limb movements. However, we observed some regional changes comparing the able-bodied and the SCI subject. Moreover, in the longitudinal experiments, our findings exhibit the cortical plasticity triggered by the BMI use, as the classification accuracy and the weights for important regions—in sensor space—generally increased, as the user learned to control the exoskeleton for movement over multiple sessions.

A convolutional neural network for steady state visual evoked potential classification under ambulatory environment

The robust analysis of neural signals is a challenging problem. Here, we contribute a convolutional neural network (CNN) for the robust classification of a steady-state visual evoked potentials (SSVEPs) paradigm. We measure electroencephalogram (EEG)-based SSVEPs for a brain-controlled exoskeleton under ambulatory conditions in which numerous artifacts may deteriorate decoding. The proposed CNN is shown to achieve reliable performance under these challenging conditions. To validate the proposed method, we have acquired an SSVEP dataset under two conditions: 1) a static environment, in a standing position while fixated into a lower-limb exoskeleton and 2) an ambulatory environment, walking along a test course wearing the exoskeleton (here, artifacts are most challenging). The proposed CNN is compared to a standard neural network and other state-of-the-art methods for SSVEP decoding (i.e., a canonical correlation analysis (CCA)-based classifier, a multivariate synchronization index (MSI), a CCA combined with k-nearest neighbors (CCA-KNN) classifier) in an offline analysis. We found highly encouraging SSVEP decoding results for the CNN architecture, surpassing those of other methods with classification rates of 99.28% and 94.03% in the static and ambulatory conditions, respectively. A subsequent analysis inspects the representation found by the CNN at each layer and can thus contribute to a better understanding of the CNN’s robust, accurate decoding abilities.

Control of an Ambulatory Exoskeleton with a Brain-Machine Interface for Spinal Cord Injury Gait Rehabilitation

The closed-loop control of rehabilitative technologies by neural commands has shown a great potential to improve motor recovery in patients suffering from paralysis. Brain-machine interfaces (BMI) can be used as a natural control method for such technologies. BMI provides a continuous association between the brain activity and peripheral stimulation, with the potential to induce plastic changes in the nervous system. Paraplegic patients, and especially the ones with incomplete injuries, constitute a potential target population to be rehabilitated with brain-controlled robotic systems, as they may improve their gait function after the reinforcement of their spared intact neural pathways. This paper proposes a closed-loop BMI system to control an ambulatory exoskeleton-without any weight or balance support-for gait rehabilitation of incomplete spinal cord injury (SCI) patients. The integrated system was validated with three healthy subjects, and its viability in a clinical scenario was tested with four SCI patients. Using a cue-guided paradigm, the electroencephalographic signals of the subjects were used to decode their gait intention and to trigger the movements of the exoskeleton. We designed a protocol with a special emphasis on safety, as patients with poor balance were required to stand and walk. We continuously monitored their fatigue and exertion level, and conducted usability and user-satisfaction tests after the experiments. The results show that, for the three healthy subjects, 84.44 ± 14.56% of the trials were correctly decoded. Three out of four patients performed at least one successful BMI session, with an average performance of 77.6 1 ± 14.72%. The shared control strategy implemented (i.e., the exoskeleton could only move during specific periods of time) was effective in preventing unexpected movements during periods in which patients were asked to relax. On average, 55.22 ± 16.69% and 40.45 ± 16.98% of the trials (for healthy subjects and patients, respectively) would have suffered from unexpected activations (i.e., false positives) without the proposed control strategy. All the patients showed low exertion and fatigue levels during the performance of the experiments. This paper constitutes a proof-of-concept study to validate the feasibility of a BMI to control an ambulatory exoskeleton by patients with incomplete paraplegia (i.e., patients with good prognosis for gait rehabilitation).

Gait adaptation to visual kinematic perturbations using a real-time closed-loop brain-computer interface to a virtual reality avatar

OBJECTIVE

The control of human bipedal locomotion is of great interest to the field of lower-body brain-computer interfaces (BCIs) for gait rehabilitation. While the feasibility of closed-loop BCI systems for the control of a lower body exoskeleton has been recently shown, multi-day closed-loop neural decoding of human gait in a BCI virtual reality (BCI-VR) environment has yet to be demonstrated. BCI-VR systems provide valuable alternatives for movement rehabilitation when wearable robots are not desirable due to medical conditions, cost, accessibility, usability, or patient preferences.

APPROACH

In this study, we propose a real-time closed-loop BCI that decodes lower limb joint angles from scalp electroencephalography (EEG) during treadmill walking to control a walking avatar in a virtual environment. Fluctuations in the amplitude of slow cortical potentials of EEG in the delta band (0.1-3 Hz) were used for prediction; thus, the EEG features correspond to time-domain amplitude modulated potentials in the delta band. Virtual kinematic perturbations resulting in asymmetric walking gait patterns of the avatar were also introduced to investigate gait adaptation using the closed-loop BCI-VR system over a period of eight days.

MAIN RESULTS

Our results demonstrate the feasibility of using a closed-loop BCI to learn to control a walking avatar under normal and altered visuomotor perturbations, which involved cortical adaptations. The average decoding accuracies (Pearson's r values) in real-time BCI across all subjects increased from (Hip: 0.18 ± 0.31; Knee: 0.23 ± 0.33; Ankle: 0.14 ± 0.22) on Day 1 to (Hip: 0.40 ± 0.24; Knee: 0.55 ± 0.20; Ankle: 0.29 ± 0.22) on Day 8.

SIGNIFICANCE

These findings have implications for the development of a real-time closed-loop EEG-based BCI-VR system for gait rehabilitation after stroke and for understanding cortical plasticity induced by a closed-loop BCI-VR system.

Design and Optimization of an EEG-Based Brain Machine Interface (BMI) to an Upper-Limb Exoskeleton for Stroke Survivors

This study demonstrates the feasibility of detecting motor intent from brain activity of chronic stroke patients using an asynchronous electroencephalography (EEG)-based brain machine interface (BMI). Intent was inferred from movement related cortical potentials (MRCPs) measured over an optimized set of EEG electrodes. Successful intent detection triggered the motion of an upper-limb exoskeleton (MAHI Exo-II), to guide movement and to encourage active user participation by providing instantaneous sensory feedback. Several BMI design features were optimized to increase system performance in the presence of single-trial variability of MRCPs in the injured brain: (1) an adaptive time window was used for extracting features during BMI calibration; (2) training data from two consecutive days were pooled for BMI calibration to increase robustness to handle the day-to-day variations typical of EEG, and (3) BMI predictions were gated by residual electromyography (EMG) activity from the impaired arm, to reduce the number of false positives. This patient-specific BMI calibration approach can accommodate a broad spectrum of stroke patients with diverse motor capabilities. Following BMI optimization on day 3, testing of the closed-loop BMI-MAHI exoskeleton, on 4th and 5th days of the study, showed consistent BMI performance with overall mean true positive rate (TPR) = 62.7 ± 21.4% on day 4 and 67.1 ± 14.6% on day 5. The overall false positive rate (FPR) across subjects was 27.74 ± 37.46% on day 4 and 27.5 ± 35.64% on day 5; however for two subjects who had residual motor function and could benefit from the EMG-gated BMI, the mean FPR was quite low (< 10%). On average, motor intent was detected -367 ± 328 ms before movement onset during closed-loop operation. These findings provide evidence that closed-loop EEG-based BMI for stroke patients can be designed and optimized to perform well across multiple days without system recalibration.

Factors of Influence on the Performance of a Short-Latency Non-Invasive Brain Switch: Evidence in Healthy Individuals and Implication for Motor Function Rehabilitation

Brain-computer interfacing (BCI) has recently been applied as a rehabilitation approach for patients with motor disorders, such as stroke. In these closed-loop applications, a brain switch detects the motor intention from brain signals, e.g., scalp EEG, and triggers a neuroprosthetic device, either to deliver sensory feedback or to mimic real movements, thus re-establishing the compromised sensory-motor control loop and promoting neural plasticity. In this context, single trial detection of motor intention with short latency is a prerequisite. The performance of the event detection from EEG recordings is mainly determined by three factors: the type of motor imagery (e.g., repetitive, ballistic), the frequency band (or signal modality) used for discrimination (e.g., alpha, beta, gamma, and MRCP, i.e., movement-related cortical potential), and the processing technique (e.g., time-series analysis, sub-band power estimation). In this study, we investigated single trial EEG traces during movement imagination on healthy individuals, and provided a comprehensive analysis of the performance of a short-latency brain switch when varying these three factors. The morphological investigation showed a cross-subject consistency of a prolonged negative phase in MRCP, and a delayed beta rebound in sensory-motor rhythms during repetitive tasks. The detection performance had the greatest accuracy when using ballistic MRCP with time-series analysis. In this case, the true positive rate (TPR) was ~70% for a detection latency of ~200 ms. The results presented here are of practical relevance for designing BCI systems for motor function rehabilitation.

Negligible Motion Artifacts in Scalp Electroencephalography (EEG) During Treadmill Walking

Recent mobile brain/body imaging (MoBI) techniques based on active electrode scalp electroencephalogram (EEG) allow the acquisition and real-time analysis of brain dynamics during active unrestrained motor behavior involving whole body movements such as treadmill walking, over-ground walking and other locomotive and non-locomotive tasks. Unfortunately, MoBI protocols are prone to physiological and non-physiological artifacts, including motion artifacts that may contaminate the EEG recordings. A few attempts have been made to quantify these artifacts during locomotion tasks but with inconclusive results due in part to methodological pitfalls. In this paper, we investigate the potential contributions of motion artifacts in scalp EEG during treadmill walking at three different speeds (1.5, 3.0, and 4.5 km/h) using a wireless 64 channel active EEG system and a wireless inertial sensor attached to the subject’s head. The experimental setup was designed according to good measurement practices using state-of-the-art commercially available instruments, and the measurements were analyzed using Fourier analysis and wavelet coherence approaches. Contrary to prior claims, the subjects’ motion did not significantly affect their EEG during treadmill walking although precaution should be taken when gait speeds approach 4.5 km/h. Overall, these findings suggest how MoBI methods may be safely deployed in neural, cognitive, and rehabilitation engineering applications.

A lower limb exoskeleton control system based on steady state visual evoked potentials

OBJECTIVE

We have developed an asynchronous brain-machine interface (BMI)-based lower limb exoskeleton control system based on steady-state visual evoked potentials (SSVEPs).

APPROACH

By decoding electroencephalography signals in real-time, users are able to walk forward, turn right, turn left, sit, and stand while wearing the exoskeleton. SSVEP stimulation is implemented with a visual stimulation unit, consisting of five light emitting diodes fixed to the exoskeleton. A canonical correlation analysis (CCA) method for the extraction of frequency information associated with the SSVEP was used in combination with k-nearest neighbors.

MAIN RESULTS

Overall, 11 healthy subjects participated in the experiment to evaluate performance. To achieve the best classification, CCA was first calibrated in an offline experiment. In the subsequent online experiment, our results exhibit accuracies of 91.3 ± 5.73%, a response time of 3.28 ± 1.82 s, an information transfer rate of 32.9 ± 9.13 bits/min, and a completion time of 1100 ± 154.92 s for the experimental parcour studied.

SIGNIFICANCE

The ability to achieve such high quality BMI control indicates that an SSVEP-based lower limb exoskeleton for gait assistance is becoming feasible.

The H2 robotic exoskeleton for gait rehabilitation after stroke: early findings from a clinical study

BACKGROUND

Stroke significantly affects thousands of individuals annually, leading to considerable physical impairment and functional disability. Gait is one of the most important activities of daily living affected in stroke survivors. Recent technological developments in powered robotics exoskeletons can create powerful adjunctive tools for rehabilitation and potentially accelerate functional recovery. Here, we present the development and evaluation of a novel lower limb robotic exoskeleton, namely H2 (Technaid S.L., Spain), for gait rehabilitation in stroke survivors.

METHODS

H2 has six actuated joints and is designed to allow intensive overground gait training. An assistive gait control algorithm was developed to create a force field along a desired trajectory, only applying torque when patients deviate from the prescribed movement pattern. The device was evaluated in 3 hemiparetic stroke patients across 4 weeks of training per individual (approximately 12 sessions). The study was approved by the Institutional Review Board at the University of Houston. The main objective of this initial pre-clinical study was to evaluate the safety and usability of the exoskeleton. A Likert scale was used to measure patient's perception about the easy of use of the device.

RESULTS

Three stroke patients completed the study. The training was well tolerated and no adverse events occurred. Early findings demonstrate that H2 appears to be safe and easy to use in the participants of this study. The overground training environment employed as a means to enhance active patient engagement proved to be challenging and exciting for patients. These results are promising and encourage future rehabilitation training with a larger cohort of patients.

CONCLUSIONS

The developed exoskeleton enables longitudinal overground training of walking in hemiparetic patients after stroke. The system is robust and safe when applied to assist a stroke patient performing an overground walking task. Such device opens the opportunity to study means to optimize a rehabilitation treatment that can be customized for individuals.

TRIAL REGISTRATION

This study was registered at ClinicalTrials.gov ( https://clinicaltrials.gov/show/NCT02114450 ).

Coarse electrocorticographic decoding of ipsilateral reach in patients with brain lesions

In patients with unilateral upper limb paralysis from strokes and other brain lesions, strategies for functional recovery may eventually include brain-machine interfaces (BMIs) using control signals from residual sensorimotor systems in the damaged hemisphere. When voluntary movements of the contralateral limb are not possible due to brain pathology, initial training of such a BMI may require use of the unaffected ipsilateral limb. We conducted an offline investigation of the feasibility of decoding ipsilateral upper limb movements from electrocorticographic (ECoG) recordings in three patients with different lesions of sensorimotor systems associated with upper limb control. We found that the first principal component (PC) of unconstrained, naturalistic reaching movements of the upper limb could be decoded from ipsilateral ECoG using a linear model. ECoG signal features yielding the best decoding accuracy were different across subjects. Performance saturated with very few input features. Decoding performances of 0.77, 0.73, and 0.66 (median Pearson's r between the predicted and actual first PC of movement using nine signal features) were achieved in the three subjects. The performance achieved here with small numbers of electrodes and computationally simple decoding algorithms suggests that it may be possible to control a BMI using ECoG recorded from damaged sensorimotor brain systems.

Brain-machine interfaces in neurorehabilitation of stroke

Stroke is among the leading causes of long-term disabilities leaving an increasing number of people with cognitive, affective and motor impairments depending on assistance in their daily life. While function after stroke can significantly improve in the first weeks and months, further recovery is often slow or non-existent in the more severe cases encompassing 30-50% of all stroke victims. The neurobiological mechanisms underlying recovery in those patients are incompletely understood. However, recent studies demonstrated the brain's remarkable capacity for functional and structural plasticity and recovery even in severe chronic stroke. As all established rehabilitation strategies require some remaining motor function, there is currently no standardized and accepted treatment for patients with complete chronic muscle paralysis. The development of brain-machine interfaces (BMIs) that translate brain activity into control signals of computers or external devices provides two new strategies to overcome stroke-related motor paralysis. First, BMIs can establish continuous high-dimensional brain-control of robotic devices or functional electric stimulation (FES) to assist in daily life activities (assistive BMI). Second, BMIs could facilitate neuroplasticity, thus enhancing motor learning and motor recovery (rehabilitative BMI). Advances in sensor technology, development of non-invasive and implantable wireless BMI-systems and their combination with brain stimulation, along with evidence for BMI systems' clinical efficacy suggest that BMI-related strategies will play an increasing role in neurorehabilitation of stroke.

Current Trends in Robot-Assisted Upper-Limb Stroke Rehabilitation: Promoting Patient Engagement in Therapy

Stroke is one of the leading causes of long-term disability today; therefore, many research efforts are focused on designing maximally effective and efficient treatment methods. In particular, robotic stroke rehabilitation has received significant attention for upper-limb therapy due to its ability to provide high-intensity repetitive movement therapy with less effort than would be required for traditional methods. Recent research has focused on increasing patient engagement in therapy, which has been shown to be important for inducing neural plasticity to facilitate recovery. Robotic therapy devices enable unique methods for promoting patient engagement by providing assistance only as needed and by detecting patient movement intent to drive to the device. Use of these methods has demonstrated improvements in functional outcomes, but careful comparisons between methods remain to be done. Future work should include controlled clinical trials and comparisons of effectiveness of different methods for patients with different abilities and needs in order to inform future development of patient-specific therapeutic protocols.