Body machine interface: remapping motor skills after spinal cord injury

Treatment of the Paretic Hand with a Robotic Glove Combined with Physiotherapy in a Patient Suffering from Traumatic Tetraparesis: A Case Report

BACKGROUND

cervical spinal cord injury leads to loss of upper limb functionality, which causes a decrease in autonomy to perform activities of daily living. The use of robotic technologies in rehabilitation could contribute to improving upper limb functionality and treatment quality. This case report aims to describe the potential of robotic hand treatment with Gloreha Sinfonia, in combination with conventional rehabilitation, in a tetraparetic patient.

MATERIAL

fifteen rehabilitative sessions were performed. Evaluations were conducted pre-treatment (T0), post-treatment (T1), and at two-months follow-up (T2) based on: the upper-limb range of motion and force assessment, the FMA-UE, the 9-Hole Peg Test (9HPT), and the DASH questionnaire. A virtual reality game-based rating system was used to evaluate the force control and modulation ability.

RESULTS

the patient reported greater ability to use hands with less compensation at T1 and T2 assessments. Improvements in clinical scales were reported in both hands at T1, however, at T2 only did the dominant hand show further improvement. Improved grip strength control and modulation ability were reported for T1. However a worsening was found in both hands at T2, significant only for the non-dominant hand. The maximum force exerted increased from T0 to T2 in both hands.

CONCLUSION

hand treatment combining physical therapy and Gloreha Sinfonia seems to have benefits in functionality and dexterity in tetraparetic patient in the short term. Further studies are needed to confirm these findings, to verify long-term results, and to identify the most appropriate modalities of robotic rehabilitation.

A Residual Movement Classification Based User Interface for Control of Assistive Devices by Persons with Complete Tetraplegia

OBJECTIVE

Complete tetraplegia can deprive a person of hand function. Assistive technologies may improve autonomy but needs for ergonomic interfaces for the user to pilot these devices still persist. Despite the paralysis of their arms, people with tetraplegia may retain residual shoulder movements. In this work we explored these movements as a mean to control assistive devices.

METHODS

We captured shoulder movement with a single inertial sensor and, by training a support vector machine based classifier, we decode such information into user intent.

RESULTS

The setup and training process take only a few minutes and so the classifiers can be user specific. We tested the algorithm with 10 able body and 2 spinal cord injury participants. The average classification accuracy was 80% and 84%, respectively.

CONCLUSION

The proposed algorithm is easy to set up, its operation is fully automated, and achieved results are on par with state-of-the-art systems.

SIGNIFICANCE

Assistive devices for persons without hand function present limitations in their user interfaces. Our work present a novel method to overcome some of these limitations by classifying user movement and decoding it into user intent, all with simple setup and training and no need for manual tuning. We demonstrate its feasibility with experiments with end users, including persons with complete tetraplegia without hand function.

Cerebellar contribution to sensorimotor adaptation deficits in humans with spinal cord injury

Humans with spinal cord injury (SCI) show deficits in associating motor commands and sensory feedback. Do these deficits affect their ability to adapt movements to new demands? To address this question, we used a robotic exoskeleton to examine learning of a sensorimotor adaptation task during reaching movements by distorting the relationship between hand movement and visual feedback in 22 individuals with chronic incomplete cervical SCI and 22 age-matched control subjects. We found that SCI individuals showed a reduced ability to learn from movement errors compared with control subjects. Sensorimotor areas in anterior and posterior cerebellar lobules contribute to learning of movement errors in intact humans. Structural brain imaging showed that sensorimotor areas in the cerebellum, including lobules I-VI, were reduced in size in SCI compared with control subjects and cerebellar atrophy increased with increasing time post injury. Notably, the degree of spared tissue in the cerebellum was positively correlated with learning rates, indicating participants with lesser atrophy showed higher learning rates. These results suggest that the reduced ability to learn from movement errors during reaching movements in humans with SCI involves abnormalities in the spinocerebellar structures. We argue that this information might help in the rehabilitation of people with SCI.

The dynamics of motor learning through the formation of internal models

A medical student learning to perform a laparoscopic procedure or a recently paralyzed user of a powered wheelchair must learn to operate machinery via interfaces that translate their actions into commands for an external device. Since the user's actions are selected from a number of alternatives that would result in the same effect in the control space of the external device, learning to use such interfaces involves dealing with redundancy. Subjects need to learn an externally chosen many-to-one map that transforms their actions into device commands. Mathematically, we describe this type of learning as a deterministic dynamical process, whose state is the evolving forward and inverse internal models of the interface. The forward model predicts the outcomes of actions, while the inverse model generates actions designed to attain desired outcomes. Both the mathematical analysis of the proposed model of learning dynamics and the learning performance observed in a group of subjects demonstrate a first-order exponential convergence of the learning process toward a particular state that depends only on the initial state of the inverse and forward models and on the sequence of targets supplied to the users. Noise is not only present but necessary for the convergence of learning through the minimization of the difference between actual and predicted outcomes.

Changes in neuromuscular activity during motor training with a body-machine interface after spinal cord injury

Body machine interfaces (BMIs) are used by people with severe motor disabilities to control external devices, but they also offer the opportunity to focus on rehabilitative goals. In this study we introduced in a clinical setting a BMI that was integrated by the therapists in the rehabilitative treatments of 2 spinal cord injured (SCI) subjects for 5 weeks. The BMI mapped the user's residual upper body mobility onto the two coordinates of a cursor on a screen. By controlling the cursor, the user engaged in playing computer games. The BMI allowed the mapping between body and cursor spaces to be modified, gradually challenging the user to exercise more impaired movements. With this approach, we were able to change our subjects' behavior, who initially used almost exclusively their proximal upper body-shoulders and arms - for using the BMI. By the end of training, cursor control was shifted toward more distal body regions - forearms instead of upper arms - with an increase of mobility and strength of all the degrees of freedom involved in the control. The clinical tests and the electromyographic signals from the main muscles of the upper body confirmed the positive effect of the training. Encouraging the subjects to explore different and sometimes unusual movement combinations was beneficial for recovering distal arm functions and for increasing their overall mobility.

Design and development of a five-bar robot for research into lower extremity proprioception

Ankle inversion is a common injury of musculoskeletal system among athletes and also in the older population. Investigation into ankle inversion requires quantitative assessment of the smallest amount of height/angle change in the floor that can be perceived by human. Blocks of different thickness have been used to change floor height manually during tests. We aimed to develop an automatic apparatus that is able to provide improved height and angle resolutions for dynamic ankle proprioception. We designed and manufactured a five-bar planar robot with one coupler serving as the mobile platform. We used a stiffening rib to achieve consistent differences in deflection across the workspace of the mobile platform. The reported robot translates at the maximal speed 423 mm/s with a resolution at 0.21 mm under a maximal load of 358 kg. This robot allows for increased sensitivity, which may lead to further investigation of functional proprioceptive ability and reflect finely tuned sensory requirements for upright stance.

Learning new movements after paralysis: Results from a home-based study

Body-machine interfaces (BMIs) decode upper-body motion for operating devices, such as computers and wheelchairs. We developed a low-cost portable BMI for survivors of cervical spinal cord injury and investigated it as a means to support personalized assistance and therapy within the home environment. Depending on the specific impairment of each participant, we modified the interface gains to restore a higher level of upper body mobility. The use of the BMI over one month led to increased range of motion and force at the shoulders in chronic survivors. Concurrently, subjects learned to reorganize their body motions as they practiced the control of a computer cursor to perform different tasks and games. The BMI allowed subjects to generate any movement of the cursor with different motions of their body. Through practice subjects demonstrated a tendency to increase the similarity between the body motions used to control the cursor in distinct tasks. Nevertheless, by the end of learning, some significant and persistent differences appeared to persist. This suggests the ability of the central nervous system to concurrently learn operating the BMI while exploiting the possibility to adapt the available mobility to the specific spatio-temporal requirements of each task.

Body-Machine Interface Enables People With Cervical Spinal Cord Injury to Control Devices With Available Body Movements: Proof of Concept

This study tested the use of a customized body-machine interface (BoMI) for enhancing functional capabilities in persons with cervical spinal cord injury (cSCI). The interface allows people with cSCI to operate external devices by reorganizing their residual movements. This was a proof-of-concept phase 0 interventional nonrandomized clinical trial. Eight cSCI participants wore a custom-made garment with motion sensors placed on the shoulders. Signals derived from the sensors controlled a computer cursor. A standard algorithm extracted the combinations of sensor signals that best captured each participant's capacity for controlling a computer cursor. Participants practiced with the BoMI for 24 sessions over 12 weeks performing 3 tasks: reaching, typing, and game playing. Learning and performance were evaluated by the evolution of movement time, errors, smoothness, and performance metrics specific to each task. Through practice, participants were able to reduce the movement time and the distance from the target at the 1-second mark in the reaching task. They also made straighter and smoother movements while reaching to different targets. All participants became faster in the typing task and more skilled in game playing, as the pong hit rate increased significantly with practice. The results provide proof-of-concept for the customized BoMI as a means for people with absent or severely impaired hand movements to control assistive devices that otherwise would be manually operated.

Body-Machine Interfaces after Spinal Cord Injury: Rehabilitation and Brain Plasticity

The purpose of this study was to identify rehabilitative effects and changes in white matter microstructure in people with high-level spinal cord injury following bilateral upper-extremity motor skill training. Five subjects with high-level (C5-C6) spinal cord injury (SCI) performed five visuo-spatial motor training tasks over 12 sessions (2-3 sessions per week). Subjects controlled a two-dimensional cursor with bilateral simultaneous movements of the shoulders using a non-invasive inertial measurement unit-based body-machine interface. Subjects' upper-body ability was evaluated before the start, in the middle and a day after the completion of training. MR imaging data were acquired before the start and within two days of the completion of training. Subjects learned to use upper-body movements that survived the injury to control the body-machine interface and improved their performance with practice. Motor training increased Manual Muscle Test scores and the isometric force of subjects' shoulders and upper arms. Moreover, motor training increased fractional anisotropy (FA) values in the cingulum of the left hemisphere by 6.02% on average, indicating localized white matter microstructure changes induced by activity-dependent modulation of axon diameter, myelin thickness or axon number. This body-machine interface may serve as a platform to develop a new generation of assistive-rehabilitative devices that promote the use of, and that re-strengthen, the motor and sensory functions that survived the injury.

Static Versus Dynamic Decoding Algorithms in a Non-Invasive Body-Machine Interface

In this study, we consider a non-invasive body-machine interface that captures body motions still available to people with spinal cord injury (SCI) and maps them into a set of signals for controlling a computer user interface while engaging in a sustained level of mobility and exercise. We compare the effectiveness of two decoding algorithms that transform a high-dimensional body-signal vector into a lower dimensional control vector on six subjects with high-level SCI and eight controls. One algorithm is based on a static map from current body signals to the current value of the control vector set through principal component analysis (PCA), the other on dynamic mapping a segment of body signals to the value and the temporal derivatives of the control vector set through a Kalman filter. SCI and control participants performed straighter and smoother cursor movements with the Kalman algorithm during center-out reaching, but their movements were faster and more precise when using PCA. All participants were able to use the BMI's continuous, two-dimensional control to type on a virtual keyboard and play pong, and performance with both algorithms was comparable. However, seven of eight control participants preferred PCA as their method of virtual wheelchair control. The unsupervised PCA algorithm was easier to train and seemed sufficient to achieve a higher degree of learnability and perceived ease of use.

A body-machine interface for training selective pelvis movements in stroke survivors: A pilot study

The body-machine interfaces (BMIs) map the subjects' movements into the low dimensional control space of external devices to reach assistive and/or rehabilitative goals. This work is a first proof of concept of this kind of BMI as tool for rehabilitation after stroke. We designed an exercise to improve the control of selective movements of the pelvis in stroke survivors, increasing the ability to decouple the motion in the sagittal and frontal planes and decreasing compensatory adjustments at the shoulder girdle. A Kinect sensor recorded the movements of the subjects. Subjects played different games by controlling the vertical and horizontal motion of a cursor on a screen with respectively the lateral tilt and the ante/retroversion of their pelvis. We monitored also the degrees of freedom not directly involved in cursor control, thus subjects could complete the task only with a correct posture. Our preliminary results highlight significant improvement not only in cursor control, but also in the Trunk Impairment Scale (TIS) and in the Five Times Sit to Stand Test (5xSST).

Remapping residual coordination for controlling assistive devices and recovering motor functions

The concept of human motor redundancy attracted much attention since the early studies of motor control, as it highlights the ability of the motor system to generate a great variety of movements to achieve any well-defined goal. The abundance of degrees of freedom in the human body may be a fundamental resource in the learning and remapping problems that are encountered in human-machine interfaces (HMIs) developments. The HMI can act at different levels decoding brain signals or body signals to control an external device. The transformation from neural signals to device commands is the core of research on brain-machine interfaces (BMIs). However, while BMIs bypass completely the final path of the motor system, body-machine interfaces (BoMIs) take advantage of motor skills that are still available to the user and have the potential to enhance these skills through their consistent use. BoMIs empower people with severe motor disabilities with the possibility to control external devices, and they concurrently offer the opportunity to focus on achieving rehabilitative goals. In this study we describe a theoretical paradigm for the use of a BoMI in rehabilitation. The proposed BoMI remaps the user's residual upper body mobility to the two coordinates of a cursor on a computer screen. This mapping is obtained by principal component analysis (PCA). We hypothesize that the BoMI can be specifically programmed to engage the users in functional exercises aimed at partial recovery of motor skills, while simultaneously controlling the cursor and carrying out functional tasks, e.g. playing games. Specifically, PCA allows us to select not only the subspace that is most comfortable for the user to act upon, but also the degrees of freedom and coordination patterns that the user has more difficulty engaging. In this article, we describe a family of map modifications that can be made to change the motor behavior of the user. Depending on the characteristics of the impairment of each high-level spinal cord injury (SCI) survivor, we can make modifications to restore a higher level of symmetric mobility (left versus right), or to increase the strength and range of motion of the upper body that was spared by the injury. Results showed that this approach restored symmetry between left and right side of the body, with an increase of mobility and strength of all the degrees of freedom in the participants involved in the control of the interface. This is a proof of concept that our BoMI may be used concurrently to control assistive devices and reach specific rehabilitative goals. Engaging the users in functional and entertaining tasks while practicing the interface and changing the map in the proposed ways is a novel approach to rehabilitation treatments facilitated by portable and low-cost technologies.

A body machine interface based on inertial sensors

Spinal cord injury (SCI) survivors generally retain residual motor and sensory functions, which provide them with the means to control assistive devices. A body-machine interface (BoMI) establishes a mapping from these residual body movements to control commands for an external device. In this study, we designed a BoMI to smooth the way for operating computers, powered wheelchairs and other assistive technologies after cervical spinal cord injuries. The interface design included a comprehensive training paradigm with a range of diverse functional activities to enhance motor learning and retention. Two groups of SCI survivors and healthy control subjects participated in the study. The results indicate the effectiveness of the developed system as an alternative pathway for individuals with motor disabilities to control assistive devices while engaging in functional motor activity.

Body machine interfaces for neuromotor rehabilitation: a case study

High-level spinal cord injury (SCI) survivors face every day two related problems: recovering motor skills and regaining functional independence. Body machine interfaces (BoMIs) empower people with sever motor disabilities with the ability to control an external device, but they also offer the opportunity to focus concurrently on achieving rehabilitative goals. In this study we developed a portable, and low-cost BoMI that addresses both problems. The BoMI remaps the user's residual upper body mobility to the two coordinates of a cursor on a computer monitor. By controlling the cursor, the user can perform functional tasks, such as entering text and playing games. This framework also allows the mapping between the body and the cursor space to be modified, gradually challenging the user to exercise more impaired movements. With this approach, we were able to change the behavior of our SCI subject, who initially used almost exclusively his less impaired degrees of freedom - on the left side - for controlling the BoMI. At the end of the few practice sessions he had restored symmetry between left and right side of the body, with an increase of mobility and strength of all the degrees of freedom involved in the control of the interface. This is the first proof of concept that our BoMI can be used to control assistive devices and reach specific rehabilitative goals simultaneously.

Assistive Robotic Manipulation through Shared Autonomy and a Body-Machine Interface

Assistive robotic manipulators have the potential to improve the lives of people with motor impairments. They can enable individuals to perform activities such as pick-and-place tasks, opening doors, pushing buttons, and can even provide assistance in personal hygiene and feeding. However, robotic arms often have more degrees of freedom (DoF) than the dimensionality of their control interface, making them challenging to use-especially for those with impaired motor abilities. Our research focuses on enabling the control of high-DoF manipulators to motor-impaired individuals for performing daily tasks. We make use of an individual's residual motion capabilities, captured through a Body-Machine Interface (BMI), to generate control signals for the robotic arm. These low-dimensional controls are then utilized in a shared-control framework that shares control between the human user and robot autonomy. We evaluated the system by conducting a user study in which 6 participants performed 144 trials of a manipulation task using the BMI interface and the proposed shared-control framework. The 100% success rate on task performance demonstrates the effectiveness of the proposed system for individuals with motor impairments to control assistive robotic manipulators.

Upper Body-Based Power Wheelchair Control Interface for Individuals With Tetraplegia

Many power wheelchair control interfaces are not sufficient for individuals with severely limited upper limb mobility. The majority of controllers that do not rely on coordinated arm and hand movements provide users a limited vocabulary of commands and often do not take advantage of the user's residual motion. We developed a body-machine interface (BMI) that leverages the flexibility and customizability of redundant control by using high dimensional changes in shoulder kinematics to generate proportional control commands for a power wheelchair. In this study, three individuals with cervical spinal cord injuries were able to control a power wheelchair safely and accurately using only small shoulder movements. With the BMI, participants were able to achieve their desired trajectories and, after five sessions driving, were able to achieve smoothness that was similar to the smoothness with their current joystick. All participants were twice as slow using the BMI however improved with practice. Importantly, users were able to generalize training controlling a computer to driving a power wheelchair, and employed similar strategies when controlling both devices. Overall, this work suggests that the BMI can be an effective wheelchair control interface for individuals with high-level spinal cord injuries who have limited arm and hand control.

Encoder-decoder optimization for brain-computer interfaces

Neuroprosthetic brain-computer interfaces are systems that decode neural activity into useful control signals for effectors, such as a cursor on a computer screen. It has long been recognized that both the user and decoding system can adapt to increase the accuracy of the end effector. Co-adaptation is the process whereby a user learns to control the system in conjunction with the decoder adapting to learn the user's neural patterns. We provide a mathematical framework for co-adaptation and relate co-adaptation to the joint optimization of the user's control scheme ("encoding model") and the decoding algorithm's parameters. When the assumptions of that framework are respected, co-adaptation cannot yield better performance than that obtainable by an optimal initial choice of fixed decoder, coupled with optimal user learning. For a specific case, we provide numerical methods to obtain such an optimized decoder. We demonstrate our approach in a model brain-computer interface system using an online prosthesis simulator, a simple human-in-the-loop pyschophysics setup which provides a non-invasive simulation of the BCI setting. These experiments support two claims: that users can learn encoders matched to fixed, optimal decoders and that, once learned, our approach yields expected performance advantages.

Non-invasive control interfaces for intention detection in active movement-assistive devices

Active movement-assistive devices aim to increase the quality of life for patients with neuromusculoskeletal disorders. This technology requires interaction between the user and the device through a control interface that detects the user’s movement intention. Researchers have explored a wide variety of invasive and non-invasive control interfaces. To summarize the wide spectrum of strategies, this paper presents a comprehensive review focused on non-invasive control interfaces used to operate active movement-assistive devices. A novel systematic classification method is proposed to categorize the control interfaces based on: (I) the source of the physiological signal, (II) the physiological phenomena responsible for generating the signal, and (III) the sensors used to measure the physiological signal. The proposed classification method can successfully categorize all the existing control interfaces providing a comprehensive overview of the state of the art. Each sensing modality is briefly described in the body of the paper following the same structure used in the classification method. Furthermore, we discuss several design considerations, challenges, and future directions of non-invasive control interfaces for active movement-assistive devices.

Cursor control by Kalman filter with a non-invasive body-machine interface

OBJECTIVE

We describe a novel human-machine interface for the control of a two-dimensional (2D) computer cursor using four inertial measurement units (IMUs) placed on the user's upper-body.

APPROACH

A calibration paradigm where human subjects follow a cursor with their body as if they were controlling it with their shoulders generates a map between shoulder motions and cursor kinematics. This map is used in a Kalman filter to estimate the desired cursor coordinates from upper-body motions. We compared cursor control performance in a centre-out reaching task performed by subjects using different amounts of information from the IMUs to control the 2D cursor.

MAIN RESULTS

Our results indicate that taking advantage of the redundancy of the signals from the IMUs improved overall performance. Our work also demonstrates the potential of non-invasive IMU-based body-machine interface systems as an alternative or complement to brain-machine interfaces for accomplishing cursor control in 2D space.

SIGNIFICANCE

The present study may serve as a platform for people with high-tetraplegia to control assistive devices such as powered wheelchairs using a joystick.

Closed-loop brain-machine-body interfaces for noninvasive rehabilitation of movement disorders

Traditional approaches for neurological rehabilitation of patients affected with movement disorders, such as Parkinson's disease (PD), dystonia, and essential tremor (ET) consist mainly of oral medication, physical therapy, and botulinum toxin injections. Recently, the more invasive method of deep brain stimulation (DBS) showed significant improvement of the physical symptoms associated with these disorders. In the past several years, the adoption of feedback control theory helped DBS protocols to take into account the progressive and dynamic nature of these neurological movement disorders that had largely been ignored so far. As a result, a more efficient and effective management of PD cardinal symptoms has emerged. In this paper, we review closed-loop systems for rehabilitation of movement disorders, focusing on PD, for which several invasive and noninvasive methods have been developed during the last decade, reducing the complications and side effects associated with traditional rehabilitation approaches and paving the way for tailored individual therapeutics. We then present a novel, transformative, noninvasive closed-loop framework based on force neurofeedback and discuss several future developments of closed-loop systems that might bring us closer to individualized solutions for neurological rehabilitation of movement disorders.

Pulsed assistance: a new paradigm of robot training

In this preliminary study we compare continuous with pulsed robot assistance in five chronic stroke survivors with a mild degree of spasticity, with the aim of promoting volitional effort and reducing assistance during a reaching task. The protocol consists of one familiarization session and a single training session during which a manipulandum provides subjects with pulsed or continuous assistance in random order. The basic level of assistive force is calibrated for each subject and is the same for both modalities; however, the average force during continuous assistance is about twice the average force in pulsed assistance. In spite of this, the results show that pulsed assistance allows subjects to reach similar performance levels as compared to continuous assistance after a single training session. Moreover, we introduce a novel kinematic-based measure to assess voluntary participation of subjects during the rehabilitation task, which is only applicable with pulsed assistance.

The body-machine interface: a new perspective on an old theme

Body-machine interfaces establish a way to interact with a variety of devices, allowing their users to extend the limits of their performance. Recent advances in this field, ranging from computer interfaces to bionic limbs, have had important consequences for people with movement disorders. The authors provide an overview of the basic concepts underlying the body-machine interface with special emphasis on their use for rehabilitation and for operating assistive devices. They outline the steps involved in building such an interface and highlight the critical role of body-machine interfaces in addressing theoretical issues in motor control as well as their utility in movement rehabilitation.