On the control of a robot hand by extracting neural signals from the PNS: preliminary results from a human implantation

Computational approaches to decode grasping force and velocity level in upper-limb amputee from intraneural peripheral signals

Objective. Recent results have shown the potentials of neural interfaces to provide sensory feedback to subjects with limb amputation increasing prosthesis usability. However, their advantages for decoding motor control signals over current methods based on electromyography (EMG) are still debated. In this study we compared a standard EMG-based method with approaches that use peripheral intraneural data to infer distinct levels of grasping force and velocity in a trans-radial amputee.Approach. Surface EMG (three channels) and intraneural signals (collected with transverse intrafascicular multichannel electrodes, TIMEs, 56 channels) were simultaneously recorded during the amputee's intended grasping movements. We sorted single unit activity (SUA) from each neural signal and then we identified the most informative units. EMG envelopes were extracted from the recorded EMG signals. A reference support vector machine (SVM) classifier was used to map EMG envelopes into desired force and velocity levels. Two decoding approaches using SUA were then tested and compared to the EMG-based reference classifier: (a) SVM classification of firing rates into desired force and velocity levels; (b) reconstruction of covariates (the grasp cue level or EMG envelopes) from neural data and use of covariates for classification into desired force and velocity levels.Main results.Using EMG envelopes as reconstructed covariates from SUA yielded significantly better results than the other approaches tested, with performance similar to that of the EMG-based reference classifier, and stable over three different recording days. Of the two reconstruction algorithms used in this approach, a linear Kalman filter and a nonlinear point process adaptive filter, the nonlinear filter gave better results.Significance.This study presented a new effective approach for decoding grasping force and velocity from peripheral intraneural signals in a trans-radial amputee, which relies on using SUA to reconstruct EMG envelopes. Being dependent on EMG recordings only for the training phase, this approach can fully exploit the advantages of implanted neural interfaces and potentially overcome, in the medium to long term, current state-of-the-art methods. (Clinical trial's registration number: NCT02848846).

Brain-machine and muscle-machine bio-sensing methods for gesture intent acquisition in upper-limb prosthesis control: a review

This paper presents a review of a number of bio-sensing methods for gesture intent signal acquisition in control tasks for upper-limb prosthesis. The paper specifically provides a breakdown of the control task in myoelectric prosthesis, and in addition, highlights and describes the importance of the acquisition of a high-quality bio-signal. The paper also describes commonly used invasive and non-invasive brain and muscle machine interfaces such as electroencephalography, electrocorticography, electroneurography, surface electromyography, sonomyography, mechanomyography, near infra-red, force sensitive resistance/pressure, and magnetoencephalography. Each modality is reviewed based on its operating principle and limitations in gesture recognition, followed by respective advantages and disadvantages. Also described within this paper, are multimodal sensing approaches, which involve data fusion of information from various sensing modalities for an enhanced neuromuscular bio-sensing source. Using a semi-systematic review methodology, we are able to derive a novel tabular approach towards contrasting the various strengths and weaknesses of the reviewed bio-sensing methods towards gesture recognition in a prosthesis interface. This would allow for a streamlined method of down selection of an appropriate bio-sensor given specific prosthesis design criteria and requirements. The paper concludes by highlighting a number of research areas that require more work for strides to be made towards improving and enhancing the connection between man and machine as it concerns upper-limb prosthesis. Such areas include classifier augmentation for gesture recognition, filtering techniques for sensor disturbance rejection, feeling of tactile sensations with an artificial limb.

The Interaction Between Feedback Type and Learning in Routine Grasping With Myoelectric Prostheses

While prosthetic fitting after upper-limb loss allows for restoration of motor functions, it deprives the amputee of tactile sensations that are essential for grasp control in able-bodied subjects. Therefore, it is commonly assumed that restoring the force feedback would improve the control of prosthesis grasping force. However, the literature regarding the benefit of feedback is controversial. Here, we investigated how the type of feedback affects learning and steady-state performance of routine grasping with a prosthesis. The experimental task was to grasp an object using a prosthesis and generate a low or high target-force range (TFR), both initially unknown, in three feedback conditions: basic auditory feedback on task outcome, and additional visual or vibratory feedback on the force magnitude. The results demonstrated that the performance was rather good and stable for the low TFR, whereas it was substantially worse for the high TFR with a pronounced training effect. Surprisingly, learning curve and steady-state performance did not depend on the feedback condition. Hence, in the specific context of routing grasping with a prosthesis controlled via surface EMG, the basic feedback on task outcome was not outperformed by force-related end-of-trial feedback and hence seemed to be sufficient for accomplishing the task.This conclusion applies to the context of routine grasping using a myoelectric prosthesis with surface EMG electrodes, which means that the control signals are variable and the feedback is perceived and processed at the end of the trial (motor adaption).

Human motor decoding from neural signals: a review

Many people suffer from movement disability due to amputation or neurological diseases. Fortunately, with modern neurotechnology now it is possible to intercept motor control signals at various points along the neural transduction pathway and use that to drive external devices for communication or control. Here we will review the latest developments in human motor decoding. We reviewed the various strategies to decode motor intention from human and their respective advantages and challenges. Neural control signals can be intercepted at various points in the neural signal transduction pathway, including the brain (electroencephalography, electrocorticography, intracortical recordings), the nerves (peripheral nerve recordings) and the muscles (electromyography). We systematically discussed the sites of signal acquisition, available neural features, signal processing techniques and decoding algorithms in each of these potential interception points. Examples of applications and the current state-of-the-art performance were also reviewed. Although great strides have been made in human motor decoding, we are still far away from achieving naturalistic and dexterous control like our native limbs. Concerted efforts from material scientists, electrical engineers, and healthcare professionals are needed to further advance the field and make the technology widely available in clinical use.

Bioelectric interfaces for the peripheral nervous system

The peripheral nervous system (PNS) is an attractive target for those developing neural interfaces as an access point to the information flow coursing within our bodies. A successful neural interface could not only offer the means to understand basic neurophysiological mechanisms, such as how the body accomplishes complex coordinated control of multi degree of freedom body segments, but also could serve as the means of delivering treatment or therapies to restore physiological functions lost due to injury or disease. Our work in the development of such a neural interface focuses upon multi-microelectrode devices that are placed within the body of the nerve fascicle; mulit-channel intra-fascicular devices called the thin-film Longitudinal Intra-Fascicular Electrode (tfLIFE) and the Transversely Implanted Multi-Electrode (TIME). These structures provide high resolution access to the PNS and have demonstrated promise in animal work as well as in preliminary sub-acute work in human volunteers. However, work remains to improve upon their longevity and biocompatibility before full translation to clinical work can occur.

Augmentation-related brain plasticity

Today, the anthropomorphism of the tools and the development of neural interfaces require reconsidering the concept of human-tools interaction in the framework of human augmentation. This review analyses the plastic process that the brain undergoes when it comes into contact with augmenting artificial sensors and effectors and, on the other hand, the changes that the use of external augmenting devices produces in the brain. Hitherto, few studies investigated the neural correlates of augmentation, but clues on it can be borrowed from logically-related paradigms: sensorimotor training, cognitive enhancement, cross-modal plasticity, sensorimotor functional substitution, use and embodiment of tools. Augmentation modifies function and structure of a number of areas, i.e., primary sensory cortices shape their receptive fields to become sensitive to novel inputs. Motor areas adapt the neuroprosthesis representation firing-rate to refine kinematics. As for normal motor outputs, the learning process recruits motor and premotor cortices and the acquisition of proficiency decreases attentional recruitment, focuses the activity on sensorimotor areas and increases the basal ganglia drive on the cortex. Augmentation deeply relies on the frontoparietal network. In particular, premotor cortex is involved in learning the control of an external effector and owns the tool motor representation, while the intraparietal sulcus extracts its visual features. In these areas, multisensory integration neurons enlarge their receptive fields to embody supernumerary limbs. For operating an anthropomorphic neuroprosthesis, the mirror system is required to understand the meaning of the action, the cerebellum for the formation of its internal model and the insula for its interoception. In conclusion, anthropomorphic sensorized devices can provide the critical sensory afferences to evolve the exploitation of tools through their embodiment, reshaping the body representation and the sense of the self.

Recent trends in assistive technology for mobility

Loss of physical mobility makes maximal participation in desired activities more difficult and in the worst case fully prevents participation. This paper surveys recent work in assistive technology to improve mobility for persons with a disability, drawing on examples observed during a tour of academic and industrial research sites in Europe. The underlying theme of this recent work is a more seamless integration of the capabilities of the user and the assistive technology. This improved integration spans diverse technologies, including powered wheelchairs, prosthetic limbs, functional electrical stimulation, and wearable exoskeletons. Improved integration is being accomplished in three ways: 1) improving the assistive technology mechanics; 2) improving the user-technology physical interface; and 3) sharing of control between the user and the technology. We provide an overview of these improvements in user-technology integration and discuss whether such improvements have the potential to be transformative for people with mobility impairments.