An exploration of grip force regulation with a low-impedance myoelectric prosthesis featuring referred haptic feedback

EMG feedback improves grasping of compliant objects using a myoelectric prosthesis

BACKGROUND

Closing the control loop in myoelectric prostheses by providing artificial somatosensory feedback is recognized as an important goal. However, designing a feedback interface that is effective in realistic conditions is still a challenge. Namely, in some situations, feedback can be redundant, as the information it provides can be readily obtained through hearing or vision (e.g., grasping force estimated from the deformation of a compliant object). EMG feedback is a non-invasive method wherein the tactile stimulation conveys to the user the level of their own myoelectric signal, hence a measurement intrinsic to the interface, which cannot be accessed incidentally.

METHODS

The present study investigated the efficacy of EMG feedback in prosthesis force control when 10 able-bodied participants and a person with transradial amputation used a myoelectric prosthesis to grasp compliant objects of different stiffness values. The performance with feedback was compared to that achieved when the participants relied solely on incidental cues.

RESULTS

The main outcome measures were the task success rate and completion time. EMG feedback resulted in significantly higher success rates regardless of pin stiffness, indicating that the feedback enhanced the accuracy of force application despite the abundance of incidental cues. Contrary to expectations, there was no difference in the completion time between the two feedback conditions. Additionally, the data revealed that the participants could produce smoother control signals when they received EMG feedback as well as more consistent commands across trials, signifying better control of the system by the participants.

CONCLUSIONS

The results presented in this study further support the efficacy of EMG feedback when closing the prosthesis control loop by demonstrating its benefits in particularly challenging conditions which maximized the utility of intrinsic feedback sources.

Neural evidence for functional roles of tactile and visual feedback in the application of myoelectric prosthesis

Objective. The primary purpose of this study was to investigate the electrophysiological mechanism underlying different modalities of sensory feedback and multi-sensory integration in typical prosthesis control tasks.Approach. We recruited 15 subjects and developed a closed-loop setup for three prosthesis control tasks which covered typical activities in the practical prosthesis application, i.e. prosthesis finger position control (PFPC), equivalent grasping force control (GFC) and box and block control (BABC). All the three tasks were conducted under tactile feedback (TF), visual feedback (VF) and tactile-visual feedback (TVF), respectively, with a simultaneous electroencephalography (EEG) recording to assess the electroencephalogram (EEG) response underlying different types of feedback. Behavioral and psychophysical assessments were also administered in each feedback condition.Results. EEG results showed that VF played a predominant role in GFC and BABC tasks. It was reflected by a significantly lower somatosensory alpha event-related desynchronization (ERD) in TVF than in TF and no significant difference in visual alpha ERD between TVF and VF. In PFPC task, there was no significant difference in somatosensory alpha ERD between TF and TVF, while a significantly lower visual alpha ERD was found in TVF than in VF, indicating that TF was essential in situations related to proprioceptive position perception. Tactile-visual integration was found when TF and VF were congruently implemented, showing an obvious activation over the premotor cortex in the three tasks. Behavioral and psychophysical results were consistent with EEG evaluations.Significance. Our findings could provide neural evidence for multi-sensory integration and functional roles of tactile and VF in a practical setting of prosthesis control, shedding a multi-dimensional insight into the functional mechanisms of sensory feedback.

Wrist speed feedback improves elbow compensation and reaching accuracy for myoelectric transradial prosthesis users in hybrid virtual reaching task

BACKGROUND

Myoelectric prostheses are a popular choice for restoring motor capability following the loss of a limb, but they do not provide direct feedback to the user about the movements of the device-in other words, kinesthesia. The outcomes of studies providing artificial sensory feedback are often influenced by the availability of incidental feedback. When subjects are blindfolded and disconnected from the prosthesis, artificial sensory feedback consistently improves control; however, when subjects wear a prosthesis and can see the task, benefits often deteriorate or become inconsistent. We theorize that providing artificial sensory feedback about prosthesis speed, which cannot be precisely estimated via vision, will improve the learning and control of a myoelectric prosthesis.

METHODS

In this study, we test a joint-speed feedback system with six transradial amputee subjects to evaluate how it affects myoelectric control and adaptation behavior during a virtual reaching task.

RESULTS

Our results showed that joint-speed feedback lowered reaching errors and compensatory movements during steady-state reaches. However, the same feedback provided no improvement when control was perturbed.

CONCLUSIONS

These outcomes suggest that the benefit of joint speed feedback may be dependent on the complexity of the myoelectric control and the context of the task.

Haptic shared control improves neural efficiency during myoelectric prosthesis use

Clinical myoelectric prostheses lack the sensory feedback and sufficient dexterity required to complete activities of daily living efficiently and accurately. Providing haptic feedback of relevant environmental cues to the user or imbuing the prosthesis with autonomous control authority have been separately shown to improve prosthesis utility. Few studies, however, have investigated the effect of combining these two approaches in a shared control paradigm, and none have evaluated such an approach from the perspective of neural efficiency (the relationship between task performance and mental effort measured directly from the brain). In this work, we analyzed the neural efficiency of 30 non-amputee participants in a grasp-and-lift task of a brittle object. Here, a myoelectric prosthesis featuring vibrotactile feedback of grip force and autonomous control of grasping was compared with a standard myoelectric prosthesis with and without vibrotactile feedback. As a measure of mental effort, we captured the prefrontal cortex activity changes using functional near infrared spectroscopy during the experiment. It was expected that the prosthesis with haptic shared control would improve both task performance and mental effort compared to the standard prosthesis. Results showed that only the haptic shared control system enabled users to achieve high neural efficiency, and that vibrotactile feedback was important for grasping with the appropriate grip force. These results indicate that the haptic shared control system synergistically combines the benefits of haptic feedback and autonomous controllers, and is well-poised to inform such hybrid advancements in myoelectric prosthesis technology.

EMG feedback outperforms force feedback in the presence of prosthesis control disturbance

Closing the prosthesis control loop by providing artificial somatosensory feedback can improve utility and user experience. Additionally, closed-loop control should be more robust with respect to disturbance, but this might depend on the type of feedback provided. Thus, the present study investigates and compares the performance of EMG and force feedback in the presence of control disturbances. Twenty able-bodied subjects and one transradial amputee performed delicate and power grasps with a prosthesis in a functional task, while the control signal gain was temporarily increased (high-gain disturbance) or decreased (low-gain disturbance) without their knowledge. Three outcome measures were considered: the percentage of trials successful in the first attempt (reaction to disturbance), the average number of attempts in trials where the wrong force was initially applied (adaptation to disturbance), and the average completion time of the last attempt in every trial. EMG feedback was shown to offer significantly better performance compared to force feedback during power grasping in terms of reaction to disturbance and completion time. During power grasping with high-gain disturbance, the median first-attempt success rate was significantly higher with EMG feedback (73.3%) compared to that achieved with force feedback (60%). Moreover, the median completion time for power grasps with low-gain disturbance was significantly longer with force feedback than with EMG feedback (3.64 against 2.48 s, an increase of 32%). Contrary to our expectations, there was no significant difference between feedback types with regards to adaptation to disturbances and the two feedback types performed similarly in delicate grasps. The results indicated that EMG feedback displayed better performance than force feedback in the presence of control disturbances, further demonstrating the potential of this approach to provide a reliable prosthesis-user interaction.

The "Federica" Hand

Hand prostheses partially restore hand appearance and functionalities. In particular, 3D printers have provided great opportunities by simplifying the manufacturing process and reducing costs. The "Federica" hand is 3D-printed and equipped with a single servomotor, which synergically actuates its five fingers by inextensible tendons; no springs are used for hand opening. A differential mechanical system simultaneously distributes the motor force on each finger in predefined portions. The proportional control of hand closure/opening is achieved by monitoring muscle contraction by means of a thin force sensor, as an alternative to EMG. The electrical current of the servomotor is monitored to provide sensory feedback of the grip force, through a small vibration motor. A simple Arduino board was adopted as the processing unit. A closed-chain, differential mechanism guarantees efficient transfer of mechanical energy and a secure grasp of any object, regardless of its shape and deformability. The force sensor offers some advantages over the EMG: it does not require any electrical contact or signal processing to monitor muscle contraction intensity. The activation speed (about half a second) is high enough to allow the user to grab objects on the fly. The cost of the device is less then 100 USD. The "Federica" hand has proved to be a lightweight, low-cost and extremely efficient prosthesis. It is now available as an open-source project (CAD files and software can be downloaded from a public repository), thus allowing everyone to use the "Federica" hand and customize or improve it.

Evaluating the Effect of Stimulus Duration on Vibrotactile Cue Localizability With a Tactile Sleeve

Vibrotactile arrays are appealing as wearable haptic devices, since designers can vary parameters including cue location and duration to create distinct haptic icons to represent a wide range of information. Vibrotactile sleeves have typically used cues that vary in duration from 100 to 400 ms, but it is not well understood how cue duration might affect localizability of stimuli. Using an experimental protocol typically employed to understand how our visual system can localize stimuli, we examined localization of tactile cues for tactors spaced at fixed locations along the forearm while we varied cue duration between 100 and 400 ms. To validate our experimental methods and hardware, we also evaluated visual cue localization performance. Our visual cue localization results were in agreement with prior experiments showing that varying noise in visual cues affects cue localization. More importantly, this experimental paradigm allowed us to verify that participants could successfully localize tactile cues regardless of duration. Response variance in tactile localizability was much greater than the visual case. There was also an effect of stimulus location on tactile localization performance. Our findings support the variation of tactile cue duration in the 100 to 400 ms range for tactile arrays positioned on the forearm.

Joint speed feedback improves myoelectric prosthesis adaptation after perturbed reaches in non amputees

Accurate control of human limbs involves both feedforward and feedback signals. For prosthetic arms, feedforward control is commonly accomplished by recording myoelectric signals from the residual limb to predict the user's intent, but augmented feedback signals are not explicitly provided in commercial devices. Previous studies have demonstrated inconsistent results when artificial feedback was provided in the presence of vision; some studies showed benefits, while others did not. We hypothesized that negligible benefits in past studies may have been due to artificial feedback with low precision compared to vision, which results in heavy reliance on vision during reaching tasks. Furthermore, we anticipated more reliable benefits from artificial feedback when providing information that vision estimates with high uncertainty (e.g. joint speed). In this study, we test an artificial sensory feedback system providing joint speed information and how it impacts performance and adaptation during a hybrid positional-and-myoelectric ballistic reaching task. We found that overall reaching errors were reduced after perturbed control, but did not significantly improve steady-state reaches. Furthermore, we found that feedback about the joint speed of the myoelectric prosthesis control improved the adaptation rate of biological limb movements, which may have resulted from high prosthesis control noise and strategic overreaching with the positional control and underreaching with the myoelectric control. These results provide insights into the relevant factors influencing the improvements conferred by artificial sensory feedback.

The Interaction Between Feedback Type and Learning in Routine Grasping With Myoelectric Prostheses

While prosthetic fitting after upper-limb loss allows for restoration of motor functions, it deprives the amputee of tactile sensations that are essential for grasp control in able-bodied subjects. Therefore, it is commonly assumed that restoring the force feedback would improve the control of prosthesis grasping force. However, the literature regarding the benefit of feedback is controversial. Here, we investigated how the type of feedback affects learning and steady-state performance of routine grasping with a prosthesis. The experimental task was to grasp an object using a prosthesis and generate a low or high target-force range (TFR), both initially unknown, in three feedback conditions: basic auditory feedback on task outcome, and additional visual or vibratory feedback on the force magnitude. The results demonstrated that the performance was rather good and stable for the low TFR, whereas it was substantially worse for the high TFR with a pronounced training effect. Surprisingly, learning curve and steady-state performance did not depend on the feedback condition. Hence, in the specific context of routing grasping with a prosthesis controlled via surface EMG, the basic feedback on task outcome was not outperformed by force-related end-of-trial feedback and hence seemed to be sufficient for accomplishing the task.This conclusion applies to the context of routine grasping using a myoelectric prosthesis with surface EMG electrodes, which means that the control signals are variable and the feedback is perceived and processed at the end of the trial (motor adaption).

A Review of Sensory Feedback in Upper-Limb Prostheses From the Perspective of Human Motor Control

This manuscript reviews historical and recent studies that focus on supplementary sensory feedback for use in upper limb prostheses. It shows that the inability of many studies to speak to the issue of meaningful performance improvements in real-life scenarios is caused by the complexity of the interactions of supplementary sensory feedback with other types of feedback along with other portions of the motor control process. To do this, the present manuscript frames the question of supplementary feedback from the perspective of computational motor control, providing a brief review of the main advances in that field over the last 20 years. It then separates the studies on the closed-loop prosthesis control into distinct categories, which are defined by relating the impact of feedback to the relevant components of the motor control framework, and reviews the work that has been done over the last 50+ years in each of those categories. It ends with a discussion of the studies, along with suggestions for experimental construction and connections with other areas of research, such as machine learning.

Psychometric characterization of incidental feedback sources during grasping with a hand prosthesis

Background

A prosthetic system should ideally reinstate the bidirectional communication between the user’s brain and its end effector by restoring both motor and sensory functions lost after an amputation. However, current commercial prostheses generally do not incorporate somatosensory feedback. Even without explicit feedback, grasping using a prosthesis partly relies on sensory information. Indeed, the prosthesis operation is characterized by visual and sound cues that could be exploited by the user to estimate the prosthesis state. However, the quality of this incidental feedback has not been objectively evaluated.

Methods

In this study, the psychometric properties of the auditory and visual feedback of prosthesis motion were assessed and compared to that of a vibro-tactile interface. Twelve able-bodied subjects passively observed prosthesis closing and grasping an object, and they were asked to discriminate (experiment I) or estimate (experiment II) the closing velocity of the prosthesis using visual (VIS), acoustic (SND), or combined (VIS + SND) feedback. In experiment II, the subjects performed the task also with a vibrotactile stimulus (VIB) delivered using a single tactor. The outcome measures for the discrimination and estimation experiments were just noticeable difference (JND) and median absolute estimation error (MAE), respectively.

Results

The results demonstrated that the incidental sources provided a remarkably good discrimination and estimation of the closing velocity, significantly outperforming the vibrotactile feedback. Using incidental sources, the subjects could discriminate almost the minimum possible increment/decrement in velocity that could be commanded to the prosthesis (median JND < 2% for SND and VIS + SND). Similarly, the median MAE in estimating the prosthesis velocity randomly commanded from the full working range was also low, i.e., approximately 5% in SND and VIS + SND.

Conclusions

Since the closing velocity is proportional to grasping force in state-of-the-art myoelectric prostheses, the results of the present study imply that the incidental feedback, when available, could be usefully exploited for grasping force control. Therefore, the impact of incidental feedback needs to be considered when designing a feedback interface in prosthetics, especially since the quality of estimation using supplemental sources (e.g., vibration) can be worse compared to that of the intrinsic cues.

Comparison of vibrotactile and joint-torque feedback in a myoelectric upper-limb prosthesis

BACKGROUND

Despite the technological advancements in myoelectric prostheses, body-powered prostheses remain a popular choice for amputees, in part due to the natural sensory advantage they provide. Research on haptic feedback in myoelectric prostheses has delivered mixed results. Furthermore, there is limited research comparing various haptic feedback modalities in myoelectric prostheses. In this paper, we present a comparison of the feedback intrinsically present in body-powered prostheses (joint-torque feedback) to a commonly proposed feedback modality for myoelectric prostheses (vibrotactile feedback). In so doing, we seek to understand whether the advantages of kinesthetic feedback present in body-powered prostheses translate to myoelectric prostheses, and whether there are differences between kinesthetic and cutaneous feedback in prosthetic applications.

METHODS

We developed an experimental testbed that features a cable-driven, voluntary-closing 1-DoF prosthesis, a capstan-driven elbow exoskeleton, and a vibrotactile actuation unit. The system can present grip force to users as either a flexion moment about the elbow or vibration on the wrist. To provide an equal comparison of joint-torque and vibrotactile feedback, a stimulus intensity matching scheme was utilized. Non-amputee participants (n=12) were asked to discriminate objects of varying stiffness with the prosthesis in three conditions: no haptic feedback, vibrotactile feedback, and joint-torque feedback.

RESULTS

Results indicate that haptic feedback increased discrimination accuracy over no haptic feedback, but the difference between joint-torque feedback and vibrotactile feedback was not significant. In addition, our results highlight nuanced differences in performance depending on the objects' stiffness, and suggest that participants likely pay less attention to incidental cues with the addition of haptic feedback.

CONCLUSION

Even when haptic feedback is not modality matched to the task, such as in the case of vibrotactile feedback, performance with a myoelectric prosthesis can improve significantly. This implies it is possible to achieve the same benefits with vibrotactile feedback, which is cheaper and easier to implement than other forms of feedback.

Effects of vibrotactile feedback and grasp interface compliance on perception and control of a sensorized myoelectric hand

Current myoelectric prosthetic limbs are limited in their ability to provide direct sensory feedback to users, which increases attentional demands and reliance on visual cues. Vibrotactile sensory substitution (VSS), which can be used to provide sensory feedback in a non-invasive manner has demonstrated some improvement in myoelectric hand control. In this work, we developed and tested two VSS configurations: one with a single burst-rate modulated actuator and another with a spatially distributed array of five coin tactors. We performed a direct comparative assessment of these two VSS configurations with able-bodied subjects to investigate sensory perception, myoelectric control of grasp force and hand aperture with a prosthesis, and the effects of interface compliance. Six subjects completed a sensory perception experiment under a stimulation only paradigm; sixteen subjects completed experiments to compare VSS performance on perception and graded myoelectric control during grasp force and hand aperture tasks; and ten subjects completed experiments to investigate the effect of mechanical compliance of the myoelectric hand on the ability to control grasp force. Results indicated that sensory perception of vibrotactile feedback was not different for the two VSS configurations in the absence of active myoelectric control, but it was better with feedback from the coin tactor array than with the single actuator during myoelectric control of grasp force. Graded myoelectric control of grasp force and hand aperture was better with feedback from the coin tactor array than with the single actuator, and myoelectric control of grasp force was improved with a compliant grasp interface. Further investigations with VSS should focus on the use of coin tactor arrays by subjects with amputation in real-world settings and on improving control of grasp force by increasing the mechanical compliance of the hand.

Myocontrol is closed-loop control: incidental feedback is sufficient for scaling the prosthesis force in routine grasping

BACKGROUND

Sensory feedback is critical for grasping in able-bodied subjects. Consequently, closing the loop in upper-limb prosthetics by providing artificial sensory feedback to the amputee is expected to improve the prosthesis utility. Nevertheless, even though amputees rate the prospect of sensory feedback high, its benefits in daily life are still very much debated. We argue that in order to measure the potential functional benefit of artificial sensory feedback, the baseline open-loop performance needs to be established.

METHODS

The myoelectric control of naïve able-bodied subjects was evaluated during modulation of electromyographic signals (EMG task), and grasping with a prosthesis (Prosthesis task). The subjects needed to activate the wrist flexor muscles and close the prosthesis to reach a randomly selected target level (routine grasping). To assess the baseline performance, the tasks were performed with a different extent of implicit feedback (proprioception, prosthesis motion and sound). Finally, the prosthesis task was repeated with explicit visual force feedback. The subjects' ability to scale the prosthesis command/force was assessed by testing for a statistically significant increase in the median of the generated commands/forces between neighboring levels. The quality of control was evaluated by computing the median absolute error (MAE) with respect to the target.

RESULTS

The subjects could successfully scale their motor commands and generated prosthesis forces across target levels in all tasks, even with the least amount of implicit feedback (only muscle proprioception, EMG task). In addition, the deviation of the generated commands/forces from the target levels decreased with additional feedback. However, the increase in implicit feedback, from proprioception to prosthesis motion and sound, seemed to have a more substantial effect than the final introduction of explicit feedback. Explicit feedback improved the performance mainly at the higher target-force levels.

CONCLUSIONS

The study establishes the baseline performance of myoelectric control and prosthesis grasping force. The results demonstrate that even without additional feedback, naïve subjects can effectively modulate force with good accuracy with respect to that achieved when increasing the amount of feedback information.

Design and Integration of an Inexpensive Wearable Mechanotactile Feedback System for Myoelectric Prostheses

The aim of this paper was to demonstrate the functionality of an inexpensive mechanotactile sensory feedback system for transhumeral myoelectric prostheses. We summarize the development of a tactile-integrated prosthesis, including 1) evaluation of sensors that were retrofit onto existing commercial terminal devices; 2) design of two custom mechanotactile tactors that were integrated into a socket without compromising suction suspension; 3) design of a modular controller which translated sensor input to tactor output, was wirelessly adjusted, and fit within a prosthetic forearm; and 4) evaluation of the system with a single transhumeral participant. Prosthesis functionality was demonstrated over three test sessions; the participant was able to identify tactor stimulation location and demonstrated a reduction in grasp force with the mechanotactile stimulation. This system offers an inexpensive and modular solution for integration of a mechanotactile sensory feedback system into a prosthetic socket without compromising the suction seal. These principles can be applied in future studies to investigate the direct impact of sensory feedback on tangible outcomes for prosthetic users, thereby reducing barriers to clinical translation.

Analysis of Al2O3-parylene C bilayer coatings and impact of microelectrode topography on long term stability of implantable neural arrays

OBJECTIVE

Performance of many dielectric coatings for neural electrodes degrades over time, contributing to loss of neural signals and evoked percepts. Studies using planar test substrates have found that a novel bilayer coating of atomic-layer deposited (ALD) Al₂O₃ and parylene C is a promising candidate for neural electrode applications, exhibiting superior stability to parylene C alone. However, initial results from bilayer encapsulation testing on non-planar devices have been less positive. Our aim was to evaluate ALD Al₂O₃-parylene C coatings using novel test paradigms, to rigorously evaluate dielectric coatings for neural electrode applications by incorporating neural electrode topography into test structure design.

APPROACH

Five test devices incorporated three distinct topographical features common to neural electrodes, derived from the utah electrode array (UEA). Devices with bilayer (52 nm Al₂O₃  +  6 µm parylene C) were evaluated against parylene C controls (N  ⩾  6 per device type). Devices were aged in phosphate buffered saline at 67 °C for up to 311 d, and monitored through: (1) leakage current to evaluate encapsulation lifetimes (>1 nA during 5VDC bias indicated failure), and (2) wideband (1-10⁵ Hz) impedance.

MAIN RESULTS

Mean-times-to-failure (MTTFs) ranged from 12 to 506 d for bilayer-coated devices, versus 10 to  >2310 d for controls. Statistical testing (log-rank test, α  =  0.05) of failure rates gave mixed results but favored the control condition. After failure, impedance loss for bilayer devices continued for months and manifested across the entire spectrum, whereas the effect was self-limiting after several days, and restricted to frequencies  <100 Hz for controls. These results correlated well with observations of UEAs encapsulated with bilayer and control films.

SIGNIFICANCE

We observed encapsulation failure modes and behaviors comparable to neural electrode performance which were undetected in studies with planar test devices. We found the impact of parylene C defects to be exacerbated by ALD Al₂O₃, and conclude that inferior bilayer performance arises from degradation of ALD Al₂O₃ when directly exposed to saline. This is an important consideration, given that neural electrodes with bilayer coatings are expected to have ALD Al₂O₃ exposed at dielectric boundaries that delineate electrode sites. Process improvements and use of different inorganic coatings to decrease dissolution in physiological fluids may improve performance. Testing frameworks which take neural electrode complexities into account will be well suited to reliably evaluate such encapsulation schemes.

The clinical relevance of advanced artificial feedback in the control of a multi-functional myoelectric prosthesis

Background

To effectively replace the human hand, a prosthesis should seamlessly respond to user intentions but also convey sensory information back to the user. Restoration of sensory feedback is rated highly by the prosthesis users, and feedback is critical for grasping in able-bodied subjects. Nonetheless, the benefits of feedback in prosthetics are still debated. The lack of consensus is likely due to the complex nature of sensory feedback during prosthesis control, so that its effectiveness depends on multiple factors (e.g., task complexity, user learning).

Methods

We evaluated the impact of these factors with a longitudinal assessment in six amputee subjects, using a clinical setup (socket, embedded control) and a range of tasks (box and blocks, block turn, clothespin and cups relocation). To provide feedback, we have proposed a novel vibrotactile stimulation scheme capable of transmitting multiple variables from a multifunction prosthesis. The subjects wore a bracelet with four by two uniformly placed vibro-tactors providing information on contact, prosthesis state (active function), and grasping force. The subjects also completed a questionnaire for the subjective evaluation of the feedback.

Results

The tests demonstrated that feedback was beneficial only in the complex tasks (block turn, clothespin and cups relocation), and that the training had an important, task-dependent impact. In the clothespin relocation and block turn tasks, training allowed the subjects to establish successful feedforward control, and therefore, the feedback became redundant. In the cups relocation task, however, the subjects needed some training to learn how to properly exploit the feedback. The subjective evaluation of the feedback was consistently positive, regardless of the objective benefits. These results underline the multifaceted nature of closed-loop prosthesis control as, depending on the context, the same feedback interface can have different impact on performance. Finally, even if the closed-loop control does not improve the performance, it could be beneficial as it seems to improve the subjective experience.

Conclusions

Therefore, in this study we demonstrate, for the first time, the relevance of an advanced, multi-variable feedback interface for dexterous, multi-functional prosthesis control in a clinically relevant setting.

Electronic supplementary material

The online version of this article (10.1186/s12984-018-0371-1) contains supplementary material, which is available to authorized users.

Short- and Long-Term Learning of Feedforward Control of a Myoelectric Prosthesis with Sensory Feedback by Amputees

Human motor control relies on a combination of feedback and feedforward strategies. The aim of this study was to longitudinally investigate artificial somatosensory feedback and feedforward control in the context of grasping with myoelectric prosthesis. Nine amputee subjects performed routine grasping trials, with the aim to produce four levels of force during four blocks of 60 trials across five days. The electrotactile force feedback was provided in the second and third block using multipad electrode and spatial coding. The first baseline and last validation block (open-loop control) evaluated the effects of long- (across sessions) and short-term (within session) learning, respectively. The outcome measures were the absolute error between the generated and target force, and the number of force saturations. The results demonstrated that the electrotactile feedback improved the performance both within and across sessions. In the validation block, the performance did not significantly decrease and the quality of open-loop control (baseline) improved across days, converging to the performance characterizing closed-loop control. This paper provides important insights into the feedback and feedforward processes in prosthesis control, contributing to the better understanding of the role and design of feedback in prosthetic systems.

Neurorehabilitation in upper limb amputation: understanding how neurophysiological changes can affect functional rehabilitation

Background

Significant advances have been made in developing new prosthetic technologies with the goal of restoring function to persons that suffer partial or complete loss of the upper limb. Despite these technological advances, many challenges remain in understanding barriers in patient adoption of technology, and what critical factors should be of focus in prosthetics development from a motor control perspective. This points to a potential opportunity to improve our understanding of amputation using neurophysiology and plasticity, and integrate this knowledge into the development of prosthetics technology in novel ways. Here, argument will be made to include a stronger focus on the neural and behavioral changes that result from amputation, and a better appreciation of the time-scale of changes which may significantly affect device adaptation, functional device utility, and motor learning implemented in rehabilitation environments.

Conclusion

By strengthening our understanding of the neuroscience of amputation, we may improve the ability to couple neurorehabilitation with neuroengineering to support clinician needs in yielding improved outcomes in patients.

GLIMPSE: Google Glass interface for sensory feedback in myoelectric hand prostheses

OBJECTIVE

Providing sensory feedback to the user of the prosthesis is an important challenge. The common approach is to use tactile stimulation, which is easy to implement but requires training and has limited information bandwidth. In this study, we propose an alternative approach based on augmented reality.

APPROACH

We have developed the GLIMPSE, a Google Glass application which connects to the prosthesis via a Bluetooth interface and renders the prosthesis states (EMG signals, aperture, force and contact) using augmented reality (see-through display) and sound (bone conduction transducer). The interface was tested in healthy subjects that used the prosthesis with (FB group) and without (NFB group) feedback during a modified clothespins test that allowed us to vary the difficulty of the task. The outcome measures were the number of unsuccessful trials, the time to accomplish the task, and the subjective ratings of the relevance of the feedback.

MAIN RESULTS

There was no difference in performance between FB and NFB groups in the case of a simple task (basic, same-color clothespins test), but the feedback significantly improved the performance in a more complex task (pins of different resistances). Importantly, the GLIMPSE feedback did not increase the time to accomplish the task. Therefore, the supplemental feedback might be useful in the tasks which are more demanding, and thereby less likely to benefit from learning and feedforward control. The subjects integrated the supplemental feedback with the intrinsic sources (vision and muscle proprioception), developing their own idiosyncratic strategies to accomplish the task.

SIGNIFICANCE

The present study demonstrates a novel self-contained, ready-to-deploy, wearable feedback interface. The interface was successfully tested and was proven to be feasible and functionally beneficial. The GLIMPSE can be used as a practical solution but also as a general and flexible instrument to investigate closed-loop prosthesis control.

Multichannel Electrotactile Feedback With Spatial and Mixed Coding for Closed-Loop Control of Grasping Force in Hand Prostheses

Providing somatosensory feedback to the user of a myoelectric prosthesis is an important goal since it can improve the utility as well as facilitate the embodiment of the assistive system. Most often, the grasping force was selected as the feedback variable and communicated through one or more individual single channel stimulation units (e.g., electrodes, vibration motors). In the present study, an integrated, compact, multichannel solution comprising an array electrode and a programmable stimulator was presented. Two coding schemes (15 levels), spatial and mixed (spatial and frequency) modulation, were tested in able-bodied subjects, psychometrically and in force control with routine grasping and force tracking using real and simulated prosthesis. The results demonstrated that mixed and spatial coding, although substantially different in psychometric tests, resulted in a similar performance during both force control tasks. Furthermore, the ideal, visual feedback was not better than the tactile feedback in routine grasping. To explain the observed results, a conceptual model was proposed emphasizing that the performance depends on multiple factors, including feedback uncertainty, nature of the task and the reliability of the feedforward control. The study outcomes, specific conclusions and the general model, are relevant for the design of closed-loop myoelectric prostheses utilizing tactile feedback.