Simultaneous and proportional force estimation in multiple degrees of freedom from intramuscular EMG

FFT Analysis and Motion Classification of EMG Signals

Bu çalışmada EMG sinyallerinin frekans analizi yapılarak elde edilen veriler ile hareket sınıflandırması yapmak amaçlanmıştır. Üç kanaldan toplanan EMG sinyalleri uygun pencerelere ayrılarak her bir pencereye” hilbert “ zarflama yöntemi uygulanmış ve FFT katsayıları hesaplanmıştır. Kaydedilen EMG sinyallerinin frekans spektrumları incelenmiştir. Bu katsayıları ile bir sınıflandırma algoritmasında kullanmak amacıyla her bir pencerenin ağırlıklı frekans bileşeni hesaplanmıştır. Elde edilen veriler YSA (Yapay sinir Ağları) algoritmasının eğitilmesi amacıyla kullanılmış ve bu işlem EMG sinyallerinin sınıflandırılması amacıyla kullanılmıştır. Sınıflandırma işlemi sonucunda özellikle aynı kas gruplarındaki kasılma kuvvetleri ile birbirinden ayırt edilebilen hareketlerin yalnızca frekans domeninde değil zaman domeninde de incelenmesi gerektiği sonucuna varılmıştır.

Hammerstein-Wiener Multimodel Approach for Fast and Efficient Muscle Force Estimation from EMG Signals

This paper develops a novel approach to characterise muscle force from electromyography (EMG) signals, which are the electric activities generated by muscles. Based on the nonlinear Hammerstein-Wiener model, the first part of this study outlines the estimation of different sub-models to mimic diverse force profiles. The second part fixes the appropriate sub-models of a multimodel library and computes the contribution of sub-models to estimate the desired force. Based on a pre-existing dataset, the obtained results show the effectiveness of the proposed approach to estimate muscle force from EMG signals with reasonable accuracy. The coefficient of determination ranges from 0.6568 to 0.9754 using the proposed method compared with a range of 0.5060 to 0.9329 using an artificial neural network (ANN), generating significantly different accuracy (p < 0.03). Results imply that the use of multimodel approach can improve the accuracy in proportional control of prostheses.

Optimal strategy of sEMG feature and measurement position for grasp force estimation

Grasp force estimation based on surface electromyography (sEMG) is essential for the dexterous control of a prosthetic hand. Nowadays, although increasing the number of sEMG measurement positions and extracting more features are common methods to increase the accuracy of grasp force estimation, it will increase the computational burden. In this paper, an approach based on analysis of variance (ANOVA) and generalized regression neural network (GRNN) for optimal measurement positions and features is proposed, with the purpose of using fewer measurement positions or features to achieve higher estimation accuracy. Firstly, we captured six channels of sEMG from subjects’ forearm and grasp force synchronously. Then, four kinds of features in time domain are extracted from each channel of sEMG. By combining different measurement position sets (MPSs) and feature set (FSs), we construct 945 data sets. These data sets are fed to GRNN to realize grasp force estimation. Normalized root mean square error (NRMS), normalized mean of absolute error (NMAE), and correlation coefficient (CC) between estimated grasp force and actual force are introduced to evaluate the performance of grasp force estimation. Finally, ANOVA and Tukey HSD testing are introduced to analyze grasp force estimation results so as to obtain the optimal measurement positions and features. We obtain the optimal MPSs for grasp force estimation when different FSs are employed, and the optimal FSs when different MPSs are utilized.

Activities of daily living with bionic arm improved by combination training and latching filter in prosthesis control comparison

BACKGROUND

Advanced prostheses can restore function and improve quality of life for individuals with amputations. Unfortunately, most commercial control strategies do not fully utilize the rich control information from residual nerves and musculature. Continuous decoders can provide more intuitive prosthesis control using multi-channel neural or electromyographic recordings. Three components influence continuous decoder performance: the data used to train the algorithm, the algorithm, and smoothing filters on the algorithm's output. Individual groups often focus on a single decoder, so very few studies compare different decoders using otherwise similar experimental conditions.

METHODS

We completed a two-phase, head-to-head comparison of 12 continuous decoders using activities of daily living. In phase one, we compared two training types and a smoothing filter with three algorithms (modified Kalman filter, multi-layer perceptron, and convolutional neural network) in a clothespin relocation task. We compared training types that included only individual digit and wrist movements vs. combination movements (e.g., simultaneous grasp and wrist flexion). We also compared raw vs. nonlinearly smoothed algorithm outputs. In phase two, we compared the three algorithms in fragile egg, zipping, pouring, and folding tasks using the combination training and smoothing found beneficial in phase one. In both phases, we collected objective, performance-based (e.g., success rate), and subjective, user-focused (e.g., preference) measures.

RESULTS

Phase one showed that combination training improved prosthesis control accuracy and speed, and that the nonlinear smoothing improved accuracy but generally reduced speed. Phase one importantly showed simultaneous movements were used in the task, and that the modified Kalman filter and multi-layer perceptron predicted more simultaneous movements than the convolutional neural network. In phase two, user-focused metrics favored the convolutional neural network and modified Kalman filter, whereas performance-based metrics were generally similar among all algorithms.

CONCLUSIONS

These results confirm that state-of-the-art algorithms, whether linear or nonlinear in nature, functionally benefit from training on more complex data and from output smoothing. These studies will be used to select a decoder for a long-term take-home trial with implanted neuromyoelectric devices. Overall, clinical considerations may favor the mKF as it is similar in performance, faster to train, and computationally less expensive than neural networks.

A novel energy-motion model for continuous sEMG decoding: from muscle energy to motor pattern

At present, sEMG-based gesture recognition requires vast amounts of training data; otherwise it is limited to a few gestures. Objective. This paper presents a novel dynamic energy model that decodes continuous hand actions by training small amounts of sEMG data. Approach. The activation of forearm muscles can set the corresponding fingers in motion or state with movement trends. The moving fingers store kinetic energy, and the fingers with movement trends store potential energy. The kinetic energy and potential energy in each finger are dynamically allocated due to the adaptive-coupling mechanism of five-fingers in actual motion. Meanwhile, the sum of the two energies remains constant at a certain muscle activation. We regarded hand movements with the same direction of acceleration for five-finger as the same in energy mode and divided hand movements into ten energy modes. Independent component analysis and machine learning methods were used to model associations between sEMG signals and energy modes and expressed gestures by energy form adaptively. This theory imitates the self-adapting mechanism in actual tasks. Thus, ten healthy subjects were recruited, and three experiments mimicking activities of daily living were designed to evaluate the interface: (1) the expression of untrained gestures, (2) the decoding of the amount of single-finger energy, and (3) real-time control. Main results. (1) Participants completed the untrained hand movements (100/100, p < 0.0001). (2) The interface performed better than chance in the experiment where participants pricked balloons with a needle tip (779/1000, p < 0.0001). (3) In the experiment where participants punched a hole in the plasticine on the balloon, the success rate was over 95% (97.67 ± 5.04%, p < 0.01). Significance. The model can achieve continuous hand actions with speed or force information by training small amounts of sEMG data, which reduces learning task complexity.

DESIGN AND CHARACTERIZATION OF A MINIATURE THREE-AXIAL MEMS FORCE SENSOR

This paper reports the design, fabrication and calibration results of a miniature cross-shaped three-axial piezoresistive force sensor, which can simultaneously detect three force components in orthogonal directions. MEMS technology was used to fabricate the sensor structure and deposit a phosphosilicate layer on the silicon wafer to form piezoresistive resistors. Using the finite element simulation, the developed sensor performance characteristics, such as linearity, repeatability, sensitivity, and hysteresis, are analyzed for different arrangements of eight piezoresistors on the silicon beam surface. The sensor performance was experimentally validated by monitoring the voltage variation of Wheatstone bridge when a load-bearing rigid rod was loaded in three different directions by a set of weights. Calibration results exhibited linear output responses with the maximum linearity of 0.98 and small crosstalk below 7%. The MEMS sensor repeatability was tested with a commercial stepper motor by measuring a step function-varying profile force was applied to the sensor. Further optimization of the sensor design for sensing six degrees of freedom movement is envisaged with its sensitivity enhancement by the silicon substrate reduction.

Multi-Segmentation Parallel CNN Model for Estimating Assembly Torque Using Surface Electromyography Signals

The precise application of tightening torque is one of the important measures to ensure accurate bolt connection and improvement in product assembly quality. Currently, due to the limited assembly space and efficiency, a wrench without the function of torque measurement is still an extensively used assembly tool. Therefore, wrench torque monitoring is one of the urgent problems that needs to be solved. This study proposes a multi-segmentation parallel convolution neural network (MSP-CNN) model for estimating assembly torque using surface electromyography (sEMG) signals, which is a method of torque monitoring through classification methods. The MSP-CNN model contains two independent CNN models with different or offset torque granularities, and their outputs are fused to obtain a finer classification granularity, thus improving the accuracy of torque estimation. First, a bolt tightening test bench is established to collect sEMG signals and tightening torque signals generated when the operator tightens various bolts using a wrench. Second, the sEMG and torque signals are preprocessed to generate the sEMG signal graphs. The range of the torque transducer is divided into several equal subdivision ranges according to different or offset granularities, and each subdivision range is used as a torque label for each torque signal. Then, the training set, verification set, and test set are established for torque monitoring to train the MSP-CNN model. The effects of different signal preprocessing methods, torque subdivision granularities, and pooling methods on the recognition accuracy and torque monitoring accuracy of a single CNN network are compared experimentally. The results show that compared to maximum pooling, average pooling can improve the accuracy of CNN torque classification and recognition. Moreover, the MSP-CNN model can improve the accuracy of torque monitoring as well as solve the problems of non-convergence and slow convergence of independent CNN network models.

A Finger Grip Force Sensor with an Open-Pad Structure for Glove-Type Assistive Devices

This paper presents a fingertip grip force sensor based on custom capacitive sensors for glove-type assistive devices with an open-pad structure. The design of the sensor allows using human tactile sensations during grasping and manipulating an object. The proposed sensor can be attached on both sides of the fingertip and measure the force caused by the expansion of the fingertip tissue when a grasping force is applied to the fingertip. The number of measurable degrees of freedom (DoFs) are the two DoFs (flexion and adduction) for the thumb and one DoF (flexion) for the index and middle fingers. The proposed sensor allows the combination with a glove-type assistive device to measure the fingertip force. Calibration was performed for each finger joint angle because the variations in the expansion of the fingertip tissue depend on the joint angles. The root mean square error (RMSE) for fingertip force estimation ranged from 3.75% to 9.71% after calibration, regardless of the finger joint angles or finger posture.

Ankle Dorsiflexion Strength Monitoring by Combining Sonomyography and Electromyography

Ankle dorsiflexion produced by Tibialis Anterior (TA) muscle contraction plays a significant role during human walking and standing balance. The weakened function or dysfunction of the TA muscle often impedes activities of daily living (ADL). Powered ankle exoskeleton is a prevalent technique to treat this pathology, and its intelligent and effective behaviors depend on human intention detection. A TA muscle contraction strength monitor is proposed to evaluate the weakness of the ankle dorsiflexion. The new method combines surface electromyography (sEMG) signals and sonomyography signals to estimate ankle torque during a voluntary isometric ankle dorsiflexion. Changes in the pennation angle (PA) are derived from the sonomyography signals. The results demonstrate strong correlations among the sonomyography-derived PA, the sEMG signal, and the measured TA muscle contraction force. Especially, the TA muscle strength monitor approximates the TA muscle strength measurement via a weighted summation of the sEMG signal and the PA signal. The new method shows an improved linear correlation with the muscle strength, compared to the correlations between the muscle strength and sole sEMG signal or sole PA signal, where the R-squared values are improved by 4.21 % and 1.99 %, respectively.

Closed-Loop Continuous Hand Control via Chronic Recording of Regenerative Peripheral Nerve Interfaces

Loss of the upper limb imposes a devastating interruption to everyday life. Full restoration of natural arm control requires the ability to simultaneously control multiple degrees of freedom of the prosthetic arm and maintain that control over an extended period of time. Current clinically available myoelectric prostheses do not provide simultaneous control or consistency for transradial amputees. To address this issue, we have implemented a standard Kalman filter for continuous hand control using intramuscular electromyography (EMG) from both regenerative peripheral nerve interfaces (RPNI) and an intact muscle within non-human primates. Seven RPNIs and one intact muscle were implanted with indwelling bipolar intramuscular electrodes in two rhesus macaques. Following recuperations, function-specific EMG signals were recorded and then fed through the Kalman filter during a hand-movement behavioral task to continuously predict the monkey's finger position. We were able to reconstruct continuous finger movement offline with an average correlation of and a root mean squared error (RMSE) of 0.12 between actual and predicted position from two macaques. This finger movement prediction was also performed in real time to enable closed-loop neural control of a virtual hand. Compared with physical hand control, neural control performance was slightly slower but maintained an average target hit success rate of 96.70%. Recalibration longevity measurements maintained consistent average correlation over time but had a significant change in RMSE ( ). Additionally, extracted single units varied in amplitude by a factor of +18.65% and -25.85% compared with its mean. This is the first demonstration of chronic indwelling electrodes being used for continuous position control via the Kalman filter. Combining these analyses with our novel peripheral nerve interface, we believe that this demonstrates an important step in providing patients with more naturalistic control of their prosthetic limbs.

On the robustness of real-time myoelectric control investigations: a multiday Fitts' law approach

OBJECTIVE

Real-time myoelectric experimental protocol is considered as a means to quantify usability of myoelectric control schemes. While usability should be considered over time to assure clinical robustness, all real-time studies reported thus far are limited to a single session or day and thus the influence of time on real-time performance is still unexplored. In this study, the aim was to develop a novel experimental protocol to quantify the effect of time on real-time performance measures over multiple days using a Fitts' law approach.

APPROACH

Four metrics: throughput, completion rate, path efficiency and overshoot, were assessed using three train-test strategies: (i) an artificial neural network (ANN) classifier was trained on data collected from the previous day and tested on present day (BDT) (ii) trained and tested on the same day (WDT) and (iii) trained on all previous days including present day and tested on present day (CDT) in a week-long experimental protocol.

MAIN RESULTS

It was found that on average, the completion rate (98.37%  ±  1.47%) of CDT was significantly better (P  <  0.01) than that of BDT (86.25%  ±  3.46%) and WDT (94.22%  ±  2.74%). The throughput (0.40  ±  0.03 bits s^-1) of CDT was significantly better (P  =  0.001) than that of BDT (0.38  ±  0.03 bits s^-1). Offline analysis showed a different trend due to the difference in the training strategies.

SIGNIFICANCE

Results suggest that increasing the size of the training set over time can be beneficial to assure robust performance of the system over time.

Online mapping of EMG signals into kinematics by autoencoding

Background

In this paper, we propose a nonlinear minimally supervised method based on autoencoding (AEN) of EMG for myocontrol. The proposed method was tested against the state-of-the-art (SOA) control scheme using a Fitts’ law approach.

Methods

Seven able-bodied subjects performed a series of target acquisition myoelectric control tasks using the AEN and SOA algorithms for controlling two degrees-of-freedom (radial/ulnar deviation and flexion/extension of the wrist), and their online performance was characterized by six metrics.

Results

Both methods allowed a completion rate close to 100%, however AEN outperformed SOA for all other performance metrics, e.g. it allowed to perform the tasks on average in half the time with respect to SOA. Moreover, the amount of information transferred by the proposed method in bit/s was nearly twice the throughput of SOA.

Conclusions

These results show that autoencoders can map EMG signals into kinematics with the potential of providing intuitive and dexterous control of artificial limbs for amputees.

Real-Time In Vivo Intraocular Pressure Monitoring using an Optomechanical Implant and an Artificial Neural Network

Optimized glaucoma therapy requires frequent monitoring and timely lowering of elevated intraocular pressure (IOP). A recently developed microscale IOP-monitoring implant, when illuminated with broadband light, reflects a pressure-dependent optical spectrum that is captured and converted to measure IOP. However, its accuracy is limited by background noise and the difficulty of modeling non-linear shifts of the spectra with respect to pressure changes. Using an end-to-end calibration system to train an artificial neural network (ANN) for signal demodulation we improved the speed and accuracy of pressure measurements obtained with an optically probed IOP-monitoring implant and make it suitable for real-time in vivo IOP monitoring. The ANN converts captured optical spectra into corresponding IOP levels. We achieved an IOP-measurement accuracy of ±0.1 mmHg at a measurement rate of 100 Hz, which represents a ten-fold improvement from previously reported values. This technique allowed real-time tracking of artificially induced sub-1 s transient IOP elevations and minor fluctuations induced by the respiratory motion of the rabbits during in vivo monitoring. All in vivo sensor readings paralleled those obtained concurrently using a commercial tonometer and showed consistency within ±2 mmHg. Real-time processing is highly useful for IOP monitoring in clinical settings and home environments and improves the overall practicality of the optical IOP-monitoring approach.

Two degrees of freedom quasi-static EMG-force at the wrist using a minimum number of electrodes

Surface electromyogram-controlled powered hand/wrist prostheses return partial upper-limb function to limb-absent persons. Typically, one degree of freedom (DoF) is controlled at a time, with mode switching between DoFs. Recent research has explored using large-channel EMG systems to provide simultaneous, independent and proportional (SIP) control of two joints-but such systems are not practical in current commercial prostheses. Thus, we investigated site selection of a minimum number of conventional EMG electrodes in an EMG-force task, targeting four sites for a two DoF controller. In a laboratory experiment with 10 able-bodied subjects and three limb-absent subjects, 16 electrodes were placed about the proximal forearm. Subjects produced 1-DoF and 2-DoF slowly force-varying contractions up to 30% maximum voluntary contraction (MVC). EMG standard deviation was related to forces via regularized regression. Backward stepwise selection was used to retain those progressively fewer electrodes that exhibited minimum error. For 1-DoF models using two retained electrodes (which mimics the current state of the art), subjects had average RMS errors of (depending on the DoF): 7.1-9.5% MVC for able-bodied and 13.7-17.1% MVC for limb-absent subjects. For 2-DoF models, subjects using four electrodes had errors on 1-DoF trials of 6.7-8.5% MVC for able-bodied and 11.9-14.0% MVC for limb-absent; and errors on 2-DoF trials of 9.9-11.2% MVC for able-bodied and 15.8-16.7% MVC for limb-absent subjects. For each model, retaining more electrodes did not statistically improve performance. The able-bodied results suggest that backward selection is a viable method for minimum error selection of as few as four electrode sites for these EMG-force tasks. Performance evaluation in a prosthesis control task is a necessary and logical next step for this site selection method.

Comparison of Constant-Posture Force-Varying EMG-Force Dynamic Models About the Elbow

Numerous techniques have been used to minimize error in relating the surface electromyogram (EMG) to elbow joint torque. We compare the use of three techniques to further reduce error. First, most EMG-torque models only use estimates of EMG standard deviation as inputs. We studied the additional features of average waveform length, slope sign change rate and zero crossing rate. Second, multiple channels of EMG from the biceps, and separately from the triceps, have been combined to produce two low-variance model inputs. We contrasted this channel combination with using each EMG separately. Third, we previously modeled nonlinearity in the EMG-torque relationship via a polynomial. We contrasted our model versus that of the classic exponential power law of Vredenbregt and Rau (1973). Results from 65 subjects performing constant-posture, force-varying contraction gave a "baseline" comparison error (i.e., error with none of the new techniques) of 5.5 ± 2.3% maximum flexion voluntary contraction (%MVC_F). Combining the techniques of multiple features with individual channels reduced error to 4.8 ± 2.2 %MVC_F, while combining individual channels with the power-law model reduced error to 4.7 ± 2.0 %MVC_F. The new techniques further reduced error from that of the baseline by ≈ 15 %.

Use of probabilistic weights to enhance linear regression myoelectric control

OBJECTIVE

Clinically available prostheses for transradial amputees do not allow simultaneous myoelectric control of degrees of freedom (DOFs). Linear regression methods can provide simultaneous myoelectric control, but frequently also result in difficulty with isolating individual DOFs when desired. This study evaluated the potential of using probabilistic estimates of categories of gross prosthesis movement, which are commonly used in classification-based myoelectric control, to enhance linear regression myoelectric control.

APPROACH

Gaussian models were fit to electromyogram (EMG) feature distributions for three movement classes at each DOF (no movement, or movement in either direction) and used to weight the output of linear regression models by the probability that the user intended the movement. Eight able-bodied and two transradial amputee subjects worked in a virtual Fitts' law task to evaluate differences in controllability between linear regression and probability-weighted regression for an intramuscular EMG-based three-DOF wrist and hand system.

MAIN RESULTS

Real-time and offline analyses in able-bodied subjects demonstrated that probability weighting improved performance during single-DOF tasks (p < 0.05) by preventing extraneous movement at additional DOFs. Similar results were seen in experiments with two transradial amputees. Though goodness-of-fit evaluations suggested that the EMG feature distributions showed some deviations from the Gaussian, equal-covariance assumptions used in this experiment, the assumptions were sufficiently met to provide improved performance compared to linear regression control.

SIGNIFICANCE

Use of probability weights can improve the ability to isolate individual during linear regression myoelectric control, while maintaining the ability to simultaneously control multiple DOFs.

Comparison of surface and intramuscular EMG pattern recognition for simultaneous wrist/hand motion classification

The simultaneous control of multiple degrees of freedom (DOFs) is important for the intuitive, life-like control of artificial limbs. The objective of this study was to determine whether the use of intramuscular electromyogram (EMG) improved pattern classification of simultaneous wrist/hand movements compared to surface EMG. Two pattern classification methods were used in this analysis, and were trained to predict 1-DOF and 2-DOF movements involving wrist rotation, wrist flexion/extension, and hand open/close. The classification methods used were (1) a single pattern classifier discriminating between 1-DOF and 2-DOF motion classes, and (2) a parallel set of three classifiers to predict the activity of each of the 3 DOFs. We demonstrate that in this combined wrist/hand classification task, the use of intramuscular EMG significantly decreases classification error compared to surface EMG for the parallel configuration (p<0.01), but not for the single classifier. We also show that the use of intramuscular EMG mitigates the increase in errors produced when the parallel classifier method is trained without 2-DOF motion class data.

Myoelectric Control System and Task-Specific Characteristics Affect Voluntary Use of Simultaneous Control

Clinically available myoelectric control does not enable simultaneous proportional control of prosthetic degrees of freedom. Multiple studies have proposed systems that provide simultaneous control, though few have investigated whether subjects voluntarily use simultaneous control or how they implement it. Additionally, few studies have explicitly evaluated the effect of providing proportional velocity control. The objective of this study was to evaluate factors influencing when and how subjects use simultaneous myoelectric control, including the ability to proportionally control the velocity and the required task precision. Five able-bodied subjects used simultaneous myoelectric control systems with and without proportional velocity control in a virtual Fitts' Law task. Though subjects used simultaneous control to a substantial degree when proportional velocity control was present, they used very little simultaneous control when using constant-velocity control. Furthermore, use of simultaneous control varied significantly with target distance and width, reflecting a strategy of using simultaneous control for gross cursor positioning and sequential control for fine corrective movements. These results provide insight into how users take advantage of simultaneous control and highlight the need for real-time evaluation of simultaneous control algorithms, as the potential benefit of providing simultaneous control may be affected by other characteristics of the myoelectric control system.

Concurrent Adaptation of Human and Machine Improves Simultaneous and Proportional Myoelectric Control

Myoelectric control of a prosthetic hand with more than one degree of freedom (DoF) is challenging, and clinically available techniques require a sequential actuation of the DoFs. Simultaneous and proportional control of multiple DoFs is possible with regression-based approaches allowing for fluent and natural movements. Conventionally, the regressor is calibrated in an open-loop with training based on recorded data and the performance is evaluated subsequently. For individuals with amputation or congenital limb-deficiency who need to (re)learn how to generate suitable muscle contractions, this open-loop process may not be effective. We present a closed-loop real-time learning scheme in which both the user and the machine learn simultaneously to follow a common target. Experiments with ten able-bodied individuals show that this co-adaptive closed-loop learning strategy leads to significant performance improvements compared to a conventional open-loop training paradigm. Importantly, co-adaptive learning allowed two individuals with congenital deficiencies to perform simultaneous 2-D proportional control at levels comparable to the able-bodied individuals, despite having to a learn completely new and unfamiliar mapping from muscle activity to movement trajectories. To our knowledge, this is the first study which investigates man-machine co-adaptation for regression-based myoelectric control. The proposed training strategy has the potential to improve myographic prosthetic control in clinically relevant settings.

Real-time simultaneous and proportional myoelectric control using intramuscular EMG

OBJECTIVE

Myoelectric prostheses use electromyographic (EMG) signals to control movement of prosthetic joints. Clinically available myoelectric control strategies do not allow simultaneous movement of multiple degrees of freedom (DOFs); however, the use of implantable devices that record intramuscular EMG signals could overcome this constraint. The objective of this study was to evaluate the real-time simultaneous control of three DOFs (wrist rotation, wrist flexion/extension, and hand open/close) using intramuscular EMG.

APPROACH

We evaluated task performance of five able-bodied subjects in a virtual environment using two control strategies with fine-wire EMG: (i) parallel dual-site differential control, which enabled simultaneous control of three DOFs and (ii) pattern recognition control, which required sequential control of DOFs.

MAIN RESULTS

Over the course of the experiment, subjects using parallel dual-site control demonstrated increased use of simultaneous control and improved performance in a Fitts' Law test. By the end of the experiment, performance using parallel dual-site control was significantly better (up to a 25% increase in throughput) than when using sequential pattern recognition control for tasks requiring multiple DOFs. The learning trends with parallel dual-site control suggested that further improvements in performance metrics were possible. Subjects occasionally experienced difficulty in performing isolated single-DOF movements with parallel dual-site control but were able to accomplish related Fitts' Law tasks with high levels of path efficiency.

SIGNIFICANCE

These results suggest that intramuscular EMG, used in a parallel dual-site configuration, can provide simultaneous control of a multi-DOF prosthetic wrist and hand and may outperform current methods that enforce sequential control.

On the usability of intramuscular EMG for prosthetic control: a Fitts' Law approach

Previous studies on intramuscular EMG based control used offline data analysis. The current study investigates the usability of intramuscular EMG in two degree-of-freedom using a Fitts' Law approach by combining classification and proportional control to perform a task, with real time feedback of user performance. Nine able-bodied subjects participated in the study. Intramuscular and surface EMG signals were recorded concurrently from the right forearm. Five performance metrics (Throughput,Path efficiency, Average Speed, Overshoot and Completion Rate) were used for quantification of usability. Intramuscular EMG based control performed significantly better than surface EMG for Path Efficiency (80.5±2.4% vs. 71.5±3.8%, P=0.004) and Overshoot (22.0±3.0% vs. 45.1±6.6%, P=0.01). No difference was found between Throughput and Completion Rate. However the Average Speed was significantly higher for surface (51.8±5.5%) than for intramuscular EMG (35.7±2.7%). The results obtained in this study imply that intramuscular EMG has great potential as control source for advanced myoelectric prosthetic devices.

A real-time comparison between direct control, sequential pattern recognition control and simultaneous pattern recognition control using a Fitts' law style assessment procedure

Background

Pattern recognition (PR) based strategies for the control of myoelectric upper limb prostheses are generally evaluated through offline classification accuracy, which is an admittedly useful metric, but insufficient to discuss functional performance in real time. Existing functional tests are extensive to set up and most fail to provide a challenging, objective framework to assess the strategy performance in real time.

Methods

Nine able-bodied and two amputee subjects gave informed consent and participated in the local Institutional Review Board approved study. We designed a two-dimensional target acquisition task, based on the principles of Fitts’ law for human motor control. Subjects were prompted to steer a cursor from the screen center of into a series of subsequently appearing targets of different difficulties. Three cursor control systems were tested, corresponding to three electromyography-based prosthetic control strategies: 1) amplitude-based direct control (the clinical standard of care), 2) sequential PR control, and 3) simultaneous PR control, allowing for a concurrent activation of two degrees of freedom (DOF). We computed throughput (bits/second), path efficiency (%), reaction time (second), and overshoot (%)) and used general linear models to assess significant differences between the strategies for each metric.

Results

We validated the proposed methodology by achieving very high coefficients of determination for Fitts’ law. Both PR strategies significantly outperformed direct control in two-DOF targets and were more intuitive to operate. In one-DOF targets, the simultaneous approach was the least precise. The direct control was efficient in one-DOF targets but cumbersome to operate in two-DOF targets through a switch-depended sequential cursor control.

Conclusions

We designed a test, capable of comprehensively describing prosthetic control strategies in real time. When implemented on control subjects, the test was able to capture statistically significant differences (p < 0.05) in control strategies when considering throughputs, path efficiencies and reaction times. Of particular note, we found statistically significant (p < 0.01) improvements in throughputs and path efficiencies with simultaneous PR when compared to direct control or sequential PR. Amputees could readily achieve the task; however a limited number of subjects was tested and a statistical analysis was not performed with that population.

Power-assistive finger exoskeleton with a palmar opening at the fingerpad

This paper presents a powered finger exoskeleton with an open fingerpad, named the Open Fingerpad eXoskeleton (OFX). The palmar opening at the fingerpad allows for direct contact between the user's fingerpad and objects in order to make use of the wearer's own tactile sensation for dexterous manipulation. Lateral side walls at the end of the OFX's index finger module are equipped with custom load cells for estimating the wearer's pinch grip force. A pneumatic cylinder generates assistance force, which is determined according to the estimated pinch grip force. The OFX transmits the assistance force directly to the objects without exerting pressure on the wearer's finger. The advantage of the OFX over an exoskeleton with a closed fingerpad was validated experimentally. During static and dynamic manipulation of a test object, the OFX exhibited a lower safety margin than the closed exoskeleton, indicating a higher ability to adjust the grip force within an appropriate range. Furthermore, the benefit of force assistance in reducing the muscular burden was observed in terms of muscle fatigue during a static pinch grip. The median frequency (MDF) of the surface electromyography (sEMG) signal from the first dorsal interosseous (FDI) muscle displayed a lower reduction rate for the assisted condition, indicating a lower accumulation rate of muscle fatigue.

Dexterous control of a prosthetic hand using fine-wire intramuscular electrodes in targeted extrinsic muscles

Restoring dexterous motor function equivalent to that of the human hand after amputation is one of the major goals in rehabilitation engineering. To achieve this requires the implementation of a effortless human-machine interface that bridges the artificial hand to the sources of volition. Attempts to tap into the neural signals and to use them as control inputs for neuroprostheses range in invasiveness and hierarchical location in the neuromuscular system. Nevertheless today, the primary clinically viable control technique is the electromyogram measured peripherally by surface electrodes. This approach is neither physiologically appropriate nor dexterous because arbitrary finger movements or hand postures cannot be obtained. Here we demonstrate the feasibility of achieving real-time, continuous and simultaneous control of a multi-digit prosthesis directly from forearm muscles signals using intramuscular electrodes on healthy subjects. Subjects contracted physiologically appropriate muscles to control four degrees of freedom of the fingers of a physical robotic hand independently. Subjects described the control as intuitive and showed the ability to drive the hand into 12 postures without explicit training. This is the first study in which peripheral neural correlates were processed in real-time and used to control multiple digits of a physical hand simultaneously in an intuitive and direct way.

Inverse estimation of muscle activations from joint torque via local multiple regression

The signal measured with an electromyogram (EMG) is the summation of all action potentials of motor units active at a certain time. According to previous literature, one can establish the relationship between torque and EMG/activations in a forward way, i.e., employing EMG of multiple channels to estimate the joint torque. Once the relationship is established, the torque can be predicted with EMG recordings. However, in some applications of neuroprosthetics where we need to make muscle control, it is required to inversely have an insight regarding the muscle activations under a specific motion scenario from the corresponding torque. Motivated by this point, this paper investigates inverse estimation of muscle activations in random contractions at the ankle joint. Local multiple regression is exploited for finding the relationship between muscle activations and torque. Such technique is able to rebuild the relationship between muscle activations and joint torque inversely based on experimental data obtained from five able-bodied subjects, and the resultant optimal weight matrix can indicate each muscle's contribution in the production of the torque. Further cross validation on prediction of muscle activations with joint torque with optimal weights shows that such approach may possess promising performance.

The effect of involuntary motor activity on myoelectric pattern recognition: a case study with chronic stroke patients

OBJECTIVE

This study investigates the effect of the involuntary motor activity of paretic-spastic muscles on the classification of surface electromyography (EMG) signals.

APPROACH

Two data collection sessions were designed for 8 stroke subjects to voluntarily perform 11 functional movements using their affected forearm and hand at relatively slow and fast speeds. For each stroke subject, the degree of involuntary motor activity present in the voluntary surface EMG recordings was qualitatively described from such slow and fast experimental protocols. Myoelectric pattern recognition analysis was performed using different combinations of voluntary surface EMG data recorded from the slow and fast sessions.

MAIN RESULTS

Across all tested stroke subjects, our results revealed that when involuntary surface EMG is absent or present in both the training and testing datasets, high accuracies (>96%, >98%, respectively, averaged over all the subjects) can be achieved in the classification of different movements using surface EMG signals from paretic muscles. When involuntary surface EMG was solely involved in either the training or testing datasets, the classification accuracies were dramatically reduced (<89%, <85%, respectively). However, if both the training and testing datasets contained EMG signals with the presence and absence of involuntary EMG interference, high accuracies were still achieved (>97%).

SIGNIFICANCE

The findings of this study can be used to guide the appropriate design and implementation of myoelectric pattern recognition based systems or devices toward promoting robot-aided therapy for stroke rehabilitation.

Wrist torque estimation during simultaneous and continuously changing movements: surface vs. untargeted intramuscular EMG

In this paper, the predictive capability of surface and untargeted intramuscular electromyography (EMG) was compared with respect to wrist-joint torque to quantify which type of measurement better represents joint torque during multiple degrees-of-freedom (DoF) movements for possible application in prosthetic control. Ten able-bodied subjects participated in the study. Surface and intramuscular EMG was recorded concurrently from the right forearm. The subjects were instructed to track continuous contraction profiles using single and combined DoF in two trials. The association between torque and EMG was assessed using an artificial neural network. Results showed a significant difference between the two types of EMG (P < 0.007) for all performance metrics: coefficient of determination (R(2)), Pearson correlation coefficient (PCC), and root mean square error (RMSE). The performance of surface EMG (R(2) = 0.93 ± 0.03; PCC = 0.98 ± 0.01; RMSE = 8.7 ± 2.1%) was found to be superior compared with intramuscular EMG (R(2) = 0.80 ± 0.07; PCC = 0.93 ± 0.03; RMSE = 14.5 ± 2.9%). The higher values of PCC compared with R(2) indicate that both methods are able to track the torque profile well but have some trouble (particularly intramuscular EMG) in estimating the exact amplitude. The possible cause for the difference, thus the low performance of intramuscular EMG, may be attributed to the very high selectivity of the recordings used in this study.

Surface versus untargeted intramuscular EMG based classification of simultaneous and dynamically changing movements

The pattern recognition-based myoelectric control scheme is in the process of being implemented in clinical settings, but it has been mainly tested on sequential and steady state data. This paper investigates the ability of pattern recognition to resolve movements that are simultaneous and dynamically changing and compares the use of surface and untargeted intramuscular EMG signals for this purpose. Ten able-bodied subjects participated in the study. Both EMG types were recorded concurrently from the right forearm. The subjects were instructed to track dynamic contraction profiles using single and combined degrees of freedom in three trials. During trials one and two, the amplitude and the frequency of the profile were kept constant (nonmodulated data), and during trial three, the two parameters were modulated (modulated data). The results showed that the performance was up to 93% for nonmodulated tasks, but highly depended on the nature of the data used. Surface and untargeted intramuscular EMG had equal performance for data of similar nature (nonmodulated), but the performance of intramuscular EMG decreased, compared to surface, when tested on modulated data. However, the results of intramuscular recordings obtained in this study are promising for future use of implantable electrodes, because, besides the value added in terms of potential chronic implantation, the performance is theoretically the same as for surface EMG provided that enough information is captured in the recordings. Nevertheless, care should be taken when training the system since data obtained from selective recordings probably need more training data to generalize to new signals.

Virtual biomechanics: a new method for online reconstruction of force from EMG recordings

Current methods to reconstruct muscle contributions to joint torque usually combine electromyograms (EMGs) with cadaver-based estimates of biomechanics, but both are imperfect representations of reality. Here, we describe a new method that enables online force reconstruction in which we optimize a "virtual" representation of muscle biomechanics. We first obtain tuning curves for the five major wrist muscles from the mean rectified EMG during the hold phase of an isometric aiming task when a cursor is driven by actual force recordings. We then apply a custom, gradient-descent algorithm to determine the set of "virtual pulling vectors" that best reach the target forces when combined with the observed muscle activity. When these pulling vectors are multiplied by the rectified and low-pass-filtered (1.3 Hz) EMG of the five muscles online, the reconstructed force provides a close spatiotemporal match to the true force exerted at the wrist. In three separate experiments, we demonstrate that the technique works equally well for surface and fine-wire recordings and is sensitive to biomechanical changes elicited by a modification of the forearm posture. In all conditions tested, muscle tuning curves obtained when the task was performed with feedback of reconstructed force were similar to those obtained when the task was performed with real force feedback. This online force reconstruction technique provides new avenues to study the relationship between neural control and limb biomechanics since the "virtual biomechanics" can be systematically altered at will.