Pattern recognition of EMG signals for low level grip force classification

An early force prediction control scheme using multimodal sensing of electromyography and digit force signals

Different grasping gestures result in the change of muscular activity of the forearm muscles. Similarly, the muscular activity changes with a change in grip force while grasping the object. This change in muscular activity, measured by a technique called Electromyography (EMG) is used in the upper limb bionic devices to select the grasping gesture. Previous research studies have shown gesture classification using pattern recognition control schemes. However, the use of EMG signals for force manipulation is less focused, especially during precision grasping. In this study, an early predictive control scheme is designed for the efficient determination of grip force using EMG signals from forearm muscles and digit force signals. The optimal pattern recognition (PR) control schemes are investigated using three different inputs of two signals: EMG signals, digit force signals and a combination of EMG and digit force signals. The features extracted from EMG signals included Slope Sign Change, Willison Amplitude, Auto Regressive Coefficient and Waveform Length. The classifiers used to predict force levels are Random Forest, Gradient Boosting, Linear Discriminant Analysis, Support Vector Machines, k-nearest Neighbors and Decision Tree. The two-fold objectives of early prediction and high classification accuracy of grip force level were obtained using EMG signals and digit force signals as inputs and Random Forest as a classifier. The earliest prediction was possible at 1000 ms from the onset of the gripping of the object with a mean classification accuracy of 90 % for different grasping gestures. Using this approach to study, an early prediction will result in the determination of force level before the object is lifted from the surface. This approach will also result in better biomimetic regulation of the grip force during precision grasp, especially for a population facing vision deficiency.

The use of nonnormalized surface EMG and feature inputs for LSTM-based powered ankle prosthesis control algorithm development

Advancements in instrumentation support improved powered ankle prostheses hardware development. However, control algorithms have limitations regarding number and type of sensors utilized and achieving autonomous adaptation, which is key to a natural ambulation. Surface electromyogram (sEMG) sensors are promising. With a minimized number of sEMG inputs an economic control algorithm can be developed, whereas limiting the use of lower leg muscles will provide a practical algorithm for both ankle disarticulation and transtibial amputation. To determine appropriate sensor combinations, a systematic assessment of the predictive success of variations of multiple sEMG inputs in estimating ankle position and moment has to conducted. More importantly, tackling the use of nonnormalized sEMG data in such algorithm development to overcome processing complexities in real-time is essential, but lacking. We used healthy population level walking data to (1) develop sagittal ankle position and moment predicting algorithms using nonnormalized sEMG, and (2) rank all muscle combinations based on success to determine economic and practical algorithms. Eight lower extremity muscles were studied as sEMG inputs to a long-short-term memory (LSTM) neural network architecture: tibialis anterior (TA), soleus (SO), medial gastrocnemius (MG), peroneus longus (PL), rectus femoris (RF), vastus medialis (VM), biceps femoris (BF) and gluteus maximus (GMax). Five features extracted from nonnormalized sEMG amplitudes were used: integrated EMG (IEMG), mean absolute value (MAV), Willison amplitude (WAMP), root mean square (RMS) and waveform length (WL). Muscle and feature combination variations were ranked using Pearson's correlation coefficient (r > 0.90 indicates successful correlations), the root-mean-square error and one-dimensional statistical parametric mapping between the original data and LSTM response. The results showed that IEMG+WL yields the best feature combination performance. The best performing variation was MG + RF + VM (r_position = 0.9099 and r_moment = 0.9707) whereas, PL (r_position = 0.9001, r_moment = 0.9703) and GMax+VM (r_position = 0.9010, r_moment = 0.9718) were distinguished as the economic and practical variations, respectively. The study established for the first time the use of nonnormalized sEMG in control algorithm development for level walking.

Continuous grip force estimation from surface electromyography using generalized regression neural network

BACKGROUND

Grip force estimation is highly required in realizing flexible and accurate prosthetic control.

OBJECTIVE

This study presents a method to accurately estimate continuous grip force from surface electromyography (sEMG) under three forearm postures for unilateral amputees.

METHODS

Ten able-bodied subjects and a transradial amputee were recruited. sEMG signals were recorded from six forearm muscles on the dominant side of each able-bodied subject and the stump of amputee. Meanwhile, grip force was synchronously measured from the ipsilateral hands of able-bodied subjects and contralateral hand of amputee. Three force profiles (triangle, trapezoid, and fast triangle) were tested under three forearm postures (supination, neutral and pronation). Two algorithms (Generalized Regression Neural Network (GRNN) and Multilinear Regression Model (MLR)) were compared using several EMG features. The estimation performance was evaluated by coefficient of determination (R2) and mean absolute error (MAE).

RESULTS

The optimal regressor combining TD and GRNN achieved R2= 96.33 ± 1.13% and MAE= 2.11 ± 0.52% for the intact subjects, and R2= 86.86% and MAE= 2.13% for the amputee. The results indicated that multiple grip force curves under three forearm postures could be accurately estimated for unilateral amputees using mirrored bilateral training.

CONCLUSIONS

The proposed method has the potential for precise force control of prosthetic hands.

Natural grasping movement recognition and force estimation using electromyography

Electromyography (EMG) generated by human hand movements is usually used to decode different action types with high accuracy. However, the classifications of the gestures rarely consider the impact of force, and the estimation of the grasp force when performing natural grasping movements is so far overlooked. Decoding natural grasping movements and estimating the force generated by the associated movements can help patients to improve the accuracy of prosthesis control. This study mainly focused on two aspects: the classification of four natural grasping movements and the force estimation of these actions. For this purpose, we designed an experimental platform where subjects could perform four common natural grasping movements in daily life, including pinch, palmar, twist, and plug grasp, to complete target profiles. On the one hand, the results showed that, for natural grasping movements with different levels of force (three levels at 20, 50, and 80%), the average accuracy could reach from 91.43 to 97.33% under five classification schemes. On the other hand, the feasibility of force estimation for natural grasping movements was demonstrated. Furthermore, in the process of force estimation, we confirmed that the regression performance about plug grasp was the best, and the average R2 could reach 0.9082. Besides, we found that the regression results were affected by the speed of force application. These findings contribute to the natural control of myoelectric prosthesis and the EMG-based rehabilitation training system, improving the user’s experience and acceptance.

Upper-Limb Electromyogram Classification of Reaching-to-Grasping Tasks Based on Convolutional Neural Networks for Control of a Prosthetic Hand

In recent years, myoelectric interfaces using surface electromyogram (EMG) signals have been developed for assisting people with physical disabilities. Especially, in the myoelectric interfaces for robotic hands or arms, decoding the user’s upper-limb movement intentions is cardinal to properly control the prosthesis. However, because previous experiments were implemented with only healthy subjects, the possibility of classifying reaching-to-grasping based on the EMG signals from the residual limb without the below-elbow muscles was not investigated yet. Therefore, we aimed to investigate the possibility of classifying reaching-to-grasping tasks using the EMG from the upper arm and upper body without considering wrist muscles for prosthetic users. In our study, seven healthy subjects, one trans-radial amputee, and one wrist amputee were participated and performed 10 repeatable 12 reaching-to-grasping tasks based on the Southampton Hand Assessment Procedure (SHAP) with 12 different weighted (light and heavy) objects. The acquired EMG was processed using the principal component analysis (PCA) and convolutional neural network (CNN) to decode the tasks. The PCA–CNN method showed that the average accuracies of the healthy subjects were 69.4 ± 11.4%, using only the EMG signals by the upper arm and upper body. The result with the PCA–CNN method showed 8% significantly higher accuracies than the result with the widely used time domain and auto-regressive-support vector machine (TDAR–SVM) method as 61.6 ± 13.7%. However, in the cases of the amputees, the PCA–CNN showed slightly lower performance. In addition, in the aspects of assistant daily living, because grip force is also important when grasping an object after reaching, the possibility of classifying the two light and heavy objects in each reaching-to-grasping task was also investigated. Consequently, the PCA–CNN method showed higher accuracy at 70.1 ± 9.8%. Based on our results, the PCA–CNN method can help to improve the performance of classifying reaching-to-grasping tasks without wrist EMG signals. Our findings and decoding method can be implemented to further develop a practical human–machine interface using EMG signals.