Channel and feature selection in multifunction myoelectric control

Sign Language Recognition Using the Electromyographic Signal: A Systematic Literature Review

The analysis and recognition of sign languages are currently active fields of research focused on sign recognition. Various approaches differ in terms of analysis methods and the devices used for sign acquisition. Traditional methods rely on video analysis or spatial positioning data calculated using motion capture tools. In contrast to these conventional recognition and classification approaches, electromyogram (EMG) signals, which measure muscle electrical activity, offer potential technology for detecting gestures. These EMG-based approaches have recently gained attention due to their advantages. This prompted us to conduct a comprehensive study on the methods, approaches, and projects utilizing EMG sensors for sign language handshape recognition. In this paper, we provided an overview of the sign language recognition field through a literature review, with the objective of offering an in-depth review of the most significant techniques. These techniques were categorized in this article based on their respective methodologies. The survey discussed the progress and challenges in sign language recognition systems based on surface electromyography (sEMG) signals. These systems have shown promise but face issues like sEMG data variability and sensor placement. Multiple sensors enhance reliability and accuracy. Machine learning, including deep learning, is used to address these challenges. Common classifiers in sEMG-based sign language recognition include SVM, ANN, CNN, KNN, HMM, and LSTM. While SVM and ANN are widely used, random forest and KNN have shown better performance in some cases. A multilayer perceptron neural network achieved perfect accuracy in one study. CNN, often paired with LSTM, ranks as the third most popular classifier and can achieve exceptional accuracy, reaching up to 99.6% when utilizing both EMG and IMU data. LSTM is highly regarded for handling sequential dependencies in EMG signals, making it a critical component of sign language recognition systems. In summary, the survey highlights the prevalence of SVM and ANN classifiers but also suggests the effectiveness of alternative classifiers like random forests and KNNs. LSTM emerges as the most suitable algorithm for capturing sequential dependencies and improving gesture recognition in EMG-based sign language recognition systems.

Reduce Surface Electromyography Channels for Gesture Recognition by Multitask Sparse Representation and Minimum Redundancy Maximum Relevance

Surface electromyography- (sEMG-) based gesture recognition is widely used in rehabilitation training, artificial prosthesis, and human-computer interaction. The purpose of this study is to simplify the sEMG devices by reducing channels while achieving comparably high gesture recognition accuracy. We propose a compound channel selection scheme by combining the variable selection algorithms based on multitask sparse representation (MTSR) and minimum Redundancy Maximum Relevance (mRMR). Specifically, channelwise features are first extracted to compose channel-feature paired variables, for which variable selection procedures by MTSR and mRMR are carried out, respectively. Then, we rank all the channels according to their occurrences in each variable selection procedure and figure out a certain number of informative channels by fusing these rankings of channels. Finally, the gesture classification performance using the selected channels is evaluated by the support vector machine (SVM) classifier. Experiment results validate the effectiveness of this proposed method.

Sparsity Analysis of a Sonomyographic Muscle-Computer Interface

OBJECTIVE

Sonomyography has been shown to be a promising method for decoding volitional motor intent from analysis of ultrasound images of the forearm musculature. The objectives of this paper are to determine the optimal location for ultrasound transducer placement on the anterior forearm for imaging maximum muscle deformations during different hand motions, and to investigate the effect of using a sparse set of ultrasound scanlines for motion classification for ultrasound-based muscle-computer interfaces (MCIs).

METHODS

The optimal placement of the ultrasound transducer along the forearm was identified using freehand three-dimensional reconstructions of the muscle thickness during rest and motion completion. Based on the ultrasound images acquired from the optimally placed transducer, classification accuracy with equally spaced scanlines across the cross-sectional field of view was determined. Furthermore, the unique contribution of each scanline to class discrimination using Fisher criterion (FC) and mutual information (MI) with respect to motion discriminability was determined.

RESULTS

Experiments with five able-bodied subjects show that the maximum muscle deformation occurred between 40%-50% of the forearm length for multiple degrees-of-freedom. The average classification accuracy was 94% ± 6% with the entire 128-scanline image and 94% ± 5% with four equally spaced scanlines. However, no significant improvement in classification accuracy was observed with optimal scanline selection using FC and MI.

CONCLUSION

For an optimally placed transducer, a small subset of ultrasound scanlines can be used instead of a full imaging array without sacrificing performance in terms of classification accuracy for multiple degrees-of-freedom.

SIGNIFICANCE

The selection of a small subset of transducer elements can enable the reduction of computation, and simplification of the instrumentation and power consumption of wearable sonomyographic MCIs, particularly for rehabilitation and gesture recognition applications.

Evaluating EMG Feature and Classifier Selection for Application to Partial-Hand Prosthesis Control

Pattern recognition-based myoelectric control of upper-limb prostheses has the potential to restore control of multiple degrees of freedom. Though this control method has been extensively studied in individuals with higher-level amputations, few studies have investigated its effectiveness for individuals with partial-hand amputations. Most partial-hand amputees retain a functional wrist and the ability of pattern recognition-based methods to correctly classify hand motions from different wrist positions is not well studied. In this study, focusing on partial-hand amputees, we evaluate (1) the performance of non-linear and linear pattern recognition algorithms and (2) the performance of optimal EMG feature subsets for classification of four hand motion classes in different wrist positions for 16 non-amputees and 4 amputees. Our results show that linear discriminant analysis and linear and non-linear artificial neural networks perform significantly better than the quadratic discriminant analysis for both non-amputees and partial-hand amputees. For amputees, including information from multiple wrist positions significantly decreased error (p < 0.001) but no further significant decrease in error occurred when more than 4, 2, or 3 positions were included for the extrinsic (p = 0.07), intrinsic (p = 0.06), or combined extrinsic and intrinsic muscle EMG (p = 0.08), respectively. Finally, we found that a feature set determined by selecting optimal features from each channel outperformed the commonly used time domain (p < 0.001) and time domain/autoregressive feature sets (p < 0.01). This method can be used as a screening filter to select the features from each channel that provide the best classification of hand postures across different wrist positions.

Myoelectric control of prosthetic hands: state-of-the-art review

Myoelectric signals (MES) have been used in various applications, in particular, for identification of user intention to potentially control assistive devices for amputees, orthotic devices, and exoskeleton in order to augment capability of the user. MES are also used to estimate force and, hence, torque to actuate the assistive device. The application of MES is not limited to assistive devices, and they also find potential applications in teleoperation of robots, haptic devices, virtual reality, and so on. The myoelectric control-based prosthetic hand aids to restore activities of daily living of amputees in order to improve the self-esteem of the user. All myoelectric control-based prosthetic hands may not have similar operations and exhibit variation in sensing input, deciphering the signals, and actuating prosthetic hand. Researchers are focusing on improving the functionality of prosthetic hand in order to suit the user requirement with the different operating features. The myoelectric control differs in operation to accommodate various external factors. This article reviews the state of the art of myoelectric prosthetic hand, giving description of each control strategy.

Hybrid soft computing systems for electromyographic signals analysis: a review

Electromyographic (EMG) is a bio-signal collected on human skeletal muscle. Analysis of EMG signals has been widely used to detect human movement intent, control various human-machine interfaces, diagnose neuromuscular diseases, and model neuromusculoskeletal system. With the advances of artificial intelligence and soft computing, many sophisticated techniques have been proposed for such purpose. Hybrid soft computing system (HSCS), the integration of these different techniques, aims to further improve the effectiveness, efficiency, and accuracy of EMG analysis. This paper reviews and compares key combinations of neural network, support vector machine, fuzzy logic, evolutionary computing, and swarm intelligence for EMG analysis. Our suggestions on the possible future development of HSCS in EMG analysis are also given in terms of basic soft computing techniques, further combination of these techniques, and their other applications in EMG analysis.