Stable Responsive EMG Sequence Prediction and Adaptive Reinforcement With Temporal Convolutional Networks

Multi-scale EMG classification with spatial-temporal attention for prosthetic hands

A classification framework for hand gestures using Electromyography (EMG) signals in prosthetic hands is presented. Leveraging the multi-scale characteristics and temporal nature of EMG signals, a Convolutional Neural Network (CNN) is used to extract multi-scale features and classify them with spatial-temporal attention. A multi-scale coarse-grained layer introduced into the input of one-dimensional CNN (1D-CNN) facilitates multi-scale feature extraction. The multi-scale features are fed into the attention layer and subsequently given to the fully connected layer to perform classification. The proposed model achieves classification accuracies of 93.4%, 92.8%, 91.3%, and 94.1% for Ninapro DB1, DB2, DB5, and DB7 respectively, thereby enhancing the confidence of prosthetic hand users.

Sequential sEMG Recognition With Knowledge Transfer and Dynamic Graph Network Based on Spatio-Temporal Feature Extraction Network

Surface electromyography (sEMG) signals are electrical signals released by muscles during movement, which can directly reflect the muscle conditions during various actions. When a series of continuous static actions are connected along the temporal axis, a sequential action is formed, which is more aligned with people's intuitive understanding of real-life movements. The signals acquired during sequential actions are known as sequential sEMG signals, including an additional dimension of sequence, embodying richer features compared to static sEMG signals. However, existing methods show inadequate utilization of the signals' sequential characteristics. Addressing these gaps, this paper introduces the Spatio-Temporal Feature Extraction Network (STFEN), which includes a Sequential Feature Analysis Module based on static-sequential knowledge transfer, and a Spatial Feature Analysis Module based on dynamic graph networks to analyze the internal relationships between the leads. The effectiveness of STFEN is tested on both modified publicly available datasets and on our acquired Arabic Digit Sequential Electromyography (ADSE) dataset. The results show that STFEN outperforms existing models in recognizing sequential sEMG signals. Experiments have confirmed the reliability and wide applicability of STFEN in analyzing complex muscle activities. Furthermore, this work also suggests STFEN's potential benefits in rehabilitation medicine, particularly for stroke recovery, and shows promising future applications.

Self-supervised learning via VICReg enables training of EMG pattern recognition using continuous data with unclear labels

In this study, we investigate the application of self-supervised learning via pre-trained Long Short-Term Memory (LSTM) networks for training surface electromyography pattern recognition models (sEMG-PR) using dynamic data with transitions. While labeling such data poses challenges due to the absence of ground-truth labels during transitions between classes, self-supervised pre-training offers a way to circumvent this issue. We compare the performance of LSTMs trained with either fully-supervised or self-supervised loss to a conventional non-temporal model (LDA) on two data types: segmented ramp data (lacking transition information) and continuous dynamic data inclusive of class transitions. Statistical analysis reveals that the temporal models outperform non-temporal models when trained with continuous dynamic data. Additionally, the proposed VICReg pre-trained temporal model with continuous dynamic data significantly outperformed all other models. Interestingly, when using only ramp data, the LSTM performed worse than the LDA, suggesting potential overfitting due to the absence of sufficient dynamics. This highlights the interplay between data type and model choice. Overall, this work highlights the importance of representative dynamics in training data and the potential for leveraging self-supervised approaches to enhance sEMG-PR models.

Decoding Gestures in Electromyography: Spatiotemporal Graph Neural Networks for Generalizable and Interpretable Classification

In recent years, significant strides in deep learning have propelled the advancement of electromyography (EMG)-based upper-limb gesture recognition systems, yielding notable successes across a spectrum of domains, including rehabilitation, orthopedics, robotics, and human-computer interaction. Despite these achievements, prevailing methodologies often overlook the intrinsic physical configurations and interconnectivity of multi-channel sensory inputs, resulting in a failure to adequately capture relational information embedded within the connections of deployed EMG sensor network topology. This oversight poses a significant challenge, impeding the extraction of crucial features from collaborative multi-channel EMG inputs and subsequently constraining model performance, generalizability, and interpretability. To address these limitations, we introduce novel graph structures meticulously crafted to encapsulate the spatial proximity of distributed EMG sensors and the temporal adjacency of EMG signals. Harnessing these tailored graph structures, we present Graph Convolution Network (GCN)-based classification models adept at effectively extracting and aggregating key features associated with various gestures. Our methodology exhibits remarkable efficacy, achieving state-of-the-art performance across five publicly available datasets, thus underscoring its prowess in gesture recognition tasks. Furthermore, our approach provides interpretable insights into muscular activation patterns, thereby reaffirming the practical effectiveness of our GCN model. Moreover, we show the effectiveness of our graph-based input structure and GCN-based classifier in maintaining high accuracy even with reduced sensor configurations, suggesting their potential for seamless integration into AI-powered rehabilitation strategies utilizing EMG-based gesture classification systems.

Deep Learning for Enhanced Prosthetic Control: Real-Time Motor Intent Decoding for Simultaneous Control of Artificial Limbs

The development of advanced prosthetic devices that can be seamlessly used during an individual's daily life remains a significant challenge in the field of rehabilitation engineering. This study compares the performance of deep learning architectures to shallow networks in decoding motor intent for prosthetic control using electromyography (EMG) signals. Four neural network architectures, including a feedforward neural network with one hidden layer, a feedforward neural network with multiple hidden layers, a temporal convolutional network, and a convolutional neural network with squeeze-and-excitation operations were evaluated in real-time, human-in-the-loop experiments with able-bodied participants and an individual with an amputation. Our results demonstrate that deep learning architectures outperform shallow networks in decoding motor intent, with representation learning effectively extracting underlying motor control information from EMG signals. Furthermore, the observed performance improvements by using deep neural networks were consistent across both able-bodied and amputee participants. By employing deep neural networks instead of a shallow network, more reliable and precise control of a prosthesis can be achieved, which has the potential to significantly enhance prosthetic functionality and improve the quality of life for individuals with amputations.

Functionally Adaptive Myosite Selection Using High-Density sEMG for Upper Limb Myoelectric Prostheses

OBJECTIVE

Our study defines a novel electrode placement method called Functionally Adaptive Myosite Selection (FAMS), as a tool for rapid and effective electrode placement during prosthesis fitting. We demonstrate a method for determining electrode placement that is adaptable towards individual patient anatomy and desired functional outcomes, agnostic to the type of classification model used, and provides insight into expected classifier performance without training multiple models.

METHODS

FAMS relies on a separability metric to rapidly predict classifier performance during prosthesis fitting.

RESULTS

The results show a predictable relationship between the FAMS metric and classifier accuracy (3.45%SE), allowing estimation of control performance with any given set of electrodes. Electrode configurations selected using the FAMS metric show improved control performance ( ) for target electrode counts compared to established methods when using an ANN classifier, and equivalent performance ( R2 ≥ .96) to previous top-performing methods on an LDA classifier, with faster convergence ( ). We used the FAMS method to determine electrode placement for two amputee subjects by using the heuristic to search through possible sets, and checking for saturation in performance vs electrode count. The resulting configurations that averaged 95.8% of the highest possible classification performance using a mean 25 number of electrodes (19.5% of the available sites).

SIGNIFICANCE

FAMS can be used to rapidly approximate the tradeoffs between increased electrode count and classifier performance, a useful tool during prosthesis fitting.

sEMG-Based Gesture Recognition Using Temporal History

Surface electromyography (sEMG) patterns have been decoded using learning-based methods that determine complicated nonlinear decision boundaries. However, overlapping classes in sEMG pattern recognition still degrade the classification accuracy because they cannot be separated by the decision boundaries. We hypothesized that certain overlapping classes can be separated while tracing the temporal history of sEMG patterns. Therefore, a novel post-processing method is proposed to adjust classification errors using the separated patterns from the temporal history of overlapping classes. The proposed method confirms the confidence of the prediction result by calculating the instantaneous pattern separability for the sequential sEMG input. The prediction result with high separability pattern is considered to have a high confidence of being correct (reliable). This result is stored for adjusting the next sEMG input. When the subsequent prediction is identified as having low confidence (unreliable), the predicted result is adjusted using the stored reliable predicted results. The proposed method adds an adjustment step to an existing classifier (maximum likelihood classifier (MLC), k-nearest neighbor (KNN), and support vector machine (SVM)), such that it can be attached to the back-end regardless of the type of classifier. Ten subjects performed 13 types of hand gestures, including overlapping patterns. The overall classification accuracy was enhanced to 88.93%(+8.12%p, MLC), 91.31%(+7.68%p, KNN), and 99.65%(+11.63%p, SVM) after the implementation of the proposed post-processing. Additionally, a faster and more accurate gesture classification was achieved with accuracy enhancement before gesture completion as 85.62%(+4.23%p, MLC), 89.77%(+4.23%p, KNN), and 97.62%(+11.12%p, SVM).

Prediction of leg muscle activities from arm muscle activities in arm and leg cycling

Functional electrical stimulation (FES) driven leg cycling is usually controlled by previously established stimulation patterns. We investigated the potential utilization of a particular computational method for controlling electrical stimulation of lower limb muscles by real-time electromyography (EMG) signals of arm muscles during hybrid arm and leg cycling. In hybrid arm and leg cycling, arm cranking is performed voluntarily, while leg cycling is driven by FES. In this study, we investigate arm and leg cycling movements of able-bodied persons when both arm and leg cycling is performed voluntarily without FES. We present a neural network-based model in which the input of the neural network is given by a time series of upper limb muscle activities (EMG), and the output provides potential lower limb muscle activities. The particular neural network was a nonlinear autoregressive exogen (NARX) neural network. The measured EMG signals of the lower limb muscles were compared to the signals that were predicted by the neural network. The neural network was trained with data recorded from four participants. Our preliminary results show notable differences between the predicted and the experimentally measured lower limb muscle activities. The prediction was good only for 60% of the movement time. We conclude that-while including arm cycling in the movement-simpler control modalities or further consideration of applying machine-learning techniques has to be taken into account to improve voluntary upper limb-controlled FES assisted leg cycling.

MSFF-Net: Multi-Stream Feature Fusion Network for surface electromyography gesture recognition

In the field of surface electromyography (sEMG) gesture recognition, how to improve recognition accuracy has been a research hotspot. The rapid development of deep learning provides a new solution to this problem. At present, the main applications of deep learning for sEMG gesture feature extraction are based on convolutional neural network (CNN) structures to capture spatial morphological information of the multichannel sEMG or based on long short-term memory network (LSTM) to extract time-dependent information of the single-channel sEMG. However, there are few methods to comprehensively consider the distribution area of the sEMG signal acquisition electrode sensor and the arrangement of the sEMG signal morphological features and electrode spatial features. In this paper, a novel multi-stream feature fusion network (MSFF-Net) model is proposed for sEMG gesture recognition. The model adopts a divide-and-conquer strategy to learn the relationship between different muscle regions and specific gestures. Firstly, a multi-stream convolutional neural network (Multi-stream CNN) and a convolutional block attention module integrated with a resblock (ResCBAM) are used to extract multi-dimensional spatial features from signal morphology, electrode space, and feature map space. Then the learned multi-view depth features are fused by a view aggregation network consisting of an early fusion network and a late fusion network. The results of all subjects and gesture movement validation experiments in the sEMG signal acquired from 12 sensors provided by NinaPro’s DB2 and DB4 sub-databases show that the proposed model in this paper has better performance in terms of gesture recognition accuracy compared with the existing models.

Non-invasive dual attention TCN for electromyography and motion data fusion in lower limb ambulation prediction

OBJECTIVE

Recent technological advances show the feasibility of fusing surface electromyography (sEMG) signals and movement data to predict lower limb ambulation intentions. However, since the invasive fusion of different signals is a major impediment to improving predictive performance, searching for a non-invasive fusion mechanism for lower limb ambulation pattern recognition based on different modal features is crucial.

APPROACH

We propose an end-to-end sequence prediction model with non-invasive dual attention temporal convolutional networks (NIDA-TCN) as a core to elegantly address the essential deficiencies of traditional decision models with heterogeneous signal fusion. Notably, the NIDA-TCN is a weighted fusion of sEMG and inertial measurement units (IMU) with time-dependent effective hidden information in the temporal and channel dimensions using TCN and self-attentive mechanisms. The new model can better discriminate between walking, jumping, downstairs, and upstairs four lower limb activities of daily living (ADL).

MAIN RESULTS

The results of this study show that the NIDA-TCN models produce predictions that significantly outperform both frame-wise and TCN models in terms of accuracy, sensitivity, precision, F1 score, and stability. Particularly, the NIDA-TCN with sequence decision fusion (NIDA-TCN-SDF) models, have maximum accuracy and stability increments of 3.37% and 4.95% relative to the frame-wise model, respectively, without manual feature-encoding and complex model parameters.

SIGNIFICANCE

It is concluded that the results demonstrate the validity and feasibility of the NIDA-TCN-SDF models to ensure the prediction of daily lower limb ambulation activities, paving the way to the development of fused heterogeneous signal decoding with better prediction performance.

Multilevel Feature Learning Method for Accurate Interictal Epileptiform Spike Detection

Interictal epileptiform spike (referred to as spike) detected from electroencephalograms lasting only 20- to 200-ms can provide a reliable evidence-based indicator for clinical seizure type diagnosis. Recent feature representation approaches focus either on the concrete-level or on abstract-level information mining of the spike, thus demonstrating suboptimal detection performance. Additionally, existing abstract-level information mining methods of the spike based deep learning networks have not realized the effective feature representation of long-term dependent distinguished information within similar waveform cycles caused by morphological heterogeneity, which affects detection performance. Thus, a multilevel feature learning method for accurate spike detection was proposed in this study. Specifically, the spatio-temporal-frequency multidomain information in concrete-level first are inferred the common mimetic properties of the spike using the multidomain feature extractors. Then, the effective feature representation of long-term dependent distinguished information within similar waveform cycles caused by morphological heterogeneity is suitably captured using the temporal convolutional network. Finally, the spatio-temporal-frequency multidomain long-term dependent feature representation of spike is calculated using the element-wise manner to fuse the feature representation in concrete- and abstract-levels. The experimental results indicate that the proposed method can achieve an accuracy of 90.62±1.38%, sensitivity of 90.38±1.52%, specificity of 91.00±1.60%, precision of 90.33±4.71%, and the false detection rate per minute is 0.148±0.020m^-1, which are higher than when using the feature representation in the concrete- or abstract-level alone. Additionally, the detection results indicate that the proposed method avoids the subjectivity and inefficiency of visual inspection, and it enables a highly accurate detection of the spike.

Finger Movement Recognition via High-Density Electromyography of Intrinsic and Extrinsic Hand Muscles

Surface electromyography (sEMG) is commonly used to observe the motor neuronal activity within muscle fibers. However, decoding dexterous body movements from sEMG signals is still quite challenging. In this paper, we present a high-density sEMG (HD-sEMG) signal database that comprises simultaneously recorded sEMG signals of intrinsic and extrinsic hand muscles. Specifically, twenty able-bodied participants performed 12 finger movements under two paces and three arm postures. HD-sEMG signals were recorded with a 64-channel high-density grid placed on the back of hand and an 8-channel armband around the forearm. Also, a data-glove was used to record the finger joint angles. Synchronisation and reproducibility of the data collection from the HD-sEMG and glove sensors were ensured. The collected data samples were further employed for automated recognition of dexterous finger movements. The introduced dataset offers a new perspective to study the synergy between the intrinsic and extrinsic hand muscles during dynamic finger movements. As this dataset was collected from multiple participants, it also provides a resource for exploring generalized models for finger movement decoding.

CSAC-Net: Fast Adaptive sEMG Recognition through Attention Convolution Network and Model-Agnostic Meta-Learning

Gesture recognition through surface electromyography (sEMG) provides a new method for the control algorithm of bionic limbs, which is a promising technology in the field of human–computer interaction. However, subject specificity of sEMG along with the offset of the electrode makes it challenging to develop a model that can quickly adapt to new subjects. In view of this, we introduce a new deep neural network called CSAC-Net. Firstly, we extract the time-frequency feature from the raw signal, which contains rich information. Secondly, we design a convolutional neural network supplemented by an attention mechanism for further feature extraction. Additionally, we propose to utilize model-agnostic meta-learning to adapt to new subjects and this learning strategy achieves better results than the state-of-the-art methods. By the basic experiment on CapgMyo and three ablation studies, we demonstrate the advancement of CSAC-Net.

Monitoring at-home prosthesis control improvements through real-time data logging

OBJECTIVE

Validating the ability for advanced prostheses to improve function beyond the laboratory remains a critical step in enabling long-term benefits for prosthetic limb users.

APPROACH

A nine week take-home case study was completed with a single participant with upper limb amputation and osseointegration (OI) to better understand how an advanced prosthesis is used during daily activities. The participant was already an expert prosthesis user and used the Modular Prosthetic Limb (MPL) at home during the study. The MPL was controlled using wireless electromyography (EMG) pattern recognition-based movement decoding. Clinical assessments were performed before and after the take-home portion of the study. Data was recorded using an onboard data log in order to measure daily prosthesis usage, sensor data, and EMG data.

MAIN RESULT

The participant's continuous prosthesis usage steadily increased (p = 0.04, max = 5.5 hr) over time and over 30% of the total time was spent actively controlling the prosthesis. The duration of prosthesis usage after each pattern recognition training session also increased over time (p = 0.04), resulting in up to 5.4 hr of usage before retraining the movement decoding algorithm. Pattern recognition control accuracy improved (1.2% per week, p < 0.001) with a maximum number of 10 classes trained at once and the transitions between different degrees of freedom increased as the study progressed, indicating smooth and efficient control of the advanced prosthesis. Variability of decoding accuracy also decreased with prosthesis usage (p < 0.001) and 30% of the time was spent performing a prosthesis movement. During clinical evaluations, Box and Blocks and the Assessment of the Capacity for Myoelectric Control (ACMC) scores increased by 43% and 6.2%, respectively, demonstrating prosthesis functionality and the NASA Task Load Index (NASA-TLX) scores decreased, on average, by 25% across assessments, indicating reduced cognitive workload while using the MPL, over the nine week study.

SIGNIFICANCE

In this case study, we demonstrate that an onboard system to monitor prosthesis usage enables better understanding of how prostheses are incorporated into daily life. That knowledge can support the long-term goal of completely restoring independence and quality of life to individuals living with upper limb amputation.

Multi-agent collaborative control parameter prediction for intelligent precision loading

Due to the low adjustment accuracy of manual prediction, conventional programmable logic controller systems can easily lead to inaccurate and unpredictable load problems. The existing multi-agent systems based on various deep learning models has weak ability for advanced multi-parameter prediction while mainly focusing on the underlying communication consensus. To solve this problem, we propose a hybrid model based on a temporal convolutional network with the feature crossover method and light gradient boosting decision trees (called TCN-LightGBDT). First, we select the initial dataset according to the loading parameters' tolerance range and supply supplementing method for the deviated data. Second, we use the temporal convolutional network to extract the hidden data features in virtual loading areas. Further, a two-dimensional feature matrix is reconstructed through the feature crossover method. Third, we combine these features with basic historical features as the input of the light gradient boosting decision trees to predict the adjustment values of different combinations. Finaly, we compare the proposed model with other related deep learning models, and the experimental results show that our model can accurately predict parameter values.

Real-Time Analysis of Hand Gesture Recognition with Temporal Convolutional Networks

In recent years, the successful application of Deep Learning methods to classification problems has had a huge impact in many domains. (1) Background: In biomedical engineering, the problem of gesture recognition based on electromyography is often addressed as an image classification problem using Convolutional Neural Networks. Recently, a specific class of these models called Temporal Convolutional Networks (TCNs) has been successfully applied to this task. (2) Methods: In this paper, we approach electromyography-based hand gesture recognition as a sequence classification problem using TCNs. Specifically, we investigate the real-time behavior of our previous TCN model by performing a simulation experiment on a recorded sEMG dataset. (3) Results: The proposed network trained with data augmentation yields a small improvement in accuracy compared to our existing model. However, the classification accuracy is decreased in the real-time evaluation, showing that the proposed TCN architecture is not suitable for such applications. (4) Conclusions: The real-time analysis helps in understanding the limitations of the model and exploring new ways to improve its performance.

Towards Integration of Domain Knowledge-Guided Feature Engineering and Deep Feature Learning in Surface Electromyography-Based Hand Movement Recognition

As a machine-learning-driven decision-making problem, the surface electromyography (sEMG)-based hand movement recognition is one of the key issues in robust control of noninvasive neural interfaces such as myoelectric prosthesis and rehabilitation robot. Despite the recent success in sEMG-based hand movement recognition using end-to-end deep feature learning technologies based on deep learning models, the performance of today's sEMG-based hand movement recognition system is still limited by the noisy, random, and nonstationary nature of sEMG signals and researchers have come up with a number of methods that improve sEMG-based hand movement via feature engineering. Aiming at achieving higher sEMG-based hand movement recognition accuracies while enabling a trade-off between performance and computational complexity, this study proposed a progressive fusion network (PFNet) framework, which improves sEMG-based hand movement recognition via integration of domain knowledge-guided feature engineering and deep feature learning. In particular, it learns high-level feature representations from raw sEMG signals and engineered time-frequency domain features via a feature learning network and a domain knowledge network, respectively, and then employs a 3-stage progressive fusion strategy to progressively fuse the two networks together and obtain the final decisions. Extensive experiments were conducted on five sEMG datasets to evaluate our proposed PFNet, and the experimental results showed that the proposed PFNet could achieve the average hand movement recognition accuracies of 87.8%, 85.4%, 68.3%, 71.7%, and 90.3% on the five datasets, respectively, which outperformed those achieved by the state of the arts.

A Hierarchical View Pooling Network for Multichannel Surface Electromyography-Based Gesture Recognition

Hand gesture recognition based on surface electromyography (sEMG) plays an important role in the field of biomedical and rehabilitation engineering. Recently, there is a remarkable progress in gesture recognition using high-density surface electromyography (HD-sEMG) recorded by sensor arrays. On the other hand, robust gesture recognition using multichannel sEMG recorded by sparsely placed sensors remains a major challenge. In the context of multiview deep learning, this paper presents a hierarchical view pooling network (HVPN) framework, which improves multichannel sEMG-based gesture recognition by learning not only view-specific deep features but also view-shared deep features from hierarchically pooled multiview feature spaces. Extensive intrasubject and intersubject evaluations were conducted on the large-scale noninvasive adaptive prosthetics (NinaPro) database to comprehensively evaluate our proposed HVPN framework. Results showed that when using 200 ms sliding windows to segment data, the proposed HVPN framework could achieve the intrasubject gesture recognition accuracy of 88.4%, 85.8%, 68.2%, 72.9%, and 90.3% and the intersubject gesture recognition accuracy of 84.9%, 82.0%, 65.6%, 70.2%, and 88.9% on the first five subdatabases of NinaPro, respectively, which outperformed the state-of-the-art methods.

Deep Cross-User Models Reduce the Training Burden in Myoelectric Control

The effort, focus, and time to collect data and train EMG pattern recognition systems is one of the largest barriers to their widespread adoption in commercial applications. In addition to multiple repetitions of motions, including exemplars of confounding factors during the training protocol has been shown to be critical for robust machine learning models. This added training burden is prohibitive for most regular use cases, so cross-user models have been proposed that could leverage inter-repetition variability supplied by other users. Existing cross-user models have not yet achieved performance levels sufficient for commercialization and require users to closely adhere to a training protocol that is impractical without expert guidance. In this work, we extend a previously reported adaptive domain adversarial neural network (ADANN) to a cross-subject framework that requires very little training data from the end-user. We compare its performance to single-repetition within-user training and the previous state-of-the-art cross-subject technique, canonical correlation analysis (CCA). ADANN significantly outperformed CCA for both intact-limb (86.8–96.2%) and amputee (64.1–84.2%) populations. Moreover, the ADANN adaptation computation time was substantially lower than the time otherwise devoted to conducting a full within-subject training protocol. This study shows that cross-user models, enabled by deep-learned adaptations, may be a viable option for improved generalized pattern recognition-based myoelectric control.

Gesture Recognition Using Surface Electromyography and Deep Learning for Prostheses Hand: State-of-the-Art, Challenges, and Future

Amputation of the upper limb brings heavy burden to amputees, reduces their quality of life, and limits their performance in activities of daily life. The realization of natural control for prosthetic hands is crucial to improving the quality of life of amputees. Surface electromyography (sEMG) signal is one of the most widely used biological signals for the prediction of upper limb motor intention, which is an essential element of the control systems of prosthetic hands. The conversion of sEMG signals into effective control signals often requires a lot of computational power and complex process. Existing commercial prosthetic hands can only provide natural control for very few active degrees of freedom. Deep learning (DL) has performed surprisingly well in the development of intelligent systems in recent years. The significant improvement of hardware equipment and the continuous emergence of large data sets of sEMG have also boosted the DL research in sEMG signal processing. DL can effectively improve the accuracy of sEMG pattern recognition and reduce the influence of interference factors. This paper analyzes the applicability and efficiency of DL in sEMG-based gesture recognition and reviews the key techniques of DL-based sEMG pattern recognition for the prosthetic hand, including signal acquisition, signal preprocessing, feature extraction, classification of patterns, post-processing, and performance evaluation. Finally, the current challenges and future prospects in clinical application of these techniques are outlined and discussed.

Extended home use of an advanced osseointegrated prosthetic arm improves function, performance, and control efficiency

Objective.Full restoration of arm function using a prosthesis remains a grand challenge; however, advances in robotic hardware, surgical interventions, and machine learning are bringing seamless human-machine interfacing closer to reality.Approach.Through extensive data logging over 1 year, we monitored at-home use of the dexterous Modular Prosthetic Limb controlled through pattern recognition of electromyography (EMG) by an individual with a transhumeral amputation, targeted muscle reinnervation, and osseointegration (OI).Main results.Throughout the study, continuous prosthesis usage increased (1% per week,p< 0.001) and functional metrics improved up to 26% on control assessments and 76% on perceived workload evaluations. We observed increases in torque loading on the OI implant (up to 12.5% every month,p< 0.001) and prosthesis control performance (0.5% every month,p< 0.005), indicating enhanced user integration, acceptance, and proficiency. More importantly, the EMG signal magnitude necessary for prosthesis control decreased, up to 34.7% (p< 0.001), over time without degrading performance, demonstrating improved control efficiency with a machine learning-based myoelectric pattern recognition algorithm. The participant controlled the prosthesis up to one month without updating the pattern recognition algorithm. The participant customized prosthesis movements to perform specific tasks, such as individual finger control for piano playing and hand gestures for communication, which likely contributed to continued usage.Significance.This work demonstrates, in a single participant, the functional benefit of unconstrained use of a highly anthropomorphic prosthetic limb over an extended period. While hurdles remain for widespread use, including device reliability, results replication, and technical maturity beyond a prototype, this study offers insight as an example of the impact of advanced prosthesis technology for rehabilitation outside the laboratory.

Cut wires: The Electrophysiology of Regenerated Tissue

When nerves are damaged by trauma or disease, they are still capable of firing off electrical command signals that originate from the brain. Furthermore, those damaged nerves have an innate ability to partially regenerate, so they can heal from trauma and even reinnervate new muscle targets. For an amputee who has his/her damaged nerves surgically reconstructed, the electrical signals that are generated by the reinnervated muscle tissue can be sensed and interpreted with bioelectronics to control assistive devices or robotic prostheses. No two amputees will have identical physiologies because there are many surgical options for reconstructing residual limbs, which may in turn impact how well someone can interface with a robotic prosthesis later on. In this review, we aim to investigate what the literature has to say about different pathways for peripheral nerve regeneration and how each pathway can impact the neuromuscular tissue’s final electrophysiology. This information is important because it can guide us in planning the development of future bioelectronic devices, such as prosthetic limbs or neurostimulators. Future devices will primarily have to interface with tissue that has undergone some natural regeneration process, and so we have explored and reported here what is known about the bioelectrical features of neuromuscular tissue regeneration.