Multi-DoF continuous estimation for wrist torques using stacked autoencoder

Movement Recognition and Muscle Force Estimation of Wrist Based on Electromyographic Signals of Forearm

To enhance wrist impairment rehabilitation efficiency, self-rehabilitation training using healthy-side forearm sEMG was introduced, improving patient engagement and proprioception. A sEMG-based movement recognition and muscle force estimation algorithm was proposed to transmit the estimated results to a wrist rehabilitation robot. Dominant eigenvalues of raw forearm EMG signals were selected to construct a movement recognition model that included a BPNN, a voting decision, and an intensified algorithm. An experimental platform for muscle force estimation was established to measure sEMG under various loads. The linear fitting was performed between mean absolute values (MAVs) and external loads to derive static muscle force estimation models. A dynamic muscle force estimation model was established through linear fitting average MAVs. Volunteers wore EMG sensors and performed six typical movements to complete the verification experiment. The average accuracy of only BPNN was 90.7%, and after the addition of the voting decision and intensified algorithm, it was improved to 98.7%. In the resistance training, the measured and estimated muscle forces exhibited similar trends, with RMSE of 4.2 N for flexion/extension and 5.8 N for ulnar/radial deviation. Under two different speeds and loads, the theoretical and estimated values of dynamic muscle forces showed similar trends with almost no phase difference, and the estimation accuracy was better during flexion movements compared to radial deviations. The proposed algorithms had strong versatility and practicality, aiming to realize the self-rehabilitation trainings of patients.

Graph-Driven Simultaneous and Proportional Estimation of Wrist Angle and Grasp Force via High-Density EMG

Myoelectric prostheses are generally unable to accurately control the position and force simultaneously, prohibiting natural and intuitive human-machine interaction. This issue is attributed to the limitations of myoelectric interfaces in effectively decoding multi-degree-of-freedom (multi-DoF) kinematic and kinetic information. We thus propose a novel multi-task, spatial-temporal model driven by graphical high-density electromyography (HD-EMG) for simultaneous and proportional control of wrist angle and grasp force. Twelve subjects were recruited to perform three multi-DoF movements, including wrist pronation/supination, wrist flexion/extension, and wrist abduction/adduction while varying grasp force. Experimental results demonstrated that the proposed model outperformed five baseline models, with the normalized root mean square error of 13.2% and 9.7% and the correlation coefficient of 89.6% and 91.9% for wrist angle and grasp force estimation, respectively. In addition, the proposed model still maintained comparable accuracy even with a significant reduction in the number of HD-EMG electrodes. To the best of our knowledge, this is the first study to achieve simultaneous and proportional wrist angle and grasp force control via HD-EMG and has the potential to empower prostheses users to perform a broader range of tasks with greater precision and control, ultimately enhancing their independence and quality of life.

Continuous Motion Intention Prediction Using sEMG for Upper-Limb Rehabilitation: A Systematic Review of Model-Based and Model-Free Approaches

Upper limb functional impairments persisting after stroke significantly affect patients' quality of life. Precise adjustment of robotic assistance levels based on patients' motion intentions using sEMG signals is crucial for active rehabilitation. This paper systematically reviews studies on continuous prediction of upper limb single joints and multi-joint combinations motion intention using Model-Based (MB) and Model-Free (MF) approaches over the past decade, based on 186 relevant studies screened from six major electronic databases. The findings indicate ongoing challenges in terms of subject composition, algorithm robustness and generalization, and algorithm feasibility for practical applications. Moreover, it suggests integrating the strengths of both MB and MF approaches to improve existing algorithms. Therefore, future research should further explore personalized MB-MF combination methods incorporating deep learning, attention mechanisms, muscle synergy features, motor unit features, and closed-loop feedback to achieve precise, real-time, and long-duration prediction of multi-joint complex movements, while further refining the transfer learning strategy for rapid algorithm deployment across days and subjects. Overall, this review summarizes the current research status, significant findings, and challenges, aiming to inspire future research on predicting upper limb motion intentions based on sEMG.

Mapping Individual Motor Unit Activity to Continuous Three-DoF Wrist Torques: Perspectives for Myoelectric Control

The surface electromyography (EMG) decomposition techniques provide access to motor neuron activities and have been applied to myoelectric control schemes. However, the current decomposition-based myoelectric control mainly focuses on discrete gestures or single-DoF continuous movements. In this study, we aimed to map the motor unit discharges, which were identified from high-density surface EMG, to the three degrees of freedom (DoFs) wrist movements. The 3-DoF wrist torques and high-density surface EMG signals were recorded concurrently from eight non-disabled subjects. The experimental protocol included single-DoF movements and their various combinations. We decoded the motor unit discharges from the EMG signals using a segment-wise decomposition algorithm. Then the neural features were extracted from motor unit discharges and projected to wrist torques with a multiple linear regression model. We compared the performance of two neural features (twitch model and spike counting) and two training schemes (single-DoF and multi-DoF training). On average, 145 ± 33 motor units were identified from each subject, with a pulse-to-noise ratio of 30.8 ± 4.2 dB. Both neural features exhibited high estimation accuracy of 3-DoF wrist torques, with an average [Formula: see text] of 0.76 ± 0.12 and normalized root mean square error of 11.4 ± 3.1%. These results demonstrated the efficiency of the proposed method in continuous estimation of 3-DoF wrist torques, which has the potential to advance dexterous myoelectric control based on neural information.

Seamless and intuitive control of a powered prosthetic leg using deep neural network for transfemoral amputees

Powered prosthetic legs are becoming a promising option for amputee patients. However, developing safe, robust, and intuitive control strategies for powered legs remains one of the greatest challenges. Although a variety of control strategies have been proposed, creating and fine-tuning the system parameters is time-intensive and complicated when more activities need to be restored. In this study, we developed a deep neural network (DNN) model that facilitates seamless and intuitive gait generation and transitions across five ambulation modes: level-ground walking, ascending/descending ramps, and ascending/descending stairs. The combination of latent and time sequence features generated the desired impedance parameters within the ambulation modes and allowed seamless transitions between ambulation modes. The model was applied to the open-source bionic leg and tested on unilateral transfemoral users. It achieved the overall coefficient of determination of 0.72 with the state machine-based impedance parameters in the offline testing session. In addition, users were able to perform in-laboratory ambulation modes with an overall success rate of 96% during the online testing session. The results indicate that the DNN model is a promising candidate for subject-independent and tuning-free prosthetic leg control for transfemoral amputees.

A deep learning method to predict ankle joint moment during walking at different speeds with ultrasound imaging: A framework for assistive devices control

Robotic assistive or rehabilitative devices are promising aids for people with neurological disorders as they help regain normative functions for both upper and lower limbs. However, it remains challenging to accurately estimate human intent or residual efforts non-invasively when using these robotic devices. In this article, we propose a deep learning approach that uses a brightness mode, that is, B-mode, of ultrasound (US) imaging from skeletal muscles to predict the ankle joint net plantarflexion moment while walking. The designed structure of customized deep convolutional neural networks (CNNs) guarantees the convergence and robustness of the deep learning approach. We investigated the influence of the US imaging's region of interest (ROI) on the net plantarflexion moment prediction performance. We also compared the CNN-based moment prediction performance utilizing B-mode US and sEMG spectrum imaging with the same ROI size. Experimental results from eight young participants walking on a treadmill at multiple speeds verified an improved accuracy by using the proposed US imaging + deep learning approach for net joint moment prediction. With the same CNN structure, compared to the prediction performance by using sEMG spectrum imaging, US imaging significantly reduced the normalized prediction root mean square error by 37.55% ( < .001) and increased the prediction coefficient of determination by 20.13% ( < .001). The findings show that the US imaging + deep learning approach personalizes the assessment of human joint voluntary effort, which can be incorporated with assistive or rehabilitative devices to improve clinical performance based on the assist-as-needed control strategy.

Applications of Machine Learning in Knowledge Management System: A Comprehensive Review

As new generations of technology appear, legacy knowledge management solutions and applications become increasingly out of date, necessitating a paradigm shift. Machine learning presents an opportunity by foregoing rule-based knowledge intensive systems inundating the marketplace. An extensive review was made on the literature pertaining to machine learning which common machine learning algorithms were identified. This study has analysed more than 200 papers extracted from Scopus and IEEE databases. Searches ranged with the bulk of the articles from 2018 to 2021, while some articles ranged from 1959 to 2017. The research gap focusses on implementing machine learning algorithm to knowledge management systems, specifically knowledge management attributes. By investigating and reviewing each algorithm extensively, the usability of each algorithm is identified, with its advantages and disadvantages. From there onwards, these algorithms were mapped for what area of knowledge management it may be beneficial. Based on the findings, it is evidently seen how these algorithms are applicable in knowledge management and how it can enhance knowledge management system further. Based on the findings, the paper aims to bridge the gap between the literature in knowledge management and machine learning. A knowledge management–machine learning framework is conceived based on the review done on each algorithm earlier and to bridge the gap between the two literatures. The framework highlights how machine learning algorithm can play a part in different areas of knowledge management. From the framework, it provides practitioners how and where to implement machine learning in knowledge management.

Wrist Torque Estimation via Electromyographic Motor Unit Decomposition and Image Reconstruction

Neural interface using decomposed motor units (MUs) from surface electromyography (sEMG) has allowed non-invasive access to the neural control signals, and provided a novel approach for intuitive human-machine interaction. However, most of the existing methods based on decomposed MUs merely adopted the discharge rate (DR) as the feature representations, which may lack local information around the discharge instant and ignore the subtle interactions of different MUs. In this study, we proposed an MU-specific image-based scheme for wrist torque estimation. Specifically, the high-density sEMG signals were decoded into motor unit spike trains (MUSTs), and then MU-specific images were reconstructed with MUSTs and corresponding motor unit action potential (MUAP). A convolutional neural network was used to learn representative features from MU-specific images automatically, and further to estimate wrist torques. The results demonstrated that the proposed method outperformed three conventional and a deep-learning regression approaches using DR features, with the estimation accuracy R² of 0.82 ± 0.09, 0.89 ± 0.06, and nRMSE of 12.6 ± 2.5%, 11.0 ± 3.1% for pronation/supination and flexion/extension, respectively. Further, the analysis of the extracted features from MU-specific images showed a higher correlation than DR for recorded torques, indicating the effectiveness of the proposed method. The outcomes of this study provide a novel and promising perspective for the intuitive control of neural interfacing.

EMG Signal Filtering Based on Variational Mode Decomposition and Sub-Band Thresholding

Surface electromyography (EMG) signals are inevitably contaminated by various noise components, including powerline interference (PLI), baseline wandering (BW), and white Gaussian noise (WGN). These noises directly degrade the efficiency of EMG processing and affect the accuracy and robustness of further applications. Currently, most of the EMG filters only target one category of noise. Here, we propose a novel filter to remove all three types of noise. The noisy EMG signal is first decomposed into an ensemble of band-limited modes using variational mode decomposition (VMD). Each category of noise is located within specific modes and is separately removed in sub-bands. In particular, WGN is suppressed by soft thresholding with a noise level-dependent threshold. The denoising performance was assessed from simulated and experimental signals using three performance metrics: the root mean square error ([Formula: see text]), the improvement in signal-to-noise ratio ([Formula: see text]), and the percentage reduction in the correlation coefficient ( η). Other methods, including traditional infinite impulse response (IIR) filters, empirical mode decomposition (EMD) method, and ensemble empirical mode decomposition (EEMD) method, were examined for comparison. The proposed method achieved the best performance to remove BW or WGN. It also effectively reduced PLI noise when the signal-to-noise ratio (SNR) was low. The SNR was improved by 18.6, 19.2, and 8.0 dB for EMG signals corrupted with PLI, BW, and WGN at -6 dB SNR, respectively. The experimental results illustrated that noise was completely removed from resting states, and obvious spikes were distinguished from action states. For two of the ten subjects, the improved SNR reached 20 dB. This study explores the special characteristics of VMD and demonstrates the feasibility of using the VMD-based filter to denoise EMG signals. The proposed filter is efficient at removing three categories of noise and can be used for any application that requires EMG signal filtering at the preprocessing stage, such as gesture recognition and EMG decomposition.

Biometric From Surface Electromyogram (sEMG): Feasibility of User Verification and Identification Based on Gesture Recognition

Electrical biosignals are favored as biometric traits due to their hidden nature and allowing for liveness detection. This study explored the feasibility of surface electromyogram (sEMG), the electrical manifestation of muscle activities, as a biometric trait. The accurate gesture recognition from sEMG provided a unique advantage over two traditional electrical biosignal traits, electrocardiogram (ECG), and electroencephalogram (EEG), enabling users to customize their own gesture codes. The performance of 16 static wrist and hand gestures was systematically investigated in two identity management modes: verification and identification. The results showed that for a single fixed gesture, using only 0.8-second data, the averaged equal error rate (EER) for verification was 3.5%, and the averaged rank-1 for identification was 90.3%, both comparable to the reported performance of ECG and EEG. The function of customizing gesture code could further improve the verification performance to 1.1% EER. This work demonstrated the potential and effectiveness of sEMG as a biometric trait in user verification and identification, beneficial for the design of future biometric systems.