A Wearable Wireless Armband Sensor for High-Density Surface Electromyography Recording

Intuitive real-time control strategy for high-density myoelectric hand prosthesis using deep and transfer learning

Myoelectric hand prostheses offer a way for upper-limb amputees to recover gesture and prehensile abilities to ease rehabilitation and daily life activities. However, studies with prosthesis users found that a lack of intuitiveness and ease-of-use in the human-machine control interface are among the main driving factors in the low user acceptance of these devices. This paper proposes a highly intuitive, responsive and reliable real-time myoelectric hand prosthesis control strategy with an emphasis on the demonstration and report of real-time evaluation metrics. The presented solution leverages surface high-density electromyography (HD-EMG) and a convolutional neural network (CNN) to adapt itself to each unique user and his/her specific voluntary muscle contraction patterns. Furthermore, a transfer learning approach is presented to drastically reduce the training time and allow for easy installation and calibration processes. The CNN-based gesture recognition system was evaluated in real-time with a group of 12 able-bodied users. A real-time test for 6 classes/grip modes resulted in mean and median positive predictive values (PPV) of 93.43% and 100%, respectively. Each gesture state is instantly accessible from any other state, with no mode switching required for increased responsiveness and natural seamless control. The system is able to output a correct prediction within less than 116 ms latency. 100% PPV has been attained in many trials and is realistically achievable consistently with user practice and/or employing a thresholded majority vote inference. Using transfer learning, these results are achievable after a sensor installation, data recording and network training/fine-tuning routine taking less than 10 min to complete, a reduction of 89.4% in the setup time of the traditional, non-transfer learning approach.

Forearm High-Density Electromyography Data Visualization and Classification with Machine Learning for Hand Prosthesis Control

Electromyography offers a way to interface an amputee's resilient muscles to control a bionic prosthesis. While myoelectric prostheses are promising, user acceptance of these devices remain low due to a lack of intuitiveness and ease-of-use. Using a low-cost wearable flexible electrodes array, the proposed system leverages high-density surface electromyography (HD-EMG) and deep learning techniques to classify forearm muscle contractions. These techniques allow for increased intuitiveness and ease-of-use of a myoelectric control scheme with a single easy-to-install electrodes apparatus. This paper proposes a flexible electrodes array construction using standard printed circuit board manufacturing processes for low-cost and quick design-to-production cycles. HD-EMG dataset visualization with t-distributed Stochastic Neighbor Embedding (t-SNE) is introduced, and offline classification results of the wearable gesture recognition system for hand prosthesis control are validated on a group of 8 able-bodied subjects. Using a majority vote on 5 successive inferences, a median recognition accuracy of 98.61 % was obtained across the group for an 8 gestures set. For a 6 gestures set containing commonly used prosthesis positions, the median accuracy reached 99.57 % with the majority vote.

Design of a Flexible High-Density Surface Electromyography Sensor

In recent years, high-density surface electromyography (HD-sEMG) has shown promising advantages in many robotics applications. Using HD-sEMG can not only reduce the sensitivity of the sensor position on the muscle belly but can also facilitate the acquisition of more muscle activity information due to spatial sampling. As current commercial HD-EMG systems use stationary amplifiers, leading to bulky measurements and poor portability, the interest in developing an HD-EMG sensor has increased. However, the insufficient electrode density and complicated fabrication process are challenges to overcome. In this paper, we propose a flexible HD-EMG sensor with an on-board amplifier capable of a density level of 0.53 channel/cm², higher than those in previous works. First, we investigated the effects of different sensor parameters (i.e., the electrode material, the inter-electrode distance (IED) and the size of the electrode) on the measured signal quality. Second, a low-cost, easily fabricated, easily customized HD-EMG fabrication method was proposed based on the selected sensor parameters with a signal-to-noise ratio (SNR) comparable to those of commercial sensors. Finally, we applied a muscle activation estimation algorithm to validate the feasibility of the designed HD-EMG sensor, showing higher estimation accuracy levels. The results here demonstrate that the designed HD-EMG sensor can be used as an effective human-machine interface for robotics applications.

A Fully Embedded Adaptive Real-Time Hand Gesture Classifier Leveraging HD-sEMG and Deep Learning

This paper presents a real-time fine gesture recognition system for multi-articulating hand prosthesis control, using an embedded convolutional neural network (CNN) to classify hand-muscle contractions sensed at the forearm. The sensor consists in a custom non-intrusive, compact, and easy-to-install 32-channel high-density surface electromyography (HDsEMG) electrode array, built on a flexible printed circuit board (PCB) to allow wrapping around the forearm. The sensor provides a low-noise digitization interface with wireless data transmission through an industrial, scientific and medical (ISM) radio link. An original frequency-time-space cross-domain preprocessing method is proposed to enhance gesture-specific data homogeneity and generate reliable muscle activation maps, leading to 98.15% accuracy when using a majority vote over 5 subsequent inferences by the proposed CNN. The obtained real-time gesture recognition, within 100 to 200 ms, and CNN properties show reliable and promising results to improve on the state-of-the-art of commercial hand prostheses. Moreover, edge computing using a specialized embedded artificial intelligence (AI) platform ensures reliable, secure and low latency real-time operation as well as quick and easy access to training, fine-tuning and calibration of the neural network. Co-design of the signal processing, AI algorithms and sensing hardware ensures a reliable and power-efficient embedded gesture recognition system.