Recalibration of myoelectric control with active learning

Screen Guided Training Does Not Capture Goal-Oriented Behaviours: Learning Myoelectric Control Mappings From Scratch Using Context Informed Incremental Learning

Human-machine interfaces based on myoelectric signals typically use screen-guided training (SGT) for model calibration, but this approach fails to capture realistic user behaviors. This study evaluates a user-in-the-loop context-informed incremental learning (CIIL) framework, comparing SGT, SGT followed by CIIL adaptation (SGT-A), and a novel zero-shot adaptation (ZS-A) CIIL approach that begins adapting with no prior training. Sixteen participants completed a Fitts' Law targeting task using these control schemes, with performance measured via online throughput and offline classification accuracy. Despite lower offline accuracy, the ZS-A model achieved the highest online throughput (1.47 ± 0.46 bits/s), significantly outperforming the SGT baseline (1.15 ± 0.37 bits/s) and reached competitive performance within 200 seconds. To further enhance control performance, a novel adaptive sigmoid-based proportional control mapping was introduced, dynamically adjusting control signals to allow precise control near neutral positions and rapid movements at higher activation levels, better aligning with natural user behaviors. These findings demonstrate that CIIL can surpass traditional SGT methods in online performance and emphasize the value of real-time user-in-the-loop data for developing adaptable and intuitive myoelectric interfaces, with implications for prosthetics, rehabilitation, and telerobotics.

Big data in myoelectric control: large multi-user models enable robust zero-shot EMG-based discrete gesture recognition

Myoelectric control, the use of electromyogram (EMG) signals generated during muscle contractions to control a system or device, is a promising input, enabling always-available control for emerging ubiquitous computing applications. However, its widespread use has historically been limited by the need for user-specific machine learning models because of behavioural and physiological differences between users. Leveraging the publicly available 612-user EMG-EPN612 dataset, this work dispels this notion, showing that true zero-shot cross-user myoelectric control is achievable without user-specific training. By taking a discrete approach to classification (i.e., recognizing the entire dynamic gesture as a single event), a classification accuracy of 93.0% for six gestures was achieved on a set of 306 unseen users, showing that big data approaches can enable robust cross-user myoelectric control. By organizing the results into a series of mini-studies, this work provides an in-depth analysis of discrete cross-user models to answer unknown questions and uncover new research directions. In particular, this work explores the number of participants required to build cross-user models, the impact of transfer learning for fine-tuning these models, and the effects of under-represented end-user demographics in the training data, among other issues. Additionally, in order to further evaluate the performance of the developed cross-user models, a completely new dataset was created (using the same recording device) that includes known covariate factors such as cross-day use and limb-position variability. The results show that the large data models can effectively generalize to new datasets and mitigate the impact of common confounding factors that have historically limited the adoption of EMG-based inputs.

Digital Sensing Systems for Electromyography

Surface electromyogram (EMG) signals find diverse applications in movement rehabilitation and human-computer interfacing. For instance, future advanced prostheses, which use artificial intelligence, will require EMG signals recorded from several sites on the forearm. This requirement will entail complex wiring and data handling. We present the design and evaluation of a bespoke EMG sensing system that addresses the above challenges, enables distributed signal processing, and balances local versus global power consumption. Additionally, the proposed EMG system enables the recording and simultaneous analysis of skin-sensor impedance, needed to ensure signal fidelity. We evaluated the proposed sensing system in three experiments, namely, monitoring muscle fatigue, real-time skin-sensor impedance measurement, and control of a myoelectric computer interface. The proposed system offers comparable signal acquisition characteristics to that achieved by a clinically-approved product. It will serve and integrate future myoelectric technology better via enabling distributed machine learning and improving the signal transmission efficiency.

Context-informed incremental learning improves both the performance and resilience of myoelectric control

Despite its rich history of success in controlling powered prostheses and emerging commercial interests in ubiquitous computing, myoelectric control continues to suffer from a lack of robustness. In particular, EMG-based systems often degrade over prolonged use resulting in tedious recalibration sessions, user frustration, and device abandonment. Unsupervised adaptation is one proposed solution that updates a model's parameters over time based on its own predictions during real-time use to maintain robustness without requiring additional user input or dedicated recalibration. However, these strategies can actually accelerate performance deterioration when they begin to classify (and thus adapt) incorrectly, defeating their own purpose. To overcome these limitations, we propose a novel adaptive learning strategy, Context-Informed Incremental Learning (CIIL), that leverages in situ context to better inform the prediction of pseudo-labels. In this work, we evaluate these CIIL strategies in an online target acquisition task for two use cases: (1) when there is a lack of training data and (2) when a drastic and enduring alteration in the input space has occurred. A total of 32 participants were evaluated across the two experiments. The results show that the CIIL strategies significantly outperform the current state-of-the-art unsupervised high-confidence adaptation and outperform models trained with the conventional screen-guided training approach, even after a 45-degree electrode shift (p < 0.05). Consequently, CIIL has substantial implications for the future of myoelectric control, potentially reducing the training burden while bolstering model robustness, and leading to improved real-time control.

One-shot random forest model calibration for hand gesture decoding

Objective.Most existing machine learning models for myoelectric control require a large amount of data to learn user-specific characteristics of the electromyographic (EMG) signals, which is burdensome. Our objective is to develop an approach to enable the calibration of a pre-trained model with minimal data from a new myoelectric user.Approach.We trained a random forest (RF) model with EMG data from 20 people collected during the performance of multiple hand grips. To adapt the decision rules for a new user, first, the branches of the pre-trained decision trees were pruned using the validation data from the new user. Then new decision trees trained merely with data from the new user were appended to the pruned pre-trained model.Results.Real-time myoelectric experiments with 18 participants over two days demonstrated the improved accuracy of the proposed approach when compared to benchmark user-specific RF and the linear discriminant analysis models. Furthermore, the RF model that was calibrated on day one for a new participant yielded significantly higher accuracy on day two, when compared to the benchmark approaches, which reflects the robustness of the proposed approach.Significance.The proposed model calibration procedure is completely source-free, that is, once the base model is pre-trained, no access to the source data from the original 20 people is required. Our work promotes the use of efficient, explainable, and simple models for myoelectric control.