A-Mode Ultrasound-Based Prediction of Transfemoral Amputee Prosthesis Walking Kinematics via an Artificial Neural Network

Dual-Modal Gesture Recognition Using Adaptive Weight Hierarchical Soft Voting Mechanism

Muscle force and morphology information offer complementary perspectives for gesture recognition and its applications. Surface Electromyography (sEMG) provides force and electrophysiological information associated with muscles, while A-mode ultrasound (AUS) reveals muscle morphological information. By leveraging these two modalities, more comprehensive muscle motor unit information relevant to gesture recognition can be obtained. In this article, we introduce the adaptive weight classification (AWC) module and its enhanced version with hierarchical classifiers, adaptive weight hierarchical soft voting (AWHSV), to integrate AUS and sEMG into a fused modality. This approach dynamically adjusts the weights of individual and fused features, compensating for lost details during fusion, leading to a richer information representation and significantly improving algorithm robustness in gesture recognition. The experimental results demonstrate that the proposed method achieves recognition rates that are 0.66%, 2.36%, and 1.30% higher than those of its counterparts using sEMG, AUS, and sEMG-AUS, respectively. Moreover, the method outperforms state-of-the-art approaches, confirming its effectiveness in gesture recognition across both single and multiple modalities. This work demonstrates the advantages of the proposed AWHSV method, providing broader application scenarios for gesture recognition.

Estimation of joint torque in dynamic activities using wearable A-mode ultrasound

The human body constantly experiences mechanical loading. However, quantifying internal loads within the musculoskeletal system remains challenging, especially during unconstrained dynamic activities. Conventional measures are constrained to laboratory settings, and existing wearable approaches lack muscle specificity or validation during dynamic movement. Here, we present a strategy for estimating corresponding joint torque from muscles with different architectures during various dynamic activities using wearable A-mode ultrasound. We first introduce a method to track changes in muscle thickness using single-element ultrasonic transducers. We then estimate elbow and knee torque with errors less than 7.6% and coefficients of determination (R2) greater than 0.92 during controlled isokinetic contractions. Finally, we demonstrate wearable joint torque estimation during dynamic real-world tasks, including weightlifting, cycling, and both treadmill and outdoor locomotion. The capability to assess joint torque during unconstrained real-world activities can provide new insights into muscle function and movement biomechanics, with potential applications in injury prevention and rehabilitation.

SonoMyoNet: A Convolutional Neural Network for Predicting Isometric Force from Highly Sparse Ultrasound Images

Ultrasound imaging or sonomyography has been found to be a robust modality for measuring muscle activity due to its ability to image deep-seated muscles directly while providing superior spatiotemporal specificity compared to surface electromyography-based techniques. Quantifying the morphological changes during muscle activity involves computationally expensive approaches for tracking muscle anatomical structures or extracting features from brightness-mode (B-mode) images and amplitude-mode (A-mode) signals. This paper uses an offline regression convolutional neural network (CNN) called SonoMyoNet to estimate continuous isometric force from sparse ultrasound scanlines. SonoMyoNet learns features from a few equispaced scanlines selected from B-mode images and utilizes the learned features to estimate continuous isometric force accurately. The performance of SonoMyoNet was evaluated by varying the number of scanlines to simulate the placement of multiple single-element ultrasound transducers in a wearable system. Results showed that SonoMyoNet could accurately predict isometric force with just four scanlines and is immune to speckle noise and shifts in the scanline location. Thus, the proposed network reduces the computational load involved in feature tracking algorithms and estimates muscle force from the global features of sparse ultrasound images.

A Method to Track 3D Knee Kinematics by Multi-Channel 3D-Tracked A-Mode Ultrasound

This paper introduces a method for measuring 3D tibiofemoral kinematics using a multi-channel A-mode ultrasound system under dynamic conditions. The proposed system consists of a multi-channel A-mode ultrasound system integrated with a conventional motion capture system (i.e., optical tracking system). This approach allows for the non-invasive and non-radiative quantification of the tibiofemoral joint's six degrees of freedom (DOF). We demonstrated the feasibility and accuracy of this method in the cadaveric experiment. The knee joint's motions were mimicked by manually manipulating the leg through multiple motion cycles from flexion to extension. To measure it, six custom ultrasound holders, equipped with a total of 30 A-mode ultrasound transducers and 18 optical markers, were mounted on various anatomical regions of the lower extremity of the specimen. During experiments, 3D-tracked intra-cortical bone pins were inserted into the femur and tibia to measure the ground truth of tibiofemoral kinematics. The results were compared with the tibiofemoral kinematics derived from the proposed ultrasound system. The results showed an average rotational error of 1.51 ± 1.13° and a translational error of 3.14 ± 1.72 mm for the ultrasound-derived kinematics, compared to the ground truth. In conclusion, this multi-channel A-mode ultrasound system demonstrated a great potential of effectively measuring tibiofemoral kinematics during dynamic motions. Its improved accuracy, nature of non-invasiveness, and lack of radiation exposure make this method a promising alternative to incorporate into gait analysis and prosthetic kinematic measurements later.

A Minimal and Multi-Source Recording Setup for Ankle Joint Kinematics Estimation During Walking Using Only Proximal Information From Lower Limb

In this study, a minimal setup for the ankle joint kinematics estimation is proposed relying only on proximal information of the lower-limb, i.e. thigh muscles activity and joint kinematics. To this purpose, myoelectric activity of Rectus Femoris (RF), Biceps Femoris (BF), and Vastus Medialis (VM) were recorded by surface electromyography (sEMG) from six healthy subjects during unconstrained walking task. For each subject, the angular kinematics of hip and ankle joints were synchronously recorded with sEMG signal for a total of 288 gait cycles. Two feature sets were extracted from sEMG signals, i.e. time domain (TD) and wavelet (WT) and compared to have a compromise between the reliability and computational capacity, they were used for feeding three regression models, i.e. Artificial Neural Networks, Random Forest, and Least Squares - Support Vector Machine (LS-SVM). BF together with LS-SVM provided the best ankle angle estimation in both TD and WT domains (RMSE < 5.6 deg). The inclusion of Hip joint trajectory significantly enhanced the regression performances of the model (RMSE < 4.5 deg). Results showed the feasibility of estimating the ankle trajectory using only proximal and limited information from the lower limb which would maximize a potential transfemoral amputee user's comfortability while facing the challenge of having a small amount of information thus requiring robust data-driven models. These findings represent a significant step towards the development of a minimal setup useful for the control design of ankle active prosthetics and rehabilitative solutions.

Continuous A-Mode Ultrasound-Based Prediction of Transfemoral Amputee Prosthesis Kinematics Across Different Ambulation Tasks

OBJECTIVE

Volitional control systems for powered prostheses require the detection of user intent to operate in real life scenarios. Ambulation mode classification has been proposed to address this issue. However, these approaches introduce discrete labels to the otherwise continuous task that is ambulation. An alternative approach is to provide users with direct, voluntary control of the powered prosthesis motion. Surface electromyography (EMG) sensors have been proposed for this task, but poor signal-to-noise ratios and crosstalk from neighboring muscles limit performance. B-mode ultrasound can address some of these issues at the cost of reduced clinical viability due to the substantial increase in size, weight, and cost. Thus, there is an unmet need for a lightweight, portable neural system that can effectively detect the movement intention of individuals with lower-limb amputation.

METHODS

In this study, we show that a small and lightweight A-mode ultrasound system can continuously predict prosthesis joint kinematics in seven individuals with transfemoral amputation across different ambulation tasks. Features from the A-mode ultrasound signals were mapped to the user's prosthesis kinematics via an artificial neural network.

RESULTS

Predictions on testing ambulation circuit trials resulted in a mean normalized RMSE across different ambulation modes of 8.7 ± 3.1%, 4.6 ± 2.5%, 7.2 ± 1.8%, and 4.6 ± 2.4% for knee position, knee velocity, ankle position, and ankle velocity, respectively.

CONCLUSION AND SIGNIFICANCE

This study lays the foundation for future applications of A-mode ultrasound for volitional control of powered prostheses during a variety of daily ambulation tasks.

Volitional EMG Control Enables Stair Climbing with a Robotic Powered Knee Prosthesis

Existing controllers for robotic powered prostheses regulate the prosthesis speed, timing, and energy generation using predefined position or torque trajectories. This approach enables climbing stairs step-over-step. However, it does not provide amputees with direct volitional control of the robotic prosthesis, a functionality necessary to restore full mobility to the user. Here we show that proportional electromyographic (EMG) control of the prosthesis knee torque enables volitional control of a powered knee prosthesis during stair climbing. The proposed EMG controller continuously regulates knee torque based on activation of the residual hamstrings, measured using a single EMG electrode located within the socket. The EMG signal is mapped to a desired knee flexion/extension torque based on the prosthesis knee position, the residual limb position, and the interaction with the ground. As a result, the proposed EMG controller enabled an above-knee amputee to climb stairs at different speeds, while carrying additional loads, and even backwards. By enabling direct, volitional control of powered robotic knee prostheses, the proposed EMG controller has the potential to improve amputee mobility in the real world.