Portable Gait Lab: Estimating 3D GRF Using a Pelvis IMU in a Foot IMU Defined Frame

Estimation of Kinetics Using IMUs to Monitor and Aid in Clinical Decision-Making during ACL Rehabilitation: A Systematic Review

After an ACL injury, rehabilitation consists of multiple phases, and progress between these phases is guided by subjective visual assessments of activities such as running, hopping, jump landing, etc. Estimation of objective kinetic measures like knee joint moments and GRF during assessment can help physiotherapists gain insights on knee loading and tailor rehabilitation protocols. Conventional methods deployed to estimate kinetics require complex, expensive systems and are limited to laboratory settings. Alternatively, multiple algorithms have been proposed in the literature to estimate kinetics from kinematics measured using only IMUs. However, the knowledge about their accuracy and generalizability for patient populations is still limited. Therefore, this article aims to identify the available algorithms for the estimation of kinetic parameters using kinematics measured only from IMUs and to evaluate their applicability in ACL rehabilitation through a comprehensive systematic review. The papers identified through the search were categorized based on the modelling techniques and kinetic parameters of interest, and subsequently compared based on the accuracies achieved and applicability for ACL patients during rehabilitation. IMUs have exhibited potential in estimating kinetic parameters with good accuracy, particularly for sagittal movements in healthy cohorts. However, several shortcomings were identified and future directions for improvement have been proposed, including extension of proposed algorithms to accommodate multiplanar movements and validation of the proposed techniques in diverse patient populations and in particular the ACL population.

Self-Supervised Learning Improves Accuracy and Data Efficiency for IMU-Based Ground Reaction Force Estimation

Objective

Recent deep learning techniques hold promise to enable IMU-driven kinetic assessment; however, they require large extents of ground reaction force (GRF) data to serve as labels for supervised model training. We thus propose using existing self-supervised learning (SSL) techniques to leverage large IMU datasets to pre-train deep learning models, which can improve the accuracy and data efficiency of IMU-based GRF estimation.

Methods

We performed SSL by masking a random portion of the input IMU data and training a transformer model to reconstruct the masked portion. We systematically compared a series of masking ratios across three pre-training datasets that included real IMU data, synthetic IMU data, or a combination of the two. Finally, we built models that used pre-training and labeled data to estimate GRF during three prediction tasks: overground walking, treadmill walking, and drop landing.

Results

When using the same amount of labeled data, SSL pre-training significantly improved the accuracy of 3-axis GRF estimation during walking compared to baseline models trained by conventional supervised learning. Fine-tuning SSL model with 1-10% of walking data yielded comparable accuracy to training baseline model with 100% of walking data. The optimal masking ratio for SSL is 6.25-12.5%.

Conclusion

SSL leveraged large real and synthetic IMU datasets to increase the accuracy and data efficiency of deep-learning-based GRF estimation, reducing the need for labeled data.

Significance

This work, with its open-source code and models, may unlock broader use cases of IMU-driven kinetic assessment by mitigating the scarcity of GRF measurements in practical applications.

Assessment of Foot Strike Angle and Forward Propulsion with Wearable Sensors in People with Stroke

Effective retraining of foot elevation and forward propulsion is a critical aspect of gait rehabilitation therapy after stroke, but valuable feedback to enhance these functions is often absent during home-based training. To enable feedback at home, this study assesses the validity of an inertial measurement unit (IMU) to measure the foot strike angle (FSA), and explores eight different kinematic parameters as potential indicators for forward propulsion. Twelve people with stroke performed walking trials while equipped with five IMUs and markers for optical motion analysis (the gold standard). The validity of the IMU-based FSA was assessed via Bland-Altman analysis, ICC, and the repeatability coefficient. Eight different kinematic parameters were compared to the forward propulsion via Pearson correlation. Analyses were performed on a stride-by-stride level and within-subject level. On a stride-by-stride level, the mean difference between the IMU-based FSA and OMCS-based FSA was 1.4 (95% confidence: -3.0; 5.9) degrees, with ICC = 0.97, and a repeatability coefficient of 5.3 degrees. The mean difference for the within-subject analysis was 1.5 (95% confidence: -1.0; 3.9) degrees, with a mean repeatability coefficient of 3.1 (SD: 2.0) degrees. Pearson's r value for all the studied parameters with forward propulsion were below 0.75 for the within-subject analysis, while on a stride-by-stride level the foot angle upon terminal contact and maximum foot angular velocity could be indicative for the peak forward propulsion. In conclusion, the FSA can accurately be assessed with an IMU on the foot in people with stroke during regular walking. However, no suitable kinematic indicator for forward propulsion was identified based on foot and shank movement that could be used for feedback in people with stroke.

A Wearable Real-time Kinematic and Kinetic Measurement Sensor Setup for Human Locomotion

Current laboratory-based setups (optical marker cameras + force plates) for human motion measurement require participants to stay in a constrained capture region which forbids rich movement types. This study established a fully wearable system, based on commercially available sensors (inertial measurement units + pressure insoles) that can measure both kinematic and kinetic motion data simultaneously and support wireless frame-by-frame streaming. In addition, its capability and accuracy were tested against a conventional laboratory-based setup. An experiment was conducted, with 9 participants wearing the wearable measurement system and performing 13 daily motion activities, from slow walking to fast running, together with vertical jump, squat, lunge and single-leg landing, inside the capture space of the laboratory-based motion capture system. The recorded sensor data were post-processed to obtain joint angles, ground reaction forces (GRFs), and joint torques (via multi-body inverse dynamics). Compared to the laboratory-based system, the established wearable measurement system can measure accurate information of all lower limb joint angles (Pearson's r = 0.929), vertical GRFs (Pearson's r = 0.954), and ankle joint torques (Pearson's r = 0.917). Center of pressure (CoP) in the anterior-posterior direction and knee joint torques were fairly matched (Pearson's r = 0.683 and 0.612, respectively). Calculated hip joint torques and measured medial-lateral CoP did not match with the laboratory-based system (Pearson's r = 0.21 and 0.47, respectively). Furthermore, both raw and processed datasets are openly accessible (https://doi.org/10.5281/zenodo.6457662). Documentation, data processing codes, and guidelines to establish the real-time wearable kinetic measurement system are also shared (https://github.com/HuaweiWang/WearableMeasurementSystem).

Estimation of ground reaction force waveforms during fixed pace running outside the laboratory

In laboratory experiments, biomechanical data collections with wearable technologies and machine learning have been promising. Despite the development of lightweight portable sensors and algorithms for the identification of gait events and estimation of kinetic waveforms, machine learning models have yet to be used to full potential. We propose the use of a Long Short Term Memory network to map inertial data to ground reaction force data gathered in a semi-uncontrolled environment. Fifteen healthy runners were recruited for this study, with varied running experience: novice to highly trained runners (<15 min 5 km race), and ages ranging from 18 to 64 years old. Force sensing insoles were used to measure normal foot-shoe forces, providing the standard for identification of gait events and measurement of kinetic waveforms. Three inertial measurement units (IMUs) were mounted to each participant, two bilaterally on the dorsal aspect of the foot and one clipped to the back of each participant's waistband, approximating their sacrum. Data input into the Long Short Term Memory network were from the three IMUs and output were estimated kinetic waveforms, compared against the standard of the force sensing insoles. The range of RMSE for each stance phase was from 0.189-0.288 BW, which is similar to multiple previous studies. Estimation of foot contact had an r ² = 0.795. Estimation of kinetic variables varied, with peak force presenting the best output with an r ² = 0.614. In conclusion, we have shown that at controlled paces over level ground a Long Short Term Memory network can estimate 4 s temporal windows of ground reaction force data across a range of running speeds.

Estimation of gait events and kinetic waveforms with wearable sensors and machine learning when running in an unconstrained environment

Wearable sensors and machine learning algorithms are becoming a viable alternative for biomechanical analysis outside of the laboratory. The purpose of this work was to estimate gait events from inertial measurement units (IMUs) and utilize machine learning for the estimation of ground reaction force (GRF) waveforms. Sixteen healthy runners were recruited for this study, with varied running experience. Force sensing insoles were used to measure normal foot-shoe forces, providing a proxy for vertical GRF and a standard for the identification of gait events. Three IMUs were mounted on each participant, two bilaterally on the dorsal aspect of each foot and one clipped to the back of each participant's waistband, approximating their sacrum. Participants also wore a GPS watch to record elevation and velocity. A Bidirectional Long Short Term Memory Network (BD-LSTM) was used to estimate GRF waveforms from inertial waveforms. Gait event estimation from both IMU data and machine learning algorithms led to accurate estimations of contact time. The GRF magnitudes were generally underestimated by the machine learning algorithm when presented with data from a novel participant, especially at faster running speeds. This work demonstrated that estimation of GRF waveforms is feasible across a range of running velocities and at different grades in an uncontrolled environment.

Peripheral-Free Calibration Method for Redundant IMUs Based on Array-Based Consumer-Grade MEMS Information Fusion

The MEMS array-based inertial navigation module (M-IMU) reduces the measurement singularities of MEMS sensors by fusing multiple data processing to improve its navigation performance. However, there are still existing random and fixed errors in M-IMU navigation. The calibration method calibrates the fixed error parameters of M-IMU to further improve navigation accuracy. In this paper, we propose a low-cost and efficient calibration method to effectively estimate the fixed error parameters of M-IMU. Firstly, we manually rotate the M-IMU in multiple sets of different attitudes (stationary), then use the LM-calibration algorithm to optimize the cost function of the corresponding sensors in different intervals of the stationary-dynamic filter separation to obtain the fixed error parameters of MEMS, and finally, the global fixed error parameters of the M-IMU are calibrated by adaptive support fusion of the individual MEMS fixed error parameters based on the benchmark conversion. A comparison of the MEMS calibrated separately by the fusion-calibration algorithm and the LM-calibration algorithm verified that the calibrated MEMS array improved the measurement accuracy by about 10 db and reduced the dispersion of the output data by about 8 db compared to the individual MEMS in a multi-dimensional test environment, indicating the robustness and feasibility of the fusion calibration algorithm.

Centroidal Moment Pivot for ambulatory estimation of relative feet and CoM movement post stroke: Portable Gait Lab. IEEE Int Conf Rehabil Robot 2022;2022:1-6. [PMID: 36176085 DOI: 10.1109/icorr55369.2022.9896526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0]

Measuring gait and balance recovery is necessary post stroke. In an earlier study, we developed a minimal three Inertial Measurement Units (IMUs) system called Portable Gait Lab (PGL). The PGL used the Centroidal Moment Pivot (CMP) assumption to estimate relative foot and centre of mass (CoM) positions, and thereby estimate gait parameters in healthy participants. In this study, we validate the feasibility of the PGL to track foot and CoM trajectory during gait in four persons with chronic stroke. Spatiotemporal gait and balance measures were estimated from the foot and CoM trajectories, and compared with the reference ForceShoes™. Each participant made at least 20 steps, and the PGL was able to track foot and CoM trajectories with a root mean square of the differences with the reference of 2.9 ± 0.2 cm and 4.6 ± 3.6 cm. The distances between either foot at the end of the walking task, and step lengths were estimated by PGL with an average error with the reference of 1.98 ± 2.2 cm and 7.8 ± 0.1 cm respectively across participants. We show that our approach was able to estimate spatiotemporal and balance parameters related to gait quality in a clinically useful manner. We recommend conducting further studies to study the feasibility of using the PGL system for variable gait patterns measured post stroke.

Cooperative ankle-exoskeleton control can reduce effort to recover balance after unexpected disturbances during walking

Background

In the last two decades, lower-limb exoskeletons have been developed to assist human standing and locomotion. One of the ongoing challenges is the cooperation between the exoskeleton balance support and the wearer control. Here we present a cooperative ankle-exoskeleton control strategy to assist in balance recovery after unexpected disturbances during walking, which is inspired on human balance responses.

Methods

We evaluated the novel controller in ten able-bodied participants wearing the ankle modules of the Symbitron exoskeleton. During walking, participants received unexpected forward pushes with different timing and magnitude at the pelvis level, while being supported (Exo-Assistance) or not (Exo-NoAssistance) by the robotic assistance provided by the controller. The effectiveness of the assistive strategy was assessed in terms of (1) controller performance (Detection Delay, Joint Angles, and Exerted Ankle Torques), (2) analysis of effort (integral of normalized Muscle Activity after perturbation onset); and (3) Analysis of center of mass COM kinematics (relative maximum COM Motion, Recovery Time and Margin of Stability) and spatio-temporal parameters (Step Length and Swing Time).

Results

In general, the results show that when the controller was active, it was able to reduce participants’ effort while keeping similar ability to counteract and withstand the balance disturbances. Significant reductions were found for soleus and gastrocnemius medialis activity of the stance leg when comparing Exo-Assistance and Exo-NoAssistance walking conditions.

Conclusions

The proposed controller was able to cooperate with the able-bodied participants in counteracting perturbations, contributing to the state-of-the-art of bio-inspired cooperative ankle exoskeleton controllers for supporting dynamic balance. In the future, this control strategy may be used in exoskeletons to support and improve balance control in users with motor disabilities.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12984-022-01000-y.

Whole Body Center of Mass Feedback in a Reflex-Based Neuromuscular Model Predicts Ankle Strategy During Perturbed Walking

Active prosthetic and orthotic devices have the potential to increase quality of life for individuals with impaired mobility. However, more research into human-like control methods is needed to create seamless interaction between device and user. In forward simulations the reflex-based neuromuscular model (RNM) by Song and Geyer shows promising similarities with real human gait in unperturbed conditions. The goal of this work was to validate and, if needed, extend the RNM to reproduce human kinematics and kinetics during walking in unperturbed and perturbed conditions. The RNM was optimized to reproduce joint torque, calculated with inverse dynamics, from kinematic and force data of unperturbed and perturbed treadmill walking of able-bodied human subjects. Torques generated by the RNM matched closely with torques found from inverse dynamics analysis on human data for unperturbed walking. However, for perturbed walking the modulation of the ankle torque in the RNM was opposite to the modulation observed in humans. Therefore, the RNM was extended with a control module that activates and inhibits muscles around the ankle of the stance leg, based on changes in whole body center of mass velocity. The added module improves the ability of the RNM to replicate human ankle torque response in response to perturbations. This reflex-based neuromuscular model with whole body center of mass velocity feedback can reproduce gait kinetics of unperturbed and perturbed gait, and as such holds promise as a basis for advanced controllers of prosthetic and orthotic devices.

Three-dimensional acceleration of the body center of mass in people with transfemoral amputation: Identification of a minimal body segment network

BACKGROUND

The analysis of biomechanical parameters derived from the body center of mass (BCoM) 3D motion allows for the characterization of gait impairments in people with lower-limb amputation, assisting in their rehabilitation. In this context, magneto-inertial measurement units are promising as they allow to measure the motion of body segments, and therefore potentially of the BCoM, directly in the field. Finding a compromise between the accuracy of computed parameters and the number of required sensors is paramount to transfer this technology in clinical routine.

RESEARCH QUESTION

Is there a reduced subset of instrumented segments (BSN) allowing a reliable and accurate estimation of the 3D BCoM acceleration transfemoral amputees?

METHODS

The contribution of each body segment to the BCoM acceleration was quantified in terms of weight and similarity in ten people with transfemoral amputation. First, body segments and BCoM accelerations were obtained using an optoelectronic system and a full-body inertial model. Based on these findings, different scenarios were explored where the use of one sensor at pelvis/trunk level and of different networks of segment-mounted sensors for the BCoM acceleration estimation was simulated and assessed against force plate-based reference acceleration.

RESULTS

Trunk, pelvis and lower-limb segments are the main contributors to the BCoM acceleration in transfemoral amputees. The trunk and shanks BSN allows for an accurate estimation of the sagittal BCoM acceleration (Normalized RMSE ≤ 13.1 %, Pearson's correlations r ≥ 0.86), while five segments are necessary when the 3D BCoM acceleration is targeted (Normalized RMSE ≤ 13.2 %, Pearson's correlations r ≥ 0.91).

SIGNIFICANCE

A network of three-to-five segments (trunk and lower limbs) allows for an accurate estimation of 2D and 3D BCoM accelerations. The use of a single pelvis- or trunk-mounted sensor does not seem advisable. Future studies should be performed to confirm these results where inertial sensor measured accelerations are considered.

Estimation of 3D Body Center of Mass Acceleration and Instantaneous Velocity from a Wearable Inertial Sensor Network in Transfemoral Amputee Gait: A Case Study

The analysis of the body center of mass (BCoM) 3D kinematics provides insights on crucial aspects of locomotion, especially in populations with gait impairment such as people with amputation. In this paper, a wearable framework based on the use of different magneto-inertial measurement unit (MIMU) networks is proposed to obtain both BCoM acceleration and velocity. The proposed framework was validated as a proof of concept in one transfemoral amputee against data from force plates (acceleration) and an optoelectronic system (acceleration and velocity). The impact in terms of estimation accuracy when using a sensor network rather than a single MIMU at trunk level was also investigated. The estimated velocity and acceleration reached a strong agreement (ρ > 0.89) and good accuracy compared to reference data (normalized root mean square error (NRMSE) < 13.7%) in the anteroposterior and vertical directions when using three MIMUs on the trunk and both shanks and in all three directions when adding MIMUs on both thighs (ρ > 0.89, NRMSE ≤ 14.0% in the mediolateral direction). Conversely, only the vertical component of the BCoM kinematics was accurately captured when considering a single MIMU. These results suggest that inertial sensor networks may represent a valid alternative to laboratory-based instruments for 3D BCoM kinematics quantification in lower-limb amputees.

Portable Gait Lab: Estimating Over-Ground 3D Ground Reaction Forces Using Only a Pelvis IMU

As an alternative to force plates, an inertial measurement unit (IMU) at the pelvis can offer an ambulatory method for measuring total center of mass (CoM) accelerations and, thereby, the ground reaction forces (GRF) during gait. The challenge here is to estimate the 3D components of the GRF. We employ a calibration procedure and an error state extended Kalman filter based on an earlier work to estimate the instantaneous 3D GRF for different over-ground walking patterns. The GRF were then expressed in a body-centric reference frame, to enable an ambulatory setup not related to a fixed global frame. The results were validated with ForceShoes^TM, and the average error in estimating instantaneous shear GRF was 5.2 ± 0.5% of body weight across different variable over-ground walking tasks. The study shows that a single pelvis IMU can measure 3D GRF in a minimal and ambulatory manner during over-ground gait.

Real-Time Vertical Ground Reaction Force Estimation in a Unified Simulation Framework Using Inertial Measurement Unit Sensors

Recent advances in computational technology have enabled the use of model-based simulation with real-time motion tracking to estimate ground reaction forces during gait. We show here that a biomechanical-based model including a foot-ground contact can reproduce measured ground reaction forces using inertial measurement unit data during single-leg support, single-support jump, side to side jump, jogging, and skipping. The framework is based on our previous work on integrating the OpenSim musculoskeletal models with the Unity environment. The validation was performed on a single subject performing several tasks that involve the lower extremity. The novelty of this paper includes the integration and real-time tracking of inertial measurement unit data in the current framework, as well as the estimation of contact forces using biologically based musculoskeletal models. The RMS errors of tracking the vertical ground reaction forces are 0.027 bodyweight, 0.174 bodyweight, 0.173 bodyweight, 0.095 bodyweight, and 0.10 bodyweight for single-leg support, single-support jump, side to side jump, jogging, and skipping, respectively. The average RMS error for all tasks and trials is 0.112 bodyweight. This paper provides a computational framework for further applications in whole-body human motion analysis.

Portable Gait Lab: Tracking Relative Distances of Feet and CoM Using Three IMUs

Ambulatory estimation of gait and balance parameters requires knowledge of relative feet and centre of mass (CoM) positions. Inertial measurement units (IMU) placed on each foot, and on the pelvis are useful in tracking these segments over time, but cannot track the relative distances between these segments. Further, drift due to strapdown inertial navigation results in erroneous relative estimates of feet and CoM positions after a few steps. In this study, we track the relative distances using the assumptions of the Centroidal Moment Pivot (CMP) theory. An Extended Kalman filter approach was used to fuse information from different sources: strapdown inertial navigation, commonly used constraints such as zero velocity updates, and relative segment distances from the CMP assumption; to eventually track relative feet and CoM positions. These estimates were expressed in a reference frame defined by the heading of each step. The validity of this approach was tested on variable gait. The step lengths and step widths were estimated with an average absolute error of 4.6±1.5 cm and 3.8±1.5 cm respectively when compared against the reference VICON^©. Additionally, we validated the relative distances of the feet and the CoM, and further, show that the approach proves useful in identifying asymmetric gait patterns. We conclude that a three IMU approach is feasible as a portable gait lab for ambulatory measurement of foot and CoM positions in daily life.