Towards Real-Time Detection of Gait Events on Different Terrains Using Time-Frequency Analysis and Peak Heuristics Algorithm

Differences in muscle coordination between older men and women during brisk walking

Brisk walking is a highly recommended physical activity for healthy community-dwelling older adults. The objective of this study was to examine through principal component analysis (PCA) how muscle coordination differs between older women and men during brisk walking. Thirty-five healthy older adults (65.2 ± 3.0 years old, 18 females, and 17 males) participated in the study. Eight surface electromyographic electrodes were used to record lower extremity muscle activities, and four inertial measurement unit sensors to monitor hip, knee, and ankle motion. Energy expenditure and heart rate were also measured during brisk walking. The effects of a person's sex on muscle coordination were identified through wavelet and PCA analysis of the sEMG signals. The results of energy expenditure and heart rate confirmed that brisk walking exercise is beneficial for older adults. PCA analysis showed that muscle coordination patterns differ between older women and men: during the stance phase a greater co-contraction of tibialis anterior and soleus in the men, and a greater activation of the quadriceps muscles during the loading-response phase in the women. The wavelet and PCA analyses facilitated a quantitative appraisal of sex-specific differences in the muscle coordination patterns of older men and women during brisk walking.

Classifying Changes in Amputee Gait following Physiotherapy Using Machine Learning and Continuous Inertial Sensor Signals

Wearable sensors allow for the objective analysis of gait and motion both in and outside the clinical setting. However, it remains a challenge to apply such systems to highly diverse patient populations, including individuals with lower-limb amputations (LLA) that present with unique gait deviations and rehabilitation goals. This paper presents the development of a novel method using continuous gyroscope data from a single inertial sensor for person-specific classification of gait changes from a physiotherapist-led gait training session. Gyroscope data at the thigh were collected using a wearable gait analysis system for five LLA before, during, and after completing a gait training session. Data from able-bodied participants receiving no intervention were also collected. Models using dynamic time warping (DTW) and Euclidean distance in combination with the nearest neighbor classifier were applied to the gyroscope data to classify the pre- and post-training gait. The model achieved an accuracy of 98.65% ± 0.69 (Euclidean) and 98.98% ± 0.83 (DTW) on pre-training and 95.45% ± 6.20 (Euclidean) and 94.18% ± 5.77 (DTW) on post-training data across the participants whose gait changed significantly during their session. This study provides preliminary evidence that continuous angular velocity data from a single gyroscope could be used to assess changes in amputee gait. This supports future research and the development of wearable gait analysis and feedback systems that are adaptable to a broad range of mobility impairments.

Co-simulation of human digital twins and wearable inertial sensors to analyse gait event estimation

We propose a co-simulation framework comprising biomechanical human body models and wearable inertial sensor models to analyse gait events dynamically, depending on inertial sensor type, sensor positioning, and processing algorithms. A total of 960 inertial sensors were virtually attached to the lower extremities of a validated biomechanical model and shoe model. Walking of hemiparetic patients was simulated using motion capture data (kinematic simulation). Accelerations and angular velocities were synthesised according to the inertial sensor models. A comprehensive error analysis of detected gait events versus reference gait events of each simulated sensor position across all segments was performed. For gait event detection, we considered 1-, 2-, and 4-phase gait models. Results of hemiparetic patients showed superior gait event estimation performance for a sensor fusion of angular velocity and acceleration data with lower nMAEs (9%) across all sensor positions compared to error estimation with acceleration data only. Depending on algorithm choice and parameterisation, gait event detection performance increased up to 65%. Our results suggest that user personalisation of IMU placement should be pursued as a first priority for gait phase detection, while sensor position variation may be a secondary adaptation target. When comparing rotatory and translatory error components per body segment, larger interquartile ranges of rotatory errors were observed for all phase models i.e., repositioning the sensor around the body segment axis was more harmful than along the limb axis for gait phase detection. The proposed co-simulation framework is suitable for evaluating different sensor modalities, as well as gait event detection algorithms for different gait phase models. The results of our analysis open a new path for utilising biomechanical human digital twins in wearable system design and performance estimation before physical device prototypes are deployed.

Design and validation of a multi-task, multi-context protocol for real-world gait simulation

BACKGROUND

Measuring mobility in daily life entails dealing with confounding factors arising from multiple sources, including pathological characteristics, patient specific walking strategies, environment/context, and purpose of the task. The primary aim of this study is to propose and validate a protocol for simulating real-world gait accounting for all these factors within a single set of observations, while ensuring minimisation of participant burden and safety.

METHODS

The protocol included eight motor tasks at varying speed, incline/steps, surface, path shape, cognitive demand, and included postures that may abruptly alter the participants' strategy of walking. It was deployed in a convenience sample of 108 participants recruited from six cohorts that included older healthy adults (HA) and participants with potentially altered mobility due to Parkinson's disease (PD), multiple sclerosis (MS), proximal femoral fracture (PFF), chronic obstructive pulmonary disease (COPD) or congestive heart failure (CHF). A novelty introduced in the protocol was the tiered approach to increase difficulty both within the same task (e.g., by allowing use of aids or armrests) and across tasks.

RESULTS

The protocol proved to be safe and feasible (all participants could complete it and no adverse events were recorded) and the addition of the more complex tasks allowed a much greater spread in walking speeds to be achieved compared to standard straight walking trials. Furthermore, it allowed a representation of a variety of daily life relevant mobility aspects and can therefore be used for the validation of monitoring devices used in real life.

CONCLUSIONS

The protocol allowed for measuring gait in a variety of pathological conditions suggests that it can also be used to detect changes in gait due to, for example, the onset or progression of a disease, or due to therapy.

TRIAL REGISTRATION

ISRCTN-12246987.

Comparison of machine learning and deep learning-based methods for locomotion mode recognition using a single inertial measurement unit

Locomotion mode recognition provides the prosthesis control with the information on when to switch between different walking modes, whereas the gait phase detection indicates where we are in the gait cycle. But powered prostheses often implement a different control strategy for each locomotion mode to improve the functionality of the prosthesis. Existing studies employed several classical machine learning methods for locomotion mode recognition. However, these methods were less effective for data with complex decision boundaries and resulted in misclassifications of motion recognition. Deep learning-based methods potentially resolve these limitations as it is a special type of machine learning method with more sophistication. Therefore, this study evaluated three deep learning-based models for locomotion mode recognition, namely recurrent neural network (RNN), long short-term memory (LSTM) neural network, and convolutional neural network (CNN), and compared the recognition performance of deep learning models to the machine learning model with random forest classifier (RFC). The models are trained from data of one inertial measurement unit (IMU) placed on the lower shanks of four able-bodied subjects to perform four walking modes, including level ground walking (LW), standing (ST), and stair ascent/stair descent (SA/SD). The results indicated that CNN and LSTM models outperformed other models, and these models were promising for applying locomotion mode recognition in real-time for robotic prostheses.

Rules-Based Real-Time Gait Event Detection Algorithm for Lower-Limb Prosthesis Users during Level-Ground and Ramp Walking

Real-time gait event detection (GED) using inertial sensors is important for applications such as remote gait assessments, intelligent assistive devices including microprocessor-based prostheses or exoskeletons, and gait training systems. GED algorithms using acceleration and/or angular velocity signals achieve reasonable performance; however, most are not suited for real-time applications involving clinical populations walking in free-living environments. The aim of this study was to develop and evaluate a real-time rules-based GED algorithm with low latency and high accuracy and sensitivity across different walking states and participant groups. The algorithm was evaluated using gait data collected from seven able-bodied (AB) and seven lower-limb prosthesis user (LLPU) participants for three walking states (level-ground walking (LGW), ramp ascent (RA), ramp descent (RD)). The performance (sensitivity and temporal error) was compared to a validated motion capture system. The overall sensitivity was 98.87% for AB and 97.05% and 93.51% for LLPU intact and prosthetic sides, respectively, across all walking states (LGW, RA, RD). The overall temporal error (in milliseconds) for both FS and FO was 10 (0, 20) for AB and 10 (0, 25) and 10 (0, 20) for the LLPU intact and prosthetic sides, respectively, across all walking states. Finally, the overall error (as a percentage of gait cycle) was 0.96 (0, 1.92) for AB and 0.83 (0, 2.08) and 0.83 (0, 1.66) for the LLPU intact and prosthetic sides, respectively, across all walking states. Compared to other studies and algorithms, the herein-developed algorithm concurrently achieves high sensitivity and low temporal error with near real-time detection of gait in both typical and clinical populations walking over a variety of terrains.

A Systematic Review of Time Series Classification Techniques Used in Biomedical Applications

Background: Digital clinical measures collected via various digital sensing technologies such as smartphones, smartwatches, wearables, and ingestible and implantable sensors are increasingly used by individuals and clinicians to capture the health outcomes or behavioral and physiological characteristics of individuals. Time series classification (TSC) is very commonly used for modeling digital clinical measures. While deep learning models for TSC are very common and powerful, there exist some fundamental challenges. This review presents the non-deep learning models that are commonly used for time series classification in biomedical applications that can achieve high performance. Objective: We performed a systematic review to characterize the techniques that are used in time series classification of digital clinical measures throughout all the stages of data processing and model building. Methods: We conducted a literature search on PubMed, as well as the Institute of Electrical and Electronics Engineers (IEEE), Web of Science, and SCOPUS databases using a range of search terms to retrieve peer-reviewed articles that report on the academic research about digital clinical measures from a five-year period between June 2016 and June 2021. We identified and categorized the research studies based on the types of classification algorithms and sensor input types. Results: We found 452 papers in total from four different databases: PubMed, IEEE, Web of Science Database, and SCOPUS. After removing duplicates and irrelevant papers, 135 articles remained for detailed review and data extraction. Among these, engineered features using time series methods that were subsequently fed into widely used machine learning classifiers were the most commonly used technique, and also most frequently achieved the best performance metrics (77 out of 135 articles). Statistical modeling (24 out of 135 articles) algorithms were the second most common and also the second-best classification technique. Conclusions: In this review paper, summaries of the time series classification models and interpretation methods for biomedical applications are summarized and categorized. While high time series classification performance has been achieved in digital clinical, physiological, or biomedical measures, no standard benchmark datasets, modeling methods, or reporting methodology exist. There is no single widely used method for time series model development or feature interpretation, however many different methods have proven successful.

Estimation of Step Length with Wearable Thigh Sensor using an Unscented Kalman Filter

The determination of step length, an important gait parameter, has been a challenging task. Although unobtrusive sensors (inertial measurement units) have been developed recently, they cannot facilitate the automatic estimation of step length. In this article, we use a model-based technique to determine the step length using the Unscented Kalman Filter with angular velocity from a gyroscope inside the thigh pocket. We then propose a novel covariance estimation algorithm based on a screening technique that performs a search for the optimal Process Noise Covariance matrix. Upon implementing the Unscented Kalman Filter, the step length is found using the horizontal position of the foot relative to the hip using a patient-independent robust peak detection algorithm. This research article paves the way for algorithms that are computationally much faster than those stated in current literature, with more scope for the development of better algorithms for covariance estimation using the one proposed in this article as a foundation.

Research on Kinematic Parameters of Multiple Gait Pattern Transitions

Gait recognition technology is the key technology in the field of exoskeletons. In the current research of gait recognition technology, there is less focus on the recognition of the transition between gait patterns. This study aims to determine which kinematic parameters have significant differences in the transitions (between level and stair walking and between level and ramp walking) of different gait patterns, to determine whether these parameters change differently in different gait pattern transitions, and the order the significant differences occur through a comparative analysis of various kinematic parameters between the transition stride and the before stride in the former pattern. We analyzed 18 parameters concerning both lower limbs and trunk. We compared each time point of the transition strides to the corresponding time points of the before stride using a series of two-sample t-tests, and we then evaluated the difference between the transition stride and the before stride based upon the number of time points within the gait cycle that were statistically different. We found that the sagittal plane angular velocity and the angular acceleration of all joints and the resultant velocity of the thigh and shank of the leading limb had significant differences in the process of transition; the sagittal plane angular velocity of all joints of the trailing limb and the velocity of the trunk in the coronary axis direction also showed a significant difference. The angular acceleration of all joints, the sagittal plane angular velocity of the ankle joint of the leading limb, and the acceleration of the trunk in the coronal axis direction showed a difference in the early stage of the transition. In general, the leading limb had a significant difference earlier than the trailing limb, and the acceleration parameters changed earlier than the velocity parameters. These parameters showed different combinations of changes in the transition of different gait patterns, and the changes in these parameters reflected different gait pattern transitions. Therefore, we believe that the results of this study can provide a reference for the gait pattern transition recognition of wearable exoskeletons.

Wearable Sensor-Based Real-Time Gait Detection: A Systematic Review

Gait analysis has traditionally been carried out in a laboratory environment using expensive equipment, but, recently, reliable, affordable, and wearable sensors have enabled integration into clinical applications as well as use during activities of daily living. Real-time gait analysis is key to the development of gait rehabilitation techniques and assistive devices such as neuroprostheses. This article presents a systematic review of wearable sensors and techniques used in real-time gait analysis, and their application to pathological gait. From four major scientific databases, we identified 1262 articles of which 113 were analyzed in full-text. We found that heel strike and toe off are the most sought-after gait events. Inertial measurement units (IMU) are the most widely used wearable sensors and the shank and foot are the preferred placements. Insole pressure sensors are the most common sensors for ground-truth validation for IMU-based gait detection. Rule-based techniques relying on threshold or peak detection are the most widely used gait detection method. The heterogeneity of evaluation criteria prevented quantitative performance comparison of all methods. Although most studies predicted that the proposed methods would work on pathological gait, less than one third were validated on such data. Clinical applications of gait detection algorithms were considered, and we recommend a combination of IMU and rule-based methods as an optimal solution.

Identification of Gait Events in Healthy Subjects and With Parkinson's Disease Using Inertial Sensors: An Adaptive Unsupervised Learning Approach

Automatic identification of gait events is an essential component of the control scheme of assistive robotic devices. Many available techniques suffer limitations for real-time implementations and in guaranteeing high performances when identifying events in subjects with gait impairments. Machine learning algorithms offer a solution by enabling the training of different models to represent the gait patterns of different subjects. Here our aim is twofold: to remove the need for training stages using unsupervised learning, and to modify the parameters according to the changes within a walking trial using adaptive procedures. We developed two adaptive unsupervised algorithms for real-time detection of four gait events, using only signals from two single-IMU foot-mounted wearable devices. We evaluated the algorithms using data collected from five healthy adults and seven subjects with Parkinson's disease (PD) walking overground and on a treadmill. Both algorithms obtained high performance in terms of accuracy ( F₁ -score ≥ 0.95 for both groups), and timing agreement using a force-sensitive resistors as reference (mean absolute differences of 66 ± 53 msec for the healthy group, and 58 ± 63 msec for the PD group). The proposed algorithms demonstrated the potential to learn optimal parameters for a particular participant and for detecting gait events without additional sensors, external labeling, or long training stages.

Finite Class Bayesian Inference System for Circle and Linear Walking Gait Event Recognition Using Inertial Measurement Units

Accurate and fast human motion pattern recognition is the key to ensuring lower limb assistive devices' appropriate assistance. The research on human motion pattern recognition of lower limb assistive devices mainly focuses on sagittal gait. The motion pattern such as circular walking (CW) is asymmetric about the sagittal plane of the body. CW is common in daily living. However, the recognition algorithm of CW is rarely reported. Since lower limb assistive devices interact with humans, lacking the capability of recognizing CW is dangerous. Thus, to realize the accurate and fast recognition of CW, this article proposed a finite class Bayesian interference system (FC-BesIS). FC-BesIS is designed to recognize walking activities (linear walking and CW) and gait events (heel contact, load response, mid stance, terminal stance, pre-swing, initial swing, mid swing, and terminal swing). A finite class method which reduces the number of potential classes according to elimination rules before decision-making is introduced. Elimination rules are designed based on likelihood estimation and sensor information. The experiments show that walking activities and gait events can be accurately and fastly recognized by FC-BesIS. The experiments also show that the performance of FC-BesIS in mean recognition accuracy (MRA) and mean decision time (MDT) is improved compared with BesIS. The MRA of walking activities and gait events are 100% and 97.38%, respectively. The MDT of walking activities and gait events are 28.19 ms and 33.94 ms, respectively. Overall, FC-BesIS has been proved to be an accurate and fast recognition algorithm for human motion patterns using wearable sensors.

Derivative Based Gait Event Detection Algorithm Using Unfiltered Accelerometer Signals

Wearable sensors have been investigated for the purpose of gait analysis, namely gait event detection. Many types of algorithms have been developed specifically using inertial sensor data for detecting gait events. Though much attention has turned toward machine learning algorithms, most of these approaches suffer from large computational requirements and are not yet suitable for real-time applications such as in prostheses or for feedback control. Current rules-based algorithms for real-time use often require fusion of multiple sensor signals to achieve high accuracy, thus increasing complexity and decreasing usability of the instrument. We present our results of a novel, rules-based algorithm using a single accelerometer signal from the foot to reliably detect heel-strike and toe-off events. Using the derivative of the raw accelerometer signal and applying an optimizer and windowing approach, high performance was achieved with a sensitivity and specificity of 94.32% and 94.70% respectively, and a timing error of 6.52 ± 22.37 ms, including trials involving multiple speed transitions. This would enable development of a compact wearable system for robust gait analysis in real-world settings, providing key insights into gait quality with the capability for real-time system control.

A Review of Gait Phase Detection Algorithms for Lower Limb Prostheses

Fast and accurate gait phase detection is essential to achieve effective powered lower-limb prostheses and exoskeletons. As the versatility but also the complexity of these robotic devices increases, the research on how to make gait detection algorithms more performant and their sensing devices smaller and more wearable gains interest. A functional gait detection algorithm will improve the precision, stability, and safety of prostheses, and other rehabilitation devices. In the past years the state-of-the-art has advanced significantly in terms of sensors, signal processing, and gait detection algorithms. In this review, we investigate studies and developments in the field of gait event detection methods, more precisely applied to prosthetic devices. We compared advantages and limitations between all the proposed methods and extracted the relevant questions and recommendations about gait detection methods for future developments.

A Determination Method for Gait Event Based on Acceleration Sensors

A gait event is a crucial step towards the effective assessment and rehabilitation of motor dysfunctions. However, for the data acquisition of a three-dimensional motion capture (3D Mo-Cap) system, the high cost of setups, such as the high standard laboratory environment, limits widespread clinical application. Inertial sensors are increasingly being used to recognize and classify physical activities in a variety of applications. Inertial sensors are now sufficiently small in size and light in weight to be part of a body sensor network for the collection of human gait data. The acceleration signal has found important applications in human gait recognition. In this paper, using the experimental data from the heel and toe, first the wavelet method was used to remove noise from the acceleration signal, then, based on the threshold of comprehensive change rate of the acceleration signal, the signal was primarily segmented. Subsequently, the vertical acceleration signals, from heel and toe, were integrated twice, to compute their respective vertical displacement. Four gait events were determined in the segmented signal, based on the characteristics of the vertical displacement of heel and toe. The results indicated that the gait events were consistent with the synchronous record of the motion capture system. The method has achieved gait event subdivision, while it has also ensured the accuracy of the defined gait events. The work acts as a valuable reference, to further study gait recognition.

Appropriate Mother Wavelets for Continuous Gait Event Detection Based on Time-Frequency Analysis for Hemiplegic and Healthy Individuals

Gait event detection is a crucial step towards the effective assessment and rehabilitation of motor dysfunctions. Recently, the continuous wavelet transform (CWT) based methods have been increasingly proposed for gait event detection due to their robustness. However, few investigations on determining the appropriate mother wavelet with proper selection criteria have been performed, especially for hemiplegic patients. In this study, the performances of commonly used mother wavelets in detecting gait events were systematically investigated. The acceleration signals from the tibialis anterior muscle of both healthy and hemiplegic subjects were recorded during ground walking and the two core gait events of heel strike (HS) and toe off (TO) were detected from the signal recordings by a CWT algorithm with different mother wavelets. Our results showed that the overall performance of the CWT algorithm in detecting the two gait events was significantly different when using various mother wavelets. By using different wavelet selection criteria, we also found that the accuracy criteria based on time-error minimization and F1-score maximization could provide the appropriate mother wavelet for gait event detection. The findings from this study will provide an insight on the selection of an appropriate mother wavelet for gait event detection and facilitate the development of adequate rehabilitation aids.

ED-FNN: A New Deep Learning Algorithm to Detect Percentage of the Gait Cycle for Powered Prostheses

Throughout the last decade, a whole new generation of powered transtibial prostheses and exoskeletons has been developed. However, these technologies are limited by a gait phase detection which controls the wearable device as a function of the activities of the wearer. Consequently, gait phase detection is considered to be of great importance, as achieving high detection accuracy will produce a more precise, stable, and safe rehabilitation device. In this paper, we propose a novel gait percent detection algorithm that can predict a full gait cycle discretised within a 1% interval. We called this algorithm an exponentially delayed fully connected neural network (ED-FNN). A dataset was obtained from seven healthy subjects that performed daily walking activities on the flat ground and a 15-degree slope. The signals were taken from only one inertial measurement unit (IMU) attached to the lower shank. The dataset was divided into training and validation datasets for every subject, and the mean square error (MSE) error between the model prediction and the real percentage of the gait was computed. An average MSE of 0.00522 was obtained for every subject in both training and validation sets, and an average MSE of 0.006 for the training set and 0.0116 for the validation set was obtained when combining all subjects' signals together. Although our experiments were conducted in an offline setting, due to the forecasting capabilities of the ED-FNN, our system provides an opportunity to eliminate detection delays for real-time applications.

A Novel Detection Model and Its Optimal Features to Classify Falls from Low- and High-Acceleration Activities of Daily Life Using an Insole Sensor System

In order to overcome the current limitations in current threshold-based and machine learning-based fall detectors, an insole system and novel fall classification model were created. Because high-acceleration activities have a high risk for falls, and because of the potential damage that is associated with falls during high-acceleration activities, four low-acceleration activities, four high-acceleration activities, and eight types of high-acceleration falls were performed by twenty young male subjects. Encompassing a total of 800 falls and 320 min of activities of daily life (ADLs), the created Support Vector Machine model’s Leave-One-Out cross-validation provides a fall detection sensitivity (0.996), specificity (1.000), and accuracy (0.999). These classification results are similar or superior to other fall detection models in the literature, while also including high-acceleration ADLs to challenge the classification model, and simultaneously reducing the burden that is associated with wearable sensors and increasing user comfort by inserting the insole system into the shoe.

A Review on Accelerometry-Based Gait Analysis and Emerging Clinical Applications

Gait analysis continues to be an important technique for many clinical applications to diagnose and monitor certain diseases. Many mental and physical abnormalities cause measurable differences in a person's gait. Gait analysis has applications in sport, computer games, physical rehabilitation, clinical assessment, surveillance, human recognition, modeling, and many other fields. There are established methods using various sensors for gait analysis, of which accelerometers are one of the most often employed. Accelerometer sensors are generally more user friendly and less invasive. In this paper, we review research regarding accelerometer sensors used for gait analysis with particular focus on clinical applications. We provide a brief introduction to accelerometer theory followed by other popular sensing technologies. Commonly used gait phases and parameters are enumerated. The details of selecting the papers for review are provided. We also review several gait analysis software. Then we provide an extensive report of accelerometry-based gait analysis systems and applications, with additional emphasis on trunk accelerometry. We conclude this review with future research directions.