Kinematic Model-Based Pedestrian Dead Reckoning for Heading Correction and Lower Body Motion Tracking

A Method for Autonomous Multi-Motion Modes Recognition and Navigation Optimization for Indoor Pedestrian

The indoor navigation method shows great application prospects that is based on a wearable foot-mounted inertial measurement unit and a zero-velocity update principle. Traditional navigation methods mainly support two-dimensional stable motion modes such as walking; special tasks such as rescue and disaster relief, medical search and rescue, in addition to normal walking, are usually accompanied by running, going upstairs, going downstairs and other motion modes, which will greatly affect the dynamic performance of the traditional zero-velocity update algorithm. Based on a wearable multi-node inertial sensor network, this paper presents a method of multi-motion modes recognition for indoor pedestrians based on gait segmentation and a long short-term memory artificial neural network, which improves the accuracy of multi-motion modes recognition. In view of the short effective interval of zero-velocity updates in motion modes with fast speeds such as running, different zero-velocity update detection algorithms and integrated navigation methods based on change of waist/foot headings are designed. The experimental results show that the overall recognition rate of the proposed method is 96.77%, and the navigation error is 1.26% of the total distance of the proposed method, which has good application prospects.

Three-dimensional continuous gait trajectory estimation using single Shank-Worn inertial measurement units and clinical walk test application

State-of-the-art estimation methods using inertial measurement units (IMUs) for global continuous gait path and local stepwise gait trajectory during walking have been developed. However, estimation methods for continuous gait trajectory integrating both these aspects with high accuracy are almost lacking. Thus, continuous gait trajectory estimation using a single shank-worn IMU with high accuracy is proposed in this study. This method calculates three-dimensional local stepwise gait trajectory based on IMU measurement data extracted between adjacent middle points of stance phases during walking. Continuous gait trajectory is estimated by concatenating adjacent local stepwise gait trajectories based on relative angles determined according to stride vectors and shank orientations. Evaluation experiments results obtained using the optical motion capture system with 12 healthy participants demonstrated estimation errors in the stride length (− 0.027 (− 0.054 to − 0.006) m) and turning angle (0.7 (− 0.2–1.7)°), and normalized endpoint position error (0.029 (0.019–0.04) m). Comparing with previous reports, the proposed method integrally achieves a continuous gait trajectory with a low estimation error level in both local and global aspects despite the continuous measurement of multiple gait cycles. The proposed simple and low-cost method can be applied in the medical field and contribute to expansion of the application of precise gait information in daily life.

Wearable IMMU-Based Relative Position Estimation between Body Segments via Time-Varying Segment-to-Joint Vectors

In biomechanics, estimating the relative position between two body segments using inertial and magnetic measurement units (IMMUs) is important in that it enables the capture of human motion in unconstrained environments. The relative position can be estimated using the segment orientation and segment-to-joint center (S2J) vectors where the S2J vectors are predetermined as constants under the assumption of rigid body segments. However, human body segments are not rigid bodies because they are easily affected by soft tissue artifacts (STAs). Therefore, the use of the constant S2J vectors is one of the most critical factors for the inaccurate estimation of relative position. To deal with this issue, this paper proposes a method of determining time-varying S2J vectors to reflect the deformation of the S2J vectors and thus to increase the estimation accuracy, in IMMU-based relative position estimation. For the proposed method, first, reference S2J vectors for learning needed to be collected. A regression method derived a function outputting S2J vectors based on specific physical quantities that were highly correlated with the deformation of S2J vectors. Subsequently, time-varying S2J vectors were determined from the derived function. The validation results showed that, in terms of the averaged root mean squared errors of four tests performed by three subjects, the proposed method (15.08 mm) provided a higher estimation accuracy than the conventional method using constant vectors (31.32 mm). This indicates the proposed method may effectively compensate for the effects of STAs and ultimately estimate more accurate relative positions. By providing STA-compensated relative positions between segments, the proposed method applied in a wearable motion tracking system can be useful in rehabilitation or sports sciences.

Enhanced PDR-BLE Compensation Mechanism Based on HMM and AWCLA for Improving Indoor Localization

This paper presents an enhanced PDR-BLE compensation mechanism for improving indoor localization, which is considerably resilient against variant uncertainties. The proposed method of ePDR-BLE compensation mechanism (EPBCM) takes advantage of the non-requirement of linearization of the system around its current state in an unscented Kalman filter (UKF) and Kalman filter (KF) in smoothing of received signal strength indicator (RSSI) values. In this paper, a fusion of conflicting information and the activity detection approach of an object in an indoor environment contemplates varying magnitude of accelerometer values based on the hidden Markov model (HMM). On the estimated orientation, the proposed approach remunerates the inadvertent body acceleration and magnetic distortion sensor data. Moreover, EPBCM can precisely calculate the velocity and position by reducing the position drift, which gives rise to a fault in zero-velocity and heading error. The developed EPBCM localization algorithm using Bluetooth low energy beacons (BLE) was applied and analyzed in an indoor environment. The experiments conducted in an indoor scenario shows the results of various activities performed by the object and achieves better orientation estimation, zero velocity measurements, and high position accuracy than other methods in the literature.

Pedestrian Navigation Method Based on Machine Learning and Gait Feature Assistance

In recent years, as the mechanical structure of humanoid robots increasingly resembles the human form, research on pedestrian navigation technology has become of great significance for the development of humanoid robot navigation systems. To solve the problem that the wearable inertial navigation system based on micro-inertial measurement units (MIMUs) installed on feet cannot effectively realize its positioning function when the body movement is too drastic to be measured correctly by commercial grade inertial sensors, a pedestrian navigation method based on construction of a virtual inertial measurement unit (VIMU) and gait feature assistance is proposed. The inertial data from different positions of pedestrians’ lower limbs are collected synchronously via actual IMUs as training samples. The nonlinear mapping relationship between inertial information from the human foot and leg is established by a visual geometry group-long short term memory (VGG-LSTM) neural network model, based on which the foot VIMU and virtual inertial navigation system (VINS) are constructed. The VINS experimental results show that, combined with zero-velocity update (ZUPT), the integrated method of error modification proposed in this paper can effectively reduce the accumulation of positioning errors in situations where the gait type exceeds the measurement range of the inertial sensors. The positioning performance of the proposed method is more accurate and stable in complex gait types than that merely using ZUPT.

Magnetic-Map-Matching-Aided Pedestrian Navigation Using Outlier Mitigation Based on Multiple Sensors and Roughness Weighting

This research proposes an algorithm that improves the position accuracy of indoor pedestrian dead reckoning, by compensating the position error with a magnetic field map-matching technique, using multiple magnetic sensors and an outlier mitigation technique based on roughness weighting factors. Since pedestrian dead reckoning using a zero velocity update (ZUPT) does not use position measurements but zero velocity measurements in a stance phase, the position error cannot be compensated, which results in the divergence of the position error. Therefore, more accurate pedestrian dead reckoning is achievable when the position measurements are used for position error compensation. Unfortunately, the position information cannot be easily obtained for indoor navigation, unlike in outdoor navigation cases. In this paper, we propose a method to determine the position based on the magnetic field map matching by using the importance sampling method and multiple magnetic sensors. The proposed method does not simply integrate multiple sensors but uses the normalization and roughness weighting method for outlier mitigation. To implement the indoor pedestrian navigation algorithm more accurately than in existing indoor pedestrian navigation, a 15th-order error model and an importance-sampling extended Kalman filter was utilized to correct the error of the map-matching-aided pedestrian dead reckoning (MAPDR). To verify the performance of the proposed indoor MAPDR algorithm, many experiments were conducted and compared with conventional pedestrian dead reckoning. The experimental results show that the proposed magnetic field MAPDR algorithm provides clear performance improvement in all indoor environments.

Terrain Feature Estimation Method for a Lower Limb Exoskeleton Using Kinematic Analysis and Center of Pressure

While controlling a lower limb exoskeleton providing walking assistance to wearers, the walking terrain is an important factor that should be considered for meeting performance and safety requirements. Therefore, we developed a method to estimate the slope and elevation using the contact points between the limb exoskeleton and ground. We used the center of pressure as a contact point on the ground and calculated the location of the contact points on the walking terrain based on kinematic analysis of the exoskeleton. Then, a set of contact points collected from each step during walking was modeled as the plane that represents the surface of the walking terrain through the least-square method. Finally, by comparing the normal vectors of the modeled planes for each step, features of the walking terrain were estimated. We analyzed the estimation accuracy of the proposed method through experiments on level ground, stairs, and a ramp. Classification using the estimated features showed recognition accuracy higher than 95% for all experimental motions. The proposed method approximately analyzed the movement of the exoskeleton on various terrains even though no prior information on the walking terrain was provided. The method can enable exoskeleton systems to actively assist walking in various environments.

Using Step Size and Lower Limb Segment Orientation from Multiple Low-Cost Wearable Inertial/Magnetic Sensors for Pedestrian Navigation

This paper demonstrates the use of multiple low-cost inertial/magnetic sensors as a pedestrian navigation system for indoor positioning. This research looks at the problem of pedestrian navigation in a practical manner by investigating dead-reckoning methods using low-cost sensors. This work uses the estimated sensor orientation angles to compute the step size from the kinematics of a skeletal model. The orientations of limbs are represented by the tilt angles estimated from the inertial measurements, especially the pitch angle. In addition, different step size estimation methods are compared. A sensor data logging system is developed in order to record all motion data from every limb segment using a single platform and similar types of sensors. A skeletal model of five segments is chosen to model the forward kinematics of the lower limbs. A treadmill walk experiment with an optical motion capture system is conducted for algorithm evaluation. The mean error of the estimated orientation angles of the limbs is less than 6 degrees. The results show that the step length mean error is 3.2 cm, the left stride length mean error is 12.5 cm, and the right stride length mean error is 9 cm. The expected positioning error is less than 5% of the total distance travelled.

Real Time Estimation of the Pose of a Lower Limb Prosthesis from a Single Shank Mounted IMU

The command of a microprocessor-controlled lower limb prosthesis classically relies on the gait mode recognition. Real time computation of the pose of the prosthesis (i.e., attitude and trajectory) is useful for the correct identification of these modes. In this paper, we present and evaluate an algorithm for the computation of the pose of a lower limb prosthesis, under the constraints of real time applications and limited computing resources. This algorithm uses a nonlinear complementary filter with a variable gain to estimate the attitude of the shank. The trajectory is then computed from the double integration of the accelerometer data corrected from the kinematics of a model of inverted pendulum rolling on a curved arc foot. The results of the proposed algorithm are evaluated against the optoelectronic measurements of walking trials of three people with transfemoral amputation. The root mean square error (RMSE) of the estimated attitude is around 3°, close to the Kalman-based algorithm results reported in similar conditions. The real time correction of the integration of the inertial measurement unit (IMU) acceleration decreases the trajectory error by a factor of 2.5 compared to its direct integration which will result in an improvement of the gait mode recognition.

Motion-Aware Correlation Filters for Online Visual Tracking

The discriminative correlation filters-based methods struggle deal with the problem of fast motion and heavy occlusion, the problem can severely degrade the performance of trackers, ultimately leading to tracking failures. In this paper, a novel Motion-Aware Correlation Filters (MACF) framework is proposed for online visual object tracking, where a motion-aware strategy based on joint instantaneous motion estimation Kalman filters is integrated into the Discriminative Correlation Filters (DCFs). The proposed motion-aware strategy is used to predict the possible region and scale of the target in the current frame by utilizing the previous estimated 3D motion information. Obviously, this strategy can prevent model drift caused by fast motion. On the base of the predicted region and scale, the MACF detects the position and scale of the target by using the DCFs-based method in the current frame. Furthermore, an adaptive model updating strategy is proposed to address the problem of corrupted models caused by occlusions, where the learning rate is determined by the confidence of the response map. The extensive experiments on popular Object Tracking Benchmark OTB-100, OTB-50 and unmanned aerial vehicles (UAV) video have demonstrated that the proposed MACF tracker performs better than most of the state-of-the-art trackers and achieves a high real-time performance. In addition, the proposed approach can be integrated easily and flexibly into other visual tracking algorithms.

Enhanced Pedestrian Navigation Based on Course Angle Error Estimation Using Cascaded Kalman Filters

An enhanced pedestrian dead reckoning (PDR) based navigation algorithm, which uses two cascaded Kalman filters (TCKF) for the estimation of course angle and navigation errors, is proposed. The proposed algorithm uses a foot-mounted inertial measurement unit (IMU), waist-mounted magnetic sensors, and a zero velocity update (ZUPT) based inertial navigation technique with TCKF. The first stage filter estimates the course angle error of a human, which is closely related to the heading error of the IMU. In order to obtain the course measurements, the filter uses magnetic sensors and a position-trace based course angle. For preventing magnetic disturbance from contaminating the estimation, the magnetic sensors are attached to the waistband. Because the course angle error is mainly due to the heading error of the IMU, and the characteristic error of the heading angle is highly dependent on that of the course angle, the estimated course angle error is used as a measurement for estimating the heading error in the second stage filter. At the second stage, an inertial navigation system-extended Kalman filter-ZUPT (INS-EKF-ZUPT) method is adopted. As the heading error is estimated directly by using course-angle error measurements, the estimation accuracy for the heading and yaw gyro bias can be enhanced, compared with the ZUPT-only case, which eventually enhances the position accuracy more efficiently. The performance enhancements are verified via experiments, and the way-point position error for the proposed method is compared with those for the ZUPT-only case and with other cases that use ZUPT and various types of magnetic heading measurements. The results show that the position errors are reduced by a maximum of 90% compared with the conventional ZUPT based PDR algorithms.

Use of the Magnetic Field for Improving Gyroscopes' Biases Estimation

An accurate orientation is crucial to a satisfactory position in pedestrian navigation. The orientation estimation, however, is greatly affected by errors like the biases of gyroscopes. In order to minimize the error in the orientation, the biases of gyroscopes must be estimated and subtracted. In the state of the art it has been proposed, but not proved, that the estimation of the biases can be accomplished using magnetic field measurements. The objective of this work is to evaluate the effectiveness of using magnetic field measurements to estimate the biases of medium-cost micro-electromechanical sensors (MEMS) gyroscopes. We carry out the evaluation with experiments that cover both, quasi-error-free turn rate and magnetic measurements and medium-cost MEMS turn rate and magnetic measurements. The impact of different homogeneous magnetic field distributions and magnetically perturbed environments is analyzed. Additionally, the effect of the successful biases subtraction on the orientation and the estimated trajectory is detailed. Our results show that the use of magnetic field measurements is beneficial to the correct biases estimation. Further, we show that different magnetic field distributions affect differently the biases estimation process. Moreover, the biases are likewise correctly estimated under perturbed magnetic fields. However, for indoor and urban scenarios the biases estimation process is very slow.