Indoor Positioning System Based on Chest-Mounted IMU

Wearables for persons with blindness and low vision: form factor matters

Based on statistics from the WHO and the International Agency for the Prevention of Blindness, an estimated 43.3 million people have blindness and 295 million have moderate and severe vision impairment globally as of 2020, statistics expected to increase to 61 million and 474 million respectively by 2050, staggering numbers. Blindness and low vision (BLV) stultify many activities of daily living, as sight is beneficial to most functional tasks. Assistive technologies for persons with blindness and low vision (pBLV) consist of a wide range of aids that work in some way to enhance one's functioning and support independence. Although handheld and head-mounted approaches have been primary foci when building new platforms or devices to support function and mobility, this perspective reviews potential shortcomings of these form factors or embodiments and posits that a body-centered approach may overcome many of these limitations.

Fall Recognition Based on an IMU Wearable Device and Fall Verification through a Smart Speaker and the IoT

A fall is one of the most devastating events that aging people can experience. Fall-related physical injuries, hospital admission, or even mortality among the elderly are all critical health issues. As the population continues to age worldwide, there is an imperative need to develop fall detection systems. We propose a system for the recognition and verification of falls based on a chest-worn wearable device, which can be used for elderly health institutions or home care. The wearable device utilizes a built-in three-axis accelerometer and gyroscope in the nine-axis inertial sensor to determine the user's postures, such as standing, sitting, and lying down. The resultant force was obtained by calculation with three-axis acceleration. Integration of three-axis acceleration and a three-axis gyroscope can obtain a pitch angle through the gradient descent algorithm. The height value was converted from a barometer. Integration of the pitch angle with the height value can determine the behavior state including sitting down, standing up, walking, lying down, and falling. In our study, we can clearly determine the direction of the fall. Acceleration changes during the fall can determine the force of the impact. Furthermore, with the IoT (Internet of Things) and smart speakers, we can verify whether the user has fallen by asking from smart speakers. In this study, posture determination is operated directly on the wearable device through the state machine. The ability to recognize and report a fall event in real-time can help to lessen the response time of a caregiver. The family members or care provider monitor, in real-time, the user's current posture via a mobile device app or internet webpage. All collected data supports subsequent medical evaluation and further intervention.

An Overview of Indoor Localization System for Human Activity Recognition (HAR) in Healthcare

The number of older people needing healthcare is a growing global phenomenon. The assistance in long-term care comprises a complex of medical, nursing, rehabilitation, and social assistance services. The cost is substantial, but technology can help reduce spending by ensuring efficient health services and improving the quality of life. Advances in artificial intelligence, wireless communication systems, and nanotechnology allow the creation of intelligent home care systems avoiding hospitalization with evident cost containment. They are capable of ensuring functions of recognition of activities, monitoring of vital functions, and tracking. However, it is essential to also have information on location in order to be able to promptly intervene in case of unforeseen events or assist people in carrying out activities in order to avoid incorrect behavior. In addition, the automatic detection of physical activities performed by human subjects is identified as human activity recognition (HAR). This work presents an overview of the positioning system as part of an integrated HAR system. Lastly, this study contains each technology's concepts, features, accuracy, advantages, and limitations. With this work, we want to highlight the relationship between HAR and the indoor positioning system (IPS), which is poorly documented in the literature.

Harris hawks optimization algorithm and BP neural network for ultra-wideband indoor positioning

Traditional back propagation neural networks (BPNNs) for ultrawideband (UWB) indoor localization can effectively improve localization accuracy, although there is high likelihood of becoming trapped in nearby minima. To solve this problem, the random weights and thresholds of the BPNN are optimized using the Harris Hawks optimization algorithm (HHO) to obtain the optimal global solution to enhance the UWB indoor positioning accuracy and NLOS resistance. The results show that the predicted trajectory of the HHO and BPNN hybrid algorithm (HHO-BP) matches the actual position in the two-dimensional localization scenario with four base stations; the optimized average positioning error is effectively reduced in both indoor LOS and NLOS environments. In the LOS environment, the total mean error of the traditional BPNN algorithm is 6.52 cm, which is 26.99% better than the UWB measurement error; in the NLOS environment, the total mean error of the conventional BPNN is 14.82 cm, which is 50.08% better than the UWB measurement error. The HHO-BP algorithm is further optimized on this basis, and the total mean error in the LOS environment is 4.50 cm, which is 22.57% better than the conventional BPNN algorithm; in the NLOS environment, the total mean error is 9.56 cm, which is 17.54% better than the conventional BPNN algorithm. The experimental findings suggest that the approach has greater calibration accuracy and stability than BPNN, making it a viable choice for scenarios requiring high positional precision.

Capturing Upper Body Kinematics and Localization with Low-Cost Sensors for Rehabilitation Applications

For upper extremity rehabilitation, quantitative measurements of a person’s capabilities during activities of daily living could provide useful information for therapists, including in telemedicine scenarios. Specifically, measurements of a person’s upper body kinematics could give information about which arm motions or movement features are in need of additional therapy, and their location within the home could give context to these motions. To that end, we present a new algorithm for identifying a person’s location in a region of interest based on a Bluetooth received signal strength (RSS) and present an experimental evaluation of this and a different Bluetooth RSS-based localization algorithm via fingerprinting. We further present algorithms for and experimental results of inferring the complete upper body kinematics based on three standalone inertial measurement unit (IMU) sensors mounted on the wrists and pelvis. Our experimental results for localization find the target location with a mean square error of 1.78 m. Our kinematics reconstruction algorithms gave lower errors with the pelvis sensor mounted on the person’s back and with individual calibrations for each test. With three standalone IMUs, the mean angular error for all of the upper body segment orientations was close to 21 degrees, and the estimated elbow and shoulder angles had mean errors of less than 4 degrees.

Chest-Worn Inertial Sensors: A Survey of Applications and Methods

Inertial Measurement Units (IMUs) are frequently implemented in wearable devices. Thanks to advances in signal processing and machine learning, applications of IMUs are not limited to those explicitly addressing body movements such as Activity Recognition (AR). On the other hand, wearing IMUs on the chest offers a few advantages over other body positions. AR and posture analysis, cardiopulmonary parameters estimation, voice and swallowing activity detection and other measurements can be approached through chest-worn inertial sensors. This survey tries to introduce the applications that come with the chest-worn IMUs and summarizes the existing methods, current challenges and future directions associated with them. In this regard, this paper references a total number of 57 relevant studies from the last 10 years and categorizes them into seven application areas. We discuss the inertial sensors used as well as their placement on the body and their associated validation methods based on the application categories. Our investigations show meaningful correlations among the studies within the same application categories. Then, we investigate the data processing architectures of the studies from the hardware point of view, indicating a lack of effort on handling the main processing through on-body units. Finally, we propose combining the discussed applications in a single platform, finding robust ways for artifact cancellation, and planning optimized sensing/processing architectures for them, to be taken more seriously in future research.

IMU-Based Movement Trajectory Heatmaps for Human Activity Recognition

Recent trends in ubiquitous computing have led to a proliferation of studies that focus on human activity recognition (HAR) utilizing inertial sensor data that consist of acceleration, orientation and angular velocity. However, the performances of such approaches are limited by the amount of annotated training data, especially in fields where annotating data is highly time-consuming and requires specialized professionals, such as in healthcare. In image classification, this limitation has been mitigated by powerful oversampling techniques such as data augmentation. Using this technique, this work evaluates to what extent transforming inertial sensor data into movement trajectories and into 2D heatmap images can be advantageous for HAR when data are scarce. A convolutional long short-term memory (ConvLSTM) network that incorporates spatiotemporal correlations was used to classify the heatmap images. Evaluation was carried out on Deep Inertial Poser (DIP), a known dataset composed of inertial sensor data. The results obtained suggest that for datasets with large numbers of subjects, using state-of-the-art methods remains the best alternative. However, a performance advantage was achieved for small datasets, which is usually the case in healthcare. Moreover, movement trajectories provide a visual representation of human activities, which can help researchers to better interpret and analyze motion patterns.

A Pedestrian Dead Reckoning Method for Head-Mounted Sensors

Pedestrian dead reckoning (PDR) plays an important role in modern life, including localisation and navigation if a Global Positioning System (GPS) is not available. Most previous PDR methods adopted foot-mounted sensors. However, humans have evolved to keep the head steady in space when the body is moving in order to stabilise the visual field. This indicates that sensors that are placed on the head might provide a more suitable alternative for real-world tracking. Emerging wearable technologies that are connected to the head also makes this a growing field of interest. Head-mounted equipment, such as glasses, are already ubiquitous in everyday life. Whilst other wearable gear, such as helmets, masks, or mouthguards, are becoming increasingly more common. Thus, an accurate PDR method that is specifically designed for head-mounted sensors is needed. It could have various applications in sports, emergency rescue, smart home, etc. In this paper, a new PDR method is introduced for head mounted sensors and compared to two established methods. The data were collected by sensors that were placed on glasses and embedded into a mouthguard. The results show that the newly proposed method outperforms the other two techniques in terms of accuracy, with the new method producing an average end-to-end error of 0.88 m and total distance error of 2.10%.

Magnetic Field Gradient-Based EKF for Velocity Estimation in Indoor Navigation

This paper proposes an advanced solution to improve the inertial velocity estimation of a rigid body, for indoor navigation, through implementing a magnetic field gradient-based Extended Kalman Filter (EKF). The proposed estimation scheme considers a set of data from a triad of inertial sensors (accelerometer and gyroscope), as well as a determined arrangement of magnetometers array. The inputs for the estimation scheme are the spatial derivatives of the magnetic field, from the magnetometers array, and the attitude, from the inertial sensors. As shown in the literature, there is a strong relation between the velocity and the measured magnetic field gradient. However, the latter usually suffers from high noises. Then, the novelty of the proposed EKF is to develop a specific equation to describe the dynamics of the magnetic field gradient. This contribution helps to filter, first, the magnetic field and its gradient and second, to better estimate the inertial velocity. Some numerical simulations that are based on an open source database show the targeted improvements. At the end of the paper, this approach is extended to position estimation in the case of a foot-mounted application and the results are very promising.

Grid-Based Bayesian Filtering Methods for Pedestrian Dead Reckoning Indoor Positioning Using Smartphones

Indoor positioning systems for smartphones are often based on Pedestrian Dead Reckoning, which computes the current position from the previously estimated location. Noisy sensor measurements, inaccurate step length estimations, faulty direction detections, and a demand on the real-time calculation introduce the error which is suppressed using a map model and a Bayesian filtering. The main focus of this paper is on grid-based implementations of Bayes filters as an alternative to commonly used Kalman and particle filters. Our previous work regarding grid-based filters is elaborated and enriched with convolution mask calculations. More advanced implementations, the centroid grid filter, and the advanced point-mass filter are introduced. These implementations are analyzed and compared using different configurations on the same raw sensor recordings. The evaluation is performed on three sets of experiments: a custom simple path in faculty building in Slovakia, and on datasets from IPIN competitions from a shopping mall in France, 2018 and a research institute in Italy, 2019. Evaluation results suggests that proposed methods are qualified alternatives to the particle filter. Advantages, drawbacks and proper configurations of these filters are discussed in this paper.

Reliable Identification Schemes for Asset and Production Tracking in Industry 4.0

Revolutionizing logistics and supply chain management in smart manufacturing is one of the main goals of the Industry 4.0 movement. Emerging technologies such as autonomous vehicles, Cyber-Physical Systems and digital twins enable highly automated and optimized solutions in these fields to achieve full traceability of individual products. Tracking various assets within shop-floors and the warehouse is a focal point of asset management; its aim is to enhance the efficiency of logistical tasks. Global players implement their own solutions based on the state of the art technologies. Small and medium companies, however, are still skeptic toward identification based tracking methods, because of the lack of low-cost and reliable solutions. This paper presents a novel, working, reliable, low-cost, scalable solution for asset tracking, supporting global asset management for Industry4.0. The solution uses high accuracy indoor positioning-based on Ultra-Wideband (UWB) radio technology-combined with RFID-based tracking features. Identifying assets is one of the most challenging parts of this work, so this paper focuses on how different identification approaches can be combined to facilitate an efficient and reliable identification scheme.

Improving the Heading Accuracy in Indoor Pedestrian Navigation Based on a Decision Tree and Kalman Filter

In pedestrian inertial navigation, multi-sensor fusion is often used to obtain accurate heading estimates. As a widely distributed signal source, the geomagnetic field is convenient to provide sufficiently accurate heading angles. Unfortunately, there is a broad presence of artificial magnetic perturbations in indoor environments, leading to difficulties in geomagnetic correction. In this paper, by analyzing the spatial distribution model of the magnetic interference field on the geomagnetic field, two quantitative features have been found to be crucial in distinguishing normal magnetic data from anomalies. By leveraging these two features and the classification and regression tree (CART) algorithm, we trained a decision tree that is capable of extracting magnetic data from distorted measurements. Furthermore, this well-trained decision tree can be used as a reject gate in a Kalman filter. By combining the decision tree and Kalman filter, a high-precision indoor pedestrian navigation system based on a magnetically assisted inertial system is proposed. This system is then validated in a real indoor environment, and the results show that our system delivers state-of-the-art positioning performance. Compared to other baseline algorithms, an improvement of over 70% in the positioning accuracy is achieved.

Smartphone-Based 3D Indoor Pedestrian Positioning through Multi-Modal Data Fusion

Combining research areas of biomechanics and pedestrian dead reckoning (PDR) provides a very promising way for pedestrian positioning in environments where Global Positioning System (GPS) signals are degraded or unavailable. In recent years, the PDR systems based on a smartphone’s built-in inertial sensors have attracted much attention in such environments. However, smartphone-based PDR systems are facing various challenges, especially the heading drift, which leads to the phenomenon of estimated walking path passing through walls. In this paper, the 2D PDR system is implemented by using a pocket-worn smartphone, and then enhanced by introducing a map-matching algorithm that employs a particle filter to prevent the wall-crossing problem. In addition, to extend the PDR system for 3D applications, the smartphone’s built-in barometer is used to measure the pressure variation associated to the pedestrian’s vertical displacement. Experimental results show that the map-matching algorithm based on a particle filter can effectively solve the wall-crossing problem and improve the accuracy of indoor PDR. By fusing the barometer readings, the vertical displacement can be calculated to derive the floor transition information. Despite the inherent sensor noises and complex pedestrian movements, smartphone-based 3D pedestrian positioning systems have considerable potential for indoor location-based services (LBS).

A Meta-Review of Indoor Positioning Systems

An accurate and reliable Indoor Positioning System (IPS) applicable to most indoor scenarios has been sought for many years. The number of technologies, techniques, and approaches in general used in IPS proposals is remarkable. Such diversity, coupled with the lack of strict and verifiable evaluations, leads to difficulties for appreciating the true value of most proposals. This paper provides a meta-review that performed a comprehensive compilation of 62 survey papers in the area of indoor positioning. The paper provides the reader with an introduction to IPS and the different technologies, techniques, and some methods commonly employed. The introduction is supported by consensus found in the selected surveys and referenced using them. Thus, the meta-review allows the reader to inspect the IPS current state at a glance and serve as a guide for the reader to easily find further details on each technology used in IPS. The analyses of the meta-review contributed with insights on the abundance and academic significance of published IPS proposals using the criterion of the number of citations. Moreover, 75 works are identified as relevant works in the research topic from a selection of about 4000 works cited in the analyzed surveys.

End-to-End Learning Framework for IMU-Based 6-DOF Odometry

This paper presents an end-to-end learning framework for performing 6-DOF odometry by using only inertial data obtained from a low-cost IMU. The proposed inertial odometry method allows leveraging inertial sensors that are widely available on mobile platforms for estimating their 3D trajectories. For this purpose, neural networks based on convolutional layers combined with a two-layer stacked bidirectional LSTM are explored from the following three aspects. First, two 6-DOF relative pose representations are investigated: one based on a vector in the spherical coordinate system, and the other based on both a translation vector and an unit quaternion. Second, the loss function in the network is designed with the combination of several 6-DOF pose distance metrics: mean squared error, translation mean absolute error, quaternion multiplicative error and quaternion inner product. Third, a multi-task learning framework is integrated to automatically balance the weights of multiple metrics. In the evaluation, qualitative and quantitative analyses were conducted with publicly-available inertial odometry datasets. The best combination of the relative pose representation and the loss function was the translation and quaternion together with the translation mean absolute error and quaternion multiplicative error, which obtained more accurate results with respect to state-of-the-art inertial odometry techniques.

Systematic Analysis of a Military Wearable Device Based on a Multi-Level Fusion Framework: Research Directions

With the development of the Internet of Battlefield Things (IoBT), soldiers have become key nodes of information collection and resource control on the battlefield. It has become a trend to develop wearable devices with diverse functions for the military. However, although densely deployed wearable sensors provide a platform for comprehensively monitoring the status of soldiers, wearable technology based on multi-source fusion lacks a generalized research system to highlight the advantages of heterogeneous sensor networks and information fusion. Therefore, this paper proposes a multi-level fusion framework (MLFF) based on Body Sensor Networks (BSNs) of soldiers, and describes a model of the deployment of heterogeneous sensor networks. The proposed framework covers multiple types of information at a single node, including behaviors, physiology, emotions, fatigue, environments, and locations, so as to enable Soldier-BSNs to obtain sufficient evidence, decision-making ability, and information resilience under resource constraints. In addition, we systematically discuss the problems and solutions of each unit according to the frame structure to identify research directions for the development of wearable devices for the military.