Enhanced Algorithm for the Detection of Preimpact Fall for Wearable Airbags

A dynamic spatiotemporal model for fall warning and protection

Early detection of falls is important for reducing fall injuries. However, existing fall detection strategies mostly focus on reducing impact injuries rather than avoiding falls. This study proposed the concept of identifying "Imbalance Point" to warn the body imbalance, allowing sufficient time to recover balance. And if falling cannot be avoided, an impact sign is released by detecting the "Fall Point" prior to the impact. To achieve this goal, motion prediction model and balance recovery model are integrated into a spatiotemporal framework to analyze dynamic and kinematic features of body motion. Eight healthy young volunteers participated in three sets of experiment: Normal trial, Recovery trial and Fall trial. The body motion in the trials was recorded using Microsoft Azure Kinect. The results show that the developed algorithm for Fall Point detection achieved 100% sensitivity and 98.6% specificity, along with an average lead time of 297 ms. Moreover, Imbalance Point was successfully detected in all Fall trials, and the average time interval between Imbalance Point and Fall Point was 315 ms, longer than reported step reaction time for elderly (approximately 270 ms). The experiment results demonstrate that the developed algorithm have great potential for fall warning and protection in the elderly.

Fall-from-Height Detection Using Deep Learning Based on IMU Sensor Data for Accident Prevention at Construction Sites

Workers at construction sites are prone to fall-from-height (FFH) accidents. The severity of injury can be represented by the acceleration peak value. In the study, a risk prediction against FFH was made using IMU sensor data for accident prevention at construction sites. Fifteen general working movements (NF: non-fall), five low-hazard-fall movements, (LF), and five high-hazard-FFH movements (HF) were performed by twenty male subjects and a dummy. An IMU sensor was attached to the T7 position of the subject to measure the three-axis acceleration and angular velocity. The peak acceleration value, calculated from the IMU data, was 4 g or less in general work movements and 9 g or more in FFHs. Regression analysis was performed by applying various deep learning models, including 1D-CNN, 2D-CNN, LSTM, and Conv-LSTM, to the risk prediction, and then comparing them in terms of their mean absolute error (MAE) and mean squared error (MSE). The FFH risk level was estimated based on the predicted peak acceleration. The Conv-LSTM model trained by MAE showed the smallest error (MAE: 1.36 g), and the classification with the predicted peak acceleration showed the best accuracy (97.6%). This study successfully predicted the FFH risk levels and could be helpful to reduce fatal injuries at construction sites.

A Large-Scale Open Motion Dataset (KFall) and Benchmark Algorithms for Detecting Pre-impact Fall of the Elderly Using Wearable Inertial Sensors

Research on pre-impact fall detection with wearable inertial sensors (detecting fall accidents prior to body-ground impacts) has grown rapidly in the past decade due to its great potential for developing an on-demand fall-related injury prevention system. However, most researchers use their own datasets to develop fall detection algorithms and rarely make these datasets publicly available, which poses a challenge to fairly evaluate the performance of different algorithms on a common basis. Even though some open datasets have been established recently, most of them are impractical for pre-impact fall detection due to the lack of temporal labels for fall time and limited types of motions. In order to overcome these limitations, in this study, we proposed and publicly provided a large-scale motion dataset called “KFall,” which was developed from 32 Korean participants while wearing an inertial sensor on the low back and performing 21 types of activities of daily living and 15 types of simulated falls. In addition, ready-to-use temporal labels of the fall time based on synchronized motion videos were published along with the dataset. Those enhancements make KFall the first public dataset suitable for pre-impact fall detection, not just for post-fall detection. Importantly, we have also developed three different types of latest algorithms (threshold based, support-vector machine, and deep learning), using the KFall dataset for pre-impact fall detection so that researchers and practitioners can flexibly choose the corresponding algorithm. Deep learning algorithm achieved both high overall accuracy and balanced sensitivity (99.32%) and specificity (99.01%) for pre-impact fall detection. Support vector machine also demonstrated a good performance with a sensitivity of 99.77% and specificity of 94.87%. However, the threshold-based algorithm showed relatively poor results, especially the specificity (83.43%) was much lower than the sensitivity (95.50%). The performance of these algorithms could be regarded as a benchmark for further development of better algorithms with this new dataset. This large-scale motion dataset and benchmark algorithms could provide researchers and practitioners with valuable data and references to develop new technologies and strategies for pre-impact fall detection and proactive injury prevention for the elderly.

The Performance of Post-Fall Detection Using the Cross-Dataset: Feature Vectors, Classifiers and Processing Conditions

In this study, algorithms to detect post-falls were evaluated using the cross-dataset according to feature vectors (time-series and discrete data), classifiers (ANN and SVM), and four different processing conditions (normalization, equalization, increase in the number of training data, and additional training with external data). Three-axis acceleration and angular velocity data were obtained from 30 healthy male subjects by attaching an IMU to the middle of the left and right anterior superior iliac spines (ASIS). Internal and external tests were performed using our lab dataset and SisFall public dataset, respectively. The results showed that ANN and SVM were suitable for the time-series and discrete data, respectively. The classification performance generally decreased, and thus, specific feature vectors from the raw data were necessary when untrained motions were tested using a public dataset. Normalization made SVM and ANN more and less effective, respectively. Equalization increased the sensitivity, even though it did not improve the overall performance. The increase in the number of training data also improved the classification performance. Machine learning was vulnerable to untrained motions, and data of various movements were needed for the training.

Detection of Pre-Impact Falls from Heights Using an Inertial Measurement Unit Sensor

Many safety accidents can occur in industrial sites. Among them, falls from heights (FFHs) are the most frequent accidents and have the highest fatality rate. Therefore, some existing studies have developed personal wearable airbags to mitigate the damage caused by FFHs. To utilize these airbags effectively, it is essential to detect FFHs before collision with the floor. In this study, an inertial measurement unit (IMU) sensor attached to the seventh thoracic vertebrae (T7) was used to develop an FFH detection algorithm. The vertical angle and vertical velocity were calculated using the inertial data obtained from the IMU sensor. Forty young and healthy males were recruited to perform non-FFH and FFH motions. In addition, experiments using a human mannequin and dynamics simulations were performed to obtain FFH data at heights above 2 m. The developed algorithm achieved 100% FFH detection accuracy and provided sufficient lead time such that the airbags could be inflated completely before collision with the floor.

Pre-Impact Fall Detection with CNN-Based Class Activation Mapping Method

In this paper, we report our improvement on the prediction accuracy of pre-impact fall detection by applying a learning-based method on the real-time data from an IMU (inertial measurement unit)-sensor mounted on the waist, making it possible to achieve a high accuracy on a wearable device with the extracted features. Using the fixed threshold method is difficult for achieving satisfactory detection accuracy, due to various characteristics and behaviors in the movement of different individuals. In contrast, one could realize high-accuracy detection with machine learning-based methods, but it is difficult to apply them in the wearable devices due to the high hardware requirement. Our method merges the two methods above. We build a convolutional neural network (CNN) with a class activation mapping (CAM) method, which could highlight the class-specific region in the data and obtain a hot map of the fall data. After training on the MobiAct dataset, the model could achieve high-accuracy detection (95.55%) and obtain the region with high contributions to the classification. Then, we manually extract effective features and characteristics of this region and form our special threshold method, achieving pre-impact fall detection in real-world data. Consequently, our method achieves accuracy of 95.33% and a detection time of within 400 ms.