1
|
Hollinger D, Schall MC, Chen H, Zabala M. The Effect of Sensor Feature Inputs on Joint Angle Prediction across Simple Movements. SENSORS (BASEL, SWITZERLAND) 2024; 24:3657. [PMID: 38894447 PMCID: PMC11175352 DOI: 10.3390/s24113657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/08/2024] [Revised: 05/31/2024] [Accepted: 06/03/2024] [Indexed: 06/21/2024]
Abstract
The use of wearable sensors, such as inertial measurement units (IMUs), and machine learning for human intent recognition in health-related areas has grown considerably. However, there is limited research exploring how IMU quantity and placement affect human movement intent prediction (HMIP) at the joint level. The objective of this study was to analyze various combinations of IMU input signals to maximize the machine learning prediction accuracy for multiple simple movements. We trained a Random Forest algorithm to predict future joint angles across these movements using various sensor features. We hypothesized that joint angle prediction accuracy would increase with the addition of IMUs attached to adjacent body segments and that non-adjacent IMUs would not increase the prediction accuracy. The results indicated that the addition of adjacent IMUs to current joint angle inputs did not significantly increase the prediction accuracy (RMSE of 1.92° vs. 3.32° at the ankle, 8.78° vs. 12.54° at the knee, and 5.48° vs. 9.67° at the hip). Additionally, including non-adjacent IMUs did not increase the prediction accuracy (RMSE of 5.35° vs. 5.55° at the ankle, 20.29° vs. 20.71° at the knee, and 14.86° vs. 13.55° at the hip). These results demonstrated how future joint angle prediction during simple movements did not improve with the addition of IMUs alongside current joint angle inputs.
Collapse
Affiliation(s)
- David Hollinger
- Department of Mechanical Engineering, Auburn University, Auburn, AL 36849, USA; (D.H.); (M.Z.)
| | - Mark C. Schall
- Department of Industrial & Systems Engineering, Auburn University, Auburn, AL 36849, USA
| | - Howard Chen
- Department of Industrial & Systems Engineering and Engineering Management, University of Alabama-Huntsville, Huntsville, AL 35899, USA;
| | - Michael Zabala
- Department of Mechanical Engineering, Auburn University, Auburn, AL 36849, USA; (D.H.); (M.Z.)
| |
Collapse
|
2
|
A Survey of IoT-Based Fall Detection for Aiding Elderly Care: Sensors, Methods, Challenges and Future Trends. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12073276] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Remote monitoring of a fall condition or activities and daily life (ADL) of elderly patients has become one of the essential purposes for modern telemedicine. Internet of Things (IoT) and artificial intelligence (AI) techniques, including machine and deep learning models, have been recently applied in the medical field to automate the diagnosis procedures of abnormal and diseased cases. They also have many other applications, including the real-time identification of fall accidents in elderly patients. The goal of this article is to review recent research whose focus is to develop AI algorithms and methods of fall detection systems (FDS) in the IoT environment. In addition, the usability of different sensor types, such as gyroscopes and accelerometers in smartwatches, is described and discussed with the current limitations and challenges for realizing successful FDSs. The availability problem of public fall datasets for evaluating the proposed detection algorithms are also addressed in this study. Finally, this article is concluded by proposing advanced techniques such as lightweight deep models as one of the solutions and prospects of futuristic smart IoT-enabled systems for accurate fall detection in the elderly.
Collapse
|
3
|
Symmetrically Stacked Long Short-Term Memory Networks for Fall Event Recognition Using Compact Convolutional Neural Networks-Based Tracker. Symmetry (Basel) 2022. [DOI: 10.3390/sym14020293] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/04/2022] Open
Abstract
In recent years, the advancement of pattern recognition algorithms, specifically the deep learning-related techniques, have propelled a tremendous amount of researches in fall event recognition systems. It is important to detect a fall incident as early as possible, whereby a slight delay in providing immediate assistance can cause severe unrecoverable injuries. One of the main challenges in fall event recognition is the imbalanced training data between fall and no-fall events, where a real-life fall incident is a sporadic event that occurs infrequently. Most of the recent techniques produce a lot of false alarms, as it is hard to train them to cover a wide range of fall situations. Hence, this paper aims to detect the exact fall frame in a video sequence, as such it will not be dependent on the whole clip of the video sequence. Our proposed approach consists of a two-stage module where the first stage employs a compact convolutional neural network tracker to generate the object trajectory information. Features of interest will be sampled from the generated trajectory paths, which will be fed as the input to the second stage. The next stage network then models the temporal dependencies of the trajectory information using symmetrical Long Short-Term Memory (LSTM) architecture. This two-stage module is a novel approach as most of the techniques rely on the detection module rather than the tracking module. The simulation experiments were tested using Fall Detection Dataset (FDD). The proposed approach obtains an expected average overlap of 0.167, which is the best performance compared to Multi-Domain Network (MDNET) and Tree-structured Convolutional Neural Network (TCNN) trackers. Furthermore, the proposed 3-layers of stacked LSTM architecture also performs the best compared to the vanilla recurrent neural network and single-layer LSTM. This approach can be further improved if the tracker model is firstly pre-tuned in offline mode with respect to a specific type of object of interest, rather than a general object.
Collapse
|
4
|
On the Heterogeneity of Existing Repositories of Movements Intended for the Evaluation of Fall Detection Systems. JOURNAL OF HEALTHCARE ENGINEERING 2020; 2020:6622285. [PMID: 33376585 PMCID: PMC7738812 DOI: 10.1155/2020/6622285] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/30/2020] [Accepted: 11/15/2020] [Indexed: 11/18/2022]
Abstract
Due to the serious impact of falls on the autonomy and health of older people, the investigation of wearable alerting systems for the automatic detection of falls has gained considerable scientific interest in the field of body telemonitoring with wireless sensors. Because of the difficulties of systematically validating these systems in a real application scenario, Fall Detection Systems (FDSs) are typically evaluated by studying their response to datasets containing inertial sensor measurements captured during the execution of labelled nonfall and fall movements. In this context, during the last decade, numerous publicly accessible databases have been released aiming at offering a common benchmarking tool for the validation of the new proposals on FDSs. This work offers a comparative and updated analysis of these existing repositories. For this purpose, the samples contained in the datasets are characterized by different statistics that model diverse aspects of the mobility of the human body in the time interval where the greatest change in the acceleration module is identified. By using one-way analysis of variance (ANOVA) on the series of these features, the comparison shows the significant differences detected between the datasets, even when comparing activities that require a similar degree of physical effort. This heterogeneity, which may result from the great variability of the sensors, experimental users, and testbeds employed to generate the datasets, is relevant because it casts doubt on the validity of the conclusions of many studies on FDSs, since most of the proposals in the literature are only evaluated using a single database.
Collapse
|
5
|
Sanchez-Comas A, Synnes K, Hallberg J. Hardware for Recognition of Human Activities: A Review of Smart Home and AAL Related Technologies. SENSORS (BASEL, SWITZERLAND) 2020; 20:E4227. [PMID: 32751345 PMCID: PMC7435866 DOI: 10.3390/s20154227] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2020] [Revised: 07/19/2020] [Accepted: 07/20/2020] [Indexed: 01/09/2023]
Abstract
Activity recognition (AR) from an applied perspective of ambient assisted living (AAL) and smart homes (SH) has become a subject of great interest. Promising a better quality of life, AR applied in contexts such as health, security, and energy consumption can lead to solutions capable of reaching even the people most in need. This study was strongly motivated because levels of development, deployment, and technology of AR solutions transferred to society and industry are based on software development, but also depend on the hardware devices used. The current paper identifies contributions to hardware uses for activity recognition through a scientific literature review in the Web of Science (WoS) database. This work found four dominant groups of technologies used for AR in SH and AAL-smartphones, wearables, video, and electronic components-and two emerging technologies: Wi-Fi and assistive robots. Many of these technologies overlap across many research works. Through bibliometric networks analysis, the present review identified some gaps and new potential combinations of technologies for advances in this emerging worldwide field and their uses. The review also relates the use of these six technologies in health conditions, health care, emotion recognition, occupancy, mobility, posture recognition, localization, fall detection, and generic activity recognition applications. The above can serve as a road map that allows readers to execute approachable projects and deploy applications in different socioeconomic contexts, and the possibility to establish networks with the community involved in this topic. This analysis shows that the research field in activity recognition accepts that specific goals cannot be achieved using one single hardware technology, but can be using joint solutions, this paper shows how such technology works in this regard.
Collapse
Affiliation(s)
- Andres Sanchez-Comas
- Department of Productivity and Innovation, Universidad de la Costa, Barranquilla 080 002, Colombia
| | - Kåre Synnes
- Department of Computer Science, Electrical and Space Engineering, Luleå Tekniska Universitet, 971 87 Luleå, Sweden;
| | - Josef Hallberg
- Department of Computer Science, Electrical and Space Engineering, Luleå Tekniska Universitet, 971 87 Luleå, Sweden;
| |
Collapse
|
6
|
Abstract
Due to the serious impact of falls on the quality of life of the elderly and on the economical sustainability of health systems, the study of new monitoring systems capable of automatically alerting about falls has gained much research interest during the last decade. In the field of Human Activity Recognition, Fall Detection Systems (FDSs) can be contemplated as pattern recognition architectures able to discriminate falls from ordinary Activities of Daily Living (ADLs). In this regard, the combined application of cellular communications and wearable devices that integrate inertial sensors offers a cost-efficient solution to track the user mobility almost ubiquitously. Inertial Measurement Units (IMUs) typically utilized for these architectures, embed an accelerometer and a gyroscope. This paper investigates if the use of the angular velocity (captured by the gyroscope) as an input feature of the movement classifier introduces any benefit with respect to the most common case in which the classification decision is uniquely based on the accelerometry signals. For this purpose, the work assesses the performance of a deep learning architecture (a convolutional neural network) which is optimized to differentiate falls from ADLs as a function of the raw data measured by the two inertial sensors (gyroscope and accelerometer). The system is evaluated against on a well-known public dataset with a high number of mobility traces (falls and ADL) measured from the movements of a wide group of experimental users.
Collapse
|
7
|
A Study on the Application of Convolutional Neural Networks to Fall Detection Evaluated with Multiple Public Datasets. SENSORS 2020; 20:s20051466. [PMID: 32155936 PMCID: PMC7085732 DOI: 10.3390/s20051466] [Citation(s) in RCA: 30] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2020] [Revised: 03/04/2020] [Accepted: 03/05/2020] [Indexed: 01/15/2023]
Abstract
Due to the repercussion of falls on both the health and self-sufficiency of older people and on the financial sustainability of healthcare systems, the study of wearable fall detection systems (FDSs) has gained much attention during the last years. The core of a FDS is the algorithm that discriminates falls from conventional Activities of Daily Life (ADLs). This work presents and evaluates a convolutional deep neural network when it is applied to identify fall patterns based on the measurements collected by a transportable tri-axial accelerometer. In contrast with most works in the related literature, the evaluation is performed against a wide set of public data repositories containing the traces obtained from diverse groups of volunteers during the execution of ADLs and mimicked falls. Although the method can yield very good results when it is hyper-parameterized for a certain dataset, the global evaluation with the other repositories highlights the difficulty of extrapolating to other testbeds the network architecture that was configured and optimized for a particular dataset.
Collapse
|
8
|
Jmaiel M, Mokhtari M, Abdulrazak B, Aloulou H, Kallel S. A Novel On-Wrist Fall Detection System Using Supervised Dictionary Learning Technique. LECTURE NOTES IN COMPUTER SCIENCE 2020. [PMCID: PMC7313291 DOI: 10.1007/978-3-030-51517-1_15] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Wrist-based fall detection system provides a very comfortable and multi-modal healthcare solution, especially for elderly risking falls. However, the wrist location presents a very challenging and unstable spot to distinguish falls among other daily activities. In this paper, we propose a Supervised Dictionary Learning approach for wrist-based fall detection. Three Dictionary learning algorithms for classification are invoked in this study, namely SRC, FDDL, and LRSDL. To extract the best descriptive representation of the signal data we followed different preprocessing scenarios based on accelerometer, gyroscope, and magnetometer. A considerable overall performance was obtained by the SRC algorithms reaching respectively 99.8%, 100%, and 96.6% of accuracy, sensitivity, and specificity using raw data provided by a triaxial accelerometer, accordingly overthrowing previously proposed methods for wrist placement.
Collapse
|
9
|
Nadeem A, Mehmood A, Rizwan K. A dataset build using wearable inertial measurement and ECG sensors for activity recognition, fall detection and basic heart anomaly detection system. Data Brief 2019; 27:104717. [PMID: 31886332 PMCID: PMC6920471 DOI: 10.1016/j.dib.2019.104717] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2019] [Revised: 07/18/2019] [Accepted: 10/17/2019] [Indexed: 11/29/2022] Open
Abstract
This paper defines two major data sets 1) from wearable inertial measurement sensors and 2) wearable ECG SHIMMER™ sensors. The first dataset is devised to benchmark techniques dealing with human behavior analysis based on multimodal inertial measurement wearable SHIMMER™ sensors unit during research studies "Fall Detection System for the Elderly Based on the Classification of Shimmer Sensor Prototype Data" [2] and "A novel fall detection algorithm for elderly using SHIMMER wearable sensors" [3]. The SHIMMER inertial sensor is a lightweight sensing device, incorporated with tri-axial accelerometer, a tri-axial gyroscope and tri-axial magnetometer, mounted on the waist of the subjects. The second dataset is developed to assess the feasibility of using SHIMMER™ wearable third generation ECG sensors for identification of basic heart anomalies by remote ECG analysis. The experimental protocol was carried out according to the Timed Up and Go (TUG) test [1], which is mainly used in fall detection and fall risk assessment systems specially designed for elderly. Three daily life activities such as standing still, walking and sitting on chair and getup were performed along with fall activity in controlled environment. This dataset is available on Data in Brief Dataverse [4] and a data repository [5].
Collapse
Affiliation(s)
- Adnan Nadeem
- Faculty of Computer and Information System, Islamic University of Madinah, Madinah, Saudi Arabia
- Department of Computer Science, Federal Urdu University of Arts, Science & Technology, Pakistan
| | - Amir Mehmood
- Department of Computer Science, Federal Urdu University of Arts, Science & Technology, Pakistan
- Electronic Engineering Department, NED University of Engineering & Technology, Karachi, Pakistan
| | - Kashif Rizwan
- Department of Computer Science, Federal Urdu University of Arts, Science & Technology, Pakistan
| |
Collapse
|
10
|
Hong J, Kong HJ, Yoon HJ. Web-Based Telepresence Exercise Program for Community-Dwelling Elderly Women With a High Risk of Falling: Randomized Controlled Trial. JMIR Mhealth Uhealth 2018; 6:e132. [PMID: 29807877 PMCID: PMC5996181 DOI: 10.2196/mhealth.9563] [Citation(s) in RCA: 35] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2017] [Revised: 01/31/2018] [Accepted: 04/26/2018] [Indexed: 12/27/2022] Open
Abstract
Background While physical exercise is known to help prevent falls in the elderly, bad weather and long distance between the home and place of exercise represent substantial deterrents for the elderly to join or continue attending exercise programs outside their residence. Conventional modalities for home exercise can be helpful but do not offer direct and prompt feedback to the participant, which minimizes the benefit. Objective We aimed to develop an elderly-friendly telepresence exercise platform and to evaluate the effects of a 12-week telepresence exercise program on fall-related risk factors in community-dwelling elderly women with a high risk of falling. Methods In total, 34 women aged 68-91 years with Fall Risk Assessment scores >14 and no medical contraindication to physical training-based therapy were recruited in person from a senior citizen center. The telepresence exercise platform included a 15-inch tablet computer, custom-made peer-to-peer video conferencing server system, and broadband Internet connectivity. The Web-based program included supervised resistance exercises performed using elastic resistance bands and balance exercise for 20-40 minutes a day, three times a week, for 12 weeks. During the telepresence exercise session, each participant in the intervention group was supervised remotely by a specialized instructor who provided feedback in real time. The women in the control group maintained their lifestyle without any intervention. Fall-related physical factors (body composition and physical function parameters) and psychological factors (Korean Falls Efficacy Scale score, Fear of Falling Questionnaire score) before and after the 12-week interventional period were examined in person by an exercise specialist blinded to the group allocation scheme. Results Of the 30 women enrolled, 23 completed the study. Compared to women in the control group (n=13), those in the intervention group (n=10) showed significant improvements on the scores for the chair stand test (95% confidence interval -10.45 to -5.94, P<.001), Berg Balance Scale (95% confidence interval -2.31 to -0.28, P=.02), and Fear of Falling Questionnaire (95% confidence interval 0.69-3.5, P=.01). Conclusions The telepresence exercise program had positive effects on fall-related risk factors in community-dwelling elderly women with a high risk of falling. Elderly-friendly telepresence technology for home-based exercises can serve as an effective intervention to improve fall-related physical and psychological factors. Trial Registration Clinical Research Information Service KCT0002710; https://cris.nih.go.kr/cris/en/search/ search_result_st01.jsp?seq=11246 (Archived by WebCite at http://www.webcitation.org/6zdSUEsmb)
Collapse
Affiliation(s)
- Jeeyoung Hong
- Biomedical Research Institute, Seoul National University Hospital, Seoul, Republic Of Korea.,Institute of Medical & Biological Engineering, Medical Research Center, Seoul National University College of Medicine, Seoul, Republic Of Korea
| | - Hyoun-Joong Kong
- Department of Biomedical Engineering, Chungnam National University College of Medicine, Daejeon, Republic Of Korea.,Medical Information Center, Department of Biomedical Engineering, Chungnam National University Hospital, Daejeon, Republic Of Korea
| | - Hyung-Jin Yoon
- Institute of Medical & Biological Engineering, Medical Research Center, Seoul National University College of Medicine, Seoul, Republic Of Korea.,Department of Biomedical Engineering, Seoul National University College of Medicine, Seoul, Republic Of Korea.,Department of Biomedical Engineering, Seoul National University Hospital, Seoul, Republic Of Korea
| |
Collapse
|