1
|
Taramasco C, Pineiro M, Ormeño-Arriagada P, Robles D, Araya D. Multimodal dataset for sensor fusion in fall detection. PeerJ 2025; 13:e19004. [PMID: 40191748 PMCID: PMC11970414 DOI: 10.7717/peerj.19004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/03/2024] [Accepted: 01/25/2025] [Indexed: 04/09/2025] Open
Abstract
The necessity for effective automatic fall detection mechanisms in older adults is driven by the growing demographic of elderly individuals who are at substantial health risk from falls, particularly when residing alone. Despite the existence of numerous fall detection systems (FDSs) that utilize machine learning and predictive modeling, accurately distinguishing between everyday activities and genuine falls continues to pose significant challenges, exacerbated by the varied nature of residential settings. Adaptable solutions are essential to cater to the diverse conditions under which falls occur. In this context, sensor fusion emerges as a promising solution, harnessing the unique physical properties of falls. The success of developing effective detection algorithms is dependent on the availability of comprehensive datasets that integrate data from multiple synchronized sensors. Our research introduces a novel multisensor dataset designed to support the creation and evaluation of advanced multisensor fall detection algorithms. This dataset was compiled from simulations of ten different fall types by ten participants, ensuring a wide array of scenarios. Data were collected using four types of sensors: a mobile phone equipped with a single-channel, three-dimensional accelerometer; a far infrared (FIR) thermal camera; an $8×8$ LIDAR; and a 60-64 GHz radar. These sensors were selected for their combined effectiveness in capturing detailed aspects of fall events while mitigating privacy issues linked to visual recordings. Characterization of the dataset was undertaken using two key metrics: the instantaneous norm of the signal and the temporal difference between consecutive frames. This analysis highlights the distinct variations between fall and non-fall events across different sensors and signal characteristics. Through the provision of this dataset, our objective is to facilitate the development of sensor fusion algorithms that surpass the accuracy and reliability of traditional single-sensor FDSs.
Collapse
Affiliation(s)
- Carla Taramasco
- Facultad de Ingeniería, Universidad Andrés Bello, Vina del Mar, Valparaíso, Chile
- Millenium Núcleo of SocioMedicine (SocioMed), Universidad Mayor, Santiago, Region Metropolitana, Chile
| | - Miguel Pineiro
- Facultad de Ingeniería, Universidad Andrés Bello, Vina del Mar, Valparaíso, Chile
| | - Pablo Ormeño-Arriagada
- Escuela de Ingenieria y Negocios, Universidad de Viña del Mar, Vina del Mar, Valparaíso, Chile
| | - Diego Robles
- Escuela de Ingeniería Civil Informática, Universidad de Valparaíso, Valparaiso, Valparaíso, Chile
- Escuela de Kinesiología, Facultad de Salud y Odontología, Universidad Diego Portales, Santiago, Region Metropolitana, Chile
| | - David Araya
- Facultad de Ingeniería, Universidad Andrés Bello, Vina del Mar, Valparaíso, Chile
| |
Collapse
|
2
|
Li Y, Liu P, Fang Y, Wu X, Xie Y, Xu Z, Ren H, Jing F. A Decade of Progress in Wearable Sensors for Fall Detection (2015-2024): A Network-Based Visualization Review. SENSORS (BASEL, SWITZERLAND) 2025; 25:2205. [PMID: 40218718 PMCID: PMC11991334 DOI: 10.3390/s25072205] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/18/2025] [Revised: 03/12/2025] [Accepted: 03/26/2025] [Indexed: 04/14/2025]
Abstract
Over the past decade, wearable sensors for fall detection have gained significant attention due to their potential in improving the safety of elderly users and reducing fall-related injuries. This review employs a network-based visualization approach to analyze research trends, key technologies, and collaborative networks. Using studies from SCI- and SSCI-indexed journals from 2015 to 2024, we analyzed 582 articles and 65 reviews with CiteSpace, revealing a significant rise in research on wearable sensors for fall detection. Additionally, we reviewed various datasets and machine learning techniques, from traditional methods to advanced deep learning frameworks, which demonstrate high accuracies, F1 scores, sensitivities, and specificities in controlled settings. This review provides a comprehensive overview of the progress and emerging trends, offering a foundation for future advancements in wearable fall detection systems.
Collapse
Affiliation(s)
- Yifei Li
- Hikvision Research Institute, Hangzhou 310051, China; (Y.L.); (P.L.)
- College of Civil Engineering and Architecture, Zhejiang University, Hangzhou 310027, China
| | - Pei Liu
- Hikvision Research Institute, Hangzhou 310051, China; (Y.L.); (P.L.)
| | - Yan Fang
- Faculty of Data Science, City University of Macau, Taipa, Macao SAR 999078, China; (Y.F.); (X.W.)
| | - Xiangyuan Wu
- Faculty of Data Science, City University of Macau, Taipa, Macao SAR 999078, China; (Y.F.); (X.W.)
| | - Yewei Xie
- Programme in Health Services and Systems Research, Duke-NUS Medical School, Singapore 169857, Singapore;
| | - Zhongzhi Xu
- School of Public Health, Sun Yat-sen University, Guangzhou 510080, China;
| | - Hao Ren
- Guangzhou Key Laboratory of Smart Home Ward and Health Sensing, The Affiliated Guangdong Second Provincial General Hospital of Jinan University, Guangzhou 510317, China
| | - Fengshi Jing
- Faculty of Data Science, City University of Macau, Taipa, Macao SAR 999078, China; (Y.F.); (X.W.)
- UNC Project-China, The University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| |
Collapse
|
3
|
Schneider M, Seeser-Reich K, Fiedler A, Frese U. Enhancing Slip, Trip, and Fall Prevention: Real-World Near-Fall Detection with Advanced Machine Learning Technique. SENSORS (BASEL, SWITZERLAND) 2025; 25:1468. [PMID: 40096348 PMCID: PMC11902511 DOI: 10.3390/s25051468] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/07/2025] [Revised: 02/25/2025] [Accepted: 02/26/2025] [Indexed: 03/19/2025]
Abstract
Slips, trips, and falls (STFs) are a major occupational hazard that contributes significantly to workplace injuries and the associated financial costs. The application of traditional fall detection techniques in the real world is limited because they are usually based on simulated falls. By using kinematic data from real near-fall incidents that occurred in physically demanding work environments, this study overcomes this limitation and improves the ecological validity of fall detection algorithms. This study systematically tests several machine-learning architectures for near-fall detection using the Prev-Fall dataset, which consists of high-resolution inertial measurement unit (IMU) data from 110 workers. Convolutional neural networks (CNNs), residual networks (ResNets), convolutional long short-term memory networks (convLSTMs), and InceptionTime models were trained and evaluated over a range of temporal window lengths using a neural architecture search. High-validation F1 scores were achieved by the best-performing models, particularly CNNs and InceptionTime, indicating their effectiveness in near-fall classification. The need for more contextual variables to increase robustness was highlighted by recurrent false positives found in subsequent tests on previously unobserved occupational data, especially during biomechanically demanding activities such as bending and squatting. Nevertheless, our findings suggest the applicability of machine-learning-based STF prevention systems for workplace safety monitoring and, more generally, applications in fall mitigation. To further improve the accuracy and generalizability of the system, future research should investigate multimodal data integration and improved classification techniques.
Collapse
Affiliation(s)
- Moritz Schneider
- Institute for Occupational Safety and Health of the German Social Accident Insurance (IFA), 53757 Sankt Augustin, Germany
| | - Kevin Seeser-Reich
- Institute for Occupational Safety and Health of the German Social Accident Insurance (IFA), 53757 Sankt Augustin, Germany
| | - Armin Fiedler
- RheinAhrCampus, Koblenz University of Applied Sciences, 53424 Remagen, Germany
| | - Udo Frese
- German Research Center for Artificial Intelligence (DFKI), 28359 Bremen, Germany
| |
Collapse
|
4
|
Kou W, Ye S, Chen X, Huang J, Shi S, Qiu P. [Longitudinal Transitions of Fall States Based on a Multi-State Markov Model and Their Associated Risk Factors]. SICHUAN DA XUE XUE BAO. YI XUE BAN = JOURNAL OF SICHUAN UNIVERSITY. MEDICAL SCIENCE EDITION 2025; 56:230-238. [PMID: 40109480 PMCID: PMC11914006 DOI: 10.12182/20250160510] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2024] [Indexed: 03/22/2025]
Abstract
Objective To investigate the transition intensity and transition probabilities of fall states among middle-aged and older adults in China, and to assess the impact of potential risk factors on falls. Methods We utilized in the study data from the China Health and Retirement Longitudinal Study (CHARLS) and employed a multi-state Markov model (MSM) to analyze the transition intensity and probabilities between states of no falls or falls without treatment, falls requiring treatment, and death. Results A total of 14722 participants were enrolled, with a mean age of (59.4 years ± 9.7 years), and 47.9% were male. The median follow-up period was 9 years (interquartile range [IQR], 7-9 years). At baseline, 12381 participants (84.1%) reported no falls or falls without treatment, while 2341 (15.9%) reported falls requiring treatment. Participants who experienced falls requiring treatment within one follow-up cycle had a 55.2% probability of not falling again or only falling without treatment in the subsequent two years, a 37.6% probability of continuing to experience falls requiring treatment, and a 7.2% probability of death. The risk of transitioning from a state of no falls or falls without treatment to falls requiring treatment increased by 8.6% for every 5-year increase in age. The risk was 35.1% higher for females compared to males. Rural residents had a 10.1% higher risk. Those who were divorced, separated, widowed, or never married had a 20.7% higher risk. Higher degrees of physical function impairment were associated with an increased risk. Depressive symptoms increased the risk by 31.6%. Having one chronic disease raised the risk by 9.6%, while multimorbidity led to a 28.8% increase in risk. Conclusion According to the findings of the study, falls are a dynamic process and emphasis should be given to fall prevention for older adults, individuals with a history of fall-related medical visits, those living alone, those with impaired physical function, and those with depressive symptoms.
Collapse
Affiliation(s)
- Wenkai Kou
- / ( 610041) Department of Epidemiology and Biostatistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu 610041, China
| | - Suni Ye
- / ( 610041) Department of Epidemiology and Biostatistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu 610041, China
| | - Xuerui Chen
- / ( 610041) Department of Epidemiology and Biostatistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu 610041, China
| | - Jing Huang
- / ( 610041) Department of Epidemiology and Biostatistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu 610041, China
| | - Sailong Shi
- / ( 610041) Department of Epidemiology and Biostatistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu 610041, China
| | - Peiyuan Qiu
- / ( 610041) Department of Epidemiology and Biostatistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu 610041, China
| |
Collapse
|
5
|
Han S, Jiang X, Gao Y. Human fall simulation testing method: where we are. Osteoporos Int 2025; 36:35-45. [PMID: 39556250 DOI: 10.1007/s00198-024-07316-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/27/2024] [Accepted: 11/08/2024] [Indexed: 11/19/2024]
Abstract
Falls pose a significant threat to human health and safety. Accurately assessing the protective effectiveness of fall protection products can significantly reduce the occurrence of fall accidents. This paper systematically reviews the types and risk factors of human falls and then discusses the current research status and future prospects of various test methods for human fall protection. A literature search was conducted in databases such as Web of Science, Google Scholar, and Scopus. This study focuses on experimental methods for human fall testing, simulation model experiments, and finite element simulations, providing an outlook on future development trends. In the discussion of three different fall testing methods, research indicates that human fall simulation testing faces limitations such as ethical concerns and safety issues. Although simulation experiments allow for multiple tests in a short period, the complexity and accuracy of the models may affect the reliability of the results. By integrating more experimental data, optimizing the design of human models, and incorporating finite element simulation technology, the scope of testing applications can be expanded, thereby improving the effectiveness of protective product designs. In conclusion, future research on fall protection testing methods should aim to establish unified international standards, which will enhance consistency and repeatability in testing, facilitating better comparison and evaluation of the effectiveness of various protective measures. Furthermore, the integration of more experimental data with real-world scenarios, the optimization of human models and test environments, and the promotion of finite element simulation technology will be crucial in enhancing the precision of protective assessments.
Collapse
Affiliation(s)
- Shuaikang Han
- School of Textiles and Fashion, Shanghai University of Engineering Science, 333 Longteng Road, Songjiang District, Shanghai, China
| | | | - Yantao Gao
- School of Textiles and Fashion, Shanghai University of Engineering Science, 333 Longteng Road, Songjiang District, Shanghai, China.
| |
Collapse
|
6
|
Zhang H, Wu C, Huang Y, Song R, Zanotto D, Agrawal SK. Fall Risk Prediction Using Instrumented Footwear in Institutionalized Older Adults. IEEE Trans Neural Syst Rehabil Eng 2024; PP:4260-4269. [PMID: 40030546 DOI: 10.1109/tnsre.2024.3510300] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
This study presents a novel framework that utilizes instrumented footwear to predict fall risk in institutionalized older adults by leveraging stride-to-stride gait data. The older adults are categorized into fallers and non-fallers using three distinct criteria: retrospective fall history, prospective fall occurrence, and a combination of both retrospective and prospective data. Three types of data collected from N=95 institutionalized older adults are analyzed: traditional timed mobility tests, gait data collected from a validated electronic walkway, and gait data collected with instrumented footwear developed by our team. The importance of each type of data is assessed using a brute-force search method, through which the optimal features are selected. AdaBoost algorithms are then utilized to develop predictive models based on the selected features. The models are evaluated using leave-one-out cross-validation and 10-fold cross-validation. The results show that models using gait data from the instrumented footwear outperformed those based on traditional tests and walkway data, with area under the receiver operating characteristic curve (AUC) values for predicting prospective falls being 0.47, 0.66, and 0.80, respectively. The sensitivity of the models increases when they are trained using both past and future falls data, rather than relying solely on past or future falls data. This study demonstrates the potential of instrumented footwear for fall risk assessment in elderly individuals. The findings provide valuable insights for fall prevention and care, highlighting the superior predictive capabilities of the developed system compared to traditional methods.
Collapse
|
7
|
Hu S, Cao S, Toosizadeh N, Barton J, Hector MG, Fain MJ. Radar-Based Fall Detection: A Survey. IEEE ROBOTICS & AUTOMATION MAGAZINE 2024; 31:170-185. [PMID: 39465183 PMCID: PMC11507471 DOI: 10.1109/mra.2024.3352851] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/29/2024]
Abstract
Fall detection, particularly critical for high-risk demographics like the elderly, is a key public health concern where timely detection can greatly minimize harm. With the advancements in radio frequency technology, radar has emerged as a powerful tool for human detection and tracking. Traditional machine learning algorithms, such as Support Vector Machines (SVM) and k-Nearest Neighbors (kNN), have shown promising outcomes. However, deep learning approaches, notably Convolutional Neural Networks (CNN) and Recurrent Neural Networks (RNN), have outperformed in learning intricate features and managing large, unstructured datasets. This survey offers an in-depth analysis of radar-based fall detection, with emphasis on Micro-Doppler, Range-Doppler, and Range-Doppler-Angles techniques. We discuss the intricacies and challenges in fall detection and emphasize the necessity for a clear definition of falls and appropriate detection criteria, informed by diverse influencing factors. We present an overview of radar signal processing principles and the underlying technology of radar-based fall detection, providing an accessible insight into machine learning and deep learning algorithms. After examining 74 research articles on radar-based fall detection published since 2000, we aim to bridge current research gaps and underscore the potential future research strategies, emphasizing the real-world applications possibility and the unexplored potential of deep learning in improving radar-based fall detection.
Collapse
Affiliation(s)
- Shuting Hu
- the Department of Electrical and Computer Engineering, The University of Arizona, Tucson, AZ, 85721 USA
| | - Siyang Cao
- the Department of Electrical and Computer Engineering, The University of Arizona, Tucson, AZ, 85721 USA
| | - Nima Toosizadeh
- the Department of Rehabilitation and Movement Sciences, Rutgers School of Health, Rutgers University
| | - Jennifer Barton
- the Department of Biomedical Engineering, The University of Arizona, Tucson, AZ, 85721 USA
| | - Melvin G Hector
- the Department of Medicine, The University of Arizona, Tucson, AZ, 85724 USA
| | - Mindy J Fain
- the Department of Medicine, The University of Arizona, Tucson, AZ, 85724 USA
| |
Collapse
|
8
|
Khan H, Ullah I, Shabaz M, Omer MF, Usman MT, Guellil MS, Koo J. Visionary vigilance: Optimized YOLOV8 for fallen person detection with large-scale benchmark dataset. IMAGE AND VISION COMPUTING 2024; 149:105195. [DOI: 10.1016/j.imavis.2024.105195] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/09/2024]
|
9
|
Vargas V, Ramos P, Orbe EA, Zapata M, Valencia-Aragón K. Low-Cost Non-Wearable Fall Detection System Implemented on a Single Board Computer for People in Need of Care. SENSORS (BASEL, SWITZERLAND) 2024; 24:5592. [PMID: 39275503 PMCID: PMC11397814 DOI: 10.3390/s24175592] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/03/2024] [Revised: 08/21/2024] [Accepted: 08/27/2024] [Indexed: 09/16/2024]
Abstract
This work aims at proposing an affordable, non-wearable system to detect falls of people in need of care. The proposal uses artificial vision based on deep learning techniques implemented on a Raspberry Pi4 4GB RAM with a High-Definition IR-CUT camera. The CNN architecture classifies detected people into five classes: fallen, crouching, sitting, standing, and lying down. When a fall is detected, the system sends an alert notification to mobile devices through the Telegram instant messaging platform. The system was evaluated considering real daily indoor activities under different conditions: outfit, lightning, and distance from camera. Results show a good trade-off between performance and cost of the system. Obtained performance metrics are: precision of 96.4%, specificity of 96.6%, accuracy of 94.8%, and sensitivity of 93.1%. Regarding privacy concerns, even though this system uses a camera, the video is not recorded or monitored by anyone, and pictures are only sent in case of fall detection. This work can contribute to reducing the fatal consequences of falls in people in need of care by providing them with prompt attention. Such a low-cost solution would be desirable, particularly in developing countries with limited or no medical alert systems and few resources.
Collapse
Affiliation(s)
- Vanessa Vargas
- Grupo de Investigación Embsys, Departamento de Eléctrica, Electrónica y Telecomunicaciones, Universidad de las Fuerzas Armadas ESPE, Av. General Rumiñahui y Ambato, Sangolquí 171103, Ecuador
| | - Pablo Ramos
- Grupo de Investigación Embsys, Departamento de Eléctrica, Electrónica y Telecomunicaciones, Universidad de las Fuerzas Armadas ESPE, Av. General Rumiñahui y Ambato, Sangolquí 171103, Ecuador
| | - Edwin A Orbe
- Grupo de Investigación Embsys, Carrera de Ingeniería en Electrónica y Automatización, Universidad de las Fuerzas Armadas ESPE, Av. General Rumiñahui y Ambato, Sangolquí 171103, Ecuador
| | - Mireya Zapata
- Centro de Investigación en Mecatrónica y Sistemas Interactivos (MIST), Ingeniería Industrial, Universidad Indoamérica, Av. Machala y Sabanilla, Quito 170103, Ecuador
| | - Kevin Valencia-Aragón
- Centro de Investigación en Mecatrónica y Sistemas Interactivos (MIST), Ingeniería Industrial, Universidad Indoamérica, Av. Machala y Sabanilla, Quito 170103, Ecuador
| |
Collapse
|
10
|
Huang L, Zhu A, Qian M, An H. Human Fall Detection with Ultra-Wideband Radar and Adaptive Weighted Fusion. SENSORS (BASEL, SWITZERLAND) 2024; 24:5294. [PMID: 39204988 PMCID: PMC11359866 DOI: 10.3390/s24165294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/24/2024] [Revised: 08/03/2024] [Accepted: 08/09/2024] [Indexed: 09/04/2024]
Abstract
To address the challenges in recognizing various types of falls, which often exhibit high similarity and are difficult to distinguish, this paper proposes a human fall classification system based on the SE-Residual Concatenate Network (SE-RCNet) with adaptive weighted fusion. First, we designed the innovative SE-RCNet network, incorporating SE modules after dense and residual connections to automatically recalibrate feature channel weights and suppress irrelevant features. Subsequently, this network was used to train and classify three types of radar images: time-distance images, time-distance images, and distance-distance images. By adaptively fusing the classification results of these three types of radar images, we achieved higher action recognition accuracy. Experimental results indicate that SE-RCNet achieved F1-scores of 94.0%, 94.3%, and 95.4% for the three radar image types on our self-built dataset. After applying the adaptive weighted fusion method, the F1-score further improved to 98.1%.
Collapse
Affiliation(s)
- Ling Huang
- School of Electrical Engineering and Information Engineering, Lanzhou University of Technology, Lanzhou 730050, China; (A.Z.); (M.Q.); (H.A.)
| | | | | | | |
Collapse
|
11
|
Zhang J, Li Z, Liu Y, Li J, Qiu H, Li M, Hou G, Zhou Z. An Effective Deep Learning Framework for Fall Detection: Model Development and Study Design. J Med Internet Res 2024; 26:e56750. [PMID: 39102676 PMCID: PMC11333863 DOI: 10.2196/56750] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2024] [Revised: 06/07/2024] [Accepted: 06/11/2024] [Indexed: 08/07/2024] Open
Abstract
BACKGROUND Fall detection is of great significance in safeguarding human health. By monitoring the motion data, a fall detection system (FDS) can detect a fall accident. Recently, wearable sensors-based FDSs have become the mainstream of research, which can be categorized into threshold-based FDSs using experience, machine learning-based FDSs using manual feature extraction, and deep learning (DL)-based FDSs using automatic feature extraction. However, most FDSs focus on the global information of sensor data, neglecting the fact that different segments of the data contribute variably to fall detection. This shortcoming makes it challenging for FDSs to accurately distinguish between similar human motion patterns of actual falls and fall-like actions, leading to a decrease in detection accuracy. OBJECTIVE This study aims to develop and validate a DL framework to accurately detect falls using acceleration and gyroscope data from wearable sensors. We aim to explore the essential contributing features extracted from sensor data to distinguish falls from activities of daily life. The significance of this study lies in reforming the FDS by designing a weighted feature representation using DL methods to effectively differentiate between fall events and fall-like activities. METHODS Based on the 3-axis acceleration and gyroscope data, we proposed a new DL architecture, the dual-stream convolutional neural network self-attention (DSCS) model. Unlike previous studies, the used architecture can extract global feature information from acceleration and gyroscope data. Additionally, we incorporated a self-attention module to assign different weights to the original feature vector, enabling the model to learn the contribution effect of the sensor data and enhance classification accuracy. The proposed model was trained and tested on 2 public data sets: SisFall and MobiFall. In addition, 10 participants were recruited to carry out practical validation of the DSCS model. A total of 1700 trials were performed to test the generalization ability of the model. RESULTS The fall detection accuracy of the DSCS model was 99.32% (recall=99.15%; precision=98.58%) and 99.65% (recall=100%; precision=98.39%) on the test sets of SisFall and MobiFall, respectively. In the ablation experiment, we compared the DSCS model with state-of-the-art machine learning and DL models. On the SisFall data set, the DSCS model achieved the second-best accuracy; on the MobiFall data set, the DSCS model achieved the best accuracy, recall, and precision. In practical validation, the accuracy of the DSCS model was 96.41% (recall=95.12%; specificity=97.55%). CONCLUSIONS This study demonstrates that the DSCS model can significantly improve the accuracy of fall detection on 2 publicly available data sets and performs robustly in practical validation.
Collapse
Affiliation(s)
- Jinxi Zhang
- Beijing Kupei Sports Culture Corporation Limited, Beijing, China
- Institute of Artificial Intelligence in Sports, Capital University of Physical Education and Sports, Beijing, China
| | - Zhen Li
- School of Physical Education and Sport Science, Fujian Normal University, Fuzhou, China
| | - Yu Liu
- Institute for Sport Performance and Health Promotion, Capital University of Physical Education and Sports, Beijing, China
| | - Jian Li
- Institute for Sport Performance and Health Promotion, Capital University of Physical Education and Sports, Beijing, China
| | - Hualong Qiu
- Institute for Sport Performance and Health Promotion, Capital University of Physical Education and Sports, Beijing, China
| | - Mohan Li
- Institute for Sport Performance and Health Promotion, Capital University of Physical Education and Sports, Beijing, China
| | - Guohui Hou
- Bioelectronics Center of YZW, Shanghai, China
- Walt Technology Group Co, Ltd, Jiaxing, China
| | - Zhixiong Zhou
- Institute of Artificial Intelligence in Sports, Capital University of Physical Education and Sports, Beijing, China
| |
Collapse
|
12
|
Can B, Tufan A, Karadağ Ş, DurmuŞ NŞ, Topçu M, Aysevinç B, Düzel SÇ, Dağcıoğlu S, AfŞar Fak N, Tazegül G, Fak AS. The effectiveness of a fall detection device in older nursing home residents: a pilot study. Psychogeriatrics 2024; 24:822-829. [PMID: 38634167 DOI: 10.1111/psyg.13126] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/01/2024] [Revised: 03/18/2024] [Accepted: 04/01/2024] [Indexed: 04/19/2024]
Abstract
BACKGROUND Real-world research to evaluate the effect of device technology in preventing fall-related morbidity is limited. This pilot study aims to investigate the effectiveness of a non-wearable fall detection device in older nursing home residents. METHODS The study was conducted in a nursing home with single-resident rooms. Fall detection devices were randomly set up in half of the rooms. Demographic data, comorbidities, lists of medications, and functional, nutritional, and frailty status were recorded. The residents were followed up for 3 months. The primary outcome was falls and the secondary outcome was all-cause mortality. RESULTS A total of 26 participants were enrolled in the study. The study group consisted of 13 residents who had a fall detection device in their rooms. The remaining 13 residents on the same floor formed the control group. Participants had a mean age of 82 ± 10 years and 89% of the residents were female. The most prevalent comorbidity was dementia. Two residents from the control group and one resident from the study group experienced a fall event during follow-up. The fall events in the control group were identified retrospectively by the nursing home staff, whereas the fall in the study group received a prompt response from the staff who were notified by the alarm. One resident was transferred to the hospital and died due to a non-fall related reason. CONCLUSION Device technology may provide an opportunity for timely intervention to prevent fall-related morbidity in institutionalized older adults.
Collapse
Affiliation(s)
- Büşra Can
- Marmara University Medical School, Department of Internal Medicine, Divisions of Geriatrics, Istanbul, Turkey
| | - Aslı Tufan
- Marmara University Medical School, Department of Internal Medicine, Divisions of Geriatrics, Istanbul, Turkey
| | - Şevval Karadağ
- VivaSmartTech, Marmara Üniversitesi Teknopark Ar-Ge Şirketi, Istanbul, Turkey
| | - Nurdan Şentürk DurmuŞ
- Marmara University Medical School, Department of Internal Medicine, Divisions of Geriatrics, Istanbul, Turkey
| | - Mümüne Topçu
- Marmara University Medical School, Hypertension and Atherosclerosis Education, Application and Research Center, Istanbul, Turkey
| | - Berrin Aysevinç
- Marmara University Medical School, Hypertension and Atherosclerosis Education, Application and Research Center, Istanbul, Turkey
| | - Songül Çeçen Düzel
- Marmara University Medical School, Hypertension and Atherosclerosis Education, Application and Research Center, Istanbul, Turkey
| | | | - Nazire AfŞar Fak
- Marmara University Medical School, Department of Neurology, Istanbul, Turkey
| | - Gökhan Tazegül
- Marmara University Medical School, Department of Internal Medicine, Istanbul, Turkey
| | - Ali Serdar Fak
- Marmara University Medical School, Hypertension and Atherosclerosis Education, Application and Research Center, Istanbul, Turkey
| |
Collapse
|
13
|
Armoundas AA, Ahmad FS, Bennett DA, Chung MK, Davis LL, Dunn J, Narayan SM, Slotwiner DJ, Wiley KK, Khera R. Data Interoperability for Ambulatory Monitoring of Cardiovascular Disease: A Scientific Statement From the American Heart Association. CIRCULATION. GENOMIC AND PRECISION MEDICINE 2024; 17:e000095. [PMID: 38779844 PMCID: PMC11703599 DOI: 10.1161/hcg.0000000000000095] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/25/2024]
Abstract
Wearable devices are increasingly used by a growing portion of the population to track health and illnesses. The data emerging from these devices can potentially transform health care. This requires an interoperability framework that enables the deployment of platforms, sensors, devices, and software applications within diverse health systems, aiming to facilitate innovation in preventing and treating cardiovascular disease. However, the current data ecosystem includes several noninteroperable systems that inhibit such objectives. The design of clinically meaningful systems for accessing and incorporating these data into clinical workflows requires strategies to ensure the quality of data and clinical content and patient and caregiver accessibility. This scientific statement aims to address the best practices, gaps, and challenges pertaining to data interoperability in this area, with considerations for (1) data integration and the scope of measures, (2) application of these data into clinical approaches/strategies, and (3) regulatory/ethical/legal issues.
Collapse
|
14
|
Chen H, Gu W, Zhang Q, Li X, Jiang X. Integrating attention mechanism and multi-scale feature extraction for fall detection. Heliyon 2024; 10:e31614. [PMID: 38831825 PMCID: PMC11145491 DOI: 10.1016/j.heliyon.2024.e31614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2024] [Revised: 05/11/2024] [Accepted: 05/20/2024] [Indexed: 06/05/2024] Open
Abstract
Addressing the critical need for accurate fall event detection due to their potentially severe impacts, this paper introduces the Spatial Channel and Pooling Enhanced You Only Look Once version 5 small (SCPE-YOLOv5s) model. Fall events pose a challenge for detection due to their varying scales and subtle pose features. To address this problem, SCPE-YOLOv5s introduces spatial attention to the Efficient Channel Attention (ECA) network, which significantly enhances the model's ability to extract features from spatial pose distribution. Moreover, the model integrates average pooling layers into the Spatial Pyramid Pooling (SPP) network to support the multi-scale extraction of fall poses. Meanwhile, by incorporating the ECA network into SPP, the model effectively combines global and local features to further enhance the feature extraction. This paper validates the SCPE-YOLOv5s on a public dataset, demonstrating that it achieves a mean Average Precision of 88.29 %, outperforming the You Only Look Once version 5 small by 4.87 %. Additionally, the model achieves 57.4 frames per second. Therefore, SCPE-YOLOv5s provides a novel solution for fall event detection.
Collapse
Affiliation(s)
- Hao Chen
- School of Computer and Information Engineering, Nantong Institute of Technology, China
| | - Wenye Gu
- Affiliated Hospital of Nantong University, China
| | - Qiong Zhang
- School of Computer and Information Engineering, Nantong Institute of Technology, China
| | - Xiujing Li
- School of Computer and Information Engineering, Nantong Institute of Technology, China
| | - Xiaojing Jiang
- School of Computer and Information Engineering, Nantong Institute of Technology, China
| |
Collapse
|
15
|
Fernandez-Bermejo J, Martinez-Del-Rincon J, Dorado J, Toro XD, Santofimia MJ, Lopez JC. Edge Computing Transformers for Fall Detection in Older Adults. Int J Neural Syst 2024; 34:2450026. [PMID: 38490957 DOI: 10.1142/s0129065724500266] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/17/2024]
Abstract
The global trend of increasing life expectancy introduces new challenges with far-reaching implications. Among these, the risk of falls among older adults is particularly significant, affecting individual health and the quality of life, and placing an additional burden on healthcare systems. Existing fall detection systems often have limitations, including delays due to continuous server communication, high false-positive rates, low adoption rates due to wearability and comfort issues, and high costs. In response to these challenges, this work presents a reliable, wearable, and cost-effective fall detection system. The proposed system consists of a fit-for-purpose device, with an embedded algorithm and an Inertial Measurement Unit (IMU), enabling real-time fall detection. The algorithm combines a Threshold-Based Algorithm (TBA) and a neural network with low number of parameters based on a Transformer architecture. This system demonstrates notable performance with 95.29% accuracy, 93.68% specificity, and 96.66% sensitivity, while only using a 0.38% of the trainable parameters used by the other approach.
Collapse
Affiliation(s)
- Jesús Fernandez-Bermejo
- Faculty of Social Science and Information Technology, University of Castilla-La Mancha, 45600 Talavera de la Reina, Toledo, Spain
| | - Jesús Martinez-Del-Rincon
- The Centre for Secure Information Technologies (CSIT), Institute of Electronics, Communications & Information Technology, Queen's University of Belfast, Belfast BT3 9DT, UK
| | - Javier Dorado
- School of Computer Engineering, University of Castilla-La Mancha, 13071 Ciudad Real, Ciudad Real, Spain
| | - Xavier Del Toro
- School of Computer Engineering, University of Castilla-La Mancha, 13071 Ciudad Real, Ciudad Real, Spain
| | - María J Santofimia
- School of Computer Engineering, University of Castilla-La Mancha, 13071 Ciudad Real, Ciudad Real, Spain
| | - Juan C Lopez
- School of Computer Engineering, University of Castilla-La Mancha, 13071 Ciudad Real, Ciudad Real, Spain
| |
Collapse
|
16
|
Jiao S, Li G, Zhang G, Zhou J, Li J. Multimodal fall detection for solitary individuals based on audio-video decision fusion processing. Heliyon 2024; 10:e29596. [PMID: 38681632 PMCID: PMC11053201 DOI: 10.1016/j.heliyon.2024.e29596] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2023] [Revised: 04/01/2024] [Accepted: 04/10/2024] [Indexed: 05/01/2024] Open
Abstract
Falls often pose significant safety risks to solitary individuals, especially the elderly. Implementing a fast and efficient fall detection system is an effective strategy to address this hidden danger. We propose a multimodal method based on audio and video. On the basis of using non-intrusive equipment, it reduces to a certain extent the false negative situation that the most commonly used video-based methods may face due to insufficient lighting conditions, exceeding the monitoring range, etc. Therefore, in the foreseeable future, methods based on audio and video fusion are expected to become the best solution for fall detection. Specifically, this article outlines the following methodology: the video-based model utilizes YOLOv7-Pose to extract key skeleton joints, which are then fed into a two stream Spatial Temporal Graph Convolutional Network (ST-GCN) for classification. Meanwhile, the audio-based model employs log-scaled mel spectrograms to capture different features, which are processed through the MobileNetV2 architecture for detection. The final decision fusion of the two results is achieved through linear weighting and Dempster-Shafer (D-S) theory. After evaluation, our multimodal fall detection method significantly outperforms the single modality method, especially the evaluation metric sensitivity increased from 81.67% in single video modality to 96.67% (linear weighting) and 97.50% (D-S theory), which emphasizing the effectiveness of integrating video and audio data to achieve more powerful and reliable fall detection in complex and diverse daily life environments.
Collapse
Affiliation(s)
- Shiqin Jiao
- School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China
| | - Guoqi Li
- School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China
| | - Guiyang Zhang
- School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China
| | - Jiahao Zhou
- Jinan Thomas School, Jinan, Shandong 250102, China
| | - Jihong Li
- School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China
| |
Collapse
|
17
|
A P, D FDS, M J, T.S S, Sankaran S, Pittu PSKR, S V. Development of artificial intelligence edge computing based wearable device for fall detection and prevention of elderly people. Heliyon 2024; 10:e28688. [PMID: 38628753 PMCID: PMC11019185 DOI: 10.1016/j.heliyon.2024.e28688] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2023] [Revised: 03/18/2024] [Accepted: 03/22/2024] [Indexed: 04/19/2024] Open
Abstract
Elderly falls are a major concerning threat resulting in over 1.5-2 million elderly people experiencing severe injuries and 1 million deaths yearly. Falls experienced by Elderly people may lead to a long-term negative impact on their physical and psychological health conditions. Major healthcare research had focused on this lately to detect and prevent the fall. In this work, an Artificial Intelligence (AI) edge computing based wearable device is designed and developed for detection and prevention of fall of elderly people. Further, the various deep learning algorithms such as Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), Gated Recurrent Unit (GRU) are utilized for activity recognition of elderly. Also, the CNN-LSTM, RNN-LSTM and GRU-LSTM with and without attention layer respectively are utilized and the performance metrics are analyzed to find the best deep learning model. Furthermore, the three different hardware boards such as Jetson Nano developer board, Raspberry PI 3 and 4 are utilized as an AI edge computing device and the best deep learning model is implemented and the computation time is evaluated. Results demonstrate that the CNN-LSTM with attention layer exhibits the accuracy, recall, precision and F1_Score of 97%, 98%, 98% and 0.98 respectively which is better when compared to other deep learning models. Also, the computation time of NVIDIA Jetson Nano is less when compared to other edge computing devices. This work appears to be of high societal relevance since the proposed wearable device can be used to monitor the activity of elderly and prevents the elderly falls which improve the quality of life of elderly people.
Collapse
Affiliation(s)
- Paramasivam A
- Department of Biomedical Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, 600062, India
| | - Ferlin Deva Shahila D
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, 600062, India
| | - Jenath M
- Department of Electronics and Communication Engineering, SRM Institute of Science and Technology, Kattankulathur, Chennai, 603203, India
| | - Sivakumaran T.S
- Department of Electrical and Computer Science Engineering, Bule Hora University, Oromia, Ethiopia
| | - Sakthivel Sankaran
- Department of Biomedical Engineering, Kalasalingam Academy of Research and Education, Krishnankoil, Virudhunagar, 626126, India
| | - Pavan Sai Kiran Reddy Pittu
- Department of Biomedical Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, 600062, India
| | - Vijayalakshmi S
- Department of Electronics and Communication Engineering, Vel Tech Rangarajan Dr. Sagunthala R&D Institute of Science and Technology, Chennai, 600062, India
| |
Collapse
|
18
|
Tang J, He B, Xu J, Tan T, Wang Z, Zhou Y, Jiang S. Synthetic IMU Datasets and Protocols Can Simplify Fall Detection Experiments and Optimize Sensor Configuration. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1233-1245. [PMID: 38408008 DOI: 10.1109/tnsre.2024.3370396] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/28/2024]
Abstract
Falls represent a significant cause of injury among the elderly population. Extensive research has been devoted to the utilization of wearable IMU sensors in conjunction with machine learning techniques for fall detection. To address the challenge of acquiring costly training data, this paper presents a novel method that generates a substantial volume of synthetic IMU data with minimal actual fall experiments. First, unmarked 3D motion capture technology is employed to reconstruct human movements. Subsequently, utilizing the biomechanical simulation platform Opensim and forward kinematic methods, an ample amount of training data from various body segments can be custom generated. Synthetic IMU data was then used to train a machine learning model, achieving testing accuracies of 91.99% and 86.62% on two distinct datasets of actual fall-related IMU data. Building upon the simulation framework, this paper further optimized the single IMU attachment position and multiple IMU combinations on fall detection. The proposed method simplifies fall detection data acquisition experiments, provides novel venue for generating low cost synthetic data in scenario where acquiring data for machine learning is challenging and paves the way for customizing machine learning configurations.
Collapse
|
19
|
Alharbi KK, Alvi SH, Ali B, Mirza J, Javed MA, Alharbi HA. Reliable relay assisted communications for IoT based fall detection. Sci Rep 2024; 14:6249. [PMID: 38491039 PMCID: PMC10942986 DOI: 10.1038/s41598-024-56124-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Accepted: 02/29/2024] [Indexed: 03/18/2024] Open
Abstract
Robust wireless communication using relaying system and Non-Orthogonal Multiple Access (NOMA) will be extensively used for future IoT applications. In this paper, we consider a fall detection IoT application in which elderly patients are equipped with wearable motion sensors. Patient motion data is sent to fog data servers via a NOMA-based relaying system, thereby improving the communication reliability. We analyze the average signal-to-interference-plus-noise (SINR) performance of the NOMA-based relaying system, where the source node transmits two different symbols to the relay and destination node by employing superposition coding over Rayleigh fading channels. In the amplify-and-forward (AF) based relaying, the relay re-transmits the received signal after amplification, whereas, in the decode-and-forward (DF) based relaying, the relay only re-transmits the symbol having lower NOMA power coefficient. We derive closed-form average SINR expressions for AF and DF relaying systems using NOMA. The average SINR expressions for AF and DF relaying systems are derived in terms of computationally efficient functions, namely Tricomi confluent hypergeometric and Meijer's G functions. Through simulations, it is shown that the average SINR values computed using the derived analytical expressions are in excellent agreement with the simulation-based average SINR results.
Collapse
Affiliation(s)
- Khulud K Alharbi
- Department of Health Administration and Hospitals, College of Public Health and Health Informatics, Umm Al-Qura University, Makkah, Saudi Arabia.
| | - Sajid H Alvi
- Department of Physics, COMSATS University Islamabad, Islamabad, 45550, Pakistan
| | - Bakhtiar Ali
- Department of Electrical and Computer Engineering, COMSATS University Islamabad, Islamabad, 45550, Pakistan
| | - Jawad Mirza
- Department of Electrical and Computer Engineering, COMSATS University Islamabad, Islamabad, 45550, Pakistan
| | - Muhammad Awais Javed
- Department of Electrical and Computer Engineering, COMSATS University Islamabad, Islamabad, 45550, Pakistan
| | - Hatem A Alharbi
- Department of Computer Engineering, College of Computer Science and Engineering, Taibah University, 42353, Madinah, Saudi Arabia
| |
Collapse
|
20
|
Wang Y, Deng T. Enhancing elderly care: Efficient and reliable real-time fall detection algorithm. Digit Health 2024; 10:20552076241233690. [PMID: 38384367 PMCID: PMC10880526 DOI: 10.1177/20552076241233690] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/28/2023] [Accepted: 02/01/2024] [Indexed: 02/23/2024] Open
Abstract
Background and Objective Falls pose a significant risk to public health, especially for the elderly population, and could potentially result in severe injuries or even death. A reliable fall detection system is urgently needed to recognise and promptly alert to falls effectively. A vision-based fall detection system has the advantage of being non-invasive and affordable compared with another popular approach using wearable sensors. Nevertheless, the present challenge lies in the algorithm's limited on-device operating speed due to extremely high computational demands, and the high computational demands are usually essential to improve the performance for the complex scene. Therefore, it is crucial to address the above challenge in computational power and complex scenes. Methods This article presents the implementation of a real-time fall detection algorithm with low computational costs using a single webcam. The suggested method optimises precision and efficiency by synthesising the strengths of background subtraction and the human pose estimation model BlazePose. The biomechanical features, derived from body key points identified by BlazePose, are utilised in a random forest model for classifying fall events. Results The proposed algorithm achieves 89.99% accuracy and 29.7 FPS with a laptop CPU on the UR Fall Detection dataset and the Le2i Fall Detection dataset. The algorithm shows great generalisation and robustness in different scenarios. Conclusion Due to the low computational power of the system, the findings also suggest the potential for implementing the system in small-scale medical monitoring equipment, which maximises its practical value in digital health.
Collapse
Affiliation(s)
- Yue Wang
- Department of Electronic and Electrical Engineering, The University of Sheffield, Sheffield, UK
| | - Tiantai Deng
- Department of Electronic and Electrical Engineering, The University of Sheffield, Sheffield, UK
| |
Collapse
|
21
|
Chato L, Regentova E. Survey of Transfer Learning Approaches in the Machine Learning of Digital Health Sensing Data. J Pers Med 2023; 13:1703. [PMID: 38138930 PMCID: PMC10744730 DOI: 10.3390/jpm13121703] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2023] [Revised: 12/01/2023] [Accepted: 12/08/2023] [Indexed: 12/24/2023] Open
Abstract
Machine learning and digital health sensing data have led to numerous research achievements aimed at improving digital health technology. However, using machine learning in digital health poses challenges related to data availability, such as incomplete, unstructured, and fragmented data, as well as issues related to data privacy, security, and data format standardization. Furthermore, there is a risk of bias and discrimination in machine learning models. Thus, developing an accurate prediction model from scratch can be an expensive and complicated task that often requires extensive experiments and complex computations. Transfer learning methods have emerged as a feasible solution to address these issues by transferring knowledge from a previously trained task to develop high-performance prediction models for a new task. This survey paper provides a comprehensive study of the effectiveness of transfer learning for digital health applications to enhance the accuracy and efficiency of diagnoses and prognoses, as well as to improve healthcare services. The first part of this survey paper presents and discusses the most common digital health sensing technologies as valuable data resources for machine learning applications, including transfer learning. The second part discusses the meaning of transfer learning, clarifying the categories and types of knowledge transfer. It also explains transfer learning methods and strategies, and their role in addressing the challenges in developing accurate machine learning models, specifically on digital health sensing data. These methods include feature extraction, fine-tuning, domain adaptation, multitask learning, federated learning, and few-/single-/zero-shot learning. This survey paper highlights the key features of each transfer learning method and strategy, and discusses the limitations and challenges of using transfer learning for digital health applications. Overall, this paper is a comprehensive survey of transfer learning methods on digital health sensing data which aims to inspire researchers to gain knowledge of transfer learning approaches and their applications in digital health, enhance the current transfer learning approaches in digital health, develop new transfer learning strategies to overcome the current limitations, and apply them to a variety of digital health technologies.
Collapse
Affiliation(s)
- Lina Chato
- Department of Electrical and Computer Engineering, University of Nevada, Las Vegas, NV 89154, USA;
| | | |
Collapse
|
22
|
Yu CH, Yeh CC, Lu YF, Lu YL, Wang TM, Lin FYS, Lu TW. Recurrent Neural Network Methods for Extracting Dynamic Balance Variables during Gait from a Single Inertial Measurement Unit. SENSORS (BASEL, SWITZERLAND) 2023; 23:9040. [PMID: 38005428 PMCID: PMC10675772 DOI: 10.3390/s23229040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/20/2023] [Revised: 10/23/2023] [Accepted: 11/02/2023] [Indexed: 11/26/2023]
Abstract
Monitoring dynamic balance during gait is critical for fall prevention in the elderly. The current study aimed to develop recurrent neural network models for extracting balance variables from a single inertial measurement unit (IMU) placed on the sacrum during walking. Thirteen healthy young and thirteen healthy older adults wore the IMU during walking and the ground truth of the inclination angles (IA) of the center of pressure to the center of mass vector and their rates of changes (RCIA) were measured simultaneously. The IA, RCIA, and IMU data were used to train four models (uni-LSTM, bi-LSTM, uni-GRU, and bi-GRU), with 10% of the data reserved to evaluate the model errors in terms of the root-mean-squared errors (RMSEs) and percentage relative RMSEs (rRMSEs). Independent t-tests were used for between-group comparisons. The sensitivity, specificity, and Pearson's r for the effect sizes between the model-predicted data and experimental ground truth were also obtained. The bi-GRU with the weighted MSE model was found to have the highest prediction accuracy, computational efficiency, and the best ability in identifying statistical between-group differences when compared with the ground truth, which would be the best choice for the prolonged real-life monitoring of gait balance for fall risk management in the elderly.
Collapse
Affiliation(s)
- Cheng-Hao Yu
- Department of Biomedical Engineering, National Taiwan University, Taipei 10617, Taiwan; (C.-H.Y.); (C.-C.Y.); (Y.-L.L.)
| | - Chih-Ching Yeh
- Department of Biomedical Engineering, National Taiwan University, Taipei 10617, Taiwan; (C.-H.Y.); (C.-C.Y.); (Y.-L.L.)
| | - Yi-Fu Lu
- Department of Information Management, National Taiwan University, Taipei 10617, Taiwan; (Y.-F.L.); (F.Y.-S.L.)
| | - Yi-Ling Lu
- Department of Biomedical Engineering, National Taiwan University, Taipei 10617, Taiwan; (C.-H.Y.); (C.-C.Y.); (Y.-L.L.)
- Department of Ophthalmology, Cheng Hsin General Hospital, Taipei 11220, Taiwan
| | - Ting-Ming Wang
- Department of Orthopaedic Surgery, School of Medicine, National Taiwan University, Taipei 10051, Taiwan;
- Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei 10002, Taiwan
| | - Frank Yeong-Sung Lin
- Department of Information Management, National Taiwan University, Taipei 10617, Taiwan; (Y.-F.L.); (F.Y.-S.L.)
| | - Tung-Wu Lu
- Department of Biomedical Engineering, National Taiwan University, Taipei 10617, Taiwan; (C.-H.Y.); (C.-C.Y.); (Y.-L.L.)
- Department of Orthopaedic Surgery, School of Medicine, National Taiwan University, Taipei 10051, Taiwan;
| |
Collapse
|
23
|
Darginavicius L, Vencloviene J, Dobozinskas P, Vaitkaitiene E, Vaitkaitis D, Pranskunas A, Krikscionaitiene A. AI-Enabled Public Surveillance Cameras for Rapid Emergency Medical Service Activation in Out-of-Hospital Cardiac Arrests. Curr Probl Cardiol 2023; 48:101915. [PMID: 37392980 DOI: 10.1016/j.cpcardiol.2023.101915] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2023] [Accepted: 06/27/2023] [Indexed: 07/03/2023]
Abstract
This study aims to evaluate the potential usefulness of a novel artificial intelligence (AI)-based video processing algorithm for rapidly activating ambulance services (EMS) in unwitnessed out-of-hospital cardiac arrest (OHCA) cases in public places. We hypothesized that AI should activate EMS using public surveillance cameras after detecting a person fallen due to OHCA. We created an AI model based on our experiment performed at the Lithuanian University of Health Sciences, Kaunas, Lithuania, in Spring 2023. Our research highlights the potential benefits of AI-based surveillance cameras for rapidly detecting and activating EMS during cardiac arrests.
Collapse
Affiliation(s)
- Linas Darginavicius
- Department of Disaster Medicine, Lithuanian University of Health Sciences, Kaunas, Lithuania.
| | - Jone Vencloviene
- Department of Environmental Sciences, Faculty of Natural Sciences, Vytautas Magnus University, Kaunas, Lithuania
| | - Paulius Dobozinskas
- Department of Disaster Medicine, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Egle Vaitkaitiene
- Department of Disaster Medicine, Lithuanian University of Health Sciences, Kaunas, Lithuania; Department of Public Health, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Dinas Vaitkaitis
- Department of Disaster Medicine, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Andrius Pranskunas
- Department of Intensive Care Medicine, Lithuanian University of Health Sciences, Kaunas, Lithuania
| | - Asta Krikscionaitiene
- Department of Disaster Medicine, Lithuanian University of Health Sciences, Kaunas, Lithuania
| |
Collapse
|
24
|
Guerra BMV, Torti E, Marenzi E, Schmid M, Ramat S, Leporati F, Danese G. Ambient assisted living for frail people through human activity recognition: state-of-the-art, challenges and future directions. Front Neurosci 2023; 17:1256682. [PMID: 37849892 PMCID: PMC10577184 DOI: 10.3389/fnins.2023.1256682] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 09/18/2023] [Indexed: 10/19/2023] Open
Abstract
Ambient Assisted Living is a concept that focuses on using technology to support and enhance the quality of life and well-being of frail or elderly individuals in both indoor and outdoor environments. It aims at empowering individuals to maintain their independence and autonomy while ensuring their safety and providing assistance when needed. Human Activity Recognition is widely regarded as the most popular methodology within the field of Ambient Assisted Living. Human Activity Recognition involves automatically detecting and classifying the activities performed by individuals using sensor-based systems. Researchers have employed various methodologies, utilizing wearable and/or non-wearable sensors, and employing algorithms ranging from simple threshold-based techniques to more advanced deep learning approaches. In this review, literature from the past decade is critically examined, specifically exploring the technological aspects of Human Activity Recognition in Ambient Assisted Living. An exhaustive analysis of the methodologies adopted, highlighting their strengths and weaknesses is provided. Finally, challenges encountered in the field of Human Activity Recognition for Ambient Assisted Living are thoroughly discussed. These challenges encompass issues related to data collection, model training, real-time performance, generalizability, and user acceptance. Miniaturization, unobtrusiveness, energy harvesting and communication efficiency will be the crucial factors for new wearable solutions.
Collapse
Affiliation(s)
- Bruna Maria Vittoria Guerra
- Bioengineering Laboratory, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Emanuele Torti
- Custom Computing and Programmable Systems Laboratory, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Elisa Marenzi
- Custom Computing and Programmable Systems Laboratory, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Micaela Schmid
- Bioengineering Laboratory, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Stefano Ramat
- Bioengineering Laboratory, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Francesco Leporati
- Custom Computing and Programmable Systems Laboratory, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| | - Giovanni Danese
- Custom Computing and Programmable Systems Laboratory, Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy
| |
Collapse
|
25
|
Moutsis SN, Tsintotas KA, Gasteratos A. PIPTO: Precise Inertial-Based Pipeline for Threshold-Based Fall Detection Using Three-Axis Accelerometers. SENSORS (BASEL, SWITZERLAND) 2023; 23:7951. [PMID: 37766008 PMCID: PMC10534597 DOI: 10.3390/s23187951] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2023] [Revised: 09/04/2023] [Accepted: 09/11/2023] [Indexed: 09/29/2023]
Abstract
After traffic-related incidents, falls are the second cause of human death, presenting the highest percentage among the elderly. Aiming to address this problem, the research community has developed methods built upon different sensors, such as wearable, ambiance, or hybrid, and various techniques, such as those that are machine learning- and heuristic based. Concerning the models used in the former case, they classify the input data between fall and no fall, and specific data dimensions are required. Yet, when algorithms that adopt heuristic techniques, mainly using thresholds, are combined with the previous models, they reduce the computational cost. To this end, this article presents a pipeline for detecting falls through a threshold-based technique over the data provided by a three-axis accelerometer. This way, we propose a low-complexity system that can be adopted from any acceleration sensor that receives information at different frequencies. Moreover, the input lengths can differ, while we achieve to detect multiple falls in a time series of sum vector magnitudes, providing the specific time range of the fall. As evaluated on several datasets, our pipeline reaches high performance results at 90.40% and 91.56% sensitivity on MMsys and KFall, respectively, while the generated specificity is 93.96% and 85.90%. Lastly, aiming to facilitate the research community, our framework, entitled PIPTO (drawing inspiration from the Greek verb "πι´πτω", signifying "to fall"), is open sourced in Python and C.
Collapse
Affiliation(s)
- Stavros N. Moutsis
- Department of Production and Management Engineering, Democritus University of Thrace, 12 Vas. Sophias, GR-671 32 Xanthi, Greece; (K.A.T.); (A.G.)
| | | | | |
Collapse
|
26
|
Hellmers S, Krey E, Gashi A, Koschate J, Schmidt L, Stuckenschneider T, Hein A, Zieschang T. Comparison of machine learning approaches for near-fall-detection with motion sensors. Front Digit Health 2023; 5:1223845. [PMID: 37564882 PMCID: PMC10410450 DOI: 10.3389/fdgth.2023.1223845] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Accepted: 07/06/2023] [Indexed: 08/12/2023] Open
Abstract
Introduction Falls are one of the most common causes of emergency hospital visits in older people. Early recognition of an increased fall risk, which can be indicated by the occurrence of near-falls, is important to initiate interventions. Methods In a study with 87 subjects we simulated near-fall events on a perturbation treadmill and recorded them with inertial measurement units (IMU) at seven different positions. We investigated different machine learning models for the near-fall detection including support vector machines, AdaBoost, convolutional neural networks, and bidirectional long short-term memory networks. Additionally, we analyzed the influence of the sensor position on the classification results. Results The best results showed a DeepConvLSTM with an F1 score of 0.954 (precision 0.969, recall 0.942) at the sensor position "left wrist." Discussion Since these results were obtained in the laboratory, the next step is to evaluate the suitability of the classifiers in the field.
Collapse
Affiliation(s)
- Sandra Hellmers
- Assistance Systems and Medical Device Technology, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
| | - Elias Krey
- Assistance Systems and Medical Device Technology, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
| | - Arber Gashi
- Geriatric Medicine, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
| | - Jessica Koschate
- Geriatric Medicine, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
| | - Laura Schmidt
- Geriatric Medicine, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
| | - Tim Stuckenschneider
- Geriatric Medicine, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
| | - Andreas Hein
- Assistance Systems and Medical Device Technology, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
| | - Tania Zieschang
- Geriatric Medicine, Department for Health Services Research, Carl von Ossietzky University, Oldenburg, Germany
| |
Collapse
|
27
|
Ma L, Li X, Liu G, Cai Y. Fall Direction Detection in Motion State Based on the FMCW Radar. SENSORS (BASEL, SWITZERLAND) 2023; 23:5031. [PMID: 37299758 PMCID: PMC10255840 DOI: 10.3390/s23115031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Revised: 05/20/2023] [Accepted: 05/23/2023] [Indexed: 06/12/2023]
Abstract
Accurately detecting falls and providing clear directions for the fall can greatly assist medical staff in promptly developing rescue plans and reducing secondary injuries during transportation to the hospital. In order to facilitate portability and protect people's privacy, this paper presents a novel method for detecting fall direction during motion using the FMCW radar. We analyze the fall direction in motion based on the correlation between different motion states. The range-time (RT) features and Doppler-time (DT) features of the person from the motion state to the fallen state were obtained by using the FMCW radar. We analyzed the different features of the two states and used a two-branch convolutional neural network (CNN) to detect the falling direction of the person. In order to improve the reliability of the model, this paper presents a pattern feature extraction (PFE) algorithm that effectively eliminates noise and outliers in RT maps and DT maps. The experimental results show that the method proposed in this paper has an identification accuracy of 96.27% for different falling directions, which can accurately identify the falling direction and improve the efficiency of rescue.
Collapse
Affiliation(s)
| | - Xingguang Li
- School of Electronic Information Engineering, Changchun University of Science and Technology, Changchun 130022, China (Y.C.)
| | | | | |
Collapse
|
28
|
Shen M, Tsui KL, Nussbaum MA, Kim S, Lure F. An Indoor Fall Monitoring System: Robust, Multistatic Radar Sensing and Explainable, Feature-Resonated Deep Neural Network. IEEE J Biomed Health Inform 2023; 27:1891-1902. [PMID: 37022061 PMCID: PMC10363252 DOI: 10.1109/jbhi.2023.3237077] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
Indoor fall monitoring is challenging for community-dwelling older adults due to the need for high accuracy and privacy concerns. Doppler radar is promising, given its low-cost and contactless sensing mechanism. However, the line-of-sight restriction limits the application of radar sensing in practice, as the Doppler signature will vary when the sensing angle changes, and signal strength will substantially degrade with large aspect angles. Additionally, the similarity of the Doppler signatures among different fall types makes classification challenging. To address these problems, we first present an experimental study to obtain Doppler signals under large and arbitrary aspect angles for diverse types of simulated activities. We then develop a novel, explainable, multi-stream, feature-resonated neural network (eMSFRNet) that achieves fall detection and a pioneering study of classifying seven fall types. eMSFRNet is robust to radar sensing angles and subjects, and is the first method that can resonate and enhance feature information from noisy/weak Doppler signatures. The multiple feature extractors - from ResNet, DenseNet, and VGGNet - extract diverse feature information with various spatial abstractions from a pair of Doppler signals. The resonated-fusion translates the multi-stream features to a single salient feature that is critical to fall detection and classification. eMSFRNet achieved 99.3% accuracy detecting falls and 76.8% accuracy classifying seven fall types. Our work is the firstmultistatic robust sensing system that overcomes the challenges associated with Doppler signatures under large and arbitrary aspect angles. Our work also demonstrates the potential to accommodate radar monitoring tasks that demand precise and robust sensing.
Collapse
|
29
|
Othmen F, Baklouti M, Lazzaretti AE, Hamdi M. Energy-Aware IoT-Based Method for a Hybrid On-Wrist Fall Detection System Using a Supervised Dictionary Learning Technique. SENSORS (BASEL, SWITZERLAND) 2023; 23:3567. [PMID: 37050627 PMCID: PMC10099041 DOI: 10.3390/s23073567] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Revised: 01/31/2023] [Accepted: 03/13/2023] [Indexed: 06/19/2023]
Abstract
In recent decades, falls have posed multiple critical health issues, especially for the older population, with their emerging growth. Recent research has shown that a wrist-based fall detection system offers an accessory-like comfortable solution for Internet of Things (IoT)-based monitoring. Nevertheless, an autonomous device for anywhere-anytime may present an energy consumption concern. Hence, this paper proposes a novel energy-aware IoT-based architecture for Message Queuing Telemetry Transport (MQTT)-based gateway-less monitoring for wearable fall detection. Accordingly, a hybrid double prediction technique based on Supervised Dictionary Learning was implemented to reinforce the detection efficiency of our previous works. A controlled dataset was collected for training (offline), while a real set of measurements of the proposed system was used for validation (online). It achieved a noteworthy offline and online detection performance of 99.8% and 91%, respectively, overpassing most of the related works using only an accelerometer. In the worst case, the system showed a battery consumption optimization by a minimum of 27.32 working hours, significantly higher than other research prototypes. The approach presented here proves to be promising for real applications, which require a reliable and long-term anywhere-anytime solution.
Collapse
Affiliation(s)
- Farah Othmen
- Tunisia Polytechnic School, University of Carthage, La Marsa, Tunis 2078, Tunisia
- CES Lab, University of Sfax, Sfax 3029, Tunisia;
| | | | - André Eugenio Lazzaretti
- Graduate Program in Electrical and Computer Engineering, Federal University of Technology (UTFPR), Curitiba 80230-901, Paraná, Brazil;
| | - Monia Hamdi
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia;
| |
Collapse
|
30
|
Ziyad SR, Altulyan M, Alharbi M. SHMAD: A Smart Health Care System to Monitor Alzheimer's Disease Patients. J Alzheimers Dis 2023; 95:1545-1557. [PMID: 37718805 DOI: 10.3233/jad-230402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/19/2023]
Abstract
BACKGROUND In the digital era monitoring the patient's health status is more effective and consistent with smart healthcare systems. Smart health care facilitates secure and reliable maintenance of patient data. Sensors, machine learning algorithms, Internet of things, and wireless technology has led to the development of Artificial Intelligence-driven Internet of Things models. OBJECTIVE This research study proposes an Artificial Intelligence driven Internet of Things model to monitor Alzheimer's disease patient condition. The proposed Smart health care system to monitor and alert caregivers of Alzheimer's disease patients includes different modules to monitor the health parameters of the patients. This study implements the detection of fall episodes using an artificial intelligence model in Python. METHODS The fall detection model is implemented with data acquired from the IMU open dataset. The ensemble machine learning algorithm AdaBoost performs classification of the fall episode and daily life activity using the feature set of each data sample. The common machine learning classification algorithms are compared for their performance on the IMU fall dataset. RESULTS AdaBoost ensemble classifier exhibits high performance compared to the other machine learning algorithms. The AdaBoost classifier shows 100% accuracy for the IMU dataset. This high accuracy is achieved as multiple weak learners in the ensemble model classify the data samples in the test data accurately. CONCLUSIONS This study proposes a smart healthcare system for monitoring Alzheimer's disease patients. The proposed model can alert the caregiver in case of fall detection via mobile applications installed in smart devices.
Collapse
Affiliation(s)
- Shabana R Ziyad
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al Kharj, Saudi Arabia
| | - May Altulyan
- Department of Computer Engineering, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al Kharj, Saudi Arabia
| | - Meshal Alharbi
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University, Al Kharj, Saudi Arabia
| |
Collapse
|
31
|
O'Connor S, Gasteiger N, Stanmore E, Wong DC, Lee JJ. Artificial intelligence for falls management in older adult care: A scoping review of nurses' role. J Nurs Manag 2022; 30:3787-3801. [PMID: 36197748 PMCID: PMC10092211 DOI: 10.1111/jonm.13853] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Revised: 08/29/2022] [Accepted: 09/30/2022] [Indexed: 12/30/2022]
Abstract
AIM This study aims to synthesize evidence on nurses' involvement in artificial intelligence research for managing falls in older adults. BACKGROUND Artificial intelligence techniques are used to analyse health datasets to aid clinical decision making, patient care and service delivery but nurses' involvement in this area of research for managing falls in older adults remains unknown. EVALUATION A scoping review was conducted. CINAHL, the Cochrane Library, Embase, MEDLI and PubMed were searched. Results were screened against inclusion criteria. Relevant data were extracted, and studies summarized using a descriptive approach. KEY ISSUES The evidence shows many artificial intelligence techniques, particularly machine learning, are used to identify falls risk factors and build predictive models that could help prevent falls in older adults, with nurses leading and participating in this research. CONCLUSION Further rigorous experimental research is needed to determine the effectiveness of algorithms in predicting aspects of falls in older adults and how to implement artificial intelligence tools in gerontological nursing practice. IMPLICATIONS FOR NURSING MANAGEMENT Nurses should pursue interdisciplinary collaborations and educational opportunities in artificial intelligence, so they can actively contribute to research on falls management. Nurses should facilitate the collection of digital falls datasets to support this emerging research agenda and the care of older adults.
Collapse
Affiliation(s)
- Siobhan O'Connor
- Division of Nursing, Midwifery and Social Work, School of Health SciencesThe University of ManchesterManchesterUK
| | - Norina Gasteiger
- Division of Nursing, Midwifery and Social Work, School of Health SciencesThe University of ManchesterManchesterUK
- Division of Informatics, Imaging and Data SciencesThe University of ManchesterManchesterUK
| | - Emma Stanmore
- Division of Nursing, Midwifery and Social Work, School of Health SciencesThe University of ManchesterManchesterUK
| | - David C. Wong
- Division of Informatics, Imaging and Data SciencesThe University of ManchesterManchesterUK
| | - Jung Jae Lee
- School of NursingThe University of Hong KongPokfulamHong Kong
| |
Collapse
|
32
|
Nazir T, Mushhood Ur Rehman M, Asghar MR, Kalia JS. Artificial intelligence assisted acute patient journey. Front Artif Intell 2022; 5:962165. [PMID: 36267660 PMCID: PMC9577284 DOI: 10.3389/frai.2022.962165] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Accepted: 09/12/2022] [Indexed: 11/13/2022] Open
Abstract
Artificial intelligence is taking the world by storm and soon will be aiding patients in their journey at the hospital. The trials and tribulations of the healthcare system during the COVID-19 pandemic have set the stage for shifting healthcare from a physical to a cyber-physical space. A physician can now remotely monitor a patient, admitting them only if they meet certain thresholds, thereby reducing the total number of admissions at the hospital. Coordination, communication, and resource management have been core issues for any industry. However, it is most accurate in healthcare. Both systems and providers are exhausted under the burden of increasing data and complexity of care delivery, increasing costs, and financial burden. Simultaneously, there is a digital transformation of healthcare in the making. This transformation provides an opportunity to create systems of care that are artificial intelligence-enabled. Healthcare resources can be utilized more justly. The wastage of financial and intellectual resources in an overcrowded healthcare system can be avoided by implementing IoT, telehealth, and AI/ML-based algorithms. It is imperative to consider the design principles of the patient's journey while simultaneously prioritizing a better user experience to alleviate physician concerns. This paper discusses the entire blueprint of the AI/ML-assisted patient journey and its impact on healthcare provision.
Collapse
Affiliation(s)
- Talha Nazir
- Research Fellow, NeuroCare.AI Neuroscience Academy, Dallas, TX, United States,*Correspondence: Talha Nazir
| | | | | | - Junaid S. Kalia
- NeuroCare.AI, Dallas, TX, United States,Neurologypocketbook.com, Dallas, TX, United States,Junaid S. Kalia
| |
Collapse
|
33
|
A Simplistic and Cost-Effective Design for Real-World Development of an Ambient Assisted Living System for Fall Detection and Indoor Localization: Proof-of-Concept. INFORMATION 2022. [DOI: 10.3390/info13080363] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023] Open
Abstract
Falls, highly common in the constantly increasing global aging population, can have a variety of negative effects on their health, well-being, and quality of life, including restricting their capabilities to conduct activities of daily living (ADLs), which are crucial for one’s sustenance. Timely assistance during falls is highly necessary, which involves tracking the indoor location of the elderly during their diverse navigational patterns associated with different activities to detect the precise location of a fall. With the decreasing caregiver population on a global scale, it is important that the future of intelligent living environments can detect falls during ADLs while being able to track the indoor location of the elderly in the real world. Prior works in these fields have several limitations, such as the lack of functionalities to detect falls and indoor locations in a simultaneous manner, high cost of implementation, complicated design, the requirement of multiple hardware components for deployment, and the necessity to develop new hardware for implementation, which make the wide-scale deployment of such technologies challenging. To address these challenges, this work proposes a cost-effective and simplistic design paradigm for an ambient assisted living system that can capture multimodal components of user behaviors during ADLs that are necessary for performing fall detection and indoor localization in a simultaneous manner in the real-world. Proof-of-concept results from real-world experiments are presented to uphold the effective working of the system. The findings from two comparative studies with prior works in this field are also presented to uphold the novelty of this work. The first comparative study shows how the proposed system outperforms prior works in the areas of indoor localization and fall detection in terms of the effectiveness of its software design and hardware design. The second comparative study shows that the cost of the development of this system is the lowest as compared to prior works in these fields, which involved real-world development of the underlining systems, thereby upholding its cost-effective nature.
Collapse
|
34
|
Salimi M, Machado JJM, Tavares JMRS. Using Deep Neural Networks for Human Fall Detection Based on Pose Estimation. SENSORS (BASEL, SWITZERLAND) 2022; 22:4544. [PMID: 35746325 PMCID: PMC9229309 DOI: 10.3390/s22124544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 06/03/2022] [Accepted: 06/11/2022] [Indexed: 06/15/2023]
Abstract
Requests for caring for and monitoring the health and safety of older adults are increasing nowadays and form a topic of great social interest. One of the issues that lead to serious concerns is human falls, especially among aged people. Computer vision techniques can be used to identify fall events, and Deep Learning methods can detect them with optimum accuracy. Such imaging-based solutions are a good alternative to body-worn solutions. This article proposes a novel human fall detection solution based on the Fast Pose Estimation method. The solution uses Time-Distributed Convolutional Long Short-Term Memory (TD-CNN-LSTM) and 1Dimentional Convolutional Neural Network (1D-CNN) models, to classify the data extracted from image frames, and achieved high accuracies: 98 and 97% for the 1D-CNN and TD-CNN-LSTM models, respectively. Therefore, by applying the Fast Pose Estimation method, which has not been used before for this purpose, the proposed solution is an effective contribution to accurate human fall detection, which can be deployed in edge devices due to its low computational and memory demands.
Collapse
Affiliation(s)
- Mohammadamin Salimi
- Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, s/n, 4200-465 Porto, Portugal;
| | - José J. M. Machado
- Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, s/n, 4200-465 Porto, Portugal;
| | - João Manuel R. S. Tavares
- Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, s/n, 4200-465 Porto, Portugal;
| |
Collapse
|
35
|
Vision-based human fall detection systems using deep learning: A review. Comput Biol Med 2022; 146:105626. [DOI: 10.1016/j.compbiomed.2022.105626] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/02/2022] [Revised: 03/08/2022] [Accepted: 04/06/2022] [Indexed: 11/24/2022]
|
36
|
Relationship between Associated Neuropsychological Factors and Fall Risk Factors in Community-Dwelling Elderly. Healthcare (Basel) 2022; 10:healthcare10040728. [PMID: 35455905 PMCID: PMC9025626 DOI: 10.3390/healthcare10040728] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2022] [Revised: 04/07/2022] [Accepted: 04/10/2022] [Indexed: 12/10/2022] Open
Abstract
This study examined whether neuropsychological factors could affect fall risk factors in the community-dwelling elderly via correlation analysis. A total of 393 older adults (76.69 ± 6.01) participated in this study. Cognitive function, depression, fall efficacy, balance confidence, balance, gait, and muscle strength were evaluated, and the correlation between psychological factors and fall risk factors was analyzed. Additionally, a multiple regression analysis was conducted to determine whether or not there was a significant effect between psychological factors and fall risk factors. Analysis showed that the psychological factors examined were all significantly correlated with the fall risk factors. A correlation analysis between cognitive function and fall risk factors showed that the correlation coefficient of the 6-Meter Walk Test was highest; for depression and fall risk factors, the correlation coefficient of gait speed was highest; for fall efficacy and fall risk factors, the correlation coefficient of the 6-Meter Walk Test was highest; and for confidence in balancing and fall risk factors, the correlation coefficient of the 6-Meter Walk Test was highest. This study suggests that psychological factors affect fall risk factors in the community-dwelling elderly, and a multifaceted approach that includes psychological factors would be helpful in providing interventions for falls.
Collapse
|
37
|
SÖZER AT. Denetimsiz Anomali Tespiti Yaklaşımı ile Düşme Algılama. BITLIS EREN ÜNIVERSITESI FEN BILIMLERI DERGISI 2022; 11:88-98. [DOI: 10.17798/bitlisfen.997760] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
Abstract
Yaşlı nüfusunun hızla artması ve yaşlılığa bağlı olarak karşılaşılan fiziksel, duyusal ve bilişsel gerilemeler, düşmeyi her geçen gün büyüyen bir problem olarak karşımıza çıkarmakta ve düşme tespiti çalışmalarının hız kazanmasına sebep olmaktadır. Günlük aktivitelerin düşmeden ayırt edilmesinden ibaret olan düşme tespiti probleminde, denetimli öğrenme yaklaşımları kullanılmasına rağmen, düşmenin nadir rastlanan ve çok farklı biçimlerde karşılaşılabilen bir olay olması genel bir model elde edilmesine izin vermemektedir. Bu çalışmada denetimsiz anomali tespiti ile düşmenin belirlenmesi önerilmektedir. Denetimsiz öğrenme modelinin elde edilmesinde ve model vasıtasıyla düşmenin tespitinde 35 tip düşme ve 44 tip günlük aktiviteye sahip kapsamlı bir veri setinden faydalanılmıştır. Denetimsiz öğrenme yöntemi olan Gauss karışım modelinin eğitiminde, günlük aktivitelerden toplanan 3-eksen ivmeölçer sinyallerinden elde edilen öznitelikler kullanılmıştır. Test aşamasında model, düşme ve günlük aktivite verileri ile karşılaşmış, modele göre olasılığı çok düşük olan veriler anomali, dolayısıyla düşme olarak kabul edilmiştir. Testlerde düşmeler %90,5 civarında doğru olarak tespit edilmiştir. Sonuçlar düşmenin anomali tespiti yaklaşımları ile belirlenebileceğini ve makine öğrenmesi modelinin elde edilmesi için yalnız günlük aktivite verilerinin yeterli olduğu yaklaşımını doğrulamaktadır.
Collapse
|
38
|
Blackburn J, Ousey K, Stephenson J, Lui S. Exploring the impact of experiencing a long lie fall on physical and clinical outcomes in older people requiring an ambulance: A systematic review. Int Emerg Nurs 2022; 62:101148. [PMID: 35245728 DOI: 10.1016/j.ienj.2022.101148] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 01/15/2022] [Accepted: 01/28/2022] [Indexed: 11/28/2022]
Abstract
BACKGROUND The long term impacts of experiencing a 'long lie' following a fall in the older person are poorly understood. This systematic review explored the impact of a long lie fall on physical and clinical outcomes in older people requiring an ambulance. METHODS PRISMA guidelines were followed. RESULTS 70 studies were identified. Nine studies were suitable for full review. Four studies meeting the inclusion criteria were included. The Critical Appraisal Skill Programme (CASP) assessed the quality of all included studies. Three studies reported on people aged 65 years and older. One study reported on people aged over 90 years. Personal alarm use was examined in two studies. One study explored patient characteristics of people confirmed to have fallen by paramedics at the scene. One study examined re-contact and characteristics of fallers referred to a falls prevention service. DISCUSSION Cognitive impairment and long lie were a caveat for falls and repeated falls. Personal alarm use was infrequent, suggesting a need for supporting the older patient in appropriate alarm use and exploration of newer technologies to alleviate their need. Future research should focus on interventions for wearable, smart and e-technology for automatic fall detection and qualitative exploration of the lived experience.
Collapse
Affiliation(s)
- Joanna Blackburn
- Institute of Skin Integrity and Infection Prevention, School of Human and Health Sciences, University of Huddersfield, Huddersfield, UK.
| | - Karen Ousey
- Institute of Skin Integrity and Infection Prevention, School of Human and Health Sciences, University of Huddersfield, Huddersfield, UK; Clinical Professor, Queensland University of Technology, Australia.
| | - John Stephenson
- School of Human and Health Sciences, University of Huddersfield, Huddersfield, UK.
| | - Steve Lui
- School of Human and Health Sciences, University of Huddersfield, Huddersfield, UK.
| |
Collapse
|
39
|
Saho K, Hayashi S, Tsuyama M, Meng L, Masugi M. Machine Learning-Based Classification of Human Behaviors and Falls in Restroom via Dual Doppler Radar Measurements. SENSORS 2022; 22:s22051721. [PMID: 35270868 PMCID: PMC8915019 DOI: 10.3390/s22051721] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 02/18/2022] [Accepted: 02/20/2022] [Indexed: 12/04/2022]
Abstract
This study presents a radar-based remote measurement system for classification of human behaviors and falls in restrooms without privacy invasion. Our system uses a dual Doppler radar mounted onto a restroom ceiling and wall. Machine learning methods, including the convolutional neural network (CNN), long short-term memory, support vector machine, and random forest methods, are applied to the Doppler radar data to verify the model’s efficiency and features. Experimental results from 21 participants demonstrated the accurate classification of eight realistic behaviors, including falling. Using the Doppler spectrograms (time–velocity distribution) as the inputs, CNN showed the best results with an overall classification accuracy of 95.6% and 100% fall classification accuracy. We confirmed that these accuracies were better than those achieved by conventional restroom monitoring techniques using thermal sensors and radars. Furthermore, the comparison results of various machine learning methods and cases using each radar’s data show that the higher-order derivative parameters of acceleration and jerk, and the motion information in the horizontal direction are the efficient features for behavior classification in a restroom. These findings indicate that daily restroom monitoring using the proposed radar system accurately recognizes human behaviors and allows early detection of fall accidents.
Collapse
Affiliation(s)
- Kenshi Saho
- Department of Intelligent Robotics, Toyama Prefectural University, Imizu 939-0398, Japan
- Department of Electronic and Computer Engineering, Ritsumeikan University, Kusatsu 525-8577, Japan; (S.H.); (M.T.); (L.M.); (M.M.)
- Correspondence:
| | - Sora Hayashi
- Department of Electronic and Computer Engineering, Ritsumeikan University, Kusatsu 525-8577, Japan; (S.H.); (M.T.); (L.M.); (M.M.)
| | - Mutsuki Tsuyama
- Department of Electronic and Computer Engineering, Ritsumeikan University, Kusatsu 525-8577, Japan; (S.H.); (M.T.); (L.M.); (M.M.)
| | - Lin Meng
- Department of Electronic and Computer Engineering, Ritsumeikan University, Kusatsu 525-8577, Japan; (S.H.); (M.T.); (L.M.); (M.M.)
| | - Masao Masugi
- Department of Electronic and Computer Engineering, Ritsumeikan University, Kusatsu 525-8577, Japan; (S.H.); (M.T.); (L.M.); (M.M.)
| |
Collapse
|
40
|
An Instrumented Apartment to Monitor Human Behavior: A Pilot Case Study in the NeuroTec Loft. SENSORS 2022; 22:s22041657. [PMID: 35214560 PMCID: PMC8875023 DOI: 10.3390/s22041657] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/20/2022] [Revised: 02/17/2022] [Accepted: 02/18/2022] [Indexed: 11/16/2022]
Abstract
For patients suffering from neurodegenerative disorders, the behavior and activities of daily living are an indicator of a change in health status, and home-monitoring over a prolonged period of time by unobtrusive sensors is a promising technology to foster independent living and maintain quality of life. The aim of this pilot case study was the development of a multi-sensor system in an apartment to unobtrusively monitor patients at home during the day and night. The developed system is based on unobtrusive sensors using basic technologies and gold-standard medical devices measuring physiological (e.g., mobile electrocardiogram), movement (e.g., motion tracking system), and environmental parameters (e.g., temperature). The system was evaluated during one session by a healthy 32-year-old male, and results showed that the sensor system measured accurately during the participant’s stay. Furthermore, the participant did not report any negative experiences. Overall, the multi-sensor system has great potential to bridge the gap between laboratories and older adults’ homes and thus for a deep and novel understanding of human behavioral and neurological disorders. Finally, this new understanding could be utilized to develop new algorithms and sensor systems to address problems and increase the quality of life of our aging society and patients with neurological disorders.
Collapse
|
41
|
Bayón C, Keemink AQL, van Mierlo M, Rampeltshammer W, van der Kooij H, van Asseldonk EHF. Cooperative ankle-exoskeleton control can reduce effort to recover balance after unexpected disturbances during walking. J Neuroeng Rehabil 2022; 19:21. [PMID: 35172846 PMCID: PMC8851842 DOI: 10.1186/s12984-022-01000-y] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2021] [Accepted: 02/02/2022] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND In the last two decades, lower-limb exoskeletons have been developed to assist human standing and locomotion. One of the ongoing challenges is the cooperation between the exoskeleton balance support and the wearer control. Here we present a cooperative ankle-exoskeleton control strategy to assist in balance recovery after unexpected disturbances during walking, which is inspired on human balance responses. METHODS We evaluated the novel controller in ten able-bodied participants wearing the ankle modules of the Symbitron exoskeleton. During walking, participants received unexpected forward pushes with different timing and magnitude at the pelvis level, while being supported (Exo-Assistance) or not (Exo-NoAssistance) by the robotic assistance provided by the controller. The effectiveness of the assistive strategy was assessed in terms of (1) controller performance (Detection Delay, Joint Angles, and Exerted Ankle Torques), (2) analysis of effort (integral of normalized Muscle Activity after perturbation onset); and (3) Analysis of center of mass COM kinematics (relative maximum COM Motion, Recovery Time and Margin of Stability) and spatio-temporal parameters (Step Length and Swing Time). RESULTS In general, the results show that when the controller was active, it was able to reduce participants' effort while keeping similar ability to counteract and withstand the balance disturbances. Significant reductions were found for soleus and gastrocnemius medialis activity of the stance leg when comparing Exo-Assistance and Exo-NoAssistance walking conditions. CONCLUSIONS The proposed controller was able to cooperate with the able-bodied participants in counteracting perturbations, contributing to the state-of-the-art of bio-inspired cooperative ankle exoskeleton controllers for supporting dynamic balance. In the future, this control strategy may be used in exoskeletons to support and improve balance control in users with motor disabilities.
Collapse
Affiliation(s)
- Cristina Bayón
- Department of Biomechanical Engineering, University of Twente, Enschede, The Netherlands
| | - Arvid Q. L. Keemink
- Department of Biomechanical Engineering, University of Twente, Enschede, The Netherlands
| | - Michelle van Mierlo
- Department of Biomechanical Engineering, University of Twente, Enschede, The Netherlands
| | | | - Herman van der Kooij
- Department of Biomechanical Engineering, University of Twente, Enschede, The Netherlands
- Department of BioMechanical Engineering, Delft University of Technology, Delft, The Netherlands
| | | |
Collapse
|
42
|
Pinto ABA, de Assis GA, Torres LCB, Beltrame T, Domingues DMG. Wearables and Detection of Falls: A Comparison of Machine Learning Methods and Sensors Positioning. Neural Process Lett 2022. [DOI: 10.1007/s11063-021-10724-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
43
|
Ben-Sadoun G, Michel E, Annweiler C, Sacco G. Human Fall Detection Using Passive Infrared Sensors with Low Resolution: A Systematic Review. Clin Interv Aging 2022; 17:35-53. [PMID: 35046646 PMCID: PMC8763199 DOI: 10.2147/cia.s329668] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Accepted: 10/09/2021] [Indexed: 12/20/2022] Open
Affiliation(s)
- Grégory Ben-Sadoun
- Department of Geriatric Medicine and Memory Clinic, Research Center on Autonomy and Longevity, University Hospital of Angers, Angers, France
- Normandie Université, UNICAEN, INSERM, COMETE, CYCERON, CHU Caen, Caen, 14000, France
- Correspondence: Grégory Ben-Sadoun Department of Geriatric Medicine and Memory Clinic, Research Center on Autonomy and Longevity, University Hospital of Angers, Angers, France, Email ; ;
| | - Emeline Michel
- Université Côte d’Azur, Centre Hospitalier Universitaire de Nice, Clinique Gériatrique du Cerveau et du Mouvement, Nice, France
- Université Côte d’Azur, LAMHESS, Nice, France
| | - Cédric Annweiler
- Department of Geriatric Medicine and Memory Clinic, Research Center on Autonomy and Longevity, University Hospital of Angers, Angers, France
- Laboratoire de Psychologie des Pays de la Loire, Univ Angers, Université de Nantes, EA 4638 LPPL, SFR CONFLUENCES, Angers, F-49000, France
- School of Medicine, Health Faculty, University of Angers, Angers, France
- Robarts Research Institute, Department of Medical Biophysics, Schulich School of Medicine and Dentistry, The University of Western Ontario, London, ON, Canada
| | - Guillaume Sacco
- Université Côte d’Azur, Centre Hospitalier Universitaire de Nice, Clinique Gériatrique du Cerveau et du Mouvement, Nice, France
- Laboratoire de Psychologie des Pays de la Loire, Univ Angers, Université de Nantes, EA 4638 LPPL, SFR CONFLUENCES, Angers, F-49000, France
- Université Côte d’Azur, CoBTek, Nice, France
| |
Collapse
|
44
|
Wang P, Li Q, Yin P, Wang Z, Ling Y, Gravina R, Li Y. A convolution neural network approach for fall detection based on adaptive channel selection of UWB radar signals. Neural Comput Appl 2022. [DOI: 10.1007/s00521-021-06795-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
AbstractAccording to the World Health Organization and other authorities, falls are one of the main causes of accidental injuries among the elderly population. Therefore, it is essential to detect and predict the fall activities of older persons in indoor environments such as homes, nursing, senior residential centers, and care facilities. Due to non-contact and signal confidentiality characteristics, radar equipment is widely used in indoor care, detection, and rescue. This paper proposes an adaptive channel selection algorithm to separate the activity signals from the background using an ultra-wideband radar and to generalize fused features of frequency- and time-domain images which will be sent to a lightweight convolutional neural network to detect and recognize fall activities. The experimental results show that the method is able to distinguish three types of fall activities (i.e., stand to fall, bow to fall, and squat to fall) and obtain a high recognition accuracy up to 95.7%.
Collapse
|
45
|
Baserga A, Grandi F, Masciadri A, Comai S, Salice F. High-Efficiency Multi-Sensor System for Chair Usage Detection. SENSORS 2021; 21:s21227580. [PMID: 34833654 PMCID: PMC8620359 DOI: 10.3390/s21227580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 11/02/2021] [Accepted: 11/05/2021] [Indexed: 11/16/2022]
Abstract
Recognizing Activities of Daily Living (ADL) or detecting falls in domestic environments require monitoring the movements and positions of a person. Several approaches use wearable devices or cameras, especially for fall detection, but they are considered intrusive by many users. To support such activities in an unobtrusive way, ambient-based solutions are available (e.g., based on PIRs, contact sensors, etc.). In this paper, we focus on the problem of sitting detection exploiting only unobtrusive sensors. In fact, sitting detection can be useful to understand the position of the user in many activities of the daily routines. While identifying sitting/lying on a sofa or bed is reasonably simple with pressure sensors, detecting whether a person is sitting on a chair is an open problem due to the natural chair position volatility. This paper proposes a reliable, not invasive and energetically sustainable system that can be used on chairs already present in the home. In particular, the proposed solution fuses the data of an accelerometer and a capacitive coupling sensor to understand if a person is sitting or not, discriminating the case of objects left on the chair. The results obtained in a real environment setting show an accuracy of 98.6% and a precision of 95%.
Collapse
Affiliation(s)
- Alessandro Baserga
- Department of Physics, Politecnico di Milano, 20133 Milan, Italy; (A.B.); (F.G.)
| | - Federico Grandi
- Department of Physics, Politecnico di Milano, 20133 Milan, Italy; (A.B.); (F.G.)
| | - Andrea Masciadri
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milano, Italy; (A.M.); (F.S.)
| | - Sara Comai
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milano, Italy; (A.M.); (F.S.)
- Correspondence:
| | - Fabio Salice
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, 20133 Milano, Italy; (A.M.); (F.S.)
| |
Collapse
|
46
|
Lin WY, Chen CH, Lee MY. Design and Implementation of a Wearable Accelerometer-Based Motion/Tilt Sensing Internet of Things Module and Its Application to Bed Fall Prevention. BIOSENSORS 2021; 11:bios11110428. [PMID: 34821644 PMCID: PMC8615976 DOI: 10.3390/bios11110428] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 10/17/2021] [Accepted: 10/27/2021] [Indexed: 06/13/2023]
Abstract
Accelerometer-based motion sensing has been extensively applied to fall detection. However, such applications can only detect fall accidents; therefore, a system that can prevent fall accidents is desirable. Bed falls account for more than half of patient falls and are preceded by a clear warning indicator: the patient attempting to get out of bed. This study designed and implemented an Internet of Things module, namely, Bluetooth low-energy-enabled Accelerometer-based Sensing In a Chip-packaging (BASIC) module, with a tilt-sensing algorithm based on the patented low-complexity COordinate Rotation DIgital Computer (CORDIC)-based algorithm for tilt angle conversions. It is applied for detecting the postural changes (from lying down to sitting up) and to protect individuals at a high risk of bed falls by prompting caregivers to take preventive actions and assist individuals trying to get up. This module demonstrates how motion and tilt sensing can be applied to bed fall prevention. The module can be further miniaturized or integrated into a wearable device and commercialized in smart health-care applications for bed fall prevention in hospitals and homes.
Collapse
Affiliation(s)
- Wen-Yen Lin
- Center for Biomedical Engineering, Department of Electrical Engineering, Chang Gung University, Tao-Yuan 33302, Taiwan
- Division of Cardiology, Department of Internal Medicine, Chang Gung Memorial Hospital, Tao-Yuan 33302, Taiwan;
| | - Chien-Hung Chen
- Graduate Institute of Biomedical Engineering, Chang Gung University, Tao-Yuan 33302, Taiwan;
| | - Ming-Yih Lee
- Division of Cardiology, Department of Internal Medicine, Chang Gung Memorial Hospital, Tao-Yuan 33302, Taiwan;
- Graduate Institute of Biomedical Engineering, Chang Gung University, Tao-Yuan 33302, Taiwan;
| |
Collapse
|
47
|
ALJawaee MA, Jones MD, Theobald PS, Williams JM. Does wobble board training improve balance in older adults? A systematic review. PHYSICAL THERAPY REVIEWS 2021. [DOI: 10.1080/10833196.2021.1987042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Affiliation(s)
- Madawi A. ALJawaee
- Medical Engineering Research Group, School of Engineering, Cardiff University, Cardiff, UK
- Princess Nourah bint Abdulrahman University, Riyadh, Kingdom of Saudi Arabia
| | - Michael D. Jones
- Medical Engineering Research Group, School of Engineering, Cardiff University, Cardiff, UK
| | - Peter S. Theobald
- Medical Engineering Research Group, School of Engineering, Cardiff University, Cardiff, UK
| | | |
Collapse
|
48
|
A Study of One-Class Classification Algorithms for Wearable Fall Sensors. BIOSENSORS-BASEL 2021; 11:bios11080284. [PMID: 34436087 PMCID: PMC8394742 DOI: 10.3390/bios11080284] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Revised: 08/10/2021] [Accepted: 08/14/2021] [Indexed: 11/22/2022]
Abstract
In recent years, the popularity of wearable devices has fostered the investigation of automatic fall detection systems based on the analysis of the signals captured by transportable inertial sensors. Due to the complexity and variety of human movements, the detection algorithms that offer the best performance when discriminating falls from conventional Activities of Daily Living (ADLs) are those built on machine learning and deep learning mechanisms. In this regard, supervised machine learning binary classification methods have been massively employed by the related literature. However, the learning phase of these algorithms requires mobility patterns caused by falls, which are very difficult to obtain in realistic application scenarios. An interesting alternative is offered by One-Class Classifiers (OCCs), which can be exclusively trained and configured with movement traces of a single type (ADLs). In this paper, a systematic study of the performance of various typical OCCs (for diverse sets of input features and hyperparameters) is performed when applied to nine public repositories of falls and ADLs. The results show the potentials of these classifiers, which are capable of achieving performance metrics very similar to those of supervised algorithms (with values for the specificity and the sensitivity higher than 95%). However, the study warns of the need to have a wide variety of types of ADLs when training OCCs, since activities with a high degree of mobility can significantly increase the frequency of false alarms (ADLs identified as falls) if not considered in the data subsets used for training.
Collapse
|
49
|
A Study of Fall Detection in Assisted Living: Identifying and Improving the Optimal Machine Learning Method. JOURNAL OF SENSOR AND ACTUATOR NETWORKS 2021. [DOI: 10.3390/jsan10030039] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
This paper makes four scientific contributions to the field of fall detection in the elderly to contribute to their assisted living in the future of Internet of Things (IoT)-based pervasive living environments, such as smart homes. First, it presents and discusses a comprehensive comparative study, where 19 different machine learning methods were used to develop fall detection systems, to deduce the optimal machine learning method for the development of such systems. This study was conducted on two different datasets, and the results show that out of all the machine learning methods, the k-NN classifier is best suited for the development of fall detection systems in terms of performance accuracy. Second, it presents a framework that overcomes the limitations of binary classifier-based fall detection systems by being able to detect falls and fall-like motions. Third, to increase the trust and reliance on fall detection systems, it introduces a novel methodology based on the usage of k-folds cross-validation and the AdaBoost algorithm that improves the performance accuracy of the k-NN classifier-based fall detection system to the extent that it outperforms all similar works in this field. This approach achieved performance accuracies of 99.87% and 99.66%, respectively, when evaluated on the two datasets. Finally, the proposed approach is also highly accurate in detecting the activity of standing up from a lying position to infer whether a fall was followed by a long lie, which can cause minor to major health-related concerns. The above contributions address multiple research challenges in the field of fall detection, that we identified after conducting a comprehensive review of related works, which is also presented in this paper.
Collapse
|
50
|
High Accuracy WiFi-Based Human Activity Classification System with Time-Frequency Diagram CNN Method for Different Places. SENSORS 2021; 21:s21113797. [PMID: 34070922 PMCID: PMC8199261 DOI: 10.3390/s21113797] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Revised: 05/24/2021] [Accepted: 05/28/2021] [Indexed: 11/30/2022]
Abstract
Older people are very likely to fall, which is a significant threat to the health. However, falls are preventable and are not necessarily an inevitable part of aging. Many different fall detection systems have been developed to help people avoid falling. However, traditional systems based on wearable devices or image recognition-based have many disadvantages, such as user-unfriendly, privacy issues. Recently, WiFi-based fall detection systems try to solve the above problems. However, there is a common problem of reduced accuracy. Since the system is trained at the original signal collecting/training place, however, the application is at a different place. The proposed solution only extracts the features of the changed signal, which is caused by a specific human action. To implement this, we used Channel State Information (CSI) to train Convolutional Neural Networks (CNNs) and further classify the action. We have designed a prototype to test the performance of our proposed method. Our simulation results show an average accuracy of same place and different place is 93.2% and 90.3%, respectively.
Collapse
|