1
|
Zhang S, Chen B, Chen C, Hovorka M, Qi J, Hu J, Yin G, Acosta M, Bautista R, Darwiche HF, Little BE, Palacio C, Hovorka J. Myoelectric signal and machine learning computing in gait pattern recognition for flat fall prediction. MEDICINE IN NOVEL TECHNOLOGY AND DEVICES 2025; 25:100341. [DOI: 10.1016/j.medntd.2024.100341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2025] Open
|
2
|
Meng L, Zhang X, Shi Y, Li X, Pang J, Chen L, Zhu X, Xu R, Ming D. Inertial-Based Dual-Task Gait Normalcy Index at Turns: A Potential Novel Gait Biomarker for Early-Stage Parkinson's Disease. IEEE Trans Neural Syst Rehabil Eng 2025; 33:687-695. [PMID: 40031335 DOI: 10.1109/tnsre.2025.3535696] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
As one of the main motor indicators of Parkinson's disease (PD), postural instability and gait disorder (PIGD) might manifest in various but subtle symptoms at early stage resulting in relatively high misdiagnosis rate. Quantitative gait assessment under dual task or complex motor task (i.e., turning) may contribute to better understanding of PIGD and provide a better diagnostic indicator of early-stage PD. However, few studies have explored gait deviation evaluation algorithms under a complex dual task that reflect disease specificity. In this work, we proposed a novel inertial-based gait normalcy index (GNI) based on inertial-based quantitative gait assessment model to characterize the overall gait performance during both straight walking and turning with or without serial-3 subtraction task. The factor of group and task on the GNI variable was investigated and the feasibility of GNI to improve early-stage PD diagnostic performance was validated. The experimental results showed that the task paradigm is a significant factor on GNI performance where the dual-task GNI at turn had the best discriminating ability between early PD and HC (AUC =0.992) and was significantly correlated with UPDRS III (r =0.81), MMSE(r =0.57) and Mini-BEST(r =0.65). We also observed that the turning-based GNI has larger effect size compared to clinical scales, demonstrating that GNI during turning can reflect the changes of functional mobility in rehabilitation for the early PD. Our work offers an innovative and potential gait biomarker for early-stage PD diagnostics and provides a new perspective into gait performance of complex dual task and its application in early PD.
Collapse
|
3
|
Meng L, Shi Y, Zhao H, Wang D, Zhu X, Ming D. The inertial-based gait normalcy index of dual task cost during turning quantifies gait automaticity improvement in early-stage Parkinson's rehabilitation. J Neuroeng Rehabil 2024; 21:166. [PMID: 39300485 PMCID: PMC11411860 DOI: 10.1186/s12984-024-01456-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2024] [Accepted: 09/02/2024] [Indexed: 09/22/2024] Open
Abstract
BACKGROUND The loss of gait automaticity is a key cause of motor deficits in Parkinson's disease (PD) patients, even at the early stage of the disease. Action observation training (AOT) shows promise in enhancing gait automaticity. However, effective assessment methods are lacking. We aimed to propose a novel gait normalcy index based on dual task cost (NIDTC) and evaluate its validity and responsiveness for early-stage PD rehabilitation. METHODS Thirty early-stage PD patients were recruited and randomly assigned to the AOT or active control (CON) group. The proposed NIDTC during straight walking and turning tasks and clinical scale scores were measured before and after 12 weeks of rehabilitation. The correlations between the NIDTCs and clinical scores were analyzed with Pearson correlation coefficient analysis to evaluate the construct validity. The rehabilitative changes were assessed using repeated-measures ANOVA, while the responsiveness of NIDTC was further compared by t tests. RESULTS The turning-based NIDTC was significantly correlated with multiple clinical scales. Significant group-time interactions were observed for the turning-based NIDTC (F = 4.669, p = 0.042), BBS (F = 6.050, p = 0.022) and PDQ-39 (F = 7.772, p = 0.011) tests. The turning-based NIDTC reflected different rehabilitation effects between the AOT and CON groups, with the largest effect size (p = 0.020, Cohen's d = 0.933). CONCLUSION The turning-based NIDTC exhibited the highest responsiveness for identifying gait automaticity improvement by providing a comprehensive representation of motor ability during dual tasks. It has great potential as a valid measure for early-stage PD diagnosis and rehabilitation assessment. Trial registration Chinese Clinical Trial Registry: ChiCTR2300067657.
Collapse
Affiliation(s)
- Lin Meng
- Academy of Medical Engineering and Translational Medicine, Medical School, Faculty of Medicine, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin, 300072, China.
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, No. 26 Ziyuan Road, Xiqing District, Tianjin, 300392, China.
| | - Yu Shi
- Academy of Medical Engineering and Translational Medicine, Medical School, Faculty of Medicine, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin, 300072, China
| | - Hongbo Zhao
- Academy of Medical Engineering and Translational Medicine, Medical School, Faculty of Medicine, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin, 300072, China
| | - Deyu Wang
- Academy of Medical Engineering and Translational Medicine, Medical School, Faculty of Medicine, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin, 300072, China
| | - Xiaodong Zhu
- Department of Neurology, Tianjin Medical University General Hospital, No. 154 Anshan Road, Heping District, Tianjin, 300052, China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Medical School, Faculty of Medicine, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin, 300072, China
| |
Collapse
|
4
|
Wang Y, Li Z, Zhao G, Ding Y, Huan Z, Chen L. Assessment of lumbar disc herniation-impaired gait by using IMU data fusion method. Comput Methods Biomech Biomed Engin 2024:1-12. [PMID: 38940627 DOI: 10.1080/10255842.2024.2370404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Accepted: 06/05/2024] [Indexed: 06/29/2024]
Abstract
The inertial motion unit (IMU) is an effective tool for monitoring and assessing gait impairment in patients with lumbar disc herniation(LDH). However, the current clinical assessment methods for LDH gait focus on patients' subjective scoring indicators and lack the assessment of kinematic ability; at the same time, individual differences in the motor function degradation of the healthy and affected lower limbs of LDH patients are also ignored. To solve this problem, we propose an LDH gait feature model based on multi-source adaptive Kalman data fusion of acceleration and angular velocity. The gait phase is segmented by using an adaptive Kalman data fusion algorithm to estimate the attitude angle, and obtaining gait events through a zero-velocity update technique and a peak detection algorithm. Two IMUs were used to analyze the gait characteristics of lumbar disc patients and healthy gait people, including 12 gait characteristics such as gait spatiotemporal parameters, kinematic parameters, gait variability and stability. Statistical methods were used to analyze the characteristic model and verify the biological differences between the healthy affected side of LDH and healthy subjects. Finally, feature engineering and machine learning technology were used to identify the gait pattern of inertial movement units in patients with lumbar intervertebral disc disease, and achieved a classification accuracy of 95.50%, providing an effective gait feature set and method for clinical evaluation of LDH.
Collapse
Affiliation(s)
- Yongsong Wang
- School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou, Jiangsu, China
| | - Zhixin Li
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, Jiangsu, China
| | - Guohui Zhao
- Department of Orthopedics, The Affiliated Changzhou No. 2 People's Hospital of Nanjing Medical University, Changzhou, China
| | - Yin Ding
- Department of Orthopedics, The Affiliated Changzhou No. 2 People's Hospital of Nanjing Medical University, Changzhou, China
| | - Zhan Huan
- School of Microelectronics and Control Engineering, Changzhou University, Changzhou, Jiangsu, China
| | - Lin Chen
- School of Computer Science and Artificial Intelligence, Changzhou University, Changzhou, Jiangsu, China
| |
Collapse
|
5
|
Samadi Kohnehshahri F, Merlo A, Mazzoli D, Bò MC, Stagni R. Machine learning applied to gait analysis data in cerebral palsy and stroke: A systematic review. Gait Posture 2024; 111:105-121. [PMID: 38663321 DOI: 10.1016/j.gaitpost.2024.04.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Revised: 03/08/2024] [Accepted: 04/08/2024] [Indexed: 05/26/2024]
Abstract
BACKGROUND Among neurological pathologies, cerebral palsy and stroke are the main contributors to walking disorders. Machine learning methods have been proposed in the recent literature to analyze gait data from these patients. However, machine learning methods still fail to translate effectively into clinical applications. This systematic review addressed the gaps hindering the use of machine learning data analysis in the clinical assessment of cerebral palsy and stroke patients. RESEARCH QUESTION What are the main challenges in transferring proposed machine learning methods to clinical applications? METHODS PubMed, Web of Science, Scopus, and IEEE databases were searched for relevant publications on machine learning methods applied to gait analysis data from stroke and cerebral palsy patients until February the 23rd, 2023. Information related to the suitability, feasibility, and reliability of the proposed methods for their effective translation to clinical use was extracted, and quality was assessed based on a set of predefined questions. RESULTS From 4120 resulting references, 63 met the inclusion criteria. Thirty-one studies used supervised, and 32 used unsupervised machine learning methods. Artificial neural networks and k-means clustering were the most used methods in each category. The lack of rationale for features and algorithm selection, the use of unrepresentative datasets, and the lack of clinical interpretability of the clustering outputs were the main factors hindering the clinical reliability and applicability of these methods. SIGNIFICANCE The literature offers numerous machine learning methods for clustering gait data from cerebral palsy and stroke patients. However, the clinical significance of the proposed methods is still lacking, limiting their translation to real-world applications. The design of future studies must take into account clinical question, dataset significance, feature and model selection, and interpretability of the results, given their criticality for clinical translation.
Collapse
Affiliation(s)
- Farshad Samadi Kohnehshahri
- Department of Electronic and Information Engineering, University of Bologna, Italy; Gait and Motion Analysis Laboratory, Sol et Salus Hospital, Torre Pedrera, Rimini, Italy.
| | - Andrea Merlo
- Gait and Motion Analysis Laboratory, Sol et Salus Hospital, Torre Pedrera, Rimini, Italy.
| | - Davide Mazzoli
- Gait and Motion Analysis Laboratory, Sol et Salus Hospital, Torre Pedrera, Rimini, Italy.
| | - Maria Chiara Bò
- Gait and Motion Analysis Laboratory, Sol et Salus Hospital, Torre Pedrera, Rimini, Italy; Merlo Bioengineering, Parma, Italy.
| | - Rita Stagni
- Department of Electronic and Information Engineering, University of Bologna, Italy.
| |
Collapse
|
6
|
Jiao Y, Hart R, Reading S, Zhang Y. Systematic review of automatic post-stroke gait classification systems. Gait Posture 2024; 109:259-270. [PMID: 38367457 DOI: 10.1016/j.gaitpost.2024.02.011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 01/11/2024] [Accepted: 02/12/2024] [Indexed: 02/19/2024]
Abstract
BACKGROUND Gait classification is a clinically helpful task performed after a stroke in order to guide rehabilitation therapy. Gait disorders are commonly identified using observational gait analysis in clinical settings, but this approach is limited due to low reliability and accuracy. Data-driven gait classification can quantify gait deviations and categorise gait patterns automatically possibly improving reliability and accuracy; however, the development and clinical utility of current data driven systems has not been reviewed previously. RESEARCH QUESTION The purpose of this systematic review is to evaluate the literature surrounding the methodology used to develop automatic gait classification systems, and their potential effectiveness in the clinical management of stroke-affected gait. METHOD The database search included PubMed, IEEE Xplore, and Scopus. Twenty-one studies were identified through inclusion and exclusion criteria from 407 available studies published between 2015 and 2022. Development methodology, classification performance, and clinical utility information were extracted for review. RESULTS AND SIGNIFICANCE Most of gait classification systems reported a classification accuracy between 80%-100%. However, collated studies presented methodological errors in machine learning (ML) model development. Further, many studies neglected model components such as clinical utility (e.g., predictions don't assist clinicians or therapists in making decisions, interpretability, and generalisability). We provided recommendations to guide development of future post-stroke automatic gait classification systems to better assist clinicians and therapists. Future automatic gait classification systems should emphasise the clinical significance and adopt a standardised development methodology of ML model.
Collapse
Affiliation(s)
- Yiran Jiao
- Department of Exercise Sciences, Faculty of Science, University of Auckland, Auckland 1023, New Zealand
| | - Rylea Hart
- Department of Exercise Sciences, Faculty of Science, University of Auckland, Auckland 1023, New Zealand
| | - Stacey Reading
- Department of Exercise Sciences, Faculty of Science, University of Auckland, Auckland 1023, New Zealand
| | - Yanxin Zhang
- Department of Exercise Sciences, Faculty of Science, University of Auckland, Auckland 1023, New Zealand.
| |
Collapse
|
7
|
Park J, Lee Y, Cho S, Choe A, Yeom J, Ro YG, Kim J, Kang DH, Lee S, Ko H. Soft Sensors and Actuators for Wearable Human-Machine Interfaces. Chem Rev 2024; 124:1464-1534. [PMID: 38314694 DOI: 10.1021/acs.chemrev.3c00356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Haptic human-machine interfaces (HHMIs) combine tactile sensation and haptic feedback to allow humans to interact closely with machines and robots, providing immersive experiences and convenient lifestyles. Significant progress has been made in developing wearable sensors that accurately detect physical and electrophysiological stimuli with improved softness, functionality, reliability, and selectivity. In addition, soft actuating systems have been developed to provide high-quality haptic feedback by precisely controlling force, displacement, frequency, and spatial resolution. In this Review, we discuss the latest technological advances of soft sensors and actuators for the demonstration of wearable HHMIs. We particularly focus on highlighting material and structural approaches that enable desired sensing and feedback properties necessary for effective wearable HHMIs. Furthermore, promising practical applications of current HHMI technology in various areas such as the metaverse, robotics, and user-interactive devices are discussed in detail. Finally, this Review further concludes by discussing the outlook for next-generation HHMI technology.
Collapse
Affiliation(s)
- Jonghwa Park
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Youngoh Lee
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Seungse Cho
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Ayoung Choe
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Jeonghee Yeom
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Yun Goo Ro
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Jinyoung Kim
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Dong-Hee Kang
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Seungjae Lee
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| | - Hyunhyub Ko
- School of Energy and Chemical Engineering, Ulsan National Institute of Science and Technology (UNIST), Ulsan Metropolitan City 44919, Republic of Korea
| |
Collapse
|
8
|
El-Adawi E, Essa E, Handosa M, Elmougy S. Wireless body area sensor networks based human activity recognition using deep learning. Sci Rep 2024; 14:2702. [PMID: 38302545 PMCID: PMC10834495 DOI: 10.1038/s41598-024-53069-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Accepted: 01/27/2024] [Indexed: 02/03/2024] Open
Abstract
In the healthcare sector, the health status and biological, and physical activity of the patient are monitored among different sensors that collect the required information about these activities using Wireless body area network (WBAN) architecture. Sensor-based human activity recognition (HAR), which offers remarkable qualities of ease and privacy, has drawn increasing attention from researchers with the growth of the Internet of Things (IoT) and wearable technology. Deep learning has the ability to extract high-dimensional information automatically, making end-to-end learning. The most significant obstacles to computer vision, particularly convolutional neural networks (CNNs), are the effect of the environment background, camera shielding, and other variables. This paper aims to propose and develop a new HAR system in WBAN dependence on the Gramian angular field (GAF) and DenseNet. Once the necessary signals are obtained, the input signals undergo pre-processing through artifact removal and median filtering. In the initial stage, the time series data captured by the sensors undergoes a conversion process, transforming it into 2-dimensional images by using the GAF algorithm. Then, DenseNet automatically makes the processes and integrates the data collected from diverse sensors. The experiment results show that the proposed method achieves the best outcomes in which it achieves 97.83% accuracy, 97.83% F-measure, and 97.64 Matthews correlation coefficient (MCC).
Collapse
Affiliation(s)
- Ehab El-Adawi
- Department of Computer Science, Faculty of Computers and Information, Mansoura University, Mansoura, 35516, Egypt
| | - Ehab Essa
- Department of Computer Science, Faculty of Computers and Information, Mansoura University, Mansoura, 35516, Egypt.
| | - Mohamed Handosa
- Department of Computer Science, Faculty of Computers and Information, Mansoura University, Mansoura, 35516, Egypt
| | - Samir Elmougy
- Department of Computer Science, Faculty of Computers and Information, Mansoura University, Mansoura, 35516, Egypt.
| |
Collapse
|
9
|
Wang Y, Pei Z, Wang C, Tang Z. Depth-aware pose estimation using deep learning for exoskeleton gait analysis. Sci Rep 2023; 13:22681. [PMID: 38114592 PMCID: PMC10730887 DOI: 10.1038/s41598-023-50207-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 12/16/2023] [Indexed: 12/21/2023] Open
Abstract
In rehabilitation medicine, real-time analysis of the gait for human wearing lower-limb exoskeleton rehabilitation robot during walking can effectively prevent patients from experiencing excessive and asymmetric gait during rehabilitation training, thereby avoiding falls or even secondary injuries. To address the above situation, we propose a gait detection method based on computer vision for the real-time monitoring of gait during human-machine integrated walking. Specifically, we design a neural network model called GaitPoseNet, which is used for posture recognition in human-machine integrated walking. Using RGB images as input and depth features as output, regression of joint coordinates through depth estimation of implicit supervised networks. In addition, joint guidance strategy (JGS) is designed in the network framework. The degree of correlation between the various joints of the human body is used as a detection target to effectively overcome prediction difficulties due to partial joint occlusion during walking. Finally, a post processing algorithm is designed to describe patients' walking motion by combining the pixel coordinates of each joint point and leg length. Our advantage is that we provide a non-contact measurement method with strong universality, and use depth estimation and JGS to improve measurement accuracy. Conducting experiments on the Walking Pose with Exoskeleton (WPE) Dataset shows that our method can reach 95.77% PCKs@0.1, 93.14% PCKs@0.08 and 3.55 ms runtime. Therefore our method achieves advanced performance considering both speed and accuracy.
Collapse
Affiliation(s)
- Yachun Wang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191, China
| | - Zhongcai Pei
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191, China
| | - Chen Wang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191, China
| | - Zhiyong Tang
- School of Automation Science and Electrical Engineering, Beihang University, Beijing, 100191, China.
| |
Collapse
|
10
|
Liu T, Liu X. Perspectives in Wearable Systems in the Human-Robot Interaction (HRI) Field. SENSORS (BASEL, SWITZERLAND) 2023; 23:8315. [PMID: 37837147 PMCID: PMC10575189 DOI: 10.3390/s23198315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Revised: 09/29/2023] [Accepted: 10/07/2023] [Indexed: 10/15/2023]
Abstract
Due to the advantages of ease of use, less motion disturbance, and low cost, wearable systems have been widely used in the human-machine interaction (HRI) field. However, HRI in complex clinical rehabilitation scenarios has further requirements for wearable sensor systems, which has aroused the interest of many researchers. However, the traditional wearable system has problems such as low integration, limited types of measurement data, and low accuracy, causing a gap with the actual needs of HRI. This paper will introduce the latest progress in the current wearable systems of HRI from four aspects. First of all, it introduces the breakthroughs of current research in system integration, which includes processing chips and flexible sensing modules to reduce the system's volume and increase battery life. After that, this paper reviews the latest progress of wearable systems in electrochemical measurement, which can extract single or multiple biomarkers from biological fluids such as sweat. In addition, the clinical application of non-invasive wearable systems is introduced, which solves the pain and discomfort problems caused by traditional clinical invasive measurement equipment. Finally, progress in the combination of current wearable systems and the latest machine-learning methods is shown, where higher accuracy and indirect acquisition of data that cannot be directly measured is achieved. From the evidence presented, we believe that the development trend of wearable systems in HRI is heading towards high integration, multi-electrochemical measurement data, and clinical and intelligent development.
Collapse
|
11
|
Gupta R, Kumari S, Senapati A, Ambasta RK, Kumar P. New era of artificial intelligence and machine learning-based detection, diagnosis, and therapeutics in Parkinson's disease. Ageing Res Rev 2023; 90:102013. [PMID: 37429545 DOI: 10.1016/j.arr.2023.102013] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Revised: 06/26/2023] [Accepted: 07/06/2023] [Indexed: 07/12/2023]
Abstract
Parkinson's disease (PD) is characterized by the loss of neuronal cells, which leads to synaptic dysfunction and cognitive defects. Despite the advancements in treatment strategies, the management of PD is still a challenging event. Early prediction and diagnosis of PD are of utmost importance for effective management of PD. In addition, the classification of patients with PD as compared to normal healthy individuals also imposes drawbacks in the early diagnosis of PD. To address these challenges, artificial intelligence (AI) and machine learning (ML) models have been implicated in the diagnosis, prediction, and treatment of PD. Recent times have also demonstrated the implication of AI and ML models in the classification of PD based on neuroimaging methods, speech recording, gait abnormalities, and others. Herein, we have briefly discussed the role of AI and ML in the diagnosis, treatment, and identification of novel biomarkers in the progression of PD. We have also highlighted the role of AI and ML in PD management through altered lipidomics and gut-brain axis. We briefly explain the role of early PD detection through AI and ML algorithms based on speech recordings, handwriting patterns, gait abnormalities, and neuroimaging techniques. Further, the review discuss the potential role of the metaverse, the Internet of Things, and electronic health records in the effective management of PD to improve the quality of life. Lastly, we also focused on the implementation of AI and ML-algorithms in neurosurgical process and drug discovery.
Collapse
Affiliation(s)
- Rohan Gupta
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA.
| | - Smita Kumari
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA
| | | | - Rashmi K Ambasta
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA
| | - Pravir Kumar
- Molecular Neuroscience and Functional Genomics Laboratory, Department of Biotechnology, Delhi Technological, University, USA.
| |
Collapse
|
12
|
Liang W, Wang F, Fan A, Zhao W, Yao W, Yang P. Extended Application of Inertial Measurement Units in Biomechanics: From Activity Recognition to Force Estimation. SENSORS (BASEL, SWITZERLAND) 2023; 23:s23094229. [PMID: 37177436 PMCID: PMC10180901 DOI: 10.3390/s23094229] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 04/20/2023] [Accepted: 04/22/2023] [Indexed: 05/15/2023]
Abstract
Abnormal posture or movement is generally the indicator of musculoskeletal injuries or diseases. Mechanical forces dominate the injury and recovery processes of musculoskeletal tissue. Using kinematic data collected from wearable sensors (notably IMUs) as input, activity recognition and musculoskeletal force (typically represented by ground reaction force, joint force/torque, and muscle activity/force) estimation approaches based on machine learning models have demonstrated their superior accuracy. The purpose of the present study is to summarize recent achievements in the application of IMUs in biomechanics, with an emphasis on activity recognition and mechanical force estimation. The methodology adopted in such applications, including data pre-processing, noise suppression, classification models, force/torque estimation models, and the corresponding application effects, are reviewed. The extent of the applications of IMUs in daily activity assessment, posture assessment, disease diagnosis, rehabilitation, and exoskeleton control strategy development are illustrated and discussed. More importantly, the technical feasibility and application opportunities of musculoskeletal force prediction using IMU-based wearable devices are indicated and highlighted. With the development and application of novel adaptive networks and deep learning models, the accurate estimation of musculoskeletal forces can become a research field worthy of further attention.
Collapse
Affiliation(s)
- Wenqi Liang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Fanjie Wang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Ao Fan
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Wenrui Zhao
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Wei Yao
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| | - Pengfei Yang
- Key Laboratory for Space Bioscience and Biotechnology, School of Life Sciences, Northwestern Polytechnical University, Xi'an 710072, China
| |
Collapse
|
13
|
Han Y, Liu X, Zhang N, Zhang X, Zhang B, Wang S, Liu T, Yi J. Automatic Assessments of Parkinsonian Gait with Wearable Sensors for Human Assistive Systems. SENSORS (BASEL, SWITZERLAND) 2023; 23:2104. [PMID: 36850705 PMCID: PMC9959760 DOI: 10.3390/s23042104] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 01/28/2023] [Accepted: 02/09/2023] [Indexed: 06/18/2023]
Abstract
The rehabilitation evaluation of Parkinson's disease has always been the research focus of human assistive systems. It is a research hotspot to objectively and accurately evaluate the gait condition of Parkinson's disease patients, thereby adjusting the actuators of the human-machine system and making rehabilitation robots better adapt to the recovery process of patients. The rehabilitation evaluation of Parkinson's disease has always been the research focus of rehabilitation robots. It is a research hotspot to be able to objectively and accurately evaluate the recovery of Parkinson's disease patients, thereby adjusting the driving module of the human-machine collaboration system in real time, so that rehabilitation robots can better adapt to the recovery process of Parkinson's disease. The gait task in the Unified Parkinson's Disease Rating Scale (UPDRS) is a widely accepted standard for assessing the gait impairments of patients with Parkinson's disease (PD). However, the assessments conducted by neurologists are always subjective and inaccurate, and the results are determined by the neurologists' observation and clinical experience. Thus, in this study, we proposed a novel machine learning-based method of automatically assessing the gait task in UPDRS with wearable sensors as a more convenient and objective alternative means for PD gait assessment. In the design, twelve gait features, including three spatial-temporal features and nine kinematic features, were extracted and calculated from two shank-mounted IMUs. A novel nonlinear model is developed for calculating the score of gait task from the gait features. Twenty-five PD patients and twenty-eight healthy subjects were recruited for validating the proposed method. For comparison purpose, three traditional models, which have been used in previous studies, were also tested by the same dataset. In terms of percentages of participants, 84.9%, 73.6%, 73.6%, and 66.0% of the participants were accurately assigned into the true level with the proposed nonlinear model, the support vector machine model, the naive Bayes model, and the linear regression model, respectively, which indicates that the proposed method has a good performance on calculating the score of the UPDRS gait task and conformance with the rating done by neurologists.
Collapse
Affiliation(s)
- Yi Han
- The State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China
- Department of Intelligent Mechanical Systems Engineering, Kochi University of Technology, Kochi 782-8502, Japan
| | - Xiangzhi Liu
- The State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Ning Zhang
- The National Research Center for Rehabilitation Technical Aids, Beijing 102676, China
| | - Xiufeng Zhang
- The National Research Center for Rehabilitation Technical Aids, Beijing 102676, China
| | - Bin Zhang
- The College of Mechanical and Electrical Engineering, China Jiliang University, Hangzhou 310018, China
| | - Shuoyu Wang
- Department of Intelligent Mechanical Systems Engineering, Kochi University of Technology, Kochi 782-8502, Japan
| | - Tao Liu
- The State Key Laboratory of Fluid Power and Mechatronic Systems, School of Mechanical Engineering, Zhejiang University, Hangzhou 310027, China
| | - Jingang Yi
- Department of Mechanical and Aerospace Engineering, Rutgers University, Piscataway, NJ 08854, USA
| |
Collapse
|
14
|
Guo Y, Yang J, Liu Y, Chen X, Yang GZ. Detection and assessment of Parkinson's disease based on gait analysis: A survey. Front Aging Neurosci 2022; 14:916971. [PMID: 35992585 PMCID: PMC9382193 DOI: 10.3389/fnagi.2022.916971] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2022] [Accepted: 07/08/2022] [Indexed: 11/13/2022] Open
Abstract
Neurological disorders represent one of the leading causes of disability and mortality in the world. Parkinson's Disease (PD), for example, affecting millions of people worldwide is often manifested as impaired posture and gait. These impairments have been used as a clinical sign for the early detection of PD, as well as an objective index for pervasive monitoring of the PD patients in daily life. This review presents the evidence that demonstrates the relationship between human gait and PD, and illustrates the role of different gait analysis systems based on vision or wearable sensors. It also provides a comprehensive overview of the available automatic recognition systems for the detection and management of PD. The intervening measures for improving gait performance are summarized, in which the smart devices for gait intervention are emphasized. Finally, this review highlights some of the new opportunities in detecting, monitoring, and treating of PD based on gait, which could facilitate the development of objective gait-based biomarkers for personalized support and treatment of PD.
Collapse
Affiliation(s)
- Yao Guo
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Jianxin Yang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Yuxuan Liu
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| | - Xun Chen
- Department of Electronic Engineering and Information Science, University of Science and Technology of China, Hefei, China
| | - Guang-Zhong Yang
- Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
15
|
Bo F, Yerebakan M, Dai Y, Wang W, Li J, Hu B, Gao S. IMU-Based Monitoring for Assistive Diagnosis and Management of IoHT: A Review. Healthcare (Basel) 2022; 10:healthcare10071210. [PMID: 35885736 PMCID: PMC9318359 DOI: 10.3390/healthcare10071210] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Revised: 06/20/2022] [Accepted: 06/23/2022] [Indexed: 01/22/2023] Open
Abstract
With the rapid development of Internet of Things (IoT) technologies, traditional disease diagnoses carried out in medical institutions can now be performed remotely at home or even ambient environments, yielding the concept of the Internet of Health Things (IoHT). Among the diverse IoHT applications, inertial measurement unit (IMU)-based systems play a significant role in the detection of diseases in many fields, such as neurological, musculoskeletal, and mental. However, traditional numerical interpretation methods have proven to be challenging to provide satisfying detection accuracies owing to the low quality of raw data, especially under strong electromagnetic interference (EMI). To address this issue, in recent years, machine learning (ML)-based techniques have been proposed to smartly map IMU-captured data on disease detection and progress. After a decade of development, the combination of IMUs and ML algorithms for assistive disease diagnosis has become a hot topic, with an increasing number of studies reported yearly. A systematic search was conducted in four databases covering the aforementioned topic for articles published in the past six years. Eighty-one articles were included and discussed concerning two aspects: different ML techniques and application scenarios. This review yielded the conclusion that, with the help of ML technology, IMUs can serve as a crucial element in disease diagnosis, severity assessment, characteristic estimation, and monitoring during the rehabilitation process. Furthermore, it summarizes the state-of-the-art, analyzes challenges, and provides foreseeable future trends for developing IMU-ML systems for IoHT.
Collapse
Affiliation(s)
- Fan Bo
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Mustafa Yerebakan
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL 32611, USA;
| | - Yanning Dai
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China;
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing 100191, China
| | - Weibing Wang
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Jia Li
- Smart Sensing Research and Development Center, Institute of Microelectronics, Chinese Academy of Sciences, Beijing 100029, China; (F.B.); (W.W.)
- School of Microelectronics, University of Chinese Academy of Sciences, Beijing 100049, China
- Correspondence: (J.L.); (B.H.); (S.G.)
| | - Boyi Hu
- Department of Industrial and Systems Engineering, University of Florida, Gainesville, FL 32611, USA;
- Correspondence: (J.L.); (B.H.); (S.G.)
| | - Shuo Gao
- School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China;
- Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, Beihang University, Beijing 100191, China
- Correspondence: (J.L.); (B.H.); (S.G.)
| |
Collapse
|
16
|
Yang X, Ye Q, Cai G, Wang Y, Cai G. PD-ResNet for Classification of Parkinson's Disease From Gait. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2022; 10:2200111. [PMID: 35795875 PMCID: PMC9252336 DOI: 10.1109/jtehm.2022.3180933] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Revised: 05/04/2022] [Accepted: 05/25/2022] [Indexed: 11/28/2022]
Abstract
OBJECTIVE To develop an objective and efficient method to automatically identify Parkinson's disease (PD) and healthy control (HC). METHODS We design a novel model based on residual network (ResNet) architecture, named PD-ResNet, to learn the gait differences between PD and HC and between PD with different severity levels. Specifically, a polynomial elevated dimensions technique is applied to increase the dimensions of the input gait features; then, the processed data is transformed into a 3-dimensional picture as the input of PD-ResNet. The synthetic minority over-sampling technique (SMOTE), data augmentation, and early stopping technologies are adopted to improve the generalization ability. To further enhance the classification performance, a new loss function, named improved focal loss function, is developed to focus on the train of PD-ResNet on the hard samples and to discard the abnormal samples. RESULTS The experiments on the clinical gait dataset show that our proposed model achieves excellent performance with an accuracy of 95.51%, a precision of 94.44%, a recall of 96.59%, a specificity of 94.44%, and an F1-score of 95.50%. Moreover, the accuracy, precision, recall, specificity, and F1-score for the classification of early PD and HC are 92.03%, 94.20%, 90.28%, 93.94%, and 92.20%, respectively. Furthermore, the accuracy, precision, recall, specificity, and F1-score for the classification of PD with different severity levels are 92.03%, 94.29%, 90.41%, 93.85%, and 92.31%, respectively. CONCLUSION Our proposed method shows better performance than the traditional machine learning and deep learning methods. CLINICAL IMPACT The experimental results show that the proposed method is clinically meaningful for the objective assessment of gait motor impairment for PD patients.
Collapse
Affiliation(s)
- Xiaoli Yang
- School of Information EngineeringGuangdong University of TechnologyGuangzhou510000China
| | - Qinyong Ye
- Department of NeurologyFujian Medical University Union HospitalFuzhou350001China
| | - Guofa Cai
- School of Information EngineeringGuangdong University of TechnologyGuangzhou510000China
| | - Yingqing Wang
- Department of NeurologyFujian Medical University Union HospitalFuzhou350001China
| | - Guoen Cai
- Department of NeurologyFujian Medical University Union HospitalFuzhou350001China
| |
Collapse
|
17
|
Three decades of gait index development: A comparative review of clinical and research gait indices. Clin Biomech (Bristol, Avon) 2022; 96:105682. [PMID: 35640522 DOI: 10.1016/j.clinbiomech.2022.105682] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 03/14/2022] [Accepted: 05/17/2022] [Indexed: 02/07/2023]
Abstract
BACKGROUND A wide variety of indices have been developed to quantify gait performance markers and associate them with their respective pathologies. Indices scores have enabled better decisions regarding patient treatments and allowed for optimized monitoring of the evolution of their condition. The extensive range of human gait indices presented over the last 30 years is evaluated and summarized in this narrative literature review exploring their application in clinical and research environments. METHODS The analysis will explore historical and modern gait indices, focusing on the clinical efficacy with respect to their proposed pathology, age range, and associated parameter limits. Features, methods, and clinically acceptable errors are discussed while simultaneously assessing indices advantages and disadvantages. This review analyses all indices published between 1994 and February 2021 identified using the Medline, PubMed, ScienceDirect, CINAHL, EMBASE, and Google Scholar databases. FINDINGS A total of 30 indices were identified as noteworthy for clinical and research purposes and another 137 works were included for discussion. The indices were divided in three major groups: observational (13), instrumented (16) and hybrid (1). The instrumented indices were further sub-divided in six groups, namely kinematic- (4), spatiotemporal- (5), kinetic- (2), kinematic- and kinetic- (2), electromyographic- (1) and Inertial Measurement Unit-based indices (2). INTERPRETATION This work is one of the first reviews to summarize observational and instrumented gait indices, exploring their applicability in research and clinical contexts. The aim of this review is to assist members of these communities with the selection of the proper index for the group in analysis.
Collapse
|
18
|
Measurement, Evaluation, and Control of Active Intelligent Gait Training Systems—Analysis of the Current State of the Art. ELECTRONICS 2022. [DOI: 10.3390/electronics11101633] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
Gait recognition and rehabilitation has been a research hotspot in recent years due to its importance to medical care and elderly care. Active intelligent rehabilitation and assistance systems for lower limbs integrates mechanical design, sensing technology, intelligent control, and robotics technology, and is one of the effective ways to resolve the above problems. In this review, crucial technologies and typical prototypes of active intelligent rehabilitation and assistance systems for gait training are introduced. The limitations, challenges, and future directions in terms of gait measurement and intention recognition, gait rehabilitation evaluation, and gait training control strategies are discussed. To address the core problems of the sensing, evaluation and control technology of the active intelligent gait training systems, the possible future research directions are proposed. Firstly, different sensing methods need to be proposed for the decoding of human movement intention. Secondly, the human walking ability evaluation models will be developed by integrating the clinical knowledge and lower limb movement data. Lastly, the personalized gait training strategy for collaborative control of human–machine systems needs to be implemented in the clinical applications.
Collapse
|
19
|
A Review on the Rehabilitation Exoskeletons for the Lower Limbs of the Elderly and the Disabled. ELECTRONICS 2022. [DOI: 10.3390/electronics11030388] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/11/2023]
Abstract
Research on the lower limb exoskeleton for rehabilitation have developed rapidly to meet the need of the aging population. The rehabilitation exoskeleton system is a wearable man–machine integrated mechanical device. In recent years, the vigorous development of exoskeletal technology has brought new ideas to the rehabilitation and medical treatment of patients with motion dysfunction, which is expected to help such people complete their daily physiological activities or even reshape their motion function. The rehabilitation exoskeletons conduct assistance based on detecting intention, control algorithm, and high-performance actuators. In this paper, we review rehabilitation exoskeletons from the aspects of the overall design, driving unit, intention perception, compliant control, and efficiency validation. We discussed the complexity and coupling of the man–machine integration system, and we hope to provide a guideline when designing a rehabilitation exoskeleton system for the lower limbs of elderly and disabled patients.
Collapse
|
20
|
Liu W, Xiao Y, Wang X, Deng F. Plantar Pressure Detection System Based on Flexible Hydrogel Sensor Array and WT-RF. SENSORS (BASEL, SWITZERLAND) 2021; 21:5964. [PMID: 34502855 PMCID: PMC8434643 DOI: 10.3390/s21175964] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/02/2021] [Revised: 08/27/2021] [Accepted: 08/30/2021] [Indexed: 11/21/2022]
Abstract
This paper presents a hydrogel-based flexible sensor array to detect plantar pressure distribution and recognize the gait patterns to assist those who suffer from gait disorders to rehabilitate better. The traditional pressure detection array is composed of rigid metal sensors, which have poor biocompatibility and expensive manufacturing costs. To solve the above problems, we have designed and fabricated a novel flexible sensor array based on AAM/NaCl (Acrylamide/Sodium chloride) hydrogel and PI (Polyimide) membrane. The proposed array exhibits excellent structural flexibility (209 KPa) and high sensitivity (12.3 mV·N-1), which allows it to be in full contact with the sole of the foot to collect pressure signals accurately. The Wavelet Transform-Random Forest (WT-RF) algorithm is introduced to recognize the gaits based on the plantar pressure signals. Wavelet transform realizes the signal filtering and normalization, and random forest is responsible for the classification of the processed signals. The classification accuracy of the WT-RF algorithm reaches 91.9%, which ensures the precise recognition of gaits.
Collapse
Affiliation(s)
| | | | | | - Fangming Deng
- School of Electrical and Automation Engineering, East China Jiaotong University, Nanchang 330013, China; (W.L.); (Y.X.); (X.W.)
| |
Collapse
|
21
|
Lee K, Tang W. A Fully Wireless Wearable Motion Tracking System with 3D Human Model for Gait Analysis. SENSORS 2021; 21:s21124051. [PMID: 34204656 PMCID: PMC8231225 DOI: 10.3390/s21124051] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/03/2021] [Revised: 06/09/2021] [Accepted: 06/10/2021] [Indexed: 01/14/2023]
Abstract
This paper presents a wearable motion tracking system with recording and playback features. This system has been designed for gait analysis and interlimb coordination studies. It can be implemented to help reduce fall risk and to retrain gait in a rehabilitation setting. Our system consists of ten custom wearable straps, a receiver, and a central computer. Comparing with similar existing solutions, the proposed system is affordable and convenient, which can be used in both indoor and outdoor settings. In the experiment, the system calculates five gait parameters and has the potential to identify deviant gait patterns. The system can track upper body parameters such as arm swing, which has potential in the study of pathological gaits and the coordination of the limbs.
Collapse
Affiliation(s)
- Kevin Lee
- Engineering Physics and Electrical Engineering, New Mexico State University Main Campus, 1125 Frenger Mall, Las Cruces, NM 88003, USA;
| | - Wei Tang
- Klipsch School of Electrical and Computer Engineering, New Mexico State University Main Campus, 1125 Frenger Mall, Las Cruces, NM 88003, USA
- Correspondence:
| |
Collapse
|
22
|
Recent Progress in Sensing and Computing Techniques for Human Activity Recognition and Motion Analysis. ELECTRONICS 2020. [DOI: 10.3390/electronics9091357] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
The recent scientific and technical advances in Internet of Things (IoT) based pervasive sensing and computing have created opportunities for the continuous monitoring of human activities for different purposes. The topic of human activity recognition (HAR) and motion analysis, due to its potentiality in human–machine interaction (HMI), medical care, sports analysis, physical rehabilitation, assisted daily living (ADL), children and elderly care, has recently gained increasing attention. The emergence of some novel sensing devices featuring miniature size, a light weight, and wireless data transmission, the availability of wireless communication infrastructure, the progress of machine learning and deep learning algorithms, and the widespread IoT applications has promised new opportunities for a significant progress in this particular field. Motivated by a great demand for HAR-related applications and the lack of a timely report of the recent contributions to knowledge in this area, this investigation aims to provide a comprehensive survey and in-depth analysis of the recent advances in the diverse techniques and methods of human activity recognition and motion analysis. The focus of this investigation falls on the fundamental theories, the innovative applications with their underlying sensing techniques, data fusion and processing, and human activity classification methods. Based on the state-of-the-art, the technical challenges are identified, and future perspectives on the future rich, sensing, intelligent IoT world are given in order to provide a reference for the research and practices in the related fields.
Collapse
|