1
|
Teran-Pineda D, Thurnhofer-Hemsi K, Domínguez E. Human Gait Activity Recognition Using Multimodal Sensors. Int J Neural Syst 2023; 33:2350058. [PMID: 37779221 DOI: 10.1142/s0129065723500582] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/03/2023]
Abstract
Human activity recognition is an application of machine learning with the aim of identifying activities from the gathered activity raw data acquired by different sensors. In medicine, human gait is commonly analyzed by doctors to detect abnormalities and determine possible treatments for the patient. Monitoring the patient's activity is paramount in evaluating the treatment's evolution. This type of classification is still not enough precise, which may lead to unfavorable reactions and responses. A novel methodology that reduces the complexity of extracting features from multimodal sensors is proposed to improve human activity classification based on accelerometer data. A sliding window technique is used to demarcate the first dominant spectral amplitude, decreasing dimensionality and improving feature extraction. In this work, we compared several state-of-art machine learning classifiers evaluated on the HuGaDB dataset and validated on our dataset. Several configurations to reduce features and training time were analyzed using multimodal sensors: all-axis spectrum, single-axis spectrum, and sensor reduction.
Collapse
Affiliation(s)
- Diego Teran-Pineda
- Department of Computer Languages and Computer Science, University of Málaga Bulevar Louis Pasteur, 35, 29071, Málaga, Spain
- Biomedical Research Institute of Málaga (IBIMA), C/ Doctor Miguel Díaz Recio, 28, 29010, Málaga, Spain
| | - Karl Thurnhofer-Hemsi
- Department of Computer Languages and Computer Science, University of Málaga Bulevar Louis Pasteur, 35, 29071, Málaga, Spain
- Biomedical Research Institute of Málaga (IBIMA), C/ Doctor Miguel Díaz Recio, 28, 29010, Málaga, Spain
| | - Enrique Domínguez
- Department of Computer Languages and Computer Science, University of Málaga Bulevar Louis Pasteur, 35, 29071, Málaga, Spain
- Biomedical Research Institute of Málaga (IBIMA), C/ Doctor Miguel Díaz Recio, 28, 29010, Málaga, Spain
| |
Collapse
|
2
|
Prochazka A, Charvatova H, Vysata O. The Effect of Face Masks on Physiological Data and the Classification of Rehabilitation Walking. IEEE Trans Neural Syst Rehabil Eng 2022; 30:2467-2473. [PMID: 36001515 DOI: 10.1109/tnsre.2022.3201487] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Gait analysis and the assessment of rehabilitation exercises are important processes that occur during fitness level monitoring and the treatment of neurological disorders. This paper presents the possibility of using oximetric, heart rate (HR), accelerometric, and global navigation satellite systems (GNSSs) to analyse signals recorded during uphill and downhill walking without and with a face mask to find its influence on physiological functions during selected walking patterns. The experimental dataset includes 86 signal segments acquired under different conditions. The proposed methodology is based on signal analysis in both the time and frequency domains. The results indicate that face mask use has a minimal effect on blood oxygen concentration and heart rate, with the average mean changes of these parameters being less than 2%. The support vector machine, a Bayesian method, the k -nearest neighbour method, and a two-layer neural network showed very good separation abilities and successfully classified different walking patterns only in the case when the effect of face mask wearing was not included in the classification process. Our methodology suggests that artificial intelligence and machine learning tools are efficient methods for the assessment of motion patterns in different motion conditions and that face masks have a negligible effect for short-duration experiments.
Collapse
|
3
|
Improved Human Activity Recognition Using Majority Combining of Reduced-Complexity Sensor Branch Classifiers. ELECTRONICS 2022. [DOI: 10.3390/electronics11030392] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Human activity recognition (HAR) employs machine learning for the automated recognition of motion and has widespread applications across healthcare, daily-life and security spaces. High performances have especially been demonstrated using video cameras and intensive signal processing such as the convolutional neural network (CNN). However, lower complexity algorithms operating on low-rate inertial data is a promising approach for portable use-cases such as pairing with smart wearables. This work considers the performance benefits from combining HAR classification estimates from multiple sensors each with lower-complexity processing compared with a higher-complexity single-sensor classifier. We show that while the highest single-sensor classification accuracy of 91% can be achieved for seven activities with optimized number of hidden units and sample rate, the classification accuracy is reduced to 56% with a reduced-complexity 50-neuron classifier. However, by majority combining the predictions of three and four low-complexity classifiers, the average classification accuracy increased to 82.5% and 94.4%, respectively, demonstrating the efficacy of this approach.
Collapse
|
4
|
Vyšata O, Ťupa O, Procházka A, Doležal R, Cejnar P, Bhorkar AM, Dostál O, Vališ M. Classification of Ataxic Gait. SENSORS 2021; 21:s21165576. [PMID: 34451018 PMCID: PMC8402252 DOI: 10.3390/s21165576] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Revised: 08/08/2021] [Accepted: 08/12/2021] [Indexed: 12/17/2022]
Abstract
Gait disorders accompany a number of neurological and musculoskeletal disorders that significantly reduce the quality of life. Motion sensors enable high-quality modelling of gait stereotypes. However, they produce large volumes of data, the evaluation of which is a challenge. In this publication, we compare different data reduction methods and classification of reduced data for use in clinical practice. The best accuracy achieved between a group of healthy individuals and patients with ataxic gait extracted from the records of 43 participants (23 ataxic, 20 healthy), forming 418 segments of straight gait pattern, is 98% by random forest classifier preprocessed by t-distributed stochastic neighbour embedding.
Collapse
Affiliation(s)
- Oldřich Vyšata
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 03 Hradec Králové, Czech Republic; (A.M.B.); (O.D.); (M.V.)
- Correspondence:
| | - Ondřej Ťupa
- Department of Computing and Control Engineering, University of Chemistry and Technology in Prague, 166 28 Praha 6, Czech Republic; (O.Ť.); (A.P.); (P.C.)
| | - Aleš Procházka
- Department of Computing and Control Engineering, University of Chemistry and Technology in Prague, 166 28 Praha 6, Czech Republic; (O.Ť.); (A.P.); (P.C.)
- Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague, 160 00 Prague 6, Czech Republic
| | - Rafael Doležal
- Department of Chemistry, Faculty of Science, University of Hradec Králové, 500 03 Hradec Králové, Czech Republic;
| | - Pavel Cejnar
- Department of Computing and Control Engineering, University of Chemistry and Technology in Prague, 166 28 Praha 6, Czech Republic; (O.Ť.); (A.P.); (P.C.)
| | - Aprajita Milind Bhorkar
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 03 Hradec Králové, Czech Republic; (A.M.B.); (O.D.); (M.V.)
| | - Ondřej Dostál
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 03 Hradec Králové, Czech Republic; (A.M.B.); (O.D.); (M.V.)
| | - Martin Vališ
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 03 Hradec Králové, Czech Republic; (A.M.B.); (O.D.); (M.V.)
| |
Collapse
|
5
|
Advanced Statistical Analysis of 3D Kinect Data: A Comparison of the Classification Methods. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app11104572] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
This paper focuses on the statistical analysis of mimetic muscle rehabilitation after head and neck surgery causing facial paresis in patients after head and neck surgery. Our work deals with an evaluation problem of mimetic muscle rehabilitation that is observed by a Kinect stereo-vision camera. After a specific brain surgery, patients are often affected by face palsy, and rehabilitation to renew mimetic muscle innervation takes several months. It is important to be able to observe the rehabilitation process in an objective way. The most commonly used House–Brackmann (HB) scale is based on the clinician’s subjective opinion. This paper compares different methods of supervised learning classification that should be independent of the clinician’s opinion. We compare a parametric model (based on logistic regression), non-parametric model (based on random forests), and neural networks. The classification problem that we have studied combines a limited dataset (it contains only 122 measurements of 93 patients) of complex observations (each measurement consists of a collection of time curves) with an ordinal response variable. To balance the frequencies of the considered classes in our data set, we reclassified the samples from HB4 to HB3 and HB5 to HB6—it means that only four HB grades are used for classification algorithm. The parametric statistical model was found to be the most suitable thanks to its stability, tractability, and reasonable performance in terms of both accuracy and precision.
Collapse
|
6
|
|
7
|
Prochazka A, Dostal O, Cejnar P, Mohamed HI, Pavelek Z, Valis M, Vysata O. Deep Learning for Accelerometric Data Assessment and Ataxic Gait Monitoring. IEEE Trans Neural Syst Rehabil Eng 2021; 29:360-367. [PMID: 33434133 DOI: 10.1109/tnsre.2021.3051093] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
Ataxic gait monitoring and assessment of neurological disorders belong to important multidisciplinary areas that are supported by digital signal processing methods and machine learning tools. This paper presents the possibility of using accelerometric data to optimise deep learning convolutional neural network systems to distinguish between ataxic and normal gait. The experimental dataset includes 860 signal segments of 16 ataxic patients and 19 individuals from the control set with the mean age of 38.6 and 39.6 years, respectively. The proposed methodology is based upon the analysis of frequency components of accelerometric signals simultaneously recorded at specific body positions with a sampling frequency of 60 Hz. The deep learning system uses all of the frequency components in a range of 〈0,30 〉 Hz. Our classification results are compared with those obtained by standard methods, which include the support vector machine, Bayesian methods, and the two-layer neural network with features estimated as the relative power in selected frequency bands. Our results show that the appropriate selection of sensor positions can increase the accuracy from 81.2% for the foot position to 91.7% for the spine position. Combining the input data and the deep learning methodology with five layers increased the accuracy to 95.8%. Our methodology suggests that artificial intelligence methods and deep learning are efficient methods in the assessment of motion disorders and they have a wide range of further applications.
Collapse
|
8
|
Charvátová H, Procházka A, Vyšata O. Motion Assessment for Accelerometric and Heart Rate Cycling Data Analysis. SENSORS (BASEL, SWITZERLAND) 2020; 20:E1523. [PMID: 32164235 PMCID: PMC7085619 DOI: 10.3390/s20051523] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/12/2020] [Revised: 03/04/2020] [Accepted: 03/05/2020] [Indexed: 11/16/2022]
Abstract
Motion analysis is an important topic in the monitoring of physical activities and recognition of neurological disorders. The present paper is devoted to motion assessment using accelerometers inside mobile phones located at selected body positions and the records of changes in the heart rate during cycling, under different body loads. Acquired data include 1293 signal segments recorded by the mobile phone and the Garmin device for uphill and downhill cycling. The proposed method is based upon digital processing of the heart rate and the mean power in different frequency bands of accelerometric data. The classification of the resulting features was performed by the support vector machine, Bayesian methods, k-nearest neighbor method, and neural networks. The proposed criterion is then used to find the best positions for the sensors with the highest discrimination abilities. The results suggest the sensors be positioned on the spine for the classification of uphill and downhill cycling, yielding an accuracy of 96.5% and a cross-validation error of 0.04 evaluated by a two-layer neural network system for features based on the mean power in the frequency bands 〈 3 , 8 〉 and 〈 8 , 15 〉 Hz. This paper shows the possibility of increasing this accuracy to 98.3% by the use of more features and the influence of appropriate sensor positioning for motion monitoring and classification.
Collapse
Affiliation(s)
- Hana Charvátová
- Faculty of Applied Informatics, Tomas Bata University in Zlín, 760 01 Zlín, Czech Republic
| | - Aleš Procházka
- Department of Computing and Control Engineering, University of Chemistry and Technology in Prague, 166 28 Prague 6, Czech Republic;
- Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague, 160 00 Prague 6, Czech Republic
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 05 Hradec Králové, Czech Republic;
| | - Oldřich Vyšata
- Department of Neurology, Faculty of Medicine in Hradec Králové, Charles University, 500 05 Hradec Králové, Czech Republic;
| |
Collapse
|