1
|
Yao S, Ping Y, Yue X, Chen H. Graph Convolutional Networks for multi-modal robotic martial arts leg pose recognition. Front Neurorobot 2025; 18:1520983. [PMID: 39906517 PMCID: PMC11792168 DOI: 10.3389/fnbot.2024.1520983] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2024] [Accepted: 11/19/2024] [Indexed: 02/06/2025] Open
Abstract
Introduction Accurate recognition of martial arts leg poses is essential for applications in sports analytics, rehabilitation, and human-computer interaction. Traditional pose recognition models, relying on sequential or convolutional approaches, often struggle to capture the complex spatial-temporal dependencies inherent in martial arts movements. These methods lack the ability to effectively model the nuanced dynamics of joint interactions and temporal progression, leading to limited generalization in recognizing complex actions. Methods To address these challenges, we propose PoseGCN, a Graph Convolutional Network (GCN)-based model that integrates spatial, temporal, and contextual features through a novel framework. PoseGCN leverages spatial-temporal graph encoding to capture joint motion dynamics, an action-specific attention mechanism to assign importance to relevant joints depending on the action context, and a self-supervised pretext task to enhance temporal robustness and continuity. Experimental results on four benchmark datasets-Kinetics-700, Human3.6M, NTU RGB+D, and UTD-MHAD-demonstrate that PoseGCN outperforms existing models, achieving state-of-the-art accuracy and F1 scores. Results and discussion These findings highlight the model's capacity to generalize across diverse datasets and capture fine-grained pose details, showcasing its potential in advancing complex pose recognition tasks. The proposed framework offers a robust solution for precise action recognition and paves the way for future developments in multi-modal pose analysis.
Collapse
Affiliation(s)
- Shun Yao
- Department of Public Instruction, ChangJiang Polytechnic of Art and Engineering, Jingzhou, China
| | - Yihan Ping
- School of Computer Science, Northwestern University, Evanston, IL, United States
| | - Xiaoyu Yue
- School of Physical Education, Hubei University of Science and Technology, Xianning, China
- College of Physical Education, Sangmyung University, Seoul, Republic of Korea
| | - He Chen
- School of Physical Education, Hubei University of Science and Technology, Xianning, China
- College of Physical Education, Sangmyung University, Seoul, Republic of Korea
| |
Collapse
|
2
|
Al-Maliki AY, Iqbal K. Improved Classification Accuracy of Hand Movements Using Softmax Classifier and Kalman Filter. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2022; 2022:3191-3194. [PMID: 36086047 DOI: 10.1109/embc48229.2022.9871606] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Accurate identification of the intended hand movement from the surface Electromyography (sEMG) data is desired for effective control of myoelectric lower arm prostheses. This study improves the classification accuracy of hand gestures by using feature arrays, Kalman filter (KF), and a Softmax classifier. We use data from BioPatRec database to classify ten hand movements performed by 17 participants. The proposed classifier achieved 95.3% accuracy without KF, and 99.3% accuracy when KF was used to smooth the training data.
Collapse
|
3
|
Zhang A, Niu Y, Gao Y, Wu J, Gao Z. Second-order information bottleneck based spiking neural networks for sEMG recognition. Inf Sci (N Y) 2022. [DOI: 10.1016/j.ins.2021.11.065] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|
4
|
Robust scene text recognition: Using manifold regularized Twin-Support Vector Machine. JOURNAL OF KING SAUD UNIVERSITY - COMPUTER AND INFORMATION SCIENCES 2022. [DOI: 10.1016/j.jksuci.2019.01.013] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
5
|
Li X, Tian L, Zheng Y, Samuel OW, Fang P, Wang L, Li G. A new strategy based on feature filtering technique for improving the real-time control performance of myoelectric prostheses. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102969] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
6
|
Su Z, Liu H, Qian J, Zhang Z, Zhang L. Hand Gesture Recognition Based on sEMG Signal and Convolutional Neural Network. INT J PATTERN RECOGN 2021. [DOI: 10.1142/s0218001421510125] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Recently, deep learning has become a promising technique for constructing gesture recognition classifiers from surface electromyography (sEMG) signals in human–computer interaction. In this paper, we propose a gesture recognition method with sEMG signals based on a deep multi-parallel convolutional neural network (CNN), which solves the problem that traditional machine learning methods may lose too much useful information during feature extraction. CNNs provide an efficient way to constrain the complexity of feedforward neural networks by weight sharing and restriction to local connections. Sophisticated feature extraction is to be avoided and hand gestures are to be classified directly. A multi-parallel and multi-convolution layer convolution structure is proposed to classify hand gestures. Experiment results show that in comparison with five traditional machine learning methods, the proposed method could achieve higher accuracy.
Collapse
Affiliation(s)
- Ziyi Su
- School of Mechatronic Engineering and Automation, Shanghai University, 99 Shangda Road, Baoshan District, Shanghai, P. R. China
| | - Handong Liu
- School of Mechatronic Engineering and Automation, Shanghai University, 99 Shangda Road, Baoshan District, Shanghai, P. R. China
| | - Jinwu Qian
- School of Mechatronic Engineering and Automation, Shanghai University, 99 Shangda Road, Baoshan District, Shanghai, P. R. China
| | - Zhen Zhang
- School of Mechatronic Engineering and Automation, Shanghai University, 99 Shangda Road, Baoshan District, Shanghai, P. R. China
| | - Lunwei Zhang
- School of Aerospace Engineering and Mechanics, Tongji University, 1239 Siping Road, Yangpu District, Shanghai, P. R. China
| |
Collapse
|
7
|
A Novel Application of Ensemble Methods with Data Resampling Techniques for Drill Bit Selection in the Oil and Gas Industry. ENERGIES 2021. [DOI: 10.3390/en14020432] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Selection of the most suitable drill bit type is an important task for drillers when planning for new oil and gas wells. With the advancement of intelligent predictive models, the automated selection of drill bit type is possible using earlier drilled offset wells’ data. However, real-field well data samples naturally involve an unequal distribution of data points that results in the formation of a complex imbalance multi-class classification problem during drill bit selection. In this analysis, Ensemble methods, namely Adaboost and Random Forest, have been combined with the data re-sampling techniques to provide a new approach for handling the complex drill bit selection process. Additionally, four popular machine learning techniques namely, K-nearest neighbors, naïve Bayes, multilayer perceptron, and support vector machine, are also evaluated to understand the performance degrading effects of imbalanced drilling data obtained from Norwegian wells. The comparison of results shows that the random forest with bootstrap class weighting technique has given the most impressive performance for bit type selection with testing accuracy ranges from 92% to 99%, and G-mean (0.84–0.97) in critical to normal experimental scenarios. This study provides an approach to automate the drill bit selection process over any field, which will minimize human error, time, and drilling cost.
Collapse
|
8
|
Gautam A, Panwar M, Wankhede A, Arjunan SP, Naik GR, Acharyya A, Kumar DK. Locomo-Net: A Low -Complex Deep Learning Framework for sEMG-Based Hand Movement Recognition for Prosthetic Control. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2020; 8:2100812. [PMID: 33014638 PMCID: PMC7529116 DOI: 10.1109/jtehm.2020.3023898] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2020] [Revised: 08/18/2020] [Accepted: 08/30/2020] [Indexed: 02/06/2023]
Abstract
Background: The enhancement in the performance of the myoelectric pattern recognition techniques based on deep learning algorithm possess computationally expensive and exhibit extensive memory behavior. Therefore, in this paper we report a deep learning framework named 'Low-Complex Movement recognition-Net' (LoCoMo-Net) built with convolution neural network (CNN) for recognition of wrist and finger flexion movements; grasping and functional movements; and force pattern from single channel surface electromyography (sEMG) recording. The network consists of a two-stage pipeline: 1) input data compression; 2) data-driven weight sharing. Methods: The proposed framework was validated on two different datasets- our own dataset (DS1) and publicly available NinaPro dataset (DS2) for 16 movements and 50 movements respectively. Further, we have prototyped the proposed LoCoMo-Net on Virtex-7 Xilinx field-programmable gate array (FPGA) platform and validated for 15 movements from DS1 to demonstrate its feasibility for real-time execution. Results: The effectiveness of the proposed LoCoMo-Net was verified by a comparative analysis against the benchmarked models using the same datasets wherein our proposed model outperformed Twin- Support Vector Machine (SVM) and existing CNN based model by an average classification accuracy of 8.5 % and 16.0 % respectively. In addition, hardware complexity analysis is done to reveal the advantages of the two-stage pipeline where approximately 27 %, 49 %, 50 %, 23 %, and 43 % savings achieved in lookup tables (LUT's), registers, memory, power consumption and computational time respectively. Conclusion: The clinical significance of such sEMG based accurate and low-complex movement recognition system can be favorable for the potential improvement in quality of life of an amputated persons.
Collapse
Affiliation(s)
- Arvind Gautam
- Indian Institute of Technology HyderabadHyderabad502205India
| | - Madhuri Panwar
- Indian Institute of Technology HyderabadHyderabad502205India
| | | | | | | | - Amit Acharyya
- Indian Institute of Technology HyderabadHyderabad502205India
| | | |
Collapse
|
9
|
Li K, Zhang J, Wang L, Zhang M, Li J, Bao S. A review of the key technologies for sEMG-based human-robot interaction systems. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.102074] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
10
|
Cai P, Wan C, Pan L, Matsuhisa N, He K, Cui Z, Zhang W, Li C, Wang J, Yu J, Wang M, Jiang Y, Chen G, Chen X. Locally coupled electromechanical interfaces based on cytoadhesion-inspired hybrids to identify muscular excitation-contraction signatures. Nat Commun 2020; 11:2183. [PMID: 32366821 PMCID: PMC7198512 DOI: 10.1038/s41467-020-15990-7] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2019] [Accepted: 04/02/2020] [Indexed: 01/31/2023] Open
Abstract
Coupling myoelectric and mechanical signals during voluntary muscle contraction is paramount in human-machine interactions. Spatiotemporal differences in the two signals intrinsically arise from the muscular excitation-contraction process; however, current methods fail to deliver local electromechanical coupling of the process. Here we present the locally coupled electromechanical interface based on a quadra-layered ionotronic hybrid (named as CoupOn) that mimics the transmembrane cytoadhesion architecture. CoupOn simultaneously monitors mechanical strains with a gauge factor of ~34 and surface electromyogram with a signal-to-noise ratio of 32.2 dB. The resolved excitation-contraction signatures of forearm flexor muscles can recognize flexions of different fingers, hand grips of varying strength, and nervous and metabolic muscle fatigue. The orthogonal correlation of hand grip strength with speed is further exploited to manipulate robotic hands for recapitulating corresponding gesture dynamics. It can be envisioned that such locally coupled electromechanical interfaces would endow cyber-human interactions with unprecedented robustness and dexterity.
Collapse
Affiliation(s)
- Pingqiang Cai
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Changjin Wan
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Liang Pan
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Naoji Matsuhisa
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Ke He
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Zequn Cui
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Wei Zhang
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Chengcheng Li
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Jianwu Wang
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Jing Yu
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Ming Wang
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Ying Jiang
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Geng Chen
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore
| | - Xiaodong Chen
- Innovative Centre for Flexible Devices (iFLEX), Max Planck-NTU Joint Lab for Artificial Senses, School of Materials Science and Engineering, Nanyang Technological University, 50 Nanyang Avenue, Singapore, 639798, Singapore.
| |
Collapse
|
11
|
Tuncer T, Dogan S, Subasi A. Surface EMG signal classification using ternary pattern and discrete wavelet transform based feature extraction for hand movement recognition. Biomed Signal Process Control 2020. [DOI: 10.1016/j.bspc.2020.101872] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
12
|
Wei Y, Zhou J, Wang Y, Liu Y, Liu Q, Luo J, Wang C, Ren F, Huang L. A Review of Algorithm & Hardware Design for AI-Based Biomedical Applications. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2020; 14:145-163. [PMID: 32078560 DOI: 10.1109/tbcas.2020.2974154] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
This paper reviews the state of the arts and trends of the AI-Based biomedical processing algorithms and hardware. The algorithms and hardware for different biomedical applications such as ECG, EEG and hearing aid have been reviewed and discussed. For algorithm design, various widely used biomedical signal classification algorithms have been discussed including support vector machine (SVM), back propagation neural network (BPNN), convolutional neural networks (CNN), probabilistic neural networks (PNN), recurrent neural networks (RNN), Short-term Memory Network (LSTM), fuzzy neural network and etc. The pros and cons of the classification algorithms have been analyzed and compared in the context of application scenarios. The research trends of AI-Based biomedical processing algorithms and applications are also discussed. For hardware design, various AI-Based biomedical processors have been reviewed and discussed, including ECG classification processor, EEG classification processor, EMG classification processor and hearing aid processor. Various techniques on architecture and circuit level have been analyzed and compared. The research trends of the AI-Based biomedical processor have also been discussed.
Collapse
|
13
|
Twin support vector machine based on improved artificial fish swarm algorithm with application to flame recognition. APPL INTELL 2020. [DOI: 10.1007/s10489-020-01676-6] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
14
|
Abstract
Human motion intention recognition is a key to achieve perfect human-machine coordination and wearing comfort of wearable robots. Surface electromyography (sEMG), as a bioelectrical signal, generates prior to the corresponding motion and reflects the human motion intention directly. Thus, a better human-machine interaction can be achieved by using sEMG based motion intention recognition. In this paper, we review and discuss the state of the art of the sEMG based motion intention recognition that is mainly used in detail. According to the method adopted, motion intention recognition is divided into two groups: sEMG-driven musculoskeletal (MS) model based motion intention recognition and machine learning (ML) model based motion intention recognition. The specific models and recognition effects of each study are analyzed and systematically compared. Finally, a discussion of the existing problems in the current studies, major advances, and future challenges is presented.
Collapse
|
15
|
Abstract
This paper presents a multi-sensor model combination system with class-specific voting for physical activity monitoring, which combines multiple classifiers obtained by splicing sensor data from different nodes into new data frames to improve the diversity of model inputs. Data obtained from a wearable multi-sensor wireless integrated measurement system (WIMS) consisting of two accelerometers and one ventilation sensor have been analysed to identify 10 different activity types of varying intensities performed by 110 voluntary participants. It is noted that each classifier shows better performance on some specific activity classes. Through class-specific weighted majority voting, the recognition accuracy of 10 PA types has been improved from 86% to 92% compared with the non-combination approach. Furthermore, the combination method has shown to be effective in reducing the subject-to-subject variability (standard deviation of recognition accuracies across subjects) in activity recognition and has better performance in monitoring physical activities of varying intensities than traditional homogeneous classifiers.
Collapse
|
16
|
Ramírez-Martínez D, Alfaro-Ponce M, Pogrebnyak O, Aldape-Pérez M, Argüelles-Cruz AJ. Hand Movement Classification Using Burg Reflection Coefficients. SENSORS (BASEL, SWITZERLAND) 2019; 19:E475. [PMID: 30682797 PMCID: PMC6387220 DOI: 10.3390/s19030475] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/26/2018] [Revised: 12/31/2018] [Accepted: 01/16/2019] [Indexed: 12/26/2022]
Abstract
Classification of electromyographic signals has a wide range of applications, from clinical diagnosis of different muscular diseases to biomedical engineering, where their use as input for the control of prosthetic devices has become a hot topic of research. The challenge of classifying these signals relies on the accuracy of the proposed algorithm and the possibility of its implementation in hardware. This paper considers the problem of electromyography signal classification, solved with the proposed signal processing and feature extraction stages, with the focus lying on the signal model and time domain characteristics for better classification accuracy. The proposal considers a simple preprocessing technique that produces signals suitable for feature extraction and the Burg reflection coefficients to form learning and classification patterns. These coefficients yield a competitive classification rate compared to the time domain features used. Sometimes, the feature extraction from electromyographic signals has shown that the procedure can omit less useful traits for machine learning models. Using feature selection algorithms provides a higher classification performance with as few traits as possible. The algorithms achieved a high classification rate up to 100% with low pattern dimensionality, with other kinds of uncorrelated attributes for hand movement identification.
Collapse
Affiliation(s)
- Daniel Ramírez-Martínez
- Centro de Investigación en Computación, Instituto Politécnico Nacional, Av. "Juan de Dios Bátiz" s/n esq. Miguel Othón de Mendizábal, Col. Nueva Industrial Vallejo, Del. Gustavo A. Madero, Ciudad de México C.P. 07738, Mexico.
| | - Mariel Alfaro-Ponce
- Departamento de Ciencias e Ingenierías, Universidad Iberoamericana Puebla, Blvrd del Niño Poblano 2901, Reserva Territorial Atlixcáyotl, Centro Comercial Puebla, San Andrés Cholula 72810, Puebla, Mexico.
| | - Oleksiy Pogrebnyak
- Centro de Investigación en Computación, Instituto Politécnico Nacional, Av. "Juan de Dios Bátiz" s/n esq. Miguel Othón de Mendizábal, Col. Nueva Industrial Vallejo, Del. Gustavo A. Madero, Ciudad de México C.P. 07738, Mexico.
| | - Mario Aldape-Pérez
- Centro de Innovación y Desarrollo Tecnológico en Cómputo, Instituto Politécnico Nacional, Av. "Juan de Dios Bátiz" s/n esq. Miguel Othón de Mendizábal, Col. Nueva Industrial Vallejo, Del. Gustavo A. Madero, Ciudad de México C.P. 07700, Mexico.
| | - Amadeo-José Argüelles-Cruz
- Centro de Investigación en Computación, Instituto Politécnico Nacional, Av. "Juan de Dios Bátiz" s/n esq. Miguel Othón de Mendizábal, Col. Nueva Industrial Vallejo, Del. Gustavo A. Madero, Ciudad de México C.P. 07738, Mexico.
| |
Collapse
|
17
|
Bouteraa Y, Abdallah IB, Elmogy AM. Training of Hand Rehabilitation Using Low Cost Exoskeleton and Vision-Based Game Interface. J INTELL ROBOT SYST 2019. [DOI: 10.1007/s10846-018-0966-6] [Citation(s) in RCA: 32] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
18
|
Qi J, Yang P, Waraich A, Deng Z, Zhao Y, Yang Y. Examining sensor-based physical activity recognition and monitoring for healthcare using Internet of Things: A systematic review. J Biomed Inform 2018; 87:138-153. [PMID: 30267895 DOI: 10.1016/j.jbi.2018.09.002] [Citation(s) in RCA: 49] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2018] [Revised: 08/22/2018] [Accepted: 09/03/2018] [Indexed: 10/28/2022]
Abstract
Due to importantly beneficial effects on physical and mental health and strong association with many rehabilitation programs, Physical Activity Recognition and Monitoring (PARM) have been considered as a key paradigm for smart healthcare. Traditional methods for PARM focus on controlled environments with the aim of increasing the types of identifiable activity subjects complete and improving recognition accuracy and system robustness by means of novel body-worn sensors or advanced learning algorithms. The emergence of the Internet of Things (IoT) enabling technology is transferring PARM studies to open and connected uncontrolled environments by connecting heterogeneous cost-effective wearable devices and mobile apps. Little is currently known about whether traditional PARM technologies can tackle the new challenges of IoT environments and how to effectively harness and improve these technologies. In an effort to understand the use of IoT technologies in PARM studies, this paper will give a systematic review, critically examining PARM studies from a typical IoT layer-based perspective. It will firstly summarize the state-of-the-art in traditional PARM methodologies as used in the healthcare domain, including sensory, feature extraction and recognition techniques. The paper goes on to identify some new research trends and challenges of PARM studies in the IoT environments, and discusses some key enabling techniques for tackling them. Finally, this paper consider some of the successful case studies in the area and look at the possible future industrial applications of PARM in smart healthcare.
Collapse
Affiliation(s)
- Jun Qi
- School of Software, Yunnan University, Kunming, China; Department of Computer Science, Liverpool John Moores University, Liverpool L3 3AF, UK.
| | - Po Yang
- School of Software, Yunnan University, Kunming, China; Department of Computer Science, Liverpool John Moores University, Liverpool L3 3AF, UK.
| | - Atif Waraich
- Department of Computer Science, Liverpool John Moores University, Liverpool L3 3AF, UK
| | - Zhikun Deng
- Department of Computer Science, University of Bedfordshire, Luton LU1 3JU, UK
| | - Youbing Zhao
- Department of Computer Science, University of Bedfordshire, Luton LU1 3JU, UK
| | - Yun Yang
- School of Software, Yunnan University, Kunming, China
| |
Collapse
|
19
|
Tavakoli M, Benussi C, Alhais Lopes P, Osorio LB, de Almeida AT. Robust hand gesture recognition with a double channel surface EMG wearable armband and SVM classifier. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2018.07.010] [Citation(s) in RCA: 70] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
20
|
|
21
|
Atzori M, Gijsberts A, Castellini C, Caputo B, Hager AGM, Elsig S, Giatsidis G, Bassetto F, Müller H. Effect of clinical parameters on the control of myoelectric robotic prosthetic hands. ACTA ACUST UNITED AC 2018; 53:345-58. [PMID: 27272750 DOI: 10.1682/jrrd.2014.09.0218] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2014] [Revised: 07/15/2015] [Indexed: 11/05/2022]
Abstract
Improving the functionality of prosthetic hands with noninvasive techniques is still a challenge. Surface electromyography (sEMG) currently gives limited control capabilities; however, the application of machine learning to the analysis of sEMG signals is promising and has recently been applied in practice, but many questions still remain. In this study, we recorded the sEMG activity of the forearm of 11 male subjects with transradial amputation who were mentally performing 40 hand and wrist movements. The classification performance and the number of independent movements (defined as the subset of movements that could be distinguished with >90% accuracy) were studied in relationship to clinical parameters related to the amputation. The analysis showed that classification accuracy and the number of independent movements increased significantly with phantom limb sensation intensity, remaining forearm percentage, and temporal distance to the amputation. The classification results suggest the possibility of naturally controlling up to 11 movements of a robotic prosthetic hand with almost no training. Knowledge of the relationship between classification accuracy and clinical parameters adds new information regarding the nature of phantom limb pain as well as other clinical parameters, and it can lay the foundations for future "functional amputation" procedures in surgery.
Collapse
Affiliation(s)
- Manfredo Atzori
- Information Systems Institute at the University of Applied Sciences Western Switzerland (HES-SO Valais), Sierre, Switzerland;.
| | | | | | | | | | | | | | | | | |
Collapse
|
22
|
Towards Control of a Transhumeral Prosthesis with EEG Signals. Bioengineering (Basel) 2018; 5:bioengineering5020026. [PMID: 29565293 PMCID: PMC6027267 DOI: 10.3390/bioengineering5020026] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2018] [Revised: 03/19/2018] [Accepted: 03/19/2018] [Indexed: 12/21/2022] Open
Abstract
Robotic prostheses are expected to allow amputees greater freedom and mobility. However, available options to control transhumeral prostheses are reduced with increasing amputation level. In addition, for electromyography-based control of prostheses, the residual muscles alone cannot generate sufficiently different signals for accurate distal arm function. Thus, controlling a multi-degree of freedom (DoF) transhumeral prosthesis is challenging with currently available techniques. In this paper, an electroencephalogram (EEG)-based hierarchical two-stage approach is proposed to achieve multi-DoF control of a transhumeral prosthesis. In the proposed method, the motion intention for arm reaching or hand lifting is identified using classifiers trained with motion-related EEG features. For this purpose, neural network and k-nearest neighbor classifiers are used. Then, elbow motion and hand endpoint motion is estimated using a different set of neural-network-based classifiers, which are trained with motion information recorded using healthy subjects. The predictions from the classifiers are compared with residual limb motion to generate a final prediction of motion intention. This can then be used to realize multi-DoF control of a prosthesis. The experimental results show the feasibility of the proposed method for multi-DoF control of a transhumeral prosthesis. This proof of concept study was performed with healthy subjects.
Collapse
|
23
|
Li D, Zhang H, Khan MS, Mi F. A self-adaptive frequency selection common spatial pattern and least squares twin support vector machine for motor imagery electroencephalography recognition. Biomed Signal Process Control 2018. [DOI: 10.1016/j.bspc.2017.11.014] [Citation(s) in RCA: 34] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
|
24
|
WANG LU, GE KEDUO, WU JIYAO, YE YE, WEI WEI. A NOVEL APPROACH FOR THE PATTERN RECOGNITION OF HAND MOVEMENTS BASED ON EMG AND VPMCD. J MECH MED BIOL 2018. [DOI: 10.1142/s0219519417501159] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Essentially, the classification of human hand movements is a process of pattern recognition. However, existing computationally intense and complex pattern recognition methods have failed thus far to be optimally successful in constructing associations between extracted signal features. Due to such limitations, a new pattern recognition method using variable predictive model-based class discrimination (VPMCD) is proposed. This approach considers that the feature values can exhibit inter-relations in nature and such associations will show different forms in different classes. In practice, this is always true for different hand movements. The signals produced by electromyography (EMG) and received from human arm muscles, are characteristically non-linear and non-stationary. A novel hand gesture recognition technique, based on wavelet feature extraction and VPMCD is proposed. First, the maximum values of the wavelet coefficient are extracted as the feature vectors from the surface EMG signals after de-noising. Then, the feature values are regarded as the inputs of the VPMCD classifier. Finally, four movement patterns (hand clenching, hand extension, wrist flexion, and wrist extension) are identified by the outputs of the VPMCD classifier. Our analysis results show that the proposed pattern recognition approach can distinguish different gestures successfully and effectively. Simultaneously, compared with the artificial neural network and the support vector machine classifier, more accurate recognition can be achieved using our proposed technique.
Collapse
Affiliation(s)
- LU WANG
- Department of Mechanical Engineering, Anhui University of Technology, Maanshan City, Anhui Province, 243002, P. R. China
| | - KE-DUO GE
- Department of Mechanical Engineering, Anhui University of Technology, Maanshan City, Anhui Province, 243002, P. R. China
| | - JI-YAO WU
- Department of Mechanical Engineering, Anhui University of Technology, Maanshan City, Anhui Province, 243002, P. R. China
| | - YE YE
- Department of Mechanical Engineering, Anhui University of Technology, Maanshan City, Anhui Province, 243002, P. R. China
| | - WEI WEI
- Department of Mechanical Engineering, Anhui University of Technology, Maanshan City, Anhui Province, 243002, P. R. China
| |
Collapse
|
25
|
Duan L, Hongxin Z, Khan MS, Fang M. Recognition of motor imagery tasks for BCI using CSP and chaotic PSO twin SVM. ACTA ACUST UNITED AC 2017. [DOI: 10.1016/s1005-8885(17)60215-2] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
26
|
Razin YS, Pluckter K, Ueda J, Feigh K. Predicting Task Intent From Surface Electromyography Using Layered Hidden Markov Models. IEEE Robot Autom Lett 2017. [DOI: 10.1109/lra.2017.2662741] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
27
|
Quitadamo LR, Cavrini F, Sbernini L, Riillo F, Bianchi L, Seri S, Saggio G. Support vector machines to detect physiological patterns for EEG and EMG-based human-computer interaction: a review. J Neural Eng 2017; 14:011001. [PMID: 28068295 DOI: 10.1088/1741-2552/14/1/011001] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Support vector machines (SVMs) are widely used classifiers for detecting physiological patterns in human-computer interaction (HCI). Their success is due to their versatility, robustness and large availability of free dedicated toolboxes. Frequently in the literature, insufficient details about the SVM implementation and/or parameters selection are reported, making it impossible to reproduce study analysis and results. In order to perform an optimized classification and report a proper description of the results, it is necessary to have a comprehensive critical overview of the applications of SVM. The aim of this paper is to provide a review of the usage of SVM in the determination of brain and muscle patterns for HCI, by focusing on electroencephalography (EEG) and electromyography (EMG) techniques. In particular, an overview of the basic principles of SVM theory is outlined, together with a description of several relevant literature implementations. Furthermore, details concerning reviewed papers are listed in tables and statistics of SVM use in the literature are presented. Suitability of SVM for HCI is discussed and critical comparisons with other classifiers are reported.
Collapse
Affiliation(s)
- L R Quitadamo
- Department of Electronic Engineering, University of Rome Tor Vergata, Rome, Italy. School of Life and Health Sciences, Aston Brain Center, Aston University, Birmingham, UK
| | | | | | | | | | | | | |
Collapse
|
28
|
Luo W, Zhang Z, Wen T, Li C, Luo Z. Features extraction and multi-classification of sEMG using a GPU-Accelerated GA/MLP hybrid algorithm. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2017; 25:273-286. [PMID: 28269817 DOI: 10.3233/xst-17259] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
BACKGROUND Surface electromyography (sEMG) signal is the combined effect of superficial muscle EMG and neural electrical activity. In recent years, researchers did large amount of human-machine system studies by using the physiological signals as control signals. OBJECTIVE To develop and test a new multi-classification method to improve performance of analyzing sEMG signals based on public sEMG dataset. METHODS First, ten features were selected as candidate features. Second, a genetic algorithm (GA) was applied to select representative features from the initial ten candidates. Third, a multi-layer perceptron (MLP) classifier was trained by the selected optimal features. Last, the trained classifier was used to predict the classes of sEMG signals. A special graphics processing unit (GPU) was used to speed up the learning process. RESULTS Experimental results show that the classification accuracy of the new method reached higher than 90%. Comparing to other previously reported results, using the new method yielded higher performance. CONCLUSIONS The proposed features selection method is effective and the classification result is accurate. In addition, our method could have practical application value in medical prosthetics and the potential to improve robustness of myoelectric pattern recognition.
Collapse
|
29
|
|
30
|
A Brain-Machine Interface Based on ERD/ERS for an Upper-Limb Exoskeleton Control. SENSORS 2016; 16:s16122050. [PMID: 27918413 PMCID: PMC5191031 DOI: 10.3390/s16122050] [Citation(s) in RCA: 61] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/29/2016] [Revised: 10/22/2016] [Accepted: 11/08/2016] [Indexed: 12/03/2022]
Abstract
To recognize the user’s motion intention, brain-machine interfaces (BMI) usually decode movements from cortical activity to control exoskeletons and neuroprostheses for daily activities. The aim of this paper is to investigate whether self-induced variations of the electroencephalogram (EEG) can be useful as control signals for an upper-limb exoskeleton developed by us. A BMI based on event-related desynchronization/synchronization (ERD/ERS) is proposed. In the decoder-training phase, we investigate the offline classification performance of left versus right hand and left hand versus both feet by using motor execution (ME) or motor imagery (MI). The results indicate that the accuracies of ME sessions are higher than those of MI sessions, and left hand versus both feet paradigm achieves a better classification performance, which would be used in the online-control phase. In the online-control phase, the trained decoder is tested in two scenarios (wearing or without wearing the exoskeleton). The MI and ME sessions wearing the exoskeleton achieve mean classification accuracy of 84.29% ± 2.11% and 87.37% ± 3.06%, respectively. The present study demonstrates that the proposed BMI is effective to control the upper-limb exoskeleton, and provides a practical method by non-invasive EEG signal associated with human natural behavior for clinical applications.
Collapse
|
31
|
Raheja JL, Mishra A, Chaudhary A. Indian sign language recognition using SVM. PATTERN RECOGNITION AND IMAGE ANALYSIS 2016. [DOI: 10.1134/s1054661816020164] [Citation(s) in RCA: 55] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
32
|
Ding S, Zhang N, Zhang X, Wu F. Twin support vector machine: theory, algorithm and applications. Neural Comput Appl 2016. [DOI: 10.1007/s00521-016-2245-4] [Citation(s) in RCA: 56] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
|
33
|
Arjunan SP, Kumar DK, Jayadeva J.. Fractal and twin SVM-based handgrip recognition for healthy subjects and trans-radial amputees using myoelectric signal. BIOMED ENG-BIOMED TE 2016; 61:87-94. [DOI: 10.1515/bmt-2014-0134] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2014] [Accepted: 06/01/2015] [Indexed: 11/15/2022]
Abstract
Abstract
Identifying functional handgrip patterns using surface electromygram (sEMG) signal recorded from amputee residual muscle is required for controlling the myoelectric prosthetic hand. In this study, we have computed the signal fractal dimension (FD) and maximum fractal length (MFL) during different grip patterns performed by healthy and transradial amputee subjects. The FD and MFL of the sEMG, referred to as the fractal features, were classified using twin support vector machines (TSVM) to recognize the handgrips. TSVM requires fewer support vectors, is suitable for data sets with unbalanced distributions, and can simultaneously be trained for improving both sensitivity and specificity. When compared with other methods, this technique resulted in improved grip recognition accuracy, sensitivity, and specificity, and this improvement was significant (κ=0.91).
Collapse
|
34
|
Naik GR, Acharyya A, Nguyen HT. Classification of finger extension and flexion of EMG and Cyberglove data with modified ICA weight matrix. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2014:3829-32. [PMID: 25570826 DOI: 10.1109/embc.2014.6944458] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
This paper reports the classification of finger flexion and extension of surface Electromyography (EMG) and Cyberglove data using the modified Independent Component Analysis (ICA) weight matrix. The finger flexion and extension data are processed through Principal Component Analysis (PCA), and next separated using modified ICA for each individual with customized weight matrix. The extension and flexion features of sEMG and Cyberglove (extracted from modified ICA) were classified using Linear Discriminant Analysis (LDA) with near 90% classification accuracy. The applications of this study include Human Computer Interface (HCI), virtual reality and neural prosthetics.
Collapse
|
35
|
Ison M, Artemiadis P. Enhancing practical multifunctional myoelectric applications through implicit motor control training systems. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2015; 2014:3525-8. [PMID: 25570751 DOI: 10.1109/embc.2014.6944383] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Despite holding promise for advances in prostheses and robot teleoperation, myoelectric controlled interfaces have had limited impact in commercial applications. Simultaneous multifunctional controls are desired, but often lead to frustration by users who cannot easily control the devices using state-of-the-art control schemes. This paper proposes and validates the use of implicit motor control training systems (IM-CTS) to achieve practical implementations of multifunctional myoelectric applications. Subjects implicitly develop muscle synergies needed to control a robotic application through an analogous visual interface without the associated physical constraints which may hinder learning. The learning then naturally transfers to perceived intuitive and robust control of the robotic device. The efficacy of the method is tested by comparing performance between two groups learning controls implicitly via the visual interface and explicitly via the robotic interface, respectively. The groups achieved comparable performance when performing tasks with the robotic device a week later. Moreover, the initial performance of the experimental group was significantly better than the control group achieved after up to 75 minutes of training. These findings support the use of IMCTS to achieve practical multifunctional control of a wide range of myoelectric applications without limiting them to intuitive mappings nor anthropomorphic devices.
Collapse
|
36
|
|
37
|
Comparative study of PCA in classification of multichannel EMG signals. AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE 2015; 38:331-43. [DOI: 10.1007/s13246-015-0343-8] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/30/2014] [Accepted: 03/30/2015] [Indexed: 10/23/2022]
|
38
|
Guo J, Yi P, Wang R, Ye Q, Zhao C. Feature selection for least squares projection twin support vector machine. Neurocomputing 2014. [DOI: 10.1016/j.neucom.2014.05.040] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
39
|
Estimation of Lower Limb Periodic Motions from sEMG Using Least Squares Support Vector Regression. Neural Process Lett 2014. [DOI: 10.1007/s11063-014-9391-4] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
|
40
|
|
41
|
Ison M, Artemiadis P. The role of muscle synergies in myoelectric control: trends and challenges for simultaneous multifunction control. J Neural Eng 2014; 11:051001. [PMID: 25188509 DOI: 10.1088/1741-2560/11/5/051001] [Citation(s) in RCA: 93] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Myoelectric control is filled with potential to significantly change human-robot interaction due to the ability to non-invasively measure human motion intent. However, current control schemes have struggled to achieve the robust performance that is necessary for use in commercial applications. As demands in myoelectric control trend toward simultaneous multifunctional control, multi-muscle coordinations, or synergies, play larger roles in the success of the control scheme. Detecting and refining patterns in muscle activations robust to the high variance and transient changes associated with surface electromyography is essential for efficient, user-friendly control. This article reviews the role of muscle synergies in myoelectric control schemes by dissecting each component of the scheme with respect to associated challenges for achieving robust simultaneous control of myoelectric interfaces. Electromyography recording details, signal feature extraction, pattern recognition and motor learning based control schemes are considered, and future directions are proposed as steps toward fulfilling the potential of myoelectric control in clinically and commercially viable applications.
Collapse
Affiliation(s)
- Mark Ison
- School for Engineering of Matter, Transport and Energy, Arizona State University, Tempe, AZ 85287, USA
| | | |
Collapse
|
42
|
Rasool G, Bouaynaya N, Iqbal K, White G. Surface myoelectric signal classification using the AR-GARCH model. Biomed Signal Process Control 2014. [DOI: 10.1016/j.bspc.2014.06.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
|
43
|
Reza SMT, Ahmad N, Choudhury IA, Ghazilla RAR. A fuzzy controller for lower limb exoskeletons during sit-to-stand and stand-to-sit movement using wearable sensors. SENSORS 2014; 14:4342-63. [PMID: 24599193 PMCID: PMC4003946 DOI: 10.3390/s140304342] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/18/2013] [Revised: 01/29/2014] [Accepted: 02/07/2014] [Indexed: 11/16/2022]
Abstract
Human motion is a daily and rhythmic activity. The exoskeleton concept is a very positive scientific approach for human rehabilitation in case of lower limb impairment. Although the exoskeleton shows potential, it is not yet applied extensively in clinical rehabilitation. In this research, a fuzzy based control algorithm is proposed for lower limb exoskeletons during sit-to-stand and stand-to-sit movements. Surface electromyograms (EMGs) are acquired from the vastus lateralis muscle using a wearable EMG sensor. The resultant acceleration angle along the z-axis is determined from a kinematics sensor. Twenty volunteers were chosen to perform the experiments. The whole experiment was accomplished in two phases. In the first phase, acceleration angles and EMG data were acquired from the volunteers during both sit-to-stand and stand-to-sit motions. During sit-to-stand movements, the average acceleration angle at activation was 11°-48° and the EMG varied from -0.19 mV to +0.19 mV. On the other hand, during stand-to-sit movements, the average acceleration angle was found to be 57.5°-108° at the activation point and the EMG varied from -0.32 mV to +0.32 mV. In the second phase, a fuzzy controller was designed from the experimental data. The controller was tested and validated with both offline and real time data using LabVIEW.
Collapse
Affiliation(s)
- Sharif Muhammad Taslim Reza
- Centre for Product Design and Manufacturing (CPDM), Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia.
| | - Norhafizan Ahmad
- Centre for Product Design and Manufacturing (CPDM), Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia.
| | - Imtiaz Ahmed Choudhury
- Centre for Product Design and Manufacturing (CPDM), Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia.
| | - Raja Ariffin Raja Ghazilla
- Centre for Product Design and Manufacturing (CPDM), Department of Mechanical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia.
| |
Collapse
|
44
|
Antuvan CW, Ison M, Artemiadis P. Embedded human control of robots using myoelectric interfaces. IEEE Trans Neural Syst Rehabil Eng 2014; 22:820-7. [PMID: 24760930 DOI: 10.1109/tnsre.2014.2302212] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Myoelectric controlled interfaces have become a research interest for use in advanced prostheses, exoskeletons, and robot teleoperation. Current research focuses on improving a user's initial performance, either by training a decoding function for a specific user or implementing "intuitive" mapping functions as decoders. However, both approaches are limiting, with the former being subject specific, and the latter task specific. This paper proposes a paradigm shift on myoelectric interfaces by embedding the human as controller of the system to be operated. Using abstract mapping functions between myoelectric activity and control actions for a task, this study shows that human subjects are able to control an artificial system with increasing efficiency by just learning how to control it. The method efficacy is tested by using two different control tasks and four different abstract mappings relating upper limb muscle activity to control actions for those tasks. The results show that all subjects were able to learn the mappings and improve their performance over time. More interestingly, a chronological evaluation across trials reveals that the learning curves transfer across subsequent trials having the same mapping, independent of the tasks to be executed. This implies that new muscle synergies are developed and refined relative to the mapping used by the control task, suggesting that maximal performance may be achieved by learning a constant, arbitrary mapping function rather than dynamic subject- or task-specific functions. Moreover, the results indicate that the method may extend to the neural control of any device or robot, without limitations for anthropomorphism or human-related counterparts.
Collapse
|
45
|
Ouyang G, Zhu X, Ju Z, Liu H. Dynamical Characteristics of Surface EMG Signals of Hand Grasps via Recurrence Plot. IEEE J Biomed Health Inform 2014; 18:257-65. [DOI: 10.1109/jbhi.2013.2261311] [Citation(s) in RCA: 61] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
|
46
|
|
47
|
Wang N, Chen Y, Zhang X. The recognition of multi-finger prehensile postures using LDA. Biomed Signal Process Control 2013. [DOI: 10.1016/j.bspc.2013.06.006] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
|
48
|
Towards identification of finger flexions using single channel surface electromyography--able bodied and amputee subjects. J Neuroeng Rehabil 2013; 10:50. [PMID: 23758881 PMCID: PMC3680228 DOI: 10.1186/1743-0003-10-50] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2012] [Accepted: 05/25/2013] [Indexed: 11/10/2022] Open
Abstract
Background This research has established a method for using single channel surface electromyogram (sEMG) recorded from the forearm to identify individual finger flexion. The technique uses the volume conduction properties of the tissues and uses the magnitude and density of the singularities in the signal as a measure of strength of the muscle activity. Methods SEMG was recorded from the flexor digitorum superficialis muscle during four different finger flexions. Based on the volume conduction properties of the tissues, sEMG was decomposed into wavelet maxima and grouped into four groups based on their magnitude. The mean magnitude and the density of each group were the inputs to the twin support vector machines (TSVM). The algorithm was tested on 11 able-bodied and one trans-radial amputated volunteer to determine the accuracy, sensitivity and specificity. The system was also tested to determine inter-experimental variations and variations due to difference in the electrode location. Results Accuracy and sensitivity of identification of finger actions from single channel sEMG signal was 93% and 94% for able-bodied and 81% and 84% for trans-radial amputated respectively, and there was only a small inter-experimental variation. Conclusions Volume conduction properties based sEMG analysis provides a suitable basis for identifying finger flexions from single channel sEMG. The reported system requires supervised training and automatic classification.
Collapse
|
49
|
Al-Timemy AH, Bugmann G, Escudero J, Outram N. Classification of Finger Movements for the Dexterous Hand Prosthesis Control With Surface Electromyography. IEEE J Biomed Health Inform 2013; 17:608-18. [DOI: 10.1109/jbhi.2013.2249590] [Citation(s) in RCA: 223] [Impact Index Per Article: 18.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
50
|
Ai Q, Liu Q, Yuan T, Lu Y. Gestures recognition based on wavelet and LLE. AUSTRALASIAN PHYSICAL & ENGINEERING SCIENCES IN MEDICINE 2013; 36:167-76. [PMID: 23512298 DOI: 10.1007/s13246-013-0191-3] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2012] [Accepted: 02/26/2013] [Indexed: 11/25/2022]
Abstract
Wavelet analysis is a time-frequency, non-stationary method while the largest Lyapunov exponent (LLE) is used to judge the non-linear characteristic of systems. Because surface electromyography signal (SEMGS) is a complex signal that is characterized by non-stationary and non-linear properties. This paper combines wavelet coefficient and LLE together as the new feature of SEMGS. The proposed method not only reflects the non-stationary and non-linear characteristics of SEMGS, but also is suitable for its classification. Then, the BP (back propagation) neural network is employed to implement the identification of six gestures (fist clench, fist extension, wrist extension, wrist flexion, radial deviation, ulnar deviation). The experimental results indicate that based on the proposed method, the identification of these six gestures can reach an average rate of 97.71 %.
Collapse
Affiliation(s)
- Qingsong Ai
- School of Information Engineering, Wuhan University of Technology, 122 Luoshi Road, Hongshan District, Hubei, People's Republic of China.
| | | | | | | |
Collapse
|