1
|
Nunes AS, Yıldız Potter İ, Mishra RK, Casado J, Dana N, Geronimo A, Tarolli CG, Schneider RB, Dorsey ER, Adams JL, Vaziri A. Using wearable sensors and machine learning to assess upper limb function in Huntington's disease. COMMUNICATIONS MEDICINE 2025; 5:50. [PMID: 40000872 PMCID: PMC11861259 DOI: 10.1038/s43856-025-00770-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2024] [Accepted: 02/14/2025] [Indexed: 02/27/2025] Open
Abstract
BACKGROUND Huntington's disease, a neurodegenerative disorder, impairs both upper and lower limb function, typically assessed in clinical settings. However, wearable sensors offer the opportunity to monitor real-world data that complements clinical assessments, providing a more comprehensive understanding of disease symptoms. METHODS In this study, we monitor upper limb function in individuals with Huntington's disease (HD, n = 16), prodromal HD (pHD, n = 7), and controls (CTR, n = 16) using a wrist-worn wearable sensor over a 7-day period. Goal-directed hand movements are detected through a deep learning model, and kinematic features of each movement are analyzed. The collected data is used to predict disease groups and clinical scores using statistical and machine learning models. RESULTS Here we show that significant differences in goal-directed movement features exist between the groups. Additionally, several of these features strongly correlate with clinical scores. Classification models accurately distinguish between HD, pHD, and CTR individuals, achieving a balanced accuracy of 67% and a recall of 0.72 for the HD group. Regression models effectively predict clinical scores. CONCLUSIONS This study demonstrates the potential of wearable sensors and machine learning to monitor upper limb function in Huntington's disease, offering a tool for early detection, remote monitoring, and assessing treatment efficacy in clinical trials.
Collapse
Affiliation(s)
| | | | | | - Jose Casado
- BioSensics LLC, 57 Chapel St, Newton, MA, USA
| | - Nima Dana
- BioSensics LLC, 57 Chapel St, Newton, MA, USA
| | | | - Christopher G Tarolli
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
| | - Ruth B Schneider
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
| | - E Ray Dorsey
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
| | - Jamie L Adams
- Center for Health + Technology, University of Rochester Medical Center, Rochester, NY, USA
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
| | | |
Collapse
|
2
|
Lobo P, Morais P, Murray P, Vilaça JL. Trends and Innovations in Wearable Technology for Motor Rehabilitation, Prediction, and Monitoring: A Comprehensive Review. SENSORS (BASEL, SWITZERLAND) 2024; 24:7973. [PMID: 39771710 PMCID: PMC11679760 DOI: 10.3390/s24247973] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/16/2024] [Revised: 11/23/2024] [Accepted: 12/10/2024] [Indexed: 01/11/2025]
Abstract
(1) Background: Continuous health promotion systems are increasingly important, enabling decentralized patient care, providing comfort, and reducing congestion in healthcare facilities. These systems allow for treatment beyond clinical settings and support preventive monitoring. Wearable systems have become essential tools for health monitoring, but they focus mainly on physiological data, overlooking motor data evaluation. The World Health Organization reports that 1.71 billion people globally suffer from musculoskeletal conditions, marked by pain and limited mobility. (2) Methods: To gain a deeper understanding of wearables for the motor rehabilitation, monitoring, and prediction of the progression and/or degradation of symptoms directly associated with upper-limb pathologies, this study was conducted. Thus, all articles indexed in the Web of Science database containing the terms "wearable", "upper limb", and ("rehabilitation" or "monitor" or "predict") between 2019 and 2023 were flagged for analysis. (3) Results: Out of 391 papers identified, 148 were included and analyzed, exploring pathologies, technologies, and their interrelationships. Technologies were categorized by typology and primary purpose. (4) Conclusions: The study identified essential sensory units and actuators in wearable systems for upper-limb physiotherapy and analyzed them based on treatment methods and targeted pathologies.
Collapse
Affiliation(s)
- Pedro Lobo
- 2AI, School of Technology, IPCA, 4750-810 Barcelos, Portugal; (P.M.); (J.L.V.)
- LIFE Research Institute, TUS—Technological University of the Shannon, V94 EC5T Limerick, Ireland;
| | - Pedro Morais
- 2AI, School of Technology, IPCA, 4750-810 Barcelos, Portugal; (P.M.); (J.L.V.)
- LASI—Associate Laboratory of Intelligent Systems, 4800-058 Guimarães, Portugal
| | - Patrick Murray
- LIFE Research Institute, TUS—Technological University of the Shannon, V94 EC5T Limerick, Ireland;
| | - João L. Vilaça
- 2AI, School of Technology, IPCA, 4750-810 Barcelos, Portugal; (P.M.); (J.L.V.)
- LASI—Associate Laboratory of Intelligent Systems, 4800-058 Guimarães, Portugal
| |
Collapse
|
3
|
Senadheera I, Hettiarachchi P, Haslam B, Nawaratne R, Sheehan J, Lockwood KJ, Alahakoon D, Carey LM. AI Applications in Adult Stroke Recovery and Rehabilitation: A Scoping Review Using AI. SENSORS (BASEL, SWITZERLAND) 2024; 24:6585. [PMID: 39460066 PMCID: PMC11511449 DOI: 10.3390/s24206585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/30/2024] [Revised: 10/08/2024] [Accepted: 10/09/2024] [Indexed: 10/28/2024]
Abstract
Stroke is a leading cause of long-term disability worldwide. With the advancements in sensor technologies and data availability, artificial intelligence (AI) holds the promise of improving the amount, quality and efficiency of care and enhancing the precision of stroke rehabilitation. We aimed to identify and characterize the existing research on AI applications in stroke recovery and rehabilitation of adults, including categories of application and progression of technologies over time. Data were collected from peer-reviewed articles across various electronic databases up to January 2024. Insights were extracted using AI-enhanced multi-method, data-driven techniques, including clustering of themes and topics. This scoping review summarizes outcomes from 704 studies. Four common themes (impairment, assisted intervention, prediction and imaging, and neuroscience) were identified, in which time-linked patterns emerged. The impairment theme revealed a focus on motor function, gait and mobility, while the assisted intervention theme included applications of robotic and brain-computer interface (BCI) techniques. AI applications progressed over time, starting from conceptualization and then expanding to a broader range of techniques in supervised learning, artificial neural networks (ANN), natural language processing (NLP) and more. Applications focused on upper limb rehabilitation were reviewed in more detail, with machine learning (ML), deep learning techniques and sensors such as inertial measurement units (IMU) used for upper limb and functional movement analysis. AI applications have potential to facilitate tailored therapeutic delivery, thereby contributing to the optimization of rehabilitation outcomes and promoting sustained recovery from rehabilitation to real-world settings.
Collapse
Affiliation(s)
- Isuru Senadheera
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Prasad Hettiarachchi
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Brendon Haslam
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
- Neurorehabilitation and Recovery, The Florey, Melbourne, VIC 3086, Australia
| | - Rashmika Nawaratne
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
| | - Jacinta Sheehan
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Kylee J. Lockwood
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
| | - Damminda Alahakoon
- Centre for Data Analytics and Cognition, La Trobe Business School, La Trobe University, Melbourne, VIC 3086, Australia; (I.S.); (P.H.); (R.N.); (D.A.)
| | - Leeanne M. Carey
- Occupational Therapy, School of Allied Health, Human Services and Sport, La Trobe University, Melbourne, VIC 3086, Australia; (B.H.); (J.S.); (K.J.L.)
- Neurorehabilitation and Recovery, The Florey, Melbourne, VIC 3086, Australia
| |
Collapse
|
4
|
Pahwa B, Tayal A, Garg K. Contributions of Machine Learning in the Management of Stroke: A Bibliometric Analysis of the 50 Most Cited Articles. World Neurosurg 2024; 184:152-160. [PMID: 38244687 DOI: 10.1016/j.wneu.2024.01.059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 01/09/2024] [Accepted: 01/10/2024] [Indexed: 01/22/2024]
Abstract
BACKGROUND Though currently considered a 'black box,' machine learning (ML) has a promising future to ameliorate the health-care burden of stroke which is the second leading cause of mortality worldwide. Through this study, we sought to review the most influential articles on the applications of ML in stroke. METHODS Web of Sciences database was searched, and a list of the top 50 most cited articles, assessing the application of ML in stroke, was prepared by 2 authors, independently. Subsequently, a detailed analysis was performed to characterize the most impactful studies. RESULTS The total number of citations to the top 50 articles were 2959 (range 35-243 citations) with a median of 47 citations. Highest number of articles were published in the journal Stroke and the United States was the major contributing country. The majority of the studies focused on the utilization of ML to improve stroke risk prediction, diagnosis, and outcome prediction. Statistical analysis revealed an insignificant association between the total and mean number of citations and the impact factor of the journal (P = 0.516 and 0.987, respectively). CONCLUSIONS Recent years have witnessed a surge in the application of ML in stroke, with an enhancement in interest and funding over the years. ML has revolutionized the management of stroke and continues to aid in the neurosurgical decision-making and care in stroke patients.
Collapse
Affiliation(s)
- Bhavya Pahwa
- University College of Medical Sciences and GTB Hospital, Delhi, India
| | - Anish Tayal
- Department of Neurosurgery, All India Institute of Medical Sciences, Delhi, India
| | - Kanwaljeet Garg
- Department of Neurosurgery, All India Institute of Medical Sciences, Delhi, India.
| |
Collapse
|
5
|
Lee K, Kim JH, Hong H, Jeong Y, Ryu H, Kim H, Lee SU. Deep learning model for classifying shoulder pain rehabilitation exercises using IMU sensor. J Neuroeng Rehabil 2024; 21:42. [PMID: 38539223 PMCID: PMC10967210 DOI: 10.1186/s12984-024-01343-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2023] [Accepted: 03/15/2024] [Indexed: 04/06/2024] Open
Abstract
BACKGROUND Artificial intelligence is being used for rehabilitation, including monitoring exercise compliance through sensor technology. AI classification of shoulder exercise wearing an IMU sensor has only been reported in normal (i.e. painless) subjects. To prove the feasibility of monitoring exercise compliance, we aimed to classify 11 types of shoulder rehabilitation exercises using an AI (artificial intelligence) algorithm in patients with shoulder pain. We had the patients wear an IMU-based sensor, collected data during exercise, and determined the accuracy of exercise classification. METHODS Data were collected from 58 patients (27 males, 31 females, age range 37-82 years) diagnosed with shoulder diseases such as adhesive capsulitis and rotator cuff disease. 11 types of shoulder pain rehabilitation exercise programs were developed and repeated each exercise ten times per session while wearing an IMU sensor. The study applied the Rectified Linear Unit (ReLU) and the SoftMax as the activation function for hidden layers, the output layer. RESULTS The acquired data was used to train a DNN model using the multilayer perceptron algorithm. The trained model was used to classify 11 types of shoulder pain rehabilitation exercises. The training accuracy was 0.975 and the test accuracy was 0.925. CONCLUSION The study demonstrates that IMU sensor data can effectively classify shoulder pain rehabilitation exercises, providing more appropriate feedback for patients. The model can be utilized to establish a system for remotely monitoring patients' exercise performance. The use of deep learning in patient monitoring and rehabilitation has significant potential to bring innovative changes to healthcare service delivery.
Collapse
Affiliation(s)
- Kyuwon Lee
- Dept. of Rehabilitation Medicine, Seoul Metropolitan Government Boramae Medical Center, Seoul, South Korea
| | - Jeong-Hyun Kim
- Dept. of Rehabilitation Medicine, Seoul Metropolitan Government Boramae Medical Center, Seoul, South Korea
| | - Hyeon Hong
- Dept. of Rehabilitation Medicine, Seoul Metropolitan Government Boramae Medical Center, Seoul, South Korea
| | - Yeji Jeong
- Dept. of Rehabilitation Medicine, Seoul Metropolitan Government Boramae Medical Center, Seoul, South Korea
| | - Hokyoung Ryu
- Dept. of Graduate School of Technology and Innovation Management, Hanyang University, Seoul, South Korea
| | - Hyundo Kim
- Dept. of Intelligence Computing, Hanyang University, Seoul, South Korea
| | - Shi-Uk Lee
- Dept. of Rehabilitation Medicine, Seoul Metropolitan Government Boramae Medical Center, Seoul, South Korea.
- Dept. of Physical Medicine & Rehabilitation, College of Medicine, Seoul National University, Seoul, South Korea.
| |
Collapse
|
6
|
Wang X, Zhang J, Xie SQ, Shi C, Li J, Zhang ZQ. Quantitative Upper Limb Impairment Assessment for Stroke Rehabilitation: A Review. IEEE SENSORS JOURNAL 2024; 24:7432-7447. [DOI: 10.1109/jsen.2024.3359811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2025]
Affiliation(s)
- Xin Wang
- School of Electrical and Electronic Engineering, University of Leeds, Leeds, U.K
| | - Jie Zhang
- School of Electrical and Electronic Engineering, University of Leeds, Leeds, U.K
| | - Sheng Quan Xie
- School of Electrical and Electronic Engineering, University of Leeds, Leeds, U.K
| | - Chaoyang Shi
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Jun Li
- College of Intelligent Systems Science and Engineering, Hubei Minzu University, Enshi, China
| | - Zhi-Qiang Zhang
- School of Electrical and Electronic Engineering, University of Leeds, Leeds, U.K
| |
Collapse
|
7
|
Oubre B, Lee SI. Detection and Assessment of Point-to-Point Movements During Functional Activities Using Deep Learning and Kinematic Analyses of the Stroke-Affected Wrist. IEEE J Biomed Health Inform 2024; 28:1022-1030. [PMID: 38015679 DOI: 10.1109/jbhi.2023.3337156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
Stoke is a leading cause of long-term disability, including upper-limb hemiparesis. Frequent, unobtrusive assessment of naturalistic motor performance could enable clinicians to better assess rehabilitation effectiveness and monitor patients' recovery trajectories. We therefore propose and validate a two-phase data analytic pipeline to estimate upper-limb impairment based on the naturalistic performance of activities of daily living (ADLs). Eighteen stroke survivors were equipped with an inertial sensor on the stroke-affected wrist and performed up to four ADLs in a naturalistic manner. Continuous inertial time series were segmented into sliding windows, and a machine-learned model identified windows containing instances of point-to-point (P2P) movements. Using kinematic features extracted from the detected windows, a subsequent model was used to estimate upper-limb motor impairment, as measured by the Fugl-Meyer Assessment (FMA). Both models were evaluated using leave-one-subject-out cross-validation. The P2P movement detection model had an area under the precision-recall curve of 0.72. FMA estimates had a normalized root mean square error of 18.8% with R2=0.72. These promising results support the potential to develop seamless, ecologically valid measures of real-world motor performance.
Collapse
|
8
|
Liu H, Wei P, Wang H, Lv X, Duan W, Li M, Zhao Y, Wang Q, Chen X, Shi G, Han B, Hao J. An EEG motor imagery dataset for brain computer interface in acute stroke patients. Sci Data 2024; 11:131. [PMID: 38272904 PMCID: PMC10811218 DOI: 10.1038/s41597-023-02787-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Accepted: 11/24/2023] [Indexed: 01/27/2024] Open
Abstract
The brain-computer interface (BCI) is a technology that involves direct communication with parts of the brain and has evolved rapidly in recent years; it has begun to be used in clinical practice, such as for patient rehabilitation. Patient electroencephalography (EEG) datasets are critical for algorithm optimization and clinical applications of BCIs but are rare at present. We collected data from 50 acute stroke patients with wireless portable saline EEG devices during the performance of two tasks: 1) imagining right-handed movements and 2) imagining left-handed movements. The dataset consists of four types of data: 1) the motor imagery instructions, 2) raw recording data, 3) pre-processed data after removing artefacts and other manipulations, and 4) patient characteristics. This is the first open dataset to address left- and right-handed motor imagery in acute stroke patients. We believe that the dataset will be very helpful for analysing brain activation and designing decoding methods that are more applicable for acute stroke patients, which will greatly facilitate research in the field of motor imagery-BCI.
Collapse
Affiliation(s)
- Haijie Liu
- Department of Neurology, Xuanwu Hospital Capital Medical University, Beijing, 100053, China
- National Center for Neurological Disorders, Beijing, 100053, China
| | - Penghu Wei
- National Center for Neurological Disorders, Beijing, 100053, China
- Department of Neurosurgery, Xuanwu Hospital Capital Medical University, Beijing, 100053, China
| | - Haochong Wang
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, Shanxi, 710049, China
| | - Xiaodong Lv
- Department of Neurology, Xuanwu Hospital Capital Medical University, Beijing, 100053, China
- National Center for Neurological Disorders, Beijing, 100053, China
| | - Wei Duan
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, 100000, China
| | - Meijie Li
- Department of Neurology, Xuanwu Hospital Capital Medical University, Beijing, 100053, China
- National Center for Neurological Disorders, Beijing, 100053, China
| | - Yan Zhao
- Department of Neurology, Xuanwu Hospital Capital Medical University, Beijing, 100053, China
- National Center for Neurological Disorders, Beijing, 100053, China
| | - Qingmei Wang
- Stroke Biological Recovery Laboratory, Department of Physical Medicine and Rehabilitation, Spaulding Rehabilitation Hospital, Harvard Medical School, Charlestown, MA, 02129, USA
| | - Xinyuan Chen
- Donders Institute of Cognition and Behaviour, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Gaige Shi
- The Key Laboratory of Biomedical Information Engineering of Ministry of Education, Institute of Health and Rehabilitation Science, School of Life Science and Technology, Xi'an Jiaotong University, Xi'an, Shanxi, 710049, China
| | - Bo Han
- Department of Neurology, Xuanwu Hospital Capital Medical University, Beijing, 100053, China
- National Center for Neurological Disorders, Beijing, 100053, China
| | - Junwei Hao
- Department of Neurology, Xuanwu Hospital Capital Medical University, Beijing, 100053, China.
- National Center for Neurological Disorders, Beijing, 100053, China.
- Chinese Institute for Brain Research, Beijing, 100053, China.
| |
Collapse
|
9
|
Nunes AS, Yildiz Potter İ, Mishra RK, Bonato P, Vaziri A. A deep learning wearable-based solution for continuous at-home monitoring of upper limb goal-directed movements. Front Neurol 2024; 14:1295132. [PMID: 38249724 PMCID: PMC10796739 DOI: 10.3389/fneur.2023.1295132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 11/28/2023] [Indexed: 01/23/2024] Open
Abstract
Introduction Monitoring upper limb function is crucial for tracking progress, assessing treatment effectiveness, and identifying potential problems or complications. Hand goal-directed movements (GDMs) are a crucial aspect of daily life, reflecting planned motor commands with hand trajectories towards specific target locations. Previous studies have shown that GDM tasks can detect early changes in upper limb function in neurodegenerative diseases and can be used to track disease progression over time. Methods In this study, we used accelerometer data from stroke survivor participants and controls doing activities of daily living to develop an automated deep learning approach to detect GDMs. The model performance for detecting GDM or non-GDM from windowed data achieved an AUC of 0.9, accuracy 0.83, sensitivity 0.81, specificity 0.84 and F1 0.82. Results We further validated the utility of detecting GDM by extracting features from GDM periods and using these features to classify whether the measurements are collected from a stroke survivor or a control participant, and to predict the Fugl-Meyer assessment score from stroke survivors. Discussion This study presents a promising and reliable tool for monitoring upper limb function in a real-world setting, and assessing biomarkers related to upper limb health in neurological, neuromuscular and muscles disorders.
Collapse
Affiliation(s)
| | | | | | - Paolo Bonato
- Department of Physical Medicine and Rehabilitation, Harvard Medical School Spaulding Rehabilitation Hospital, Boston, MA, United States
| | | |
Collapse
|
10
|
Oh Y, Choi SA, Shin Y, Jeong Y, Lim J, Kim S. Investigating Activity Recognition for Hemiparetic Stroke Patients Using Wearable Sensors: A Deep Learning Approach with Data Augmentation. SENSORS (BASEL, SWITZERLAND) 2023; 24:210. [PMID: 38203072 PMCID: PMC10781277 DOI: 10.3390/s24010210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Revised: 12/23/2023] [Accepted: 12/28/2023] [Indexed: 01/12/2024]
Abstract
Measuring the daily use of an affected limb after hospital discharge is crucial for hemiparetic stroke rehabilitation. Classifying movements using non-intrusive wearable sensors provides context for arm use and is essential for the development of a home rehabilitation system. However, the movement classification of stroke patients poses unique challenges, including variability and sparsity. To address these challenges, we collected movement data from 15 hemiparetic stroke patients (Stroke group) and 29 non-disabled individuals (ND group). The participants performed two different tasks, the range of motion (14 movements) task and the activities of daily living (56 movements) task, wearing five inertial measurement units in a home setting. We trained a 1D convolutional neural network and evaluated its performance for different training groups: ND-only, Stroke-only, and ND and Stroke jointly. We further compared the model performance with data augmentation from axis rotation and investigated how the performance varied based on the asymmetry of movements. The joint training of ND + Stroke yielded an increased F1-score by a margin of 31.6% and 10.6% compared to ND-only training and Stroke-only training, respectively. Data augmentation further enhanced F1-scores across all conditions by an average of 11.3%. Finally, asymmetric movements decreased the F1-score by 25.9% compared to symmetric movements in the Stroke group, indicating the importance of asymmetry in movement classification.
Collapse
Affiliation(s)
- Youngmin Oh
- School of Computing, Gachon University, Seongnam 13120, Republic of Korea;
| | - Sol-A Choi
- Department of Physical Therapy, Jeonju University, Jeonju 55069, Republic of Korea; (S.-A.C.); (Y.S.); (Y.J.)
| | - Yumi Shin
- Department of Physical Therapy, Jeonju University, Jeonju 55069, Republic of Korea; (S.-A.C.); (Y.S.); (Y.J.)
| | - Yeonwoo Jeong
- Department of Physical Therapy, Jeonju University, Jeonju 55069, Republic of Korea; (S.-A.C.); (Y.S.); (Y.J.)
| | - Jongkuk Lim
- Department of Computer Engineering, Dankook University, Yongin 16890, Republic of Korea;
| | - Sujin Kim
- Department of Physical Therapy, Jeonju University, Jeonju 55069, Republic of Korea; (S.-A.C.); (Y.S.); (Y.J.)
| |
Collapse
|
11
|
Okita S, Yakunin R, Korrapati J, Ibrahim M, Schwerz de Lucena D, Chan V, Reinkensmeyer DJ. Counting Finger and Wrist Movements Using Only a Wrist-Worn, Inertial Measurement Unit: Toward Practical Wearable Sensing for Hand-Related Healthcare Applications. SENSORS (BASEL, SWITZERLAND) 2023; 23:5690. [PMID: 37420857 DOI: 10.3390/s23125690] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 06/08/2023] [Accepted: 06/15/2023] [Indexed: 07/09/2023]
Abstract
The ability to count finger and wrist movements throughout the day with a nonobtrusive, wearable sensor could be useful for hand-related healthcare applications, including rehabilitation after a stroke, carpal tunnel syndrome, or hand surgery. Previous approaches have required the user to wear a ring with an embedded magnet or inertial measurement unit (IMU). Here, we demonstrate that it is possible to identify the occurrence of finger and wrist flexion/extension movements based on vibrations detected by a wrist-worn IMU. We developed an approach we call "Hand Activity Recognition through using a Convolutional neural network with Spectrograms" (HARCS) that trains a CNN based on the velocity/acceleration spectrograms that finger/wrist movements create. We validated HARCS with the wrist-worn IMU recordings obtained from twenty stroke survivors during their daily life, where the occurrence of finger/wrist movements was labeled using a previously validated algorithm called HAND using magnetic sensing. The daily number of finger/wrist movements identified by HARCS had a strong positive correlation to the daily number identified by HAND (R2 = 0.76, p < 0.001). HARCS was also 75% accurate when we labeled the finger/wrist movements performed by unimpaired participants using optical motion capture. Overall, the ringless sensing of finger/wrist movement occurrence is feasible, although real-world applications may require further accuracy improvements.
Collapse
Affiliation(s)
- Shusuke Okita
- Department of Mechanical and Aerospace Engineering, University of California Irvine, Irvine, CA 92697, USA
- Department of Anatomy and Neurobiology, University of California Irvine, Irvine, CA 92697, USA
| | - Roman Yakunin
- College of Computing, Georgia Institute of Technology, Atlanta, GA 30332, USA
| | - Jathin Korrapati
- Department of Electrical Engineering and Computer Science, University of California Berkeley, Berkeley, CA 94720, USA
| | - Mina Ibrahim
- Department of Biomedical Engineering, University of California Irvine, Irvine, CA 92697, USA
| | - Diogo Schwerz de Lucena
- AE Studio, Venice, CA 90291, USA
- CAPES Foundation, Ministry of Education of Brazil, Brasilia 70040-020, Brazil
| | - Vicky Chan
- Rehabilitation Services, University of California Irvine, Irvine, CA 92697, USA
| | - David J Reinkensmeyer
- Department of Mechanical and Aerospace Engineering, University of California Irvine, Irvine, CA 92697, USA
- Department of Anatomy and Neurobiology, University of California Irvine, Irvine, CA 92697, USA
- Department of Biomedical Engineering, University of California Irvine, Irvine, CA 92697, USA
| |
Collapse
|
12
|
Razfar N, Kashef R, Mohammadi F. Automatic Post-Stroke Severity Assessment Using Novel Unsupervised Consensus Learning for Wearable and Camera-Based Sensor Datasets. SENSORS (BASEL, SWITZERLAND) 2023; 23:5513. [PMID: 37420682 DOI: 10.3390/s23125513] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/21/2023] [Revised: 05/30/2023] [Accepted: 06/02/2023] [Indexed: 07/09/2023]
Abstract
Stroke survivors often suffer from movement impairments that significantly affect their daily activities. The advancements in sensor technology and IoT have provided opportunities to automate the assessment and rehabilitation process for stroke survivors. This paper aims to provide a smart post-stroke severity assessment using AI-driven models. With the absence of labelled data and expert assessment, there is a research gap in providing virtual assessment, especially for unlabeled data. Inspired by the advances in consensus learning, in this paper, we propose a consensus clustering algorithm, PSA-NMF, that combines various clusterings into one united clustering, i.e., cluster consensus, to produce more stable and robust results compared to individual clustering. This paper is the first to investigate severity level using unsupervised learning and trunk displacement features in the frequency domain for post-stroke smart assessment. Two different methods of data collection from the U-limb datasets-the camera-based method (Vicon) and wearable sensor-based technology (Xsens)-were used. The trunk displacement method labelled each cluster based on the compensatory movements that stroke survivors employed for their daily activities. The proposed method uses the position and acceleration data in the frequency domain. Experimental results have demonstrated that the proposed clustering method that uses the post-stroke assessment approach increased the evaluation metrics such as accuracy and F-score. These findings can lead to a more effective and automated stroke rehabilitation process that is suitable for clinical settings, thus improving the quality of life for stroke survivors.
Collapse
Affiliation(s)
- Najmeh Razfar
- Department of Electrical, Computer, and Biomedical Engineering, Faculty of Engineering and Architectural Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| | - Rasha Kashef
- Department of Electrical, Computer, and Biomedical Engineering, Faculty of Engineering and Architectural Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| | - Farah Mohammadi
- Department of Electrical, Computer, and Biomedical Engineering, Faculty of Engineering and Architectural Science, Toronto Metropolitan University, Toronto, ON M5B 2K3, Canada
| |
Collapse
|
13
|
Yen JM, Lim JH. A Clinical Perspective on Bespoke Sensing Mechanisms for Remote Monitoring and Rehabilitation of Neurological Diseases: Scoping Review. SENSORS (BASEL, SWITZERLAND) 2023; 23:536. [PMID: 36617134 PMCID: PMC9823649 DOI: 10.3390/s23010536] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/20/2022] [Revised: 12/17/2022] [Accepted: 12/29/2022] [Indexed: 06/17/2023]
Abstract
Neurological diseases including stroke and neurodegenerative disorders cause a hefty burden on the healthcare system. Survivors experience significant impairment in mobility and daily activities, which requires extensive rehabilitative interventions to assist them to regain lost skills and restore independence. The advent of remote rehabilitation architecture and enabling technology mandates the elaboration of sensing mechanisms tailored to individual clinical needs. This study aims to review current trends in the application of sensing mechanisms in remote monitoring and rehabilitation in neurological diseases, and to provide clinical insights to develop bespoke sensing mechanisms. A systematic search was performed using the PubMED database to identify 16 papers published for the period between 2018 to 2022. Teleceptive sensors (56%) were utilized more often than wearable proximate sensors (50%). The most commonly used modality was infrared (38%) and acceleration force (38%), followed by RGB color, EMG, light and temperature, and radio signal. The strategy adopted to improve the sensing mechanism included a multimodal sensor, the application of multiple sensors, sensor fusion, and machine learning. Most of the stroke studies utilized biofeedback control systems (78%) while the majority of studies for neurodegenerative disorders used sensors for remote monitoring (57%). Functional assessment tools that the sensing mechanism may emulate to produce clinically valid information were proposed and factors affecting user adoption were described. Lastly, the limitations and directions for further development were discussed.
Collapse
Affiliation(s)
- Jia Min Yen
- Division of Rehabilitation Medicine, University Medicine Cluster, National University Hospital, Singapore 119074, Singapore
| | - Jeong Hoon Lim
- Division of Rehabilitation Medicine, University Medicine Cluster, National University Hospital, Singapore 119074, Singapore
- Department of Medicine, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119077, Singapore
| |
Collapse
|
14
|
Park C, Yi C, Choi WJ, Lim HS, Yoon HU, You S(JH. Long-term effects of deep-learning digital therapeutics on pain, movement control, and preliminary cost-effectiveness in low back pain: A randomized controlled trial. Digit Health 2023; 9:20552076231217817. [PMID: 38053732 PMCID: PMC10695084 DOI: 10.1177/20552076231217817] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2023] [Accepted: 11/11/2023] [Indexed: 12/07/2023] Open
Abstract
Objective The present study aimed to compare the effects of a deep learning-based digital application with digital application physical therapy (DPT) and those of conventional physical therapy (CPT) on back pain intensity, limited functional ability, lower extremity weakness, radicular symptoms, limited range of motion (ROM), functional movement, quality of life, cost-effectiveness, and postintervention questionnaires for perceived transmission risk of COVID-19 and satisfaction results in 100 participants with low back pain (LBP). Methods One hundred participants with LBP were randomized into either DPT or CPT groups, three times per week over four weeks. Outcome measures included the (1) Oswestry Disability Index, (2) Quebec Back Pain Disability Scale, (3) Roland-Morris Disability Questionnaire (RMDQ), (4) Numeric Pain Rating Scale, (5) functional movement screen (FMS), (6) short form-12, (7) lower extremity strength, (8) ROM of trunk flexion, extension, and bilateral side bending, (9) questionnaires for perceived transmission risk of COVID-19, (10) preliminary cost-effectiveness, and (11) postintervention satisfaction questionnaire results. The analysis of variance was conducted at p < 0.05. Results Analysis of variance showed that DPT showed superior effects, compared to CPT on RMDQ, hip extensor strength, transmission risk of COVID-19, as well as satisfaction. Both groups showed significant improvement pre- and postintervention, suggesting that DPT is as effective as CPT, and was superior in preliminary cost-effectiveness and transmission risk of COVID-19. Conclusions Our results provide novel, promising clinical evidence that DPT was as effective as CPT in improving structural and functional impairment, activity limitation, and participation restriction. Our results highlight the successful incorporation of DPT intervention for clinical outcome measures, lower extremity strength, trunk mobility, ADL improvement, QOL improvement, and FMS in LBP.
Collapse
Affiliation(s)
- Chanhee Park
- Sports(Movement Artificial-Intelligence Robotics Technology (SMART) Institute, Department of Physical Therapy, Yonsei University, Wonju, Republic of Korea
- Department of Physical Therapy, Yonsei University, Wonju, Republic of Korea
| | - Chunghwi Yi
- Department of Physical Therapy, Yonsei University, Wonju, Republic of Korea
| | | | - Hyo-Sang Lim
- Division of Software, Yonsei University, Wonju, Republic of Korea
| | - Han Ul Yoon
- Division of Computer and Telecommunication Engineering, Yonsei University, Wonju, Republic of Korea
| | - Sung (Joshua) Hyun You
- Sports(Movement Artificial-Intelligence Robotics Technology (SMART) Institute, Department of Physical Therapy, Yonsei University, Wonju, Republic of Korea
- Department of Physical Therapy, Yonsei University, Wonju, Republic of Korea
| |
Collapse
|
15
|
Guo L, Zhang B, Wang J, Wu Q, Li X, Zhou L, Xiong D. Wearable Intelligent Machine Learning Rehabilitation Assessment for Stroke Patients Compared with Clinician Assessment. J Clin Med 2022; 11:jcm11247467. [PMID: 36556083 PMCID: PMC9783419 DOI: 10.3390/jcm11247467] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 12/10/2022] [Accepted: 12/13/2022] [Indexed: 12/23/2022] Open
Abstract
In order to solve the shortcomings of the current clinical scale assessment for stroke patients, such as excessive time consumption, strong subjectivity, and coarse grading, this study designed an intelligent rehabilitation assessment system based on wearable devices and a machine learning algorithm and explored the effectiveness of the system in assessing patients’ rehabilitation outcomes. The accuracy and effectiveness of the intelligent rehabilitation assessment system were verified by comparing the consistency and time between the designed intelligent rehabilitation assessment system scores and the clinical Fugl−Meyer assessment (FMA) scores. A total of 120 stroke patients from two hospitals participated as volunteers in the trial study, and statistical analyses of the two assessment methods were performed. The results showed that the R2 of the total score regression analysis for both methods was 0.9667, 95% CI 0.92−0.98, p < 0.001, and the mean of the deviation was 0.30, 95% CI 0.57−1.17. The percentages of deviations/relative deviations falling within the mean ± 1.96 SD of deviations/relative deviations were 92.50% and 95.83%, respectively. The mean time for system assessment was 35.00% less than that for clinician assessment, p < 0.05. Therefore, wearable intelligent machine learning rehabilitation assessment has a strong and significant correlation with clinician assessment, and the time spent is significantly reduced, which provides an accurate, objective, and effective solution for clinical rehabilitation assessment and remote rehabilitation without the presence of physicians.
Collapse
Affiliation(s)
- Liquan Guo
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230052, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Bochao Zhang
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230052, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Jiping Wang
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230052, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Qunqiang Wu
- Department of Rehabilitation Medicine, Tangdu Hospital Airforce Medicine University, Xi’an 710032, China
| | - Xinming Li
- Department of Rehabilitation Medicine, Xi’an Gaoxin Hospital, Xi’an 710065, China
| | - Linfu Zhou
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- Department of Respiratory and Critical Care Medicine, The First Affiliated Hospital, Nanjing Medical University, Nanjing 210029, China
- Correspondence: (L.Z.); (D.X.); Tel.: +86-18662576055 (D.X.)
| | - Daxi Xiong
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230052, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
- Correspondence: (L.Z.); (D.X.); Tel.: +86-18662576055 (D.X.)
| |
Collapse
|
16
|
Zhu M, Men Q, Ho ESL, Leung H, Shum HPH. A Two-stream Convolutional Network for Musculoskeletal and Neurological Disorders Prediction. J Med Syst 2022; 46:76. [PMID: 36201114 PMCID: PMC9537228 DOI: 10.1007/s10916-022-01857-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Accepted: 08/17/2022] [Indexed: 11/24/2022]
Abstract
Musculoskeletal and neurological disorders are the most common causes of walking problems among older people, and they often lead to diminished quality of life. Analyzing walking motion data manually requires trained professionals and the evaluations may not always be objective. To facilitate early diagnosis, recent deep learning-based methods have shown promising results for automated analysis, which can discover patterns that have not been found in traditional machine learning methods. We observe that existing work mostly applies deep learning on individual joint features such as the time series of joint positions. Due to the challenge of discovering inter-joint features such as the distance between feet (i.e. the stride width) from generally smaller-scale medical datasets, these methods usually perform sub-optimally. As a result, we propose a solution that explicitly takes both individual joint features and inter-joint features as input, relieving the system from the need of discovering more complicated features from small data. Due to the distinctive nature of the two types of features, we introduce a two-stream framework, with one stream learning from the time series of joint position and the other from the time series of relative joint displacement. We further develop a mid-layer fusion module to combine the discovered patterns in these two streams for diagnosis, which results in a complementary representation of the data for better prediction performance. We validate our system with a benchmark dataset of 3D skeleton motion that involves 45 patients with musculoskeletal and neurological disorders, and achieve a prediction accuracy of 95.56%, outperforming state-of-the-art methods.
Collapse
Affiliation(s)
- Manli Zhu
- Department of Computer and Information Sciences, Northumbria University, Newcastle upon Tyne, UK
| | - Qianhui Men
- Department of Engineering Science, University of Oxford, Oxford, UK
| | - Edmond S. L. Ho
- School of Computing Science, University of Glasgow, Glasgow, UK
| | - Howard Leung
- Department of Computer Science, City University of Hong Kong, Kowloon, Hong Kong
| | | |
Collapse
|
17
|
Kim GJ, Parnandi A, Eva S, Schambra H. The use of wearable sensors to assess and treat the upper extremity after stroke: a scoping review. Disabil Rehabil 2022; 44:6119-6138. [PMID: 34328803 PMCID: PMC9912423 DOI: 10.1080/09638288.2021.1957027] [Citation(s) in RCA: 34] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2021] [Revised: 06/25/2021] [Accepted: 07/13/2021] [Indexed: 01/27/2023]
Abstract
PURPOSE To address the gap in the literature and clarify the expanding role of wearable sensor data in stroke rehabilitation, we summarized the methods for upper extremity (UE) sensor-based assessment and sensor-based treatment. MATERIALS AND METHODS The guideline outlined by the preferred reporting items for systematic reviews and meta-analysis extension for scoping reviews was used to complete this scoping review. Information pertaining to participant demographics, sensory information, data collection, data processing, data analysis, and study results were extracted from the studies for analysis and synthesis. RESULTS We included 43 articles in the final review. We organized the results into assessment and treatment categories. The included articles used wearable sensors to identify UE functional motion, categorize motor impairment/activity limitation, and quantify real-world use. Wearable sensors were also used to augment UE training by triggering sensory cues or providing instructional feedback about the affected UE. CONCLUSIONS Sensors have the potential to greatly expand assessment and treatment beyond traditional clinic-based approaches. This capability could support the quantification of rehabilitation dose, the nuanced assessment of impairment and activity limitation, the characterization of daily UE use patterns in real-world settings, and augment UE training adherence for home-based rehabilitation.IMPLICATIONS FOR REHABILITATIONSensor data have been used to assess UE functional motion, motor impairment/activity limitation, and real-world use.Sensor-assisted treatment approaches are emerging, and may be a promising tool to augment UE adherence in home-based rehabilitation.Wearable sensors may extend our ability to objectively assess UE motion beyond supervised clinical settings, and into home and community settings.
Collapse
Affiliation(s)
- Grace J. Kim
- Department of Occupational Therapy, Steinhardt School of Culture, Education and Human Development, New York University, New York, NY, USA
| | - Avinash Parnandi
- Department of Neurology, NYU Langone Grossman School of Medicine, New York, NY, USA
| | - Sharon Eva
- Department of Occupational Therapy, Nova Southeastern University, Fort Lauderdale, FL, USA
| | - Heidi Schambra
- Department of Neurology, NYU Langone Grossman School of Medicine, New York, NY, USA
| |
Collapse
|
18
|
Islam MM, Nooruddin S, Karray F, Muhammad G. Human activity recognition using tools of convolutional neural networks: A state of the art review, data sets, challenges, and future prospects. Comput Biol Med 2022; 149:106060. [DOI: 10.1016/j.compbiomed.2022.106060] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2022] [Revised: 08/09/2022] [Accepted: 08/27/2022] [Indexed: 01/02/2023]
|
19
|
Zhou Y, Stewart R. Highly flexible, durable,
UV
resistant, and electrically conductive graphene based
TPU
/textile composite sensor. POLYM ADVAN TECHNOL 2022. [DOI: 10.1002/pat.5856] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Affiliation(s)
- Yi Zhou
- Dyson School of Design Engineering Imperial College London London UK
| | - Rebecca Stewart
- Dyson School of Design Engineering Imperial College London London UK
| |
Collapse
|
20
|
Jaén-Vargas M, Reyes Leiva KM, Fernandes F, Barroso Gonçalves S, Tavares Silva M, Lopes DS, Serrano Olmedo JJ. Effects of sliding window variation in the performance of acceleration-based human activity recognition using deep learning models. PeerJ Comput Sci 2022; 8:e1052. [PMID: 36091986 PMCID: PMC9455026 DOI: 10.7717/peerj-cs.1052] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2022] [Accepted: 07/03/2022] [Indexed: 06/15/2023]
Abstract
Deep learning (DL) models are very useful for human activity recognition (HAR); these methods present better accuracy for HAR when compared to traditional, among other advantages. DL learns from unlabeled data and extracts features from raw data, as for the case of time-series acceleration. Sliding windows is a feature extraction technique. When used for preprocessing time-series data, it provides an improvement in accuracy, latency, and cost of processing. The time and cost of preprocessing can be beneficial especially if the window size is small, but how small can this window be to keep good accuracy? The objective of this research was to analyze the performance of four DL models: a simple deep neural network (DNN); a convolutional neural network (CNN); a long short-term memory network (LSTM); and a hybrid model (CNN-LSTM), when variating the sliding window size using fixed overlapped windows to identify an optimal window size for HAR. We compare the effects in two acceleration sources': wearable inertial measurement unit sensors (IMU) and motion caption systems (MOCAP). Moreover, short sliding windows of sizes 5, 10, 15, 20, and 25 frames to long ones of sizes 50, 75, 100, and 200 frames were compared. The models were fed using raw acceleration data acquired in experimental conditions for three activities: walking, sit-to-stand, and squatting. Results show that the most optimal window is from 20-25 frames (0.20-0.25s) for both sources, providing an accuracy of 99,07% and F1-score of 87,08% in the (CNN-LSTM) using the wearable sensors data, and accuracy of 98,8% and F1-score of 82,80% using MOCAP data; similar accurate results were obtained with the LSTM model. There is almost no difference in accuracy in larger frames (100, 200). However, smaller windows present a decrease in the F1-score. In regard to inference time, data with a sliding window of 20 frames can be preprocessed around 4x (LSTM) and 2x (CNN-LSTM) times faster than data using 100 frames.
Collapse
Affiliation(s)
- Milagros Jaén-Vargas
- Bioinstrumentation and Nanomedicine Laboratory, Center for Biomedical Technology, Universidad Politécnica de Madrid, Madrid, Spain
| | - Karla Miriam Reyes Leiva
- Bioinstrumentation and Nanomedicine Laboratory, Center for Biomedical Technology, Universidad Politécnica de Madrid, Madrid, Spain
- Engineering Faculty, Universidad Tecnológica Centroamericana, San Pedro Sula, Honduras
| | | | | | | | - Daniel Simões Lopes
- INESC ID, Lisbon, Portugal
- Instituto Superior Técnico, Universidade de Lisboa, Lisbon, Portugal
| | - José Javier Serrano Olmedo
- Bioinstrumentation and Nanomedicine Laboratory, Center for Biomedical Technology, Universidad Politécnica de Madrid, Madrid, Spain
- CIBER-BBN, Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina, Madrid, Spain
| |
Collapse
|
21
|
Chen Y, Zhang D, Karimi HR, Deng C, Yin W. A new deep learning framework based on blood pressure range constraint for continuous cuffless BP estimation. Neural Netw 2022; 152:181-190. [DOI: 10.1016/j.neunet.2022.04.017] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2022] [Revised: 03/23/2022] [Accepted: 04/14/2022] [Indexed: 11/25/2022]
|
22
|
Luvizutto GJ, Silva GF, Nascimento MR, Sousa Santos KC, Appelt PA, de Moura Neto E, de Souza JT, Wincker FC, Miranda LA, Hamamoto Filho PT, de Souza LAPS, Simões RP, de Oliveira Vidal EI, Bazan R. Use of artificial intelligence as an instrument of evaluation after stroke: a scoping review based on international classification of functioning, disability and health concept. Top Stroke Rehabil 2022; 29:331-346. [PMID: 34115576 DOI: 10.1080/10749357.2021.1926149] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2021] [Accepted: 04/22/2021] [Indexed: 10/21/2022]
Abstract
INTRODUCTION To understand the current practices in stroke evaluation, the main clinical decision support system and artificial intelligence (AI) technologies need to be understood to assist the therapist in obtaining better insights about impairments and level of activity and participation in persons with stroke during rehabilitation. METHODS This scoping review maps the use of AI for the functional evaluation of persons with stroke; the context involves any setting of rehabilitation. Data were extracted from CENTRAL, MEDLINE, EMBASE, LILACS, CINAHL, PEDRO Web of Science, IEEE Xplore, AAAI Publications, ACM Digital Library, MathSciNet, and arXiv up to January 2021. The data obtained from the literature review were summarized in a single dataset in which each reference paper was considered as an instance, and the study characteristics were considered as attributes. The attributes used for the multiple correspondence analysis were publication year, study type, sample size, age, stroke phase, stroke type, functional status, AI type, and AI function. RESULTS Forty-four studies were included. The analysis showed that spasticity analysis based on ML techniques was used for the cases of stroke with moderate functional status. The techniques of deep learning and pressure sensors were used for gait analysis. Machine learning techniques and algorithms were used for upper limb and reaching analyses. The inertial measurement unit technique was applied in studies where the functional status was between mild and severe. The fuzzy logic technique was used for activity classifiers. CONCLUSION The prevailing research themes demonstrated the growing utility of AI algorithms for stroke evaluation.
Collapse
Affiliation(s)
- Gustavo José Luvizutto
- Department of Applied Physical Therapy, Federal University of Triângulo Mineiro, Uberaba, Brazil
| | | | | | | | | | | | - Juli Thomaz de Souza
- Department of Internal Medicine, Botucatu Medical School, Brazil
- Department of Neurology, Psychology and Psychiatry, Botucatu Medical School, Brazil
| | - Fernanda Cristina Wincker
- Department of Internal Medicine, Botucatu Medical School, Brazil
- Department of Neurology, Psychology and Psychiatry, Botucatu Medical School, Brazil
| | - Luana Aparecida Miranda
- Department of Internal Medicine, Botucatu Medical School, Brazil
- Department of Neurology, Psychology and Psychiatry, Botucatu Medical School, Brazil
| | | | | | - Rafael Plana Simões
- Department of Bioprocesses and Biotechnology, São Paulo State University, Botucatu, SP, Brazil
| | | | - Rodrigo Bazan
- Department of Neurology, Psychology and Psychiatry, Botucatu Medical School, Brazil
| |
Collapse
|
23
|
A machine learning approach for the identification of kinematic biomarkers of chronic neck pain during single- and dual-task gait. Gait Posture 2022; 96:81-86. [PMID: 35597050 DOI: 10.1016/j.gaitpost.2022.05.015] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 05/06/2022] [Accepted: 05/10/2022] [Indexed: 02/02/2023]
Abstract
BACKGROUND Changes in gait characteristics have been reported in people with chronic neck pain (CNP). RESEARCH QUESTION Can we classify people with and without CNP by training machine learning models with Inertial Measurement Units (IMU)-based gait kinematic data? METHODS Eighteen asymptomatic individuals and 21 participants with CNP were recruited for the study and performed two gait trajectories, (1) linear walking with their head straight (single-task) and (2) linear walking with continuous head-rotation (dual-task). Kinematic data were recorded from three IMU sensors attached to the forehead, upper thoracic spine (T1), and lower thoracic spine (T12). Temporal and spectral features were extracted to generate the dataset for both single- and dual-task gait. To evaluate the most significant features and simultaneously reduce the dataset size, the Neighbourhood Component Analysis (NCA) method was utilized. Three supervised models were applied, including K-Nearest Neighbour, Support Vector Machine, and Linear Discriminant Analysis to test the performance of the most important temporal and spectral features. RESULTS The performance of all classifiers increased after the implementation of NCA. The best performance was achieved by NCA-Support Vector Machine with an accuracy of 86.85%, specificity of 83.30%, and sensitivity of 92.85% during the dual-task gait using only nine features. SIGNIFICANCE The results present a data-driven approach and machine learning-based methods to identify test conditions and features from high-dimensional data obtained during gait for the classification of people with and without CNP.
Collapse
|
24
|
PrimSeq: A deep learning-based pipeline to quantitate rehabilitation training. PLOS DIGITAL HEALTH 2022; 1. [PMID: 36420347 PMCID: PMC9681023 DOI: 10.1371/journal.pdig.0000044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
Stroke rehabilitation seeks to accelerate motor recovery by training functional activities, but may have minimal impact because of insufficient training doses. In animals, training hundreds of functional motions in the first weeks after stroke can substantially boost upper extremity recovery. The optimal quantity of functional motions to boost recovery in humans is currently unknown, however, because no practical tools exist to measure them during rehabilitation training. Here, we present PrimSeq, a pipeline to classify and count functional motions trained in stroke rehabilitation. Our approach integrates wearable sensors to capture upper-body motion, a deep learning model to predict motion sequences, and an algorithm to tally motions. The trained model accurately decomposes rehabilitation activities into elemental functional motions, outperforming competitive machine learning methods. PrimSeq furthermore quantifies these motions at a fraction of the time and labor costs of human experts. We demonstrate the capabilities of PrimSeq in previously unseen stroke patients with a range of upper extremity motor impairment. We expect that our methodological advances will support the rigorous measurement required for quantitative dosing trials in stroke rehabilitation. Stroke commonly damages motor function in the upper extremity (UE), leading to long-term disability and loss of independence in a majority of individuals. Rehabilitation seeks to restore function by training daily activities, which deliver repeated UE functional motions. The optimal number of functional motions necessary to boost recovery is unknown. This gap stems from the lack of measurement tools to feasibly count functional motions. We thus developed the PrimSeq pipeline to enable the accurate and rapid counting of building-block functional motions, called primitives. PrimSeq uses wearable sensors to capture rich motion information from the upper body, and custom-built algorithms to detect and count functional primitives in this motion data. We showed that our deep learning algorithm precisely counts functional primitives performed by stroke patients and outperformed other benchmark algorithms. We also showed patients tolerated the wearable sensors and that the approach is 366 times faster at counting primitives than humans. PrimSeq thus provides a precise and practical means of quantifying functional primitives, which promises to advance stroke research and clinical care and to improve the outcomes of individuals with stroke.
Collapse
|
25
|
Song X, Van De Ven SS, Liu L, Wouda FJ, Wang H, Shull PB. Activities of Daily Living-based Rehabilitation System for Arm and Hand Motor Function Retraining after Stroke. IEEE Trans Neural Syst Rehabil Eng 2022; 30:621-631. [PMID: 35239484 DOI: 10.1109/tnsre.2022.3156387] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Most stroke survivors have difficulties completing activities of daily living (ADLs) independently. However, few rehabilitation systems have focused on ADLs-related training for gross and fine motor function together. We propose an ADLs-based serious game rehabilitation system for the training of motor function and coordination of both arm and hand movement where the user performs corresponding ADLs movements to interact with the target in the serious game. A multi-sensor fusion model based on electromyographic (EMG), force myographic (FMG), and inertial sensing was developed to estimate users' natural upper limb movement. Eight healthy subjects and three stroke patients were recruited in an experiment to validate the system's effectiveness. The performance of different sensor and classifier configurations on hand gesture classification against the arm position variations were analyzed, and qualitative patient questionnaires were conducted. Results showed that elbow extension/flexion has a more significant negative influence on EMG-based, FMG-based, and EMG+FMG-based hand gesture recognition than shoulder abduction/adduction does. In addition, there was no significant difference in the negative influence of shoulder abduction/adduction and shoulder flexion/extension on hand gesture recognition. However, there was a significant interaction between sensor configurations and algorithm configurations in both offline and real-time recognition accuracy. The EMG+FMG-combined multi-position classifier model had the best performance against arm position change. In addition, all the stroke patients reported their ADLs-related ability could be restored by using the system. These results demonstrate that the multi-sensor fusion model could estimate hand gestures and gross movement accurately, and the proposed training system has the potential to improve patients' ability to perform ADLs.
Collapse
|
26
|
Leng J, Wang D, Ma X, Yu P, Wei L, Chen W. Bi-level artificial intelligence model for risk classification of acute respiratory diseases based on Chinese clinical data. APPL INTELL 2022; 52:13114-13131. [PMID: 35221528 PMCID: PMC8861621 DOI: 10.1007/s10489-022-03222-y] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/06/2022] [Indexed: 11/10/2022]
Abstract
Objective: The high incidence of respiratory diseases has dramatically increased the medical burden under the COVID-19 pandemic in the year 2020. It is of considerable significance to utilize a new generation of information technology to improve the artificial intelligence level of respiratory disease diagnosis. Methods: Based on the semi-structured data of Chinese Electronic Medical Records (CEMRs) from the China Hospital Pharmacovigilance System, this paper proposed a bi-level artificial intelligence model for the risk classification of acute respiratory diseases. It includes two levels. The first level is a dedicated design of the “BiLSTM+Dilated Convolution+3D Attention+CRF” deep learning model that is used for Chinese Clinical Named Entity Recognition (CCNER) to extract valuable information from the unstructured data in the CEMRs. Incorporating the transfer learning and semi-supervised learning technique into the proposed deep learning model achieves higher accuracy and efficiency in the CCNER task than the popular “Bert+BiLSTM+CRF” approach. Combining the extracted entity data with other structured data in the CEMRs, the second level is a customized XGBoost to realize the risk classification of acute respiratory diseases. Results: The empirical study shows that the proposed model could provide practical technical support for improving diagnostic accuracy. Conclusion: Our study provides a proof-of-concept for implementing a hybrid artificial intelligence-based system as a tool to aid clinicians in tackling CEMR data and enhancing the diagnostic evaluation under diagnostic uncertainty.
Collapse
|
27
|
Barak Ventura R, Stewart Hughes K, Nov O, Raghavan P, Ruiz Marín M, Porfiri M. Data-Driven Classification of Human Movements in Virtual Reality-Based Serious Games: Preclinical Rehabilitation Study in Citizen Science. JMIR Serious Games 2022; 10:e27597. [PMID: 35142629 PMCID: PMC8874800 DOI: 10.2196/27597] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Revised: 06/14/2021] [Accepted: 10/12/2021] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Sustained engagement is essential for the success of telerehabilitation programs. However, patients' lack of motivation and adherence could undermine these goals. To overcome this challenge, physical exercises have often been gamified. Building on the advantages of serious games, we propose a citizen science-based approach in which patients perform scientific tasks by using interactive interfaces and help advance scientific causes of their choice. This approach capitalizes on human intellect and benevolence while promoting learning. To further enhance engagement, we propose performing citizen science activities in immersive media, such as virtual reality (VR). OBJECTIVE This study aims to present a novel methodology to facilitate the remote identification and classification of human movements for the automatic assessment of motor performance in telerehabilitation. The data-driven approach is presented in the context of a citizen science software dedicated to bimanual training in VR. Specifically, users interact with the interface and make contributions to an environmental citizen science project while moving both arms in concert. METHODS In all, 9 healthy individuals interacted with the citizen science software by using a commercial VR gaming device. The software included a calibration phase to evaluate the users' range of motion along the 3 anatomical planes of motion and to adapt the sensitivity of the software's response to their movements. During calibration, the time series of the users' movements were recorded by the sensors embedded in the device. We performed principal component analysis to identify salient features of movements and then applied a bagged trees ensemble classifier to classify the movements. RESULTS The classification achieved high performance, reaching 99.9% accuracy. Among the movements, elbow flexion was the most accurately classified movement (99.2%), and horizontal shoulder abduction to the right side of the body was the most misclassified movement (98.8%). CONCLUSIONS Coordinated bimanual movements in VR can be classified with high accuracy. Our findings lay the foundation for the development of motion analysis algorithms in VR-mediated telerehabilitation.
Collapse
Affiliation(s)
- Roni Barak Ventura
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering, Brooklyn, NY, United States
| | - Kora Stewart Hughes
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering, Brooklyn, NY, United States
| | - Oded Nov
- Department of Technology Management and Innovation, New York University Tandon School of Engineering, Brooklyn, NY, United States
| | - Preeti Raghavan
- Department of Physical Medicine and Rehabilitation, Johns Hopkins School of Medicine, Baltimore, MD, United States
| | - Manuel Ruiz Marín
- Department of Quantitative Methods, Law and Modern Languages, Technical University of Cartagena, Cartagena, Spain
- Murcia Bio-Health Institute (IMIB-Arrixaca), Health Science Campus, Cartagena, Spain
| | - Maurizio Porfiri
- Department of Mechanical and Aerospace Engineering, New York University Tandon School of Engineering, Brooklyn, NY, United States
- Center for Urban Science and Progress, New York University, Brooklyn, NY, United States
- Department of Biomedical Engineering, New York University Tandon School of Engineering, Brooklyn, NY, United States
| |
Collapse
|
28
|
Wearable sensors and machine learning in post-stroke rehabilitation assessment: A systematic review. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103197] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/14/2023]
|
29
|
González-Alonso J, Oviedo-Pastor D, Aguado HJ, Díaz-Pernas FJ, González-Ortega D, Martínez-Zarzuela M. Custom IMU-Based Wearable System for Robust 2.4 GHz Wireless Human Body Parts Orientation Tracking and 3D Movement Visualization on an Avatar. SENSORS 2021; 21:s21196642. [PMID: 34640961 PMCID: PMC8512038 DOI: 10.3390/s21196642] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Revised: 09/30/2021] [Accepted: 09/30/2021] [Indexed: 02/06/2023]
Abstract
Recent studies confirm the applicability of Inertial Measurement Unit (IMU)-based systems for human motion analysis. Notwithstanding, high-end IMU-based commercial solutions are yet too expensive and complex to democratize their use among a wide range of potential users. Less featured entry-level commercial solutions are being introduced in the market, trying to fill this gap, but still present some limitations that need to be overcome. At the same time, there is a growing number of scientific papers using not commercial, but custom do-it-yourself IMU-based systems in medical and sports applications. Even though these solutions can help to popularize the use of this technology, they have more limited features and the description on how to design and build them from scratch is yet too scarce in the literature. The aim of this work is two-fold: (1) Proving the feasibility of building an affordable custom solution aimed at simultaneous multiple body parts orientation tracking; while providing a detailed bottom-up description of the required hardware, tools, and mathematical operations to estimate and represent 3D movement in real-time. (2) Showing how the introduction of a custom 2.4 GHz communication protocol including a channel hopping strategy can address some of the current communication limitations of entry-level commercial solutions. The proposed system can be used for wireless real-time human body parts orientation tracking with up to 10 custom sensors, at least at 50 Hz. In addition, it provides a more reliable motion data acquisition in Bluetooth and Wi-Fi crowded environments, where the use of entry-level commercial solutions might be unfeasible. This system can be used as a groundwork for developing affordable human motion analysis solutions that do not require an accurate kinematic analysis.
Collapse
Affiliation(s)
- Javier González-Alonso
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
- Correspondence: (J.G.-A.); (M.M.-Z.)
| | - David Oviedo-Pastor
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - Héctor J. Aguado
- Unidad de Traumatología, Hospital Clínico Universitario de Valladolid, 47003 Valladolid, Spain;
| | - Francisco J. Díaz-Pernas
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - David González-Ortega
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
| | - Mario Martínez-Zarzuela
- Grupo de Telemática e Imagen, Universidad de Valladolid, 47011 Valladolid, Spain; (D.O.-P.); (F.J.D.-P.); (D.G.-O.)
- Correspondence: (J.G.-A.); (M.M.-Z.)
| |
Collapse
|
30
|
Dutta D, Aruchamy S, Mandal S, Sen S. Poststroke Grasp Ability Assessment using an Intelligent Data Glove based on Action Research Arm Test: Development, Algorithms, and Experiments. IEEE Trans Biomed Eng 2021; 69:945-954. [PMID: 34495824 DOI: 10.1109/tbme.2021.3110432] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Growing impact of poststroke upper extremity (UE) functional limitations entails newer dimensions in assessment methodologies. This has compelled researchers to think way beyond traditional stroke assessment scales during the out-patient rehabilitation phase. In concurrence with this, sensor-driven quantitative evaluation of poststroke UE functional limitations has become a fertile field of research. Here, we have emphasized an instrumented wearable for systematic monitoring of stroke patients with right-hemiparesis for evaluating their grasp abilities deploying intelligent algorithms. An instrumented glove housing 6 flex sensors, 3 force sensors, and a motion processing unit was developed to administer 19 activities of Action Research Arm Test (ARAT) while experimenting on 20 voluntarily participating subjects. After necessary signal conditioning, meaningful features were extracted, and subsequently the most appropriate ones were selected using the ReliefF algorithm. An optimally tuned support vector classifier was employed to classify patients with different degrees of disability and an accuracy of 92% was achieved supported by a high area under the receiver operating characteristic score. Furthermore, selected features could provide additional information that revealed the causes of grasp limitations. This would assist physicians in planning more effective poststroke rehabilitation strategies. Results of the one-way ANOVA test conducted on actual and predicted ARAT scores of the subjects indicated remarkable prospects of the proposed glove-based method in poststroke grasp ability assessment and rehabilitation.
Collapse
|
31
|
Li Z, Fathima G, Kautish S. Action classification and analysis during sports training session using fuzzy model and video surveillance. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2021. [DOI: 10.3233/jifs-219010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
Activity recognition and classification are emerging fields of research that enable many human-centric applications in the sports domain. One of the most critical and challenged aspects of coaching is improving the performance of athletes. Hence, in this paper, the Adaptive Evolutionary Neuro-Fuzzy Inference System (AENFIS) has been proposed for sports person activity classification based on the biomedical signal, trial accelerator data and video surveillance. This paper obtains movement data and heart rate from the developed sensor module. This small sensor is patched onto the user’s chest to get physiological information. Based on the time and frequency domain features, this paper defines the fuzzy sets and assess the natural grouping of data via expectation-maximization of the probabilities. Sensor data feature selection and classification algorithms are applied, and a majority voting is utilized to choose the most representative features. The experimental results show that the proposed AENFIS model enhances accuracy ratio of 98.9%, prediction ratio of 98.5%, the precision ratio of 95.4, recall ratio of 96.7%, the performance ratio of 97.8%, an efficiency ratio of 98.1% and reduces the error rate of 10.2%, execution time 8.9% compared to other existing models.
Collapse
Affiliation(s)
- Zhao Li
- Chengdu University of TCM, Chengdu, Sichuan, China
| | - G. Fathima
- Professor, CSE Adhiyamaan College of Engineering, India
| | | |
Collapse
|
32
|
Yao CM, Poovendran P, Stewart Kirubakaran S. Internet of things-based energy-efficient optimized heuristic framework to monitor sportsperson's health. Technol Health Care 2021; 29:1291-1304. [PMID: 34092677 DOI: 10.3233/thc-213007] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
BACKGROUND Recently, wearable technologies have gained attention in diverse applications of the medical platform to guarantee the health and safety of the sportsperson with the assistance of the Internet of things (IoT) device. The IoT device's topology varies due to the shift in users' orientation and accessibility, making it impossible to assign resources, and routing strategies have been considered the prominent factor in the current medical research. Further, for sportspersons with sudden cardiac arrests, hospital survival rates are low in which wearable IoT devices play a significant role. OBJECTIVE In this paper, the energy efficient optimized heuristic framework (EEOHF) has been proposed and implemented on a wearable device of the sportsperson's health monitoring system. METHOD The monitoring system has been designed with cloud assistance to locate the nearest health centers during an emergency. The wearable sensor technologies have been used with an optimized energy-efficient algorithm that helps athletes monitor their health during physical workouts. The monitoring system has fitness tracking devices, in which health information is gathered, and workout logs are tracked using EEOHF. The proposed method is applied to evaluate and track the sportsperson's fitness based on case study analysis. RESULTS The simulation results have been analyzed, and the proposed EEOHF achieves a high accuracy ratio of 97.8%, a performance ratio of 95.3%, and less energy consumption of 9.4%, delay of 13.1%, and an average runtime of 98.2% when compared to other existing methods.
Collapse
Affiliation(s)
| | | | - S Stewart Kirubakaran
- Department of Computer Science and Engineering, Saveetha School of Engineering, Simats, India
| |
Collapse
|
33
|
Jiang S, Kang P, Song X, Lo B, Shull P. Emerging Wearable Interfaces and Algorithms for Hand Gesture Recognition: A Survey. IEEE Rev Biomed Eng 2021; 15:85-102. [PMID: 33961564 DOI: 10.1109/rbme.2021.3078190] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Hands are vital in a wide range of fundamental daily activities, and neurological diseases that impede hand function can significantly affect quality of life. Wearable hand gesture interfaces hold promise to restore and assist hand function and to enhance human-human and human-computer communication. The purpose of this review is to synthesize current novel sensing interfaces and algorithms for hand gesture recognition, and the scope of applications covers rehabilitation, prosthesis control, sign language recognition, and human-computer interaction. Results showed that electrical, dynamic, acoustical/vibratory, and optical sensing were the primary input modalities in gesture recognition interfaces. Two categories of algorithms were identified: 1) classification algorithms for predefined, fixed hand poses and 2) regression algorithms for continuous finger and wrist joint angles. Conventional machine learning algorithms, including linear discriminant analysis, support vector machines, random forests, and non-negative matrix factorization, have been widely used for a variety of gesture recognition applications, and deep learning algorithms have more recently been applied to further facilitate the complex relationship between sensor signals and multi-articulated hand postures. Future research should focus on increasing recognition accuracy with larger hand gesture datasets, improving reliability and robustness for daily use outside of the laboratory, and developing softer, less obtrusive interfaces.
Collapse
|
34
|
Song X, Liu X, Peng Y, Xu Z, Liu W, Pang K, Wang J, Zhong L, Yang Q, Meng J. A graphene-coated silk-spandex fabric strain sensor for human movement monitoring and recognition. NANOTECHNOLOGY 2021; 32:215501. [PMID: 33601355 DOI: 10.1088/1361-6528/abe788] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/07/2020] [Accepted: 02/18/2021] [Indexed: 06/12/2023]
Abstract
Flexible and stretchable sensors are emerging and promising wearable devices for motion monitoring. Manufacturing a flexible and stretchable strain sensor with desirable electromechanical performance and excellent skin compatibility plays an essential role in building a smart wearable system. In this paper, a graphene-coated silk-spandex (GCSS) fabric strain sensor is prepared by reducing graphene oxide. The sensor functions as a result of conductive fiber extending and woven structure deforming. The conductive fabric can be stretched towards 60% with high sensitivity, and its performance remains constant after a 1000-cycle test. Based on its superior performance, the GCSS is successfully employed to detect full-range human movement and provide data for deep learning-based gesture recognition. This work offers a desirable method to fabricate low-cost strain sensors for industrial applications such as human movement detection and advanced information science.
Collapse
Affiliation(s)
- Xian Song
- Department of Sports Science, Zhejiang University, Hangzhou 310058, People's Republic of China
| | - Xiaoting Liu
- Department of Polymer Science and Engineering, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Yuxin Peng
- Department of Sports Science, Zhejiang University, Hangzhou 310058, People's Republic of China
| | - Zhen Xu
- Department of Polymer Science and Engineering, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Wenming Liu
- Department of Sports Science, Zhejiang University, Hangzhou 310058, People's Republic of China
| | - Kai Pang
- Department of Polymer Science and Engineering, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Jianxiang Wang
- Department of Sports Science, Zhejiang University, Hangzhou 310058, People's Republic of China
| | - Liang Zhong
- Department of Sports Science, Zhejiang University, Hangzhou 310058, People's Republic of China
| | - Qiang Yang
- College of Electrical Engineering, Zhejiang University, Hangzhou 310027, People's Republic of China
| | - Jun Meng
- College of Electrical Engineering, Zhejiang University, Hangzhou 310027, People's Republic of China
| |
Collapse
|
35
|
Li F, Tao Z, Li R, Qu Z. The early warning research on nursing care of stroke patients with intelligent wearable devices under COVID-19. PERSONAL AND UBIQUITOUS COMPUTING 2021; 27:767-779. [PMID: 33526997 PMCID: PMC7837337 DOI: 10.1007/s00779-021-01520-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2020] [Accepted: 01/06/2021] [Indexed: 05/27/2023]
Abstract
Stroke patients under the background of the new crown epidemic need to be home-based care. However, traditional nursing methods cannot take care of the patients' lives in all aspects. Based on this, based on machine learning algorithms, our work combines regression models and SVM to build a smart wearable device system and builds a system prediction module to predict patient care needs. The node is used to collect human body motion and physiological parameter information and transmit data wirelessly. The software is used to quickly process and analyze the various motion and physiological parameters of the patient and save the analysis and processing structure in the database. By comparing the results of nursing intervention experiments, we can see that the smart wearable device designed in this paper has a certain effect in stroke care.
Collapse
Affiliation(s)
- Fengxia Li
- Huaihe Hospital of Henan University, College of Nursing and Health, Henan University, Kaifeng, 475001 China
| | - Zhimin Tao
- College of Nursing and Health, Henan University, Kaifeng, 475001 China
| | - Ruiling Li
- College of Nursing and Health, Henan University, Kaifeng, 475001 China
| | - Zhi Qu
- College of Nursing and Health, Henan University, Kaifeng, 475001 China
| |
Collapse
|
36
|
Russell B, McDaid A, Toscano W, Hume P. Moving the Lab into the Mountains: A Pilot Study of Human Activity Recognition in Unstructured Environments. SENSORS 2021; 21:s21020654. [PMID: 33477828 PMCID: PMC7832872 DOI: 10.3390/s21020654] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/18/2020] [Revised: 01/13/2021] [Accepted: 01/14/2021] [Indexed: 12/22/2022]
Abstract
Goal: To develop and validate a field-based data collection and assessment method for human activity recognition in the mountains with variations in terrain and fatigue using a single accelerometer and a deep learning model. Methods: The protocol generated an unsupervised labelled dataset of various long-term field-based activities including run, walk, stand, lay and obstacle climb. Activity was voluntary so transitions could not be determined a priori. Terrain variations included slope, crossing rivers, obstacles and surfaces including road, gravel, clay, mud, long grass and rough track. Fatigue levels were modulated between rested to physical exhaustion. The dataset was used to train a deep learning convolutional neural network (CNN) capable of being deployed on battery powered devices. The human activity recognition results were compared to a lab-based dataset with 1,098,204 samples and six features, uniform smooth surfaces, non-fatigued supervised participants and activity labelling defined by the protocol. Results: The trail run dataset had 3,829,759 samples with five features. The repetitive activities and single instance activities required hyper parameter tuning to reach an overall accuracy 0.978 with a minimum class precision for the one-off activity (climbing gate) of 0.802. Conclusion: The experimental results showed that the CNN deep learning model performed well with terrain and fatigue variations compared to the lab equivalents (accuracy 97.8% vs. 97.7% for trail vs. lab). Significance: To the authors knowledge this study demonstrated the first successful human activity recognition (HAR) in a mountain environment. A robust and repeatable protocol was developed to generate a validated trail running dataset when there were no observers present and activity types changed on a voluntary basis across variations in terrain surface and both cognitive and physical fatigue levels.
Collapse
Affiliation(s)
- Brian Russell
- Sports Performance Institute, Auckland University of Technology, Auckland 0632, New Zealand;
- Correspondence:
| | - Andrew McDaid
- Department of Mechanical Engineering, University of Auckland, Auckland 1142, New Zealand;
| | - William Toscano
- National Aeronautics and Space Administration, Ames Research Center, Moffett Field, CA 94043, USA;
| | - Patria Hume
- Sports Performance Institute, Auckland University of Technology, Auckland 0632, New Zealand;
| |
Collapse
|
37
|
Mohammadian Rad N, Marchiori E. Machine learning for healthcare using wearable sensors. Digit Health 2021. [DOI: 10.1016/b978-0-12-818914-6.00007-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022] Open
|
38
|
Automatic Functional Shoulder Task Identification and Sub-task Segmentation Using Wearable Inertial Measurement Units for Frozen Shoulder Assessment. SENSORS 2020; 21:s21010106. [PMID: 33375341 PMCID: PMC7795360 DOI: 10.3390/s21010106] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/03/2020] [Revised: 12/22/2020] [Accepted: 12/22/2020] [Indexed: 11/26/2022]
Abstract
Advanced sensor technologies have been applied to support frozen shoulder assessment. Sensor-based assessment tools provide objective, continuous and quantitative information for evaluation and diagnosis. However, the current tools for assessment of functional shoulder tasks mainly rely on manual operation. It may cause several technical issues to the reliability and usability of the assessment tool, including manual bias during the recording and additional efforts for data labeling. To tackle these issues, this pilot study aims to propose an automatic functional shoulder task identification and sub-task segmentation system using inertial measurement units to provide reliable shoulder task labeling and sub-task information for clinical professionals. The proposed method combines machine learning models and rule-based modification to identify shoulder tasks and segment sub-tasks accurately. A hierarchical design is applied to enhance the efficiency and performance of the proposed approach. Nine healthy subjects and nine frozen shoulder patients are invited to perform five common shoulder tasks in the lab-based and clinical environments, respectively. The experimental results show that the proposed method can achieve 87.11% F-score for shoulder task identification, and 83.23% F-score and 427 mean absolute time errors (milliseconds) for sub-task segmentation. The proposed approach demonstrates the feasibility of the proposed method to support reliable evaluation for clinical assessment.
Collapse
|
39
|
Szczęsna A, Błaszczyszyn M, Kawala-Sterniuk A. Convolutional neural network in upper limb functional motion analysis after stroke. PeerJ 2020; 8:e10124. [PMID: 33083146 PMCID: PMC7549467 DOI: 10.7717/peerj.10124] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Accepted: 09/17/2020] [Indexed: 12/03/2022] Open
Abstract
In this work, implementation of Convolutional Neural Network (CNN) for the purpose of analysis of functional upper limb movement pattern was applied. The main aim of the study was to compare motion of selected activities of daily living of participants after stroke with the healthy ones (in similar age). The optical, marker-based motion capture system was applied for the purpose of data acquisition. There were some attempts made in order to find the existing differences in the motion pattern of the upper limb. For this purpose, the motion features of dominant and non-dominant upper limb of healthy participants were compared with motion features of paresis and non-paresis upper limbs of participants after stroke. On the basis of the newly collected data set, a new CNN application was presented to the classification of motion data in two different class label configurations. Analyzing individual segments of the upper body, it turned out that the arm was the most sensitive segment for capturing changes in the trajectory of the lifting movements of objects.
Collapse
Affiliation(s)
- Agnieszka Szczęsna
- Faculty of Automatic Control, Electronics and Computer Science, Silesian University of Technology, Gliwice, Poland
| | - Monika Błaszczyszyn
- Faculty of Physical Education and Physiotherapy, Opole University of Technology, Opole, Poland
| | - Aleksandra Kawala-Sterniuk
- Faculty of Electrical Engineering, Automatic Control and Informatics, Opole University of Technology, Opole, Poland
| |
Collapse
|
40
|
Gautam A, Panwar M, Wankhede A, Arjunan SP, Naik GR, Acharyya A, Kumar DK. Locomo-Net: A Low -Complex Deep Learning Framework for sEMG-Based Hand Movement Recognition for Prosthetic Control. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2020; 8:2100812. [PMID: 33014638 PMCID: PMC7529116 DOI: 10.1109/jtehm.2020.3023898] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/19/2020] [Revised: 08/18/2020] [Accepted: 08/30/2020] [Indexed: 02/06/2023]
Abstract
Background: The enhancement in the performance of the myoelectric pattern recognition techniques based on deep learning algorithm possess computationally expensive and exhibit extensive memory behavior. Therefore, in this paper we report a deep learning framework named 'Low-Complex Movement recognition-Net' (LoCoMo-Net) built with convolution neural network (CNN) for recognition of wrist and finger flexion movements; grasping and functional movements; and force pattern from single channel surface electromyography (sEMG) recording. The network consists of a two-stage pipeline: 1) input data compression; 2) data-driven weight sharing. Methods: The proposed framework was validated on two different datasets- our own dataset (DS1) and publicly available NinaPro dataset (DS2) for 16 movements and 50 movements respectively. Further, we have prototyped the proposed LoCoMo-Net on Virtex-7 Xilinx field-programmable gate array (FPGA) platform and validated for 15 movements from DS1 to demonstrate its feasibility for real-time execution. Results: The effectiveness of the proposed LoCoMo-Net was verified by a comparative analysis against the benchmarked models using the same datasets wherein our proposed model outperformed Twin- Support Vector Machine (SVM) and existing CNN based model by an average classification accuracy of 8.5 % and 16.0 % respectively. In addition, hardware complexity analysis is done to reveal the advantages of the two-stage pipeline where approximately 27 %, 49 %, 50 %, 23 %, and 43 % savings achieved in lookup tables (LUT's), registers, memory, power consumption and computational time respectively. Conclusion: The clinical significance of such sEMG based accurate and low-complex movement recognition system can be favorable for the potential improvement in quality of life of an amputated persons.
Collapse
Affiliation(s)
- Arvind Gautam
- Indian Institute of Technology HyderabadHyderabad502205India
| | - Madhuri Panwar
- Indian Institute of Technology HyderabadHyderabad502205India
| | | | | | | | - Amit Acharyya
- Indian Institute of Technology HyderabadHyderabad502205India
| | | |
Collapse
|
41
|
Recent Progress in Sensing and Computing Techniques for Human Activity Recognition and Motion Analysis. ELECTRONICS 2020. [DOI: 10.3390/electronics9091357] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
The recent scientific and technical advances in Internet of Things (IoT) based pervasive sensing and computing have created opportunities for the continuous monitoring of human activities for different purposes. The topic of human activity recognition (HAR) and motion analysis, due to its potentiality in human–machine interaction (HMI), medical care, sports analysis, physical rehabilitation, assisted daily living (ADL), children and elderly care, has recently gained increasing attention. The emergence of some novel sensing devices featuring miniature size, a light weight, and wireless data transmission, the availability of wireless communication infrastructure, the progress of machine learning and deep learning algorithms, and the widespread IoT applications has promised new opportunities for a significant progress in this particular field. Motivated by a great demand for HAR-related applications and the lack of a timely report of the recent contributions to knowledge in this area, this investigation aims to provide a comprehensive survey and in-depth analysis of the recent advances in the diverse techniques and methods of human activity recognition and motion analysis. The focus of this investigation falls on the fundamental theories, the innovative applications with their underlying sensing techniques, data fusion and processing, and human activity classification methods. Based on the state-of-the-art, the technical challenges are identified, and future perspectives on the future rich, sensing, intelligent IoT world are given in order to provide a reference for the research and practices in the related fields.
Collapse
|
42
|
Liu SQ, Zhang JC, Zhu R. A Wearable Human Motion Tracking Device Using Micro Flow Sensor Incorporating a Micro Accelerometer. IEEE Trans Biomed Eng 2020; 67:940-948. [DOI: 10.1109/tbme.2019.2924689] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
43
|
Vasanthi SM, Jayasree T. Performance evaluation of pattern recognition networks using electromyography signal and time-domain features for the classification of hand gestures. Proc Inst Mech Eng H 2020; 234:639-648. [PMID: 32202473 DOI: 10.1177/0954411920912119] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The problem of classifying individual finger movements of one hand is focused in this article. The input electromyography signal is processed and eight time-domain features are extracted for classifying hand gestures. The classified finger movements are thumb, middle, index, little, ring, hand close, thumb index, thumb ring, thumb little and thumb middle and the hand grasps are palmar class, spherical class, hook class, cylindrical class, tip class and lateral class. Four state-of-the-art classifiers namely feed forward artificial neural network, cascaded feed forward artificial neural network, deep learning neural network and support vector machine are selected for this work to classify the finger movements and hand grasps using the extracted time-domain features. The experimental results show that the artificial neural network classifier is stabilized at 6 epochs for finger movement dataset and at 4 epochs for hand grasps dataset with low mean square error. However, the support vector machine classifier attains the maximum accuracy of 97.3077% for finger movement dataset and 98.875% for hand grasp dataset which is significantly greater than feed forward artificial neural network, cascaded feed forward artificial neural network and deep learning neural network classifiers.
Collapse
Affiliation(s)
- S Mary Vasanthi
- Department of Electronics and Communication Engineering, St. Xavier's Catholic College of Engineering, Nagercoil, India
| | - T Jayasree
- Department of Electronics and Communication Engineering, Government College of Engineering, Tirunelveli, Tirunelveli, India
| |
Collapse
|
44
|
Gautam A, Panwar M, Biswas D, Acharyya A. MyoNet: A Transfer-Learning-Based LRCN for Lower Limb Movement Recognition and Knee Joint Angle Prediction for Remote Monitoring of Rehabilitation Progress From sEMG. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2020; 8:2100310. [PMID: 32190428 PMCID: PMC7062147 DOI: 10.1109/jtehm.2020.2972523] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/26/2019] [Revised: 12/29/2019] [Accepted: 01/09/2020] [Indexed: 12/02/2022]
Abstract
The clinical assessment technology such as remote monitoring of rehabilitation progress for lower limb related ailments rely on the automatic evaluation of movement performed along with an estimation of joint angle information. In this paper, we introduce a transfer-learning based Long-term Recurrent Convolution Network (LRCN) named as 'MyoNet' for the classification of lower limb movements, along with the prediction of the corresponding knee joint angle. The model consists of three blocks- (i) feature extractor block, (ii) joint angle prediction block, and (iii) movement classification block. Initially, the model is end-to-end trained for knee joint angle prediction followed by transferring the knowledge of a trained model to the movement classification through transfer-learning approach making a memory and computationally efficient design. The proposed MyoNet was evaluated on publicly available University of California (UC) Irvine machine learning repository dataset of the lower limb for 11 healthy subjects and 11 subjects with knee pathology for three movements type-walking, standing with knee flexion movements and sitting with knee extension movements. The average mean absolute error (MAE) resulted in the prediction of joint angle for healthy subjects and subjects with knee pathology are 8.1 % and 9.2 % respectively. Subsequently, an average classification accuracy of 98.1 % and 92.4 % were achieved for healthy subjects and subjects with knee pathology, respectively. Interestingly, the significance of this study in itself is promising with substantial improvement in the performance compared to state-of-the-art methodologies. The clinical significance of such surface electromyography signals (sEMG) based movement recognition and prediction of corresponding joint angle system could be beneficial for remote monitoring of rehabilitation progress by the physiotherapist using wearables.
Collapse
Affiliation(s)
- Arvind Gautam
- Department of Electrical EngineeringIndian Institute of Technology HyderabadHyderabad502205India
| | - Madhuri Panwar
- Department of Electrical EngineeringIndian Institute of Technology HyderabadHyderabad502205India
| | | | - Amit Acharyya
- Department of Electrical EngineeringIndian Institute of Technology HyderabadHyderabad502205India
| |
Collapse
|
45
|
Cai S, Li G, Su E, Wei X, Huang S, Ma K, Zheng H, Xie L. Real-Time Detection of Compensatory Patterns in Patients With Stroke to Reduce Compensation During Robotic Rehabilitation Therapy. IEEE J Biomed Health Inform 2020; 24:2630-2638. [PMID: 31902785 DOI: 10.1109/jbhi.2019.2963365] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
OBJECTIVES Compensations are commonly employed by patients with stroke during rehabilitation without therapist supervision, leading to suboptimal recovery outcomes. This study investigated the feasibility of the real-time monitoring of compensation in patients with stroke by using pressure distribution data and machine learning algorithms. Whether trunk compensation can be reduced by combining the online detection of compensation and haptic feedback of a rehabilitation robot was also investigated. METHODS Six patients with stroke did three forms of reaching movements while pressure distribution data were recorded as Dataset1. A support vector machine (SVM) classifier was trained with features extracted from Dataset1. Then, two other patients with stroke performed reaching tasks, and the SVM classifier trained by Dataset1 was employed to classify the compensatory patterns online. Based on the real-time monitoring of compensation, a rehabilitation robot provided an assistive force to patients with stroke to reduce compensations. RESULTS Good classification performance (F1 score > 0.95) was obtained in both offline and online compensation analysis using the SVM classifier and pressure distribution data of patients with stroke. Based on the real-time detection of compensatory patterns, the angles of trunk rotation, trunk lean-forward and trunk-scapula elevation decreased by 46.95%, 32.35% and 23.75%, respectively. CONCLUSION High classification accuracies verified the feasibility of detecting compensation in patients with stroke based on pressure distribution data. Since the validity and reliability of the online detection of compensation has been verified, this classifier can be incorporated into a rehabilitation robot to reduce trunk compensations in patients with stroke.
Collapse
|