1
|
Cheng X, Jiao Y, Meiring RM, Sheng B, Zhang Y. Reliability and validity of current computer vision based motion capture systems in gait analysis: A systematic review. Gait Posture 2025; 120:150-160. [PMID: 40250127 DOI: 10.1016/j.gaitpost.2025.04.016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/04/2024] [Revised: 03/06/2025] [Accepted: 04/15/2025] [Indexed: 04/20/2025]
Abstract
BACKGROUND Traditional instrumented gait analysis (IGA) objectively quantifies gait deviations, but its clinical use is hindered by high cost, lab environment, and complex protocols. Pose estimation algorithm (PEA)-based gait analysis, which infers joint positions from videos, offers an accessible method to detect gait abnormalities and tailor rehabilitation strategies. However, its reliability and validity in gait analysis and algorithmic factors affecting accuracy have not been reviewed. RESEARCH QUESTION This systematic review aims to evaluate the accuracy of PEA-based gait analysis systems and to identify the algorithmic factors impacting their accuracy. METHOD A total of 644 articles were initially identified through Scopus, PubMed, and IEEE, with 20 meeting the inclusion and exclusion criteria. Reliability, validity, and algorithmic parameters were extracted for detailed review. RESULTS AND SIGNIFICANCE Most included articles focus on validity against the gold standard, while limited evidence makes it challenging to determine reliability. OpenCap demonstrated an MAE of 4.1° for 3D joint angles, but higher errors in rotational angles require further validation. OpenPose demonstrated ICCs of 0.89-0.994 for spatiotemporal parameters and MAE < 5.2° for 2D hip and knee joint angles in the sagittal plane (ICCs = 0.67-0.92, CCCs = 0.83-0.979), but ankle kinematics exhibited poor accuracy (ICCs = 0.37-0.57, MAEs = 3.1°-9.77°, CCCs = 0.51-0.936). PEA accuracy depends on camera settings, backbone architecture, and training datasets. This study reviews the accuracy of PEA-based gait analysis systems, supporting future research in gait-related clinical applications of PEA.
Collapse
Affiliation(s)
- Xingye Cheng
- Department of Exercise Sciences, Faculty of Science, University of Auckland, Auckland 1023, New Zealand
| | - Yiran Jiao
- Department of Exercise Sciences, Faculty of Science, University of Auckland, Auckland 1023, New Zealand
| | - Rebecca M Meiring
- Department of Exercise Sciences, Faculty of Science, University of Auckland, Auckland 1023, New Zealand; School of Physiology, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg 2050, South Africa
| | - Bo Sheng
- School of Mechatronic Engineering and Automation, Shanghai University, Shanghai 200444, China
| | - Yanxin Zhang
- Department of Exercise Sciences, Faculty of Science, University of Auckland, Auckland 1023, New Zealand.
| |
Collapse
|
2
|
Molteni LE, Andreoni G. Comparing the Accuracy of Markerless Motion Analysis and Optoelectronic System for Measuring Gait Kinematics of Lower Limb. Bioengineering (Basel) 2025; 12:424. [PMID: 40281784 PMCID: PMC12025091 DOI: 10.3390/bioengineering12040424] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2025] [Revised: 03/28/2025] [Accepted: 04/11/2025] [Indexed: 04/29/2025] Open
Abstract
(1) Background: Marker-based optical motion tracking is the gold standard in gait analysis; however, markerless solutions are rapidly emerging today. Algorithms like Openpose can track human movement from a video. Few studies have assessed the validity of this method. This study aimed to assess the reliability of Openpose in measuring the kinematics and spatiotemporal gait parameters. (2) Methods: This analysis used simultaneously recorded video and optoelectronic motion capture data. We assessed 20 subjects with different gait impairments (healthy, right hemiplegia, left hemiplegia, paraparesis). The two methods were compared using computing absolute errors (AEs), intraclass correlation coefficients (ICCs), and cross-correlation coefficients (CCs) for normalized gait cycle joint angles. (3) Results: The spatiotemporal parameters showed an ICC between good to excellent, and the absolute error was very small: cadence AE = 1.63 step/min, Mean Velocity AE = 0.16 m/s. The Range of Motion (ROM) showed a good to excellent agreement in the sagittal plane. Furthermore, the normalized gait cycle CCC values indicated moderate to strong coupling in the sagittal plane. (4) Conclusions: We found Openpose to be accurate for sagittal plane gait kinematics and for spatiotemporal gait parameters in the healthy and pathological subjects assessed.
Collapse
Affiliation(s)
| | - Giuseppe Andreoni
- Scientific Institute IRCCS “E. Medea”, Bosisio Parini, 23842 Lecco, Italy
- Department of Design, Politecnico di Milano, 20133 Milano, Italy
| |
Collapse
|
3
|
Sun T, Chen Z, Guo Q, Yan Y. Optimization of Exoskeleton Trajectory Toward Minimizing Human Joint Torques. IEEE Trans Neural Syst Rehabil Eng 2025; 33:1231-1241. [PMID: 40126955 DOI: 10.1109/tnsre.2025.3553861] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/26/2025]
Abstract
The reference trajectory, serving as the sole kinematic guidance, is crucial for exoskeleton robot systems. This study introduces a method for generating an optimal trajectory for lower-limb exoskeletons, aiming at reducing human power during walking. Initially, the human joint angles were computed from measured data by a neighborhood field optimization (NFO). Subsequently, inverse dynamic analysis including seven-link dynamic model of human-exoskeleton coupling and corresponding ground reaction forces optimization were constructed, which was surrogated by a back propagation neural network (BPNN) to accelerate successive analyses. The exoskeleton trajectory, generated by perturbing human movement described by Fourier series, was optimized using a NFO algorithm with a revised initial generation strategy and boundary update function to minimize human joint torques. This approach was found to provide more accurate predictions of human trajectory and ground reaction forces compared to traditional methods, achieving a root mean square error (RMSE) within 5 mm and 3 kN respectively, making it suitable for computational applications. The generated trajectory preserves individual walking patterns and anticipates human motion with a mean leading value of 4.6%, effectively reducing joint torque across various gait phases. This research contributes significantly to the analysis of human-exoskeleton interactions and offers valuable insights for designing energy-efficient exoskeletons.
Collapse
|
4
|
Chapman RM, Taylor KB, Kaczynski E, Khodabakhsh S, Richards S, Hutchinson JB, Marchand RC. Accuracy amidst errors: Evaluating a commercially available wearable sensor system and its associated calibration procedures for monitoring sagittal knee motion in patients undergoing total knee arthroplasty. Knee 2025; 54:316-328. [PMID: 40174415 DOI: 10.1016/j.knee.2025.03.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/23/2024] [Revised: 02/18/2025] [Accepted: 03/10/2025] [Indexed: 04/04/2025]
Abstract
BACKGROUND Commercially available wearable sensors monitoring knee range of motion (ROM) are gaining traction in orthopaedics, but few studies validate against optical motion capture (MOCAP) in total knee arthroplasty (TKA) patients. Furthermore, wearable calibration is essential for accurate measurements, yet few investigations evaluate calibration and ROM accuracy. This study assessed one commercial wearable sensor system's calibration (goniometric versus MOCAP) and sagittal knee angle computation accuracy in TKA patients during activities. METHODS Twenty TKA patients were recruited (5 lost to follow-up). Following a sensor tutorial (MotionSense, Stryker, Mahwah, NJ), participants self-applied sensors for pre-TKA data capture. TKA was then performed by one surgeon followed by identical post-TKA data captures. MOCAP and wearable sensor data were collected during activities. MOCAP sagittal knee angles (θMOCAP) were compared to two wearable sensor knee angles: 1) θCalGoni = goniometric calibration, 2) θCalMOCAP = MOCAP calibration. Two-way ANOVAs evaluated the impact of time (pre-TKA vs. post-TKA) and calibration type (goniometry vs. MOCAP) on calibration angles and wearable sensor error. Variance equality tests compared pre-TKA vs. post-TKA and goniometric vs. MOCAP calibration. RESULTS No significant differences were noted pre-TKA vs. post-TKA. Calibration angles differed significantly with goniometry yielding significantly more error than MOCAP. MOCAP calibration reduced error below clinically acceptable levels (<5°) during activities and with significantly less error variance. CONCLUSION MOCAP calibration significant improved accuracy of knee angle computations to acceptable levels (<5°). Accordingly, these wearables are suitable for continuous knee ROM monitoring after calibrating with correct angles, Future studies should investigate specific activities and sensor misplacement on angle measurements.
Collapse
Affiliation(s)
- Ryan M Chapman
- University of Rhode Island, Department of Kinesiology, 25 West Independence Way, Kingston, RI 02881, USA; University of Rhode Island, Department of Electrical, Computer, and Biomedical Engineering, 4 East Alumni Avenue, Kingston, RI 02881, USA.
| | - Kelly B Taylor
- Ortho Rhode Island, 70 Kenyon Avenue, Wakefield, RI 02879, USA
| | - Emily Kaczynski
- Ortho Rhode Island, 70 Kenyon Avenue, Wakefield, RI 02879, USA
| | - Shayan Khodabakhsh
- University of Rhode Island, Department of Kinesiology, 25 West Independence Way, Kingston, RI 02881, USA
| | - Skye Richards
- University of Rhode Island, Department of Kinesiology, 25 West Independence Way, Kingston, RI 02881, USA
| | - Jayson B Hutchinson
- University of Rhode Island, Department of Kinesiology, 25 West Independence Way, Kingston, RI 02881, USA
| | | |
Collapse
|
5
|
He Y, Jan YH, Yang F, Ma Y, Pei C. A novel method for assessing cycling movement status: an exploratory study integrating deep learning and signal processing technologies. BMC Med Inform Decis Mak 2025; 25:71. [PMID: 39934805 DOI: 10.1186/s12911-024-02828-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2024] [Accepted: 12/16/2024] [Indexed: 02/13/2025] Open
Abstract
This study proposes a deep learning-based motion assessment method that integrates the pose estimation algorithm (Keypoint RCNN) with signal processing techniques, demonstrating its reliability and effectiveness.The reliability and validity of this method were also verified.Twenty college students were recruited to pedal a stationary bike. Inertial sensors and a smartphone simultaneously recorded the participants' cycling movement. Keypoint RCNN(KR) algorithm was used to acquire 2D coordinates of the participants' skeletal keypoints from the recorded movement video. Spearman's rank correlation analysis, intraclass correlation coefficient (ICC), error analysis, and t-test were conducted to compare the consistency of data obtained from the two movement capture systems, including the peak frequency of acceleration, transition time point between movement statuses, and the complexity index average (CIA) of the movement status based on multiscale entropy analysis.The KR algorithm showed excellent consistency (ICC1,3=0.988) between the two methods when estimating the peak acceleration frequency. Both peak acceleration frequencies and CIA metrics estimated by the two methods displayed a strong correlation (r > 0.70) and good agreement (ICC2,1>0.750). Additionally, error values were relatively low (MAE = 0.001 and 0.040, MRE = 0.00% and 7.67%). Results of t-tests showed significant differences (p = 0.003 and 0.030) for various acceleration CIAs, indicating our method could distinguish different movement statuses.The KR algorithm also demonstrated excellent intra-session reliability (ICC = 0.988). Acceleration frequency analysis metrics derived from the KR method can accurately identify transitions among movement statuses. Leveraging the KR algorithm and signal processing techniques, the proposed method is designed for individualized motor function evaluation in home or community-based settings.
Collapse
Affiliation(s)
- Yingchun He
- Department of Rehabilitation Medicine, School of Health, Fujian Medical University, Fuzhou, 350122, China
- Department of Rehabilitation Medicine, Heyuan People's Hospital, Heyuan, 517001, China
| | - Yi-Haw Jan
- Department of Transportation Engineering, Xiamen City University, Xiamen, 361008, China
- Digital Twin Intelligent Transportation Maintenance Engineering Research Center of Xiamen City University, Xiamen, China
| | - Fan Yang
- Department of Rehabilitation Medicine, School of Health, Fujian Medical University, Fuzhou, 350122, China
- Rehabilitation Engineering, Fujian University Engineering Research Center, Fuzhou, 350122, China
| | - Yunru Ma
- Department of Rehabilitation Medicine, School of Health, Fujian Medical University, Fuzhou, 350122, China
| | - Chun Pei
- Department of Rehabilitation Medicine, School of Health, Fujian Medical University, Fuzhou, 350122, China.
- Rehabilitation Engineering, Fujian University Engineering Research Center, Fuzhou, 350122, China.
| |
Collapse
|
6
|
Baldinger M, Reimer LM, Senner V. Influence of the Camera Viewing Angle on OpenPose Validity in Motion Analysis. SENSORS (BASEL, SWITZERLAND) 2025; 25:799. [PMID: 39943438 PMCID: PMC11819822 DOI: 10.3390/s25030799] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/21/2024] [Revised: 01/22/2025] [Accepted: 01/27/2025] [Indexed: 02/16/2025]
Abstract
(1) Background: With human pose estimation on the rise in the field of biomechanics, the need for scientific investigation of those algorithms is becoming evident. The validity of several of those algorithms has been presented in the literature. However, there is only limited research investigating the applicability of human pose estimation outside the lab. The aim of this research was to quantify the effect of deviating from the standard camera setup used in biomechanics research. (2) Methods: Video data from four camera viewing angles were recorded and keypoints estimated using OpenPose. Kinematic data were compared against a gold-standard marker-based motion capture system to quantify the effect of the camera viewing angle on the validity of joint angle estimation of the knee, hip, elbow and shoulder joints. (3) Results: The results of this study showed reasonable correlations between the joint angles of OpenPose and the gold standard, except for the shoulder. However, the analysis also revealed significant biases when comparing the joint angles inferred from the different viewing angles. In general, back-viewing cameras performed best and resulted in the lowest percental deviations. (4) Conclusions: The findings of this study underscore the importance of conducting a detailed examination of individual movements before proposing specific camera angles for users in diverse settings.
Collapse
Affiliation(s)
- Melanie Baldinger
- School of Engineering and Design, Technical University of Munich, 85748 Garching b. Munich, Germany
| | - Lara Marie Reimer
- Institute for Digital Medicine, University Hospital Bonn, 53127 Bonn, Germany;
| | - Veit Senner
- School of Engineering and Design, Technical University of Munich, 85748 Garching b. Munich, Germany
| |
Collapse
|
7
|
Henry R, Cordillet S, Rauscent H, Bonan I, Huaulmé A, Marleix S, Jannin P, Casy T, Violas P. Comparison of the OpenPose system and the reference optoelectronic system for gait analysis of lower-limb angular parameters in children. Orthop Traumatol Surg Res 2024:104044. [PMID: 39522602 DOI: 10.1016/j.otsr.2024.104044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/29/2024] [Revised: 10/22/2024] [Accepted: 11/07/2024] [Indexed: 11/16/2024]
Abstract
INTRODUCTION Quantitative Gait Analysis (QGA) is the gold-standard for detailed study of lower-limb movement, angles and forces, especially in pediatrics, providing a decision aid for treatment and for assessment of results. However, widespread use of QGA is hindered by the need for specific equipment and trained personnel and high costs. Recently, the OpenPose system used algorithms for 2D video movement analysis, to determine joint points and angles without any supplementary equipment or great expertise. The present study therefore aimed to validate application of OpenPose for gait analysis in children with locomotor pathology, thereby circumventing the limitations of QGA. HYPOTHESIS The OpenPose system is as precise as QGA for measuring lower-limb angles in gait in children. MATERIALS AND METHODS Gait analysis was studied prospectively, between January and July 2023, in 20 children: 13 boys, 7 girls; mean age, 13 years. There was no selection for pathology or use of walking aids. QGA was performed, measuring joint angles in the hips, knees and ankles. The same measurements were then made using the points obtained on OpenPose. The Mann-Whitney test was used to compare the two methods. RESULTS There were only slight differences in angle measurements (in degrees) for the knees: right, 0.54 [-0.61; 1.71], p = 0.361; left, -1.09 [-2.16; 0.01], p = 0.051. Differences were greater for the hips (right, 9.32 [8.28; 10.35]; left, 7.54 [6.55; 8.54], p < 0.01) and ankles (right, -6.67 [-7.22; -6.12]; left, -7.07 [-7.60; -6.54], p < 0.01). DISCUSSION OpenPose provided angle values close to those of QGA for the knees in the sagittal plane, independently of pathology and walking aid. In the hips and ankles, on the other hand, differences were too great to allow clinical application of OpenPose. LEVEL OF EVIDENCE IV.
Collapse
Affiliation(s)
- Roxane Henry
- Service de chirurgie pédiatrique, CHU Rennes, hôpital Sud, 16 Boulevard de Bulgarie, 35200 Rennes, France; Laboratoire du traitement du signal et de l'image - UMR 1099, Inserm, Université de Rennes, Campus Beaulieu, Bâtiment 22, 263 Avenue du Général Leclerc, 35000 Rennes, France
| | - Sébastien Cordillet
- Unité clinique d'analyse du mouvement, service de médecine physique et réadaptation, CHU Rennes- Pontchaillou, 2 Rue Henri Le Guilloux, 35000 Rennes, France
| | - Hélène Rauscent
- Unité clinique d'analyse du mouvement, service de médecine physique et réadaptation, CHU Rennes- Pontchaillou, 2 Rue Henri Le Guilloux, 35000 Rennes, France
| | - Isabelle Bonan
- Unité clinique d'analyse du mouvement, service de médecine physique et réadaptation, CHU Rennes- Pontchaillou, 2 Rue Henri Le Guilloux, 35000 Rennes, France
| | - Arnaud Huaulmé
- Laboratoire du traitement du signal et de l'image - UMR 1099, Inserm, Université de Rennes, Campus Beaulieu, Bâtiment 22, 263 Avenue du Général Leclerc, 35000 Rennes, France
| | - Sylvette Marleix
- Service de chirurgie pédiatrique, CHU Rennes, hôpital Sud, 16 Boulevard de Bulgarie, 35200 Rennes, France
| | - Pierre Jannin
- Laboratoire du traitement du signal et de l'image - UMR 1099, Inserm, Université de Rennes, Campus Beaulieu, Bâtiment 22, 263 Avenue du Général Leclerc, 35000 Rennes, France
| | - Tiphaine Casy
- Laboratoire du traitement du signal et de l'image - UMR 1099, Inserm, Université de Rennes, Campus Beaulieu, Bâtiment 22, 263 Avenue du Général Leclerc, 35000 Rennes, France
| | - Philippe Violas
- Service de chirurgie pédiatrique, CHU Rennes, hôpital Sud, 16 Boulevard de Bulgarie, 35200 Rennes, France.
| |
Collapse
|
8
|
Asaeda M, Onishi T, Ito H, Miyahara S, Mikami Y. Reliability and validity of knee valgus angle calculation at single-leg drop landing by posture estimation using machine learning. Heliyon 2024; 10:e36338. [PMID: 39281584 PMCID: PMC11399566 DOI: 10.1016/j.heliyon.2024.e36338] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Revised: 06/29/2024] [Accepted: 08/13/2024] [Indexed: 09/18/2024] Open
Abstract
Background The consensus on anterior cruciate ligament (ACL) injury prevention involves the suppression of dynamic knee valgus (DKV). The gold standard for evaluating the DKV includes three-dimensional motion analysis systems; however, these are expensive and cannot be used to evaluate all athletes. Markerless motion-capture systems and joint angle calculations using posture estimation have been reported. However, there have been no reports on the reliability and validity of DKV calculations using posture estimation. Research question This study aimed to clarify the reliability and validity of DKV calculation using posture estimation. Methods Fifteen participants performed 10 single-leg jump landings from a height of 20 cm, and the knee joint angle was calculated using joint points measured using machine learning (MediaPipe Pose) and motion-capture systems (VICON MX). Two types of angle calculation methods were used: absolute value and change from the initial ground contact (IC). Intra- and inter-rater reliabilities were examined using intraclass correlation coefficients, and concurrent validity was examined using Pearson's correlation coefficients. To examine intra-examiner reliability, we performed single-leg jump landings at intervals of ≥3 days. Results The calculation by MediaPipe Pose was significantly higher than that by the 3-D motion analysis systems (p < 0.05, error range 18.83-19.68°), and there was no main effect of knee valgus angle or time on the excursion angle from IC (p > 0.05). No significant concurrent validity was found in the absolute value, which was significantly correlated with the change in IC. Although the inter-rater reliability of the absolute value was low, the change in IC showed good reliability and concurrent validity. Significance The results of this research suggest that the DKV calculation by pose estimation using machine learning is practical, with normalization by the angle at IC.
Collapse
Affiliation(s)
- Makoto Asaeda
- Faculty of Wakayama Health Care Sciences, Takarazuka University of Medical and Health, 2252 Nakanoshima, Wakayama, 640-8392, Japan
- Division of Rehabilitation, Department of Clinical Practice and Support, Hiroshima University Hospital, 1-2-3, Kasumi, Minami-ku, Hiroshima, 734-8551, Japan
| | - Tomoya Onishi
- Faculty of Wakayama Health Care Sciences, Takarazuka University of Medical and Health, 2252 Nakanoshima, Wakayama, 640-8392, Japan
| | - Hideyuki Ito
- Faculty of Wakayama Health Care Sciences, Takarazuka University of Medical and Health, 2252 Nakanoshima, Wakayama, 640-8392, Japan
| | - So Miyahara
- Faculty of Wakayama Health Care Sciences, Takarazuka University of Medical and Health, 2252 Nakanoshima, Wakayama, 640-8392, Japan
| | - Yukio Mikami
- Department of Rehabilitation Medicine, Hiroshima University Hospital, 1-2-3 Kasumi, Hiroshima, 734-8551, Japan
| |
Collapse
|
9
|
Ino T, Samukawa M, Ishida T, Wada N, Koshino Y, Kasahara S, Tohyama H. Validity and Reliability of OpenPose-Based Motion Analysis in Measuring Knee Valgus during Drop Vertical Jump Test. J Sports Sci Med 2024; 23:515-525. [PMID: 39228769 PMCID: PMC11366844 DOI: 10.52082/jssm.2024.515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 06/14/2024] [Indexed: 09/05/2024]
Abstract
OpenPose-based motion analysis (OpenPose-MA), utilizing deep learning methods, has emerged as a compelling technique for estimating human motion. It addresses the drawbacks associated with conventional three-dimensional motion analysis (3D-MA) and human visual detection-based motion analysis (Human-MA), including costly equipment, time-consuming analysis, and restricted experimental settings. This study aims to assess the precision of OpenPose-MA in comparison to Human-MA, using 3D-MA as the reference standard. The study involved a cohort of 21 young and healthy adults. OpenPose-MA employed the OpenPose algorithm, a deep learning-based open-source two-dimensional (2D) pose estimation method. Human-MA was conducted by a skilled physiotherapist. The knee valgus angle during a drop vertical jump task was computed by OpenPose-MA and Human-MA using the same frontal-plane video image, with 3D-MA serving as the reference standard. Various metrics were utilized to assess the reproducibility, accuracy and similarity of the knee valgus angle between the different methods, including the intraclass correlation coefficient (ICC) (1, 3), mean absolute error (MAE), coefficient of multiple correlation (CMC) for waveform pattern similarity, and Pearson's correlation coefficients (OpenPose-MA vs. 3D-MA, Human-MA vs. 3D-MA). Unpaired t-tests were conducted to compare MAEs and CMCs between OpenPose-MA and Human-MA. The ICCs (1,3) for OpenPose-MA, Human-MA, and 3D-MA demonstrated excellent reproducibility in the DVJ trial. No significant difference between OpenPose-MA and Human-MA was observed in terms of the MAEs (OpenPose: 2.4° [95%CI: 1.9-3.0°], Human: 3.2° [95%CI: 2.1-4.4°]) or CMCs (OpenPose: 0.83 [range: 0.99-0.53], Human: 0.87 [range: 0.24-0.98]) of knee valgus angles. The Pearson's correlation coefficients of OpenPose-MA and Human-MA relative to that of 3D-MA were 0.97 and 0.98, respectively. This study demonstrated that OpenPose-MA achieved satisfactory reproducibility, accuracy and exhibited waveform similarity comparable to 3D-MA, similar to Human-MA. Both OpenPose-MA and Human-MA showed a strong correlation with 3D-MA in terms of knee valgus angle excursion.
Collapse
Affiliation(s)
- Takumi Ino
- Graduate School of Health Sciences, Hokkaido University, Sapporo, Japan
- Department of Physical Therapy, Faculty of Health Sciences, Hokkaido University of Science, Sapporo, Japan
| | - Mina Samukawa
- Faculty of Health Sciences, Hokkaido University, Sapporo, Japan
| | - Tomoya Ishida
- Faculty of Health Sciences, Hokkaido University, Sapporo, Japan
| | - Naofumi Wada
- Department of Information and Computer Science, Faculty of Engineering, Hokkaido University of Science, Sapporo, Japan
| | - Yuta Koshino
- Faculty of Health Sciences, Hokkaido University, Sapporo, Japan
| | | | | |
Collapse
|
10
|
Milone D, Longo F, Merlino G, De Marchis C, Risitano G, D’Agati L. MocapMe: DeepLabCut-Enhanced Neural Network for Enhanced Markerless Stability in Sit-to-Stand Motion Capture. SENSORS (BASEL, SWITZERLAND) 2024; 24:3022. [PMID: 38793876 PMCID: PMC11125421 DOI: 10.3390/s24103022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2024] [Revised: 04/26/2024] [Accepted: 05/06/2024] [Indexed: 05/26/2024]
Abstract
This study examined the efficacy of an optimized DeepLabCut (DLC) model in motion capture, with a particular focus on the sit-to-stand (STS) movement, which is crucial for assessing the functional capacity in elderly and postoperative patients. This research uniquely compared the performance of this optimized DLC model, which was trained using 'filtered' estimates from the widely used OpenPose (OP) model, thereby emphasizing computational effectiveness, motion-tracking precision, and enhanced stability in data capture. Utilizing a combination of smartphone-captured videos and specifically curated datasets, our methodological approach included data preparation, keypoint annotation, and extensive model training, with an emphasis on the flow of the optimized model. The findings demonstrate the superiority of the optimized DLC model in various aspects. It exhibited not only higher computational efficiency, with reduced processing times, but also greater precision and consistency in motion tracking thanks to the stability brought about by the meticulous selection of the OP data. This precision is vital for developing accurate biomechanical models for clinical interventions. Moreover, this study revealed that the optimized DLC maintained higher average confidence levels across datasets, indicating more reliable and accurate detection capabilities compared with standalone OP. The clinical relevance of these findings is profound. The optimized DLC model's efficiency and enhanced point estimation stability make it an invaluable tool in rehabilitation monitoring and patient assessments, potentially streamlining clinical workflows. This study suggests future research directions, including integrating the optimized DLC model with virtual reality environments for enhanced patient engagement and leveraging its improved data quality for predictive analytics in healthcare. Overall, the optimized DLC model emerged as a transformative tool for biomechanical analysis and physical rehabilitation, promising to enhance the quality of patient care and healthcare delivery efficiency.
Collapse
Affiliation(s)
- Dario Milone
- Department of Engineering (DI), University of Messina, Contrada di Dio, 98166 Messina, Italy; (F.L.); (G.M.); (C.D.M.); (G.R.); (L.D.)
| | | | | | | | | | | |
Collapse
|
11
|
Ishida T, Ino T, Yamakawa Y, Wada N, Koshino Y, Samukawa M, Kasahara S, Tohyama H. Estimation of Vertical Ground Reaction Force during Single-leg Landing Using Two-dimensional Video Images and Pose Estimation Artificial Intelligence. Phys Ther Res 2024; 27:35-41. [PMID: 38690532 PMCID: PMC11057390 DOI: 10.1298/ptr.e10276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 01/09/2024] [Indexed: 05/02/2024]
Abstract
OBJECTIVE Assessment of the vertical ground reaction force (VGRF) during landing tasks is crucial for physical therapy in sports. The purpose of this study was to determine whether the VGRF during a single-leg landing can be estimated from a two-dimensional (2D) video image and pose estimation artificial intelligence (AI). METHODS Eighteen healthy male participants (age: 23.0 ± 1.6 years) performed a single-leg landing task from a 30-cm height. The VGRF was measured using a force plate and estimated using center of mass (COM) position data from a 2D video image with pose estimation AI (2D-AI) and three-dimensional optical motion capture (3D-Mocap). The measured and estimated peak VGRFs were compared using a paired t-test and Pearson's correlation coefficient. The absolute errors of the peak VGRF were also compared between the two estimations. RESULTS No significant difference in the peak VGRF was found between the force plate measured VGRF and the 2D-AI or 3D-Mocap estimated VGRF (force plate: 3.37 ± 0.42 body weight [BW], 2D-AI: 3.32 ± 0.42 BW, 3D-Mocap: 3.50 ± 0.42 BW). There was no significant difference in the absolute error of the peak VGRF between the 2D-AI and 3D-Mocap estimations (2D-AI: 0.20 ± 0.16 BW, 3D-Mocap: 0.13 ± 0.09 BW, P = 0.163). The measured peak VGRF was significantly correlated with the estimated peak by 2D-AI (R = 0.835, P <0.001). CONCLUSION The results of this study indicate that peak VGRF estimation using 2D video images and pose estimation AI is useful for the clinical assessment of single-leg landing.
Collapse
Affiliation(s)
- Tomoya Ishida
- Faculty of Health Sciences, Hokkaido University, Japan
| | - Takumi Ino
- Faculty of Health Sciences, Hokkaido University of Science, Japan
| | | | - Naofumi Wada
- Faculty of Engineering, Hokkaido University of Science, Japan
| | - Yuta Koshino
- Faculty of Health Sciences, Hokkaido University, Japan
| | - Mina Samukawa
- Faculty of Health Sciences, Hokkaido University, Japan
| | | | | |
Collapse
|
12
|
Yang J, Park K. Improving Gait Analysis Techniques with Markerless Pose Estimation Based on Smartphone Location. Bioengineering (Basel) 2024; 11:141. [PMID: 38391625 PMCID: PMC10886083 DOI: 10.3390/bioengineering11020141] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2024] [Revised: 01/25/2024] [Accepted: 01/29/2024] [Indexed: 02/24/2024] Open
Abstract
Marker-based 3D motion capture systems, widely used for gait analysis, are accurate but have disadvantages such as cost and accessibility. Whereas markerless pose estimation has emerged as a convenient and cost-effective alternative for gait analysis, challenges remain in achieving optimal accuracy. Given the limited research on the effects of camera location and orientation on data collection accuracy, this study investigates how camera placement affects gait assessment accuracy utilizing five smartphones. This study aimed to explore the differences in data collection accuracy between marker-based systems and pose estimation, as well as to assess the impact of camera location and orientation on accuracy in pose estimation. The results showed that the differences in joint angles between pose estimation and marker-based systems are below 5°, an acceptable level for gait analysis, with a strong correlation between the two datasets supporting the effectiveness of pose estimation in gait analysis. In addition, hip and knee angles were accurately measured at the front diagonal of the subject and ankle angle at the lateral side. This research highlights the significance of careful camera placement for reliable gait analysis using pose estimation, serving as a concise reference to guide future efforts in enhancing the quantitative accuracy of gait analysis.
Collapse
Affiliation(s)
- Junhyuk Yang
- Department of Mechatronics Engineering, Incheon National University, Incheon 22012, Republic of Korea
| | - Kiwon Park
- Department of Mechatronics Engineering, Incheon National University, Incheon 22012, Republic of Korea
| |
Collapse
|
13
|
Ino T, Samukawa M, Ishida T, Wada N, Koshino Y, Kasahara S, Tohyama H. Validity of AI-Based Gait Analysis for Simultaneous Measurement of Bilateral Lower Limb Kinematics Using a Single Video Camera. SENSORS (BASEL, SWITZERLAND) 2023; 23:9799. [PMID: 38139644 PMCID: PMC10747245 DOI: 10.3390/s23249799] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Revised: 12/02/2023] [Accepted: 12/12/2023] [Indexed: 12/24/2023]
Abstract
Accuracy validation of gait analysis using pose estimation with artificial intelligence (AI) remains inadequate, particularly in objective assessments of absolute error and similarity of waveform patterns. This study aimed to clarify objective measures for absolute error and waveform pattern similarity in gait analysis using pose estimation AI (OpenPose). Additionally, we investigated the feasibility of simultaneous measuring both lower limbs using a single camera from one side. We compared motion analysis data from pose estimation AI using video footage that was synchronized with a three-dimensional motion analysis device. The comparisons involved mean absolute error (MAE) and the coefficient of multiple correlation (CMC) to compare the waveform pattern similarity. The MAE ranged from 2.3 to 3.1° on the camera side and from 3.1 to 4.1° on the opposite side, with slightly higher accuracy on the camera side. Moreover, the CMC ranged from 0.936 to 0.994 on the camera side and from 0.890 to 0.988 on the opposite side, indicating a "very good to excellent" waveform similarity. Gait analysis using a single camera revealed that the precision on both sides was sufficiently robust for clinical evaluation, while measurement accuracy was slightly superior on the camera side.
Collapse
Affiliation(s)
- Takumi Ino
- Graduate School of Health Sciences, Hokkaido University, Sapporo 0600812, Japan;
- Department of Physical Therapy, Faculty of Health Sciences, Hokkaido University of Science, Sapporo 0068585, Japan
| | - Mina Samukawa
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| | - Tomoya Ishida
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| | - Naofumi Wada
- Department of Information and Computer Science, Faculty of Engineering, Hokkaido University of Science, Sapporo 0068585, Japan;
| | - Yuta Koshino
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| | - Satoshi Kasahara
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| | - Harukazu Tohyama
- Faculty of Health Sciences, Hokkaido University, Sapporo 0600812, Japan
| |
Collapse
|
14
|
Wade L, Needham L, Evans M, McGuigan P, Colyer S, Cosker D, Bilzon J. Examination of 2D frontal and sagittal markerless motion capture: Implications for markerless applications. PLoS One 2023; 18:e0293917. [PMID: 37943887 PMCID: PMC10635560 DOI: 10.1371/journal.pone.0293917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2023] [Accepted: 10/21/2023] [Indexed: 11/12/2023] Open
Abstract
This study examined if occluded joint locations, obtained from 2D markerless motion capture (single camera view), produced 2D joint angles with reduced agreement compared to visible joints, and if 2D frontal plane joint angles were usable for practical applications. Fifteen healthy participants performed over-ground walking whilst recorded by fifteen marker-based cameras and two machine vision cameras (frontal and sagittal plane). Repeated measures Bland-Altman analysis illustrated that markerless standard deviation of bias and limits of agreement for the occluded-side hip and knee joint angles in the sagittal plane were double that of the camera-side (visible) hip and knee. Camera-side sagittal plane knee and hip angles were near or within marker-based error values previously observed. While frontal plane limits of agreement accounted for 35-46% of total range of motion at the hip and knee, Bland-Altman bias and limits of agreement (-4.6-1.6 ± 3.7-4.2˚) were actually similar to previously reported marker-based error values. This was not true for the ankle, where the limits of agreement (± 12˚) were still too high for practical applications. Our results add to previous literature, highlighting shortcomings of current pose estimation algorithms and labelled datasets. As such, this paper finishes by reviewing methods for creating anatomically accurate markerless training data using marker-based motion capture data.
Collapse
Affiliation(s)
- Logan Wade
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Laurie Needham
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Murray Evans
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Polly McGuigan
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Steffi Colyer
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - Darren Cosker
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| | - James Bilzon
- Centre for the Analysis of Motion, Entertainment Research and Applications, University of Bath, Bath, United Kingdom
| |
Collapse
|
15
|
Martínez-Zarzuela M, González-Alonso J, Antón-Rodríguez M, Díaz-Pernas FJ, Müller H, Simón-Martínez C. Multimodal video and IMU kinematic dataset on daily life activities using affordable devices. Sci Data 2023; 10:648. [PMID: 37737210 PMCID: PMC10516922 DOI: 10.1038/s41597-023-02554-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 09/08/2023] [Indexed: 09/23/2023] Open
Abstract
Human activity recognition and clinical biomechanics are challenging problems in physical telerehabilitation medicine. However, most publicly available datasets on human body movements cannot be used to study both problems in an out-of-the-lab movement acquisition setting. The objective of the VIDIMU dataset is to pave the way towards affordable patient gross motor tracking solutions for daily life activities recognition and kinematic analysis. The dataset includes 13 activities registered using a commodity camera and five inertial sensors. The video recordings were acquired in 54 subjects, of which 16 also had simultaneous recordings of inertial sensors. The novelty of dataset lies in: (i) the clinical relevance of the chosen movements, (ii) the combined utilization of affordable video and custom sensors, and (iii) the implementation of state-of-the-art tools for multimodal data processing of 3D body pose tracking and motion reconstruction in a musculoskeletal model from inertial data. The validation confirms that a minimally disturbing acquisition protocol, performed according to real-life conditions can provide a comprehensive picture of human joint angles during daily life activities.
Collapse
Affiliation(s)
| | | | | | | | - Henning Müller
- University of Applied Sciences and Arts Western Switzerland (HES-SO) Valais-Wallis, Sierre, Switzerland
- Medical faculty, University of Geneva, Geneva, Switzerland
| | - Cristina Simón-Martínez
- University of Applied Sciences and Arts Western Switzerland (HES-SO) Valais-Wallis, Sierre, Switzerland
| |
Collapse
|
16
|
Reliability and validity of OpenPose for measuring hip-knee-ankle angle in patients with knee osteoarthritis. Sci Rep 2023; 13:3297. [PMID: 36841842 PMCID: PMC9968277 DOI: 10.1038/s41598-023-30352-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2022] [Accepted: 02/21/2023] [Indexed: 02/27/2023] Open
Abstract
We aimed to assess the reliability and validity of OpenPose, a posture estimation algorithm, for measuring hip-knee-ankle (HKA) angle in patients with knee osteoarthritis, by comparing it with radiography. In this prospective study, we analysed 60 knees (30 patients) with knee osteoarthritis. We measured HKA angle using OpenPose and radiography before or after total knee arthroplasty and assessed the test-retest reliability of each method with intraclass correlation coefficient (1, 1). We evaluated the ability to estimate the radiographic measurement values from the OpenPose values using linear regression analysis and used intraclass correlation coefficients (2, 1) and Bland-Altman analyses to evaluate the agreement and error between OpenPose and radiographic measurements. OpenPose had excellent test-retest reliability (intraclass correlation coefficient (1, 1) = 1.000) and excellent agreement with radiography (intraclass correlation coefficient (2, 1) = 0.915), with regression analysis indicating a large correlation (R2 = 0.865). OpenPose also had a 1.1° fixed error and no systematic error when compared with radiography. This is the first study to validate the use of OpenPose for the estimation of HKA angle in patients with knee osteoarthritis. OpenPose is a reliable and valid tool for measuring HKA angle in patients with knee osteoarthritis. OpenPose, which enables non-invasive and simple measurements, may be a useful tool to assess changes in HKA angle and monitor the progression and post-operative course of knee osteoarthritis. Furthermore, this validated tool can be used not only in clinics and hospitals, but also at home and in training gyms; thus, its use could potentially be expanded to include self-assessment/monitoring.
Collapse
|
17
|
Fujita K, Hiyama T, Wada K, Aihara T, Matsumura Y, Hamatsuka T, Yoshinaka Y, Kimura M, Kuzuya M. Machine learning-based muscle mass estimation using gait parameters in community-dwelling older adults: A cross-sectional study. Arch Gerontol Geriatr 2022; 103:104793. [PMID: 35987032 DOI: 10.1016/j.archger.2022.104793] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Revised: 08/03/2022] [Accepted: 08/13/2022] [Indexed: 11/22/2022]
Abstract
BACKGROUND Loss of skeletal muscle mass is associated with numerous factors such as metabolic diseases, lack of independence, and mortality in older adults. Therefore, developing simple, safe, and reliable tools for assessing skeletal muscle mass is needed. Some studies recently reported that the risks of the incidence of geriatric conditions could be estimated by analyzing older adults' gait; however, no studies have assessed the association between gait parameters and skeletal muscle loss in older adults. In this study, we applied machine learning approach to the gait parameters derived from three-dimensional skeletal models to distinguish older adults' low skeletal muscle mass. We also identified the most important gait parameters for detecting low muscle mass. METHODS Sixty-six community-dwelling older adults were recruited. Thirty-two gait parameters were created using a three-dimensional skeletal model involving 10-meter comfortable walking. After skeletal muscle mass measurement using a bioimpedance analyzer, low muscle mass was judged in accordance with the guideline of the Asia Working Group for Sarcopenia. The eXtreme gradient boosting (XGBoost) model was applied to discriminate between low and high skeletal muscle mass. RESULTS Eleven subjects had a low muscle mass. The c-statistics, sensitivity, specificity, precision of the final model were 0.7, 59.5%, 81.4%, and 70.5%, respectively. The top three dominant gait parameters were, in order of strongest effect, stride length, hip dynamic range of motion, and trunk rotation variability. CONCLUSION Machine learning-based gait analysis is a useful approach to determine the low skeletal muscle mass of community-dwelling older adults.
Collapse
Affiliation(s)
- Kosuke Fujita
- Department of Community Healthcare and Geriatrics, Graduate School of Medicine, Nagoya University, Nagoya, Japan; Department of Prevention and Care Science, Center for Development of Advanced Medicine for Dementia, National Center for Geriatrics and Gerontology, Obu, Japan.
| | - Takahiro Hiyama
- Technology Division, Panasonic Holdings Corporation, Kadoma, Japan
| | - Kengo Wada
- Electric Works Company, Panasonic Corporation, Kadoma, Japan
| | - Takahiro Aihara
- Electric Works Company, Panasonic Corporation, Kadoma, Japan
| | | | | | - Yasuko Yoshinaka
- Department of Bioenvironment, Kyoto University of Advanced Science, Kameoka, Japan
| | - Misaka Kimura
- Department of Bioenvironment, Kyoto University of Advanced Science, Kameoka, Japan; Doshisha Women's College of Liberal Arts, Graduate School of Nursing, Kyotanabe, Japan
| | - Masafumi Kuzuya
- Department of Community Healthcare and Geriatrics, Graduate School of Medicine, Nagoya University, Nagoya, Japan
| |
Collapse
|
18
|
Washabaugh EP, Shanmugam TA, Ranganathan R, Krishnan C. Comparing the accuracy of open-source pose estimation methods for measuring gait kinematics. Gait Posture 2022; 97:188-195. [PMID: 35988434 DOI: 10.1016/j.gaitpost.2022.08.008] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Revised: 06/30/2022] [Accepted: 08/12/2022] [Indexed: 02/02/2023]
Abstract
BACKGROUND Open-source pose estimation is rapidly reducing the costs associated with motion capture, as machine learning partially eliminates the need for specialized cameras and equipment. This technology could be particularly valuable for clinical gait analysis, which is often performed qualitatively due to the prohibitive cost and setup required for conventional, marker-based motion capture. RESEARCH QUESTION How do open-source pose estimation software packages compare in their ability to measure kinematics and spatiotemporal gait parameters for gait analysis? METHODS This analysis used an existing dataset that contained video and synchronous motion capture data from 32 able-bodied participants while walking. Sagittal plane videos were analyzed using pre-trained algorithms from four open-source pose estimation methods-OpenPose, Tensorflow MoveNet Lightning, Tensorflow MoveNet Thunder, and DeepLabCut-to extract keypoints (i.e., landmarks) and calculate hip and knee kinematics and spatiotemporal gait parameters. The absolute error when using each markerless pose estimation method was computed against conventional marker-based optical motion capture. Errors were compared between pose estimation methods using statistical parametric mapping. RESULTS Pose estimation methods differed in their ability to measure kinematics. OpenPose and Tensorflow MoveNet Thunder methods were most accurate for measuring hip kinematics, averaging 3.7 ± 1.3 deg and 4.6 ± 1.8 deg (mean ± std) over the entire gait cycle, respectively. OpenPose was most accurate when measuring knee kinematics, averaging 5.1 ± 2.5 deg of error over the gait cycle. MoveNet Thunder and OpenPose had the lowest errors when measuring spatiotemporal gait parameters but were not statistically different from one another. SIGNIFICANCE The results indicate that OpenPose significantly outperforms other existing platforms for pose-estimation of healthy gait kinematics and spatiotemporal gait parameters and could serve as an alternative to conventional motion capture systems in clinical and research settings when marker-based systems are not available.
Collapse
Affiliation(s)
- Edward P Washabaugh
- Department of Biomedical Engineering, Wayne State University, Detroit, MI, USA; Department of Physical Medicine and Rehabilitation, Michigan Medicine, Ann Arbor, MI, USA
| | | | - Rajiv Ranganathan
- Department of Kinesiology, Michigan State University, East Lansing, MI, USA
| | - Chandramouli Krishnan
- Department of Physical Medicine and Rehabilitation, Michigan Medicine, Ann Arbor, MI, USA; Michigan Robotics Institute, University of Michigan, Ann Arbor, MI, USA; Department of Physical Therapy, College of Health Sciences, University of Michigan-Flint, Flint, MI, USA.
| |
Collapse
|
19
|
A Lightweight Pose Sensing Scheme for Contactless Abnormal Gait Behavior Measurement. SENSORS 2022; 22:s22114070. [PMID: 35684689 PMCID: PMC9185243 DOI: 10.3390/s22114070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Revised: 05/24/2022] [Accepted: 05/25/2022] [Indexed: 12/10/2022]
Abstract
The recognition of abnormal gait behavior is important in the field of motion assessment and disease diagnosis. Currently, abnormal gait behavior is primarily recognized by pressure and inertial data obtained from wearable sensors. However, the data drift and wearing difficulties for patients have impeded the application of these wearable sensors. Here, we propose a contactless abnormal gait behavior recognition method that captures human pose data using a monocular camera. A lightweight OpenPose (OP) model is generated with Depthwise Separable Convolution to recognize joint points and extract their coordinates during walking in real time. For the walking data errors extracted in the 2D plane, a 3D reconstruction is performed on the walking data, and a total of 11 types of abnormal gait features are extracted by the OP model. Finally, the XGBoost algorithm is used for feature screening. The final experimental results show that the Random Forest (RF) algorithm in combination with 3D features delivers the highest precision (92.13%) for abnormal gait behavior recognition. The proposed scheme overcomes the data drift of inertial sensors and sensor wearing challenges in the elderly while reducing the hardware requirements for model deployment. With excellent real-time and contactless capabilities, the scheme is expected to enjoy a wide range of applications in the field of abnormal gait measurement.
Collapse
|