1
|
Gashri C, Talmon R, Peleg N, Moshe Y, Agoston D, Gavras S, Fischer AG, Horowitz-Kraus T. Multimodal analysis of mother-child interaction using hyperscanning and diffusion maps. Sci Rep 2025; 15:5431. [PMID: 39948429 PMCID: PMC11825838 DOI: 10.1038/s41598-025-90310-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2024] [Accepted: 02/12/2025] [Indexed: 02/16/2025] Open
Abstract
The current work aims to reveal mother-child synchronization patterns using several interaction modalities and combining them using the diffusion maps method. Twenty-two Hebrew-speaking toddlers (ages = 33 ± 5.38 months, 17 males) and their mothers (ages = 35 ± 5.79 years) participated in two interaction conditions while data was collected from several modalities, i.e. EEG, joint attention (measured through video coding of looking behavior), and motion analysis. Dimension reduction and data fusion of these modalities were performed using diffusion maps to enable a comprehensive assessment of mother-child synchronization dynamics. This multimodal approach allows better characterization of mother-child interaction and examining the associations between interaction patterns and maternal parenting style and their importance to the child's long-term language abilities.
Collapse
Affiliation(s)
- C Gashri
- Faculty of Biomedical Engineering, Technion, Haifa, Israel
| | - R Talmon
- Faculty of Biomedical Engineering, Technion, Haifa, Israel
| | - N Peleg
- Faculty of Electrical and Computer Engineering, Technion, Haifa, Israel
| | - Y Moshe
- Faculty of Biomedical Engineering, Technion, Haifa, Israel
| | - D Agoston
- Faculty of Biomedical Engineering, Technion, Haifa, Israel
- Department of Mechatronics, Optics and Mechanical Engineering Informatics, Faculty of Mechanical Engineering, Budapest University of Technology and Economics, Budapest, Hungary
| | - S Gavras
- Faculty of Biomedical Engineering, Technion, Haifa, Israel
| | - A G Fischer
- Faculty of Biomedical Engineering, Technion, Haifa, Israel
| | - T Horowitz-Kraus
- Faculty of Biomedical Engineering, Technion, Haifa, Israel.
- Educational Neuroimaging Group, Faculty of Education in Science and Technology, Faculty of Biomedical Engineering, Technion, Haifa, Israel.
- Department of Neuropsychology, Center for Neurodevelopmental and Imaging Research (CNIR), Kennedy Krieger Institute, Baltimore, MD, USA.
- Department of Psychology and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| |
Collapse
|
2
|
Matsuda T, Fujino Y, Morisawa T, Takahashi T, Kakegawa K, Matsumoto T, Kiyohara T, Fukushima H, Higuchi M, Torimoto Y, Miwa M, Fujiwara T, Daida H. Reliability and Validity Examination of a New Gait Motion Analysis System. SENSORS (BASEL, SWITZERLAND) 2025; 25:1076. [PMID: 40006304 PMCID: PMC11858938 DOI: 10.3390/s25041076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/02/2024] [Revised: 01/08/2025] [Accepted: 02/09/2025] [Indexed: 02/27/2025]
Abstract
Recent advancements have made two-dimensional (2D) clinical gait analysis systems more accessible and portable than traditional three-dimensional (3D) clinical systems. This study evaluates the reliability and validity of gait measurements using monocular and composite camera setups with VisionPose, comparing them to the Vicon 3D motion capture system as a reference. Key gait parameters-including hip and knee joint angles, and time and distance factors-were assessed under normal, maximum speed, and tandem gait conditions during level walking. The results show that the intraclass correlation coefficient (ICC(1,k)) for the 2D model exceeded 0.969 for the monocular camera and 0.963 for the composite camera for gait parameters. Time-distance gait parameters demonstrated excellent relative agreement across walking styles, while joint range of motion showed overall strong agreement. However, accuracy was lower for measurements during tandem walking. The Cronbach's alpha coefficient for time-distance parameters ranged from 0.932 to 0.999 (monocular) and from 0.823 to 0.998 (composite). In contrast, for joint range of motion, the coefficient varied more widely, ranging from 0.826 to 0.985 (monocular) and from 0.314 to 0.974 (composite). The correlation coefficients for spatiotemporal gait parameters were greater than 0.933 (monocular) and 0.837 (composite). However, for joint angle parameters, the coefficients were lower during tandem walking. This study underscores the potential of 2D models in clinical applications and highlights areas for improvement to enhance their reliability and application scope.
Collapse
Affiliation(s)
- Tadamitsu Matsuda
- Department of Physical Therapy, Faculty of Health Science, Juntendo University, Tokyo 113-8421, Japan; (Y.F.); (T.M.); (T.T.); (K.K.)
| | - Yuji Fujino
- Department of Physical Therapy, Faculty of Health Science, Juntendo University, Tokyo 113-8421, Japan; (Y.F.); (T.M.); (T.T.); (K.K.)
| | - Tomoyuki Morisawa
- Department of Physical Therapy, Faculty of Health Science, Juntendo University, Tokyo 113-8421, Japan; (Y.F.); (T.M.); (T.T.); (K.K.)
| | - Tetsuya Takahashi
- Department of Physical Therapy, Faculty of Health Science, Juntendo University, Tokyo 113-8421, Japan; (Y.F.); (T.M.); (T.T.); (K.K.)
| | - Kei Kakegawa
- Department of Physical Therapy, Faculty of Health Science, Juntendo University, Tokyo 113-8421, Japan; (Y.F.); (T.M.); (T.T.); (K.K.)
| | - Takanari Matsumoto
- Global Development Center, Development Department, Development Section, IMASEN Electric Industrial Co., Ltd., Inuyama 484-0083, Japan (T.K.); (H.F.); (M.H.); (Y.T.); (M.M.)
| | - Takehiko Kiyohara
- Global Development Center, Development Department, Development Section, IMASEN Electric Industrial Co., Ltd., Inuyama 484-0083, Japan (T.K.); (H.F.); (M.H.); (Y.T.); (M.M.)
| | - Hiroshi Fukushima
- Global Development Center, Development Department, Development Section, IMASEN Electric Industrial Co., Ltd., Inuyama 484-0083, Japan (T.K.); (H.F.); (M.H.); (Y.T.); (M.M.)
| | - Makoto Higuchi
- Global Development Center, Development Department, Development Section, IMASEN Electric Industrial Co., Ltd., Inuyama 484-0083, Japan (T.K.); (H.F.); (M.H.); (Y.T.); (M.M.)
| | - Yasuo Torimoto
- Global Development Center, Development Department, Development Section, IMASEN Electric Industrial Co., Ltd., Inuyama 484-0083, Japan (T.K.); (H.F.); (M.H.); (Y.T.); (M.M.)
| | - Masaki Miwa
- Global Development Center, Development Department, Development Section, IMASEN Electric Industrial Co., Ltd., Inuyama 484-0083, Japan (T.K.); (H.F.); (M.H.); (Y.T.); (M.M.)
| | - Toshiyuki Fujiwara
- Department of Rehabilitation Medicine, Graduate School of Medicine, Juntendo University, Tokyo 113-8421, Japan;
| | - Hiroyuki Daida
- Department of Physical Therapy, Faculty of Health Science, Juntendo University, Tokyo 113-8421, Japan; (Y.F.); (T.M.); (T.T.); (K.K.)
| |
Collapse
|
3
|
van den Hoorn W, Fabre A, Nardese G, Su EYS, Cutbush K, Gupta A, Kerr G. The Future of Clinical Active Shoulder Range of Motion Assessment, Best Practice, and Its Challenges: Narrative Review. SENSORS (BASEL, SWITZERLAND) 2025; 25:667. [PMID: 39943306 PMCID: PMC11820973 DOI: 10.3390/s25030667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/25/2024] [Revised: 12/13/2024] [Accepted: 01/03/2025] [Indexed: 02/16/2025]
Abstract
Optimising outcomes after shoulder interventions requires objective shoulder range of motion (ROM) assessments. This narrative review examines video-based pose technologies and markerless motion capture, focusing on their clinical application for shoulder ROM assessment. Camera pose-based methods offer objective ROM measurements, though the accuracy varies due to the differences in gold standards, anatomical definitions, and deep learning techniques. Despite some biases, the studies report a high consistency, emphasising that methods should not be used interchangeably if they do not agree with each other. Smartphone cameras perform well in capturing 2D planar movements but struggle with that of rotational movements and forward flexion, particularly when thoracic compensations are involved. Proper camera positioning, orientation, and distance are key, highlighting the importance of standardised protocols in mobile phone-based ROM evaluations. Although 3D motion capture, per the International Society of Biomechanics recommendations, remains the gold standard, advancements in LiDAR/depth sensing, smartphone cameras, and deep learning show promise for reliable ROM assessments in clinical settings.
Collapse
Affiliation(s)
- Wolbert van den Hoorn
- School of Exercise and Nutrition Sciences, Queensland University of Technology, Brisbane, QLD 4059, Australia; (A.F.); (G.N.); (E.Y.-S.S.)
- School of Health and Rehabilitation Sciences, The University of Queensland, Brisbane, QLD 4072, Australia
- Queensland Unit for Advanced Shoulder Research, Queensland University of Technology, Brisbane, QLD 4000, Australia; (K.C.); (A.G.)
| | - Arthur Fabre
- School of Exercise and Nutrition Sciences, Queensland University of Technology, Brisbane, QLD 4059, Australia; (A.F.); (G.N.); (E.Y.-S.S.)
| | - Giacomo Nardese
- School of Exercise and Nutrition Sciences, Queensland University of Technology, Brisbane, QLD 4059, Australia; (A.F.); (G.N.); (E.Y.-S.S.)
| | - Eric Yung-Sheng Su
- School of Exercise and Nutrition Sciences, Queensland University of Technology, Brisbane, QLD 4059, Australia; (A.F.); (G.N.); (E.Y.-S.S.)
| | - Kenneth Cutbush
- Queensland Unit for Advanced Shoulder Research, Queensland University of Technology, Brisbane, QLD 4000, Australia; (K.C.); (A.G.)
- Australia Shoulder Research Institute, Brisbane, QLD 4000, Australia
- Faculty of Medicine, The University of Queensland, Brisbane, QLD 4343, Australia
| | - Ashish Gupta
- Queensland Unit for Advanced Shoulder Research, Queensland University of Technology, Brisbane, QLD 4000, Australia; (K.C.); (A.G.)
- Australia Shoulder Research Institute, Brisbane, QLD 4000, Australia
- Shoulder Surgery QLD Research Institute, Brisbane, QLD 4120, Australia
- Greenslopes Private Hospital, Brisbane, QLD 4120, Australia
| | - Graham Kerr
- School of Exercise and Nutrition Sciences, Queensland University of Technology, Brisbane, QLD 4059, Australia; (A.F.); (G.N.); (E.Y.-S.S.)
- Queensland Unit for Advanced Shoulder Research, Queensland University of Technology, Brisbane, QLD 4000, Australia; (K.C.); (A.G.)
| |
Collapse
|
4
|
Ryu SM, Shin K, Doh CH, Ben H, Park JY, Koh KH, Shin H, Jeon IH. Orthopedic surgeon level joint angle assessment with artificial intelligence based on photography: a pilot study. Biomed Eng Lett 2025; 15:131-142. [PMID: 39781060 PMCID: PMC11703788 DOI: 10.1007/s13534-024-00432-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2024] [Revised: 09/07/2024] [Accepted: 09/19/2024] [Indexed: 01/12/2025] Open
Abstract
Accurate assessment of shoulder range of motion (ROM) is crucial for evaluating patient progress. Traditional manual goniometry often lacks precision and is subject to inter-observer variability, especially in measuring shoulder internal rotation (IR). This study introduces an artificial intelligence (AI)-based approach that uses clinical photography to improve the accuracy of ROM quantification. We analyzed a total of 150 clinical photographs, including 100 shoulder and 50 elbow images, taken between January and April 2022. An MMPose model with an HR-NET backbone architecture, pre-trained on the COCO-WholeBody dataset, was used to detect 17 anatomical landmarks. A random forest classifier (PoseRF) then categorized poses, and ROM angles were calculated. Concurrently, two clinicians independently measured shoulder IR at the vertebral level, and inter-observer agreement was evaluated. Linear regression analyses were conducted to correlate the AI-derived measurements with the clinicians' assessments. The AI-based algorithm accurately detected anatomical landmarks in 96% of shoulder and 100% of elbow images. Pose detection achieved 95% accuracy overall, with 100% accuracy for specific shoulder (abduction, flexion, external rotation) and elbow (flexion, extension) poses. Intraclass correlation coefficients (ICCs) between the AI algorithm and human observers ranged from 0.965 to 0.997, indicating excellent inter-observer reliability. Kruskal-Wallis test showed no statistically significant differences in ROM measurements among the AI algorithm and two human observers across all joint angles (p > 0.05). The AI-based algorithm demonstrated performance comparable to that of human observers in quantifying shoulder and elbow ROM from clinical photographs. For shoulder internal rotation, the AI approach showed potential for improved consistency compared to traditional methods. Supplementary Information The online version contains supplementary material available at 10.1007/s13534-024-00432-w.
Collapse
Affiliation(s)
- Seung Min Ryu
- Department of Orthopedic Surgery, Seoul Medical Center, Seoul, 02053, South Korea
| | - Keewon Shin
- Department of Artificial Intelligence Research Center, Korea University College of Medicine, Anam Hospital, Seoul, 02841, South Korea
| | - Chang Hyun Doh
- Department of Orthopedic Surgery, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505 South Korea
| | - Hui Ben
- Department of Orthopedic Surgery, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505 South Korea
| | - Ji Yeon Park
- Department of Orthopedic Surgery, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505 South Korea
| | - Kyoung-Hwan Koh
- Department of Orthopedic Surgery, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505 South Korea
| | - Hangsik Shin
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505 South Korea
| | - In-ho Jeon
- Department of Orthopedic Surgery, Asan Medical Center, University of Ulsan College of Medicine, Seoul, 05505 South Korea
| |
Collapse
|
5
|
Moreira R, Teixeira S, Fialho R, Miranda A, Lima LDB, Carvalho MB, Alves AB, Bastos VHV, Teles AS. Validity Analysis of Monocular Human Pose Estimation Models Interfaced with a Mobile Application for Assessing Upper Limb Range of Motion. SENSORS (BASEL, SWITZERLAND) 2024; 24:7983. [PMID: 39771719 PMCID: PMC11679233 DOI: 10.3390/s24247983] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/19/2024] [Revised: 12/03/2024] [Accepted: 12/12/2024] [Indexed: 01/11/2025]
Abstract
Human Pose Estimation (HPE) is a computer vision application that utilizes deep learning techniques to precisely locate Key Joint Points (KJPs), enabling the accurate description of a person's pose. HPE models can be extended to facilitate Range of Motion (ROM) assessment by leveraging patient photographs. This study aims to evaluate and compare the performance of HPE models for assessing upper limbs ROM. A physiotherapist evaluated the degrees of ROM in shoulders (flexion, extension, and abduction) and elbows (flexion and extension) for fifty-two participants using both Universal Goniometer (UG) and five HPE models. Participants were instructed to repeat each movement three times to obtain measurements with the UG, then positioned while photos were captured using the NLMeasurer mobile application. The paired t-test, bias, and error measures were employed to evaluate the difference and agreement between measurement methods. Results indicated that the MoveNet Thunder INT16 model exhibited superior performance. Root Mean Square Errors obtained through this model were <10° in 8 of 10 analyzed movements. HPE models demonstrated better performance in shoulder flexion and abduction movements while exhibiting unsatisfactory performance in elbow flexion. Challenges such as image perspective distortion, environmental lighting conditions, images in monocular view, and complications in the pose may influence the models' performance. Nevertheless, HPE models show promise in identifying KJPs and facilitating ROM measurements, potentially enhancing convenience and efficiency in assessments. However, their current accuracy for this application is unsatisfactory, highlighting the need for caution when considering automated upper limb ROM measurement with them. The implementation of these models in clinical practice does not diminish the crucial role of examiners in carefully inspecting images and making adjustments to ensure measurement reliability.
Collapse
Affiliation(s)
- Rayele Moreira
- Postgraduate Program in Biotechnology, Parnaíba Delta Federal University, Parnaíba 64202-020, Brazil; (R.M.)
| | - Silmar Teixeira
- Postgraduate Program in Biotechnology, Parnaíba Delta Federal University, Parnaíba 64202-020, Brazil; (R.M.)
| | - Renan Fialho
- Postgraduate Program in Biotechnology, Parnaíba Delta Federal University, Parnaíba 64202-020, Brazil; (R.M.)
| | - Aline Miranda
- Postgraduate Program in Biotechnology, Parnaíba Delta Federal University, Parnaíba 64202-020, Brazil; (R.M.)
| | - Lucas Daniel Batista Lima
- Postgraduate Program in Biotechnology, Parnaíba Delta Federal University, Parnaíba 64202-020, Brazil; (R.M.)
| | - Maria Beatriz Carvalho
- Postgraduate Program in Biotechnology, Parnaíba Delta Federal University, Parnaíba 64202-020, Brazil; (R.M.)
| | | | - Victor Hugo Vale Bastos
- Postgraduate Program in Biotechnology, Parnaíba Delta Federal University, Parnaíba 64202-020, Brazil; (R.M.)
| | - Ariel Soares Teles
- Postgraduate Program in Biotechnology, Parnaíba Delta Federal University, Parnaíba 64202-020, Brazil; (R.M.)
- Campus Araioses, Federal Institute of Maranhão, Araioses 65570-000, Brazil
| |
Collapse
|
6
|
Ino T, Samukawa M, Ishida T, Wada N, Koshino Y, Kasahara S, Tohyama H. Validity and Reliability of OpenPose-Based Motion Analysis in Measuring Knee Valgus during Drop Vertical Jump Test. J Sports Sci Med 2024; 23:515-525. [PMID: 39228769 PMCID: PMC11366844 DOI: 10.52082/jssm.2024.515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Accepted: 06/14/2024] [Indexed: 09/05/2024]
Abstract
OpenPose-based motion analysis (OpenPose-MA), utilizing deep learning methods, has emerged as a compelling technique for estimating human motion. It addresses the drawbacks associated with conventional three-dimensional motion analysis (3D-MA) and human visual detection-based motion analysis (Human-MA), including costly equipment, time-consuming analysis, and restricted experimental settings. This study aims to assess the precision of OpenPose-MA in comparison to Human-MA, using 3D-MA as the reference standard. The study involved a cohort of 21 young and healthy adults. OpenPose-MA employed the OpenPose algorithm, a deep learning-based open-source two-dimensional (2D) pose estimation method. Human-MA was conducted by a skilled physiotherapist. The knee valgus angle during a drop vertical jump task was computed by OpenPose-MA and Human-MA using the same frontal-plane video image, with 3D-MA serving as the reference standard. Various metrics were utilized to assess the reproducibility, accuracy and similarity of the knee valgus angle between the different methods, including the intraclass correlation coefficient (ICC) (1, 3), mean absolute error (MAE), coefficient of multiple correlation (CMC) for waveform pattern similarity, and Pearson's correlation coefficients (OpenPose-MA vs. 3D-MA, Human-MA vs. 3D-MA). Unpaired t-tests were conducted to compare MAEs and CMCs between OpenPose-MA and Human-MA. The ICCs (1,3) for OpenPose-MA, Human-MA, and 3D-MA demonstrated excellent reproducibility in the DVJ trial. No significant difference between OpenPose-MA and Human-MA was observed in terms of the MAEs (OpenPose: 2.4° [95%CI: 1.9-3.0°], Human: 3.2° [95%CI: 2.1-4.4°]) or CMCs (OpenPose: 0.83 [range: 0.99-0.53], Human: 0.87 [range: 0.24-0.98]) of knee valgus angles. The Pearson's correlation coefficients of OpenPose-MA and Human-MA relative to that of 3D-MA were 0.97 and 0.98, respectively. This study demonstrated that OpenPose-MA achieved satisfactory reproducibility, accuracy and exhibited waveform similarity comparable to 3D-MA, similar to Human-MA. Both OpenPose-MA and Human-MA showed a strong correlation with 3D-MA in terms of knee valgus angle excursion.
Collapse
Affiliation(s)
- Takumi Ino
- Graduate School of Health Sciences, Hokkaido University, Sapporo, Japan
- Department of Physical Therapy, Faculty of Health Sciences, Hokkaido University of Science, Sapporo, Japan
| | - Mina Samukawa
- Faculty of Health Sciences, Hokkaido University, Sapporo, Japan
| | - Tomoya Ishida
- Faculty of Health Sciences, Hokkaido University, Sapporo, Japan
| | - Naofumi Wada
- Department of Information and Computer Science, Faculty of Engineering, Hokkaido University of Science, Sapporo, Japan
| | - Yuta Koshino
- Faculty of Health Sciences, Hokkaido University, Sapporo, Japan
| | | | | |
Collapse
|
7
|
Ishida T, Ino T, Yamakawa Y, Wada N, Koshino Y, Samukawa M, Kasahara S, Tohyama H. Estimation of Vertical Ground Reaction Force during Single-leg Landing Using Two-dimensional Video Images and Pose Estimation Artificial Intelligence. Phys Ther Res 2024; 27:35-41. [PMID: 38690532 PMCID: PMC11057390 DOI: 10.1298/ptr.e10276] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 01/09/2024] [Indexed: 05/02/2024]
Abstract
OBJECTIVE Assessment of the vertical ground reaction force (VGRF) during landing tasks is crucial for physical therapy in sports. The purpose of this study was to determine whether the VGRF during a single-leg landing can be estimated from a two-dimensional (2D) video image and pose estimation artificial intelligence (AI). METHODS Eighteen healthy male participants (age: 23.0 ± 1.6 years) performed a single-leg landing task from a 30-cm height. The VGRF was measured using a force plate and estimated using center of mass (COM) position data from a 2D video image with pose estimation AI (2D-AI) and three-dimensional optical motion capture (3D-Mocap). The measured and estimated peak VGRFs were compared using a paired t-test and Pearson's correlation coefficient. The absolute errors of the peak VGRF were also compared between the two estimations. RESULTS No significant difference in the peak VGRF was found between the force plate measured VGRF and the 2D-AI or 3D-Mocap estimated VGRF (force plate: 3.37 ± 0.42 body weight [BW], 2D-AI: 3.32 ± 0.42 BW, 3D-Mocap: 3.50 ± 0.42 BW). There was no significant difference in the absolute error of the peak VGRF between the 2D-AI and 3D-Mocap estimations (2D-AI: 0.20 ± 0.16 BW, 3D-Mocap: 0.13 ± 0.09 BW, P = 0.163). The measured peak VGRF was significantly correlated with the estimated peak by 2D-AI (R = 0.835, P <0.001). CONCLUSION The results of this study indicate that peak VGRF estimation using 2D video images and pose estimation AI is useful for the clinical assessment of single-leg landing.
Collapse
Affiliation(s)
- Tomoya Ishida
- Faculty of Health Sciences, Hokkaido University, Japan
| | - Takumi Ino
- Faculty of Health Sciences, Hokkaido University of Science, Japan
| | | | - Naofumi Wada
- Faculty of Engineering, Hokkaido University of Science, Japan
| | - Yuta Koshino
- Faculty of Health Sciences, Hokkaido University, Japan
| | - Mina Samukawa
- Faculty of Health Sciences, Hokkaido University, Japan
| | | | | |
Collapse
|
8
|
Sabo A, Mittal N, Deshpande A, Clarke H, Taati B. Automated, Vision-Based Goniometry and Range of Motion Calculation in Individuals With Suspected Ehlers-Danlos Syndromes/Generalized Hypermobility Spectrum Disorders: A Comparison of Pose-Estimation Libraries to Goniometric Measurements. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2023; 12:140-150. [PMID: 38088992 PMCID: PMC10712662 DOI: 10.1109/jtehm.2023.3327691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Revised: 09/28/2023] [Accepted: 10/23/2023] [Indexed: 12/18/2023]
Abstract
Generalized joint hypermobility (GJH) often leads clinicians to suspect a diagnosis of Ehlers Danlos Syndrome (EDS), but it can be difficult to objectively assess. Video-based goniometry has been proposed to objectively estimate joint range of motion in hyperextended joints. As part of an exam of joint hypermobility at a specialized EDS clinic, a mobile phone was used to record short videos of 97 adults (89 female, 35.0 ± 9.9 years old) undergoing assessment of the elbows, knees, shoulders, ankles, and fifth fingers. Five body keypoint pose-estimation libraries (AlphaPose, Detectron, MediaPipe-Body, MoveNet - Thunder, OpenPose) and two hand keypoint pose-estimation libraries (AlphaPose, MediaPipe-Hands) were used to geometrically calculate the maximum angle of hyperextension or hyperflexion of each joint. A custom domain-specific model with a MobileNet-v2 backbone finetuned on data collected as part of this study was also evaluated for the fifth finger movement. Spearman's correlation was used to analyze the angles calculated from the tracked joint positions, the angles calculated from manually annotated keypoints, and the angles measured using a goniometer. Moderate correlations between the angles estimated using pose-tracked keypoints and the goniometer measurements were identified for the elbow (rho =.722; Detectron), knee (rho =.608; MoveNet - Thunder), shoulder (rho =.632; MoveNet - Thunder), and fifth finger (rho =.786; custom model) movements. The angles estimated from keypoints predicted by open-source libraries at the ankles were not significantly correlated with the goniometer measurements. Manually annotated angles at the elbows, knees, shoulders, and fifth fingers were moderately to strongly correlated to goniometer measurements but were weakly correlated for the ankles. There was not one pose-estimation library which performed best across all joints, so the library of choice must be selected separately for each joint of interest. This work evaluates several pose-estimation models as part of a vision-based system for estimating joint angles in individuals with suspected joint hypermobility. Future applications of the proposed system could facilitate objective assessment and screening of individuals referred to specialized EDS clinics.
Collapse
Affiliation(s)
- Andrea Sabo
- KITE Research Institute, Toronto Rehabilitation Institute--University Health NetworkTorontoONM5G 2A2Canada
| | - Nimish Mittal
- KITE Research Institute, Toronto Rehabilitation Institute--University Health NetworkTorontoONM5G 2A2Canada
- Division of Physical Medicine and Rehabilitation, Temerty Faculty of MedicineUniversity of TorontoTorontoONM5S 1A1Canada
- Department of Anesthesia and Pain MedicineUniversity of TorontoTorontoONM5S 1A1Canada
- Faculty of Kinesiology and Physical EducationUniversity of TorontoTorontoONM5S 1A1Canada
| | - Amol Deshpande
- Faculty of MedicineUniversity of TorontoTorontoONM5S 1A1Canada
| | - Hance Clarke
- Department of Anesthesiology and Pain MedicineUniversity of TorontoTorontoONM5S 1A1Canada
- Canada Transitional Pain ServiceToronto General Hospital—University Health NetworkTorontoONM5T 1V4Canada
- Canada Transitional Pain ServiceToronto General HospitalTorontoONM5G 2C4Canada
| | - Babak Taati
- KITE Research Institute, Toronto Rehabilitation Institute--University Health NetworkTorontoONM5G 2A2Canada
- Department of Computer ScienceUniversity of TorontoTorontoONM5S 1A1Canada
- Institute of Biomedical Engineering, University of TorontoTorontoONM5S 1A1Canada
| |
Collapse
|
9
|
Tozawa R, Ishii N, Onuma R, Kawasaki T. The reliability and validity of joint range of motion measurement using zoom and a smartphone application. J Phys Ther Sci 2023; 35:538-541. [PMID: 37405179 PMCID: PMC10315204 DOI: 10.1589/jpts.35.538] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 04/16/2023] [Indexed: 07/06/2023] Open
Abstract
[Purpose] This study aimed to evaluate the reliability and validity of measuring the range of motion of joints using a remote videoconferencing system (Zoom) and a smartphone application. [Participants and Methods] This study included 16 young and healthy adults. The participants were instructed to perform shoulder joint flexion exercises in a seated position, with automatic motions, and maintain that posture throughout the measurement. Two measurements were performed: 1) angle measurement using a three-dimensional (3D) motion analyzer, and 2) angle measurement using the videoconference software, Zoom, and a smartphone application. Intra- and inter-rater reliabilities were calculated using the intraclass correlation coefficients (ICC). The degree of agreement between the representative values of each measurer and the 3D motion analyzer was examined. [Results] ICC (1, 1) for intra-examiner reliability were 0.912 and 0.996. For the inter-rater reliability, the ICC (2, 1) was 0.945. The correlation coefficient between each examiner's value and the value of the 3D motion analyzer was 0.955 and 0.980, respectively. The Bland-Altman analysis results indicated no systematic error. [Conclusion] The method of remotely measuring joint range of motion using Zoom and a smartphone application demonstrated high reliability and validity.
Collapse
Affiliation(s)
- Ryosuke Tozawa
- Department of Physical Therapy, Faculty of Health Science,
Ryotokuji University: 5-8-1 Akemi, Urayasu, Chiba 279-8567, Japan
- Department of Rehabilitation, Kasai Clinic of Orthopedic
and Internal Medicine, Japan
| | - Narumi Ishii
- Department of Physical Therapy, Faculty of Health Science,
Ryotokuji University: 5-8-1 Akemi, Urayasu, Chiba 279-8567, Japan
| | - Ryo Onuma
- Department of Physical Therapy, Faculty of Health Science,
Mejiro University, Japan
| | - Tsubasa Kawasaki
- Department of Physical Therapy, School of Health Sciences,
Tokyo International University, Japan
| |
Collapse
|
10
|
Gupta L, Najm A, Kabir K, De Cock D. Digital health in musculoskeletal care: where are we heading? BMC Musculoskelet Disord 2023; 24:192. [PMID: 36918856 PMCID: PMC10012296 DOI: 10.1186/s12891-023-06309-w] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 03/10/2023] [Indexed: 03/16/2023] Open
Abstract
BMC Musculoskeletal Disorders launched a Collection on digital health to get a sense of where the wind is blowing, and what impact these technologies are and will have on musculoskeletal medicine. This editorial summarizes findings and focuses on some key topics, which are valuable as digital health establishes itself in patient care. Elements discussed are digital tools for the diagnosis, prognosis and evaluation of rheumatic and musculoskeletal diseases, coupled together with advances in methodologies to analyse health records and imaging. Moreover, the acceptability and validity of these digital advances is discussed. In sum, this editorial and the papers presented in this article collection on Digital health in musculoskeletal care will give the interested reader both a glance towards which future we are heading, and which new challenges these advances bring.
Collapse
Affiliation(s)
- Latika Gupta
- Department of Rheumatology, Royal Wolverhampton Hospitals NHS Trust, Wolverhampton, UK.,City Hospital, Sandwell and West Birmingham Hospitals NHS Trust, Birmingham, UK.,Division of Musculoskeletal and Dermatological Sciences, Centre for Musculoskeletal Research, School of Biological Sciences, The University of Manchester, Manchester, UK
| | - Aurélie Najm
- Institute of Infection, Immunity and Inflammation, College of Medical Veterinary and Life Sciences, University of Glasgow, Sir Graeme Davies Building Level 4, Glasgow, UK.,NHS Royal Alexandra Hospital, Glasgow, UK
| | - Koroush Kabir
- Department of Orthopaedics and Trauma Surgery, University Hospital Bonn, Bonn, Germany
| | - Diederik De Cock
- Biostatistics and Medical Informatics Research Group, Department of Public Health, Vrije Universiteit Brussel, Brussels, Belgium.
| |
Collapse
|