1
|
Adamowicz L, Christakis Y, Czech MD, Adamusiak T. SciKit Digital Health: Python Package for Streamlined Wearable Inertial Sensor Data Processing. JMIR Mhealth Uhealth 2022; 10:e36762. [PMID: 35353039 PMCID: PMC9073613 DOI: 10.2196/36762] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Revised: 03/28/2022] [Accepted: 03/29/2022] [Indexed: 01/30/2023] Open
Abstract
Wearable inertial sensors are providing enhanced insight into patient mobility and health. Significant research efforts have focused on wearable algorithm design and deployment in both research and clinical settings; however, open-source, general-purpose software tools for processing various activities of daily living are relatively scarce. Furthermore, few studies include code for replication or off-the-shelf software packages. In this work, we introduce SciKit Digital Health (SKDH), a Python software package (Python Software Foundation) containing various algorithms for deriving clinical features of gait, sit to stand, physical activity, and sleep, wrapped in an easily extensible framework. SKDH combines data ingestion, preprocessing, and data analysis methods geared toward modern data science workflows and streamlines the generation of digital endpoints in “good practice” environments by combining all the necessary data processing steps in a single pipeline. Our package simplifies the construction of new data processing pipelines and promotes reproducibility by following a convention over configuration approach, standardizing most settings on physiologically reasonable defaults in healthy adult populations or those with mild impairment. SKDH is open source, as well as free to use and extend under a permissive Massachusetts Institute of Technology license, and is available from GitHub (PfizerRD/scikit-digital-health), the Python Package Index, and the conda-forge channel of Anaconda.
Collapse
Affiliation(s)
- Lukas Adamowicz
- Digital Medicine and Translational Imaging, Pfizer Inc, Cambridge, MA, United States
| | - Yiorgos Christakis
- Digital Medicine and Translational Imaging, Pfizer Inc, Cambridge, MA, United States
| | - Matthew D Czech
- Digital Medicine and Translational Imaging, Pfizer Inc, Cambridge, MA, United States
| | - Tomasz Adamusiak
- Digital Medicine and Translational Imaging, Pfizer Inc, Cambridge, MA, United States
| |
Collapse
|
2
|
Dasgupta P, VanSwearingen J, Godfrey A, Redfern M, Montero-Odasso M, Sejdic E. Acceleration Gait Measures as Proxies for Motor Skill of Walking: A Narrative Review. IEEE Trans Neural Syst Rehabil Eng 2021; 29:249-261. [PMID: 33315570 PMCID: PMC7995554 DOI: 10.1109/tnsre.2020.3044260] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2023]
Abstract
In adults 65 years or older, falls or other neuromotor dysfunctions are often framed as walking-related declines in motor skill; the frequent occurrence of such decline in walking-related motor skill motivates the need for an improved understanding of the motor skill of walking. Simple gait measurements, such as speed, do not provide adequate information about the quality of the body motion's translation during walking. Gait measures from accelerometers can enrich measurements of walking and motor performance. This review article will categorize the aspects of the motor skill of walking and review how trunk-acceleration gait measures during walking can be mapped to motor skill aspects, satisfying a clinical need to understand how well accelerometer measures assess gait. We will clarify how to leverage more complicated acceleration measures to make accurate motor skill decline predictions, thus furthering fall research in older adults.
Collapse
|
3
|
Di Nardo F, Morbidoni C, Cucchiarelli A, Fioretti S. Influence of EMG-signal processing and experimental set-up on prediction of gait events by neural network. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102232] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
4
|
Test-Retest Reliability and the Effects of Walking Speed on Stride Time Variability During Continuous, Overground Walking in Healthy Young Adults. J Appl Biomech 2020; 37:102-108. [PMID: 33361489 DOI: 10.1123/jab.2020-0138] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2020] [Revised: 08/24/2020] [Accepted: 09/29/2020] [Indexed: 11/18/2022]
Abstract
Studies have investigated the reliability and effect of walking speed on stride time variability during walking trials performed on a treadmill. The objective of this study was to investigate the reliability of stride time variability and the effect of walking speed on stride time variability, during continuous, overground walking in healthy young adults. Participants completed: (1) 2 walking trials at their preferred walking speed on 1 day and another trial 2 to 4 days later and (2) 1 trial at their preferred walking speed, 1 trial approximately 20% to 25% faster than their preferred walking speed, and 1 trial approximately 20% to 25% slower than their preferred walking speed on a separate day. Data from a waist-mounted accelerometer were used to determine the consecutive stride times for each trial. The reliability of stride time variability outcomes was generally poor (intraclass correlations: .167-.487). Although some significant differences in stride time variability were found between the preferred walking speed, fast, and slow trials, individual between-trial differences were generally below the estimated minimum difference considered to be a real difference. The development of a protocol to improve the reliability of stride time variability outcomes during continuous, overground walking would be beneficial to improve their application in research and clinical settings.
Collapse
|
5
|
Dong R, Cai D, Ikuno S. Motion Capture Data Analysis in the Instantaneous Frequency-Domain Using Hilbert-Huang Transform. SENSORS (BASEL, SWITZERLAND) 2020; 20:E6534. [PMID: 33207544 PMCID: PMC7698183 DOI: 10.3390/s20226534] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/10/2020] [Revised: 11/11/2020] [Accepted: 11/13/2020] [Indexed: 12/24/2022]
Abstract
Motion capture data are widely used in different research fields such as medical, entertainment, and industry. However, most motion researches using motion capture data are carried out in the time-domain. To understand human motion complexities, it is necessary to analyze motion data in the frequency-domain. In this paper, to analyze human motions, we present a framework to transform motions into the instantaneous frequency-domain using the Hilbert-Huang transform (HHT). The empirical mode decomposition (EMD) that is a part of HHT decomposes nonstationary and nonlinear signals captured from the real-world experiments into pseudo monochromatic signals, so-called intrinsic mode function (IMF). Our research reveals that the multivariate EMD can decompose complicated human motions into a finite number of nonlinear modes (IMFs) corresponding to distinct motion primitives. Analyzing these decomposed motions in Hilbert spectrum, motion characteristics can be extracted and visualized in instantaneous frequency-domain. For example, we apply our framework to (1) a jump motion, (2) a foot-injured gait, and (3) a golf swing motion.
Collapse
Affiliation(s)
- Ran Dong
- School of Computer Science, Tokyo University of Technology, Tokyo 192-0982, Japan;
| | - Dongsheng Cai
- Faculty of Engineering, Information and Systems, University of Tsukuba, Ibaraki 305-8577, Japan;
| | - Soichiro Ikuno
- School of Computer Science, Tokyo University of Technology, Tokyo 192-0982, Japan;
| |
Collapse
|
6
|
Di Nardo F, Morbidoni C, Mascia G, Verdini F, Fioretti S. Intra-subject approach for gait-event prediction by neural network interpretation of EMG signals. Biomed Eng Online 2020; 19:58. [PMID: 32723335 PMCID: PMC7389432 DOI: 10.1186/s12938-020-00803-1] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2020] [Accepted: 07/20/2020] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Machine learning models were satisfactorily implemented for estimating gait events from surface electromyographic (sEMG) signals during walking. Most of them are based on inter-subject approaches for data preparation. Aim of the study is to propose an intra-subject approach for binary classifying gait phases and predicting gait events based on neural network interpretation of sEMG signals and to test the hypothesis that the intra-subject approach is able to achieve better performances compared to an inter-subject one. To this aim, sEMG signals were acquired from 10 leg muscles in about 10.000 strides from 23 healthy adults, during ground walking, and a multi-layer perceptron (MLP) architecture was implemented. RESULTS Classification/prediction accuracy was tested vs. the ground truth, represented by the foot-floor-contact signal provided by three foot-switches, through samples not used during training phase. Average classification accuracy of 96.1 ± 1.9% and mean absolute value (MAE) of 14.4 ± 4.7 ms and 23.7 ± 11.3 ms in predicting heel-strike (HS) and toe-off (TO) timing were provided. Performances of the proposed approach were tested by a direct comparison with performances provided by the inter-subject approach in the same population. Comparison results showed 1.4% improvement of mean classification accuracy and a significant (p < 0.05) decrease of MAE in predicting HS and TO timing (23% and 33% reduction, respectively). CONCLUSIONS The study developed an accurate methodology for classification and prediction of gait events, based on neural network interpretation of intra-subject sEMG data, able to outperform more typical inter-subject approaches. The clinically useful contribution consists in predicting gait events from only EMG signals from a single subject, contributing to remove the need of further sensors for the direct measurement of temporal data.
Collapse
Affiliation(s)
- Francesco Di Nardo
- Department of Information Engineering, Università Politecnica delle Marche, via Brecce Bianche, 60131, Ancona, Italy.
| | - Christian Morbidoni
- Department of Information Engineering, Università Politecnica delle Marche, via Brecce Bianche, 60131, Ancona, Italy
| | - Guido Mascia
- Laboratory of Bioengineering and Neuromechanics of Movement, University of Rome "Foro Italico", P.zza Lauro de Bosis 6, 00135, Rome, Italy
| | - Federica Verdini
- Department of Information Engineering, Università Politecnica delle Marche, via Brecce Bianche, 60131, Ancona, Italy
| | - Sandro Fioretti
- Department of Information Engineering, Università Politecnica delle Marche, via Brecce Bianche, 60131, Ancona, Italy
| |
Collapse
|
7
|
Lordall J, Bruno P, Ryan N. Assessment of diurnal variation of stride time variability during continuous, overground walking in healthy young adults. Gait Posture 2020; 79:108-110. [PMID: 32387809 DOI: 10.1016/j.gaitpost.2020.04.024] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/25/2019] [Revised: 04/22/2020] [Accepted: 04/24/2020] [Indexed: 02/02/2023]
Abstract
BACKGROUND There is emerging evidence that gait variability outcomes provide unique insights regarding the status of an individual's locomotor control system; however, there is currently limited evidence on the within-day reliability of stride time variability (STV) outcomes, or whether they demonstrate diurnal variation, when measured during continuous, overground walking in healthy young adults. RESEARCH QUESTIONS 1) Are STV outcomes measured in the morning and afternoon during continuous, overground walking significantly different in healthy young adults? 2) What is the within-day reliability of STV outcomes measured during continuous, overground walking in healthy young adults?. METHODS Thirty-one healthy young adults (20.8 ± 3.7 years) completed two 10-minute continuous, overground walking trials on the same day (9:00-11:00am and 3:00-5:00pm) at their preferred walking speed. Data from a waist-mounted tri-axial accelerometer were used to determine the series of consecutive stride times for each trial. RESULTS There were no significant differences between sessions for average walking speed, average stride time, or STV. The within-day reliability was excellent for average walking speed and stride time, and generally poor to fair for STV. SIGNIFICANCE Healthy young adults do not appear to demonstrate diurnal variation in STV outcomes during continuous, overground walking; however, the development of a protocol to improve their reliability, as well as the establishment of normative ranges for such outcomes, would be beneficial to improve their application and interpretation in research and clinical settings.
Collapse
Affiliation(s)
- Jackson Lordall
- College of Kinesiology, University of Saskatchewan, Saskatoon, SK, Canada
| | - Paul Bruno
- Faculty of Kinesiology and Health Studies, University of Regina, Regina, SK, Canada.
| | - Nicholas Ryan
- Faculty of Kinesiology and Health Studies, University of Regina, Regina, SK, Canada
| |
Collapse
|
8
|
Sapone M, Martin P, Ben Mansour K, Château H, Marin F. Comparison of Trotting Stance Detection Methods from an Inertial Measurement Unit Mounted on the Horse's Limb. SENSORS 2020; 20:s20102983. [PMID: 32466104 PMCID: PMC7288211 DOI: 10.3390/s20102983] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/10/2020] [Revised: 05/14/2020] [Accepted: 05/22/2020] [Indexed: 11/16/2022]
Abstract
The development of on-board sensors, such as inertial measurement units (IMU), has made it possible to develop new methods for analyzing horse locomotion to detect lameness. The detection of spatiotemporal events is one of the keystones in the analysis of horse locomotion. This study assesses the performance of four methods for detecting Foot on and Foot off events. They were developed from an IMU positioned on the canon bone of eight horses during trotting recording on a treadmill and compared to a standard gold method based on motion capture. These methods are based on accelerometer and gyroscope data and use either thresholding or wavelets to detect stride events. The two methods developed from gyroscopic data showed more precision than those developed from accelerometric data with a bias less than 0.6% of stride duration for Foot on and 0.1% of stride duration for Foot off. The gyroscope is less impacted by the different patterns of strides, specific to each horse. To conclude, methods using the gyroscope present the potential of further developments to investigate the effects of different gait paces and ground types in the analysis of horse locomotion.
Collapse
Affiliation(s)
- Marie Sapone
- Université de Technologie de Compiègne, Alliance Sorbonne Université, UMR CNRS 7338 BioMécanique et BioIngénierie, 60200 Compiègne, France; (K.B.M.) ; (F.M.)
- Ecole Nationale Vétérinaire d’Alfort, USC INRAE-ENVA 957 BPLC, CWD-VetLab, 94700 Maisons-Alfort, France; (P.M.) ; (H.C.)
- LIM France, Chemin Fontaine de Fanny, 24300 Nontron, France
- Correspondence:
| | - Pauline Martin
- Ecole Nationale Vétérinaire d’Alfort, USC INRAE-ENVA 957 BPLC, CWD-VetLab, 94700 Maisons-Alfort, France; (P.M.) ; (H.C.)
- LIM France, Chemin Fontaine de Fanny, 24300 Nontron, France
| | - Khalil Ben Mansour
- Université de Technologie de Compiègne, Alliance Sorbonne Université, UMR CNRS 7338 BioMécanique et BioIngénierie, 60200 Compiègne, France; (K.B.M.) ; (F.M.)
| | - Henry Château
- Ecole Nationale Vétérinaire d’Alfort, USC INRAE-ENVA 957 BPLC, CWD-VetLab, 94700 Maisons-Alfort, France; (P.M.) ; (H.C.)
| | - Frédéric Marin
- Université de Technologie de Compiègne, Alliance Sorbonne Université, UMR CNRS 7338 BioMécanique et BioIngénierie, 60200 Compiègne, France; (K.B.M.) ; (F.M.)
| |
Collapse
|
9
|
Dot T, Quijoux F, Oudre L, Vienne-Jumeau A, Moreau A, Vidal PP, Ricard D. Non-Linear Template-Based Approach for the Study of Locomotion. SENSORS 2020; 20:s20071939. [PMID: 32235667 PMCID: PMC7180476 DOI: 10.3390/s20071939] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/24/2020] [Revised: 03/17/2020] [Accepted: 03/26/2020] [Indexed: 12/25/2022]
Abstract
The automatic detection of gait events (i.e., Initial Contact (IC) and Final Contact (FC)) is crucial for the characterisation of gait from Inertial Measurements Units. In this article, we present a method for detecting steps (i.e., IC and FC) from signals of gait sequences of individuals recorded with a gyrometer. The proposed approach combines the use of a dictionary of templates and a Dynamic Time Warping (DTW) measure of fit to retrieve these templates into input signals. Several strategies for choosing and learning the adequate templates from annotated data are also described. The method is tested on thirteen healthy subjects and compared to gold standard. Depending of the template choice, the proposed algorithm achieves average errors from 0.01 to 0.03 s for the detection of IC, FC and step duration. Results demonstrate that the use of DTW allows achieving these performances with only one single template. DTW is a convenient tool to perform pattern recognition on gait gyrometer signals. This study paves the way for new step detection methods: it shows that using one single template associated with non-linear deformations may be sufficient to model the gait of healthy subjects.
Collapse
Affiliation(s)
- Tristan Dot
- Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, F-94235 Cachan, France
- Université de Paris, CNRS, Centre Borelli, F-75005 Paris, France
| | - Flavien Quijoux
- Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, F-94235 Cachan, France
- Université de Paris, CNRS, Centre Borelli, F-75005 Paris, France
- ORPEA Group, F-92813 Puteaux, France
| | - Laurent Oudre
- Université Sorbonne Paris Nord, L2TI, UR 3043, F-93430 Villetaneuse, France
- Correspondence: ; Tel.: +33-1-49-40-40-63
| | - Aliénor Vienne-Jumeau
- Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, F-94235 Cachan, France
- Université de Paris, CNRS, Centre Borelli, F-75005 Paris, France
| | - Albane Moreau
- Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, F-94235 Cachan, France
- Université de Paris, CNRS, Centre Borelli, F-75005 Paris, France
- Service de Neurologie, Service de Santé des Armées, Hôpital d’Instruction des Armées Percy, F-92190 Clamart, France
| | - Pierre-Paul Vidal
- Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, F-94235 Cachan, France
- Université de Paris, CNRS, Centre Borelli, F-75005 Paris, France
- Hangzhou Dianzi University, Hangzhou C-310005, China
| | - Damien Ricard
- Université Paris-Saclay, ENS Paris-Saclay, CNRS, Centre Borelli, F-94235 Cachan, France
- Université de Paris, CNRS, Centre Borelli, F-75005 Paris, France
- Service de Neurologie, Service de Santé des Armées, Hôpital d’Instruction des Armées Percy, F-92190 Clamart, France
- Ecole du Val-de-Grâce, Ecole de Santé des Armées, F-75005 Paris, France
| |
Collapse
|
10
|
Gohar I, Riaz Q, Shahzad M, Zeeshan Ul Hasnain Hashmi M, Tahir H, Ehsan Ul Haq M. Person Re-Identification Using Deep Modeling of Temporally Correlated Inertial Motion Patterns. SENSORS 2020; 20:s20030949. [PMID: 32050728 PMCID: PMC7039239 DOI: 10.3390/s20030949] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2020] [Revised: 02/03/2020] [Accepted: 02/06/2020] [Indexed: 11/17/2022]
Abstract
Person re-identification (re-ID) is among the essential components that play an integral role in constituting an automated surveillance environment. Majorly, the problem is tackled using data acquired from vision sensors using appearance-based features, which are strongly dependent on visual cues such as color, texture, etc., consequently limiting the precise re-identification of an individual. To overcome such strong dependence on visual features, many researchers have tackled the re-identification problem using human gait, which is believed to be unique and provide a distinctive biometric signature that is particularly suitable for re-ID in uncontrolled environments. However, image-based gait analysis often fails to extract quality measurements of an individual’s motion patterns owing to problems related to variations in viewpoint, illumination (daylight), clothing, worn accessories, etc. To this end, in contrast to relying on image-based motion measurement, this paper demonstrates the potential to re-identify an individual using inertial measurements units (IMU) based on two common sensors, namely gyroscope and accelerometer. The experiment was carried out over data acquired using smartphones and wearable IMUs from a total of 86 randomly selected individuals including 49 males and 37 females between the ages of 17 and 72 years. The data signals were first segmented into single steps and strides, which were separately fed to train a sequential deep recurrent neural network to capture implicit arbitrary long-term temporal dependencies. The experimental setup was devised in a fashion to train the network on all the subjects using data related to half of the step and stride sequences only while the inference was performed on the remaining half for the purpose of re-identification. The obtained experimental results demonstrate the potential to reliably and accurately re-identify an individual based on one’s inertial sensor data.
Collapse
Affiliation(s)
- Imad Gohar
- Department of Computing, School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (I.G.); (M.S.); (M.Z.U.H.H.); (H.T.); (M.E.U.H.)
- The College of Optoelectronic Engineering, Shenzhen University, Shenzhen 518060, China
| | - Qaiser Riaz
- Department of Computing, School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (I.G.); (M.S.); (M.Z.U.H.H.); (H.T.); (M.E.U.H.)
- Correspondence:
| | - Muhammad Shahzad
- Department of Computing, School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (I.G.); (M.S.); (M.Z.U.H.H.); (H.T.); (M.E.U.H.)
| | - Muhammad Zeeshan Ul Hasnain Hashmi
- Department of Computing, School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (I.G.); (M.S.); (M.Z.U.H.H.); (H.T.); (M.E.U.H.)
| | - Hasan Tahir
- Department of Computing, School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (I.G.); (M.S.); (M.Z.U.H.H.); (H.T.); (M.E.U.H.)
| | - Muhammad Ehsan Ul Haq
- Department of Computing, School of Electrical Engineering and Computer Science, National University of Sciences and Technology (NUST), Islamabad 44000, Pakistan; (I.G.); (M.S.); (M.Z.U.H.H.); (H.T.); (M.E.U.H.)
| |
Collapse
|