1
|
Huang P, Mostovov A, Cohen R, Cadilhac C, Pionnier R. Comparison of feetme insoles with a motion capture system coupled to force plates for assessing gait and posture. Sci Rep 2025; 15:13476. [PMID: 40251254 PMCID: PMC12008406 DOI: 10.1038/s41598-025-96878-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2024] [Accepted: 04/01/2025] [Indexed: 04/20/2025] Open
Abstract
Traditional gait measurement systems are often limited by factors such as cost, complexity, prolonged setup times, and requirements for specialized training and expertise. Wearable pressure- and motion-sensing insoles have opened new possibilities for accessible gait analysis in real-life conditions. This study evaluated the equivalence of FeetMe insole measurements of gait parameters to those of a laboratory gold standard, optoelectronic motion capture system coupled to force platforms (MoCap/FP). Gait and posture parameters were assessed in 37 healthy adults by FeetMe insoles and by MoCap/FP system simultaneously. Means and variances were compared, and inter-device agreement was assessed for each parameter. Between-device equivalence was demonstrated for all parameters assessed (two one-sided t tests: P < .001). For static parameters, six of 13 variables presented excellent interclass correlation coefficients (ICCs ≥ 0.90) and three had good ICCs (≥ 0.75 to < 0.90). Moreover, 10 of 11 spatiotemporal parameters showed excellent accuracy (ICCs ≥ 0.90), and three of four kinetic parameters showed moderate-to-good accuracy (ICCs between 0.78 and 0.89). In summary, FeetMe can be considered as a valid gait measurement tool compared to the high precision MoCap/FP system and could be used in clinical practice to assess a wide range of gait and posture parameters, overcoming some limitations of traditional systems.
Collapse
Affiliation(s)
- Piao Huang
- FeetMe SAS, 157 boulevard Macdonald, 75019, Paris, France
| | | | - Raphaël Cohen
- FeetMe SAS, 157 boulevard Macdonald, 75019, Paris, France
| | - Céline Cadilhac
- Hôpitaux Paris-Est Val de Marne, Unité Fonctionnelle d'Analyse du Mouvement (UFAM), 14 rue du Val d'Osne, 94410, Saint-Maurice, France
| | - Raphaël Pionnier
- Hôpitaux Paris-Est Val de Marne, Unité Fonctionnelle d'Analyse du Mouvement (UFAM), 14 rue du Val d'Osne, 94410, Saint-Maurice, France.
- Service de Médecine Physique et de Réadaptation, CHU de Nîmes, 4 rue du Professeur Robert Debré, 30900, Nîmes, France.
| |
Collapse
|
2
|
Caroppo A, Manni A, Rescio G, Carluccio AM, Siciliano PA, Leone A. Movement Disorders and Smart Wrist Devices: A Comprehensive Study. SENSORS (BASEL, SWITZERLAND) 2025; 25:266. [PMID: 39797057 PMCID: PMC11723440 DOI: 10.3390/s25010266] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/20/2024] [Revised: 12/27/2024] [Accepted: 01/03/2025] [Indexed: 01/13/2025]
Abstract
In the medical field, there are several very different movement disorders, such as tremors, Parkinson's disease, or Huntington's disease. A wide range of motor and non-motor symptoms characterizes them. It is evident that in the modern era, the use of smart wrist devices, such as smartwatches, wristbands, and smart bracelets is spreading among all categories of people. This diffusion is justified by the limited costs, ease of use, and less invasiveness (and consequently greater acceptability) than other types of sensors used for health status monitoring. This systematic review aims to synthesize research studies using smart wrist devices for a specific class of movement disorders. Following PRISMA-S guidelines, 130 studies were selected and analyzed. For each selected study, information is provided relating to the smartwatch/wristband/bracelet model used (whether it is commercial or not), the number of end-users involved in the experimentation stage, and finally the characteristics of the benchmark dataset possibly used for testing. Moreover, some articles also reported the type of raw data extracted from the smart wrist device, the implemented designed algorithmic pipeline, and the data classification methodology. It turned out that most of the studies have been published in the last ten years, showing a growing interest in the scientific community. The selected articles mainly investigate the relationship between smart wrist devices and Parkinson's disease. Epilepsy and seizure detection are also research topics of interest, while there are few papers analyzing gait disorders, Huntington's Disease, ataxia, or Tourette Syndrome. However, the results of this review highlight the difficulties still present in the use of the smartwatch/wristband/bracelet for the identified categories of movement disorders, despite the advantages these technologies could bring in the dissemination of low-cost solutions usable directly within living environments and without the need for caregivers or medical personnel.
Collapse
Affiliation(s)
- Andrea Caroppo
- National Research Council of Italy, Institute for Microelectronics and Microsystems, 73100 Lecce, Italy; (G.R.); (A.M.C.); (P.A.S.); (A.L.)
| | - Andrea Manni
- National Research Council of Italy, Institute for Microelectronics and Microsystems, 73100 Lecce, Italy; (G.R.); (A.M.C.); (P.A.S.); (A.L.)
| | | | | | | | | |
Collapse
|
3
|
Crowe C, Sica M, Kenny L, O'Flynn B, Scott Mueller D, Timmons S, Barton J, Tedesco S. Wearable-Enabled Algorithms for the Estimation of Parkinson's Symptoms Evaluated in a Continuous Home Monitoring Setting Using Inertial Sensors. IEEE Trans Neural Syst Rehabil Eng 2024; 32:3828-3836. [PMID: 39383074 DOI: 10.1109/tnsre.2024.3477003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/11/2024]
Abstract
Motor symptoms such as tremor and bradykinesia can develop concurrently in Parkinson's disease; thus, the ideal home monitoring system should be capable of tracking symptoms continuously despite background noise from daily activities. The goal of this study is to demonstrate the feasibility of detecting symptom episodes in a free-living scenario, providing a higher level of interpretability to aid AI-powered decision-making. Machine learning models trained on wearable sensor data from scripted activities performed by participants in the lab and clinician ratings of the video recordings of these tasks identified tremor, bradykinesia, and dyskinesia in the supervised lab environment with a balanced accuracy of 83%, 75%, and 81%, respectively, when compared to the clinician ratings. The performance of the same models when evaluated on data from subjects performing unscripted activities unsupervised in their own homes achieved a balanced accuracy of 63%, 63%, and 67%, respectively, in comparison to self-assessment patient diaries, further highlighting their limitations. The ankle-worn sensor was found to be advantageous for the detection of dyskinesias but did not show an added benefit for tremor and bradykinesia detection here.
Collapse
|
4
|
Sapienza S, Tsurkalenko O, Giraitis M, Mejia AC, Zelimkhanov G, Schwaninger I, Klucken J. Assessing the clinical utility of inertial sensors for home monitoring in Parkinson's disease: a comprehensive review. NPJ Parkinsons Dis 2024; 10:161. [PMID: 39164257 PMCID: PMC11335938 DOI: 10.1038/s41531-024-00755-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 07/24/2024] [Indexed: 08/22/2024] Open
Abstract
This review screened 296 articles on wearable sensors for home monitoring of people with Parkinson's Disease within the PubMed Database, from January 2017 to May 2023. A three-level maturity framework was applied for classifying the aims of 59 studies included: demonstrating technical efficacy, diagnostic sensitivity, or clinical utility. As secondary analysis, user experience (usability and patient adherence) was evaluated. The evidences provided by the studies were categorized and stratified according to the level of maturity. Our results indicate that approximately 75% of articles investigated diagnostic sensitivity, i.e. correlation of sensor-data with clinical parameters. Evidence of clinical utility, defined as improvement on health outcomes or clinical decisions after the use of the wearables, was found only in nine papers. A third of the articles included reported evidence of user experience. Future research should focus more on clinical utility, to facilitate the translation of research results within the management of Parkinson's Disease.
Collapse
Affiliation(s)
- Stefano Sapienza
- Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg
- Luxembourg Institute of Health (LIH), Strassen, Luxembourg
| | - Olena Tsurkalenko
- Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg
- Luxembourg Institute of Health (LIH), Strassen, Luxembourg
- Centre Hospitalier de Luxembourg (CHL), Rollengergronn-belair-nord, Luxembourg
| | - Marijus Giraitis
- Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg
- Luxembourg Institute of Health (LIH), Strassen, Luxembourg
- Centre Hospitalier de Luxembourg (CHL), Rollengergronn-belair-nord, Luxembourg
| | - Alan Castro Mejia
- Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg
- Luxembourg Institute of Health (LIH), Strassen, Luxembourg
| | - Gelani Zelimkhanov
- Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg
- Luxembourg Institute of Health (LIH), Strassen, Luxembourg
- Centre Hospitalier de Luxembourg (CHL), Rollengergronn-belair-nord, Luxembourg
| | - Isabel Schwaninger
- Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg
- Luxembourg Institute of Health (LIH), Strassen, Luxembourg
| | - Jochen Klucken
- Luxembourg Centre for Systems Biomedicine (LCSB), University of Luxembourg, Esch-sur-Alzette, Luxembourg.
- Luxembourg Institute of Health (LIH), Strassen, Luxembourg.
- Centre Hospitalier de Luxembourg (CHL), Rollengergronn-belair-nord, Luxembourg.
| |
Collapse
|
5
|
Li P, van Wezel R, He F, Zhao Y, Wang Y. The role of wrist-worn technology in the management of Parkinson's disease in daily life: A narrative review. Front Neuroinform 2023; 17:1135300. [PMID: 37124068 PMCID: PMC10130445 DOI: 10.3389/fninf.2023.1135300] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 03/28/2023] [Indexed: 05/02/2023] Open
Abstract
Parkinson's disease (PD) is a neurodegenerative disorder that affects millions of people worldwide. Its slow and heterogeneous progression over time makes timely diagnosis challenging. Wrist-worn digital devices, particularly smartwatches, are currently the most popular tools in the PD research field due to their convenience for long-term daily life monitoring. While wrist-worn sensing devices have garnered significant interest, their value for daily practice is still unclear. In this narrative review, we survey demographic, clinical and technological information from 39 articles across four public databases. Wrist-worn technology mainly monitors motor symptoms and sleep disorders of patients in daily life. We find that accelerometers are the most commonly used sensors to measure the movement of people living with PD. There are few studies on monitoring the disease progression compared to symptom classification. We conclude that wrist-worn sensing technology might be useful to assist in the management of PD through an automatic assessment based on patient-provided daily living information.
Collapse
Affiliation(s)
- Peng Li
- Biomedical Signals and Systems (BSS) Group, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, Netherlands
- Department of Biophysics, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
- *Correspondence: Peng Li,
| | - Richard van Wezel
- Biomedical Signals and Systems (BSS) Group, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, Netherlands
- Department of Biophysics, Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, Netherlands
| | - Fei He
- Centre for Computational Science and Mathematical Modelling, Coventry University, Coventry, United Kingdom
| | - Yifan Zhao
- School of Aerospace, Transport and Manufacturing, Cranfield University, Cranfield, United Kingdom
| | - Ying Wang
- Biomedical Signals and Systems (BSS) Group, Faculty of Electrical Engineering, Mathematics and Computer Science (EEMCS), University of Twente, Enschede, Netherlands
| |
Collapse
|
6
|
Guo CC, Chiesa PA, de Moor C, Fazeli MS, Schofield T, Hofer K, Belachew S, Scotland A. Digital Devices for Assessing Motor Functions in Mobility-Impaired and Healthy Populations: Systematic Literature Review. J Med Internet Res 2022; 24:e37683. [DOI: 10.2196/37683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 07/18/2022] [Accepted: 10/11/2022] [Indexed: 11/22/2022] Open
Abstract
Background
With the advent of smart sensing technology, mobile and wearable devices can provide continuous and objective monitoring and assessment of motor function outcomes.
Objective
We aimed to describe the existing scientific literature on wearable and mobile technologies that are being used or tested for assessing motor functions in mobility-impaired and healthy adults and to evaluate the degree to which these devices provide clinically valid measures of motor function in these populations.
Methods
A systematic literature review was conducted by searching Embase, MEDLINE, CENTRAL (January 1, 2015, to June 24, 2020), the United States and European Union clinical trial registries, and the United States Food and Drug Administration website using predefined study selection criteria. Study selection, data extraction, and quality assessment were performed by 2 independent reviewers.
Results
A total of 91 publications representing 87 unique studies were included. The most represented clinical conditions were Parkinson disease (n=51 studies), followed by stroke (n=5), Huntington disease (n=5), and multiple sclerosis (n=2). A total of 42 motion-detecting devices were identified, and the majority (n=27, 64%) were created for the purpose of health care–related data collection, although approximately 25% were personal electronic devices (eg, smartphones and watches) and 11% were entertainment consoles (eg, Microsoft Kinect or Xbox and Nintendo Wii). The primary motion outcomes were related to gait (n=30), gross motor movements (n=25), and fine motor movements (n=23). As a group, sensor-derived motion data showed a mean sensitivity of 0.83 (SD 7.27), a mean specificity of 0.84 (SD 15.40), a mean accuracy of 0.90 (SD 5.87) in discriminating between diseased individuals and healthy controls, and a mean Pearson r validity coefficient of 0.52 (SD 0.22) relative to clinical measures. We did not find significant differences in the degree of validity between in-laboratory and at-home sensor-based assessments nor between device class (ie, health care–related device, personal electronic devices, and entertainment consoles).
Conclusions
Sensor-derived motion data can be leveraged to classify and quantify disease status for a variety of neurological conditions. However, most of the recent research on digital clinical measures is derived from proof-of-concept studies with considerable variation in methodological approaches, and much of the reviewed literature has focused on clinical validation, with less than one-quarter of the studies performing analytical validation. Overall, future research is crucially needed to further consolidate that sensor-derived motion data may lead to the development of robust and transformative digital measurements intended to predict, diagnose, and quantify neurological disease state and its longitudinal change.
Collapse
|
7
|
di Biase L, Tinkhauser G, Martin Moraud E, Caminiti ML, Pecoraro PM, Di Lazzaro V. Adaptive, personalized closed-loop therapy for Parkinson's disease: biochemical, neurophysiological, and wearable sensing systems. Expert Rev Neurother 2021; 21:1371-1388. [PMID: 34736368 DOI: 10.1080/14737175.2021.2000392] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/31/2022]
Abstract
INTRODUCTION Motor complication management is one of the main unmet needs in Parkinson's disease patients. AREAS COVERED Among the most promising emerging approaches for handling motor complications in Parkinson's disease, adaptive deep brain stimulation strategies operating in closed-loop have emerged as pivotal to deliver sustained, near-to-physiological inputs to dysfunctional basal ganglia-cortical circuits over time. Existing sensing systems that can provide feedback signals to close the loop include biochemical-, neurophysiological- or wearable-sensors. Biochemical sensing allows to directly monitor the pharmacokinetic and pharmacodynamic of antiparkinsonian drugs and metabolites. Neurophysiological sensing relies on neurotechnologies to sense cortical or subcortical brain activity and extract real-time correlates of symptom intensity or symptom control during DBS. A more direct representation of the symptom state, particularly the phenomenological differentiation and quantification of motor symptoms, can be realized via wearable sensor technology. EXPERT OPINION Biochemical, neurophysiologic, and wearable-based biomarkers are promising technological tools that either individually or in combination could guide adaptive therapy for Parkinson's disease motor symptoms in the future.
Collapse
Affiliation(s)
- Lazzaro di Biase
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico Di Roma, Rome, Italy.,Brain Innovations Lab, Università Campus Bio-Medico Di Roma, Rome, Italy
| | - Gerd Tinkhauser
- Department of Neurology, Bern University Hospital and University of Bern, Bern, Switzerland
| | - Eduardo Martin Moraud
- Department of Clinical Neurosciences, Lausanne University Hospital (Chuv) and University of Lausanne (Unil), Lausanne, Switzerland.,Defitech Center for Interventional Neurotherapies (.neurorestore), Lausanne University Hospital and Swiss Federal Institute of Technology (Epfl), Lausanne, Switzerland
| | - Maria Letizia Caminiti
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico Di Roma, Rome, Italy
| | - Pasquale Maria Pecoraro
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico Di Roma, Rome, Italy
| | - Vincenzo Di Lazzaro
- Unit of Neurology, Neurophysiology, Neurobiology, Department of Medicine, Università Campus Bio-Medico Di Roma, Rome, Italy
| |
Collapse
|
8
|
Jacobs D, Farid L, Ferré S, Herraez K, Gracies JM, Hutin E. Evaluation of the Validity and Reliability of Connected Insoles to Measure Gait Parameters in Healthy Adults. SENSORS 2021; 21:s21196543. [PMID: 34640868 PMCID: PMC8512009 DOI: 10.3390/s21196543] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/30/2021] [Revised: 09/21/2021] [Accepted: 09/23/2021] [Indexed: 11/16/2022]
Abstract
The continuous, accurate and reliable estimation of gait parameters as a measure of mobility is essential to assess the loss of functional capacity related to the progression of disease. Connected insoles are suitable wearable devices which allow precise, continuous, remote and passive gait assessment. The data of 25 healthy volunteers aged 20 to 77 years were analysed in the study to validate gait parameters (stride length, velocity, stance, swing, step and single support durations and cadence) measured by FeetMe® insoles against the GAITRite® mat reference. The mean values and the values of variability were calculated per subject for GAITRite® and insoles. A t-test and Levene’s test were used to compare the gait parameters for means and variances, respectively, obtained for both devices. Additionally, measures of bias, standard deviation of differences, Pearson’s correlation and intraclass correlation were analysed to explore overall agreement between the two devices. No significant differences in mean and variance between the two devices were detected. Pearson’s correlation coefficients of averaged gait estimates were higher than 0.98 and 0.8, respectively, for unipedal and bipedal gait parameters, supporting a high level of agreement between the two devices. The connected insoles are therefore a device equivalent to GAITRite® to estimate the mean and variability of gait parameters.
Collapse
Affiliation(s)
- Damien Jacobs
- FeetMe S.A.S., 157 bd. MacDonald, 75019 Paris, France; (L.F.); (S.F.)
- Correspondence:
| | - Leila Farid
- FeetMe S.A.S., 157 bd. MacDonald, 75019 Paris, France; (L.F.); (S.F.)
| | - Sabine Ferré
- FeetMe S.A.S., 157 bd. MacDonald, 75019 Paris, France; (L.F.); (S.F.)
| | - Kilian Herraez
- UFR de Mathématiques, Université Pierre et Marie Curie, 75005 Paris, France;
| | - Jean-Michel Gracies
- Laboratoire Analyse et Restauration du Mouvement (ARM), Hôpitaux Universitaires Henri Mondor, Assistance Publique des Hôpitaux de Paris (AP-HP), 94000 Créteil, France; (J.-M.G.); (E.H.)
- EA 7377 Bioingénierie, Tissus et Neuroplasticité (BIOTN), Université Paris-Est Créteil (UPEC), 94000 Créteil, France
| | - Emilie Hutin
- Laboratoire Analyse et Restauration du Mouvement (ARM), Hôpitaux Universitaires Henri Mondor, Assistance Publique des Hôpitaux de Paris (AP-HP), 94000 Créteil, France; (J.-M.G.); (E.H.)
- EA 7377 Bioingénierie, Tissus et Neuroplasticité (BIOTN), Université Paris-Est Créteil (UPEC), 94000 Créteil, France
| |
Collapse
|
9
|
Bhidayasiri R. Will Artificial Intelligence Outperform the Clinical Neurologist in the Near Future? Yes. Mov Disord Clin Pract 2021; 8:525-528. [PMID: 33981785 DOI: 10.1002/mdc3.13202] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2021] [Revised: 02/28/2021] [Accepted: 03/10/2021] [Indexed: 12/11/2022] Open
Affiliation(s)
- Roongroj Bhidayasiri
- Chulalongkorn Centre of Excellence for Parkinson's Disease & Related Disorders, Department of Medicine, Faculty of Medicine Chulalongkorn University and King Chulalongkorn Memorial Hospital Bangkok Thailand.,The Academy of Science The Royal Society of Thailand Bangkok Thailand
| |
Collapse
|
10
|
Hssayeni MD, Jimenez-Shahed J, Burack MA, Ghoraani B. Ensemble deep model for continuous estimation of Unified Parkinson's Disease Rating Scale III. Biomed Eng Online 2021; 20:32. [PMID: 33789666 PMCID: PMC8010504 DOI: 10.1186/s12938-021-00872-w] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Accepted: 03/18/2021] [Indexed: 12/27/2022] Open
Abstract
BACKGROUND Unified Parkinson Disease Rating Scale-part III (UPDRS III) is part of the standard clinical examination performed to track the severity of Parkinson's disease (PD) motor complications. Wearable technologies could be used to reduce the need for on-site clinical examinations of people with Parkinson's disease (PwP) and provide a reliable and continuous estimation of the severity of PD at home. The reported estimation can be used to successfully adjust the dose and interval of PD medications. METHODS We developed a novel algorithm for unobtrusive and continuous UPDRS-III estimation at home using two wearable inertial sensors mounted on the wrist and ankle. We used the ensemble of three deep-learning models to detect UPDRS-III-related patterns from a combination of hand-crafted features, raw temporal signals, and their time-frequency representation. Specifically, we used a dual-channel, Long Short-Term Memory (LSTM) for hand-crafted features, 1D Convolutional Neural Network (CNN)-LSTM for raw signals, and 2D CNN-LSTM for time-frequency data. We utilized transfer learning from activity recognition data and proposed a two-stage training for the CNN-LSTM networks to cope with the limited amount of data. RESULTS The algorithm was evaluated on gyroscope data from 24 PwP as they performed different daily living activities. The estimated UPDRS-III scores had a correlation of [Formula: see text] and a mean absolute error of 5.95 with the clinical examination scores without requiring the patients to perform any specific tasks. CONCLUSION Our analysis demonstrates the potential of our algorithm for estimating PD severity scores unobtrusively at home. Such an algorithm could provide the required motor-complication measurements without unnecessary clinical visits and help the treating physician provide effective management of the disease.
Collapse
Affiliation(s)
- Murtadha D Hssayeni
- Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL, 33431, USA
| | | | - Michelle A Burack
- Department of Neurology, University of Rochester Medical Center, Rochester, NY, USA
| | - Behnaz Ghoraani
- Department of Computer and Electrical Engineering and Computer Science, Florida Atlantic University, Boca Raton, FL, 33431, USA.
| |
Collapse
|
11
|
Cheung VCK, Seki K. Approaches to revealing the neural basis of muscle synergies: a review and a critique. J Neurophysiol 2021; 125:1580-1597. [PMID: 33729869 DOI: 10.1152/jn.00625.2019] [Citation(s) in RCA: 58] [Impact Index Per Article: 14.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023] Open
Abstract
The central nervous system (CNS) may produce coordinated motor outputs via the combination of motor modules representable as muscle synergies. Identification of muscle synergies has hitherto relied on applying factorization algorithms to multimuscle electromyographic data (EMGs) recorded during motor behaviors. Recent studies have attempted to validate the neural basis of the muscle synergies identified by independently retrieving the muscle synergies through CNS manipulations and analytic techniques such as spike-triggered averaging of EMGs. Experimental data have demonstrated the pivotal role of the spinal premotor interneurons in the synergies' organization and the presence of motor cortical loci whose stimulations offer access to the synergies, but whether the motor cortex is also involved in organizing the synergies has remained unsettled. We argue that one difficulty inherent in current approaches to probing the synergies' neural basis is that the EMG generative model based on linear combination of synergies and the decomposition algorithms used for synergy identification are not grounded on enough prior knowledge from neurophysiology. Progress may be facilitated by constraining or updating the model and algorithms with knowledge derived directly from CNS manipulations or recordings. An investigative framework based on evaluating the relevance of neurophysiologically constrained models of muscle synergies to natural motor behaviors will allow a more sophisticated understanding of motor modularity, which will help the community move forward from the current debate on the neural versus nonneural origin of muscle synergies.
Collapse
Affiliation(s)
- Vincent C K Cheung
- School of Biomedical Sciences and The Gerald Choa Neuroscience Centre, The Chinese University of Hong Kong, Hong Kong, China
| | - Kazuhiko Seki
- Department of Neurophysiology, National Institute of Neuroscience, Kodaira, Tokyo, Japan
| |
Collapse
|
12
|
Abrami A, Gunzler S, Kilbane C, Ostrand R, Ho B, Cecchi G. Automated Computer Vision Assessment of Hypomimia in Parkinson Disease: Proof-of-Principle Pilot Study. J Med Internet Res 2021; 23:e21037. [PMID: 33616535 PMCID: PMC7939934 DOI: 10.2196/21037] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2020] [Revised: 07/30/2020] [Accepted: 12/18/2020] [Indexed: 01/30/2023] Open
Abstract
BACKGROUND Facial expressions require the complex coordination of 43 different facial muscles. Parkinson disease (PD) affects facial musculature leading to "hypomimia" or "masked facies." OBJECTIVE We aimed to determine whether modern computer vision techniques can be applied to detect masked facies and quantify drug states in PD. METHODS We trained a convolutional neural network on images extracted from videos of 107 self-identified people with PD, along with 1595 videos of controls, in order to detect PD hypomimia cues. This trained model was applied to clinical interviews of 35 PD patients in their on and off drug motor states, and seven journalist interviews of the actor Alan Alda obtained before and after he was diagnosed with PD. RESULTS The algorithm achieved a test set area under the receiver operating characteristic curve of 0.71 on 54 subjects to detect PD hypomimia, compared to a value of 0.75 for trained neurologists using the United Parkinson Disease Rating Scale-III Facial Expression score. Additionally, the model accuracy to classify the on and off drug states in the clinical samples was 63% (22/35), in contrast to an accuracy of 46% (16/35) when using clinical rater scores. Finally, each of Alan Alda's seven interviews were successfully classified as occurring before (versus after) his diagnosis, with 100% accuracy (7/7). CONCLUSIONS This proof-of-principle pilot study demonstrated that computer vision holds promise as a valuable tool for PD hypomimia and for monitoring a patient's motor state in an objective and noninvasive way, particularly given the increasing importance of telemedicine.
Collapse
Affiliation(s)
- Avner Abrami
- IBM Research - Computational Biology Center, Yorktown Heights, NY, United States
| | - Steven Gunzler
- Parkinson's and Movement Disorders Center, Neurological Institute, University Hospitals Cleveland Medical Center, Cleveland, OH, United States
| | - Camilla Kilbane
- Parkinson's and Movement Disorders Center, Neurological Institute, University Hospitals Cleveland Medical Center, Cleveland, OH, United States
| | - Rachel Ostrand
- IBM Research - Computational Biology Center, Yorktown Heights, NY, United States
| | - Bryan Ho
- Department of Neurology, Tufts Medical Center, Boston, MA, United States
| | - Guillermo Cecchi
- IBM Research - Computational Biology Center, Yorktown Heights, NY, United States
| |
Collapse
|
13
|
Agurto C, Heisig S, Abrami A, Ho BK, Caggiano V. Parkinson's disease medication state and severity assessment based on coordination during walking. PLoS One 2021; 16:e0244842. [PMID: 33596202 PMCID: PMC7888646 DOI: 10.1371/journal.pone.0244842] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Accepted: 12/18/2020] [Indexed: 12/31/2022] Open
Abstract
Walking is a complex motor function requiring coordination of all body parts. Parkinson's disease (PD) motor signs such as rigidity, bradykinesia, and impaired balance affect movements including walking. Here, we propose a computational method to objectively assess the effects of Parkinson's disease pathology on coordination between trunk, shoulder and limbs during the gait cycle to assess medication state and disease severity. Movements during a scripted walking task were extracted from wearable devices placed at six different body locations in participants with PD and healthy participants. Three-axis accelerometer data from each device was synchronized at the beginning of either left or right steps. Canonical templates of movements were then extracted from each body location. Movements projected on those templates created a reduced dimensionality space, where complex movements are represented as discrete values. These projections enabled us to relate the body coordination in people with PD to disease severity. Our results show that the velocity profile of the right wrist and right foot during right steps correlated with the participant's total score on the gold standard Unified Parkinson's Disease Rating Scale (UPRDS) with an r2 up to 0.46. Left-right symmetry of feet, trunk and wrists also correlated with the total UPDRS score with an r2 up to 0.3. In addition, we demonstrate that binary dopamine replacement therapy medication states (self-reported 'ON' or 'OFF') can be discriminated in PD participants. In conclusion, we showed that during walking, the movement of body parts individually and in coordination with one another changes in predictable ways that vary with disease severity and medication state.
Collapse
Affiliation(s)
- Carla Agurto
- IBM Research - Healthcare and Life Sciences, Yorktown Heights, Yorktown, New York, United States of America
| | - Stephen Heisig
- IBM Research - Healthcare and Life Sciences, Yorktown Heights, Yorktown, New York, United States of America
| | - Avner Abrami
- IBM Research - Healthcare and Life Sciences, Yorktown Heights, Yorktown, New York, United States of America
| | - Bryan K. Ho
- Department of Neurology, Boston, Massachusetts, United States of America
| | - Vittorio Caggiano
- IBM Research - Healthcare and Life Sciences, Yorktown Heights, Yorktown, New York, United States of America
| |
Collapse
|
14
|
Moon S, Song HJ, Sharma VD, Lyons KE, Pahwa R, Akinwuntan AE, Devos H. Classification of Parkinson's disease and essential tremor based on balance and gait characteristics from wearable motion sensors via machine learning techniques: a data-driven approach. J Neuroeng Rehabil 2020; 17:125. [PMID: 32917244 PMCID: PMC7488406 DOI: 10.1186/s12984-020-00756-5] [Citation(s) in RCA: 33] [Impact Index Per Article: 6.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Accepted: 09/02/2020] [Indexed: 02/07/2023] Open
Abstract
BACKGROUND Parkinson's disease (PD) and essential tremor (ET) are movement disorders that can have similar clinical characteristics including tremor and gait difficulty. These disorders can be misdiagnosed leading to delay in appropriate treatment. The aim of the study was to determine whether balance and gait variables obtained with wearable inertial motion sensors can be utilized to differentiate between PD and ET using machine learning. Additionally, we compared classification performances of several machine learning models. METHODS This retrospective study included balance and gait variables collected during the instrumented stand and walk test from people with PD (n = 524) and with ET (n = 43). Performance of several machine learning techniques including neural networks, support vector machine, k-nearest neighbor, decision tree, random forest, and gradient boosting, were compared with a dummy model or logistic regression using F1-scores. RESULTS Machine learning models classified PD and ET based on balance and gait characteristics better than the dummy model (F1-score = 0.48) or logistic regression (F1-score = 0.53). The highest F1-score was 0.61 of neural network, followed by 0.59 of gradient boosting, 0.56 of random forest, 0.55 of support vector machine, 0.53 of decision tree, and 0.49 of k-nearest neighbor. CONCLUSIONS This study demonstrated the utility of machine learning models to classify different movement disorders based on balance and gait characteristics collected from wearable sensors. Future studies using a well-balanced data set are needed to confirm the potential clinical utility of machine learning models to discern between PD and ET.
Collapse
Affiliation(s)
- Sanghee Moon
- Department of Physical Therapy, Ithaca College, Ithaca, NY, USA.
- Department of Physical Therapy and Rehabilitation Science, University of Kansas Medical Center, Kansas City, KS, USA.
| | - Hyun-Je Song
- Department of Information Technology, Jeonbuk National University, Jeonju, South Korea
| | - Vibhash D Sharma
- Department of Neurology, University of Kansas Medical Center, Kansas City, KS, USA
| | - Kelly E Lyons
- Department of Neurology, University of Kansas Medical Center, Kansas City, KS, USA
| | - Rajesh Pahwa
- Department of Neurology, University of Kansas Medical Center, Kansas City, KS, USA
| | - Abiodun E Akinwuntan
- Department of Physical Therapy and Rehabilitation Science, University of Kansas Medical Center, Kansas City, KS, USA
- Office of the Dean, School of Health Professions, University of Kansas Medical Center, Kansas City, KS, USA
| | - Hannes Devos
- Department of Physical Therapy and Rehabilitation Science, University of Kansas Medical Center, Kansas City, KS, USA
| |
Collapse
|