1
|
Huang YC, Hong CT, Chi WC, Yen CF, Fang Liao H, Liou TH, Chan L. Deterioration of fine motor skills and functional disability in patients with moderate-to-advanced Parkinson disease: A longitudinal follow-up study. Arch Gerontol Geriatr 2024; 121:105366. [PMID: 38341958 DOI: 10.1016/j.archger.2024.105366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 01/09/2024] [Accepted: 02/05/2024] [Indexed: 02/13/2024]
Abstract
INTRODUCTION Parkinson disease (PD) caused substantially disability. The impairment of fine motor skills (FMSs) is correlated with the severity of functional disability (FD) cross-sectionally in people with PD (PwP). The present study investigated the decline in FMSs and the predictive value of baseline FMSs for the progression of FD. METHODS People with moderate-to-advanced PD who received two evaluations within 1-5 years were identified from the Taiwan Data Bank of Persons with Disability database. The World Health Organization Disability Assessment Schedule 2.0 (WHODAS 2.0) was used to evaluate FD, and FMSs including pen-holding, buttoning, and knotting were assessed. RESULTS Our study included 2,271 people with moderate-to-advanced PD. We observed annual progression of FD in each domain of the WHODAS 2.0, with no difference between the sexes. The most significant correlation between FD and FMSs was that of decline in buttoning ability and deterioration of summary WHODAS 2.0 scores. Deterioration in FD across all domains of WHODAS 2.0 was associated with at least one FMS. The extent of disability in all three types of FMS at baseline was also correlated with deterioration of motility. Additionally, baseline disability in buttoning was significantly correlated with cognitive decline, and disability in knotting was significantly associated with the progression of FD. CONCLUSION FMSs may be reliable markers for further FD, particularly in the areas of cognition, motility, and life activity. Because of the significant FD observed in people with moderate-to-advanced PD, the availability of predictors is essential for applying precautionary measures and providing appropriate treatment.
Collapse
Affiliation(s)
- Yin-Chia Huang
- Department of Neurology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, 23561, Taiwan
| | - Chien-Tai Hong
- Department of Neurology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, 23561, Taiwan; Department of Neurology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, 11031, Taiwan; Taipei Neuroscience Institute, Taipei Medical University, Taipei, 11031, Taiwan
| | - Wen-Chou Chi
- Taiwan Society of International Classification of Functioning, Disability and Health, TSICF, New Taipei City, 23561, Taiwan; Department of Occupational Therapy, Chung Shan Medical University, Taichung, 40201, Taiwan
| | - Chia-Feng Yen
- Taiwan Society of International Classification of Functioning, Disability and Health, TSICF, New Taipei City, 23561, Taiwan; Department of Public Health, Tzu Chi University, Hualien City, 97004, Taiwan
| | - Hua- Fang Liao
- Taiwan Society of International Classification of Functioning, Disability and Health, TSICF, New Taipei City, 23561, Taiwan; School and Graduate Institute of Physical Therapy, College of Medicine, National Taiwan University, Taipei, 10617, Taiwan
| | - Tsan-Hon Liou
- Taipei Neuroscience Institute, Taipei Medical University, Taipei, 11031, Taiwan; Department of Physical Medicine and Rehabilitation, Shuang Ho Hospital, Taipei Medical University, Taipei, Taiwan; Department of Physical Medicine and Rehabilitation, School of Medicine, College of Medicine, Taipei Medical University, Taipei, Taiwan; Department of Physical Medicine and Rehabilitation, Shuang Ho Hospital, Taipei Medical University, No. 291, Zhongzheng Rd., Zhonghe District, New Taipei City, 23561, Taiwan.
| | - Lung Chan
- Department of Neurology, Shuang Ho Hospital, Taipei Medical University, New Taipei City, 23561, Taiwan; Department of Neurology, School of Medicine, College of Medicine, Taipei Medical University, Taipei, 11031, Taiwan; Taipei Neuroscience Institute, Taipei Medical University, Taipei, 11031, Taiwan; Department of Neurology, Shuang Ho Hospital, Taipei Medical University, No. 291, Zhongzheng Rd., Zhonghe District, New Taipei City, 23561, Taiwan.
| |
Collapse
|
2
|
Erb MK, Calcagno N, Brown R, Burke KM, Scheier ZA, Iyer AS, Clark A, Higgins MP, Keegan M, Gupta AS, Johnson SA, Chew S, Berry JD. Longitudinal comparison of the self-administered ALSFRS-RSE and ALSFRS-R as functional outcome measures in ALS. Amyotroph Lateral Scler Frontotemporal Degener 2024:1-11. [PMID: 38501453 DOI: 10.1080/21678421.2024.2322549] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Accepted: 02/19/2024] [Indexed: 03/20/2024]
Abstract
Objective: Test the feasibility, adherence rates and optimal frequency of digital, remote assessments using the ALSFRS-RSE via a customized smartphone-based app. Methods: This fully remote, longitudinal study was conducted over a 24-week period, with virtual visits every 3 months and weekly digital assessments. 19 ALS participants completed digital assessments via smartphone, including a digital version of the ALSFRS-RSE and mood survey. Interclass correlation coefficients (ICC) and Bland-Altman plots were used to assess agreement between staff-administered and self-reported ALSFRS-R pairs. Longitudinal change was evaluated using ANCOVA models and linear mixed models, including impact of mood and time of day. Impact of frequency of administration of the ALSFRS-RSE on precision of the estimate slope was tested using a mixed effects model. Results: In our ALS cohort, digital assessments were well-accepted and adherence was robust, with completion rates of 86%. There was excellent agreement between the digital self-entry and staff-administered scores computing multiple ICCs (ICC range = 0.925-0.961), with scores on the ALSFRS-RSE slightly higher (1.304 points). Digital assessments were associated with increased precision of the slope, resulting in higher standardized response mean estimates for higher frequencies, though benefit appeared to diminish at biweekly and weekly frequency. Effects of participant mood and time of day on total ALSFRS-RSE score were evaluated but were minimal and not statistically significant. Conclusion: Remote collection of digital patient-reported outcomes of functional status such as the ALSFRS-RSE yield more accurate estimates of change over time and provide a broader understanding of the lived experience of people with ALS.
Collapse
Affiliation(s)
| | - Narghes Calcagno
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
- Neurology Residency Program, University of Milan, Milan, Italy
| | | | - Katherine M Burke
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - Zoe A Scheier
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - Amrita S Iyer
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - Alison Clark
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - Max P Higgins
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - Mackenzie Keegan
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - Anoopum S Gupta
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - Stephen A Johnson
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - Sheena Chew
- Biogen, Inc, Cambridge, MA, USA
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| | - James D Berry
- Department of Neurology, Massachusetts General Hospital, Sean M. Healey & AMG Center for ALS, Boston, MA, USA, and
| |
Collapse
|
3
|
Arya SS, Dias SB, Jelinek HF, Hadjileontiadis LJ, Pappa AM. The convergence of traditional and digital biomarkers through AI-assisted biosensing: A new era in translational diagnostics? Biosens Bioelectron 2023; 235:115387. [PMID: 37229842 DOI: 10.1016/j.bios.2023.115387] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 04/11/2023] [Accepted: 05/10/2023] [Indexed: 05/27/2023]
Abstract
Advances in consumer electronics, alongside the fields of microfluidics and nanotechnology have brought to the fore low-cost wearable/portable smart devices. Although numerous smart devices that track digital biomarkers have been successfully translated from bench-to-bedside, only a few follow the same fate when it comes to track traditional biomarkers. Current practices still involve laboratory-based tests, followed by blood collection, conducted in a clinical setting as they require trained personnel and specialized equipment. In fact, real-time, passive/active and robust sensing of physiological and behavioural data from patients that can feed artificial intelligence (AI)-based models can significantly improve decision-making, diagnosis and treatment at the point-of-procedure, by circumventing conventional methods of sampling, and in person investigation by expert pathologists, who are scarce in developing countries. This review brings together conventional and digital biomarker sensing through portable and autonomous miniaturized devices. We first summarise the technological advances in each field vs the current clinical practices and we conclude by merging the two worlds of traditional and digital biomarkers through AI/ML technologies to improve patient diagnosis and treatment. The fundamental role, limitations and prospects of AI in realizing this potential and enhancing the existing technologies to facilitate the development and clinical translation of "point-of-care" (POC) diagnostics is finally showcased.
Collapse
Affiliation(s)
- Sagar S Arya
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P.O. Box 127788, Abu Dhabi, United Arab Emirates
| | - Sofia B Dias
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P.O. Box 127788, Abu Dhabi, United Arab Emirates; Interdisciplinary Center for Human Performance, Faculdade de Motricidade Humana, Universidade de Lisboa, Portugal.
| | - Herbert F Jelinek
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P.O. Box 127788, Abu Dhabi, United Arab Emirates; Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates
| | - Leontios J Hadjileontiadis
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P.O. Box 127788, Abu Dhabi, United Arab Emirates; Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates; Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, GR, 54124, Thessaloniki, Greece
| | - Anna-Maria Pappa
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P.O. Box 127788, Abu Dhabi, United Arab Emirates; Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates; Department of Chemical Engineering and Biotechnology, Cambridge University, Cambridge, UK.
| |
Collapse
|
4
|
Alfalahi H, Dias SB, Khandoker AH, Chaudhuri KR, Hadjileontiadis LJ. A scoping review of neurodegenerative manifestations in explainable digital phenotyping. NPJ Parkinsons Dis 2023; 9:49. [PMID: 36997573 PMCID: PMC10063633 DOI: 10.1038/s41531-023-00494-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Accepted: 03/16/2023] [Indexed: 04/03/2023] Open
Abstract
Neurologists nowadays no longer view neurodegenerative diseases, like Parkinson's and Alzheimer's disease, as single entities, but rather as a spectrum of multifaceted symptoms with heterogeneous progression courses and treatment responses. The definition of the naturalistic behavioral repertoire of early neurodegenerative manifestations is still elusive, impeding early diagnosis and intervention. Central to this view is the role of artificial intelligence (AI) in reinforcing the depth of phenotypic information, thereby supporting the paradigm shift to precision medicine and personalized healthcare. This suggestion advocates the definition of disease subtypes in a new biomarker-supported nosology framework, yet without empirical consensus on standardization, reliability and interpretability. Although the well-defined neurodegenerative processes, linked to a triad of motor and non-motor preclinical symptoms, are detected by clinical intuition, we undertake an unbiased data-driven approach to identify different patterns of neuropathology distribution based on the naturalistic behavior data inherent to populations in-the-wild. We appraise the role of remote technologies in the definition of digital phenotyping specific to brain-, body- and social-level neurodegenerative subtle symptoms, emphasizing inter- and intra-patient variability powered by deep learning. As such, the present review endeavors to exploit digital technologies and AI to create disease-specific phenotypic explanations, facilitating the understanding of neurodegenerative diseases as "bio-psycho-social" conditions. Not only does this translational effort within explainable digital phenotyping foster the understanding of disease-induced traits, but it also enhances diagnostic and, eventually, treatment personalization.
Collapse
Affiliation(s)
- Hessa Alfalahi
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates.
| | - Sofia B Dias
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- CIPER, Faculdade de Motricidade Humana, University of Lisbon, Lisbon, Portugal
| | - Ahsan H Khandoker
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| | - Kallol Ray Chaudhuri
- Parkinson Foundation, International Center of Excellence, King's College London, Denmark Hills, London, UK
- Department of Basic and Clinical Neurosciences, Institute of Psychiatry, Psychology and Neuroscience, King's College London, De Crespigny Park, London, UK
| | - Leontios J Hadjileontiadis
- Department of Biomedical Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece
| |
Collapse
|
5
|
Belić M, Radivojević Z, Bobić V, Kostić V, Đurić-Jovičić M. Quick computer aided differential diagnostics based on repetitive finger tapping in Parkinson’s disease and atypical parkinsonisms. Heliyon 2023; 9:e14824. [PMID: 37077676 PMCID: PMC10107087 DOI: 10.1016/j.heliyon.2023.e14824] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2022] [Revised: 03/06/2023] [Accepted: 03/17/2023] [Indexed: 03/30/2023] Open
Abstract
Background Parkinson's disease (PD) is the second most common neurodegenerative disorder whose prevalence rises with age, yet clinical diagnosis is still a challenging task due to similar manifestations of other neurodegenerative movement disorders. In untreated patients or those with unclear responses to medication, correct percentages of early diagnoses go as low as 26%. Technology has been used in various forms to facilitate discerning between persons with PD and healthy individuals, but much less work has been dedicated to separating PD and atypical parkinsonisms. Methods A wearable system was developed based on inertial sensors that capture the movements of fingers during repetitive finger tapping. A k-nearest-neighbor classifier was used on features extracted from gyroscope recordings for quick aid in differential diagnostics, discerning patients with PD, progressive supranuclear palsy (PSP), multiple system atrophy (MSA) and healthy controls (HC). Results The overall classification accuracy achieved was 85.18% in the multiclass setup. MSA and HC groups were the easiest to discern (100%), while PSP was the most elusive diagnosis, as some patients were incorrectly assigned to MSA and HC groups. Conclusions The system shows potential for use as a tool for quick diagnostic aid, and in the era of big data, offers a means of standardization of data collection that could allow scientists to aggregate multi-center data for further research.
Collapse
|
6
|
Hoeijmakers A, Licitra G, Meijer K, Lam KH, Molenaar P, Strijbis E, Killestein J. Disease severity classification using passively collected smartphone-based keystroke dynamics within multiple sclerosis. Sci Rep 2023; 13:1871. [PMID: 36725975 PMCID: PMC9892592 DOI: 10.1038/s41598-023-28990-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2022] [Accepted: 01/27/2023] [Indexed: 02/03/2023] Open
Abstract
Multiple Sclerosis (MS) is a progressive demyelinating disease of the central nervous system characterised by a wide range of motor and non-motor symptoms. The level of disability of people with MS (pwMS) is based on a wide range of clinical measures, though their frequency of evaluation and inaccuracies coming from objective and self-reported evaluations limits these assessments. Alternatively, remote health monitoring through devices can offer a cost-efficient solution to gather more reliable, objective measures continuously. Measuring smartphone keyboard interactions is a promising tool since typing and, thus, keystroke dynamics are likely influenced by symptoms that pwMS can experience. Therefore, this paper aims to investigate whether keyboard interactions gathered on a person's smartphone can provide insight into the clinical status of pwMS leveraging machine learning techniques. In total, 24 Healthy Controls (HC) and 102 pwMS were followed for one year. Next to continuous data generated via smartphone interactions, clinical outcome measures were collected and used as targets to train four independent multivariate binary classification pipelines in discerning pwMS versus HC and estimating the level of disease severity, manual dexterity and cognitive capabilities. The final models yielded an AUC-ROC in the hold-out set above 0.7, with the highest performance obtained in estimating the level of fine motor skills (AUC-ROC=0.753). These findings show that keyboard interactions combined with machine learning techniques can be used as an unobtrusive monitoring tool to estimate various levels of clinical disability in pwMS from daily activities and with a high frequency of sampling without increasing patient burden.
Collapse
Affiliation(s)
| | | | - Kim Meijer
- Neurocast B.V., Amsterdam, The Netherlands
| | - Ka-Hoo Lam
- Department of Neurology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Pam Molenaar
- Department of Neurology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Eva Strijbis
- Department of Neurology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| | - Joep Killestein
- Department of Neurology, Amsterdam University Medical Centers, Amsterdam, The Netherlands
| |
Collapse
|
7
|
Tripathi S, Arroyo-Gallego T, Giancardo L. Keystroke-Dynamics for Parkinson's Disease Signs Detection in an At-Home Uncontrolled Population: A New Benchmark and Method. IEEE Trans Biomed Eng 2023; 70:182-192. [PMID: 35767495 PMCID: PMC9904385 DOI: 10.1109/tbme.2022.3187309] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/24/2023]
Abstract
Parkinson's disease (PD) is the second most prevalent neurodegenerative disease disorder in the world. A prompt diagnosis would enable clinical trials for disease-modifying neuroprotective therapies. Recent research efforts have unveiled imaging and blood markers that have the potential to be used to identify PD patients promptly, however, the idiopathic nature of PD makes these tests very hard to scale to the general population. To this end, we need an easily deployable tool that would enable screening for PD signs in the general population. In this work, we propose a new set of features based on keystroke dynamics, i.e., the time required to press and release keyboard keys during typing, and used to detect PD in an ecologically valid data acquisition setup at the subject's homes, without requiring any pre-defined task. We compare and contrast existing models presented in the literature and present a new model that combines a new type of keystroke dynamics signal representation using hold time and flight time series as a function of key types and asymmetry in the time series using a convolutional neural network. We show how this model achieves an Area Under the Receiving Operating Characteristic curve ranging from 0.80 to 0.83 on a dataset of subjects who actively interacted with their computers for at least 5 months and positively compares against other state-of-the-art approaches previously tested on keystroke dynamics data acquired with mechanical keyboards.
Collapse
|
8
|
Park SY, Schott N. Which motor-cognitive abilities underlie the digital Trail-Making Test? Decomposing various test scores to detect cognitive impairment in Parkinson's disease-Pilot study. Appl Neuropsychol Adult 2022:1-15. [PMID: 36412487 DOI: 10.1080/23279095.2022.2147837] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Since Parkinson's disease (PD) is a heterogeneous disorder with symptoms, such as tremors, gait and speech disturbances, or memory loss, individualized diagnostics are needed to optimize treatment. In their current form, the typical paper-pencil methods traditionally used to track disease progression are too coarse to capture the subtleties of clinical phenomena. For this reason, digital biomarkers that capture, for example, motor function, cognition, and behavior using apps, wearables, and tracking systems are becoming increasingly established. However, given the high prevalence of cognitive impairment in PD, digital cognitive biomarkers to predict mental progression are important in clinical practice. This pilot study aimed to identify those components of our digital version of the TMT (dTMT) that allow discrimination between PD patients with and without cognitive deficits. A total of 30 healthy control (age 66.3 ± 8.61) and 30 participants with PD (age 68.3 ± 9.66) performed the dTMT using a touch-sensitive tablet to capture enhanced performance metrics, such as the speed between and inside circles. The decomposition of cognitive abilities based on integrating additional variables in the dTMT revealed that the Parkinson's disease group was significantly more sensitive to parameters of inhibitory control. In contrast, the mild cognitive impairment group was sensitive to parameters of cognitive flexibility and working memory. The dTMT allows objective, ecologically valid, and long-term cognitive and fine-motor performance tracking, suggesting its potential as a digital biomarker in neurodegenerative disorders.
Collapse
Affiliation(s)
- Soo-Yong Park
- Department of Sport Psychology & Human Movement Performance, Institute of Sport and Exercise Science, University of Stuttgart, Stuttgart, Germany
| | - Nadja Schott
- Department of Sport Psychology & Human Movement Performance, Institute of Sport and Exercise Science, University of Stuttgart, Stuttgart, Germany
| |
Collapse
|
9
|
Guo CC, Chiesa PA, de Moor C, Fazeli MS, Schofield T, Hofer K, Belachew S, Scotland A. Digital Devices for Assessing Motor Functions in Mobility-Impaired and Healthy Populations: Systematic Literature Review. J Med Internet Res 2022; 24:e37683. [DOI: 10.2196/37683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Revised: 07/18/2022] [Accepted: 10/11/2022] [Indexed: 11/22/2022] Open
Abstract
Background
With the advent of smart sensing technology, mobile and wearable devices can provide continuous and objective monitoring and assessment of motor function outcomes.
Objective
We aimed to describe the existing scientific literature on wearable and mobile technologies that are being used or tested for assessing motor functions in mobility-impaired and healthy adults and to evaluate the degree to which these devices provide clinically valid measures of motor function in these populations.
Methods
A systematic literature review was conducted by searching Embase, MEDLINE, CENTRAL (January 1, 2015, to June 24, 2020), the United States and European Union clinical trial registries, and the United States Food and Drug Administration website using predefined study selection criteria. Study selection, data extraction, and quality assessment were performed by 2 independent reviewers.
Results
A total of 91 publications representing 87 unique studies were included. The most represented clinical conditions were Parkinson disease (n=51 studies), followed by stroke (n=5), Huntington disease (n=5), and multiple sclerosis (n=2). A total of 42 motion-detecting devices were identified, and the majority (n=27, 64%) were created for the purpose of health care–related data collection, although approximately 25% were personal electronic devices (eg, smartphones and watches) and 11% were entertainment consoles (eg, Microsoft Kinect or Xbox and Nintendo Wii). The primary motion outcomes were related to gait (n=30), gross motor movements (n=25), and fine motor movements (n=23). As a group, sensor-derived motion data showed a mean sensitivity of 0.83 (SD 7.27), a mean specificity of 0.84 (SD 15.40), a mean accuracy of 0.90 (SD 5.87) in discriminating between diseased individuals and healthy controls, and a mean Pearson r validity coefficient of 0.52 (SD 0.22) relative to clinical measures. We did not find significant differences in the degree of validity between in-laboratory and at-home sensor-based assessments nor between device class (ie, health care–related device, personal electronic devices, and entertainment consoles).
Conclusions
Sensor-derived motion data can be leveraged to classify and quantify disease status for a variety of neurological conditions. However, most of the recent research on digital clinical measures is derived from proof-of-concept studies with considerable variation in methodological approaches, and much of the reviewed literature has focused on clinical validation, with less than one-quarter of the studies performing analytical validation. Overall, future research is crucially needed to further consolidate that sensor-derived motion data may lead to the development of robust and transformative digital measurements intended to predict, diagnose, and quantify neurological disease state and its longitudinal change.
Collapse
|
10
|
Lam KH, Twose J, Lissenberg-Witte B, Licitra G, Meijer K, Uitdehaag B, De Groot V, Killestein J. The Use of Smartphone Keystroke Dynamics to Passively Monitor Upper Limb and Cognitive Function in Multiple Sclerosis: Longitudinal Analysis. J Med Internet Res 2022; 24:e37614. [PMID: 36342763 PMCID: PMC9679948 DOI: 10.2196/37614] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Revised: 07/31/2022] [Accepted: 08/22/2022] [Indexed: 11/09/2022] Open
Abstract
Background Typing on smartphones, which has become a near daily activity, requires both upper limb and cognitive function. Analysis of keyboard interactions during regular typing, that is, keystroke dynamics, could therefore potentially be utilized for passive and continuous monitoring of function in patients with multiple sclerosis. Objective To determine whether passively acquired smartphone keystroke dynamics correspond to multiple sclerosis outcomes, we investigated the association between keystroke dynamics and clinical outcomes (upper limb and cognitive function). This association was investigated longitudinally in order to study within-patient changes independently of between-patient differences. Methods During a 1-year follow-up, arm function and information processing speed were assessed every 3 months in 102 patients with multiple sclerosis with the Nine-Hole Peg Test and Symbol Digit Modalities Test, respectively. Keystroke-dynamics data were continuously obtained from regular typing on the participants’ own smartphones. Press-and-release latency of the alphanumeric keys constituted the fine motor score cluster, while latency of the punctuation and backspace keys constituted the cognition score cluster. The association over time between keystroke clusters and the corresponding clinical outcomes was assessed with linear mixed models with subjects as random intercepts. By centering around the mean and calculating deviation scores within subjects, between-subject and within-subject effects were distinguished. Results Mean (SD) scores for the fine motor score cluster and cognition score cluster were 0.43 (0.16) and 0.94 (0.41) seconds, respectively. The fine motor score cluster was significantly associated with the Nine-Hole Peg Test: between-subject β was 15.9 (95% CI 12.2-19.6) and within-subject β was 6.9 (95% CI 2.0-11.9). The cognition score cluster was significantly associated with the Symbol Digit Modalities Test between subjects (between-subject β –11.2, 95% CI –17.3 to –5.2) but not within subjects (within-subject β –0.4, 95% CI –5.6 to 4.9). Conclusions Smartphone keystroke dynamics were longitudinally associated with multiple sclerosis outcomes. Worse arm function corresponded with longer latency in typing both across and within patients. Worse processing speed corresponded with higher latency in using punctuation and backspace keys across subjects. Hence, keystroke dynamics are a potential digital biomarker for remote monitoring and predicting clinical outcomes in patients with multiple sclerosis. Trial Registration Netherlands Trial Register NTR7268; https://trialsearch.who.int/Trial2.aspx?TrialID=NTR7268
Collapse
Affiliation(s)
- Ka-Hoo Lam
- Department of Neurology, Amsterdam University Medical Centers (VU University Medical Center location), Amsterdam, Netherlands
| | | | - Birgit Lissenberg-Witte
- Department of Epidemiology and Data Science, Amsterdam University Medical Centers (VU University Medical Center location), Amsterdam, Netherlands
| | | | | | - Bernard Uitdehaag
- Department of Neurology, Amsterdam University Medical Centers (VU University Medical Center location), Amsterdam, Netherlands
| | - Vincent De Groot
- Department of Rehabilitation Medicine, Amsterdam University Medical Centers (VU University Medical Center location), Amsterdam, Netherlands
| | - Joep Killestein
- Department of Neurology, Amsterdam University Medical Centers (VU University Medical Center location), Amsterdam, Netherlands
| |
Collapse
|
11
|
Holmes AA, Tripathi S, Katz E, Mondesire-Crump I, Mahajan R, Ritter A, Arroyo-Gallego T, Giancardo L. A novel framework to estimate cognitive impairment via finger interaction with digital devices. Brain Commun 2022; 4:fcac194. [PMID: 35950091 PMCID: PMC9356723 DOI: 10.1093/braincomms/fcac194] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2021] [Revised: 05/11/2022] [Accepted: 07/25/2022] [Indexed: 11/13/2022] Open
Abstract
Measuring cognitive function is essential for characterizing brain health and tracking cognitive decline in Alzheimer’s Disease and other neurodegenerative conditions. Current tools to accurately evaluate cognitive impairment typically rely on a battery of questionnaires administered during clinical visits which is essential for the acquisition of repeated measurements in longitudinal studies. Previous studies have shown that the remote data collection of passively monitored daily interaction with personal digital devices can measure motor signs in the early stages of synucleinopathies, as well as facilitate longitudinal patient assessment in the real-world scenario with high patient compliance. This was achieved by the automatic discovery of patterns in the time series of keystroke dynamics, i.e. the time required to press and release keys, by machine learning algorithms. In this work, our hypothesis is that the typing patterns generated from user-device interaction may reflect relevant features of the effects of cognitive impairment caused by neurodegeneration. We use machine learning algorithms to estimate cognitive performance through the analysis of keystroke dynamic patterns that were extracted from mechanical and touchscreen keyboard use in a dataset of cognitively normal (n = 39, 51% male) and cognitively impaired subjects (n = 38, 60% male). These algorithms are trained and evaluated using a novel framework that integrates items from multiple neuropsychological and clinical scales into cognitive subdomains to generate a more holistic representation of multifaceted clinical signs. In our results, we see that these models based on typing input achieve moderate correlations with verbal memory, non-verbal memory and executive function subdomains [Spearman’s ρ between 0.54 (P < 0.001) and 0.42 (P < 0.001)] and a weak correlation with language/verbal skills [Spearman’s ρ 0.30 (P < 0.05)]. In addition, we observe a moderate correlation between our typing-based approach and the Total Montreal Cognitive Assessment score [Spearman’s ρ 0.48 (P < 0.001)]. Finally, we show that these machine learning models can perform better by using our subdomain framework that integrates the information from multiple neuropsychological scales as opposed to using the individual items that make up these scales. Our results support our hypothesis that typing patterns are able to reflect the effects of neurodegeneration in mild cognitive impairment and Alzheimer’s disease and that this new subdomain framework both helps the development of machine learning models and improves their interpretability.
Collapse
Affiliation(s)
| | - Shikha Tripathi
- Center for Precision Health, School of Biomedical Informatics, University of Texas Health Science Center at Houston , Houston, TX 77030 , USA
| | | | | | - Rahul Mahajan
- nQ Medical , Cambridge, MA 02142 , USA
- Division of Neurocritical Care, Department of Neurology, Brigham & Women’s Hospital , Boston, MA 02115 , USA
| | - Aaron Ritter
- Cleveland Clinic Lou Ruvo Center for Brain Health, Cleveland Clinic , Las Vegas, NV 89106 , USA
| | | | - Luca Giancardo
- Center for Precision Health, School of Biomedical Informatics, University of Texas Health Science Center at Houston , Houston, TX 77030 , USA
| |
Collapse
|
12
|
Alfalahi H, Khandoker AH, Chowdhury N, Iakovakis D, Dias SB, Chaudhuri KR, Hadjileontiadis LJ. Diagnostic accuracy of keystroke dynamics as digital biomarkers for fine motor decline in neuropsychiatric disorders: a systematic review and meta-analysis. Sci Rep 2022; 12:7690. [PMID: 35546606 PMCID: PMC9095860 DOI: 10.1038/s41598-022-11865-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Accepted: 04/25/2022] [Indexed: 12/12/2022] Open
Abstract
The unmet timely diagnosis requirements, that take place years after substantial neural loss and neuroperturbations in neuropsychiatric disorders, affirm the dire need for biomarkers with proven efficacy. In Parkinson's disease (PD), Mild Cognitive impairment (MCI), Alzheimers disease (AD) and psychiatric disorders, it is difficult to detect early symptoms given their mild nature. We hypothesize that employing fine motor patterns, derived from natural interactions with keyboards, also knwon as keystroke dynamics, could translate classic finger dexterity tests from clinics to populations in-the-wild for timely diagnosis, yet, further evidence is required to prove this efficiency. We have searched PubMED, Medline, IEEEXplore, EBSCO and Web of Science for eligible diagnostic accuracy studies employing keystroke dynamics as an index test for the detection of neuropsychiatric disorders as the main target condition. We evaluated the diagnostic performance of keystroke dynamics across 41 studies published between 2014 and March 2022, comprising 3791 PD patients, 254 MCI patients, and 374 psychiatric disease patients. Of these, 25 studies were included in univariate random-effect meta-analysis models for diagnostic performance assessment. Pooled sensitivity and specificity are 0.86 (95% Confidence Interval (CI) 0.82-0.90, I2 = 79.49%) and 0.83 (CI 0.79-0.87, I2 = 83.45%) for PD, 0.83 (95% CI 0.65-1.00, I2 = 79.10%) and 0.87 (95% CI 0.80-0.93, I2 = 0%) for psychomotor impairment, and 0.85 (95% CI 0.74-0.96, I2 = 50.39%) and 0.82 (95% CI 0.70-0.94, I2 = 87.73%) for MCI and early AD, respectively. Our subgroup analyses conveyed the diagnosis efficiency of keystroke dynamics for naturalistic self-reported data, and the promising performance of multimodal analysis of naturalistic behavioral data and deep learning methods in detecting disease-induced phenotypes. The meta-regression models showed the increase in diagnostic accuracy and fine motor impairment severity index with age and disease duration for PD and MCI. The risk of bias, based on the QUADAS-2 tool, is deemed low to moderate and overall, we rated the quality of evidence to be moderate. We conveyed the feasibility of keystroke dynamics as digital biomarkers for fine motor decline in naturalistic environments. Future work to evaluate their performance for longitudinal disease monitoring and therapeutic implications is yet to be performed. We eventually propose a partnership strategy based on a "co-creation" approach that stems from mechanistic explanations of patients' characteristics derived from data obtained in-clinics and under ecologically valid settings. The protocol of this systematic review and meta-analysis is registered in PROSPERO; identifier CRD42021278707. The presented work is supported by the KU-KAIST joint research center.
Collapse
Affiliation(s)
- Hessa Alfalahi
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates.
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates.
| | - Ahsan H Khandoker
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates
| | - Nayeefa Chowdhury
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates
| | - Dimitrios Iakovakis
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, 54124, Thessaloniki, Greece
| | - Sofia B Dias
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates
- CIPER, Faculdade de Motricidade Humana, Universidade de Lisboa, Cruz Quebrada, 1499-002, Lisbon, Portugal
| | - K Ray Chaudhuri
- Parkinson's Foundation Centre of Excellence, King's College Hospital NHS Foundation Trust, Denmark Hill, London, SE5 9RS, United Kingdom
- Department of Basic and Clinical Neurosciences, Institute of Psychiatry, Psychology & Neuroscience, King's College London, De Crespigny Park, London, SE5 8AF, United Kingdom
| | - Leontios J Hadjileontiadis
- Department of Biomedical Engineering, Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates
- Healthcare Engineering Innovation Center (HEIC), Khalifa University of Science and Technology, P O Box 127788, Abu Dhabi, United Arab Emirates
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, 54124, Thessaloniki, Greece
| |
Collapse
|
13
|
Gopal A, Hsu WY, Allen DD, Bove R. Remote Assessments of Hand Function in Neurological Disorders: Systematic Review. JMIR Rehabil Assist Technol 2022; 9:e33157. [PMID: 35262502 PMCID: PMC8943610 DOI: 10.2196/33157] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Revised: 01/17/2022] [Accepted: 01/26/2022] [Indexed: 02/06/2023] Open
Abstract
BACKGROUND Loss of fine motor skills is observed in many neurological diseases, and remote monitoring assessments can aid in early diagnosis and intervention. Hand function can be regularly assessed to monitor loss of fine motor skills in people with central nervous system disorders; however, there are challenges to in-clinic assessments. Remotely assessing hand function could facilitate monitoring and supporting of early diagnosis and intervention when warranted. OBJECTIVE Remote assessments can facilitate the tracking of limitations, aiding in early diagnosis and intervention. This study aims to systematically review existing evidence regarding the remote assessment of hand function in populations with chronic neurological dysfunction. METHODS PubMed and MEDLINE, CINAHL, Web of Science, and Embase were searched for studies that reported remote assessment of hand function (ie, outside of traditional in-person clinical settings) in adults with chronic central nervous system disorders. We excluded studies that included participants with orthopedic upper limb dysfunction or used tools for intervention and treatment. We extracted data on the evaluated hand function domains, validity and reliability, feasibility, and stage of development. RESULTS In total, 74 studies met the inclusion criteria for Parkinson disease (n=57, 77% studies), stroke (n=9, 12%), multiple sclerosis (n=6, 8%), spinal cord injury (n=1, 1%), and amyotrophic lateral sclerosis (n=1, 1%). Three assessment modalities were identified: external device (eg, wrist-worn accelerometer), smartphone or tablet, and telerehabilitation. The feasibility and overall participant acceptability were high. The most common hand function domains assessed included finger tapping speed (fine motor control and rigidity), hand tremor (pharmacological and rehabilitation efficacy), and finger dexterity (manipulation of small objects required for daily tasks) and handwriting (coordination). Although validity and reliability data were heterogeneous across studies, statistically significant correlations with traditional in-clinic metrics were most commonly reported for telerehabilitation and smartphone or tablet apps. The most readily implementable assessments were smartphone or tablet-based. CONCLUSIONS The findings show that remote assessment of hand function is feasible in neurological disorders. Although varied, the assessments allow clinicians to objectively record performance in multiple hand function domains, improving the reliability of traditional in-clinic assessments. Remote assessments, particularly via telerehabilitation and smartphone- or tablet-based apps that align with in-clinic metrics, facilitate clinic to home transitions, have few barriers to implementation, and prompt remote identification and treatment of hand function impairments.
Collapse
Affiliation(s)
- Arpita Gopal
- Weill Institute of Neurosciences, University of California San Francisco, San Francisco, CA, United States
| | - Wan-Yu Hsu
- Weill Institute of Neurosciences, University of California San Francisco, San Francisco, CA, United States
| | - Diane D Allen
- Department of Physical Therapy and Rehabilitation Science, University of California San Francisco/San Francisco State University, San Francisco, CA, United States
| | - Riley Bove
- Weill Institute of Neurosciences, University of California San Francisco, San Francisco, CA, United States
| |
Collapse
|
14
|
Surangsrirat D, Sri-Iesaranusorn P, Chaiyaroj A, Vateekul P, Bhidayasiri R. Parkinson's disease severity clustering based on tapping activity on mobile device. Sci Rep 2022; 12:3142. [PMID: 35210451 DOI: 10.1038/s41598-022-06572-2] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2021] [Accepted: 02/01/2022] [Indexed: 11/09/2022] Open
Abstract
In this study, we investigated the relationship between finger tapping tasks on the smartphone and the MDS-UPDRS I–II and PDQ-8 using the mPower dataset. mPower is a mobile application-based study for monitoring key indicators of PD progression and diagnosis. Currently, it is one of the largest, open access, mobile Parkinson’s Disease studies. Data from seven modules with a total of 8,320 participants who provided the data of at least one task were released to the public researcher. The modules comprise demographics, MDS-UPDRS I–II, PDQ-8, memory, tapping, voice, and walking. Finger-tapping is one of the tasks that easy to perform and has been analyzed for the quantitative measurement of PD. Therefore, participants who performed both the tapping activity and MDS-UPDRS I–II rating scale were selected for our analysis. Note that the MDS-UPDRS mPower Survey only contains parts of the original scale and has not been clinimetrically tested for validity and reliability. We obtained a total of 1851 samples that contained the tapping activity and MDS-UPDRS I–II for the analysis. Nine features were selected to represent tapping activity. K-mean was applied as an unsupervised clustering algorithm in our study. For determining the number of clusters, the elbow method, Sihouette score, and Davies–Bouldin index, were employed as supporting evaluation metrics. Based on these metrics and expert opinion, we decide that three clusters were appropriate for our study. The statistical analysis found that the tapping features could separate participants into three severity groups. Each group has different characteristics and could represent different PD severity based on the MDS-UPDRS I–II and PDQ-8 scores. Currently, the severity assessment of a movement disorder is based on clinical observation. Therefore, it is highly dependant on the skills and experiences of the trained movement disorder specialist who performs the procedure. We believe that any additional methods that could potentially assist with quantitative assessment of disease severity, without the need for a clinical visit would be beneficial to both the healthcare professionals and patients.
Collapse
|
15
|
Gerber SM, Single M, Knobel SEJ, Schütz N, Bruhin LC, Botros A, Naef AC, Schindler KA, Nef T. An Instrumented Apartment to Monitor Human Behavior: A Pilot Case Study in the NeuroTec Loft. Sensors 2022; 22:1657. [PMID: 35214560 PMCID: PMC8875023 DOI: 10.3390/s22041657] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/20/2022] [Revised: 02/17/2022] [Accepted: 02/18/2022] [Indexed: 11/16/2022]
Abstract
For patients suffering from neurodegenerative disorders, the behavior and activities of daily living are an indicator of a change in health status, and home-monitoring over a prolonged period of time by unobtrusive sensors is a promising technology to foster independent living and maintain quality of life. The aim of this pilot case study was the development of a multi-sensor system in an apartment to unobtrusively monitor patients at home during the day and night. The developed system is based on unobtrusive sensors using basic technologies and gold-standard medical devices measuring physiological (e.g., mobile electrocardiogram), movement (e.g., motion tracking system), and environmental parameters (e.g., temperature). The system was evaluated during one session by a healthy 32-year-old male, and results showed that the sensor system measured accurately during the participant’s stay. Furthermore, the participant did not report any negative experiences. Overall, the multi-sensor system has great potential to bridge the gap between laboratories and older adults’ homes and thus for a deep and novel understanding of human behavioral and neurological disorders. Finally, this new understanding could be utilized to develop new algorithms and sensor systems to address problems and increase the quality of life of our aging society and patients with neurological disorders.
Collapse
|
16
|
Ntracha A, Iakovakis D, Hadjidimitriou S, Charisis VS, Tsolaki M, Hadjileontiadis LJ. Detection of Mild Cognitive Impairment Through Natural Language and Touchscreen Typing Processing. Front Digit Health 2021; 2:567158. [PMID: 34713039 PMCID: PMC8521910 DOI: 10.3389/fdgth.2020.567158] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2020] [Accepted: 08/27/2020] [Indexed: 11/13/2022] Open
Abstract
Mild cognitive impairment (MCI), an identified prodromal stage of Alzheimer's Disease (AD), often evades detection in the early stages of the condition, when existing diagnostic methods are employed in the clinical setting. From an alternative perspective, smartphone interaction behavioral data, unobtrusively acquired in a non-clinical setting, can assist the screening and monitoring of MCI and its symptoms' progression. In this vein, the diagnostic ability of digital biomarkers, drawn from Fine Motor Impairment (FMI)- and Spontaneous Written Speech (SWS)-related data analysis, are examined here. In particular, keystroke dynamics derived from touchscreen typing activities, using Convolutional Neural Networks, along with linguistic features of SWS through Natural Language Processing (NLP), were used to distinguish amongst MCI patients and healthy controls (HC). Analytically, three indices of FMI (rigidity, bradykinesia and alternate finger tapping) and nine NLP features, related with lexical richness, grammatical, syntactical complexity, and word deficits, formed the feature space. The proposed approach was tested on two demographically matched groups of 11 MCI patients and 12 HC, having undergone the same neuropsychological tests, producing 4,930 typing sessions and 78 short texts, within 6 months, for analysis. A cascaded-classifier scheme was realized under three different feature combinations and validated via a Leave-One-Subject-Out cross-validation scheme. The acquired results have shown: (a) keystroke features with a k-NN classifier achieved an Area Under Curve (AUC) of 0.78 [95% confidence interval (CI):0.68-0.88; specificity/sensitivity (SP/SE): 0.64/0.92], (b) NLP features with a Logistic regression classifier achieved an AUC of 0.76 (95% CI: 0.65-0.85; SP/SE: 0.80/0.71), and (c) an ensemble model with the fusion of keystroke and NLP features resulted in AUC of 0.75 (95% CI:0.63-0.86; SP/SE 0.90/0.60). The current findings indicate the potentiality of new digital biomarkers to capture early stages of cognitive decline, providing a highly specific remote screening tool in-the-wild.
Collapse
Affiliation(s)
- Anastasia Ntracha
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Dimitrios Iakovakis
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Stelios Hadjidimitriou
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Vasileios S Charisis
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Magda Tsolaki
- Third Department of Neurology, Medical School, Aristotle University of Thessaloniki, Thessaloniki, Greece
| | - Leontios J Hadjileontiadis
- Department of Electrical and Computer Engineering, Aristotle University of Thessaloniki, Thessaloniki, Greece.,Department of Electrical and Computer Engineering, Khalifa University of Science and Technology, Abu Dhabi, United Arab Emirates
| |
Collapse
|
17
|
Faundez-zanuy M, Mekyska J, Impedovo D. Online Handwriting, Signature and Touch Dynamics: Tasks and Potential Applications in the Field of Security and Health. Cognit Comput 2021; 13:1406-21. [DOI: 10.1007/s12559-021-09938-2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
|
18
|
Adams JL, Lizarraga KJ, Waddell EM, Myers TL, Jensen-Roberts S, Modica JS, Schneider RB. Digital Technology in Movement Disorders: Updates, Applications, and Challenges. Curr Neurol Neurosci Rep 2021; 21:16. [PMID: 33660110 DOI: 10.1007/s11910-021-01101-6] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/21/2021] [Indexed: 12/14/2022]
Abstract
Purpose of Review Digital technology affords the opportunity to provide objective, frequent, and sensitive assessment of disease outside of the clinic environment. This article reviews recent literature on the application of digital technology in movement disorders, with a focus on Parkinson’s disease (PD) and Huntington’s disease. Recent Findings Recent research has demonstrated the ability for digital technology to discriminate between individuals with and without PD, identify those at high risk for PD, quantify specific motor features, predict clinical events in PD, inform clinical management, and generate novel insights. Summary Digital technology has enormous potential to transform clinical research and care in movement disorders. However, more work is needed to better validate existing digital measures, including in new populations, and to develop new more holistic digital measures that move beyond motor features.
Collapse
|
19
|
Kyritsis K, Fagerberg P, Ioakimidis I, Chaudhuri KR, Reichmann H, Klingelhoefer L, Delopoulos A. Assessment of real life eating difficulties in Parkinson's disease patients by measuring plate to mouth movement elongation with inertial sensors. Sci Rep 2021; 11:1632. [PMID: 33452324 DOI: 10.1038/s41598-020-80394-y] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 12/14/2020] [Indexed: 02/06/2023] Open
Abstract
Parkinson’s disease (PD) is a neurodegenerative disorder with both motor and non-motor symptoms. Despite the progressive nature of PD, early diagnosis, tracking the disease’s natural history and measuring the drug response are factors that play a major role in determining the quality of life of the affected individual. Apart from the common motor symptoms, i.e., tremor at rest, rigidity and bradykinesia, studies suggest that PD is associated with disturbances in eating behavior and energy intake. Specifically, PD is associated with drug-induced impulsive eating disorders such as binge eating, appetite-related non-motor issues such as weight loss and/or gain as well as dysphagia—factors that correlate with difficulties in completing day-to-day eating-related tasks. In this work we introduce Plate-to-Mouth (PtM), an indicator that relates with the time spent for the hand operating the utensil to transfer a quantity of food from the plate into the mouth during the course of a meal. We propose a two-step approach towards the objective calculation of PtM. Initially, we use the 3D acceleration and orientation velocity signals from an off-the-shelf smartwatch to detect the bite moments and upwards wrist micromovements that occur during a meal session. Afterwards, we process the upwards hand micromovements that appear prior to every detected bite during the meal in order to estimate the bite’s PtM duration. Finally, we use a density-based scheme to estimate the PtM durations distribution and form the in-meal eating behavior profile of the subject. In the results section, we provide validation for every step of the process independently, as well as showcase our findings using a total of three datasets, one collected in a controlled clinical setting using standardized meals (with a total of 28 meal sessions from 7 Healthy Controls (HC) and 21 PD patients) and two collected in-the-wild under free living conditions (37 meals from 4 HC/10 PD patients and 629 meals from 3 HC/3 PD patients, respectively). Experimental results reveal an Area Under the Curve (AUC) of 0.748 for the clinical dataset and 0.775/1.000 for the in-the-wild datasets towards the classification of in-meal eating behavior profiles to the PD or HC group. This is the first work that attempts to use wearable Inertial Measurement Unit (IMU) sensor data, collected both in clinical and in-the-wild settings, towards the extraction of an objective eating behavior indicator for PD.
Collapse
|
20
|
Perez-Pozuelo I, Spathis D, Clifton EA, Mascolo C. Wearables, smartphones, and artificial intelligence for digital phenotyping and health. Digit Health 2021. [DOI: 10.1016/b978-0-12-820077-3.00003-1] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022] Open
|
21
|
Papadopoulos A, Iakovakis D, Klingelhoefer L, Bostantjopoulou S, Chaudhuri KR, Kyritsis K, Hadjidimitriou S, Charisis V, Hadjileontiadis LJ, Delopoulos A. Unobtrusive detection of Parkinson's disease from multi-modal and in-the-wild sensor data using deep learning techniques. Sci Rep 2020; 10:21370. [PMID: 33288807 DOI: 10.1038/s41598-020-78418-8] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2020] [Accepted: 11/17/2020] [Indexed: 11/17/2022] Open
Abstract
Parkinson’s Disease (PD) is the second most common neurodegenerative disorder, affecting more than 1% of the population above 60 years old with both motor and non-motor symptoms of escalating severity as it progresses. Since it cannot be cured, treatment options focus on the improvement of PD symptoms. In fact, evidence suggests that early PD intervention has the potential to slow down symptom progression and improve the general quality of life in the long term. However, the initial motor symptoms are usually very subtle and, as a result, patients seek medical assistance only when their condition has substantially deteriorated; thus, missing the opportunity for an improved clinical outcome. This situation highlights the need for accessible tools that can screen for early motor PD symptoms and alert individuals to act accordingly. Here we show that PD and its motor symptoms can unobtrusively be detected from the combination of accelerometer and touchscreen typing data that are passively captured during natural user-smartphone interaction. To this end, we introduce a deep learning framework that analyses such data to simultaneously predict tremor, fine-motor impairment and PD. In a validation dataset from 22 clinically-assessed subjects (8 Healthy Controls (HC)/14 PD patients with a total data contribution of 18.305 accelerometer and 2.922 typing sessions), the proposed approach achieved 0.86/0.93 sensitivity/specificity for the binary classification task of HC versus PD. Additional validation on data from 157 subjects (131 HC/26 PD with a total contribution of 76.528 accelerometer and 18.069 typing sessions) with self-reported health status (HC or PD), resulted in area under curve of 0.87, with sensitivity/specificity of 0.92/0.69 and 0.60/0.92 at the operating points of highest sensitivity or specificity, respectively. Our findings suggest that the proposed method can be used as a stepping stone towards the development of an accessible PD screening tool that will passively monitor the subject-smartphone interaction for signs of PD and which could be used to reduce the critical gap between disease onset and start of treatment.
Collapse
|
22
|
Lam KH, Meijer KA, Loonstra FC, Coerver E, Twose J, Redeman E, Moraal B, Barkhof F, de Groot V, Uitdehaag B, Killestein J. Real-world keystroke dynamics are a potentially valid biomarker for clinical disability in multiple sclerosis. Mult Scler 2020; 27:1421-1431. [PMID: 33150823 PMCID: PMC8358561 DOI: 10.1177/1352458520968797] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
Background: Clinical measures in multiple sclerosis (MS) face limitations that may be overcome by utilising smartphone keyboard interactions acquired continuously and remotely during regular typing. Objective: The aim of this study was to determine the reliability and validity of keystroke dynamics to assess clinical aspects of MS. Methods: In total, 102 MS patients and 24 controls were included in this observational study. Keyboard interactions were obtained with the Neurokeys keyboard app. Eight timing-related keystroke features were assessed for reliability with intraclass correlation coefficients (ICCs); construct validity by analysing group differences (in fatigue, gadolinium-enhancing lesions on magnetic resonance imaging (MRI), and patients vs controls); and concurrent validity by correlating with disability measures. Results: Reliability was moderate in two (ICC = 0.601 and 0.742) and good to excellent in the remaining six features (ICC = 0.760–0.965). Patients had significantly higher keystroke latencies than controls. Latency between key presses correlated the highest with Expanded Disability Status Scale (r = 0.407) and latency between key releases with Nine-Hole Peg Test and Symbol Digit Modalities Test (ρ = 0.503 and r = −0.553, respectively), ps < 0.001. Conclusion: Keystroke dynamics were reliable, distinguished patients and controls, and were associated with clinical disability measures. Consequently, keystroke dynamics are a promising valid surrogate marker for clinical disability in MS.
Collapse
Affiliation(s)
- K H Lam
- Department of Neurology, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, MS Center Amsterdam, Amsterdam, The Netherlands
| | - K A Meijer
- Neurocast B.V., Amsterdam, The Netherlands
| | - F C Loonstra
- Department of Neurology, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, MS Center Amsterdam, Amsterdam, The Netherlands
| | - Eme Coerver
- Department of Neurology, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, MS Center Amsterdam, Amsterdam, The Netherlands
| | - J Twose
- Neurocast B.V., Amsterdam, The Netherlands
| | - E Redeman
- Neurocast B.V., Amsterdam, The Netherlands
| | - B Moraal
- Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, MS Center Amsterdam, Amsterdam, The Netherlands
| | - F Barkhof
- Department of Radiology and Nuclear Medicine, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, MS Center Amsterdam, Amsterdam, The Netherlands/Queen Square Institute of Neurology and Centre for Medical Image Computing, University College London, London, UK
| | - V de Groot
- Department of Rehabilitation Medicine, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, MS Center Amsterdam, Amsterdam Neuroscience, Amsterdam, The Netherlands
| | - Bmj Uitdehaag
- Department of Neurology, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, MS Center Amsterdam, Amsterdam, The Netherlands
| | - J Killestein
- Department of Neurology, Amsterdam University Medical Centers, Vrije Universiteit Amsterdam, Amsterdam Neuroscience, MS Center Amsterdam, Amsterdam, The Netherlands
| |
Collapse
|
23
|
Twose J, Licitra G, McConchie H, Lam KH, Killestein J. Early-warning signals for disease activity in patients diagnosed with multiple sclerosis based on keystroke dynamics. Chaos 2020; 30:113133. [PMID: 33261343 DOI: 10.1063/5.0022031] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Accepted: 10/21/2020] [Indexed: 06/12/2023]
Abstract
Within data gathered through passive monitoring of patients with Multiple Sclerosis (MS), there is a clear necessity for improved methodological approaches to match the emergence of continuous, objective, measuring technologies. As most gold standards measure infrequently and require clinician presence, fluctuations in the daily progression are not accounted for. Due to the underlying conditions of homogeneity and stationarity (the main tenets of ergodicity) not being met for the majority of the statistical methods employed in the clinical setting, alternative approaches should be investigated. A solution is to use a non-linear time series analysis approach. Here, Early-Warning Signals (EWS) in the form of critical fluctuations in Keystroke Dynamics (KD), collected using participant's smartphones, are investigated as indicators for a clinical change in three groups. These are patients with MS and changes in Magnetic Resonance Imaging (MRI), patients with MS but without changes in MRI, and healthy controls (HCs). Here, we report examples of EWS and changes in KD coinciding with clinically relevant changes in outcome measures in both patients with and without differences in the amount of MRI enhancing lesions. We also report no clinically relevant changes in EWS in the HC population. This study is a first promising step toward using EWS to identify periods of instability as measured by a continuous objective measure as a proxy for outcome measures in the field of MS.
Collapse
Affiliation(s)
- J Twose
- Neurocast B.V., Amsterdam 1097DN, The Netherlands
| | - G Licitra
- Neurocast B.V., Amsterdam 1097DN, The Netherlands
| | - H McConchie
- Neurocast B.V., Amsterdam 1097DN, The Netherlands
| | - K H Lam
- Department of Neurology, Amsterdam University Medical Centers, Amsterdam 1105AZ, The Netherlands
| | - J Killestein
- Department of Neurology, Amsterdam University Medical Centers, Amsterdam 1105AZ, The Netherlands
| |
Collapse
|
24
|
Sanderson JB, Yu JH, Liu DD, Amaya D, Lauro PM, D'Abreu A, Akbar U, Lee S, Asaad WF. Multi-Dimensional, Short-Timescale Quantification of Parkinson's Disease and Essential Tremor Motor Dysfunction. Front Neurol 2020; 11:886. [PMID: 33071924 PMCID: PMC7530842 DOI: 10.3389/fneur.2020.00886] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/21/2020] [Accepted: 07/10/2020] [Indexed: 12/18/2022] Open
Abstract
Introduction: Parkinson's disease (PD) is a progressive movement disorder characterized by heterogenous motor dysfunction with fluctuations in severity. Objective, short-timescale characterization of this dysfunction is necessary as therapies become increasingly adaptive. Objectives: This study aims to characterize a novel, naturalistic, and goal-directed tablet-based task and complementary analysis protocol designed to characterize the motor features of PD. Methods: A total of 26 patients with PD and without deep brain stimulation (DBS), 20 control subjects, and eight patients with PD and with DBS completed the task. Eight metrics, each designed to capture an aspect of motor dysfunction in PD, were calculated from 1-second, non-overlapping epochs of the raw positional and pressure data captured during task completion. These metrics were used to generate a classifier using a support vector machine (SVM) model to produce a unifying, scalar “motor error score” (MES). The data generated from these patients with PD were compared to same-day standard clinical assessments. Additionally, these data were compared to analogous data generated from a separate group of 12 patients with essential tremor (ET) to assess the task's specificity for different movement disorders. Finally, an SVM model was generated for each of the eight patients with PD and with DBS to differentiate between their motor dysfunction in the “DBS On” and “DBS Off” stimulation states. Results: The eight metrics calculated from the raw positional and force data captured during task completion were non-redundant. MES generated by the SVM analysis protocol showed a strong correlation with MDS-UPDRS-III scores assigned by movement disorder specialists. Analysis of the relative contributions of each of the eight metrics showed a significant difference between the motor dysfunction of PD and ET. Much of this difference was attributable to the homogenous, tremor-dominant phenotype of ET motor dysfunction. Finally, in individual patients with PD with DBS, task performance and subsequent SVM classification effectively differentiated between the “DBS On” and “DBS Off” stimulation states. Conclusion: This tablet-based task and analysis protocol correlated strongly with expert clinical assessments of PD motor dysfunction. Additionally, the task showed specificity for PD when compared to ET, another common movement disorder. This specificity was driven by the relative heterogeneity of motor dysfunction of PD compared to ET. Finally, the task was able to distinguish between the “DBS On” and “DBS Off” states within single patients with PD. This task provides temporally-precise and specific information about motor dysfunction in at least two movement disorders that could feasibly correlate to neural activity.
Collapse
Affiliation(s)
- John B Sanderson
- The Warren Alpert Medical School, Brown University, Providence, RI, United States
| | - James H Yu
- The Warren Alpert Medical School, Brown University, Providence, RI, United States
| | - David D Liu
- The Warren Alpert Medical School, Brown University, Providence, RI, United States.,Department of Neurosurgery, Rhode Island Hospital, Providence, RI, United States
| | - Daniel Amaya
- Department of Neuroscience, Brown University, Providence, RI, United States.,Carney Institute for Brain Science, Brown University, Providence, RI, United States.,Norman Prince Neurosciences Institute, Rhode Island Hospital, Providence, RI, United States
| | - Peter M Lauro
- The Warren Alpert Medical School, Brown University, Providence, RI, United States.,Department of Neuroscience, Brown University, Providence, RI, United States.,Carney Institute for Brain Science, Brown University, Providence, RI, United States.,Norman Prince Neurosciences Institute, Rhode Island Hospital, Providence, RI, United States
| | - Anelyssa D'Abreu
- The Warren Alpert Medical School, Brown University, Providence, RI, United States.,Norman Prince Neurosciences Institute, Rhode Island Hospital, Providence, RI, United States.,Department of Neurology, Rhode Island Hospital, Providence, RI, United States
| | - Umer Akbar
- The Warren Alpert Medical School, Brown University, Providence, RI, United States.,Norman Prince Neurosciences Institute, Rhode Island Hospital, Providence, RI, United States.,Department of Neurology, Rhode Island Hospital, Providence, RI, United States
| | - Shane Lee
- Department of Neuroscience, Brown University, Providence, RI, United States.,Carney Institute for Brain Science, Brown University, Providence, RI, United States.,Norman Prince Neurosciences Institute, Rhode Island Hospital, Providence, RI, United States
| | - Wael F Asaad
- The Warren Alpert Medical School, Brown University, Providence, RI, United States.,Department of Neurosurgery, Rhode Island Hospital, Providence, RI, United States.,Department of Neuroscience, Brown University, Providence, RI, United States.,Carney Institute for Brain Science, Brown University, Providence, RI, United States.,Norman Prince Neurosciences Institute, Rhode Island Hospital, Providence, RI, United States
| |
Collapse
|
25
|
Kyritsis K, Fagerberg P, Ioakimidis I, Klingelhoefer L, Reichmann H, Delopoulos A. Using IMU Sensors to Assess Motor Degradation of PD Patients by Modeling In-meal Plate-to-Mouth Movement Elongation. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2020:494-497. [PMID: 33018035 DOI: 10.1109/embc44109.2020.9175615] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Parkinson's disease (PD) is the second most common age-related neurodegenerative disorder after Alzheimer's disease, associated, among others, with motor symptoms such as resting tremor, rigidity and bradykinesia. At the same time, early diagnosis of PD is hindered by a high misdiagnosis rate and the subjective nature of the diagnosis process itself. Recent developments in mobile and wearable devices, such as smartphones and smartwatches, have allowed the automated detection and objective measurement of PD symptoms. In this paper we investigate the hypothesis that PD motor symptom degradation can be assessed by studying the in-meal behavior and modeling the food intake process. To achieve this, we use the inertial data from a commercial smartwatch to investigate the in-meal eating behavior of healthy controls and PD patients. In addition, we define and provide a methodology for calculating Plate-to-Mouth (PtM), an indicator that relates with the average time that the hand spends transferring food from the plate towards the mouth during the course of a meal. The presented experimental results, using our collected dataset of 28 participants (7 healthy controls and 21 PD patients), support our hypothesis. Results initially point out that PD patients have a higher PtM value than the healthy controls. Finally, using PtM we achieve a precision/recall/F1 of 0.882/0.714/0.789 towards classifying the meals from the PD patients and healthy controls.
Collapse
|
26
|
Iakovakis D, Mastoras RE, Hadjidimitriou S, Charisis V, Bostanjopoulou S, Katsarou Z, Klingelhoefer L, Reichmann H, Trivedi D, Chaudhuri RK, Hadjileontiadis LJ, D S, D J. Smartwatch-based Activity Analysis During Sleep for Early Parkinson's Disease Detection. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2020:4326-4329. [PMID: 33018953 DOI: 10.1109/embc44109.2020.9176412] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Parkinson's Disease (PD) is the second most common neurodegenerative disorder with the non-motor symptoms preceding the motor impairment that is needed for clinical diagnosis. In the current study, an angle-based analysis that processes activity data during sleep from a smartwatch for quantification of sleep quality, when applied on controls and PD patients, is proposed. Initially, changes in their arm angle due to activity are captured from the smartwatch triaxial accelerometry data and used for the estimation of the corresponding binary state (awake/sleep). Then, sleep metrics (i.e., sleep efficiency index, total sleep time, sleep fragmentation index, sleep onset latency, and wake after sleep onset) are computed and used for the discrimination between controls and PD patients. A process of validation of the proposed approach when compared with the PSG-based ground truth in an in-the-clinic setting, resulted in comparable state estimation. Moreover, data from 15 early PD patients and 11 healthy controls were used as a test set, including 1,376 valid sleep recordings in-the-wild setting. The univariate analysis of the extracted sleep metrics achieved up to 0.77 AUC in early PD patients vs. healthy controls classification and exhibited a statistically significant correlation (up to 0.46) with the clinical PD Sleep Scale 2 counterpart Items. The findings of the proposed method show the potentiality to capture non-motor behavior from users' nocturnal activity to detect PD in the early stage.
Collapse
|
27
|
Butt AH, Rovini E, Fujita H, Maremmani C, Cavallo F. Data-Driven Models for Objective Grading Improvement of Parkinson's Disease. Ann Biomed Eng 2020; 48:2976-2987. [PMID: 33006005 PMCID: PMC7723941 DOI: 10.1007/s10439-020-02628-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2020] [Accepted: 09/18/2020] [Indexed: 12/20/2022]
Abstract
Parkinson's disease (PD) is a progressive disorder of the central nervous system that causes motor dysfunctions in affected patients. Objective assessment of symptoms can support neurologists in fine evaluations, improving patients' quality of care. Herein, this study aimed to develop data-driven models based on regression algorithms to investigate the potential of kinematic features to predict PD severity levels. Sixty-four patients with PD (PwPD) and 50 healthy subjects of control (HC) were asked to perform 13 motor tasks from the MDS-UPDRS III while wearing wearable inertial sensors. Simultaneously, the clinician provided the evaluation of the tasks based on the MDS-UPDRS scores. One hundred-ninety kinematic features were extracted from the inertial motor data. Data processing and statistical analysis identified a set of parameters able to distinguish between HC and PwPD. Then, multiple feature selection methods allowed selecting the best subset of parameters for obtaining the greatest accuracy when used as input for several predicting regression algorithms. The maximum correlation coefficient, equal to 0.814, was obtained with the adaptive neuro-fuzzy inference system (ANFIS). Therefore, this predictive model could be useful as a decision support system for a reliable objective assessment of PD severity levels based on motion performance, improving patients monitoring over time.
Collapse
Affiliation(s)
- Abdul Haleem Butt
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio, 34, 56025, Pontedera, Italy.,Department of Excellence in Robotics & AI, Scuola Superiore Sant'Anna, Piazza Martiri della Libertà 33, 56127, Pisa, Italy.,The Creative Technology Department, Faculty of Computing and Artificial Intelligence, Air University Islamabad Pakistan, Service Road E-9/E-8, Islamabad, Pakistan
| | - Erika Rovini
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio, 34, 56025, Pontedera, Italy.,Department of Excellence in Robotics & AI, Scuola Superiore Sant'Anna, Piazza Martiri della Libertà 33, 56127, Pisa, Italy
| | - Hamido Fujita
- Intelligent Software Systems Lab, Iwate Prefectural University, 152-52, Sugo, Takizawa, Iwate, Japan
| | - Carlo Maremmani
- U.O. Neurologia, Ospedale delle Apuane (AUSL Toscana Nord Ovest), Viale Mattei 21, 54100, Massa, Italy
| | - Filippo Cavallo
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Viale Rinaldo Piaggio, 34, 56025, Pontedera, Italy. .,Department of Excellence in Robotics & AI, Scuola Superiore Sant'Anna, Piazza Martiri della Libertà 33, 56127, Pisa, Italy. .,The Department of Industrial Engineering, University of Florence, Via Santa Marta 3, 50139, Florence, Italy.
| |
Collapse
|
28
|
Peachap AB, Tchiotsop D, Louis-dorr V, Wolf D. Detection of early Parkinson’s disease with wavelet features using finger typing movements on a keyboard. SN Appl Sci 2020; 2. [DOI: 10.1007/s42452-020-03473-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022] Open
|
29
|
Iakovakis D, Chaudhuri KR, Klingelhoefer L, Bostantjopoulou S, Katsarou Z, Trivedi D, Reichmann H, Hadjidimitriou S, Charisis V, Hadjileontiadis LJ. Screening of Parkinsonian subtle fine-motor impairment from touchscreen typing via deep learning. Sci Rep 2020; 10:12623. [PMID: 32724210 DOI: 10.1038/s41598-020-69369-1] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Accepted: 06/30/2020] [Indexed: 11/22/2022] Open
Abstract
Fine-motor impairment (FMI) is progressively expressed in early Parkinson’s Disease (PD) patients and is now known to be evident in the immediate prodromal stage of the condition. The clinical techniques for detecting FMI may not be robust enough and here, we show that the subtle FMI of early PD patients can be effectively estimated from the analysis of natural smartphone touchscreen typing via deep learning networks, trained in stages of initialization and fine-tuning. In a validation dataset of 36,000 typing sessions from 39 subjects (17 healthy/22 PD patients with medically validated UPDRS Part III single-item scores), the proposed approach achieved values of area under the receiver operating characteristic curve (AUC) of 0.89 (95% confidence interval: 0.80–0.96) with sensitivity/specificity: 0.90/0.83. The derived estimations result in statistically significant (\documentclass[12pt]{minimal}
\usepackage{amsmath}
\usepackage{wasysym}
\usepackage{amsfonts}
\usepackage{amssymb}
\usepackage{amsbsy}
\usepackage{mathrsfs}
\usepackage{upgreek}
\setlength{\oddsidemargin}{-69pt}
\begin{document}$$p<0.05$$\end{document}p<0.05) correlation of 0.66/0.73/0.58 with the clinical standard UPDRS Part III items 22/23/31, respectively. Further validation analysis on 9 de novo PD patients vs. 17 healthy controls classification resulted in AUC of 0.97 (0.93–1.00) with 0.93/0.90. For 253 remote study participants, with self-reported health status providing 252.000 typing sessions via a touchscreen typing data acquisition mobile app (iPrognosis), the proposed approach predicted 0.79 AUC (0.66–0.91) with 0.76/0.71. Remote and unobtrusive screening of subtle FMI via natural smartphone usage, may assist in consolidating early and accurate diagnosis of PD.
Collapse
|
30
|
de Oliveira APS, de Santana MA, Andrade MKS, Gomes JC, Rodrigues MCA, dos Santos WP. Early diagnosis of Parkinson’s disease using EEG, machine learning and partial directed coherence. ACTA ACUST UNITED AC 2020; 36:311-31. [DOI: 10.1007/s42600-020-00072-w] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
|
31
|
Iakovakis D, Diniz JA, Trivedi D, Chaudhuri RK, Hadjileontiadis LJ, Hadjidimitriou S, Charisis V, Bostanjopoulou S, Katsarou Z, Klingelhoefer L, Mayer S, Reichmann H, Dias SB. Early Parkinson's Disease Detection via Touchscreen Typing Analysis using Convolutional Neural Networks. Annu Int Conf IEEE Eng Med Biol Soc 2020; 2019:3535-3538. [PMID: 31946641 DOI: 10.1109/embc.2019.8857211] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Parkinson's Disease (PD) is the second most common neurodegenerative disorder worldwide, causing both motor and non-motor symptoms. In the early stages, symptoms are mild and patients may ignore their existence. As a result, they do not undergo any related clinical examination; hence delaying their PD diagnosis. In an effort to remedy such delay, analysis of data passively captured from user's interaction with consumer technologies has been recently explored towards remote screening of early PD motor signs. In the current study, a smartphone-based method analyzing subjects' finger interaction with the smartphone screen is developed for the quantification of fine-motor skills decline in early PD using Convolutional Neural Networks. Experimental results from the analysis of keystroke typing in-the-clinic data from 18 early PD patients and 15 healthy controls have shown a classification performance of 0.89 Area Under the Curve (AUC) with 0.79/0.79 sensitivity/specificity, respectively. Evaluation of the generalization ability of the proposed approach was made by its application on typing data arising from a separate self-reported cohort of 27 PD patients' and 84 healthy controls' daily usage with their personal smartphones (data in-the-wild), achieving 0.79 AUC with 0.74/0.78 sensitivity/specificity, respectively. The results show the potentiality of the proposed approach to process keystroke dynamics arising from users' natural typing activity to detect PD, which contributes to the development of digital tools for remote pathological symptom screening.
Collapse
|
32
|
Papadopoulos A, Kyritsis K, Klingelhoefer L, Bostanjopoulou S, Chaudhuri KR, Delopoulos A. Detecting Parkinsonian Tremor From IMU Data Collected in-the-Wild Using Deep Multiple-Instance Learning. IEEE J Biomed Health Inform 2019; 24:2559-2569. [PMID: 31880570 DOI: 10.1109/jbhi.2019.2961748] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Parkinson's Disease (PD) is a slowly evolving neurological disease that affects about [Formula: see text] of the population above 60 years old, causing symptoms that are subtle at first, but whose intensity increases as the disease progresses. Automated detection of these symptoms could offer clues as to the early onset of the disease, thus improving the expected clinical outcomes of the patients via appropriately targeted interventions. This potential has led many researchers to develop methods that use widely available sensors to measure and quantify the presence of PD symptoms such as tremor, rigidity and braykinesia. However, most of these approaches operate under controlled settings, such as in lab or at home, thus limiting their applicability under free-living conditions. In this work, we present a method for automatically identifying tremorous episodes related to PD, based on IMU signals captured via a smartphone device. We propose a Multiple-Instance Learning approach, wherein a subject is represented as an unordered bag of accelerometer signal segments and a single, expert-provided, tremor annotation. Our method combines deep feature learning with a learnable pooling stage that is able to identify key instances within the subject bag, while still being trainable end-to-end. We validate our algorithm on a newly introduced dataset of 45 subjects, containing accelerometer signals collected entirely in-the-wild. The good classification performance obtained in the conducted experiments suggests that the proposed method can efficiently navigate the noisy environment of in-the-wild recordings.
Collapse
|
33
|
Youngmann B, Allerhand L, Paltiel O, Yom-Tov E, Arkadir D. A machine learning algorithm successfully screens for Parkinson's in web users. Ann Clin Transl Neurol 2019; 6:2503-2509. [PMID: 31714022 PMCID: PMC6917308 DOI: 10.1002/acn3.50945] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2019] [Accepted: 10/21/2019] [Indexed: 12/17/2022] Open
Abstract
Objective To develop, apply, and evaluate, a novel web‐based classifier for screening for Parkinson disease among a large cohort of search engine users. Methods A supervised machine learning classifier learned to distinguish web users with self‐reported Parkinson's disease from controls based on their interactions with a search engine (Bing, Microsoft). It was then applied to groups of web users with low or high risk for actual Parkinson's disease. Textual content of web queries was used to sort surfers into the different risk groups, but not for classifying users as negative or positive for Parkinson's disease. Disease detection was unsolicited. Researchers did not have access to any identifying data on users. Results Applying the classifier (with an estimated positive predictive value of 25%) resulted in 17,843/1,490,987 (1.2%) web users over the age of 40 years screened positive for Parkinson's disease. This percentile was higher in at‐risk groups (Fisher exact P < 0.00001), including users who searched for information regarding the disease (518/804, 64.4%), and users with non‐motor Parkinson's symptom or with an affected relative (57/1064, 5.3%). Longitudinal follow‐up revealed that in all studied groups individuals classified as having the disease showed a higher mean rate of progression in disease‐related features (t‐test P < 0.05). Interpretation An automatic classifier, based on mouse and keyboard interactions with a search engine, is able to reliably trace individuals at high risk for actual Parkinson's disease as well as to demonstrate more rapid progression of disease‐related signs in those who screened positive. This ability raises novel ethical issues.
Collapse
Affiliation(s)
| | | | - Ora Paltiel
- Braun School of Public Health and Community Medicine, Hadassah-Hebrew University, Jerusalem, Israel
| | - Elad Yom-Tov
- Microsoft Research, Herzliya, Israel.,Faculty of Industrial Engineering and Management, Technion, Haifa, Israel
| | - David Arkadir
- Department of Neurology, Hadassah Hebrew University, Jerusalem, Israel
| |
Collapse
|
34
|
Mastoras RE, Iakovakis D, Hadjidimitriou S, Charisis V, Kassie S, Alsaadi T, Khandoker A, Hadjileontiadis LJ. Touchscreen typing pattern analysis for remote detection of the depressive tendency. Sci Rep 2019; 9:13414. [PMID: 31527640 DOI: 10.1038/s41598-019-50002-9] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2019] [Accepted: 09/04/2019] [Indexed: 11/08/2022] Open
Abstract
Depressive disorder (DD) is a mental illness affecting more than 300 million people worldwide, whereas social stigma and subtle, variant symptoms impede diagnosis. Psychomotor retardation is a common component of DD with a negative impact on motor function, usually reflected on patients’ routine activities, including, nowadays, their interaction with mobile devices. Therefore, such interactions constitute an enticing source of information towards unsupervised screening for DD symptoms in daily life. In this vein, this paper proposes a machine learning-based method for discriminating between subjects with depressive tendency and healthy controls, as denoted by self-reported Patient Health Questionnaire-9 (PHQ-9) compound scores, based on typing patterns captured in-the-wild. The latter consisted of keystroke timing sequences and typing metadata, passively collected during natural typing on touchscreen smartphones by 11/14 subjects with/without depressive tendency. Statistical features were extracted and tested in univariate and multivariate classification pipelines to reach a decision on subjects’ status. The best-performing pipeline achieved an AUC = 0.89 (0.72–1.00; 95% Confidence Interval) and 0.82/0.86 sensitivity/specificity, with the outputted probabilities significantly correlating (>0.60) with the respective PHQ-9 scores. This work adds to the findings of previous research associating typing patterns with psycho-motor impairment and contributes to the development of an unobtrusive, high-frequency monitoring of depressive tendency in everyday living.
Collapse
|
35
|
Wehbe R, Frangieh J, Rima M, El Obeid D, Sabatier JM, Fajloun Z. Bee Venom: Overview of Main Compounds and Bioactivities for Therapeutic Interests. Molecules 2019; 24:E2997. [PMID: 31430861 DOI: 10.3390/molecules24162997] [Citation(s) in RCA: 129] [Impact Index Per Article: 25.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2019] [Revised: 08/14/2019] [Accepted: 08/16/2019] [Indexed: 11/17/2022] Open
Abstract
Apitherapy is an alternate therapy that relies on the usage of honeybee products, most importantly bee venom for the treatment of many human diseases. The venom can be introduced into the human body by manual injection or by direct bee stings. Bee venom contains several active molecules such as peptides and enzymes that have advantageous potential in treating inflammation and central nervous system diseases, such as Parkinson's disease, Alzheimer's disease, and amyotrophic lateral sclerosis. Moreover, bee venom has shown promising benefits against different types of cancer as well as anti-viral activity, even against the challenging human immunodeficiency virus (HIV). Many studies described biological activities of bee venom components and launched preclinical trials to improve the potential use of apitoxin and its constituents as the next generation of drugs. The aim of this review is to summarize the main compounds of bee venom, their primary biological properties, mechanisms of action, and their therapeutic values in alternative therapy strategies.
Collapse
|
36
|
Belić M, Bobić V, Badža M, Šolaja N, Đurić-Jovičić M, Kostić VS. Artificial intelligence for assisting diagnostics and assessment of Parkinson's disease-A review. Clin Neurol Neurosurg 2019; 184:105442. [PMID: 31351213 DOI: 10.1016/j.clineuro.2019.105442] [Citation(s) in RCA: 48] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2019] [Revised: 05/31/2019] [Accepted: 07/11/2019] [Indexed: 01/30/2023]
Abstract
Artificial intelligence, specifically machine learning, has found numerous applications in computer-aided diagnostics, monitoring and management of neurodegenerative movement disorders of parkinsonian type. These tasks are not trivial due to high inter-subject variability and similarity of clinical presentations of different neurodegenerative disorders in the early stages. This paper aims to give a comprehensive, high-level overview of applications of artificial intelligence through machine learning algorithms in kinematic analysis of movement disorders, specifically Parkinson's disease (PD). We surveyed papers published between January 2007 and January 2019, within online databases, including PubMed and Science Direct, with a focus on the most recently published studies. The search encompassed papers dealing with the implementation of machine learning algorithms for diagnosis and assessment of PD using data describing motion of upper and lower extremities. This systematic review presents an overview of 48 relevant studies published in the abovementioned period, which investigate the use of artificial intelligence for diagnostics, therapy assessment and progress prediction in PD based on body kinematics. Different machine learning algorithms showed promising results, particularly for early PD diagnostics. The investigated publications demonstrated the potentials of collecting data from affordable and globally available devices. However, to fully exploit artificial intelligence technologies in the future, more widespread collaboration is advised among medical institutions, clinicians and researchers, to facilitate aligning of data collection protocols, sharing and merging of data sets.
Collapse
Affiliation(s)
- Minja Belić
- Innovation Center, School of Electrical Engineering, University of Belgrade, Belgrade, Serbia.
| | - Vladislava Bobić
- Innovation Center, School of Electrical Engineering, University of Belgrade, Belgrade, Serbia; School of Electrical Engineering, University of Belgrade, Belgrade, Serbia.
| | - Milica Badža
- Innovation Center, School of Electrical Engineering, University of Belgrade, Belgrade, Serbia; School of Electrical Engineering, University of Belgrade, Belgrade, Serbia.
| | - Nikola Šolaja
- School of Electrical Engineering, University of Belgrade, Belgrade, Serbia.
| | - Milica Đurić-Jovičić
- Innovation Center, School of Electrical Engineering, University of Belgrade, Belgrade, Serbia.
| | - Vladimir S Kostić
- Clinic of Neurology, School of Medicine, University of Belgrade, Belgrade, Serbia.
| |
Collapse
|
37
|
Iakovakis D, Hadjidimitriou S, Charisis V, Bostantjopoulou S, Katsarou Z, Klingelhoefer L, Reichmann H, Dias SB, Diniz JA, Trivedi D, Chaudhuri KR, Hadjileontiadis LJ. Motor Impairment Estimates via Touchscreen Typing Dynamics Toward Parkinson's Disease Detection From Data Harvested In-the-Wild. ACTA ACUST UNITED AC 2018. [DOI: 10.3389/fict.2018.00028] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
|