Novel Digital Biomarkers for Fine Motor Skills Assessment in Psoriatic Arthritis: The DaktylAct Touch-Based Serious Game Approach

Psoriatic Arthritis (PsA) is a chronic, inflammatory disease affecting joints, substantially impacting patients' quality of life, with European guidelines for managing PsA emphasizing the importance of assessing hand function. Here, we present a set of novel digital biomarkers (dBMs) derived from a touchscreen-based serious game approach, DaktylAct, intended as a proxy, gamified, objective assessment of hand impairment, with emphasis on fine motor skills, caused by PsA. This is achieved by its design, where the user controls a cannon to aim at and hit targets using two finger pinch-in/out and wrist rotation gestures. In-game metrics (targets hit and score) and statistical features (mean, standard deviation) of gameplay actions (duration of gestures, applied pressure, and wrist rotation angle) produced during gameplay serve as informative dBMs. DaktylAct was tested on a cohort comprising 16 clinically verified PsA patients and nine healthy controls (HC). Correlation analysis demonstrated a positive correlation between average pinch-in duration and disease activity (DA) and a negative correlation between standard deviation of applied pressure during wrist rotation and joint inflammation. Logistic regression models achieved 83% and 91% classification performance discriminating HC from PsA patients with low DA (LDA) and PsA patients with and without joint inflammation, respectively. Results presented here are promising and create a proof-of-concept, paving the way for further validation in larger cohorts.

Monipar: movement data collection tool to monitor motor symptoms in Parkinson's disease using smartwatches and smartphones

Introduction

Parkinson's disease (PD) is a neurodegenerative disorder commonly characterized by motor impairments. The development of mobile health (m-health) technologies, such as wearable and smart devices, presents an opportunity for the implementation of clinical tools that can support tasks such as early diagnosis and objective quantification of symptoms.

Objective

This study evaluates a framework to monitor motor symptoms of PD patients based on the performance of standardized exercises such as those performed during clinic evaluation. To implement this framework, an m-health tool named Monipar was developed that uses off-the-shelf smart devices.

Methods

An experimental protocol was conducted with the participation of 21 early-stage PD patients and 7 healthy controls who used Monipar installed in off-the-shelf smartwatches and smartphones. Movement data collected using the built-in acceleration sensors were used to extract relevant digital indicators (features). These indicators were then compared with clinical evaluations performed using the MDS-UPDRS scale.

Results

The results showed moderate to strong (significant) correlations between the clinical evaluations (MDS-UPDRS scale) and features extracted from the movement data used to assess resting tremor (i.e., the standard deviation of the time series: r = 0.772, p < 0.001) and data from the pronation and supination movements (i.e., power in the band of 1-4 Hz: r = -0.662, p < 0.001).

Conclusion

These results suggest that the proposed framework could be used as a complementary tool for the evaluation of motor symptoms in early-stage PD patients, providing a feasible and cost-effective solution for remote and ambulatory monitoring of specific motor symptoms such as resting tremor or bradykinesia.

An Internet- and Kinect-Based Multiple Sclerosis Fitness Intervention Training With Pilates Exercises: Development and Usability Study

BACKGROUND

Balance impairments are common in people with multiple sclerosis (MS), with reduced ability to maintain position and delayed responses to postural adjustments. Pilates is a popular alternative method for balance training that may reduce the rapid worsening of symptoms and the increased risk of secondary conditions (eg, depression) that are frequently associated with physical inactivity.

OBJECTIVE

In this paper, we aimed to describe the design, development, and usability testing of MS Fitness Intervention Training (MS-FIT), a Kinect-based tool implementing Pilates exercises customized for MS.

METHODS

MS-FIT has been developed using a user-centered design approach (design, prototype, user feedback, and analysis) to gain the target user's perspective. A team composed of 1 physical therapist, 2 game programmers, and 1 game designer developed the first version of MS-FIT that integrated the knowledge and experience of the team with MS literature findings related to Pilates exercises and balance interventions based on exergames. MS-FIT, developed by using the Unity 3D (Unity Technologies) game engine software with Kinect Sensor V2 for Windows, implements exercises for breathing, posture, and balance. Feedback from an Italian panel of experts in MS rehabilitation (neurologists, physiatrists, physical therapists, 1 statistician, and 1 bioengineer) and people with MS was collected to customize the tool for use in MS. The context of MS-FIT is traveling around the world to visit some of the most important cities to learn the aspects of their culture through pictures and stories. At each stay of the travel, the avatar of a Pilates teacher shows the user the exercises to be performed. Overall, 9 people with MS (n=4, 44% women; mean age 42.89, SD 11.97 years; mean disease duration 10.19, SD 9.18 years; Expanded Disability Status Scale score 3.17, SD 0.75) were involved in 3 outpatient user test sessions of 30 minutes; MS-FIT's usability was assessed through an ad hoc questionnaire (maximum value=5; higher the score, higher the usability) evaluating easiness to use, playability, enjoyment, satisfaction, and acceptance.

RESULTS

A user-centered design approach was used to develop an accessible and challenging tool for balance training. All people with MS (9/9, 100%) completed the user test sessions and answered the ad hoc questionnaire. The average score on each item ranged from 3.78 (SD 0.67) to 4.33 (SD 1.00), which indicated a high usability level. The feedback and suggestions provided by 64% (9/14) of people with MS and 36% (5/14) of therapists involved in the user test were implemented to refine the first prototype to release MS-FIT 2.0.

CONCLUSIONS

The participants reported that MS-FIT was a usable tool. It is a promising system for enhancing the motivation and engagement of people with MS in performing exercise with the aim of improving their physical status.

Leveraging Unlabelled Data in Multiple-Instance Learning Problems for Improved Detection of Parkinsonian Tremor in Free-Living Conditions

Data-driven approaches for remote detection of Parkinson's Disease and its motor symptoms have proliferated in recent years, owing to the potential clinical benefits of early diagnosis. The holy grail of such approaches is the free-living scenario, in which data are collected continuously and unobtrusively during every day life. However, obtaining fine-grained ground-truth and remaining unobtrusive is a contradiction and therefore, the problem is usually addressed via multiple-instance learning. Yet for large scale studies, obtaining even the necessary coarse ground-truth is not trivial, as a complete neurological evaluation is required. In contrast, large scale collection of data without any ground-truth is much easier. Nevertheless, utilizing unlabelled data in a multiple-instance setting is not straightforward, as the topic has received very little research attention. Here we try to fill this gap by introducing a new method for combining semi-supervised with multiple-instance learning. Our approach builds on the Virtual Adversarial Training principle, a state-of-the-art approach for regular semi-supervised learning, which we adapt and modify appropriately for the multiple-instance setting. We first establish the validity of the proposed approach through proof-of-concept experiments on synthetic problems generated from two well-known benchmark datasets. We then move on to the actual task of detecting PD tremor from hand acceleration signals collected in-the-wild, but in the presence of additional completely unlabelled data. We show that by leveraging the unlabelled data of 454 subjects we can achieve large performance gains (up to 9% increase in F1-score) in per-subject tremor detection for a cohort of 45 subjects with known tremor ground-truth. In doing so, we confirm the validity of our approach on a real-world problem where the need for semi-supervised and multiple-instance learning arises naturally.

A generic optimization and learning framework for Parkinson disease via speech and handwritten records

Parkinson's disease (PD) is a neurodegenerative disorder with slow progression whose symptoms can be identified at late stages. Early diagnosis and treatment of PD can help to relieve the symptoms and delay progression. However, this is very challenging due to the similarities between the symptoms of PD and other diseases. The current study proposes a generic framework for the diagnosis of PD using handwritten images and (or) speech signals. For the handwriting images, 8 pre-trained convolutional neural networks (CNN) via transfer learning tuned by Aquila Optimizer were trained on the NewHandPD dataset to diagnose PD. For the speech signals, features from the MDVR-KCL dataset are extracted numerically using 16 feature extraction algorithms and fed to 4 different machine learning algorithms tuned by Grid Search algorithm, and graphically using 5 different techniques and fed to the 8 pretrained CNN structures. The authors propose a new technique in extracting the features from the voice dataset based on the segmentation of variable speech-signal-segment-durations, i.e., the use of different durations in the segmentation phase. Using the proposed technique, 5 datasets with 281 numerical features are generated. Results from different experiments are collected and recorded. For the NewHandPD dataset, the best-reported metric is 99.75% using the VGG19 structure. For the MDVR-KCL dataset, the best-reported metrics are 99.94% using the KNN and SVM ML algorithms and the combined numerical features; and 100% using the combined the mel-specgram graphical features and VGG19 structure. These results are better than other state-of-the-art researches.

Users' Perspective on the AI-Based Smartphone PROTEIN App for Personalized Nutrition and Healthy Living: A Modified Technology Acceptance Model (mTAM) Approach

The ubiquitous nature of smartphone ownership, its broad application and usage, along with its interactive delivery of timely feedback are appealing for health-related behavior change interventions via mobile apps. However, users' perspectives about such apps are vital in better bridging the gap between their design intention and effective practical usage. In this vein, a modified technology acceptance model (mTAM) is proposed here, to explain the relationship between users' perspectives when using an AI-based smartphone app for personalized nutrition and healthy living, namely, PROTEIN, and the mTAM constructs toward behavior change in their nutrition and physical activity habits. In particular, online survey data from 85 users of the PROTEIN app within a period of 2 months were subjected to confirmatory factor analysis (CFA) and regression analysis (RA) to reveal the relationship of the mTAM constructs, i.e., perceived usefulness (PU), perceived ease of use (PEoU), perceived novelty (PN), perceived personalization (PP), usage attitude (UA), and usage intention (UI) with the users' behavior change (BC), as expressed via the acceptance/rejection of six related hypotheses (H1-H6), respectively. The resulted CFA-related parameters, i.e., factor loading (FL) with the related p-value, average variance extracted (AVE), and composite reliability (CR), along with the RA results, have shown that all hypotheses H1-H6 can be accepted (p < 0.001). In particular, it was found that, in all cases, FL > 0.5, CR > 0.7, AVE > 0.5, indicating that the items/constructs within the mTAM framework have good convergent validity. Moreover, the adjusted coefficient of determination (R 2) was found within the range of 0.224-0.732, justifying the positive effect of PU, PEoU, PN, and PP on the UA, that in turn positively affects the UI, leading to the BC. Additionally, using a hierarchical RA, a significant change in the prediction of BC from UA when the UI is used as a mediating variable was identified. The explored mTAM framework provides the means for explaining the role of each construct in the functionality of the PROTEIN app as a supportive tool for the users to improve their healthy living by adopting behavior change in their dietary and physical activity habits. The findings herein offer insights and references for formulating new strategies and policies to improve the collaboration among app designers, developers, behavior scientists, nutritionists, physical activity/exercise physiology experts, and marketing experts for app design/development toward behavior change.

Machine Learning-Based Analysis of Digital Movement Assessment and ExerGame Scores for Parkinson's Disease Severity Estimation

Neurodegenerative Parkinson's Disease (PD) is one of the common incurable diseases among the elderly. Clinical assessments are characterized as standardized means for PD diagnosis. However, relying on medical evaluation of a patient's status can be subjective to physicians' experience, making the assessment process susceptible to human errors. The use of ICT-based tools for capturing the status of patients with PD can provide more objective and quantitative metrics. In this vein, the Personalized Serious Game Suite (PGS) and intelligent Motor Assessment Tests (iMAT), produced within the i-PROGNOSIS European project (www.i-prognosis.eu), are explored in the current study. More specifically, data from 27 patients with PD at Stage 1 (9) and Stage 3 (18) produced from their interaction with PGS/iMAT are analyzed. Five feature vector (FV) scenarios are set, including features from PGS or iMAT scores or their combination, after also taking into consideration the age of patients with PD. These FVs are fed into three machine learning classifiers, i.e., K-Nearest Neighbor (KNN), Support Vector Machines (SVM), and Random Forest (RF), to infer the stage of each patient with PD. A Leave-One-Out Cross-Validation (LOOCV) method is adopted for testing the classification performance. The experimental results show that a high (>90%) classification accuracy is achieved from both data sources (PGS/iMAT), justifying the effectiveness of PGS/iMAT to efficiently reflect the motor skill status of patients with PD and further potentiating PGS/iMAT enhancement with a machine learning a part to infer for the stage of patients with PD. Clearly, this integrated approach provides new opportunities for remote monitoring of the stage of patients with PD, contributing to a more efficient organization and set up of personalized interventions.

Assistive HCI-Serious Games Co-design Insights: The Case Study of i-PROGNOSIS Personalized Game Suite for Parkinson's Disease

Human-Computer Interaction (HCI) and games set a new domain in understanding people's motivations in gaming, behavioral implications of game play, game adaptation to player preferences and needs for increased engaging experiences in the context of HCI serious games (HCI-SGs). When the latter relate with people's health status, they can become a part of their daily life as assistive health status monitoring/enhancement systems. Co-designing HCI-SGs can be seen as a combination of art and science that involves a meticulous collaborative process. The design elements in assistive HCI-SGs for Parkinson's Disease (PD) patients, in particular, are explored in the present work. Within this context, the Game-Based Learning (GBL) design framework is adopted here and its main game-design parameters are explored for the Exergames, Dietarygames, Emotional games, Handwriting games, and Voice games design, drawn from the PD-related i-PROGNOSIS Personalized Game Suite (PGS) (www.i-prognosis.eu) holistic approach. Two main data sources were involved in the study. In particular, the first one includes qualitative data from semi-structured interviews, involving 10 PD patients and four clinicians in the co-creation process of the game design, whereas the second one relates with data from an online questionnaire addressed by 104 participants spanning the whole related spectrum, i.e., PD patients, physicians, software/game developers. Linear regression analysis was employed to identify an adapted GBL framework with the most significant game-design parameters, which efficiently predict the transferability of the PGS beneficial effect to real-life, addressing functional PD symptoms. The findings of this work can assist HCI-SG designers for designing PD-related HCI-SGs, as the most significant game-design factors were identified, in terms of adding value to the role of HCI-SGs in increasing PD patients' quality of life, optimizing the interaction with personalized HCI-SGs and, hence, fostering a collaborative human-computer symbiosis.