Acceptability of an In-Home Multimodal Sensor Platform in Parkinson’s Disease: A Qualitative Study (Preprint)

Shifting From Active to Passive Monitoring of Alzheimer Disease: The State of the Research

Most research using digital technologies builds on existing methods for staff-administered evaluation, requiring a large investment of time, effort, and resources. Widespread use of personal mobile devices provides opportunities for continuous health monitoring without active participant engagement. Home-based sensors show promise in evaluating behavioral features in near real time. Digital technologies across these methodologies can detect precise measures of cognition, mood, sleep, gait, speech, motor activity, behavior patterns, and additional features relevant to health. As a neurodegenerative condition with insidious onset, Alzheimer disease and other dementias (AD/D) represent a key target for advances in monitoring disease symptoms. Studies to date evaluating the predictive power of digital measures use inconsistent approaches to characterize these measures. Comparison between different digital collection methods supports the use of passive collection methods in settings in which active participant engagement approaches are not feasible. Additional studies that analyze how digital measures across multiple data streams can together improve prediction of cognitive impairment and early-stage AD are needed. Given the long timeline of progression from normal to diagnosis, digital monitoring will more easily make extended longitudinal follow-up possible. Through the American Heart Association-funded Strategically Focused Research Network, the Boston University investigative team deployed a platform involving a wide range of technologies to address these gaps in research practice. Much more research is needed to thoroughly evaluate limitations of passive monitoring. Multidisciplinary collaborations are needed to establish legal and ethical frameworks for ensuring passive monitoring can be conducted at scale while protecting privacy and security, especially in vulnerable populations.

Machine Learning for Multimodal Mental Health Detection: A Systematic Review of Passive Sensing Approaches

As mental health (MH) disorders become increasingly prevalent, their multifaceted symptoms and comorbidities with other conditions introduce complexity to diagnosis, posing a risk of underdiagnosis. While machine learning (ML) has been explored to mitigate these challenges, we hypothesized that multiple data modalities support more comprehensive detection and that non-intrusive collection approaches better capture natural behaviors. To understand the current trends, we systematically reviewed 184 studies to assess feature extraction, feature fusion, and ML methodologies applied to detect MH disorders from passively sensed multimodal data, including audio and video recordings, social media, smartphones, and wearable devices. Our findings revealed varying correlations of modality-specific features in individualized contexts, potentially influenced by demographics and personalities. We also observed the growing adoption of neural network architectures for model-level fusion and as ML algorithms, which have demonstrated promising efficacy in handling high-dimensional features while modeling within and cross-modality relationships. This work provides future researchers with a clear taxonomy of methodological approaches to multimodal detection of MH disorders to inspire future methodological advancements. The comprehensive analysis also guides and supports future researchers in making informed decisions to select an optimal data source that aligns with specific use cases based on the MH disorder of interest.

A multimodal dataset of real world mobility activities in Parkinson's disease

Parkinson's disease (PD) is a neurodegenerative disorder characterised by motor symptoms such as gait dysfunction and postural instability. Technological tools to continuously monitor outcomes could capture the hour-by-hour symptom fluctuations of PD. Development of such tools is hampered by the lack of labelled datasets from home settings. To this end, we propose REMAP (REal-world Mobility Activities in Parkinson's disease), a human rater-labelled dataset collected in a home-like setting. It includes people with and without PD doing sit-to-stand transitions and turns in gait. These discrete activities are captured from periods of free-living (unobserved, unstructured) and during clinical assessments. The PD participants withheld their dopaminergic medications for a time (causing increased symptoms), so their activities are labelled as being "on" or "off" medications. Accelerometry from wrist-worn wearables and skeleton pose video data is included. We present an open dataset, where the data is coarsened to reduce re-identifiability, and a controlled dataset available on application which contains more refined data. A use-case for the data to estimate sit-to-stand speed and duration is illustrated.

Automated Real-World Video Analysis of Sit-to-Stand Transitions Predicts Parkinson's Disease Severity

Introduction

Technology holds the potential to track disease progression and response to neuroprotective therapies in Parkinson's disease (PD). The sit-to-stand (STS) transition is a frequently occurring event which is important to people with PD. The aim of this study was to demonstrate an automatic approach to quantify STS duration and speed using a real-world free-living dataset and look at clinical correlations of the outcomes, including whether STS parameters change when someone withholds PD medications.

Methods

Eighty-five hours of video data were collected from 24 participants staying in pairs for 5-day periods in a naturalistic setting. Skeleton joints were extracted from the video data; the head trajectory was estimated and used to estimate the STS parameters of duration and speed.

Results

3.14 STS transitions were seen per hour per person on average. Significant correlations were seen between automatic and manual STS duration (Pearson rho - 0.419, p = 0.042) and between automatic STS speed and manual STS duration (Pearson rho - 0.780, p < 0.001). Significant and strong correlations were seen between the gold-standard clinical rating scale scores and both STS duration and STS speed; these correlations were not seen in the STS transitions when the participants were carrying something in their hand(s). Significant differences were seen at the cohort level between control and PD participants' ON medications' STS duration (U = 6,263, p = 0.018) and speed (U = 9,965, p < 0.001). At an individual level, only two participants with PD became significantly slower to STS when they were OFF medications; withholding medications did not significantly change STS duration at an individual level in any participant.

Conclusion

We demonstrate a novel approach to automatically quantify and ecologically validate two STS parameters which correlate with gold-standard clinical tools measuring disease severity in PD.

Understanding how people with Parkinson's disease turn in gait from a real-world in-home dataset

INTRODUCTION

Turning in gait digital parameters may be useful in measuring disease progression in Parkinson's disease (PD), however challenges remain over algorithm validation in real-world settings. The influence of clinician observation on turning outcomes is poorly understood. Our objective is to describe a unique in-home video dataset and explore the use of turning parameters as biomarkers in PD.

METHODS

11 participants with PD, 11 control participants stayed in a home-like setting living freely for 5 days (with two sessions of clinical assessment), during which high-resolution video was captured. Clinicians watched the videos, identified turns and documented turning parameters.

RESULTS

From 85 hours of video 3869 turns were evaluated, averaging at 22.7 turns per hour per person. 6 participants had significantly different numbers of turning steps and/or turn duration between "ON" and "OFF" medication states. Positive Spearman correlations were seen between the Movement Disorders Society-sponsored revision of the Unified Parkinson's Disease Rating Scale III score with a) number of turning steps (rho = 0.893, p < 0.001), and b) duration of turn (rho = 0.744, p = 0.009) "OFF" medications. A positive correlation was seen "ON" medications between number of turning steps and clinical rating scale score (rho = 0.618, p = 0.048). Both cohorts took more steps and shorter durations of turn during observed clinical assessments than when free-living.

CONCLUSION

This study shows proof of concept that real-world free-living turn duration and number of turning steps recorded can distinguish between PD medication states and correlate with gold-standard clinical rating scale scores. It illustrates a methodology for ecological validation of real-world digital outcomes.