Monitoring Activity and Gait in Children (MAGIC) using digital health technologies

BACKGROUND

Digital health technologies (DHTs) can collect gait and physical activity in adults, but limited studies have validated these in children. This study compared gait and physical activity metrics collected using DHTs to those collected by reference comparators during in-clinic sessions, to collect a normative accelerometry dataset, and to evaluate participants' comfort and their compliance in wearing the DHTs at-home.

METHODS

The MAGIC (Monitoring Activity and Gait in Children) study was an analytical validation study which enrolled 40, generally healthy participants aged 3-17 years. Gait and physical activity were collected using DHTs in a clinical setting and continuously at-home.

RESULTS

Overall good to excellent agreement was observed between gait metrics extracted with a gait algorithm from a lumbar-worn DHT compared to ground truth reference systems. Majority of participants either "agreed" or "strongly agreed" that wrist and lumbar DHTs were comfortable to wear at home, respectively, with 86% (wrist-worn DHT) and 68% (lumbar-worn DHT) wear-time compliance. Significant differences across age groups were observed in multiple gait and activity metrics obtained at home.

CONCLUSIONS

Our findings suggest that gait and physical activity data can be collected from DHTs in pediatric populations with high reliability and wear compliance, in-clinic and in home environments.

TRIAL REGISTRATION

ClinicalTrials.gov: NCT04823650 IMPACT: Digital health technologies (DHTs) have been used to collect gait and physical activity in adult populations, but limited studies have validated these metrics in children. The MAGIC study comprehensively validates the performance and feasibility of DHT-measured gait and physical activity in the pediatric population. Our findings suggest that reliable gait and physical activity data can be collected from DHTs in pediatric populations, with both high accuracy and wear compliance both in-clinic and in home environments. The identified across-age-group differences in gait and activity measurements highlighted their potential clinical value.

Monitoring Gait and Physical Activity of Elderly Frail Individuals in Free-Living Environment: A Feasibility Study

INTRODUCTION

Frailty is conventionally diagnosed using clinical tests and self-reported assessments. However, digital health technologies (DHTs), such as wearable accelerometers, can capture physical activity and gait during daily life, enabling more objective assessments. In this study, we assess the feasibility of deploying DHTs in community-dwelling older individuals, and investigate the relationship between digital measurements of physical activity and gait in naturalistic environments and participants' frailty status, as measured by conventional assessments.

METHODS

Fried Frailty Score (FFS) was used to classify fifty healthy individuals as non-frail (FFS = 0, n/female = 21/11, mean ± SD age: 71.10 ± 3.59 years), pre-frail (FFS = 1-2, n/female = 23/9, age: 73.74 ± 5.52 years), or frail (FFS = 3+, n/female = 6/6, age: 70.70 ± 6.53 years). Participants wore wrist-worn and lumbar-worn GENEActiv accelerometers (Activinsights Ltd., Kimbolton, UK) during three in-laboratory visits, and at-home for 2 weeks, to measure physical activity and gait. After this period, they completed a comfort and usability questionnaire. Compliant days at-home were defined as follows: those with ≥18 h of wear time, for the wrist-worn accelerometer, and those with ≥1 detected walking bout, for the lumbar-worn accelerometer. For each at-home measurement, a group analysis was performed using a linear regression model followed by ANOVA, to investigate the effect of frailty on physical activity and gait. Correlation between at-home digital measurements and conventional in-laboratory assessments was also investigated.

RESULTS

Participants were highly compliant in wearing the accelerometers, as 94% indicated willingness to wear the wrist device, and 66% the lumbar device, for at least 1 week. Time spent in sedentary activity and time spent in moderate activity as measured from the wrist device, as well as average gait speed and its 95th percentile from the lumbar device were significantly different between frailty groups. Moderate correlations between digital measurements and self-reported physical activity were found.

CONCLUSIONS

This work highlights the feasibility of deploying DHTs in studies involving older individuals. The potential of digital measurements in distinguishing frailty phenotypes, while unobtrusively collecting unbiased data, thus minimizing participants' travels to sites, will be further assessed in a follow-up study.

Can Gait Characteristics Be Represented by Physical Activity Measured with Wrist-Worn Accelerometers?

Wearable accelerometers allow for continuous monitoring of function and behaviors in the participant's naturalistic environment. Devices are typically worn in different body locations depending on the concept of interest and endpoint under investigation. The lumbar and wrist are commonly used locations: devices placed at the lumbar region enable the derivation of spatio-temporal characteristics of gait, while wrist-worn devices provide measurements of overall physical activity (PA). Deploying multiple devices in clinical trial settings leads to higher patient burden negatively impacting compliance and data quality and increases the operational complexity of the trial. In this work, we evaluated the joint information shared by features derived from the lumbar and wrist devices to assess whether gait characteristics can be adequately represented by PA measured with wrist-worn devices. Data collected at the Pfizer Innovation Research (PfIRe) Lab were used as a real data example, which had around 7 days of continuous at-home data from wrist- and lumbar-worn devices (GENEActiv) obtained from a group of healthy participants. The relationship between wrist- and lumbar-derived features was estimated using multiple statistical methods, including penalized regression, principal component regression, partial least square regression, and joint and individual variation explained (JIVE). By considering multilevel models, both between- and within-subject effects were taken into account. This work demonstrated that selected gait features, which are typically measured with lumbar-worn devices, can be represented by PA features measured with wrist-worn devices, which provides preliminary evidence to reduce the number of devices needed in clinical trials and to increase patients' comfort. Moreover, the statistical methods used in this work provided an analytic framework to compare repeated measures collected from multiple data modalities.

Reliability of Wearable Sensors for Assessing Gait and Chair Stand Function at Home in People With Knee Osteoarthritis

OBJECTIVE

To assess the reliability of wearable sensors for at-home assessment of walking and chair stand activities in people with knee osteoarthritis (OA).

METHODS

Baseline data from participants with knee OA (n = 20) enrolled in a clinical trial of an exercise intervention were used. Participants completed an in-person laboratory visit and a video conference-enabled at-home visit. In both visits, participants performed walking and chair stand tasks while fitted with 3 inertial sensors. During the at-home visit, participants self-donned the sensors and completed 2 sets of acquisitions separated by a 15-minute break, when they removed and redonned the sensors. Participants completed a survey on their experience with the at-home visit. During the laboratory visit, researchers placed the sensors on the participants. Spatiotemporal metrics of walking gait and chair stand duration were extracted from the sensor data. We used intraclass correlation coefficients (ICCs) and the Bland-Altman plot for statistical analyses.

RESULTS

For test-retest reliability during the at-home visit, all ICCs were good to excellent (0.85-0.95). For agreement between at-home and laboratory visits, ICCs were moderate to good (0.59-0.87). Systematic differences were noted between at-home and laboratory data due to faster task speed during the laboratory visits. Participants reported a favorable experience during the at-home visit.

CONCLUSION

Our method of estimating spatiotemporal gait measures and chair stand duration function remotely was reliable, feasible, and acceptable in people with knee OA. Wearable sensors could be used to remotely assess walking and chair stand in participant's natural environments in future studies.

Digital health technology derived measures: Biomarkers or clinical outcome assessments?

Digital health technologies (DHTs) present unique opportunities for clinical evidence generation but pose certain challenges. These challenges stem, in part, from existing definitions of drug development tools, which were not created with DHT-derived measures in mind. DHT-derived measures can be leveraged as either clinical outcome assessments (COAs) or as biomarkers since they share properties with both categories of drug development tools. Examples from the literature indicate a variety of applications for DHT-derived data, including capturing disease physiology, symptom tracking, or response to therapies. The distinction between the categorization of DHT-derived measures as COAs or as biomarkers can be very fine, with terminology variability among regulatory authorities. This has significant implications for integration of DHT-derived measures in clinical trials, leading to confusion regarding the evidence required to support these tools' use in drug development. There is a need to amend definitions and create clear evidentiary requirements to support broad adoption of these new and innovative tools. The biopharma industry, the technology sector, consulting businesses, academic researchers, and regulators need a dialogue via multi-stakeholder collaborations to clarify questions around DHT-derived measures, to unify definitions, and to create the foundations for evidentiary package requirements, providing a path forward to predictable results.

From Meaningful Outcomes to Meaningful Change Thresholds: A Path to Progress for Establishing Digital Endpoints

This paper examines the use of digital endpoints (DEs) derived from digital health technologies (DHTs), focusing primarily on the specific considerations regarding the determination of meaningful change thresholds (MCT). Using DHTs in drug development is becoming more commonplace. There is general acceptance of the value of DHTs supporting patient-centric trial design, capturing data outside the traditional clinical trial setting, and generating DEs with the potential to be more sensitive to change than conventional assessments. However, the transition from exploratory endpoints to primary and secondary endpoints capable of supporting labeling claims requires these endpoints to be substantive with reproducible population-specific values. Meaningful change represents the amount of change in an endpoint measure perceived as important to patients and should be determined for each digital endpoint and given population under consideration. This paper examines existing approaches to determine meaningful change thresholds and explores examples of these methodologies and their use as part of DE development: emphasizing the importance of determining what aspects of health are important to patients and ensuring the DE captures these concepts of interest and aligns with the overarching endpoint strategy. Examples are drawn from published DE qualification documentation and responses to qualification submissions under review by the various regulatory authorities. It is the hope that these insights will inform and strengthen the development and validation of DEs as drug development tools, particularly for those new to the approaches to determine MCTs.

Decentralized clinical trials and rare diseases: a Drug Information Association Innovative Design Scientific Working Group (DIA-IDSWG) perspective

BACKGROUND

Traditional clinical trials require tests and procedures that are administered in centralized clinical research sites, which are beyond the standard of care that patients receive for their rare and chronic diseases. The limited number of rare disease patients scattered around the world makes it particularly challenging to recruit participants and conduct these traditional clinical trials.

MAIN BODY

Participating in clinical research can be burdensome, especially for children, the elderly, physically and cognitively impaired individuals who require transportation and caregiver assistance, or patients who live in remote locations or cannot afford transportation. In recent years, there is an increasing need to consider Decentralized Clinical Trials (DCT) as a participant-centric approach that uses new technologies and innovative procedures for interaction with participants in the comfort of their home.

CONCLUSION

This paper discusses the planning and conduct of DCTs, which can increase the quality of trials with a specific focus on rare diseases.

Wearable-Based Stair Climb Power Estimation and Activity Classification

Stair climb power (SCP) is a clinical measure of leg muscular function assessed in-clinic via the Stair Climb Power Test (SCPT). This method is subject to human error and cannot provide continuous remote monitoring. Continuous monitoring using wearable sensors may provide a more comprehensive assessment of lower-limb muscular function. In this work, we propose an algorithm to classify stair climbing periods and estimate SCP from a lower-back worn accelerometer, which strongly agrees with the clinical standard (r = 0.92, p < 0.001; ICC = 0.90, [0.82, 0.94]). Data were collected in-lab from healthy adults (n = 65) performing the four-step SCPT and a walking assessment while instrumented (accelerometer + gyroscope), which allowed us to investigate tradeoffs between sensor modalities. Using two classifiers, we were able to identify periods of stair ascent with >89% accuracy [sensitivity = >0.89, specificity = >0.90] using two ensemble machine learning algorithms, trained on accelerometer signal features. Minimal changes in model performances were observed using the gyroscope alone (±0−6% accuracy) versus the accelerometer model. While we observed a slight increase in accuracy when combining gyroscope and accelerometer (about +3−6% accuracy), this is tolerable to preserve battery life in the at-home environment. This work is impactful as it shows potential for an accelerometer-based at-home assessment of SCP.

Considerations for Conducting Bring Your Own “Device” (BYOD) Clinical Studies

Background

Digital health technologies are attracting attention as novel tools for data collection in clinical research. They present alternative methods compared to in-clinic data collection, which often yields snapshots of the participants' physiology, behavior, and function that may be prone to biases and artifacts, e.g., white coat hypertension, and not representative of the data in free-living conditions. Modern digital health technologies equipped with multi-modal sensors combine different data streams to derive comprehensive endpoints that are important to study participants and are clinically meaningful. Used for data collection in clinical trials, they can be deployed as provisioned products where technology is given at study start or in a bring your own “device” (BYOD) manner where participants use their technologies to generate study data.

Summary

The BYOD option has the potential to be more user-friendly, allowing participants to use technologies that they are familiar with, ensuring better participant compliance, and potentially reducing the bias that comes with introducing new technologies. However, this approach presents different technical, operational, regulatory, and ethical challenges to study teams. For example, BYOD data can be more heterogeneous, and recruiting historically underrepresented populations with limited access to technology and the internet can be challenging. Despite the rapid increase in digital health technologies for clinical and healthcare research, BYOD use in clinical trials is limited, and regulatory guidance is still evolving.

Key Messages

We offer considerations for academic researchers, drug developers, and patient advocacy organizations on the design and deployment of BYOD models in clinical research. These considerations address: (1) early identification and engagement with internal and external stakeholders; (2) study design including informed consent and recruitment strategies; (3) outcome, endpoint, and technology selection; (4) data management including compliance and data monitoring; (5) statistical considerations to meet regulatory requirements. We believe that this article acts as a primer, providing insights into study design and operational requirements to ensure the successful implementation of BYOD clinical studies.

Considerations to address missing data when deriving clinical trial endpoints from digital health technologies

Digital health technologies (DHTs) enable us to measure human physiology and behavior remotely, objectively and continuously. With the accelerated adoption of DHTs in clinical trials, there is an unmet need to identify statistical approaches to address missing data to ensure that the derived endpoints are valid, accurate, and reliable. It is not obvious how commonly used statistical methods to handle missing data in clinical trials can be directly applied to the complex data collected by DHTs. Meanwhile, current approaches used to address missing data from DHTs are of limited sophistication and focus on the exclusion of data where the quantity of missing data exceeds a given threshold. High-frequency time series data collected by DHTs are often summarized to derive epoch-level data, which are then processed to compute daily summary measures. In this article, we discuss characteristics of missing data collected by DHT, review emerging statistical approaches for addressing missingness in epoch-level data including within-patient imputations across common time periods, functional data analysis, and deep learning methods, as well as imputation approaches and robust modeling appropriate for handling missing data in daily summary measures. We discuss strategies for minimizing missing data by optimizing DHT deployment and by including the patients' perspective in the study design. We believe that these approaches provide more insight into preventing missing data when deriving digital endpoints. We hope this article can serve as a starting point for further discussion among clinical trial stakeholders.

Assessment of Sit-to-Stand Transfers during Daily Life Using an Accelerometer on the Lower Back

The ability to perform sit-to-stand (STS) transfers has a significant impact on the functional mobility of an individual. Wearable technology has the potential to enable the objective, long-term monitoring of STS transfers during daily life. However, despite several recent efforts, most algorithms for detecting STS transfers rely on multiple sensing modalities or device locations and have predominantly been used for assessment during the performance of prescribed tasks in a lab setting. A novel wavelet-based algorithm for detecting STS transfers from data recorded using an accelerometer on the lower back is presented herein. The proposed algorithm is independent of device orientation and was validated on data captured in the lab from younger and older healthy adults as well as in people with Parkinson's disease (PwPD). The algorithm was then used for processing data captured in free-living conditions to assess the ability of multiple features extracted from STS transfers to detect age-related group differences and assess the impact of monitoring duration on the reliability of measurements. The results show that performance of the proposed algorithm was comparable or significantly better than that of a commercially available system (precision: 0.990 vs. 0.868 in healthy adults) and a previously published algorithm (precision: 0.988 vs. 0.643 in persons with Parkinson's disease). Moreover, features extracted from STS transfers at home were able to detect age-related group differences at a higher level of significance compared to data captured in the lab during the performance of prescribed tasks. Finally, simulation results showed that a monitoring duration of 3 days was sufficient to achieve good reliability for measurement of STS features. These results point towards the feasibility of using a single accelerometer on the lower back for detection and assessment of STS transfers during daily life. Future work in different patient populations is needed to evaluate the performance of the proposed algorithm, as well as assess the sensitivity and reliability of the STS features.

The Impact of Reducing the Number of Wearable Devices on Measuring Gait in Parkinson Disease: Noninterventional Exploratory Study

Background

Measuring free-living gait using wearable devices may offer higher granularity and temporal resolution than the current clinical assessments for patients with Parkinson disease (PD). However, increasing the number of devices worn on the body adds to the patient burden and impacts the compliance.

Objective

This study aimed to investigate the impact of reducing the number of wearable devices on the ability to assess gait impairments in patients with PD.

Methods

A total of 35 volunteers with PD and 60 healthy volunteers performed a gait task during 2 clinic visits. Participants with PD were assessed in the On and Off medication state using the Movement Disorder Society version of the Unified Parkinson Disease Rating Scale (MDS-UPDRS). Gait features derived from a single lumbar-mounted accelerometer were compared with those derived using 3 and 6 wearable devices for both participants with PD and healthy participants.

Results

A comparable performance was observed for predicting the MDS-UPDRS gait score using longitudinal mixed-effects model fit with gait features derived from a single (root mean square error [RMSE]=0.64; R2=0.53), 3 (RMSE=0.64; R2=0.54), and 6 devices (RMSE=0.54; R2=0.65). In addition, MDS-UPDRS gait scores predicted using all 3 models differed significantly between On and Off motor states (single device, P=.004; 3 devices, P=.004; 6 devices, P=.045).

Conclusions

We observed a marginal benefit in using multiple devices for assessing gait impairments in patients with PD when compared with gait features derived using a single lumbar-mounted accelerometer. The wearability burden associated with the use of multiple devices may offset gains in accuracy for monitoring gait under free-living conditions.

Age and environment-related differences in gait in healthy adults using wearables

Technological advances in multimodal wearable and connected devices have enabled the measurement of human movement and physiology in naturalistic settings. The ability to collect continuous activity monitoring data with digital devices in real-world environments has opened unprecedented opportunity to establish clinical digital phenotypes across diseases. Many traditional assessments of physical function utilized in clinical trials are limited because they are episodic, therefore, cannot capture the day-to-day temporal fluctuations and longitudinal changes in activity that individuals experience. In order to understand the sensitivity of gait speed as a potential endpoint for clinical trials, we investigated the use of digital devices during traditional clinical assessments and in real-world environments in a group of healthy younger (n = 33, 18-40 years) and older (n = 32, 65-85 years) adults. We observed good agreement between gait speed estimated using a lumbar-mounted accelerometer and gold standard system during the performance of traditional gait assessment task in-lab, and saw discrepancies between in-lab and at-home gait speed. We found that gait speed estimated in-lab, with or without digital devices, failed to differentiate between the age groups, whereas gait speed derived during at-home monitoring was able to distinguish the age groups. Furthermore, we found that only three days of at-home monitoring was sufficient to reliably estimate gait speed in our population, and still capture age-related group differences. Our results suggest that gait speed derived from activities during daily life using data from wearable devices may have the potential to transform clinical trials by non-invasively and unobtrusively providing a more objective and naturalistic measure of functional ability.

mHealth and wearable technology should replace motor diaries to track motor fluctuations in Parkinson's disease

Accurately monitoring motor and non-motor symptoms as well as complications in people with Parkinson's disease (PD) is a major challenge, both during clinical management and when conducting clinical trials investigating new treatments. A variety of strategies have been relied upon including questionnaires, motor diaries, and the serial administration of structured clinical exams like part III of the MDS-UPDRS. To evaluate the potential use of mobile and wearable technologies in clinical trials of new pharmacotherapies targeting PD symptoms, we carried out a project (project BlueSky) encompassing four clinical studies, in which 60 healthy volunteers (aged 23-69; 33 females) and 95 people with PD (aged 42-80; 37 females; years since diagnosis 1-24 years; Hoehn and Yahr 1-3) participated and were monitored in either a laboratory environment, a simulated apartment, or at home and in the community. In this paper, we investigated (i) the utility and reliability of self-reports for describing motor fluctuations; (ii) the agreement between participants and clinical raters on the presence of motor complications; (iii) the ability of video raters to accurately assess motor symptoms, and (iv) the dynamics of tremor, dyskinesia, and bradykinesia as they evolve over the medication cycle. Future papers will explore methods for estimating symptom severity based on sensor data. We found that 38% of participants who were asked to complete an electronic motor diary at home missed ~25% of total possible entries and otherwise made entries with an average delay of >4 h. During clinical evaluations by PD specialists, self-reports of dyskinesia were marked by ~35% false negatives and 15% false positives. Compared with live evaluation, the video evaluation of part III of the MDS-UPDRS significantly underestimated the subtle features of tremor and extremity bradykinesia, suggesting that these aspects of the disease may be underappreciated during remote assessments. On the other hand, live and video raters agreed on aspects of postural instability and gait. Our results highlight the significant opportunity for objective, high-resolution, continuous monitoring afforded by wearable technology to improve upon the monitoring of PD symptoms.

Development of digital biomarkers for resting tremor and bradykinesia using a wrist-worn wearable device

Objective assessment of Parkinson's disease symptoms during daily life can help improve disease management and accelerate the development of new therapies. However, many current approaches require the use of multiple devices, or performance of prescribed motor activities, which makes them ill-suited for free-living conditions. Furthermore, there is a lack of open methods that have demonstrated both criterion and discriminative validity for continuous objective assessment of motor symptoms in this population. Hence, there is a need for systems that can reduce patient burden by using a minimal sensor setup while continuously capturing clinically meaningful measures of motor symptom severity under free-living conditions. We propose a method that sequentially processes epochs of raw sensor data from a single wrist-worn accelerometer by using heuristic and machine learning models in a hierarchical framework to provide continuous monitoring of tremor and bradykinesia. Results show that sensor derived continuous measures of resting tremor and bradykinesia achieve good to strong agreement with clinical assessment of symptom severity and are able to discriminate between treatment-related changes in motor states.

Distributed slow-wave dynamics during sleep predict memory consolidation and its impairment in schizophrenia

The slow waves (SW) of non-rapid eye movement (NREM) sleep reflect neocortical components of network activity during sleep-dependent information processing; their disruption may therefore impair memory consolidation. Here, we quantify sleep-dependent consolidation of motor sequence memory, alongside sleep EEG-derived SW properties and synchronisation, and SW–spindle coupling in 21 patients suffering from schizophrenia and 19 healthy volunteers. Impaired memory consolidation in patients culminated in an overnight improvement in motor sequence task performance of only 1.6%, compared with 15% in controls. During sleep after learning, SW amplitudes and densities were comparable in healthy controls and patients. However, healthy controls showed a significant 45% increase in frontal-to-occipital SW coherence during sleep after motor learning in comparison with a baseline night (baseline: 0.22 ± 0.05, learning: 0.32 ± 0.05); patient EEG failed to show this increase (baseline: 0.22 ± 0.04, learning: 0.19 ± 0.04). The experience-dependent nesting of spindles in SW was similarly disrupted in patients: frontal-to-occipital SW–spindle phase-amplitude coupling (PAC) significantly increased after learning in healthy controls (modulation index baseline: 0.17 ± 0.02, learning: 0.22 ± 0.02) but not in patients (baseline: 0.13 ± 0.02, learning: 0.14 ± 0.02). Partial least-squares regression modelling of coherence and PAC data from all electrode pairs confirmed distributed SW coherence and SW–spindle coordination as superior predictors of overnight memory consolidation in healthy controls but not in patients. Quantifying the full repertoire of NREM EEG oscillations and their long-range covariance therefore presents learning-dependent changes in distributed SW and spindle coordination as fingerprints of impaired cognition in schizophrenia.

Multimodal Wearable Sensors to Measure Gait and Voice

Background

Traditional measurement systems utilized in clinical trials are limited because they are episodic and thus cannot capture the day-to-day fluctuations and longitudinal changes that frequently affect patients across different therapeutic areas.

Objectives

The aim of this study was to collect and evaluate data from multiple devices, including wearable sensors, and compare them to standard lab-based instruments across multiple domains of daily tasks.

Methods

Healthy volunteers aged 18-65 years were recruited for a 1-h study to collect and assess data from wearable sensors. They performed walking tasks on a gait mat while instrumented with a watch, phone, and sensor insoles as well as several speech tasks on multiple recording devices.

Results

Step count and temporal gait metrics derived from a single lumbar accelerometer are highly precise; spatial gait metrics are consistently 20% shorter than gait mat measurements. The insole's algorithm only captures about 72% of steps but does have precision in measuring temporal gait metrics. Mobile device voice recordings provide similar results to traditional recorders for average signal pitch and sufficient signal-to-noise ratio for analysis when hand-held. Lossless compression techniques are advised for signal processing.

Conclusions

Gait metrics from a single lumbar accelerometer sensor are in reasonable concordance with standard measurements, with some variation between devices and across individual metrics. Finally, participants in this study were familiar with mobile devices and had high acceptance of potential future continuous wear for clinical trials.

Quantification of discrete behavioral components of the MDS-UPDRS

INTRODUCTION

The Movement Disorder Society's Unified Parkinson's Disease Rating Scale (MDS-UPDRS) is the current gold standard means of assessing disease state in Parkinson's disease (PD). Objective measures in the form of wearable sensors have the potential to improve our ability to monitor symptomology in PD, but numerous methodological challenges remain, including integration into the MDS-UPDRS. We applied a structured video coding scheme to temporally quantify clinical, scripted, motor tasks in the MDS-UPDRS for the alignment and integration of objective measures collected in parallel.

METHODS

25 PD subjects completed two video-recorded MDS-UPDRS administrations. Visual cues of task performance reliably identifiable in video recordings were used to construct a structured video coding scheme. Postural transitions were also defined and coded. Videos were independently coded by two trained non-expert coders and a third expert coder to derive indices of inter-rater agreement.

RESULTS

50 videos of MDS-UPDRS performance were fully coded. Non-expert coders achieved a high level of agreement (Cohen's κ > 0.8) on all postural transitions and scripted motor tasks except for Postural Stability (κ = 0.617); this level of agreement was largely maintained even when more stringent thresholds for agreement were applied. Durations coded by non-expert coders and expert coders were significantly different (p < 0.05) for only Postural Stability and Rigidity, Left Upper Limb.

CONCLUSIONS

Non-expert coders consistently and accurately quantified discrete behavioral components of the MDS-UPDRS using a structured video coding scheme; this represents a novel, promising approach for integrating objective and clinical measures into unified, longitudinal datasets.

Coordination of Slow Waves With Sleep Spindles Predicts Sleep-Dependent Memory Consolidation in Schizophrenia

Study Objectives

Schizophrenia patients have correlated deficits in sleep spindle density and sleep-dependent memory consolidation. In addition to spindle density, memory consolidation is thought to rely on the precise temporal coordination of spindles with slow waves (SWs). We investigated whether this coordination is intact in schizophrenia and its relation to motor procedural memory consolidation.

Methods

Twenty-one chronic medicated schizophrenia patients and 17 demographically matched healthy controls underwent two nights of polysomnography, with training on the finger tapping motor sequence task (MST) on the second night and testing the following morning. We detected SWs (0.5-4 Hz) and spindles during non-rapid eye movement (NREM) sleep. We measured SW-spindle phase-amplitude coupling and its relation with overnight improvement in MST performance.

Results

Patients did not differ from controls in the timing of SW-spindle coupling. In both the groups, spindles peaked during the SW upstate. For patients alone, the later in the SW upstate that spindles peaked and the more reliable this phase relationship, the greater the overnight MST improvement. Regression models that included both spindle density and SW-spindle coordination predicted overnight improvement significantly better than either parameter alone, suggesting that both contribute to memory consolidation.

Conclusion

Schizophrenia patients show intact spindle-SW temporal coordination, and these timing relationships, together with spindle density, predict sleep-dependent memory consolidation. These relations were seen only in patients suggesting that their memory is more dependent on optimal spindle-SW timing, possibly due to reduced spindle density. Interventions to improve memory may need to increase spindle density while preserving or enhancing the coordination of NREM oscillations.

Characterizing sleep spindles in 11,630 individuals from the National Sleep Research Resource

Sleep spindles are characteristic electroencephalogram (EEG) signatures of stage 2 non-rapid eye movement sleep. Implicated in sleep regulation and cognitive functioning, spindles may represent heritable biomarkers of neuropsychiatric disease. Here we characterize spindles in 11,630 individuals aged 4 to 97 years, as a prelude to future genetic studies. Spindle properties are highly reliable but exhibit distinct developmental trajectories. Across the night, we observe complex patterns of age- and frequency-dependent dynamics, including signatures of circadian modulation. We identify previously unappreciated correlates of spindle activity, including confounding by body mass index mediated by cardiac interference in the EEG. After taking account of these confounds, genetic factors significantly contribute to spindle and spectral sleep traits. Finally, we consider topographical differences and critical measurement issues. Taken together, our findings will lead to an increased understanding of the genetic architecture of sleep spindles and their relation to behavioural and health outcomes, including neuropsychiatric disorders.

Sleep patterns vary and are associated with health and disease. Here Purcell et al characterize sleep spindle activity in 11,630 individuals and describe age-related changes, genetic influences, and possible confounding effects, serving as a resource for further understanding the physiology of sleep.

A statistical approach for segregating cognitive task stages from multivariate fMRI BOLD time series

Multivariate pattern analysis can reveal new information from neuroimaging data to illuminate human cognition and its disturbances. Here, we develop a methodological approach, based on multivariate statistical/machine learning and time series analysis, to discern cognitive processing stages from functional magnetic resonance imaging (fMRI) blood oxygenation level dependent (BOLD) time series. We apply this method to data recorded from a group of healthy adults whilst performing a virtual reality version of the delayed win-shift radial arm maze (RAM) task. This task has been frequently used to study working memory and decision making in rodents. Using linear classifiers and multivariate test statistics in conjunction with time series bootstraps, we show that different cognitive stages of the task, as defined by the experimenter, namely, the encoding/retrieval, choice, reward and delay stages, can be statistically discriminated from the BOLD time series in brain areas relevant for decision making and working memory. Discrimination of these task stages was significantly reduced during poor behavioral performance in dorsolateral prefrontal cortex (DLPFC), but not in the primary visual cortex (V1). Experimenter-defined dissection of time series into class labels based on task structure was confirmed by an unsupervised, bottom-up approach based on Hidden Markov Models. Furthermore, we show that different groupings of recorded time points into cognitive event classes can be used to test hypotheses about the specific cognitive role of a given brain region during task execution. We found that whilst the DLPFC strongly differentiated between task stages associated with different memory loads, but not between different visual-spatial aspects, the reverse was true for V1. Our methodology illustrates how different aspects of cognitive information processing during one and the same task can be separated and attributed to specific brain regions based on information contained in multivariate patterns of voxel activity.

Hippocampal-dorsolateral prefrontal coupling as a species-conserved cognitive mechanism: a human translational imaging study

Hippocampal-prefrontal cortex (HC-PFC) interactions are implicated in working memory (WM) and altered in psychiatric conditions with cognitive impairment such as schizophrenia. While coupling between both structures is crucial for WM performance in rodents, evidence from human studies is conflicting and translation of findings is complicated by the use of differing paradigms across species. We therefore used functional magnetic resonance imaging together with a spatial WM paradigm adapted from rodent research to examine HC-PFC coupling in humans. A PFC-parietal network was functionally connected to hippocampus (HC) during task stages requiring high levels of executive control but not during a matched control condition. The magnitude of coupling in a network comprising HC, bilateral dorsolateral PFC (DLPFC), and right supramarginal gyrus explained one-fourth of the variability in an independent spatial WM task but was unrelated to visual WM performance. HC-DLPFC coupling may thus represent a systems-level mechanism specific to spatial WM that is conserved across species, suggesting its utility for modeling cognitive dysfunction in translational neuroscience.

Information flow between interacting human brains: Identification, validation, and relationship to social expertise

Social interactions are fundamental for human behavior, but the quantification of their neural underpinnings remains challenging. Here, we used hyperscanning functional MRI (fMRI) to study information flow between brains of human dyads during real-time social interaction in a joint attention paradigm. In a hardware setup enabling immersive audiovisual interaction of subjects in linked fMRI scanners, we characterize cross-brain connectivity components that are unique to interacting individuals, identifying information flow between the sender's and receiver's temporoparietal junction. We replicate these findings in an independent sample and validate our methods by demonstrating that cross-brain connectivity relates to a key real-world measure of social behavior. Together, our findings support a central role of human-specific cortical areas in the brain dynamics of dyadic interactions and provide an approach for the noninvasive examination of the neural basis of healthy and disturbed human social behavior with minimal a priori assumptions.

Sleep spindle deficits in antipsychotic-naïve early course schizophrenia and in non-psychotic first-degree relatives

INTRODUCTION

Chronic medicated patients with schizophrenia have marked reductions in sleep spindle activity and a correlated deficit in sleep-dependent memory consolidation. Using archival data, we investigated whether antipsychotic-naïve early course patients with schizophrenia and young non-psychotic first-degree relatives of patients with schizophrenia also show reduced sleep spindle activity and whether spindle activity correlates with cognitive function and symptoms.

METHOD

Sleep spindles during Stage 2 sleep were compared in antipsychotic-naïve adults newly diagnosed with psychosis, young non-psychotic first-degree relatives of schizophrenia patients and two samples of healthy controls matched to the patients and relatives. The relations of spindle parameters with cognitive measures and symptom ratings were examined.

RESULTS

Early course schizophrenia patients showed significantly reduced spindle activity relative to healthy controls and to early course patients with other psychotic disorders. Relatives of schizophrenia patients also showed reduced spindle activity compared with controls. Reduced spindle activity correlated with measures of executive function in early course patients, positive symptoms in schizophrenia and IQ estimates across groups.

CONCLUSIONS

Like chronic medicated schizophrenia patients, antipsychotic-naïve early course schizophrenia patients and young non-psychotic relatives of individuals with schizophrenia have reduced sleep spindle activity. These findings indicate that the spindle deficit is not an antipsychotic side-effect or a general feature of psychosis. Instead, the spindle deficit may predate the onset of schizophrenia, persist throughout its course and be an endophenotype that contributes to cognitive dysfunction.

Neuronal oscillations in the EEG under varying cognitive load: a comparative study between slow waves and faster oscillations

OBJECTIVE

This study has been specifically designed to investigate very low frequency neuronal oscillations (VLFO, <0.5 Hz) during resting states and during goal-directed tasks of graded difficulty levels, quantify the changes that the slow waves undergo in these conditions and compare them with those for higher frequency bands (namely delta, theta and alpha).

METHODS

To this end we developed a multistage signal processing methodology comprising blind source separation coupled with a neural network based feature extraction and classification method.

RESULTS

Changes in the amplitude and phase of brain sources estimates in the VLF band between rest and task were enhanced with increased task difficulty, but remained lower than those experienced in higher frequency bands. The slow wave variations were also significantly correlated with task performance measures, and hence with the level of task-directed attention.

CONCLUSIONS

These findings suggest that besides their prominent sensitivity to external stimulation, VLFOs also contribute to the cortical ongoing background activity which may not be specifically related to task-specific attention and performance.

SIGNIFICANCE

Our work provides important insight into the association between VLF brain activity and conventional EEG frequency bands, and presents a novel framework for assessing neural activity during various mental conditions and psychiatric states.

Space-time independent component analysis: the definitive BSS technique to use in biomedical signal processing?

Independent Component Analysis (ICA) is a very common instantiation of the Blind Source Separation (BSS) problem. In the context of biomedical signal analysis, ICA is generally applied to multi-channel recordings of physiological phenomena in order to de-noise and extract meaningful information underlying the recordings. This paper assesses the Spatio-Temporal ICA (ST-ICA) framework, which uses both spatial and temporal information derived from multi-channel time-series to extract underlying sources. In contrast, the standard implementation of the ICA algorithm generally uses only limited spatial information to inform the separation process. One of the major steps in the implementation of any ICA algorithm is the selection of relevant components from the many ICA usually returns. With ST-ICA there is a rich data-set of components exhibiting spatial as well as temporal/spectral information that could be used to identify the underlying process subspaces extracted by the ST-ICA algorithm. This paper highlights the methodology for performing ST-ICA and assesses the possible ways in which process subspace identification may take place.

Trial-to-Trial Variability in Evoked Neural Responses Exhibits a Very Low Frequency Temporal Signature

In functional magnetic resonance (fMRI) studies, the blood oxygen level dependent (BOLD) signal displays intrinsic spontaneous and task-independent very low frequency (VLF) oscillations (< 0.1 Hz). Most prominent during rest, when they persist into task sessions they can predict trial-to-trial variability in both evoked behavior and brain responses by providing a baseline onto which deterministic responses elicited by the task are superimposed. Moreover, evidence in the literature tentatively suggests that this VLF activity may not be present in the data as distinct, independent source(s) per se, but rather as a mechanism that modulates and perhaps even governs underlying brain processes. Here, we use electrophysiology to investigate the intertrial variability observed in magnetoencephalographic (MEG) event-related field (ERF) components, and to examine whether this variability exhibits a VLF time signature in order to indirectly infer information about the underlying slow waves. The focus is on the visual component, the M100, understood to be regulated by attention. We also explored whether individual differences in the M100 VLF pattern varies as a function of attention deficit/hyperactivity disorder (ADHD) by comparing 11 cases against 11 controls. The M100 component was extracted from the data using a recently introduced blind-source separation technique – space-time independent component analysis (ST-ICA) – which allowed trial-by-trial analysis to be performed on the M100 for proper assessment of VLF modulation. Our results demonstrate, for the first time, the ability of this signal-processing method to isolate relevant components from multidimensional, noisy, ERF data recorded from a highly dense 148-channel MEG system. The intertrial variability in the amplitude and latency of the M100 responses exhibits a slow wave pattern (< 0.1 Hz). However, there was no evidence that the degree of VLF modulation was different in ADHD participants. The role of this VLF activity in brain function is discussed.

Slow neuronal oscillations in the resting brain vs task execution: A BSS investigation of EEG recordings

Spontaneous very low frequency oscillations (< 0.5 Hz) occurring within widely distributed neuroanatomical systems have been increasingly analyzed in brain imaging studies. Whilst being more prominent in the resting brain, these slow waves also persist into task sessions and may potentially interfere with active goal-directed attention, leading to periodic lapses in attention during task execution. This work presents a new experimental framework and a multistage signal processing methodology - comprising blind source separation (BSS) coupled with a neural network feature extraction and classification method - developed for assessing variations in the slow wave characteristics in EEG data recorded during periods of quiet wakefulness (termed as "rest"), and during visual tasks of various difficulty levels. Core results demonstrate that the amplitude and phase of the brain sources in the slow wave band share essential similarities during rest and task conditions, but are distinct enough to be classified separately. These slow wave variations are also significantly correlated with the level of cognitive attention assessed by task performance measures (such as reaction times and error rates). Moreover, the power of the brain sources in the slow wave band is attenuated during task, and the level of attenuation drops as the task difficulty level is increased, whilst the slow wave phase undergoes a change in structure (measured through entropy). The methodology and findings presented here provide a new basis for assessing neural activity during various mental conditions.

On spatio-temporal component selection in space-time independent component analysis: an application to ictal EEG

This paper assesses the use of Independent Component Analysis (ICA) as applied to epileptic scalp electroencephalographic (EEG) recordings. In particular we address the newly introduced Spatio-Temporal ICA algorithm (ST-ICA), which uses both spatial and temporal information derived from multi-channel biomedical signal recordings to inform (or update) the standard ICA algorithm. ICA is a technique well suited to extracting underlying sources from multi-channel EEG recordings - for ictal EEG recordings, the goal is to both de-noise the EEG recordings (i.e. remove artifacts) as well as isolate and extract epileptic processes. As part of any ICA application, there is an interim stage whereby relevant components (or processes) need to be identified - either objectively or subjectively (usually the latter). In previous work with ST-ICA we used spectral information alone to identify the underlying processes subspaces extracted by the ST-ICA. Here we assess the joint use of spatial as well as spectral information for this purpose. We test this on ictal EEG segments where it can be seen that different underlying processes possess characteristic signatures in both modalities which can be utilized for the clustering (or process selection) stage.

Distinguishing low frequency oscillations within the 1/f spectral behaviour of electromagnetic brain signals

Background

It has been acknowledged that the frequency spectrum of measured electromagnetic (EM) brain signals shows a decrease in power with increasing frequency. This spectral behaviour may lead to difficulty in distinguishing event-related peaks from ongoing brain activity in the electro- and magnetoencephalographic (EEG and MEG) signal spectra. This can become an issue especially in the analysis of low frequency oscillations (LFOs) – below 0.5 Hz – which are currently being observed in signal recordings linked with specific pathologies such as epileptic seizures or attention deficit hyperactivity disorder (ADHD), in sleep studies, etc.

Methods

In this work we propose a simple method that can be used to compensate for this 1/f trend hence achieving spectral normalisation. This method involves filtering the raw measured EM signal through a differentiator prior to further data analysis.

Results

Applying the proposed method to various exemplary datasets including very low frequency EEG recordings, epileptic seizure recordings, MEG data and Evoked Response data showed that this compensating procedure provides a flat spectral base onto which event related peaks can be clearly observed.

Conclusion

Findings suggest that the proposed filter is a useful tool for the analysis of physiological data especially in revealing very low frequency peaks which may otherwise be obscured by the 1/f spectral activity inherent in EEG/MEG recordings.