Reliability and Validity of Smartphone Cognitive Testing for Frontotemporal Lobar Degeneration

Importance

Frontotemporal lobar degeneration (FTLD) is relatively rare, behavioral and motor symptoms increase travel burden, and standard neuropsychological tests are not sensitive to early-stage disease. Remote smartphone-based cognitive assessments could mitigate these barriers to trial recruitment and success, but no such tools are validated for FTLD.

Objective

To evaluate the reliability and validity of smartphone-based cognitive measures for remote FTLD evaluations.

Design, Setting, and Participants

In this cohort study conducted from January 10, 2019, to July 31, 2023, controls and participants with FTLD performed smartphone application (app)-based executive functioning tasks and an associative memory task 3 times over 2 weeks. Observational research participants were enrolled through 18 centers of a North American FTLD research consortium (ALLFTD) and were asked to complete the tests remotely using their own smartphones. Of 1163 eligible individuals (enrolled in parent studies), 360 were enrolled in the present study; 364 refused and 439 were excluded. Participants were divided into discovery (n = 258) and validation (n = 102) cohorts. Among 329 participants with data available on disease stage, 195 were asymptomatic or had preclinical FTLD (59.3%), 66 had prodromal FTLD (20.1%), and 68 had symptomatic FTLD (20.7%) with a range of clinical syndromes.

Exposure

Participants completed standard in-clinic measures and remotely administered ALLFTD mobile app (app) smartphone tests.

Main Outcomes and Measures

Internal consistency, test-retest reliability, association of smartphone tests with criterion standard clinical measures, and diagnostic accuracy.

Results

In the 360 participants (mean [SD] age, 54.0 [15.4] years; 209 [58.1%] women), smartphone tests showed moderate-to-excellent reliability (intraclass correlation coefficients, 0.77-0.95). Validity was supported by association of smartphones tests with disease severity (r range, 0.38-0.59), criterion-standard neuropsychological tests (r range, 0.40-0.66), and brain volume (standardized β range, 0.34-0.50). Smartphone tests accurately differentiated individuals with dementia from controls (area under the curve [AUC], 0.93 [95% CI, 0.90-0.96]) and were more sensitive to early symptoms (AUC, 0.82 [95% CI, 0.76-0.88]) than the Montreal Cognitive Assessment (AUC, 0.68 [95% CI, 0.59-0.78]) (z of comparison, -2.49 [95% CI, -0.19 to -0.02]; P = .01). Reliability and validity findings were highly similar in the discovery and validation cohorts. Preclinical participants who carried pathogenic variants performed significantly worse than noncarrier family controls on 3 app tasks (eg, 2-back β = -0.49 [95% CI, -0.72 to -0.25]; P < .001) but not a composite of traditional neuropsychological measures (β = -0.14 [95% CI, -0.42 to 0.14]; P = .32).

Conclusions and Relevance

The findings of this cohort study suggest that smartphones could offer a feasible, reliable, valid, and scalable solution for remote evaluations of FTLD and may improve early detection. Smartphone assessments should be considered as a complementary approach to traditional in-person trial designs. Future research should validate these results in diverse populations and evaluate the utility of these tests for longitudinal monitoring.

Functional network collapse in neurodegenerative disease

Cognitive and behavioral deficits in Alzheimer's disease (AD) and frontotemporal dementia (FTD) result from brain atrophy and altered functional connectivity. However, it is unclear how atrophy relates to functional connectivity disruptions across dementia subtypes and stages. We addressed this question using structural and functional MRI from 221 patients with AD (n=82), behavioral variant FTD (n=41), corticobasal syndrome (n=27), nonfluent (n=34) and semantic (n=37) variant primary progressive aphasia, and 100 cognitively normal individuals. Using partial least squares regression, we identified three principal structure-function components. The first component showed overall atrophy correlating with primary cortical hypo-connectivity and subcortical/association cortical hyper-connectivity. Components two and three linked focal syndrome-specific atrophy to peri-lesional hypo-connectivity and distal hyper-connectivity. Structural and functional component scores predicted global and domain-specific cognitive deficits. Anatomically, functional connectivity changes reflected alterations in specific brain activity gradients. Eigenmode analysis identified temporal phase and amplitude collapse as an explanation for atrophy-driven functional connectivity changes.

Feasibility and acceptability of remote smartphone cognitive testing in frontotemporal dementia research

Introduction

Remote smartphone assessments of cognition, speech/language, and motor functioning in frontotemporal dementia (FTD) could enable decentralized clinical trials and improve access to research. We studied the feasibility and acceptability of remote smartphone data collection in FTD research using the ALLFTD Mobile App (ALLFTD-mApp).

Methods

A diagnostically mixed sample of 214 participants with FTD or from familial FTD kindreds (asymptomatic: CDR®+NACC-FTLD = 0 [N = 101]; prodromal: 0.5 [N = 49]; symptomatic ≥1 [N = 51]; not measured [N = 13]) were asked to complete ALLFTD-mApp tests on their smartphone three times within 12 days. They completed smartphone familiarity and participation experience surveys.

Results

It was feasible for participants to complete the ALLFTD-mApp on their own smartphones. Participants reported high smartphone familiarity, completed ∼ 70% of tasks, and considered the time commitment acceptable (98% of respondents). Greater disease severity was associated with poorer performance across several tests.

Discussion

These findings suggest that the ALLFTD-mApp study protocol is feasible and acceptable for remote FTD research.

HIGHLIGHTS

The ALLFTD Mobile App is a smartphone-based platform for remote, self-administered data collection.The ALLFTD Mobile App consists of a comprehensive battery of surveys and tests of executive functioning, memory, speech and language, and motor abilities.Remote digital data collection using the ALLFTD Mobile App was feasible in a multicenter research consortium that studies FTD. Data was collected in healthy controls and participants with a range of diagnoses, particularly FTD spectrum disorders.Remote digital data collection was well accepted by participants with a variety of diagnoses.