Device-Embedded Cameras for Eye Tracking-Based Cognitive Assessment: Validation With Paper-Pencil and Computerized Cognitive Composites

Assessing webcam-based eye-tracking during comic reading in the classroom: a feasibility study

BACKGROUND

Webcam-based eye tracking offers a practical approach for monitoring reading behavior in classroom environments. Nascimento et al. demonstrated the feasibility of using the Webcam-based eye tracking to observe comic reading patterns among children and showed that it effectively captures fixation time and reading dynamics. Despite the data quality challenges, Webcam-based eye tracking provided an accuracy comparable to that of infrared-based systems.

OBJECTIVE

To evaluate the feasibility and accuracy of webcam-based eye tracking for monitoring comic books reading behavior in a real-world classroom setting.

METHODS

We tested the feasibility of using the webcam-based eye tracking in a children's classroom experiment (n=22), observing reading patterns as students engaged with a comic strip. Qualitative quality control was implemented to exclude low-quality data. Fixation dwell time was measured to determine whether specific areas of the image received more attention. Additionally, a validation test was conducted (n=3) to assess the accuracy and precision of webcam-based eye tracking compared with an infrared-based eye-tracking system. The accuracy and precision were evaluated, with lower values indicating better performance.

RESULTS

During the comic reading task, webcam-based eye tracking effectively captured fixation dwell time, showing that students read the left side significantly faster (2.916 words/s, SD=0.705) compared to the right side (1.962 words/s, SD=0.450, p≤0.001). The validation test showed that webcam-based eye tracking had an average accuracy of 11.581% and a precision of 3.058%, whereas the infrared-based system recorded an accuracy of 11.290% and a precision of 1.264%. Although webcam-based eye tracking demonstrated a slightly lower precision (bias=-1.794, 95%CI=-3.055 to -0.532), no significant difference was observed in accuracy between the two systems.

BACKGROUND

■ Webcam-based eye tracking demonstrated feasibility for monitoring reading behavior in classrooms.

BACKGROUND

■ Webcam-based eye tracking captured fixation times, showing differing reading speeds across comic sections.

BACKGROUND

■ Webcam-based eye tracking showed accuracy comparable to infrared-based systems, despite lower precision.

BACKGROUND

■ Limitations resulting in data loss underscore the need for methodological improvements.

Prospective observational study to evaluate the feasibility of the mobile app for mild cognitive impairment detection and screening

Introduction

The increasing prevalence of dementia in aging populations necessitates effective and accessible cognitive screening tools. This study aimed to evaluate the feasibility and reliability of a newly developed mobile app for detecting and screening mild cognitive impairment (MCI).

Methods

The mobile app, developed by LifeQuest Co., Ltd. (Minato-ku, Tokyo), is an original tool inspired by the Japanese version of the Montreal Cognitive Assessment (MoCA-J). A prospective observational study was conducted with 20 participants, including healthy individuals, MCI patients, and those with mild to moderate-severe dementia. Participants completed both the mobile app and the MoCA-J in a randomized order within a two-week period, with a minimum one-day interval between tests.

Results and conclusion

The intraclass correlation coefficient (ICC) between the mobile app and the MoCA-J was 0.956 (95% CI: 0.89-0.983), demonstrating a very high level of correlation. All participants successfully completed the mobile app assessment, highlighting its feasibility across various cognitive levels. Although minor technical issues and usability challenges were identified, the results support the mobile app as a reliable and user-friendly alternative for cognitive screening. Further studies with larger sample sizes are necessary to validate these findings and refine the app for broader clinical use.

A Holistic Approach to the Measurement of Physical Function in Clinical Research

Background

This commentary highlights the evolution of our understanding of physical function (PF) and key models/frameworks that have contributed to the current holistic understanding of PF, which encompasses not only a person's performance but also the environment and any adaptations an individual utilizes. This commentary also addresses how digital health tools can facilitate and complement the assessment of holistic PF and enable both objective and subjective input from the participant in their real-world environment. Lastly, we discuss how successful implementation of digital tools within clinical research requires patient input.

Summary

This commentary highlights how our understanding of PF has evolved to be more holistic.

Key Messages

Inclusion of digital tools within clinical research can provide a path forward to holistically assess PF in a patient-focused manner.

Detecting early stages of Alzheimer's disease using a web-based cognitive battery

Portable and efficient cognitive screening measures are needed to address the growing need for effective early detection of Alzheimer's disease. The Neurotrack Cognitive Battery (NCB) offers an appealing, web-based application that may be sensitive to early cognitive changes associated with Alzheimer's disease. The NCB contains measures that were conceptually derived from animal lesion studies. The current study sought to investigate the construct and diagnostic validity of the NCB among those with and without mild cognitive impairment (MCI). Participants (n = 47) with and without MCI were administered the NCB and traditional cognitive tests. Three of six NCB measures assessing domains of memory, processing speed, and executive functioning demonstrated moderate to strong associations with well-established cognitive performance tests. In classifying those with and without MCI, sensitivities of these three NCB measures ranged from 0.47 to 0.74, and specificities ranged from 0.78 to 1.00. For traditional cognitive measures, sensitivities ranged from 0.74 to 0.84, and specificities ranged from 0.74 to 0.94. Overall, web-based cognitive test measures pertaining to cognitive domains of memory, processing speed, and executive functioning may serve as highly portable screening tools for detecting the early stages of Alzheimer's disease. Additionally, these cognitive domains may be valuable in informing back-translational research.

Recognition memory deficits detected through eye-tracking in well-controlled children with self-limited epilepsy with centrotemporal spikes

OBJECTIVE

Children with self-limited epilepsy characterized by centrotemporal spikes (SeLECTS) exhibit cognitive deficits in memory during the active phase, but there is currently a lack of studies and techniques to assess their memory development after well-controlled seizures. In this study, we employed eye-tracking techniques to investigate visual memory and its association with clinical factors and global intellectual ability, aiming to identify potential risk factors by examining encoding and recognition processes.

METHODS

A total of 26 recruited patients diagnosed with SeLECTS who had been seizure-free for at least 2 years, along with 24 control subjects, underwent Wechsler cognitive assessment and an eye-movement-based memory task while video-electroencephalographic (EEG) data were recorded. Fixation and pupil data related to eye movements were utilized to detect distinct memory processes and subsequently to compare the cognitive performance of patients exhibiting different regression patterns on EEG.

RESULTS

The findings revealed persistent impairments in visual memory among children with SeLECTS after being well controlled, primarily observed in the recognition stage rather than the encoding phase. Furthermore, the age at onset, frequency of seizures, and interictal epileptiform discharges exhibited significant correlations with eye movement data.

SIGNIFICANCE

Children with SeLECTS exhibit persistent recognition memory impairment after being well controlled for the disease. Controlling the frequency of seizures and reducing prolonged epileptiform activity may improve memory cognitive development. The application of the eye-tracking technique may provide novel insights into exploring memory cognition as well as underlying mechanisms associated with pediatric epilepsy.

Eye Tracking During Visual Paired-Comparison Tasks: A Systematic Review and Meta-Analysis of the Diagnostic Test Accuracy for Detecting Cognitive Decline

Background

Alzheimer's disease and mild cognitive impairment (MCI) progress silently, making early diagnosis challenging, especially in less educated populations. The visual paired comparison (VPC) task, utilizing eye-tracking movement (ETM) technology, offers a promising alternative for early detection of memory decline.

Objective

This systematic review and meta-analysis evaluated the efficacy of the VPC task, utilizing ETM as a tool for assessing age-related cognitive changes.

Methods

A comprehensive search across five databases and grey literature focused on healthy and impaired memory participants assessed through the ETM-based VPC task. The primary outcomes were novelty preference scores and eye movement metrics. The risk of bias of the included studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Random-effects meta-analyses calculated Hedges' g effect size. Sensitivity and specificity of the VPC were meta-analytically pooled.

Results

The systematic review included 12 articles, involving 1,022 participants (aged 18 to 90 years, with education ranging from 6.5 to 20.0 years), with a low risk of bias and minimal applicability concerns across all items. Five studies contributed to the meta-analysis, revealing a significant effect favoring the VPC task for recognition memory detection (k = 9, g = -1.03). Pooled sensitivity and specificity analyses demonstrated VPC effectiveness as a recognition memory assessment tool (0.84 and 0.75, respectively).

Conclusions

The VPC task, utilizing ETM, may serve as a biomarker for early memory decline detection. Its use as a digital eye-tracking tool presents a possible alternative to traditional tests, warranting further research for application in neurodegenerative disease diagnosis.

Webcam-based eye-tracking to measure visual expertise of medical students during online histology training

Objectives

Visual expertise is essential for image-based tasks that rely on visual cues, such as in radiology or histology. Studies suggest that eye movements are related to visual expertise and can be measured by near-infrared eye-tracking. With the popularity of device-embedded webcam eye-tracking technology, cost-effective use in educational contexts has recently become amenable. This study investigated the feasibility of such methodology in a curricular online-only histology course during the 2021 summer term.

Methods

At two timepoints (t1 and t2), third-semester medical students were asked to diagnose a series of histological slides while their eye movements were recorded. Students' eye metrics, performance and behavioral measures were analyzed using variance analyses and multiple regression models.

Results

First, webcam-eye tracking provided eye movement data with satisfactory quality (mean accuracy=115.7 px±31.1). Second, the eye movement metrics reflected the students' proficiency in finding relevant image sections (fixation count on relevant areas=6.96±1.56 vs. irrelevant areas=4.50±1.25). Third, students' eye movement metrics successfully predicted their performance (R2adj=0.39, p<0.001).

Conclusion

This study supports the use of webcam-eye-tracking expanding the range of educational tools available in the (digital) classroom. As the students' interest in using the webcam eye-tracking was high, possible areas of implementation will be discussed.

The efficacy and practicality of the Neurotrack Cognitive Battery assessment for utilization in clinical settings for the identification of cognitive decline in an older Japanese population

Introduction

Japan has the largest aging population with 33% of the population over the age of 60 years. The number of Japanese adults with dementia is estimated to be approximately 4.6 million, comprising nearly 15% of the older adult population. It is critical to administer cognitive assessments early in the disease state that have high reliability and low user burden to detect negative cognitive changes as early as possible; however, current preclinical AD detection methods are invasive, time-consuming, and expensive. A number of traditional and digital cognitive assessments are also available, but many of these tests are time-consuming, taxing to the user, and not widely scalable. The purpose of this study was to incorporate a digital cognitive assessment battery into a standard clinical assessment performed within a Japanese-based neuropsychology clinic to assess the diagnostic accuracy and the relationship between the digital Neurotrack Cognitive Assessment Battery (N-CAB) to traditional cognitive assessments.

Methods

Healthy individuals and probable Alzheimer's patients completed the N-CAB, as well as two traditional cognitive assessments, the Mini Mental Status Exam (MMSE) and the Revised Hasegawa's Dementia Scale (HDS-R).

Results

Our results demonstrate the Image Pairs hand-response phase of the N-CAB had the highest diagnostic accuracy with 95% sensitivity and 89% specificity to probable Alzheimer's disease. This was closely followed by the Symbol Match assessment, with a 96% sensitivity and 74% specificity to probable Alzheimer's disease. Additionally, Symbol Match and Path Points used in combination resulted in a sensitivity of 94%, specificity of 90%; a model with all N-CAB assessments resulted in a sensitivity and specificity of 100%. All N-CAB assessments had moderate to strong and significant correlations with the MMSE and HDS-R.

Discussion

Together, this suggests that the N-CAB assessment battery may be an appropriate alternative for the clinical screening of cognition for earlier detection of Alzheimer's disease.

Eye-tracking paradigms for the assessment of mild cognitive impairment: a systematic review

Mild cognitive impairment (MCI), representing the 'transitional zone' between normal cognition and dementia, has become a novel topic in clinical research. Although early detection is crucial, it remains logistically challenging at the same time. While traditional pen-and-paper tests require in-depth training to ensure standardized administration and accurate interpretation of findings, significant technological advancements are leading to the development of procedures for the early detection of Alzheimer's disease (AD) and facilitating the diagnostic process. Some of the diagnostic protocols, however, show significant limitations that hamper their widespread adoption. Concerns about the social and economic implications of the increasing incidence of AD underline the need for reliable, non-invasive, cost-effective, and timely cognitive scoring methodologies. For instance, modern clinical studies report significant oculomotor impairments among patients with MCI, who perform poorly in visual paired-comparison tasks by ascribing less attentional resources to novel stimuli. To accelerate the Global Action Plan on the Public Health Response to Dementia 2017-2025, this work provides an overview of research on saccadic and exploratory eye-movement deficits among older adults with MCI. The review protocol was drafted based on the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. Electronic databases were systematically searched to identify peer-reviewed articles published between 2017 and 2022 that examined visual processing in older adults with MCI and reported gaze parameters as potential biomarkers. Moreover, following the contemporary trend for remote healthcare technologies, we reviewed studies that implemented non-commercial eye-tracking instrumentation in order to detect information processing impairments among the MCI population. Based on the gathered literature, eye-tracking-based paradigms may ameliorate the screening limitations of traditional cognitive assessments and contribute to early AD detection. However, in order to translate the findings pertaining to abnormal gaze behavior into clinical applications, it is imperative to conduct longitudinal investigations in both laboratory-based and ecologically valid settings.

Intensive assessment of executive functions derived from performance in cognitive training games

Traditional neuropsychological tests accurately describe the current cognitive state but fall short to characterize cognitive change over multiple short time periods. We present an innovative approach to remote monitoring of executive functions on a monthly basis, which leverages the performance indicators from self-administered computerized cognitive training games (NUP-EXE). We evaluated the measurement properties of NUP-EXE in N = 56 individuals (59% women, 60-80 years) at increased risk of Alzheimer's disease (APOE-ϵ4 carriers with subjective cognitive decline) who completed a 12-month multimodal intervention for preventing cognitive decline. NUP-EXE presented good psychometric properties and greater sensitivity to change than traditional tests. Improvements in NUP-EXE correlated with improvements in functionality and were affected by participants' age and gender. This novel data collection methodology is expected to allow a more accurate characterization of an individual's response to a cognitive decline preventive intervention and to inform development of outcome measures for a new generation of intervention trials.

A novel tablet-based software for the acquisition and analysis of gaze and eye movement parameters: a preliminary validation study in Parkinson's disease

The idea that eye movements can reflect certain aspects of brain function and inform on the presence of neurodegeneration is not a new one. Indeed, a growing body of research has shown that several neurodegenerative disorders, such as Alzheimer's and Parkinson's Disease, present characteristic eye movement anomalies and that specific gaze and eye movement parameters correlate with disease severity. The use of detailed eye movement recordings in research and clinical settings, however, has been limited due to the expensive nature and limited scalability of the required equipment. Here we test a novel technology that can track and measure eye movement parameters using the embedded camera of a mobile tablet. We show that using this technology can replicate several well-known findings regarding oculomotor anomalies in Parkinson's disease (PD), and furthermore show that several parameters significantly correlate with disease severity as assessed with the MDS-UPDRS motor subscale. A logistic regression classifier was able to accurately distinguish PD patients from healthy controls on the basis of six eye movement parameters with a sensitivity of 0.93 and specificity of 0.86. This tablet-based tool has the potential to accelerate eye movement research via affordable and scalable eye-tracking and aid with the identification of disease status and monitoring of disease progression in clinical settings.

Associations of an eye-tracking task and pupillary metrics with age and ASA physical status score in a preoperative cohort

Advanced age, American Society of Anesthesiologists physical status (ASA) classification and the presence of cognitive impairment are associated with an elevated risk of postoperative morbidity and mortality. The visual paired comparison (VPC) task, which relies on recognition of novel images, examines declarative memory. VPC scores have demonstrated the ability to detect mild cognitive impairment and track progression of neurodegenerative disease. Quantitative pupillometry may have similar value. We evaluate for associations between these variables of interest and the feasibility of performing these tests in the preoperative clinic. Prospective data from 199 patients seen in the preoperative clinic at a tertiary academic center were analyzed. A 5 min VPC task (Neurotrack Technologies, Inc, Redwood City, CA) was administered during their scheduled preoperative clinic visit. Pupillary light reflexes were measured at the same visit (PLR-3000™, Neuroptics Corp, Irvine, California).Thirty-four percent of patients were categorized as ASA 2 and 58% as ASA 3. Median age was 57 (IQR: 44-69). Associations were demonstrated between age and ASA physical status (Mann-Whitney U Test, p < 0.0001), maximum pupil size (Spearman Rank Correlation, r = - 0.40, p < 0.0001), and maximum constriction velocity (Spearman Rank Correlation, r = - 0.39, p < 0.0001). Our data also revealed an association between VPC score and age (Spearman Rank Correlation, p = 0.0016, r = - 0.21) but not ASA score (Kruskal-Wallis Test, p = 0.14). When compared to a nonsurgical cohort with no history of memory impairment, our population scored worse on the VPC task (Mann-Whitney U Test, p = 0.0002). A preoperative 5 min VPC task and pupillometry are feasible tests in the preoperative setting and may provide a valuable window into an individual's cognition prior to elective surgery.

A Novel Digital Digit-Symbol Substitution Test Measuring Processing Speed in Adults At Risk for Alzheimer Disease: Validation Study

BACKGROUND

Assessing cognitive constructs affected by Alzheimer disease, such as processing speed (PS), is important to screen for potential disease and allow for early detection. Digital PS assessments have been developed to provide widespread, efficient cognitive testing, but all have been validated only based on the correlation between test scores. Best statistical practices dictate that concurrent validity should be assessed for agreement or equivalence rather than using correlation alone.

OBJECTIVE

This study aimed to assess the concurrent validity of a novel digital PS assessment against a gold-standard measure of PS.

METHODS

Adults aged 45-75 years (n=191) participated in this study. Participants completed the novel digital digit-symbol substitution test (DDSST) and the Repeatable Battery for the Assessment of Neuropsychological Status coding test (RBANS-C). The correlation between the test scores was determined using a Pearson product-moment correlation, and a difference in mean test scores between tests was checked for using a 2-tailed dependent samples t test. Data were analyzed for agreement between the 2 tests using Bland-Altman limits of agreement and equivalency using a two one-sided t tests (TOST) approach.

RESULTS

A significant moderate, positive correlation was found between DDSST and RBANS-C scores (r=.577; P<.001), and no difference in mean scores was detected between the tests (P=.93). Bias was nearly zero (0.04). Scores between the tests were found to display adequate agreement with 90% of score differences falling between -22.66 and 22.75 (90% limits of agreement=-22.91 to 22.99), and the scores were equivalent (P=.049).

CONCLUSIONS

Analyses indicate that the DDSST is a valid digital assessment of PS. The DDSST appears to be a suitable option for widespread, immediate, and efficient PS testing.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04559789; https://clinicaltrials.gov/ct2/show/NCT04559789.

Acute Inositol-Stabilized Arginine Silicate Improves Cognitive Outcomes in Healthy Adults

Inositol-stabilized arginine silicate (ASI) is an ergogenic aid that upregulates nitric oxide. Acute ASI supplementation improves working memory and processing speed in young adults but there is a lack of data examining other cognitive tasks. Therefore, the purpose of this study was to examine acute ASI effects on young healthy adults by assessing multiple cognitive domains. Nineteen young adults (20.9 ± 3.2 years) completed this randomized, double-blind, crossover study consuming ASI (1.5 g ASI + 12 g dextrose) and placebo (12 g dextrose). The participants completed the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) and two digital cognitive assessments before consuming the supplement and then completed the same battery of tests 60 min post-supplementation. Repeated measures ANOVA demonstrated that ASI consumption significantly improved total RBANS and immediate memory scores compared to the placebo (p < 0.05). However, no significant differences were displayed between trials for other cognitive domains (p > 0.05). Acute ASI ingestion increased overall RBANS scores and immediate memory scores in young adults. More research is needed to examine the acute effects of ASI on other domains of cognition, in older populations, and its long-term effects on cognition.

Current advances in digital cognitive assessment for preclinical Alzheimer's disease

There is a pressing need to capture and track subtle cognitive change at the preclinical stage of Alzheimer's disease (AD) rapidly, cost-effectively, and with high sensitivity. Concurrently, the landscape of digital cognitive assessment is rapidly evolving as technology advances, older adult tech-adoption increases, and external events (i.e., COVID-19) necessitate remote digital assessment. Here, we provide a snapshot review of the current state of digital cognitive assessment for preclinical AD including different device platforms/assessment approaches, levels of validation, and implementation challenges. We focus on articles, grants, and recent conference proceedings specifically querying the relationship between digital cognitive assessments and established biomarkers for preclinical AD (e.g., amyloid beta and tau) in clinically normal (CN) individuals. Several digital assessments were identified across platforms (e.g., digital pens, smartphones). Digital assessments varied by intended setting (e.g., remote vs. in-clinic), level of supervision (e.g., self vs. supervised), and device origin (personal vs. study-provided). At least 11 publications characterize digital cognitive assessment against AD biomarkers among CN. First available data demonstrate promising validity of this approach against both conventional assessment methods (moderate to large effect sizes) and relevant biomarkers (predominantly weak to moderate effect sizes). We discuss levels of validation and issues relating to usability, data quality, data protection, and attrition. While still in its infancy, digital cognitive assessment, especially when administered remotely, will undoubtedly play a major future role in screening for and tracking preclinical AD.

Protocol of the Cognitive Health in Ageing Register: Investigational, Observational and Trial Studies in Dementia Research (CHARIOT): Prospective Readiness cOhort (PRO) SubStudy

INTRODUCTION

The Cognitive Health in Ageing Register: Investigational, Observational and Trial Studies in Dementia Research (CHARIOT): Prospective Readiness cOhort (PRO) SubStudy (CPSS), sponsored by Janssen Pharmaceutical Research & Development LLC, is an Alzheimer's disease (AD) biomarker enriched observational study that began 3 July 2015 CPSS aims to identify and validate determinants of AD, alongside cognitive, functional and biological changes in older adults with or without detectable evidence of AD pathology at baseline.

METHODS AND ANALYSIS

CPSS is a dual-site longitudinal cohort (3.5 years) assessed quarterly. Cognitively normal participants (60-85 years) were recruited across Greater London and Edinburgh. Participants are classified as high, medium (amnestic or non-amnestic) or low risk for developing mild cognitive impairment-Alzheimer's disease based on their Repeatable Battery for the Assessment of Neuropsychological Status performance at screening. Additional AD-related assessments include: a novel cognitive composite, the Global Preclinical Alzheimer's Cognitive Composite, brain MRI and positron emission tomography and cerebrospinal fluid analysis. Lifestyle, other cognitive and functional data, as well as biosamples (blood, urine, and saliva) are collected. Primarily, study analyses will evaluate longitudinal change in cognitive and functional outcomes. Annual interim analyses for descriptive data occur throughout the course of the study, although inferential statistics are conducted as required.

ETHICS AND DISSEMINATION

CPSS received ethical approvals from the London-Central Research Ethics Committee (15/LO/0711) and the Administration of Radioactive Substances Advisory Committee (RPC 630/3764/33110) The study is at the forefront of global AD prevention efforts, with frequent and robust sampling of the well-characterised cohort, allowing for detection of incipient pathophysiological, cognitive and functional changes that could inform therapeutic strategies to prevent and/or delay cognitive impairment and dementia. Dissemination of results will target the scientific community, research participants, volunteer community, public, industry, regulatory authorities and policymakers. On study completion, and following a predetermined embargo period, CPSS data are planned to be made accessible for analysis to facilitate further research into the determinants of AD pathology, onset of symptomatology and progression.

TRIAL REGISTRATION NUMBER

The CHARIOT:PRO SubStudy is registered with clinicaltrials.gov (NCT02114372). Notices of protocol modifications will be made available through this trial registry.

A short digital eye-tracking assessment predicts cognitive status among adults

Current cognitive assessments suffer from limited scalability and high user burden. This study aimed to (1) examine the relationship between a brief eye-tracking-based visual paired-comparison (VPC) and gold standard cognitive assessments, (2) examine longitudinal stability of the VPC task, (3) determine the ability of the VPC task to differentiate between cognitively normal (CN) individuals and individuals with mild cognitive impairment (MCI). Fifty-five adults (n = 44 CN, n = 11 MCI; 56.4 ± 26.7 years) were tested on two occasions, separated by at least 14 days. Visit 1 included VPC, Montreal Cognitive Assessment (MoCA), Digit Symbol Coding test (DSC), and NIH Toolbox Cognitive Battery (NIHTB-CB). Visit 2 included VPC, DSC, NIHTB-CB, and dual-task (DT). Significant differences existed between baseline VPC scores for CN and MCI groups (p < .001). VPC scores remained stable over time in both groups (p < .05). Significant associations existed between VPC and MoCA (p < .01), DSC (p < .001), and various NIHTB-CB subtests at both time points. The VPC test significantly predicts cognitive outcomes (p < .05), with age and VPC being the only significant predictors. Additionally, area under the curve (receiver operator characteristic = 0.80) for VPC scores demonstrated good classification accuracy. VPC reliably predicted cognitive status while remaining stable over time and displayed significant associations with gold standard cognitive assessments. VPC is a less burdensome and more scalable assessment than traditional tests, enabling longitudinal monitoring of cognitive status in resource-limited environments.

Cognitive decline negatively impacts physical function

Many older adults report difficulty performing one or more activities of daily living. These difficulties may be attributed to cognitive decline and as a result, measuring cognitive status among aging adults may help provide an understanding of current functional status. The purpose of the present investigation was to determine the association between cognitive status and measures of physical functioning. Seventy-six older adults participated in this study; 41 were categorized as normal memory function (NM) and 35 were poor memory function (PM). NM participants had significantly higher physical function as measured by Short Physical Performance Battery (SPPB; 9.4 ± 2.2 vs. 8.4 ± 2.0; p = .03) and peak velocity (0.67 ± 0.16 vs. 0.56 ± 0.19; p = .04) during a quick sit-to-stand task. Dual-task walking velocities were 22% and 126% slower between cognitive groups for the fast and habitual trials, respectively when compared to the single-task walking condition. Significant correlations existed between measures of memory and physical function. The largest correlations with memory were for peak (r = 0.42) and average (r = 0.38) velocity. The results suggest a positive relationship between physical function and cognitive status. However, further research is needed to determine the mechanism of the underlying relationships between physical and cognitive function.

Environmental Distractions during Unsupervised Remote Digital Cognitive Assessment

The current demand for cognitive assessment cannot be met with traditional in-person methods, warranting the need for remote unsupervised options. However, lack of visibility into testing conditions and effort levels limit the utility of existing remote options. This retrospective study analyzed the frequency of and factors associated with environmental distractions during a brief digital assessment taken at home by 1,442 adults aged 23–84. Automated scoring algorithms flagged low data capture. Frequency of environmental distractions were manually counted on a per-frame and per-trial basis. A total of 7.4% of test administrations included distractions. Distractions were more frequent in men (41:350) than women (65:1,092) and the average age of distracted participants (51.7) was lower than undistracted participants (57.8). These results underscore the challenges associated with unsupervised cognitive assessment. Data collection methods that enable review of testing conditions are needed to confirm quality, usability, and actionability.

Development of a new virtual reality test of cognition: assessing the test-retest reliability, convergent and ecological validity of CONVIRT

Background

Technological advances provide an opportunity to refine tools that assess central nervous system performance. This study aimed to assess the test-retest reliability and convergent and ecological validity of a newly developed, virtual-reality, concussion assessment tool, ‘CONVIRT’, which uses eye-tracking technology to assess visual processing speed, and manual reaction time (pushing a button on a riding crop) to assess attention and decision-making. CONVIRT was developed for horse jockeys, as of all sportspersons, they are most at risk of concussion.

Methods

Participants (N = 165), were assessed with CONVIRT, which uses virtual reality to give the user the experience of riding a horse during a horserace. Participants were also assessed with standard Cogstate computer-based concussion measures in-between two completions of the CONVIRT battery. The physiological arousal induced by the test batteries were assessed via measures of heart rate and heart rate variability (LF/HF ratio).

Results

Satisfactory test-retest reliability and convergent validity with Cogstate attention and decision-making subtests and divergent validity in visual processing speed measures were observed. CONVIRT also increased heart rate and LF/HF ratio, which may better approximate participant arousal levels in their workplace.

Conclusions

CONVIRT may be a reliable and valid tool to assess elements of cognition and CNS disruption. The increased ecological validity may also mean better informed ‘return-to-play’ decisions and stronger industry acceptance due to the real-world meaningfulness of the assessment. However, before this can be achieved, the sensitivity of the CONVIRT battery needs to be demonstrated.

Eye tracking metrics to screen and assess cognitive impairment in patients with neurological disorders

PURPOSE OF REVIEW

Eye tracking is a powerful method to investigate the relationship between behavior and neural mechanisms. In recent years, eye movement analysis has been used in patients with neurological disorders to assess cognitive function. In this review, we explore the latest eye tracking researches in neurological disorders that are commonly associated with cognitive deficits, specifically, amyotrophic lateral sclerosis (ALS), Alzheimer's disease (AD), Parkinson's disease (PD), multiple sclerosis (MS), and epilepsy. We focus on the application of ocular measures in these disorders, with the goal of understanding how eye tracking technology can be used in the clinical setting.

FINDINGS

Eye tracking tasks (especially saccadic tasks) are often used as an adjunct to traditional scales for cognitive assessment. Eye tracking data confirmed that executive dysfunction is common in PD and ALS, whereas AD and MS are characterized by attention deficits. Research in evaluating cognitive function in epilepsy using eye tracking is still in its early stages, but this approach has shown advantages as a sensitive quantitative method with high temporal and spatial resolution. Eye tracking technology can facilitate the assessment of cognitive impairment with higher temporal resolution and finer granularity than traditional cognitive assessment. Oculomotor data collected during cognitive tasks can provide insight into biological processes. Eye tracking provides a nonverbal and less cognitively demanding method of measuring disease progression in cognitively impaired patients.

Engagement With a Digital Platform for Multimodal Cognitive Assessment and Multidomain Intervention in a Japanese Population: Pilot, Quasi-Experimental, Longitudinal Study

Background

As the global prevalence of dementia continues to rise, multidomain lifestyle interventions that address modifiable risk factors associated with pathological cognitive decline are increasing. Although some digital options have been developed to increase the reach and scalability of these programs, because of cultural differences, the efficacy of the programs in one population cannot easily be generalized to populations in other countries.

Objective

This investigation aimed to examine the usability and engagement of a digitally delivered multidomain cognitive lifestyle intervention developed in the United States for a Japanese population.

Methods

This feasibility investigation utilized a quasi-experimental, single-arm, nonrandomized, longitudinal design where participants engaged in the behavioral intervention on a smartphone. Of the 559 participants that initially enrolled (age: mean 51 years, SD 7.5 years; 51.7% female [289/559]), 242 completed the final testing trial. Participants enrolled in a multidomain lifestyle program that consisted of (1) psychoeducational material, (2) physical activity tracker, (3) nutrition tracker, (4) audio-based meditations, and (5) health coaching. Engagement with the program was assessed through the total number of app sessions and the use of the exercise, diet, and meditation tracking features within the app. The total number of minutes exercised was collected through subjective user inputs, and nutrition was quantified by the Mediterranean-DASH Intervention for Neurodegenerative Delay diet adherence score.

Results

Significant relationships existed between overall nutrition score and frequency of nutrition tracking (r=0.18), frequency of physical activity tracking (r=0.19), and the total number of minutes exercised (r=0.22). Total minutes exercised was significantly correlated with total app sessions (r=0.57), frequency of physical activity tracking (r=0.85), frequency of nutrition tracking (r=0.64), number of times participants meditated (r=0.46), and total lessons read (r=0.36). The number of completed lessons was significantly related to frequency of physical activity tracking (r=0.40), frequency of nutrition tracking (r=0.43), the total number of times participants meditated (r=0.35), and total minutes exercised (r=0.33). Dividing the cohort into two groups based on lesson completion (<10 lessons completed vs ≥10 lessons completed), significant differences were observed between the total minutes exercised, frequency of physical activity tracking, frequency of nutrition tracking, and total number of times participants meditated (all P values <.01).

Conclusions

Overall, this cross-cultural feasibility study in Japanese users demonstrated that the various engagement metrics were significantly correlated, and greater engagement was related to improved nutrition scores and increased time exercising. In addition, the relationships between lesson completion and other engagement metrics suggest that there may be value in exploring mechanisms that enhance lesson completion. Future research should examine the program in randomized control trials to more rigorously evaluate program efficacy.

Current State of Digital Biomarker Technologies for Real-Life, Home-Based Monitoring of Cognitive Function for Mild Cognitive Impairment to Mild Alzheimer Disease and Implications for Clinical Care: Systematic Review

BACKGROUND

Among areas that have challenged the progress of dementia care has been the assessment of change in symptoms over time. Digital biomarkers are defined as objective, quantifiable, physiological, and behavioral data that are collected and measured by means of digital devices, such as embedded environmental sensors or wearables. Digital biomarkers provide an alternative assessment approach, as they allow objective, ecologically valid, and long-term follow-up with continuous assessment. Despite the promise of a multitude of sensors and devices that can be applied, there are no agreed-upon standards for digital biomarkers, nor are there comprehensive evidence-based results for which digital biomarkers may be demonstrated to be most effective.

OBJECTIVE

In this review, we seek to answer the following questions: (1) What is the evidence for real-life, home-based use of technologies for early detection and follow-up of mild cognitive impairment (MCI) or dementia? And (2) What transformation might clinicians expect in their everyday practices?

METHODS

A systematic search was conducted in PubMed, Cochrane, and Scopus databases for papers published from inception to July 2018. We searched for studies examining the implementation of digital biomarker technologies for mild cognitive impairment or mild Alzheimer disease follow-up and detection in nonclinic, home-based settings. All studies that included the following were examined: community-dwelling older adults (aged 65 years or older); cognitively healthy participants or those presenting with cognitive decline, from subjective cognitive complaints to early Alzheimer disease; a focus on home-based evaluation for noninterventional follow-up; and remote diagnosis of cognitive deterioration.

RESULTS

An initial sample of 4811 English-language papers were retrieved. After screening and review, 26 studies were eligible for inclusion in the review. These studies ranged from 12 to 279 participants and lasted between 3 days to 3.6 years. Most common reasons for exclusion were as follows: inappropriate setting (eg, hospital setting), intervention (eg, drugs and rehabilitation), or population (eg, psychiatry and Parkinson disease). We summarized these studies into four groups, accounting for overlap and based on the proposed technological solutions, to extract relevant data: (1) data from dedicated embedded or passive sensors, (2) data from dedicated wearable sensors, (3) data from dedicated or purposive technological solutions (eg, games or surveys), and (4) data derived from use of nondedicated technological solutions (eg, computer mouse movements).

CONCLUSIONS

Few publications dealt with home-based, real-life evaluations. Most technologies were far removed from everyday life experiences and were not mature enough for use under nonoptimal or uncontrolled conditions. Evidence available from embedded passive sensors represents the most relatively mature research area, suggesting that some of these solutions could be proposed to larger populations in the coming decade. The clinical and research communities would benefit from increasing attention to these technologies going forward.

Validation of a digitally delivered visual paired comparison task: reliability and convergent validity with established cognitive tests

Alzheimer's disease (AD) affects the memory and cognitive function of approximately 5.7 million Americans. Early detection subsequently allows for earlier treatment and improves outcomes. Currently, there exists a validated 30-min eye-tracking cognitive assessment (VPC-30) for predicting AD risk. However, a shorter assessment would improve user experience and improve scalability. Thus, the purposes were to (1) determine convergent validity between the 5-min web camera-based eye-tracking task (VPC-5) and VPC-30, (2) examine the relationship between VPC-5 and gold-standard cognitive tests, and (3) determine the reliability and stability of VPC-5. This prospective study included two healthy cohorts: older adults (65+ years, n = 20) and younger adults (18-46 years, n = 24). Participants were tested on two separate occasions. Visit 1 included the Montreal Cognitive Assessment (MoCA), Digit Symbol Coding test (DSC), NIH Toolbox Cognitive Battery (NIHTB-CB), VPC-30, and VPC-5. Visit 2 occurred at least 14 days later; participants completed the VPC-5, DSC, NIHTB-CB, and dual-task walking assessments (DT). VPC-30 significantly correlated with VPC-5 at the first (p < .001) and second (p = .001) time points. VPC-5 and DSC (p < .01) and Pattern Comparison Processing Speed Test (PSPAC) (p = .01) were also correlated on day 1. Significant associations existed between VPC-5 and DSC (p < .001), Flanker Inhibitory Control Test (p = .05), PSPAC (p < .001), and Picture Sequence Memory Test (p = .02) during day 14 testing session. The test retest reliability of VPC-5 was significant (p < .001). VPC-5 displayed moderate convergent validity with the VPC-30 and gold-standard measures of cognition, while demonstrating strong stability, suggesting it is a valuable assessment for monitoring memory function.

Device-Embedded Cameras for Eye Tracking-Based Cognitive Assessment: Implications for Teleneuropsychology

Introduction: Widespread screening for cognitive decline is an important challenge to address as the aging population grows, but there is currently a shortage of clinical infrastructure to meet the demand for in-person evaluation. Remotely delivered assessments that utilize eye-tracking data from webcams, such as visual paired comparison (VPC) tasks, could increase access to remote, asynchronous neuropsychological screening for cognitive decline but further validation against clinical-grade eye trackers is required. Methods: To demonstrate equivalence between a novel automated scoring system for eye-tracking metrics acquired through a laptop-embedded camera and a gold-standard eye tracker, we analyzed VPC data from 18 subjects aged 50+ with normal cognitive function across three visits. The eye tracker data were scored by the manufacturer's software, and the webcam data were scored by a novel algorithm. Results: Automated scoring of webcam-based VPC data revealed strong correlations with the clinical-grade eye-tracking camera. Correlation of mean VPC performance across all time points was robust: r = 0.95 (T1 r = 0.97; T2 r = 0.88; T3 r = 0.97; p's < 0.001). Correlation of per-trial performance across time points was also robust: r = 0.88 (T1 r = 0.85; T2 r = 0.89; T3 r = 0.92; p's < 0.001). Mean differences between performance data acquired by each device were 0.00. Conclusion: These results suggest that device-embedded cameras are a valid and scalable alternative to traditional laboratory-based equipment for gaze-based tasks measuring cognitive function. The validation of this technique represents an important technical advance for the field of teleneuropsychology.