Computerized cognitive testing for older adults: a review

Normative data for COGITAB: An Italian tablet-based test battery conceived for the preclinical phase of Alzheimer's disease

The number of people with dementia is increasing worldwide. Two main approaches have been adopted to identify subjects with Alzheimer's disease (AD): the neuropsychological evaluation and the identification of biomarkers of AD. The first method is less invasive and easier to perform. This study assesses the psychometric properties of COGITAB, a novel web application d esigned to be sensitive to the subtle cognitive changes distinctive of the early Mild Cognitive Impairment (MCI) and the preclinical phase of AD. We enrolled 518 healthy controls, classified according to several risk factors and the presence of a family history of dementia. The participants were given COGITAB after a neuropsychological screening. The COGITAB Total Score (TS) was significantly affected by age and years of education. Acquired risk factors and family history of dementia significantly impacted only the COGITAB total execution time (TET), not the TS. This study provides normative data for a newly developed web application. Control subjects with acquired risk factors performed slower, giving an important role to the TET recording. Further studies should examine the ability of this new technology to discriminate between healthy subjects and subjects with initial cognitive decline, even when not detected by standard neuropsychological assessments.

Diagnostic performance of self-administered unsupervised computerized cognitive tests for the identification of mild cognitive impairment (MCI) and dementia: a systematic review and meta-analysis

OBJECTIVES

Self-administered, unsupervised computerized tools for community-based early cognitive screening are gradually being developed and applied. This study aims to evaluate the diagnostic performance and system usability of those tools in detecting MCI and dementia in older adults.

METHOD

Five electronic databases were systematically searched from inception to 17 August 2023. The included studies were reported using the PRISMA 2020 guideline, the risk of bias and applicability was assessed using QUADAS-2.

RESULTS

28 articles were included in the systematic review and 21 studies in the meta-analysis. The pooled sensitivity and specificity for unsupervised computerized tools were 0.84 (95% CI: 0.81 - 0.87) and 0.86 (95% CI: 0.82 - 0.89) respectively. Meta-regression showed that mean age, cognitive status, cognitive domains and administration time might be responsible for heterogeneity. Notably, tools taking less than 5 min had a pooled sensitivity of 0.85 (95% CI: 0.81-0.89). However, only 3 studies evaluated feasibility and system usability in the intended clinical settings.

CONCLUSION

Unsupervised computerized cognitive screening tools demonstrate good diagnostic performance for MCI/dementia, and tools taking less than 5 min appear particularly suitable for large-scale cognitive screening. Future research should combine various cognitive data to develop multimodal screening tools with better diagnostic performance, evaluate these tools' usability and improve age-friendly designs.

Cross-Cultural Adaptation and Spanish Validation of the Computerized Information Processing Assessment Battery (COGNITO)

INTRODUCTION

Mild cognitive impairment (CI) has an exponential increase in its prevalence and causes functional deficits and dependence. Its early detection allows for timely treatment and greater therapeutic efficacy. However, mild cognitive impairment (MCI) is currently underdiagnosed. Although recent decades have seen a rise in computerized instruments for the detection and early diagnosis of MCI, showing numerous advantages over the classic paper-and-pencil methods, such as standardized stimulus presentation. However, their limitations include the use of self-administered application without professional supervision. Few of these instruments have Spanish-adapted versions.

OBJECTIVE

To translate, adapt, and validate the computerized Information Processing Assessment Battery (COGNITO) battery in the Spanish population and to develop a portable administration system that facilitates its application in different settings. COGNITO was then administered to 232 Spanish participants (18-89 years) without cognitive impairment, after which preliminary normative data were obtained.

RESULTS

Strong positive correlations were found between the main cognitive domains assessed by COGNITO and the variables of age, educational level, and MEC score. The gender variable only correlated with visuospatial skills, with men outperforming women. The test-retest correlations conducted after 4 weeks with 89 participants revealed adequate reliability coefficients ranging between.63 and.66 (visuospatial skills = 0.35). Internal consistency coefficients were satisfactory in Attention-Executive Functions and Memory domains.

CONCLUSIONS

The Spanish adaptation of COGNITO shows adequate psychometric characteristics of validity and reliability. The preliminary normative data provided may contribute to the early detection of cognitive impairments associated with both normal aging and various types of neurological pathology. This tool has great utility and versatility for neuropsychological practice.

Modernizing the Staging of Parkinson Disease Using Digital Health Technology

Due to the complicated nature of Parkinson disease (PD), a number of subjective considerations (eg, staging schemes, clinical assessment tools, or questionnaires) on how best to assess clinical deficits and monitor clinical progression have been published; however, none of these considerations include a comprehensive, objective assessment of all functional areas of neurocognition affected by PD (eg, motor, memory, speech, language, executive function, autonomic function, sensory function, behavior, and sleep). This paper highlights the increasing use of digital health technology (eg, smartphones, tablets, and wearable devices) for the classification, staging, and monitoring of PD. Furthermore, this Viewpoint proposes a foundation for a new staging schema that builds from multiple clinically implemented scales (eg, Hoehn and Yahr Scale and Berg Balance Scale) for ease and homogeneity, while also implementing digital health technology to expand current staging protocols. This proposed staging system foundation aims to provide an objective, symptom-specific assessment of all functional areas of neurocognition via inherent device capabilities (eg, device sensors and human-device interactions). As individuals with PD may manifest different symptoms at different times across the spectrum of neurocognition, the modernization of assessments that include objective, symptom-specific monitoring is imperative for providing personalized medicine and maintaining individual quality of life.

Validation and convergent validity of the Boston cognitive assessment (BOCA) in an Italian population: a comparative study with the Montreal cognitive assessment (MoCA) in Alzheimer's disease spectrum

BACKGROUND

The Boston Cognitive Assessment (BOCA) is a self-administered online test developed for cognitive screening and longitudinal monitoring of brain health in an aging population. The study aimed to validate BOCA in an Italian population and to investigate the convergent validity with the Montreal Cognitive Assessment (MOCA) in healthy ageing population and patients within the Alzheimer Disease spectrum.

METHODS

BOCA was administered to 150 participants, including cognitively healthy controls (HC, n = 50), patients with mild cognitive impairment (MCI, n = 50), and dementia (DEM, n = 50). The BOCA reliability was assessed using (i) Spearman's correlation analysis between subscales; (ii) Cronbach's alpha calculation, and (iii) Principal Component Analysis. Repeated-measures ANOVA was employed to assess the impact of the sequence of test administrations between the groups. BOCA performance between HS, MCI and DEM and within different severity subgroups were compared using Kruskall Wallis test. Furthermore, a comparison was conducted between MCI patients who tested positive for amyloid and those who tested negative, utilizing Mann Whitney's U-test.

RESULTS

Test scores were significantly different between patients and controls (p < 0.001) suggesting good discriminative ability. The Cronbach's alpha was 0.82 indicating a good internal consistency of the BOCA subscales and strong-to-moderate Spearman's correlation coefficients between them. BOCA total and subscores differ across different MoCA severity subgroups and demonstrated strong correlation with MoCA scores (rho = 0.790, p < 0.001).

CONCLUSIONS

The Italian version of the BOCA test exhibited validity, feasibility, and accurate discrimination closely performing as MoCA.

Test-retest reliability, practice effects and estimates of change: A study on the Mindmore digital cognitive assessment tool

The present study aimed to establish test-retest reliability and investigate practice effects of the Mindmore cognitive assessment tool, a digital adaptation of traditional pencil and paper tests designed for self-administration. Additionally, normative change scores for the most frequently used tests were derived. A total of 149 healthy Swedish adults (aged 20-79) completed the test battery twice, 1 month apart. The battery assessed attention and processing speed, memory, language, visuospatial functions, and executive functions. Test-retest reliability, measured by ICC and Spearman coefficients, and practice effects were estimated for 22 main-scores and 33 sub-scores. Regression models were used to assess change in performance while controlling for demographics, computer equipment, testing location (online or in-laboratory) and baseline performance for 12 main-scores and nine sub-scores. Test-retest reliability was good for 11 main-scores (≥0.70), satisfactory for five (0.60-0.69), and minimal for six (<0.60) albeit three having satisfactory sub-scores. Practice effects were observed for tests with a major speed component, but not for reaction time, sustained attention, verbal memory and naming (alternate forms), nor visuospatial functions. Trackpad negatively influenced change for one test. Demographics and testing location did not significantly affect the change scores. Our study provides support for test-retest reliability and practice effects of the Mindmore cognitive assessment tool which were comparable to those of traditional tests. These findings, together with the normative change scores, can aid researchers and clinicians in interpreting test results and distinguishing between normal variations in performance and changes indicative of clinical impairment.

A User-Centered Design Approach for a Screening App for People With Cognitive Impairment (digiDEM-SCREEN): Development and Usability Study

Background

Dementia is a widespread syndrome that currently affects more than 55 million people worldwide. Digital screening instruments are one way to increase diagnosis rates. Developing an app for older adults presents several challenges, both technical and social. In order to make the app user-friendly, feedback from potential future end users is crucial during this development process.

Objective

This study aimed to establish a user-centered design process for the development of digiDEM-SCREEN, a user-friendly app to support early identification of persons with slight symptoms of dementia.

Methods

This research used qualitative and quantitative methods and involved 3 key stakeholder groups: the digiDEM research team, the software development team, and the target user group (older adults ≥65 years with and without cognitive impairments). The development of the screening app was based on an already existing and scientifically analyzed screening test (Self-Administered Tasks Uncovering Risk of Neurodegeneration; SATURN). An initial prototype was developed based on the recommendations for mobile health apps and the teams' experiences. The prototype was tested in several iterations by various end users and continuously improved. The app's usability was evaluated using the System Usability Scale (SUS), and verbal feedback by the end users was obtained using the think-aloud method.

Results

The translation process during test development took linguistic and cultural aspects into account. The texts were also adapted to the German-speaking context. Additional instructions were developed and supplemented. The test was administered using different randomization options to minimize learning effects. digiDEM-SCREEN was developed as a tablet and smartphone app. In the first focus group discussion, the developers identified and corrected the most significant criticism in the next version. Based on the iterative improvement process, only minor issues needed to be addressed after the final focus group discussion. The SUS score increased with each version (score of 72.5 for V1 vs 82.4 for V2), while the verbal feedback from end users also improved.

Conclusions

The development of digiDEM-SCREEN serves as an excellent example of the importance of involving experts and potential end users in the design and development process of health apps. Close collaboration with end users leads to products that not only meet current standards but also address the actual needs and expectations of users. This is also a crucial step toward promoting broader adoption of such digital tools. This research highlights the significance of a user-centered design approach, allowing content, text, and design to be optimally tailored to the needs of the target audience. From these findings, it can be concluded that future projects in the field of health apps would also benefit from a similar approach.

Digital screening tool for the assessment of cognitive impairment in unsupervised setting-digiDEM-SCREEN: study protocol for a validation study

INTRODUCTION

Dementia is one of the most relevant widespread diseases, with a prevalence of currently 55 million people with dementia worldwide. However, about 60-75% of people with dementia have not yet received a formal diagnosis. Asymptomatic screening of cognitive impairments using neuropsychiatric tests has been proven to efficiently enhance diagnosis rates. Digital screening tools, in particular, provide the advantage of being accessible without spatial or time restrictions. The study aims to validate a digital cognitive screening test (digiDEM-SCREEN) as an app in the German language.

METHODS AND ANALYSIS

This is a multicentre study in Bavaria. Participants are people with mild cognitive impairment, people with dementia in an early stage and cognitively healthy people. Recruitment will take place in specialised diagnostic facilities (memory outpatient clinics). 135 participants are aimed based on a power analysis. Sociodemographic data, diagnosis and results of neuropsychiatric tests (Consortium to Establish a Registry for Alzheimer's Disease, Montreal Cognitive Assessment, digiDEM-SCREEN) will be collected at one point per person via electronic data capturing. The sensitivity, specificity and corresponding cut-off values will be determined based on receiver-operating-characteristic curves. The correlation of the digiDEM-SCREEN test with existing cognitive screening/testing procedures will be analysed.

ETHICS AND DISSEMINATION

The study obtained ethical approval from the Ethics Committee of the Julius-Maximilians-Universität of Würzburg (JMU) (application number: 177/23-sc). The test will give feedback about the current cognitive status and possible cognitive impairments that should lead to the users seeking further diagnostic measures by medical professionals. It will be accessible free of charge in established app stores. The results of the validation study will be published in peer-reviewed journals.

Computerized assessment of executive functioning: Validation of the CNS Vital Signs executive functioning scores in a sample of community-dwelling older adults

Objective: Computerized assessment of cognitive functioning has gained significant popularity over recent years, yet options for clinical assessment of executive functioning (EF) are lacking. One computerized testing platform, CNS Vital Signs (CNS-VS), offers tests designed to measure EF but requires further validation. The goal of the present study was to validate CNS-VS executive scores against standard clinical measures of EF. We also sought to determine whether a modified CNS-VS composite score that included variables purported to measure inhibition, switching, and working memory would outperform the currently available CNS-VS Executive Function Index. Method: A sample of 73 cognitively healthy older adults completed four tests from the Delis-Kaplan Executive Function System, the Digit Span subtest from the Wechsler Adult Intelligence Scale-fourth edition, and three CNS-VS tasks purported to measure inhibition, switching, and working memory. Results: Performances on the CNS-VS tests were predicted by performances on standard paper-and-pencil measures. Although the currently available CNS-VS Executive Function Index predicted unique variance in a well-validated paper-and-pencil EF composite score, our Modified CNS-VS EF composite accounted for unique variance above and beyond the original CNS-VS Executive Function Index, while the reverse was not true. Conclusions: The present results support the construct validity of CNS-VS EF tests but also suggest that modifications to their current composite scores would improve the prediction of EF performance.

Development and validation of a self-administered computerized cognitive assessment based on automatic speech recognition

Existing computerized cognitive tests (CCTs) lack speech recognition, which limits their assessment of language function. Therefore, we developed CogMo, a self-administered CCT that uses automatic speech recognition (ASR) to assess multi-domain cognitive functions, including language. This study investigated the validity and reliability of CogMo in discriminating cognitive impairments. CogMo automatically provides CCT results; however, manual scoring using recorded audio was performed to verify its ASR accuracy. The mini-mental state examination (MMSE) was used to assess cognitive functions. Pearson's correlation was used to analyze the relationship between the MMSE and CogMo results, intraclass correlation coefficient (ICC) was used to evaluate the test-retest reliability of CogMo, and receiver operating characteristic (ROC) analysis validated its diagnostic accuracy for cognitive impairments. Data of 100 participants (70 with normal cognition, 30 with cognitive impairment), mean age 74.6±7.4 years, were analyzed. The CogMo scores indicated significant differences in cognitive levels for all test items, including manual and automatic scoring for the speech recognition test, and a very high correlation (r = 0.98) between the manual and automatic CogMo scores. Additionally, the total CogMo and MMSE scores exhibited a strong correlation (r = 0.89). Moreover, CogMo exhibited high test-retest reliability (ICC = 0.94) and ROC analysis yielded an area under the curve of 0.89 (sensitivity = 90.0%, specificity = 82.9%) at a cutoff value of 68.8 points. The CogMo demonstrated adequate validity and reliability for discriminating multi-domain cognitive impairment, including language function, in community-dwelling older adults.

Investigating the acute cognitive effects of dietary compounds using fNIRS: methodological limitations and perspectives for research targeting healthy adults

The brain's response to cognitive demands hinges on sufficient blood flow, with changes in brain hemodynamics serving as a reflection of this process. Certain bioactive compounds found in our diet, such as caffeine, polyphenols, and nitrate, can acutely impact brain hemodynamics through diverse neural, vasoactive, and metabolic mechanisms. Functional Near-Infrared Spectroscopy (fNIRS) offers a non-invasive and real-time method to investigate these effects. Despite their potential, fNIRS studies investigating the acute impacts of bioactive compounds on cognition face methodological gaps, especially in controlling confounding factors. Given the impact of these confounding effects, which can be significant due to the relatively limited sample size of such studies, there is a need to refine the methodologies employed. This review proposes recommendations to enhance current methodologies in the research field, focusing on key aspects of the data collection phase, including research design, experimental paradigms, and participant demographics, and their integration into the analysis phase. Ultimately, it seeks to advance our understanding of the effects of bioactive compounds on cognitive functions to contribute to the development of targeted nutritional interventions for improved brain health.

The Potential of Automated Assessment of Cognitive Function Using Non-Neuroimaging Data: A Systematic Review

Background/Objectives: The growing incidence of cognitive impairment among older adults has a significant impact on individuals, family members, caregivers, and society. Current conventional cognitive assessment tools are faced with some limitations. Recent evidence suggests that automating cognitive assessment holds promise, potentially resulting in earlier diagnosis, timely intervention, improved patient outcomes, and higher chances of response to treatment. Despite the advantages of automated assessment and technological advancements, automated cognitive assessment has yet to gain widespread use, especially in low and lower middle-income countries. This review highlights the potential of automated cognitive assessment tools and presents an overview of existing tools. Methods: This review includes 87 studies carried out with non-neuroimaging data alongside their performance metrics. Results: The identified articles automated the cognitive assessment process and were grouped into five categories either based on the tools' design or the data analysis approach. These categories include game-based, digital versions of conventional tools, original computerized tests and batteries, virtual reality/wearable sensors/smart home technologies, and artificial intelligence-based (AI-based) tools. These categories are further explained, and evaluation of their strengths and limitations is discussed to strengthen their adoption in clinical practice. Conclusions: The comparative metrics of both conventional and automated approaches of assessment suggest that the automated approach is a strong alternative to the conventional approach. Additionally, the results of the review show that the use of automated assessment tools is more prominent in countries ranked as high-income and upper middle-income countries. This trend merits further social and economic studies to understand the impact of this global reality.

Factor Structure and Validity of Composite Scores Resulting From a Computerized Cognitive Test Battery in Healthy Adults and Patients With Primary Brain Tumors

Computerized neuropsychological test batteries (CNTs), such as Central Nervous System Vital Signs (CNS VS), are increasingly used for measuring cognitive functioning, but empirical evidence of how they measure cognition is scarce. We investigated the factor structure of CNS VS using exploratory factor analyses four samples: healthy adults (n = 169), patients with meningioma (392), low-grade glioma (99), and high-grade glioma (247). We tested model fit and investigated measurement invariance. Differences in factor interpretation existed between healthy participants and patients. Factor structures among patient groups were approximately the same but differed in non-zero loadings. Overall, factor structures largely did not support the "clinical domains" provided by CNS VS for clinical interpretation. Confirmatory models did not have a good fit, and measurement invariance could not be established. Our results indicate that (weighted) sum scores of CNS VS results may lack validity. We recommend researchers and clinicians to use scores on individual test measures.

General Principles, Etiologies, Evaluation, and Management in Older Adults

Hypertension impacts most older adults as one of many multiple chronic conditions. A thorough evaluation is required to assess overall health, cardiovascular status, and comorbid conditions that impact treatment targets. In the absence of severe frailty or dementia, intensive treatment prevents more cardiovascular events than standard treatment and may slow cognitive decline. "Start low and go slow" is not the best strategy for many older adults as fewer cardiovascular events occur when hypertension is controlled within the first 3 to 6 months of treatment.

A Novel Computerized Flexible Attention Test in Detecting Executive Dysfunction of Patients with Early-Onset Cognitive Impairment and Dementia

OBJECTIVE

The number of computer-based cognitive tests has increased in recent years, but there is a need for tests focusing on the assessment of executive function (EF), as it can be crucial for the identification of early-onset neurodegenerative disorders. This study aims to examine the ability of the Flexible Attention Test (FAT), a new computer-based test battery for detecting executive dysfunction of early-onset cognitive impairment and dementia patients.

METHOD

We analyzed the FAT subtask results in memory clinic patients with cognitive symptom onset at ≤65 years. The patients were divided into four groups: early onset dementia (EOD, n = 48), mild cognitive impairment due to neurological causes (MCI-n, n = 34), MCI due to other causes (MCI-o, n = 99), and subjective cognitive decline (SCD, n = 14). The test accuracy to distinguish EOD patients from other groups was examined, as well as correlations with pen-and-paper EF tests. We also reported the 12-months follow-up results.

RESULTS

The EOD and MCI-n patients performed significantly poorer (p ≤ .002) than those in the MCI-o and SCD groups in most of the FAT subtasks. The accuracies of the FAT subtasks to detect EOD from other causes were mainly moderate (0.34 ≤ area under the curve < 0.74). The FAT subtasks correlated logically with corresponding pen-and-paper EF tests (.15 ≤ r ≤ .75). No systematic learning effects were detected in the FAT performance at follow-up.

CONCLUSIONS

The FAT appears to be a promising method for the precise evaluation of EF and applicable distinguishing early-onset neurodegenerative disorders from patients with other causes of cognitive problems.

Test-retest reliability and reliable change index of the Philips IntelliSpace Cognition digital test battery

OBJECTIVE

This article provides the test-retest reliability and Reliable Change Indices (RCIs) of the Philips IntelliSpace Cognition (ISC) platform, which contains digitized versions of well-established neuropsychological tests.

METHOD

147 participants (ages 19 to 88) completed a digital cognitive test battery on the ISC platform or paper-pencil versions of the same test battery during two separate visits. Intraclass correlation coefficients (ICC) were calculated separately for the ISC and analog test versions to compare reliabilities between administration modalities. RCIs were calculated for the digital tests using the practice-adjusted RCI and standardized regression-based (SRB) method.

RESULTS

Test-retest reliabilities for the ISC tests ranged from moderate to excellent and were comparable to the test-retest reliabilities for the paper-pencil tests. Baseline test performance, retest interval, age, and education predicted test performance at visit 2 with baseline test performance being the strongest predictor for all outcome measures. For most outcome measures, both methods for the calculation of RCIs show agreement on whether or not a reliable change was observed.

CONCLUSIONS

RCIs for the digital tests enable clinicians to determine whether a measured change between assessments is due to real improvement or decline. Together, this contributes to the growing evidence for the clinical utility of the ISC platform.

Initial results from the PHEFREE longitudinal natural history study: Cross-sectional observations in a cohort of individuals with phenylalanine hydroxylase (PAH) deficiency

Over fifty years have passed since the last large scale longitudinal study of individuals with PAH deficiency in the U.S. Since then, there have been significant changes in terms of treatment recommendations as well as treatment options. The Phenylalanine Families and Researchers Exploring Evidence (PHEFREE) Consortium was recently established to collect a more up-to-date and extensive longitudinal natural history in individuals with phenylketonuria across the lifespan. In the present paper, we describe the structure and methods of the PHEFREE longitudinal study protocol and report cross-sectional data from an initial sample of 73 individuals (5 months to 54 years of age) with PAH deficiency who have enrolled. Looking forward, the study holds the promise for advancing the field on several fronts including the validation of novel neurocognitive tools for assessment in individuals with PKU as well as evaluation of the long-term effects of changes in metabolic control (e.g., effects of Phe-lowering therapies) on outcome.

A Longitudinal Study of CogEvo's Prediction of Cognitive Decline in Older Adults

The predictive abilities of computer-based screening devices for early cognitive decline (CD) in older adults have rarely been longitudinally examined. Therefore, this study examined the ability of CogEvo, a short-duration, computer-based cognitive screening device requiring little professional involvement, to predict CD among community-dwelling older adults. We determined whether 119 individuals aged ≥ 65 years living in Japanese rural communities who scored ≥ 24 on the Mini-Mental State Examination (MMSE) at baseline developed CD by annually administering the MMSE to them. CD was defined as an MMSE score of ≤23. At baseline, the overall CogEvo judgment grade, with lower grades indicating better cognitive function, was calculated from the results of various cognitive tasks. Over 2 years, 10 participants developed CD. Participants with grades of 4 had a higher percentage of CD cases than those with grades of ≤3 (p < 0.01). This relationship remained significant after controlling for possible confounders, including the MMSE score at baseline. The sensitivity and specificity of the CogEvo grade cutoff of 4 were 50.0% and 93.6%, respectively. In conclusion, CogEvo may be an efficient tool for identifying individuals at a high risk for dementia. The possibility of missing CD cases should be considered when using CogEvo for screening.

The Real-World Usability, Feasibility, and Performance Distributions of Deploying a Digital Toolbox of Computerized Assessments to Remotely Evaluate Brain Health: Development and Usability Study

BACKGROUND

An ongoing global challenge is managing brain health and understanding how performance changes across the lifespan.

OBJECTIVE

We developed and deployed a set of self-administrable, computerized assessments designed to measure key indexes of brain health across the visual and auditory sensory modalities. In this pilot study, we evaluated the usability, feasibility, and performance distributions of the assessments in a home-based, real-world setting without supervision.

METHODS

Potential participants were untrained users who self-registered on an existing brain training app called BrainHQ. Participants were contacted via a recruitment email and registered remotely to complete a demographics questionnaire and 29 unique assessments on their personal devices. We examined participant engagement, descriptive and psychometric properties of the assessments, associations between performance and self-reported demographic variables, cognitive profiles, and factor loadings.

RESULTS

Of the 365,782 potential participants contacted via a recruitment email, 414 (0.11%) registered, of whom 367 (88.6%) completed at least one assessment and 104 (25.1%) completed all 29 assessments. Registered participants were, on average, aged 63.6 (SD 14.8; range 13-107) years, mostly female (265/414, 64%), educated (329/414, 79.5% with a degree), and White (349/414, 84.3% White and 48/414, 11.6% people of color). A total of 72% (21/29) of the assessments showed no ceiling or floor effects or had easily modifiable score bounds to eliminate these effects. When correlating performance with self-reported demographic variables, 72% (21/29) of the assessments were sensitive to age, 72% (21/29) of the assessments were insensitive to gender, 93% (27/29) of the assessments were insensitive to race and ethnicity, and 93% (27/29) of the assessments were insensitive to education-based differences. Assessments were brief, with a mean duration of 3 (SD 1.0) minutes per task. The pattern of performance across the assessments revealed distinctive cognitive profiles and loaded onto 4 independent factors.

CONCLUSIONS

The assessments were both usable and feasible and warrant a full normative study. A digital toolbox of scalable and self-administrable assessments that can evaluate brain health at a glance (and longitudinally) may lead to novel future applications across clinical trials, diagnostics, and performance optimization.

Digital Neuropsychology beyond Computerized Cognitive Assessment: Applications of Novel Digital Technologies

Compared with other health disciplines, there is a stagnation in technological innovation in the field of clinical neuropsychology. Traditional paper-and-pencil tests have a number of shortcomings, such as low-frequency data collection and limitations in ecological validity. While computerized cognitive assessment may help overcome some of these issues, current computerized paradigms do not address the majority of these limitations. In this paper, we review recent literature on the applications of novel digital health approaches, including ecological momentary assessment, smartphone-based assessment and sensors, wearable devices, passive driving sensors, smart homes, voice biomarkers, and electronic health record mining, in neurological populations. We describe how each digital tool may be applied to neurologic care and overcome limitations of traditional neuropsychological assessment. Ethical considerations, limitations of current research, as well as our proposed future of neuropsychological practice are also discussed.

Measuring the Reliability of a Gamified Stroop Task: Quantitative Experiment

BACKGROUND

Few gamified cognitive tasks are subjected to rigorous examination of psychometric properties, despite their use in experimental and clinical settings. Even small manipulations to cognitive tasks require extensive research to understand their effects.

OBJECTIVE

This study aims to investigate how game elements can affect the reliability of scores on a Stroop task. We specifically investigated performance consistency within and across sessions.

METHODS

We created 2 versions of the Stroop task, with and without game elements, and then tested each task with participants at 2 time points. The gamified task used points and feedback as game elements. In this paper, we report on the reliability of the gamified Stroop task in terms of internal consistency and test-retest reliability, compared with the control task. We used a permutation approach to evaluate internal consistency. For test-retest reliability, we calculated the Pearson correlation and intraclass correlation coefficients between each time point. We also descriptively compared the reliability of scores on a trial-by-trial basis, considering the different trial types.

RESULTS

At the first time point, the Stroop effect was reduced in the game condition, indicating an increase in performance. Participants in the game condition had faster reaction times (P=.005) and lower error rates (P=.04) than those in the basic task condition. Furthermore, the game condition led to higher measures of internal consistency at both time points for reaction times and error rates, which indicates a more consistent response pattern. For reaction time in the basic task condition, at time 1, rSpearman-Brown=0.78, 95% CI 0.64-0.89. At time 2, rSpearman-Brown=0.64, 95% CI 0.40-0.81. For reaction time, in the game condition, at time 1, rSpearman-Brown=0.83, 95% CI 0.71-0.91. At time 2, rSpearman-Brown=0.76, 95% CI 0.60-0.88. Similarly, for error rates in the basic task condition, at time 1, rSpearman-Brown=0.76, 95% CI 0.62-0.87. At time 2, rSpearman-Brown=0.74, 95% CI 0.58-0.86. For error rates in the game condition, at time 1, rSpearman-Brown=0.76, 95% CI 0.62-0.87. At time 2, rSpearman-Brown=0.74, 95% CI 0.58-0.86. Test-retest reliability analysis revealed a distinctive performance pattern depending on the trial type, which may be reflective of motivational differences between task versions. In short, especially in the incongruent trials where cognitive conflict occurs, performance in the game condition reaches peak consistency after 100 trials, whereas performance consistency drops after 50 trials for the basic version and only catches up to the game after 250 trials.

CONCLUSIONS

Even subtle gamification can impact task performance albeit not only in terms of a direct difference in performance between conditions. People playing the game reach peak performance sooner, and their performance is more consistent within and across sessions. We advocate for a closer examination of the impact of game elements on performance.

"Guttmann Cognitest®," a digital solution for assessing cognitive performance in adult population: A feasibility and usability pilot study

Background

As the world population continues to age, the prevalence of neurological diseases, such as dementia, poses a significant challenge to society. Detecting cognitive impairment at an early stage is vital in preserving and enhancing cognitive function. Digital tools, particularly mHealth, offer a practical solution for large-scale population screening and prompt follow-up assessments of cognitive function, thus overcoming economic and time limitations.

Objective

In this work, two versions of a digital solution called Guttmann Cognitest® were tested.

Methods

Two hundred and one middle-aged adults used the first version (Group A), while 132 used the second one, which included improved tutorials and practice screens (Group B). This second version was also validated in an older age group (Group C).

Results

This digital solution was found to be highly satisfactory in terms of usability and feasibility, with good acceptability among all three groups. Specifically for Group B, the system usability scale score obtained classifies the solution as the best imaginable in terms of usability.

Conclusions

Guttmann Cognitest® has been shown to be effective and well-perceived, with a high potential for sustained engagement in tracking changes in cognitive function.

Toward digitally screening and profiling AD: A GAMLSS approach of MemTrax in China

PURPOSES

To establish a normative range of MemTrax (MTx) metrics in the Chinese population.

METHODS

The correct response percentage (MTx-%C) and mean response time (MTx-RT) were obtained and the composite scores (MTx-Cp) calculated. Generalized additive models for location, shape and scale (GAMLSS) were applied to create percentile curves and evaluate goodness of fit, and the speed-accuracy trade-off was investigated.

RESULTS

26,633 subjects, including 13,771 (51.71%) men participated in this study. Age- and education-specific percentiles of the metrics were generated. Q tests and worm plots indicated adequate fit for models of MTx-RT and MTx-Cp. Models of MTx-%C for the low and intermediate education fit acceptably, but not well enough for a high level of education. A significant speed-accuracy trade-off was observed for MTx-%C from 72 to 94.

CONCLUSIONS

GAMLSS is a reliable method to generate smoothed age- and education-specific percentile curves of MTx metrics, which may be adopted for mass screening and follow-ups addressing Alzheimer's disease or other cognitive diseases.

HIGHLIGHTS

GAMLSS was applied to establish nonlinear percentile curves of cognitive decline. Subjects with a high level of education demonstrate a later onset and slower decline of cognition. Speed-accuracy trade-off effects were observed in a subgroup with moderate accuracy. MemTrax can be used as a mass-screen instrument for active cognition health management advice.

Development of a digital multidomain lifestyle intervention for mild cognitive impairment: A pilot study on the feasibility and efficacy of cognitive training

Background

The heterogeneous etiology of mild cognitive impairment (MCI) presents significant challenges in monitoring its progression and impeding its advancement toward dementia. Digital multidomain lifestyle interventions have shown promise as potential solutions for their ability to treat MCI.

Objective

This study is the first phase in a series of evaluations aimed at assessing various components of Silvia-Rx, which was originally designed as a digital multidomain lifestyle intervention. Specifically, this study focused on a 60-session core cognitive training program to evaluate its feasibility and efficacy in addressing cognitive decline in individuals with MCI.

Methods

Individuals aged 60 to 80 years diagnosed with MCI were enrolled to participate in a 60-session tablet-based cognitive regimen of Silvia-Rx. Feasibility was assessed through adherence and retention rates, while the Alzheimer's Disease Assessment Scale-Cognitive (ADAS-cog) scale was utilized to measure cognitive function as the primary indicator of efficacy.

Results

The mean age of the participants was 71.11 years, and 13 (68.42%) were women. Only one withdrawal occurred, resulting in a 95% retention rate (19 participants) post-intervention. The completion rate was excellent at 100%, indicating that the 60-session core cognitive program in Silvia-Rx was well tolerated by older participants with MCI. Regarding efficacy, there was a statistically significant improvement in cognitive function among MCI participants after the intervention, as evidenced by changes in total ADAS-cog scores.

Conclusions

Results demonstrated excellent adherence throughout the program and significant cognitive improvements after the intervention. This pilot study indicates that Silvia-Rx's digital cognitive program is feasible for people diagnosed with MCI, suggests potential for improving cognitive function, though further research with large sample size is needed to confirm these results.

Digital Cognitive Assessment Tests for Older Adults: Systematic Literature Review

BACKGROUND

The global health pandemic has affected the increasing older adult population, especially those with mental illnesses. It is necessary to prevent cases of cognitive impairment in adults early on, and this requires the support of information and communication technologies for evaluating and training cognitive functions. This can be achieved through computer applications designed for cognitive assessment.

OBJECTIVE

In this review, we aimed to assess the state of the art of the current platforms and digital test applications for cognitive evaluation, with a focus on older adults.

METHODS

A systematic literature search was conducted on 3 databases (Web of Science, PubMed, and Scopus) to retrieve recent articles on the applications of digital tests for cognitive assessment and analyze them based on the methodology used. Four research questions were considered. Through the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) methodology, following the application of inclusion and exclusion criteria, a total of 20 articles were finally reviewed.

RESULTS

Some gaps and trends were identified regarding the types of digital applications and technologies used, the evaluated effects on cognitive domains, and the psychometric parameters and personal characteristics considered for validation.

CONCLUSIONS

Computerized tests (similar to paper-and-pencil tests) and test batteries (on computers, tablets, or web platforms) were the predominant types of assessments. Initial studies with simulators, virtual environments, and daily-life activity games were also conducted. Diverse validation methods and psychometric properties were observed; however, there was a lack of evaluations that involved specific populations with diverse education levels, cultures, and degrees of technology acceptance. In addition, these evaluations should consider emotional and usability aspects.

Mapping the trajectory of acute mild-stroke cognitive recovery using serial computerised cognitive assessment

INTRODUCTION

Cognitive impairment is common post-stroke. There is a need to understand patterns of early cognitive recovery post-stroke to guide both clinical and research practice. The aim of the study was to map the trajectory of cognitive recovery during the first week to 90-days post-stroke using serial computerised assessment.

METHOD

An observational cohort study recruited consecutive stroke patients admitted to a stroke unit within 48 hours of onset. Cognitive function was assessed using the computerised Cambridge Neuropsychological Test Automated Battery (CANTAB) daily for seven days, then 14, 30 and 90 days post-stroke. The CANTAB measured visual episodic memory and learning, information processing speed, visuo-spatial working memory, complex sustained attention and mental flexibility. Repeated measures MANOVA/ANOVA with Least Squares Difference post-hoc analyses were performed to ascertain significant change over time.

RESULT

Forty-eight participants, mean age 73, primarily mild, ischaemic stroke, completed all assessment timepoints. There was a trajectory of early, global cognitive improvement, indicative of a post-stroke delirium, that largely stabilised between 6 and 14-days post-stroke. Change over time was examined within each cognitive test, with one measure stabilising by day 6 (Reaction Time) and others detecting improving performances up to 14 days post-stroke.

CONCLUSIONS

Serial, computerised cognitive assessment can effectively map post-stroke cognitive recovery and revealed an early phase of global improvement over 14 days that is evidence for an acute post-stroke delirium. Resolution of post-stroke delirium in the second week following mild stroke indicates more extensive neuropsychological testing may be undertaken earlier than previously thought.

Computerized Cognitive Test Batteries for Children and Adolescents-A Scoping Review of Tools For Lab- and Web-Based Settings From 2000 to 2021

OBJECTIVE

Cognitive functioning is essential to well-being. Since cognitive difficulties are common in many disorders, their early identification is critical, notably during childhood and adolescence. This scoping review aims to provide a comprehensive literature overview of computerized cognitive test batteries (CCTB) that have been developed and used in children and adolescents over the past 22 years and to evaluate their psychometric properties.

METHOD

Among 3192 records identified from three databases (PubMed, PsycNET, and Web of Science) between 2000 and 2021, 564 peer-reviewed articles conducted in children and adolescents aged 3 to 18 years met inclusion criteria. Twenty main CCTBs were identified and further reviewed following PRISMA guidelines. Relevant study details (sample information, topic, location, setting, norms, and psychometrics) were extracted, as well as administration and instrument characteristics for the main CCTBs.

RESULTS

Findings suggest that CCTB use varies according to age, location, and topic, with eight tools accounting for 85% of studies, and the Cambridge Neuropsychological Test Automated Battery (CANTAB) being most frequently used. Few instruments were applied in web-based settings or include social cognition tasks. Only 13% of studies reported psychometric properties.

CONCLUSIONS

Over the past two decades, a high number of computerized cognitive batteries have been developed. Among these, more validation studies are needed, particularly across diverse cultural contexts. This review offers a comprehensive synthesis of CCTBs to aid both researchers and clinicians to conduct cognitive assessments in children in either a lab- or web-based setting.

Wireless Lighting System: A New Tool for Assessing Cognitive Functions in the Elderly

Studies on the effects of aging on cognition have been using the same cognitive tests for decades. A Wireless Lighting System (WLS) could be used to assess cognitive functions in a physically active situation, making the assessment of cognition less isolated and more ecological. This pilot study aimed to evaluate the potential of a WLS for assessing older adults' cognitive functions. It was set up with 15 young (M = 23.47 years old) and 18 older adults (M = 71.44 years old). Their performances were recorded on three WLS tests, designed with the Witty SEM system to assess four main cognitive functions (i.e., inhibition, flexibility, visuospatial short-term and working memory), as well as on three traditional (TRAD) tests (Spatial Span Test, Stroop Test, Trail Making Test). The results show a significant difference between the YOUNG and OLD groups on all WLS test measures (except for WLS flexibility), as well as on all TRAD measures. Additionally, for the OLD group, there were significant correlations between WLS and TRAD test results (r = -0.49 for two measures of inhibition to r = -0.80 for two other measures of inhibition), except for visuospatial short-term memory. However, there was no significant correlation for the YOUNG group (ρ = -0.27 for inhibition to r = 0.45 for visuospatial short-term memory). These WLS tests were valid for assessing the cognitive functions (i.e., flexibility, visuospatial short-term and working memory, inhibition) of older adults and were sensitive to aging.

Feasibility of Remote Unsupervised Cognitive Screening With SATURN in Older Adults

Widespread cognitive test screening as part of tele-public health initiatives necessitates a test that is self-administered online and automatically scored, with no clinician effort. The feasibility of unsupervised cognitive screening is unclear. We adapted the Self-Administered Tasks Uncovering Risk of Neurodegeneration (SATURN) to make it suitable for self-administration and automatic scoring. A sample of 364 healthy older adults completed SATURN via a web browser, in a fully independent manner. SATURN's overall score was not modulated by gender, education, reading speed, the time of day at which the test was taken, or an individual's familiarity with technology. SATURN proved extremely portable across operating systems. Importantly, comments from participants reported satisfaction with the experience and the clarity of the instructions. SATURN represents a fast and easy screening tool that can be used for a first assessment, during a routine test or clinical evaluation, or during periodic health monitoring, in person or remotely.

Ecologically valid virtual reality-based technologies for assessment and rehabilitation of acquired brain injury: a systematic review

Purpose

A systematic review was conducted to examine the state of the literature regarding using ecologically valid virtual environments and related technologies to assess and rehabilitate people with Acquired Brain Injury (ABI).

Materials and methods

A literature search was performed following the PRISMA guidelines using PubMed, Web of Science, ACM and IEEE databases. The focus was on assessment and intervention studies using ecologically valid virtual environments (VE). All studies were included if they involved individuals with ABI and simulated environments of the real world or Activities of Daily Living (ADL).

Results

Seventy out of 363 studies were included in this review and grouped and analyzed according to the nature of its simulation, prefacing a total of 12 kitchens, 11 supermarkets, 10 shopping malls, 16 streets, 11 cities, and 10 other everyday life scenarios. These VE were mostly presented on computer screens, HMD's and laptops and patients interacted with them primarily via mouse, keyboard, and joystick. Twenty-five out of 70 studies had a non-experimental design.

Conclusion

Evidence about the clinical impact of ecologically valid VE is still modest, and further research with more extensive samples is needed. It is important to standardize neuropsychological and motor outcome measures to strengthen conclusions between studies.

Systematic review registration

identifier CRD42022301560, https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=301560.

Research on digital tool in cognitive assessment: a bibliometric analysis

Objective

The number of research into new cognitive assessment tools has increased rapidly in recent years, sparking great interest among professionals. However, there is still little literature revealing the current status and future trends of digital technology use in cognitive assessment. The aim of this study was to summarize the development of digital cognitive assessment tools through the bibliometric method.

Methods

We carried out a comprehensive search in the Web of Science Core Collection to identify relevant papers published in English between January 1, 2003, and April 3, 2023. We used the subjects such as "digital," "computer," and "cognitive," and finally 13,244 related publications were collected. Then we conducted the bibliometric analysis by Bibliometrix" R-package, VOSviewer and CiteSpace software, revealing the prominent countries, authors, institutions, and journals.

Results

11,045 articles and 2,199 reviews were included in our analyzes. The number of annual publications in this field was rising rapidly. The results showed that the most productive countries, authors and institutions were primarily located in economically developed regions, especially the North American, European, and Australian countries. Research cooperation tended to occur in these areas as well. The application of digital technology in cognitive assessment appealed to growing attention during the outbreak of the COVID-19 epidemic.

Conclusion

Digital technology uses have had a great impact on cognitive assessment and health care. There have been substantial papers published in these areas in recent years. The findings of the study indicate the great potential of digital technology in cognitive assessment.

Utility of Diffusion Modeling of Cogstate Brief Battery Test Performance in Detecting Mild Cognitive Impairment

Cognitive testing data are essential to the diagnosis of mild cognitive impairment (MCI), and computerized cognitive testing, such as the Cogstate Brief Battery, has proven helpful in efficiently identifying harbingers of dementia. This study provides a side-by-side comparison of traditional Cogstate outcomes and diffusion modeling of these outcomes in predicting MCI diagnosis. Participants included 257 older adults (160 = normal cognition; 97 = MCI). Results showed that both traditional Cogstate and diffusion modeling analyses predicted MCI diagnosis with acceptable accuracy. Cogstate measures of recognition learning and working memory accuracy and diffusion modeling variable of decision-making efficiency (drift rate) and nondecisional time were most predictive of MCI. While participants with normal cognition demonstrated a change in response caution (boundary separation) when transitioning tasks, participants with MCI did not evidence this change.

Virtual reality technology in the detection of mild cognitive impairment: A systematic review and meta-analysis

BACKGROUND

In recent years, virtual reality technology has developed the potential to help in the early detection of mild cognitive impairment (MCI). However, integrative evidence of its detection performance for mild cognitive impairment is lacking, and meta-analysis or systematic reviews are required to further determine the effectiveness of virtual reality technology in screening for MCI.

METHODS

Literature searches were performed for MCI screening tests in the Cochrane Library, Web of Science, PsycINFO, PubMed, EMBASE, CINAHL, and Scopus. The primary outcome was the performance of VR tests for MCI detection. A protocol for this systematic review was registered in PROSPERO (Registration number: CRD42022302139).

RESULTS

A total of 14 studies in 13 reports were eventually included. The combined data with the bivariate random-effects model gave a summary point of 0.89 sensitivity (95 % confidence interval [CI]: 0.82-0.94) and 0.91 specificity (95 % CI: 0.82-0.96). The SROC curve was plotted, the DOR was 79.25 (95 % CI: 22.59-277.99), and the AUC was 0.95 (95 % CI: 0.93-0.97).

CONCLUSIONS

Virtual reality-based tests have shown considerable detection performance in detecting MCI, and therefore, virtual reality-based tests can serve as recommended screening methods. Future studies can consider longitudinal assessment and follow-up programs to identify progressive changes.

A Tablet-Based Aphasia Assessment System "STELA": Feasibility and Validation Study

BACKGROUND

There is an extensive library of language tests, each with excellent psychometric properties; however, many of the tests available take considerable administration time, possibly bearing psychological strain on patients. The Short and Tailored Evaluation of Language Ability (STELA) is a simplified, tablet-based language ability assessment system developed to address this issue, with a reduced number of items and automated testing process.

OBJECTIVE

The aim of this paper is to assess the administration time, internal consistency, and validity of the STELA.

METHODS

The STELA consists of a tablet app, a microphone, and an input keypad for clinician's use. The system is designed to assess language ability with 52 questions grouped into 2 comprehension modalities (auditory comprehension and reading comprehension) and 3 expression modalities (naming and sentence formation, repetition, and reading aloud). Performance in each modality was scored as the correct answer rate (0-100), and overall performance expressed as the sum of modality scores (out of 500 points).

RESULTS

The time taken to complete the STELA was significantly less than the time for the WAB (mean 16.2, SD 9.4 vs mean 149.3, SD 64.1 minutes; P<.001). The STELA's total score was strongly correlated with the WAB Aphasia Quotient (r=0.93, P<.001), supporting the former's concurrent validity concerning the WAB, which is a gold-standard aphasia assessment. Strong correlations were also observed at the subscale level; STELA auditory comprehension versus WAB auditory comprehension (r=0.75, P<.001), STELA repetition versus WAB repetition (r=0.96, P<.001), STELA naming and sentence formation versus WAB naming and word finding (r=0.81, P<.001), and the sum of STELA reading comprehension or reading aloud versus WAB reading (r=0.82, P<.001). Cronbach α obtained for each modality was .862 for auditory comprehension, .872 for reading comprehension, .902 for naming and sentence formation, .787 for repetition, and .892 for reading aloud. Global Cronbach α was .961. The average of the values of item-total correlation to each subscale was 0.61 (SD 0.17).

CONCLUSIONS

Our study confirmed significant time reduction in the assessment of language ability and provided evidence for good internal consistency and validity of the STELA tablet-based aphasia assessment system.

Delirium-related psychiatric and neurocognitive impairment and the association with post-intensive care syndrome-A narrative review

INTRODUCTION

Delirium is common among patients admitted to the intensive care unit (ICU) and its impact on the neurocognitive and psychiatric state of survivors is of great interest. These new-onset or worsening conditions, together with physical alterations, are called post-intensive care syndrome (PICS). Our aim is to update on the latest screening and follow-up options for psychological and cognitive sequelae of PICS.

METHOD

This narrative review discusses the occurrence of delirium in ICU settings and the relatively new concept of PICS. Psychiatric and neurocognitive morbidities that may occur in survivors of critical illness following delirium are addressed. Future perspectives for practice and research are discussed.

RESULTS

There is no "gold standard" for diagnosing delirium in the ICU, but two extensively validated tools, the confusion assessment method for the ICU and the intensive care delirium screening checklist, are often used. PICS complaints are frequent in ICU survivors who have suffered delirium and have been recognized as an important public health and socio-economic problem worldwide. Depression, anxiety, post-traumatic stress disorder, and long-term cognitive impairment are recurrently exhibited. Screening tools for these deficits are discussed, as well as the suggestion of early assessment after discharge and at 3 and 12 months.

CONCLUSIONS

Delirium is a complex but common phenomenon in the ICU and a risk factor for PICS. Its diagnosis is challenging with potential long-term adverse outcomes, including psychiatric and cognitive difficulties. The implementation of screening and follow-up protocols for PICS sequelae is warranted to ensure early detection and appropriate management.

Newly self-administered two-step tool for screening cognitive function in an ageing Chinese population: an exploratory cross-sectional study

Background

Early screening of cognitive function is critical to dementia treatment and care. However, traditional tests require face-to-face administration and are often limited by implementation costs and biases.

Aims

This study aimed to assess whether the Thoven Cognitive Self-Assessment (TCSA), a novel, innovative two-step touchscreen-based cognition assessment tool, could identify early cognitive impairment due to dementia in older adults.

Methods

The TCSA was administered to 61 healthy controls (HCs), 46 participants with mild cognitive impairment (MCI) and 44 participants diagnosed with dementia recruited from Shanghai. Two outcome measures were generated from the TCSA test: the TCSA_{primary task} score and the TCSA_{secondary task} score.

Results

The total average scores in the control group for the TCSA_{primary task} and TCSA_{secondary task} were significantly higher than those in the MCI and dementia groups (TCSA_{primary task}: HCs vs MCI group vs dementia group, 8.58±1.76 vs 5.40±2.67 vs 2.74±2.11, F=75.40, p<0.001; TCSA_{secondary task}: HCs vs MCI group vs dementia group, 23.02±3.31 vs 17.95±4.93 vs 11.93±5.50, F=76.46, p<0.001). Moreover, receiver operating characteristic analysis showed that a score below 7.5 for the TCSA_{primary task} and a score below 22.5 for the TCSA_{secondary task} were indicators of MCI.

Conclusions

The TCSA appears to be efficacious for the detection of cognitive impairment in older adults. It demonstrates the potential for large-scale cognition screening in community service settings.

The necessary, albeit belated, transition to computerized cognitive assessment

Cognitive assessment is a common and daily process in educational, clinical, or research settings, among others. Currently, most professionals use classic pencil-and-paper screenings, tests, and assessment batteries. However, as the SARS-CoV-2 health crisis has shown, the pencil-and-paper format is becoming increasingly outdated and it is necessary to transition to new technologies, using computerized cognitive assessments (CCA). This article discusses the advantages, disadvantages, and implications of this necessary transition that professionals should face in the immediate future, and encourages careful adoption of this change to ensure a smooth transition.

Validity and diagnostic performance of a virtual reality-based supermarket application "MEMOSHOP" for assessing episodic memory in normal and pathological aging

Objective

MEMOSHOP is a virtual reality (VR)-based supermarket application for assessing episodic memory in aging. The aim of this study was to examine its construct validity against the gold standard paper-and-pencil neuropsychological test for clinical memory assessment in mild cognitive impairment (MCI) in older adults.

Methods

Patients with isolated subjective cognitive complaints (SCCs) or MCI were recruited in the Bordeaux Memory Clinic (MEMENTO cohort). Cognitively normal elderly controls were also recruited. MEMOSHOP allows a near-ecological evaluation of episodic memory during a usual daily life activity, i.e. shopping at the supermarket. MEMOSHOP and the gold standard Free and Cued Selective Reminding Test (FCSRT: French adaptation) were administered to all participants to assess episodic memory. Non-parametric tests and receiver operating characteristic curves were computed to compare their performances.

Results

Twenty-nine patients (21 females, age = 71 years ±7) and 29 matched controls were evaluated. The performance trends observed with MEMOSHOP and FCSRT on free and cued recall were associated (p < .01) and comparable (p < .0001), without any participants' groups interaction. Although easier than FCSRT in free recall for participants, MEMOSHOP demonstrated better diagnostic performance based on cued recall in isolated SCCs/MCI patients (p < .05).

Conclusion

MEMOSHOP demonstrated its reliability and validity for VR-based episodic memory assessment in the early stage of MCI and is potentially of interest for use in memory clinic settings.

Validation of a rapid remote digital test for impaired cognition using clinical dementia rating and mini-mental state examination: An observational research study

Background

The Clinical Dementia Rating (CDR) and Mini-Mental State Examination (MMSE) are useful screening tools for mild cognitive impairment (MCI). However, these tests require qualified in-person supervision and the CDR can take up to 60 min to complete. We developed a digital cognitive screening test (M-CogScore) that can be completed remotely in under 5 min without supervision. We set out to validate M-CogScore in head-to-head comparisons with CDR and MMSE.

Methods

To ascertain the validity of the M-CogScore, we enrolled participants as healthy controls or impaired cognition, matched for age, sex, and education. Participants completed the 30-item paper MMSE Second Edition Standard Version (MMSE-2), paper CDR, and smartphone-based M-CogScore. The digital M-CogScore test is based on time-normalised scores from smartphone-adapted Stroop (M-Stroop), digit-symbols (M-Symbols), and delayed recall tests (M-Memory). We used Spearman's correlation coefficient to determine the convergent validity between M-CogScore and the 30-item MMSE-2, and non-parametric tests to determine its discriminative validity with a CDR label of normal (CDR 0) or impaired cognition (CDR 0.5 or 1). M-CogScore was further compared to MMSE-2 using area under the receiver operating characteristic curves (AUC) with corresponding optimal cut-offs.

Results

72 participants completed all three tests. The M-CogScore correlated with both MMSE-2 (rho = 0.54, p < 0.0001) and impaired cognition on CDR (Mann Whitney U = 187, p < 0.001). M-CogScore achieved an AUC of 0.85 (95% bootstrapped CI [0.80, 0.91]), when differentiating between normal and impaired cognition, compared to an AUC of 0.78 [0.72, 0.84] for MMSE-2 (p = 0.21).

Conclusion

Digital screening tests such as M-CogScore are desirable to aid in rapid and remote clinical cognitive evaluations. M-CogScore was significantly correlated with established cognitive tests, including CDR and MMSE-2. M-CogScore can be taken remotely without supervision, is automatically scored, has less of a ceiling effect than the MMSE-2, and takes significantly less time to complete.

A massive dataset of the NeuroCognitive Performance Test, a web-based cognitive assessment

We present a dataset of approximately 5.5 million subtest scores from over 750,000 adults who completed the NeuroCognitive Performance Test (NCPT; Lumos Labs, Inc.), a validated, self-administered cognitive test accessed via web browser. The dataset includes assessment scores from eight test batteries consisting of 5-11 subtests that collectively span several cognitive domains including working memory, visual attention, and abstract reasoning. In addition to the raw scores and normative data from each subtest, the dataset includes basic demographic information from each participant (age, gender, and educational background). The scale and diversity of the dataset provides an unprecedented opportunity for researchers to investigate population-level variability in cognitive abilities and their relation to demographic factors. To facilitate reuse of this dataset by other researchers, we provide a Python module that supports several common preprocessing steps.

Validation of a novel computerized cognitive function test for the rapid detection of mild cognitive impairment

BACKGROUND

In the present study, we examined the distinguishing ability of a mild cognitive impairment (MCI) assessment tool for rapid screening using a computer (MARC) for Alzheimer's disease dementia (ADD), MCI, and non-demented controls (NDC) with no cognitive impairment, as well as its validity and reliability, as part of a preliminary trial for the development of the tool.

METHODS

A total of 64 participants (23 in the ADD group, 17 in the MCI group, and 24 in the NDC group) were analyzed. The participants were administered MARC and a pre-existing computerized Alzheimer's dementia screening test (MSP), and 31 participants (14 in the MCI group, 17 in the NDC group) were readministered MARC within 4 months from the first test.

RESULTS

The median (interquartile range) test time for MARC was 401 (350-453) s. Total MARC scores were significantly worse in the MCI and ADD groups than in the NDC group (p < 0.05 and p < 0.01, respectively). In the receiver operating characteristic (ROC) analysis, the area under the ROC curve (AUC) when comparing the NDC and MCI groups was 0.866 (95% CI, 0.759-0.974), when comparing the NDC and AD groups was 0.989 (95% CI, 0.970-1.000), and when comparing the MCI and AD groups was 0.889 (95% CI, 0.790-0.988). Furthermore, there was a significant correlation with the results of the existing test, MSP (r = 0.839, p < 0.001). In addition, the intraclass correlation coefficient (ICC) (1,1) when the first and second MARC scores were compared was 0.740 (95% CI, 0.529-0.865; p < 0.001).

CONCLUSIONS

MARC is considered capable of distinguishing MCI with high accuracy. The tool has good validity and reliability, and it can be administered in a short period of time without the need for a specialist.

Touchscreen Cognitive Tools for Mild Cognitive Impairment and Dementia Used in Primary Care Across Diverse Cultural and Literacy Populations: A Systematic Review

BACKGROUND

Touchscreen cognitive tools opened new promising opportunities for the early detection of cognitive impairment; however, most research studies are conducted in English-speaking populations and high-income countries, with a gap in knowledge about their use in populations with cultural, linguistic, and educational diversity.

OBJECTIVE

To review the touchscreen tools used in primary care settings for the cognitive assessment of mild cognitive impairment (MCI) and dementia, with a focus on populations of different cultures, languages, and literacy.

METHODS

This systematic review was conducted following the PRISMA guidelines. Studies were identified by searching across MEDLINE, EMBASE, EBSCO, OVID, SCOPUS, SCIELO, LILACS, and by cross-referencing. All studies that provide a first-level cognitive assessment for MCI and dementia with any touchscreen tools suitable to be used in the context of primary care were included.

RESULTS

Forty-two studies reporting on 30 tools and batteries were identified. Substantial differences among the tools emerged, in terms of theoretical framework, clinical validity, and features related to the application in clinical practice. A small proportion of the tools are available in multiple languages. Only 7 out of the 30 tools have a multiple languages validation. Only two tools are validated in low-educated samples, e.g., IDEA and mSTS-MCI.

CONCLUSION

General practitioners can benefit from touchscreen cognitive tools. However, easy requirements of the device, low dependence on the examiner, fast administration, and adaptation to different cultures and languages are some of the main features that we need to take into consideration when implementing touchscreen cognitive tools in the culture and language of underrepresented populations.

Correctness and response time distributions in the MemTrax continuous recognition task: Analysis of strategies and a reverse-exponential model

A critical issue in addressing medical conditions is measurement. Memory measurement is difficult, especially episodic memory, which is disrupted by many conditions. On-line computer testing can precisely measure and assess several memory functions. This study analyzed memory performances from a large group of anonymous, on-line participants using a continuous recognition task (CRT) implemented at https://memtrax.com. These analyses estimated ranges of acceptable performance and average response time (RT). For 344,165 presumed unique individuals completing the CRT a total of 602,272 times, data were stored on a server, including each correct response (HIT), Correct Rejection, and RT to the thousandth of a second. Responses were analyzed, distributions and relationships of these parameters were ascertained, and mean RTs were determined for each participant across the population. From 322,996 valid first tests, analysis of correctness showed that 63% of these tests achieved at least 45 correct (90%), 92% scored at or above 40 correct (80%), and 3% scored 35 correct (70%) or less. The distribution of RTs was skewed with 1% faster than 0.62 s, a median at 0.890 s, and 1% slower than 1.57 s. The RT distribution was best explained by a novel model, the reverse-exponential (RevEx) function. Increased RT speed was most closely associated with increased HIT accuracy. The MemTrax on-line memory test readily provides valid and reliable metrics for assessing individual episodic memory function that could have practical clinical utility for precise assessment of memory dysfunction in many conditions, including improvement or deterioration over time.

"Guttmann Cognitest"®, preliminary validation of a digital solution to test cognitive performance

Thanks to technological advances, the administration of cognitive assessments via digital solutions continues to increase, both in research and clinical practice. "Guttmann Cognitest"°ledR is a digital solution for cognitive assessment which includes seven computerized tasks designed to assess main cognitive functions requiring approximately 20 min to be completed. The purpose of the present study was to validate it against standard and more extensive in-person neuropsychological assessments in the context of the Barcelona Brain Health Initiative (BBHI) cohort study. We studied 274 participants of the BBHI (126 women, mean age = 56.14, age range 44-69), who underwent an extensive in-person assessment, including a classical paper-and-pencil neuropsychological assessment and a cognitive assessment via the "Guttmann Cognitest"°ledR. Principal component analysis indicated that "Guttmann Cognitest"°ledR measures four main cognitive domains and convergent validity analysis demonstrated that cognitive performance was associated with gold standard paper and pencil tests. Results also showed an expected negative correlation with age, a relation with educational level as well as a gender effect. Regression-based norming equations for the sample tested are also reported. Performing a cognitive assessment with this digital solution is feasible and potentially useful to gather information about cognitive functioning in large samples and experimental settings.

Philips IntelliSpace Cognition digital test battery: Equivalence and measurement invariance compared to traditional analog test versions

Objective: To collect evidence of validity for a selection of digital tests on the Philips IntelliSpace Cognition (ISC) platform.Method: A total of 200 healthy participants (age 50-80) completed both the ISC battery and an analog version of the battery during separate visits. The battery included the following screeners and cognitive tests: Mini-Mental State Examination (2^nd edition), Clock Drawing Test, Trail-Making Test (TMT), Rey Auditory Verbal Learning Test (RAVLT), Rey-Osterrieth Complex Figure Test (ROCFT), Letter Fluency, Star Cancellation Test, and Digit Span Test. The ISC tests were administered on an iPad Pro and were automatically scored using designated algorithms. The analog tests were administered in line with existing guidelines and scored by trained neuropsychologists. Criterion validity was established through relative agreement coefficients and raw score equivalence tests. In addition,measurement invariance analysis was used to compare the factor structures of both versions. Finally, we explored effects of demographics and experience with digital devices on performance.Results: We found fair to excellent relative agreement between test versions. Absolute equivalence was found for RAVLT, Letter Fluency, Star Cancellation Test, and Digit Span Test. Importantly, we demonstrated equal loadings of the digital and analog test versions on the same set of underlying cognitive domains. Demographic effects were mostly comparable between modalities, and people's experience with digital devices was found to only influence performance on TMT B.Conclusions: This study provides several sources of evidence for the validity of the ISC test battery, offering an important step in validating ISC for clinical use.Supplemental data for this article is available online at https://doi.org/10.1080/13854046.2021.1974565.

Alpha3/alpha2 power ratios relate to performance on a virtual reality shopping task in ageing adults

Background

Aspects of cognitive function decline with age. This phenomenon is referred to as age-related cognitive decline (ARCD). Improving the understanding of these changes that occur as part of the ageing process can serve to enhance the detection of the more incapacitating neurodegenerative disorders such as Alzheimer’s disease (AD). In this study, we employ novel methods to assess ARCD by exploring the utility of the alpha3/alpha2 electroencephalogram (EEG) power ratio – a marker of AD, and a novel virtual reality (VR) functional cognition task – VStore, in discriminating between young and ageing healthy adults.

Materials and methods

Twenty young individuals aged 20–30, and 20 older adults aged 60–70 took part in the study. Participants underwent resting-state EEG and completed VStore and the Cogstate Computerised Cognitive Battery. The difference in alpha3/alpha2 power ratios between the age groups was tested using t-test. In addition, the discriminatory accuracy of VStore and Cogstate were compared using logistic regression and overlying receiver operating characteristic (ROC) curves. Youden’s J statistic was used to establish the optimal threshold for sensitivity and specificity and model performance was evaluated with the DeLong’s test. Finally, alpha3/alpha2 power ratios were correlated with VStote and Cogstate performance.

Results

The difference in alpha3/alpha2 power ratios between age cohorts was not statistically significant. On the other hand, VStore discriminated between age groups with high sensitivity (94%) and specificity (95%) The Cogstate Pre-clinical Alzheimer’s Battery achieved a sensitivity of 89% and specificity of 60%, and Cogstate Composite Score achieved a sensitivity of 83% and specificity of 85%. The differences between the discriminatory accuracy of VStore and Cogstate models were statistically significant. Finally, high alpha3/alpha2 power ratios correlated strongly with VStore (r = 0.73), the Cogstate Pre-clinical Alzheimer’s Battery (r = -0.67), and Cogstate Composite Score (r = -0.76).

Conclusion

While we did not find evidence that the alpha3/alpha2 power ratio is elevated in healthy ageing individuals compared to young individuals, we demonstrated that VStore can classify age cohorts with high accuracy, supporting its utility in the assessment of ARCD. In addition, we found preliminary evidence that elevated alpha3/alpha2 power ratio may be linked to lower cognitive performance.

Integrating Technology in Neuropsychological Assessment

Abstract. Although neuropsychological assessments include some measures that are administered, scored, or interpreted using new technologies, most researchers in this area advocate that more technology should be integrated. The current situation in neuropsychological assessment may be conceptualized as triggering a crisis leading to a paradigm shift, as there is some resistance to adopting more technology. In this paper, the context of the present crisis in neuropsychological assessment, the main obstacles, and new developments will be discussed. An example of a new computerized assessment tool, the NIH Toolbox, is highlighted. Also addressed are potential issues: in the assessment with tablets illustrating it with the older adult population and how to ensure the compatibility of data collected through these devices within the framework of the European General Data Protection Regulation (GDPR). Recommendations for research, test development, and clinical practice are also provided.

Validation of the Computerized Cognitive Assessment Test: NNCT

Population aging brings with it cognitive impairment. One of the challenges of the coming years is the early and accessible detection of cognitive impairment. Therefore, this study aims to validate a neuropsychological screening test, self-administered and in software format, called NAIHA Neuro Cognitive Test (NNCT), designed for elderly people with and without cognitive impairment. This test aims to digitize cognitive assessments to add greater accessibility than classic tests, as well as to present results in real time and reduce costs. To this end, a comparison is made with tests such as MMSE, Clock Drawing Test (CDT) and CAMCOG. For this purpose, the following statistical analyses were performed: correlations, ROC curves, and three ANOVAs. The NNCT test evaluates seven cognitive areas and shows a significant and positive correlation with other tests, at total and subareas levels. Scores are established for the detection of both mild cognitive impairment and dementia, presenting optimal sensitivity and specificity. It is concluded that the NNCT test is a valid method of detection of cognitive impairment.