Comparison between a Paper-Pencil Version and Computerized Version for the Realization of a Neuropsychological Test: The Example of the Trail Making Test

Virtual Reality and Serious Videogame-Based Instruments for Assessing Spatial Navigation in Alzheimer's Disease: A Systematic Review of Psychometric Properties

Over the past decade, research using virtual reality and serious game-based instruments for assessing spatial navigation and spatial memory in at-risk and AD populations has risen. We systematically reviewed the literature since 2012 to identify and evaluate the methodological quality and risk of bias in the analyses of the psychometric properties of VRSG-based instruments. The search was conducted primarily in July-December 2022 and updated in November 2023 in eight major databases. The quality of instrument development and study design were analyzed in all studies. Measurement properties were defined and analyzed according to COSMIN guidelines. A total of 1078 unique records were screened, and following selection criteria, thirty-seven studies were analyzed. From these studies, 30 instruments were identified. Construct and criterion validity were the most reported measurement properties, while structural validity and internal consistency evidence were the least reported. Nineteen studies were deemed very good in construct validity, whereas 11 studies reporting diagnostic accuracy were deemed very good in quality. Limitations regarding theoretical framework and research design requirements were found in most of the studies. VRSG-based instruments are valuable additions to the current diagnostic toolkit for AD. Further research is required to establish the psychometric performance and clinical utility of VRSG-based instruments, particularly the instrument development, content validity, and diagnostic accuracy for preclinical AD screening scenarios. This review provides a straightforward synthesis of the state of the art of VRSG-based instruments and suggests future directions for research.

Correlation analysis between subtest scores of CERAD-K and a newly developed tablet computer-based digital cognitive test (Inbrain CST)

Introduction

The prevalence of Alzheimer's disease (AD) and other dementias is increasing; therefore, identifying individuals at risk for dementia is crucial. Traditional neuropsychological assessments are expensive and time-consuming; however, computerized cognitive testing is becoming popular in clinical and research settings, particularly during the COVID-19 pandemic. This study aimed to investigate the correlation between the computerized cognitive test, Inbrain cognitive screening test (CST), and the traditional neuropsychological battery, the consortium to establish a registry for Alzheimer's disease assessment packet (CERAD-K).

Methods

We enrolled 166 participants from five districts in Republic of Korea, including cognitively unimpaired individuals and those with mild cognitive impairment (MCI) diagnosed by experienced neurologists. We used the Inbrain CST and CERAD-K to evaluate the cognitive function of the participants, and the scores of each subtest of the Inbrain CST and CERAD-K were compared.

Results

A significant correlation was found between the Inbrain CST and CERAD-K subtests. Furthermore, multivariate analysis revealed a significant correlation between the Inbrain CST and the CERAD-K test pairs after adjusting for age, educational level, and sex.

Discussion

In conclusion, this study demonstrates that the Inbrain CST is a reliable tool for detecting cognitive impairment in cognitively unimpaired individuals and patients with MCI, because it has a high correlation and agreement with CERAD-K. Therefore, the Inbrain CST can be a useful, time-efficient, and cost-effective computer-based cognitive test for individuals at risk for cognitive impairment.

The limitations and challenges in the assessment of executive dysfunction associated with real-world functioning: The opportunity of serious games

Nowadays, there is a broad range of methods for detecting and evaluating executive dysfunction ranging from clinical interview to neuropsychological evaluation. Nevertheless, a critical issue of these assessments is the lack of correspondence of the neuropsychological test's results with real-world functioning. This paper proposes serious games as a new framework to improve the neuropsychological assessment of real-world functioning. We briefly discuss the contribution and limitations of current methods of evaluation of executive dysfunction (paper-and-pencil tests, naturalistic observation methods, and Information and Communications Technologies) to inform on daily life functioning. Then, we analyze what are the limitations of these methods to predict real-world performance: (1) A lack of appropriate instruments to investigate the complexity of real-world functioning, (2) the vast majority of neuropsychological tests assess well-structured tasks, and (3) measurement of behaviors are based on simplistic data collection and statistical analysis. This work shows how serious games offer an opportunity to develop more efficient tools to detect executive dysfunction in everyday life contexts. Serious games provide meaningful narrative stories and virtual or real environments that immerse the user in natural and social environments with social interactions. In those highly interactive game environments, the player needs to adapt his/her behavioral performance to novel and ill-structured tasks which are suited for collecting user interaction evidence. Serious games offer a novel opportunity to develop better tools to improve diagnosis of the executive dysfunction in everyday life contexts. However, more research is still needed to implement serious games in everyday clinical practice.

Which motor-cognitive abilities underlie the digital Trail-Making Test? Decomposing various test scores to detect cognitive impairment in Parkinson's disease-Pilot study

Since Parkinson's disease (PD) is a heterogeneous disorder with symptoms, such as tremors, gait and speech disturbances, or memory loss, individualized diagnostics are needed to optimize treatment. In their current form, the typical paper-pencil methods traditionally used to track disease progression are too coarse to capture the subtleties of clinical phenomena. For this reason, digital biomarkers that capture, for example, motor function, cognition, and behavior using apps, wearables, and tracking systems are becoming increasingly established. However, given the high prevalence of cognitive impairment in PD, digital cognitive biomarkers to predict mental progression are important in clinical practice. This pilot study aimed to identify those components of our digital version of the TMT (dTMT) that allow discrimination between PD patients with and without cognitive deficits. A total of 30 healthy control (age 66.3 ± 8.61) and 30 participants with PD (age 68.3 ± 9.66) performed the dTMT using a touch-sensitive tablet to capture enhanced performance metrics, such as the speed between and inside circles. The decomposition of cognitive abilities based on integrating additional variables in the dTMT revealed that the Parkinson's disease group was significantly more sensitive to parameters of inhibitory control. In contrast, the mild cognitive impairment group was sensitive to parameters of cognitive flexibility and working memory. The dTMT allows objective, ecologically valid, and long-term cognitive and fine-motor performance tracking, suggesting its potential as a digital biomarker in neurodegenerative disorders.

Different Dynamic Nodal Properties Contribute to Cognitive Impairment in Patients with White Matter Hyperintensities

White matter hyperintensities (WMHs) are commonly observed in older adults and are associated with cognitive impairment. Although previous studies have found abnormal functional connectivities in patients with WMHs based on static functional magnetic resonance imaging (fMRI), the topological properties in the context of brain dynamics remain relatively unexplored. Herein, we explored disrupted dynamic topological properties of functional network connectivity in patients with WMHs and its relationship with cognitive impairment. We included 36 healthy controls (HC) and 104 patients with mild WMHs (n = 39), moderate WMHs (n = 37), and severe (n = 28) WMHs. The fMRI data of all participants were analyzed using Anatomical Automatic Labeling (AAL) and a sliding-window approach to generate dynamic functional connectivity matrics. Then, graph theory methods were applied to calculate the topological properties. Comprehensive neuropsychological scales were used to assess cognitive functions. Relationships between cognitive functions and abnormal dynamic topological properties were evaluated by Pearson’s correlation. We found that the patients with WMHs had higher temporal variability in regional properties, including betweenness centrality, nodal efficiencies, and nodal clustering coefficient. Furthermore, we found that the degree of centrality was related to executive function and memory, and the local coefficient correlated to executive function. Our results indicate that patients with WMHs have higher temporal variabilities in regional properties and are associated with executive and memory function.

Validation of At-Home Application of a Digital Cognitive Screener for Older Adults

Standardized neuropsychological assessments of older adults are important for both clinical diagnosis and biobehavioral research. Over decades, in-person testing has been the basis for population normative values that rank cognitive performance by demographic status. Most recently, digital tools have enabled remote data collection for cognitive measures, which offers the significant promise to extend the basis for normative values to be more inclusive of a larger cross section of the older population. We developed a Remote Characterization Module (RCM), using a speech-to-text interface, as a novel digital tool to administer an at-home, 25-min cognitive screener that mimics eight standardized neuropsychological measures. Forty cognitively healthy participants were recruited from a longitudinal aging research cohort, and they performed the same measures of memory, attention, verbal fluency and set-shifting in both in-clinic paper-and-pencil (PAP) and at-home RCM versions. The results showed small differences, if any, for how participants performed on in-person and remote versions in five of eight tasks. Critically, robust correlations between their PAP and RCM scores across participants support the finding that remote, digital testing can provide a reliable assessment tool for rapid and remote screening of healthy older adults’ cognitive performance in several key domains. The implications for digital cognitive screeners are discussed.

Initial Adaptation of the General Cognitive Assessment Battery by Cognifit™ for Bulgarian Older Adults

BACKGROUND

Online neuropsychological assessment batteries may facilitate the screening of cognitive functions in older adults and could be useful for early diagnosis and detection of cognitive impairments.

OBJECTIVE

The primary aim of this study was to assess the psychometric qualities of an online multi-domain cognitive assessment battery (General Cognitive Assessment Battery (GCAB) by Cognifit™) applied for the first time in Bulgaria.

METHODS

A total of 20 healthy older adults (6 male and 14 female, aged 60-82) completed the GCAB as well as the Mini-Mental State Examination (MMSE) and the Consortium to Establish a Registry for Alzheimer's Disease (CERAD) neuropsychological battery. Descriptive statistics were used to describe the demographic characteristics of the sample and the scores on the GCAB and the CERAD battery. The internal consistency of the GCAB was evaluated using item analysis and measured with Cronbach's alpha. The concurrent validity of the GCAB was assessed with respect to the CERAD using Spearman's r after verifying the linear relationship between the GCAB and CERAD scores.

RESULTS

The GCAB showed good concurrent validity when compared with the corresponding CERAD tests. The correlation coefficients ranged from 0.67 for working memory to 0.47 for short-term auditory memory. We found very good reliability of the GCAB, with the inter-class correlation coefficient higher than 0.8 for all cognitive domains. There were no significant correlations between MMSE and GCAB scores.

CONCLUSION

The GCAB was found to be valid for the cognitive screening of Bulgarian healthy older adults and may provide an adequate assessment of their cognitive status. The GCAB showed good concurrent validity when compared with the CERAD battery, measuring similar cognitive constructs. Further work is necessary to explore its validity and reliability.

Altered Functional Connectivity Patterns of Parietal Subregions Contribute to Cognitive Dysfunction in Patients with White Matter Hyperintensities

BACKGROUND

The white matter hyperintensities (WMHs) are considered as one of the core neuroimaging findings of cerebral small vessel disease and independently associated with cognitive deficit. The parietal lobe is a heterogeneous area containing many subregions and play an important role in the processes of neurocognition.

OBJECTIVE

To explore the relationship between parietal subregions alterations and cognitive impairments in WHMs.

METHODS

Resting-state functional connectivity (rs-FC) analyses of parietal subregions were performed in 104 right-handed WMHs patients divided into mild (n = 39), moderate (n = 37), and severe WMHs (n = 28) groups according to the Fazekas scale and 36 healthy controls. Parietal subregions were defined using tractographic Human Brainnetome Atlas and included five subregions for superior parietal lobe, six subregions for inferior parietal lobe (IPL), and three subregions for precuneus. All participants underwent a neuropsychological test battery to evaluate emotional and general cognitive functions.

RESULTS

Differences existed between the rs-FC strength of IPL_R_6_2 with the left anterior cingulate gyrus, IPL_R_6_3 with the right dorsolateral superior frontal gyrus, and the IPL_R_6_5 with the left anterior cingulate gyrus. The connectivity strength between IPL_R_6_3 and the left anterior cingulate gyrus were correlated with AVLT-immediate and AVLT-recognition test in WMHs.

CONCLUSION

We explored the roles of parietal subregions in WMHs using rs-FC. The functional connectivity of parietal subregions with the cortex regions showed significant differences between the patients with WMHs and healthy controls which may be associated with cognitive deficits in WMHs.

Decline in executive function in patients with white matter hyperintensities from the static and dynamic perspectives of amplitude of low-frequency fluctuations

Cognitive impairments are characteristics of patients with white matter hyperintensities (WMHs), and hypoperfusion is currently a relatively recognized mechanism of WMHs. Brain activity is closely coupled to the regulation of local blood flow. This study aimed to investigate the abnormal local brain activity of patients with WMHs from the viewpoint of the static amplitude of low-frequency fluctuations (sALFF) and dynamic amplitude of low-frequency fluctuations (dALFF). Seventy-four patients with WMHs and 35 healthy controls (HCs) were included. Based on the Fazekas scale, patients with WMHs were further divided into a mild WMH group (n = 33, Fazekas score 1-2) and moderate-severe WMH group (n = 41, Fazekas score 3-6). The sALFF and dALFF values were calculated separately and neuropsychological tests including the Montreal Cognitive Assessment (MoCA), Auditory Verbal Learning Test (AVLT), Trail Making Test (TMT), and Boston Naming Test (BNT) were completed by all participants. Patients with WMHs showed increased sALFF and dALFF values in the bilateral thalamus and decreased performance in the MoCA test, AVLT-immediate, AVLT-delay, AVLT-recognition, TMT-A, and BNT. The dALFF values in the bilateral thalamus was correlated with the MoCA in HCs. The sALFF values in the bilateral thalamus correlated with TMT-B in patients with WMHs. Patients with WMHs showed abnormal brain activity and decreased functional stability of the bilateral thalamus, which may be a potential mechanism of decreased executive function.

Innovative motor and cognitive dual-task approaches combining upper and lower limbs may improve dementia early detection

Motor and Cognitive Dual-Task (MCDT) represents an innovative chance to assess Mild Cognitive Impairment (MCI). We compare two novel MCDTs, fore-finger tapping (FTAP), toe-tapping (TTHP), to gold standards for cognitive screening (Mini-Mental State Examination-MMSE), and to a well-established MCDT (GAIT). We administered the aforementioned MCDTs to 44 subjects (MCIs and controls). Motor parameters were extracted, and correlations with MMSE investigated. Logistic regression models were built, and AUC areas computed. Spearman's correlation demonstrated that FTAP and TTHP significantly correlate with MMSE, at each cognitive load. AUC areas computed report similar (FTAP, 0.87), and even higher (TTHP, 0.97) capability to identify MCIs, if compared to GAIT (0.92). We investigated the use of novel MCDT approaches to assess MCI, aiming to enrich the clinical repertoire with objective and non-invasive tools. Our protocol shows good correlations with MMSE, and reaches high performances in identifying MCI, adopting simpler exercises.

The trail-making-test: Comparison between paper-and-pencil and computerized versions in young and healthy older adults

One of the key challenges in assessing cognitive performance is to detect not only apparent impairment but to also pick up on subtle differences. Computerized tests benefit especially from the acquisition of fine-grained outcome measures. However, the equivalency of paper-based and computerized tests cannot be assumed. The Trail-Making-Test is a paper-pencil cognitive assessment tool (ppTMT) that has been used in many research studies to evaluate visuomotor abilities and mental flexibility. A digital version of the extended TMT (including a condition measuring fine motor speed) called the dTMT has been developed. This study aims to test (1) reliability, (2) equivalence, and (3) agreement of the ppTMT and dTMT. A total of 53 healthy individuals aged 19 to 82 years of age (22 men, 31 women; mean age 42.2, SD = 22.8) completed three trials per ppTMT and dTMT condition. Part M involves following a predefined path, Part A links numbers randomly distributed in space, in ascending order, and Part B alternates between linking numbers and letters. dTMT scores were highly reproducible, correlated strongly with paper-pencil administered durations, and discriminated young from older adults. Measures of reliability, sensitivity, and clinical meaning for dTMT scores were favorable compared with ppTMT-based testing. Our findings support the comparability of TMT-indices in computerized assessments. While many digital biomarker efforts are in progress (e.g., neurodegenerative disorders), the dTMT sets itself apart through its high sensitivity, the alternate forms, and the additional component measures. In this light, it could serve as a starting point for an early diagnostic tool.

A Validation Study of the Inbrain CST: a Tablet Computer-based Cognitive Screening Test for Elderly People with Cognitive Impairment

BACKGROUND

Computerized versions of cognitive screening test could have advantages over pencil-and-paper versions by eliminating rater-dependent factors and saving the time required to score the tests and report the results. We developed a computerized cognitive screening test (Inbrain Cognitive Screening Test [Inbrain CST]) that takes about 30 minutes to administer on a touchscreen computer and is composed of neuropsychological tests already shown to be sensitive in detecting early cognitive decline in Alzheimer's disease (AD). The aims of this study were to 1) introduce normative data for Inbrain CST, 2) verify its reliability and validity, 3) assess clinical usefulness, and 4) identify neuroanatomical correlates of Inbrain CST.

METHODS

The Inbrain CST runs on the Microsoft Windows 10 operating system and comprises 7 subtests that encompass 5 cognitive domains: attention, language, visuospatial, memory, and executive functions. First, we recruited 480 cognitively normal elderly people (age 50-90) from communities nationwide to establish normative data for Inbrain CST. Second, we enrolled 97 patients from our dementia clinic (26 with subjective cognitive decline [SCD], 42 with amnestic mild cognitive impairment [aMCI], and 29 with dementia due to AD) and investigated sensitivity and specificity of Inbrain CST for discriminating cognitively impaired patients from those with SCD using receiver operating characteristic (ROC) curve analyses. Third, we compared the Inbrain CST scores with those from another neuropsychological test battery to obtain concurrent validity and assessed test-retest reliability. Finally, magnetic resonance imaging (MRI)-based cortical thickness analyses were performed to provide anatomical substrates for performances on the Inbrain CST.

RESULTS

First, in the normative sample, the total score on the Inbrain CST was significantly affected by age, years of education, and gender. Second, Inbrain CST scores among the three patient groups decreased in the order of SCD, aMCI, and AD dementia, and the ROC curve analysis revealed that Inbrain CST had good discriminative power for differentiating cognitively impaired patients from those with SCD. Third, the Inbrain CST subtests had high concurrent validity and test-retest reliability. Finally, in the cortical thickness analysis, each cognitive domain score and the total score of Inbrain CST showed distinct patterns of anatomical correlates that fit into the previously known brain-behavior relationship.

CONCLUSION

Inbrain CST had good validity, reliability, and clinical usefulness in detecting cognitive impairment in the elderly. Furthermore, it showed neuroanatomical validity through MRI cortical thinning patterns. These results suggest that Inbrain CST is a useful cognitive screening tool with efficiency and validity to detect mild impairments in cognition in clinical settings.