Diagnostic accuracy of the UDS 3.0 neuropsychological battery in a cohort with Alzheimer's disease in Colombia

Cross-cultural Diagnostic Validity of the Multilingual Naming Test (MINT) in a Sample of Older Adults

OBJECTIVE

We aimed to evaluate the psychometric properties and diagnostic accuracy of the 32-item version of the Multilingual Naming Test (MINT) in participants from 2 ethnic groups (European Americans [EA; n = 106] and Hispanic Americans [HA; n = 175]) with 3 diagnostic groups (cognitively normal [CN], n = 94, mild cognitive impairment [MCI], n = 148, and dementia, n = 39).

METHOD

An Item Response Theory model was used to evaluate items across ethnicity and language groups (Spanish and English), resulting in a 24-item version. We analyzed the MINT discriminant and predictive validity across diagnostic groups.

RESULTS

A total of 8 items were differentially difficult between languages in the 32-item version of the MINT. EA scored significantly higher than HA, but the difference was not significant when removing those 8 items (controlling for Education). The Receiver Operating Characteristics showed that the MINT had poor accuracy when identifying CN participants and was acceptable in identifying dementia participants but unacceptable in classifying MCI participants. Finally, we tested the association between MINT scores and magnetic resonance imaging volumetric measures of language-related areas in the temporal and frontal lobes. The 32-item MINT in English and Spanish and the 24-item MINT in Spanish were significantly correlated with the bilateral middle temporal gyrus. The left fusiform gyrus correlated with MINT scores regardless of language and MINT version. We also found differential correlations depending on the language of administration.

CONCLUSIONS

Our results highlight the importance of analyzing cross-cultural samples when implementing clinical neuropsychological tests such as the MINT.

Evidence of validity and reliability of the Colombian version of Addenbroke's Cognitive Examination Revised (ACE-R)

OBJECTIVE

The purpose of this study is to provide evidence that supports the validity and reliability of the Colombian version of the Addenbrooke's Cognitive Examination Revised (ACE-R) in comparison to the MMSE at assessing and finding patients with Mild Cognitive Impairment (MCI). Additionally, the study aims to determine the optimal cut-off scores based on the age of a population with a low education level.

METHOD

This study included 314 individuals (235 participants diagnosed with MCI and 79 cognitively healthy) who live in two different rural departments (states) in Colombia. The participants were recruited for this study through community clubs for the older adults. Most of the individuals were female (236), the average age was 65.95 years of age (SD= 7.8), and the average education level was of 3.78 years (SD = 1.79). It is important to note that the sample only included people with a maximum of 6 years of schooling.

RESULTS

A ROC analysis indicated that the ACE-R is more effective than the MMSE at evaluating and finding MCI individuals within the three groups. The cut-off points for the Under 60 years of age group was 83.50 (sensitivity 0.880% and specificity 0.632%); 61-69 years of age 80.50 (sensitivity 0.714% and specificity 0.677%); and Over 70 years of age was 79.50 (sensitivity 0.750% and specificity 0.659%). The internal consistency analysis with MacDonald's Ω determined reliability indicators ≥70 in the ACE-R, except for the age range of 61 to 69 years.

CONCLUSION

The Colombian version of the ACE-R demonstrates to be a valid and reliable global cognitive screening tool. It is effective at discerning MCI individuals from healthy within a group of participants with a low education level.

Validation of a Remote and Fully Automated Story Recall Task to Assess for Early Cognitive Impairment in Older Adults: Longitudinal Case-Control Observational Study

Background

Story recall is a simple and sensitive cognitive test that is commonly used to measure changes in episodic memory function in early Alzheimer disease (AD). Recent advances in digital technology and natural language processing methods make this test a candidate for automated administration and scoring. Multiple parallel test stimuli are required for higher-frequency disease monitoring.

Objective

This study aims to develop and validate a remote and fully automated story recall task, suitable for longitudinal assessment, in a population of older adults with and without mild cognitive impairment (MCI) or mild AD.

Methods

The “Amyloid Prediction in Early Stage Alzheimer’s disease” (AMYPRED) studies recruited participants in the United Kingdom (AMYPRED-UK: NCT04828122) and the United States (AMYPRED-US: NCT04928976). Participants were asked to complete optional daily self-administered assessments remotely on their smart devices over 7 to 8 days. Assessments included immediate and delayed recall of 3 stories from the Automatic Story Recall Task (ASRT), a test with multiple parallel stimuli (18 short stories and 18 long stories) balanced for key linguistic and discourse metrics. Verbal responses were recorded and securely transferred from participants’ personal devices and automatically transcribed and scored using text similarity metrics between the source text and retelling to derive a generalized match score. Group differences in adherence and task performance were examined using logistic and linear mixed models, respectively. Correlational analysis examined parallel-forms reliability of ASRTs and convergent validity with cognitive tests (Logical Memory Test and Preclinical Alzheimer’s Cognitive Composite with semantic processing). Acceptability and usability data were obtained using a remotely administered questionnaire.

Results

Of the 200 participants recruited in the AMYPRED studies, 151 (75.5%)—78 cognitively unimpaired (CU) and 73 MCI or mild AD—engaged in optional remote assessments. Adherence to daily assessment was moderate and did not decline over time but was higher in CU participants (ASRTs were completed each day by 73/106, 68.9% participants with MCI or mild AD and 78/94, 83% CU participants). Participants reported favorable task usability: infrequent technical problems, easy use of the app, and a broad interest in the tasks. Task performance improved modestly across the week and was better for immediate recall. The generalized match scores were lower in participants with MCI or mild AD (Cohen d=1.54). Parallel-forms reliability of ASRT stories was moderate to strong for immediate recall (mean rho 0.73, range 0.56-0.88) and delayed recall (mean rho=0.73, range=0.54-0.86). The ASRTs showed moderate convergent validity with established cognitive tests.

Conclusions

The unsupervised, self-administered ASRT task is sensitive to cognitive impairments in MCI and mild AD. The task showed good usability, high parallel-forms reliability, and high convergent validity with established cognitive tests. Remote, low-cost, low-burden, and automatically scored speech assessments could support diagnostic screening, health care, and treatment monitoring.