Concurrent validity and reliability of at-home teleneuropsychological evaluations among people with and without HIV

Development of a self-administered online battery for remote assessment of executive functions and verbal memory: equivalence with face-to-face administration, preliminary norms, and acceptance

OBJECTIVES

Interest in teleneuropsychology services increased considerably after the COVID-19 pandemic. However, the utility of unsupervised administration of computerized tests remains largely unexplored. In the present study, we developed a brief computerized battery that assesses self-reported cognitive abilities and performances on executive functioning and verbal memory. We investigated the equivalence of the self-administration online (SAO) procedure and the face-to-face (FTF) administration. Preliminary normative data were developed and the acceptance of the SAO procedure was explored.

METHODS

A community sample of 169 Greek adults [94 women; mean age: 41.95 (SD = 13.40) years, mean years of education: 15.10 (SD = 2.65)] completed the SAO assessment. A subgroup of 40 participants was tested in a counterbalanced way both with SAO and FTF. Participants' performances were compared with paired sample t-tests and the agreement between the two methods was estimated with intraclass correlation coefficients (ICCs). Multiple linear regression analyses were applied to investigate the effect of demographic characteristics on SAO measures.

RESULTS

No difference between SAO and FTF scores was observed. ICCs indicated moderate to good agreement (.418-.848) for most measures. Age was positively associated with self-reported cognitive state and negatively with neuropsychological performances and the level of acceptance of the SAO procedure. Approximately 80% of participants reported satisfaction from the SAO assessment, 69% good compliance with the instructions, but less than 30% belief that the FTF assessment could be adequately replaced.

CONCLUSION

SAO testing is feasible and well accepted among Greek adults yielding equivalent results with FTF testing. Despite the wide satisfaction, though, notable reluctance was noted for the substitution of FTF with SAO procedures.

Tele-Neuropsychology: From Science to Policy to Practice

OBJECTIVE

The primary aim of this paper is to accelerate the number of randomized experimental studies of the reliability and validity in-home tele-neuropsychological testing (tele-np-t).

METHOD

We conducted a critical review of the tele-neuropsychology literature. We discuss this research in the context of the United States' public and private healthcare payer systems, including the Centers for Medicare & Medicaid Services (CMS) and Current Procedural Terminology (CPT) coding system's telehealth lists, and existing disparities in healthcare access.

RESULTS

The number of tele-np publications has been stagnant since the onset of the COVID-19 pandemic. There are less published experimental studies of tele-neuropsychology (tele-np), and particularly in-home tele-np-t, than other tele-np publications. There is strong foundational evidence of the acceptability, feasibility, and reliability of tele-np-t, but relatively few studies of the reliability and validity of in-home tele-np-t using randomization methodology.

CONCLUSIONS

More studies of the reliability and validity of in-home tele-np-t using randomization methodology are necessary to support inclusion of tele-np-t codes on the CMS and CPT telehealth lists, and subsequently, the integration and delivery of in-home tele-np-t services across providers and institutions. These actions are needed to maintain equitable reimbursement of in-home tele-np-t services and address the widespread disparities in healthcare access.

Mild Cognitive Impairment, But Not HIV Status, is Related to Reduced Awareness of Level of Cognitive Performance Among Older Adults

OBJECTIVE

Self-assessment of cognitive abilities can be an important predictor of clinical outcomes. This study examined impairments in self-assessments of cognitive performance, assessed with traditional neuropsychological assessments and novel virtual reality tests among older persons with and without human immunodeficiency virus (HIV) and mild cognitive impairment (MCI).

METHODS

One hundred twenty-two participants (82 persons with HIV; 79 MCI+) completed a traditional neuropsychological battery, DETECT virtual reality cognitive battery, and self-reported their general cognitive complaints, depressive symptoms, and perceptions of DETECT performance. Relationships between DETECT performance and self-assessments of performance were examined as were the correlations between general cognitive complaints and performance. These relations were evaluated across HIV and MCI status, considering the associations of depressive symptoms, performance, and self-assessment.

RESULTS

We found no effect of HIV status on objective performance or self-assessment of DETECT performance. However, MCI+ participants performed worse on DETECT and traditional cognitive tests, while also showing a directional bias towards overestimation of their performance. MCI- participants showed a bias toward underestimation. Cognitive complaints were reduced compared to objective performance in MCI+ participants. Correlations between self-reported depressive symptoms and cognitive performance or self-assessment of performance were nonsignificant.

CONCLUSIONS

MCI+ participants underperformed on neuropsychological testing, while overestimating performance. Interestingly, MCI- participants underestimated performance to approximately the same extent as MCI+ participants overestimated. Practical implications include providing support for persons with MCI regarding awareness of limitations and consideration that self-assessments of cognitive performance may be overestimated. Similarly, supporting older persons without MCI to realistically appraise their abilities may have clinical importance.

An Automated Virtual Reality Program Accurately Diagnoses HIV-Associated Neurocognitive Disorders in Older People With HIV

Background

HIV-associated neurocognitive disorders (HANDs) remain prevalent despite antiretroviral therapy, particularly among older people with HIV (PWH). However, the diagnosis of HAND is labor intensive and requires expertise to administer neuropsychological tests. Our prior pilot work established the feasibility and accuracy of a computerized self-administered virtual reality program (DETECT; Display Enhanced Testing for Cognitive Impairment and Traumatic Brain Injury) to measure cognition in younger PWH. The present study expands this to a larger sample of older PWH.

Methods

We enrolled PWH who were ≥60 years old, were undergoing antiretroviral therapy, had undetectable plasma viral loads, and were without significant neuropsychological confounds. HAND status was determined via Frascati criteria. Regression models that controlled for demographic differences (age, sex, education, race/ethnicity) examined the association between DETECT's cognition module and both HAND status and Global Deficit Score (GDS) derived via traditional neuropsychological tests.

Results

Seventy-nine PWH (mean age, 66 years; 28% women) completed a comprehensive neuropsychological battery and DETECT's cognition module. Twenty-five (32%) had HAND based on the comprehensive battery. A significant correlation was found between the DETECT cognition module and the neuropsychological battery (r = 0.45, P < .001). Furthermore, in two separate regression models, HAND status (b = -0.79, P < .001) and GDS impairment status (b = -0.83, P < .001) significantly predicted DETECT performance. Areas under the curve for DETECT were 0.78 for differentiating participants by HAND status (HAND vs no HAND) and 0.85 for detecting GDS impairment.

Conclusions

The DETECT cognition module provides a novel means to identify cognitive impairment in older PWH. As DETECT is fully immersive and self-administered, this virtual reality tool holds promise as a scalable cognitive screening battery.

Auditory and cognitive function in older adults living with and without HIV

OBJECTIVES

To evaluate the peripheral hearing sensitivity and central auditory processing in persons with HIV (PWH) and persons without HIV (PWoH); and the association between cognitive function and central auditory processing in PWH and PWoH.

DESIGN

Cross-sectional, observational study.

METHODS

Participants included 67 PWH {70.2% men; mean age = 66.6 years [standard deviation (SD) = 4.7 years]} and 35 PWoH [51.4% men; mean age = 72.9 years (SD = 7.0 years)]. Participants completed a hearing assessment and a central auditory processing assessment that included dichotic digits testing (DDT). Pure-tone air-conduction thresholds were obtained at octave frequencies from 0.25 through 8 kHz. A pure-tone average (PTA) was calculated from 0.5, 1, 2, and 4 kHz thresholds for each ear. Participants also completed a neuropsychological battery assessing cognition in seven domains.

RESULTS

PWH had slightly lower (i.e. better) PTAs compared with PWoH, but this was not statistically significant. Conversely, PWH and PWoH had similar DDT results for both ears. Poorer verbal fluency, learning, and working memory performance was significantly related to lower DDT scores, and those defined as having verbal fluency, learning, and working memory impairment had significantly poorer DDT scores (8-18% lower) in both ears.

CONCLUSION

Hearing and DDT results were similar in PWH and PWoH. The relationship between verbal fluency, learning, and working memory impairment and poorer DDT results did not differ by HIV serostatus. Clinicians, particularly audiologists, should be mindful of cognitive functioning abilities when evaluating central auditory processing.

A phase II single-arm trial of memantine for prevention of cognitive decline during chemotherapy in patients with early breast cancer: Feasibility, tolerability, acceptability, and preliminary effects

BACKGROUND

Cognitive difficulties have been described after chemotherapy for breast cancer, but there is no standard of care to improve cognitive outcomes in these patients. This trial examined the feasibility, tolerability, acceptability, and preliminary effects of memantine to prevent cognitive decline during chemotherapy for breast cancer.

METHODS

Patients with stage I-III breast cancer, scheduled for neo/adjuvant chemotherapy, completed a cognitive battery prior to and 4 weeks after completing chemotherapy. Memantine (10 mg BID) was administered concurrent with chemotherapy. Our primary cognitive outcome was visual working memory assessed by the Delayed Matching to Sample test. We used the Brief Medication Questionnaire to assess acceptability.

RESULTS

Of 126 patients approached, 56 (44%) enrolled. Forty-five (80%) received ≥1 dose of memantine and completed pre-post assessments. Seventy-six percent reported taking ≥90% of scheduled doses. Participants were mean age of 56, 77% White, and 57% had stage I disease. Sixty-four percent had stable or improved Delayed Matching to Sample test scores. Stable or improved cognition was observed in 87%-91% across objective cognitive domain composite measures. Sixty-six percent self-reported stable or improved cognitive symptoms. There were seven greater than or equal to grade 3 adverse events; two were possibly related to memantine. Only 5% reported that taking memantine was a disruption to their lives.

CONCLUSIONS

Memantine was well-tolerated and consistently taken by a large majority of patients receiving breast cancer chemotherapy. The majority demonstrated stable or improved cognition from pre- to post-assessment. Randomized trials are needed to determine memantine's efficacy to ameliorate cognitive loss.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04033419.