Comparison of Time Taken to Assess Cognitive Function Using a Fully Immersive and Automated Virtual Reality System vs. the Montreal Cognitive Assessment

Extended reality for neurocognitive assessment: A systematic review

OBJECTIVE

The objective of this study is to evaluate the effectiveness, feasibility, and clinical relevance of extended reality (XR) technologies for neurocognitive assessment.

METHODS

A systematic review of published literature on augmented reality (AR), mixed reality (MR) and fully immersive virtual reality (VR) technologies for neurocognitive assessment was conducted. Studies were included if they evaluated XR for assessing neurocognitive domains, with outcomes related to diagnostic accuracy or usability.

RESULTS

28 studies met the inclusion criteria. VR-based tools (n = 26) were the most commonly utilized, offering immersive environments for assessing several cognitive domains including memory, attention and executive function. AR applications (n = 2) were less frequently utilized but showed promising potential in cognitive impairment detection. No studies utilized MR technology for assessing neurocognitive functions. XR technologies were found to be more sensitive, ecologically valid, and engaging compared to traditional assessment tools.

DISCUSSION

XR technologies offer a transformative approach to neurocognitive assessments by providing immersive, interactive environments that go beyond the limitations of traditional methods. Despite their potential, XR technologies face limitations such as high costs and technical challenges like motion sickness. Future efforts should focus on improving accessibility, user interfaces, and incorporating social and emotional dynamics to create more realistic assessments.

The Potential of Automated Assessment of Cognitive Function Using Non-Neuroimaging Data: A Systematic Review

Background/Objectives: The growing incidence of cognitive impairment among older adults has a significant impact on individuals, family members, caregivers, and society. Current conventional cognitive assessment tools are faced with some limitations. Recent evidence suggests that automating cognitive assessment holds promise, potentially resulting in earlier diagnosis, timely intervention, improved patient outcomes, and higher chances of response to treatment. Despite the advantages of automated assessment and technological advancements, automated cognitive assessment has yet to gain widespread use, especially in low and lower middle-income countries. This review highlights the potential of automated cognitive assessment tools and presents an overview of existing tools. Methods: This review includes 87 studies carried out with non-neuroimaging data alongside their performance metrics. Results: The identified articles automated the cognitive assessment process and were grouped into five categories either based on the tools' design or the data analysis approach. These categories include game-based, digital versions of conventional tools, original computerized tests and batteries, virtual reality/wearable sensors/smart home technologies, and artificial intelligence-based (AI-based) tools. These categories are further explained, and evaluation of their strengths and limitations is discussed to strengthen their adoption in clinical practice. Conclusions: The comparative metrics of both conventional and automated approaches of assessment suggest that the automated approach is a strong alternative to the conventional approach. Additionally, the results of the review show that the use of automated assessment tools is more prominent in countries ranked as high-income and upper middle-income countries. This trend merits further social and economic studies to understand the impact of this global reality.

A virtual reality cognitive screening tool based on the six cognitive domains

INTRODUCTION

Early detection of cognitive impairment enables interventions to slow cognitive decline. Existing neuropsychological paper-and-pencil tests may not adequately assess cognition in real-life environments. A fully-immersive and automated virtual reality (VR) system-Cognitive Assessment using VIrtual REality (CAVIRE)-was developed to assess all six cognitive domains. This case-control study aims to evaluate the ability of CAVIRE to differentiate cognitively-healthy individuals from those with cognitive impairment.

METHODS

One hundred nine Asian individuals 65-84 years of age were recruited at a primary care setting in Singapore. Based on the Montreal Cognitive Assessment (MoCA), participants were grouped as either Cognitively Healthy (MoCA ≥26, n = 60) or Cognitively Impaired (MoCA <26, n = 49). Subsequently, all participants completed the CAVIRE assessment.

RESULTS

Cognitively-healthy participants achieved higher VR scores and required shorter completion time across all six cognitive domains (all p's < 0.005). Receiver-operating characteristic curve analysis showed area under the curve of 0.7267.

DISCUSSION

The results demonstrated the potential of CAVIRE as a cognitive screening tool in primary care.

Highlights

CAVIRE is a virtual reality (VR) system that assesses the six cognitive domains.CAVIRE can distinguish healthy individuals from individuals with cognitive impairment.It has potential as a cognitive screening tool for older people in primary care.

Association Between Postoperative Delirium and Long-Term Subjective Cognitive Decline in Older Patients Undergoing Cardiac Surgery: A Secondary Analysis of the Minimizing Intensive Care Unit Neurological Dysfunction with Dexmedetomidine-Induced Sleep Trial

OBJECTIVES

This study aimed to evaluate whether a measure of subjective cognitive decline (SCD), the Patient-Reported Outcomes Measurement Information System (PROMIS) Applied Cognition-Abilities questionnaire, was associated with postoperative delirium. It was hypothesized that delirium during the surgical hospitalization would be associated with a decrease in subjective cognition up to 6 months after cardiac surgery.

DESIGN

This was a secondary analysis of data from the Minimizing Intensive Care Unit Neurological Dysfunction with Dexmedetomidine-induced Sleep randomized, placebo-controlled, parallel-arm superiority trial.

SETTING

Data from patients recruited between March 2017 and February 2022 at a tertiary medical center in Boston, Massachusetts were analyzed in February 2023.

PARTICIPANTS

Data from 337 patients aged 60 years or older who underwent cardiac surgery with cardiopulmonary bypass were included.

INTERVENTIONS

Patients were assessed preoperatively and postoperatively at 30, 90, and 180 days using the subjective PROMIS Applied Cognition-Abilities and telephonic Montreal Cognitive Assessment.

MEASUREMENT AND MAIN RESULTS

Postoperative delirium occurred within 3 days in 39 participants (11.6%). After adjusting for baseline function, participants who developed postoperative delirium self-reported worse cognitive function (mean difference [MD] -2.64 [95% CI -5.25, -0.04]; p = 0.047) up to 180 days after surgery, as compared with nondelirious patients. This finding was consistent with those obtained from objective t-MoCA assessments (MD -0.77 [95% CI -1.49, -0.04]; p = 0.04).

CONCLUSIONS

In this cohort of older patients undergoing cardiac surgery, in-hospital delirium was associated with SCD up to 180 days after surgery. This finding suggested that measures of SCD may enable population-level insights into the burden of cognitive decline associated with postoperative delirium.

Evaluating the validity of game-based assessments measuring cognitive function among children and adolescents: A systematic review and meta-analysis

Games offer advantages over traditional methods of assessing cognitive function among children and adolescents. However, the validity of game-based assessments has not been systematically evaluated. We conducted a systematic review and meta-analysis to assess the validity of game-based assessments measuring cognitive function among children and adolescents. We systematically searched several databases using pre-defined inclusion criteria. For papers that met the criteria, we extracted and analyzed the cognitive functions measured by each study, the correlation coefficients between game-based and traditional assessments, and factors that could influence the validity of game-based assessments. Our review identified 19 articles featuring 20 studies, 18 games, and 378 unique correlations between game-based and traditional assessments of cognitive function. Game-based assessments yielded significant correlations (n=282, 75%) with traditional assessments, over half of which were in the low to medium range in strength (r=0.3-0.69, n=227, 80%). Factors related to the child, such as age, gender, and prior gaming experience, may influence the validity of game-based assessments by modifying performance on game-based assessments. In addition, we found that game-based assessments that measured cognitive functions across more than one neurocognitive domain and used a prediction model for scoring were more likely to yield significant correlations. In contrast, including a narrative storyline in a game-based assessment was less likely to yield significant correlations. Most studies were of good quality, although the lack of sample size justification was a limiting factor. Further research is needed to elucidate the influence of identified factors on the validity of game-based assessment to justify the wide adoption of game-based assessments of cognitive function among children and adolescents.

Screening for Mild Cognitive Impairment in the Preoperative Setting: A Narrative Review

Cognitive impairment predisposes patients to the development of delirium and postoperative cognitive dysfunction. In particular, in older patients, the adverse sequelae of cognitive decline in the perioperative period may contribute to adverse outcomes after surgical procedures. Subtle signs of cognitive impairment are often not previously diagnosed. Therefore, the aim of this review is to describe the available cognitive screeners suitable for preoperative screening and their psychometric properties for identifying mild cognitive impairment, as preoperative workup may improve perioperative care for patients at risk for postoperative cognitive dysfunction. Electronic systematic and snowball searches of PubMed, PsycInfo, ClinicalKey, and ScienceDirect were conducted for the period 2015-2020. Major inclusion criteria for articles included those that discussed a screener that included the cognitive domain 'memory', that had a duration time of less than 15 min, and that reported sensitivity and specificity to detect mild cognitive impairment. Studies about informant-based screeners were excluded. We provided an overview of the characteristics of the cognitive screener, such as interrater and test-retest reliability correlations, sensitivity and specificity for mild cognitive impairment and cognitive impairment, and duration of the screener and cutoff points. Of the 4775 identified titles, 3222 were excluded from further analysis because they were published prior to 2015. One thousand four hundred and forty-eight titles did not fulfill the inclusion criteria. All abstracts of 52 studies on 45 screeners were examined of which 10 met the inclusion criteria. For these 10 screeners, a further snowball search was performed to obtain related studies, resulting in 20 articles. Screeners included in this review were the Mini-Cog, MoCA, O3DY, AD8, SAGE, SLUMS, TICS(-M), QMCI, MMSE2, and Mini-ACE. The sensitivity and specificity range to detect MCI in an older population is the highest for the MoCA, with a sensitivity range of 81-93% and a specificity range of 74-89%. The MoCA, with the highest combination of sensitivity and specificity, is a feasible and valid routine screening of pre-surgical cognitive function. This warrants further implementation and validation studies in surgical pathways with a large proportion of older patients.

Age-Related Performance in Using a Fully Immersive and Automated Virtual Reality System to Assess Cognitive Function

Introduction

Cognition generally declines gradually over time due to progressive degeneration of the brain, leading to dementia and eventual loss of independent functions. The rate of regression varies among the six cognitive domains (perceptual motor, executive function, complex attention, learning and memory, social cognition and language). Current modality of cognitive assessment using neuropsychological paper-and-pencil screening tools for cognitive impairment such as the Montreal Cognitive Assessment (MoCA) has limitations and is influenced by age. Virtual reality (VR) is considered as a potential alternative tool to assess cognition. A novel, fully immersive automated VR system (Cognitive Assessment using Virtual Reality, CAVIRE) has been developed to assess the six cognitive domains. As cognition is associated with age, VR performance is postulated to vary with age using this system.

Aims

This is a feasibility study to evaluate the VR performance of cognitively healthy adults aged between 35 and 74 years old, based on the performance score and completion time using the CAVIRE system.

Methods

Conducted in a public primary care clinic in Singapore, 25 multi-ethnic Asian adults were recruited in each of the four age groups in years: (1) 35–44; (2) 45–54; (3) 55–64, and (4) 65–74. The eligibility criteria included a MoCA score of 26 or higher to reflect normal cognition and understanding English instructions. They completed common daily activities ranging from brushing teething to shopping, across 13 VR segments. Their performances scores and completion time were automatically computed by the CAVIRE system. These VR performance indices were compared across the four age groups using one-way ANOVA, F-test of the hypothesis, followed by pair-wise comparisons in the event of a significant F-test (p < 0.05).

Results

One participant dropped out from Group 1. The demographic characteristics of 99 participants were similar across the 4 age groups. Overall, younger participants in Groups 1 and 2 attained higher VR performance scores and shorter completion time, compared to those in Groups 3 and 4, in all six cognitive domains (all p < 0.05).

Conclusion

The CAVIRE VR performance scores and completion time significantly differ between the younger and older Asian participants with normal cognition. Enhancements to the system are needed to establish the age-group specific normal performance indices.