Web-Based Cognitive Testing in Psychiatric Research: Validation and Usability Study

Cardiff Online Cognitive Assessment in a National Sample: Cross-Sectional Web-Based Study

BACKGROUND

Psychiatric disorders are associated with cognitive impairment. We have developed a web-based, 9-task cognitive battery to measure the core domains affected in people with psychiatric disorders. To date, this assessment has been used to collect data on a clinical sample of participants with psychiatric disorders.

OBJECTIVE

The aims of this study were (1) to establish a briefer version of the battery (called the Cardiff Online Cognitive Assessment [CONCA]) that can give a valid measure of cognitive ability ("g") and (2) to collect normative data and demonstrate CONCA's application in a health population sample.

METHODS

Based on 6 criteria and data from our previous study, we selected 5 out of the original 9 tasks to include in CONCA. These included 3 core tasks that were sufficient to derive a measure of "g" and 2 optional tasks. Participants from a web-based national cohort study (HealthWise Wales) were invited to complete CONCA. Completion rates, sample characteristics, performance distributions, and associations between cognitive performance and demographic characteristics and mental health measures were examined.

RESULTS

A total of 3679 participants completed at least one CONCA task, of which 3135 completed all 3 core CONCA tasks. Performance on CONCA was associated with age (B=-0.05, SE 0.002; P<.001), device (tablet computer: B=-0.26, SE 0.05; P<.001; smartphone: B=-0.46, SE 0.05; P<.001), education (degree: B=1.68, SE 0.14; P<.001), depression symptoms (B=-0.04, SE 0.01; P<.001), and anxiety symptoms (B=-0.04, SE 0.01; P<.001).

CONCLUSIONS

CONCA provides a valid measure of "g," which can be derived using as few as 3 tasks that take no more than 15 minutes. Performance on CONCA showed associations with demographic characteristics in the expected direction and was associated with current depression and anxiety symptoms. The effect of device on cognitive performance is an important consideration for research using web-based assessments.

Evaluating the validity of game-based assessments measuring cognitive function among children and adolescents: A systematic review and meta-analysis

Games offer advantages over traditional methods of assessing cognitive function among children and adolescents. However, the validity of game-based assessments has not been systematically evaluated. We conducted a systematic review and meta-analysis to assess the validity of game-based assessments measuring cognitive function among children and adolescents. We systematically searched several databases using pre-defined inclusion criteria. For papers that met the criteria, we extracted and analyzed the cognitive functions measured by each study, the correlation coefficients between game-based and traditional assessments, and factors that could influence the validity of game-based assessments. Our review identified 19 articles featuring 20 studies, 18 games, and 378 unique correlations between game-based and traditional assessments of cognitive function. Game-based assessments yielded significant correlations (n=282, 75%) with traditional assessments, over half of which were in the low to medium range in strength (r=0.3-0.69, n=227, 80%). Factors related to the child, such as age, gender, and prior gaming experience, may influence the validity of game-based assessments by modifying performance on game-based assessments. In addition, we found that game-based assessments that measured cognitive functions across more than one neurocognitive domain and used a prediction model for scoring were more likely to yield significant correlations. In contrast, including a narrative storyline in a game-based assessment was less likely to yield significant correlations. Most studies were of good quality, although the lack of sample size justification was a limiting factor. Further research is needed to elucidate the influence of identified factors on the validity of game-based assessment to justify the wide adoption of game-based assessments of cognitive function among children and adolescents.

Cognitive impairment in psychiatric diseases: Biomarkers of diagnosis, treatment, and prevention

Psychiatric diseases, such as schizophrenia, bipolar disorder, autism spectrum disorder, and major depressive disorder, place a huge health burden on society. Cognitive impairment is one of the core characteristics of psychiatric disorders and a vital determinant of social function and disease recurrence in patients. This review thus aims to explore the underlying molecular mechanisms of cognitive impairment in major psychiatric disorders and identify valuable biomarkers for diagnosis, treatment and prevention of patients.

Differences of resting fMRI and cognitive function between drug-naïve bipolar disorder and schizophrenia

BACKGROUND

Bipolar disorder (BD) and schizophrenia (SC) have many similarities in clinical manifestations. The acute phase of BD has psychotic symptoms, while SC also has emotional symptoms during the onset, which suggests that there is some uncertainty in distinguishing BD and SC through clinical symptoms.

AIM

To explore the characteristics of brain functional activities and cognitive impairment between BD and SC.

METHODS

Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) test was performed on patients in drug-naïve BD and SC (50 subjects in each group), and resting-state functional magnetic resonance imaging (rs-fMRI) scanning was performed meanwhile. Rs-fMRI data were routinely preprocessed, and the value of the fractional amplitude of low-frequency fluctuation (fALFF) was calculated. Then each part of the scores of the RBANS and the characteristics of brain function activities were compared between the two groups. Finally used Pearson correlation to analyze the correlation between cognition and brain function.

RESULTS

(1) Compared with BD group, all parts of RBANS scores in SC group decreased; (2) The left inferior occipital gyrus (IOG, peak coordinates - 30, -87, -15; t = 4.78, voxel size = 31, Alphasim correction) and the right superior temporal gyrus (STG, peak coordinates 51, -12, 0; t = 5.08, voxel size = 17, AlphaSim correction) were the brain areas with significant difference in fALFF values between BD and SC. Compared with SC group, the fALFF values of the left IOG and the right STG in BD group were increased (p < 0.05); (3) Pearson correlation analysis showed that the visuospatial construction score was positively correlated with the fALFF values of the left IOG and the right STG (r_{left IOG} = 0.304, p = 0.003; r_{right STG} = 0.340, p = 0.001); The delayed memory (figure recall) score was positively correlated with the fALFF value of the left IOG (r_{left IOG} = 0.207, p = 0.044).

DISCUSSION

The cognitive impairment of SC was more serious than BD. The abnormal activities of the left IOG and the right STG may be the core brain region to distinguish BD and SC, and are closely related to cognitive impairment, which provide neuroimaging basis for clinical differential diagnosis and explore the pathological mechanism of cognitive impairment.