A Meta-Analysis of Neuropsychological Effort Test Performance in Psychotic Disorders

Integrating Clinical Neuropsychology and Psychotic Spectrum Disorders: A Systematic Analysis of Cognitive Dynamics, Interventions, and Underlying Mechanisms

Background and Objectives: The study aims to provide a comprehensive neuropsychological analysis of psychotic spectrum disorders, including schizophrenia, bipolar disorder, and depression. It focuses on the critical aspects of cognitive impairments, diagnostic tools, intervention efficacy, and the roles of genetic and environmental factors in these disorders. The paper emphasizes the diagnostic significance of neuropsychological tests in identifying cognitive deficiencies and their predictive value in the early management of psychosis. Materials and Methods: The study involved a systematic literature review following the PRISMA guidelines. The search was conducted in significant databases like Scopus, PsycINFO, PubMed, and Web of Science using keywords relevant to clinical neuropsychology and psychotic spectrum disorders. The inclusion criteria required articles to be in English, published between 2018 and 2023, and pertinent to clinical neuropsychology's application in these disorders. A total of 153 articles were identified, with 44 ultimately included for detailed analysis based on relevance and publication status after screening. Results: The review highlights several key findings, including the diagnostic and prognostic significance of mismatch negativity, neuroprogressive trajectories, cortical thinning in familial high-risk individuals, and distinct illness trajectories within psychosis subgroups. The studies evaluated underline the role of neuropsychological tests in diagnosing psychiatric disorders and emphasize early detection and the effectiveness of intervention strategies based on cognitive and neurobiological markers. Conclusions: The systematic review underscores the importance of investigating the neuropsychological components of psychotic spectrum disorders. It identifies significant cognitive impairments in attention, memory, and executive function, correlating with structural and functional brain abnormalities. The paper stresses the need for precise diagnoses and personalized treatment modalities, highlighting the complex interplay between genetic, environmental, and psychosocial factors. It calls for a deeper understanding of these neuropsychological processes to enhance diagnostic accuracy and therapeutic outcomes.

Performance Validity Test Failure in the Clinical Population: A Systematic Review and Meta-Analysis of Prevalence Rates

Performance validity tests (PVTs) are used to measure the validity of the obtained neuropsychological test data. However, when an individual fails a PVT, the likelihood that failure truly reflects invalid performance (i.e., the positive predictive value) depends on the base rate in the context in which the assessment takes place. Therefore, accurate base rate information is needed to guide interpretation of PVT performance. This systematic review and meta-analysis examined the base rate of PVT failure in the clinical population (PROSPERO number: CRD42020164128). PubMed/MEDLINE, Web of Science, and PsychINFO were searched to identify articles published up to November 5, 2021. Main eligibility criteria were a clinical evaluation context and utilization of stand-alone and well-validated PVTs. Of the 457 articles scrutinized for eligibility, 47 were selected for systematic review and meta-analyses. Pooled base rate of PVT failure for all included studies was 16%, 95% CI [14, 19]. High heterogeneity existed among these studies (Cochran's Q = 697.97, p < .001; I2 = 91%; τ2 = 0.08). Subgroup analysis indicated that pooled PVT failure rates varied across clinical context, presence of external incentives, clinical diagnosis, and utilized PVT. Our findings can be used for calculating clinically applied statistics (i.e., positive and negative predictive values, and likelihood ratios) to increase the diagnostic accuracy of performance validity determination in clinical evaluation. Future research is necessary with more detailed recruitment procedures and sample descriptions to further improve the accuracy of the base rate of PVT failure in clinical practice.

Assessing harmonized intelligence measures in a multinational study

Studies examining the neurocognitive and circuit-based etiology of psychiatric illness are moving toward inclusive, global designs. A potential confounding effect of these associations is general intelligence; however, an internationally validated, harmonized intelligence quotient (IQ) measure is not available. We describe the procedures used to measure IQ across a five-site, multinational study and demonstrate the harmonized measure's cross-site validity. Culturally appropriate intelligence measures were selected: four short-form Wechsler intelligence tests (Brazil, Netherlands, South Africa, United States) and the Binet Kamat (India). Analyses included IQ scores from 255 healthy participants (age 18-50; 42% male). Regression analyses tested between-site differences in IQ scores, as well as expected associations with sociodemographic factors (sex, socioeconomic status, education) to assess validity. Harmonization (e.g., a priori selection of tests) yielded the compatibility of IQ measures. Higher IQ was associated with higher socioeconomic status, suggesting good convergent validity. No association was found between sex and IQ at any site, suggesting good discriminant validity. Associations between higher IQ and higher years of education were found at all sites except the United States. Harmonized IQ scores provide a measure of IQ with evidence of good validity that can be used in neurocognitive and circuit-based studies to control for intelligence across global sites.

The use of performance validity tests among inpatient forensic monolingual Spanish-speakers

Performance validity tests (PVTs) are an integral part of neuropsychological assessments. Yet no studies have examined how Spanish-speaking forensic inpatients perform on PVTs, making it difficult to interpret these tests in this population. The present study examined archival data collected from monolingual Spanish-speaking forensic inpatients (n = 55; Mage = 49.6 years, SD = 12.0; 84.9% male; 93.5% diagnosed with a Psychotic Spectrum Disorder) to determine how this population performs on several PVTs. Most participants' scores on the Dot Counting Test (DCT; 82.2%; n = 45), Repeatable Battery for Assessment of Neuropsychological Status-Effort Index (RBANS EI; 84.4%; n = 33), and Test of Memory Malingering (TOMM; 79.1%; n = 43) were indicative of valid performance. Few participants, however, had Rey-15 Item Test (FIT) scores in the valid range (24.5% to 48.0%; Recall n = 50 and Combined n = 49, respectively); although FIT Recall specificity was improved when cutoff scores were lowered. Total years of education, but not other educational factors, were significantly associated with performance on PVTs (r = .33-.40, p = .01-.03). Study results suggest the DCT, TOMM, and RBANS EI may be more appropriate PVTs for Spanish-speaking forensic inpatients compared to the FIT.

Selective processing in attention and memory in schizophrenia: A meta-analysis of the negative priming effect

Individuals with schizophrenia show impairments in a variety of selective attention tasks. Research on the negative priming (NP) effect in schizophrenia has yielded mixed evidence. This meta-analysis aimed to examine the NP effect exhibited by patients with schizophrenia and the impact of study methodology on findings. The methods and reporting of this meta-analysis followed the PRISMA guideline. Eligible studies were identified through primary literature search in MEDLINE, PsycInfo, PsycArticles, and Embase and secondary search based on included studies and important reviews. Three-level random effects-models were used to summarize between-group differences in the raw NP score, as well as the NP ratio and baseline reaction time (RT) as secondary outcomes. We identified 1383 studies published between 1966 and 2022 and reviewed 27 studies that consist of 627 patients with schizophrenia and 653 controls in total. Compared to healthy controls, patients with schizophrenia showed a mildly reduced raw NP score with marginal significance, Hedges' g = -0.16, 95% confidence interval (CI) -0.35 to 0.02, p = 0.084. However, analysis of a subsample of studies indicated a significant, moderate reduction in the NP ratio among patients, g = -0.52, 95% CI -0.91 to -0.14; p = 0.014. Moderator analyses revealed a longer illness duration as predictive of a more reduced NP effect. This meta-analysis lends tentative evidence to impaired attention or memory process as measured by the NP task in schizophrenia. More research is needed to substantiate our results and clarify the impact of study design and patient characteristics on findings.

Is suboptimal effort an issue? A systematic review on neuropsychological performance validity in major depressive disorder

BACKGROUND

In Major Depressive Disorder (MDD), emotion- and motivation related symptoms may affect effort during neuropsychological testing. Performance Validity Tests (PVT's) are therefore essential, but are rarely mentioned in research on cognitive functioning in MDD. We aimed to assess the proportion of MDD patients with demonstrated valid performance and determine cognitive functioning in patients with valid performance. This is the first systematic review on neuropsychological performance validity in MDD.

METHODS

Databases PubMed, PsycINFO, Embase, and Cochrane Library were searched for studies reporting on PVT results of adult MDD patients. We meta-analyzed the proportion of MDD patients with PVT scores indicative of valid performance.

RESULTS

Seven studies with a total of 409 MDD patients fulfilled inclusion criteria. Six studies reported the exact proportion of patients with PVT scores indicative of valid performance, which ranged from 60 to 100 % with a proportion estimate of 94 %. Four studies reported on cognitive functioning in MDD patients with valid performance. Two out of these studies found memory impairment in a minority of MDD patients and two out of these studies found no cognitive impairment.

LIMITATIONS

Small number of studies and small sample sizes.

CONCLUSIONS

A surprisingly small number of studies reported on PVT in MDD. About 94 % of MDD patients in studies using PVT's had valid neuropsychological test performance. Concessive information regarding cognitive functioning in MDD patients with valid performance was lacking. Neuropsychological performance validity should be taken into account since this may alter conclusions regarding cognitive functioning.

Network Analysis of the Structure of the Core Symptoms and Clinical Correlates in Comorbid Schizophrenia and Gambling Disorder

Few studies have analyzed the clinical profile of treatment-seeking patients with the comorbid presence of schizophrenia (SCZ) and gambling disorder (GD), which warrants new research to assess the network structure of this complex mental condition. The aim of this study was to explore the organization of the symptoms and other clinical correlates of SCZ with GD. Network analysis was applied to a sample of N = 179 SCZ patients (age range: 19-70 years, mean=39.5, SD=9.9) who met clinical criteria for gambling disorder-related problems. Variables included in the network were the core GD symptoms according to the DSM-5, psychotic and paranoid ideation levels, global psychological distress, GD severity measures (debts and illegal behavior related with gambling), substances (tobacco, alcohol, and illegal drugs), and personality profile. The nodes with the highest authority in the network (variables of highest relevance) were personality traits and psychological distress. Four empirical modules/clusters were identified, and linkage analysis identified the nodes with the highest closeness (bridge nodes) to be novelty seeking and reward dependence (these traits facilitate the transition between the modules). Identification of the variables with the highest centrality/linkage can be particularly useful for developing precise management plans to prevent and treat SCZ with GD.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11469-022-00983-y.

Profile of Embedded Validity Indicators in Criminal Defendants with Verified Valid Neuropsychological Test Performance

Objective

Few studies have examined the use of embedded validity indicators (EVIs) in criminal-forensic practice settings, where judgements regarding performance validity can carry severe consequences for the individual and society. This study sought to examine how various EVIs perform in criminal defendant populations, and determine relationships between EVI scores and intrapersonal variables thought to influence performance validity.

Method

Performance on 16 empirically established EVI cutoffs were examined in a sample of 164 criminal defendants with valid performance who were referred for forensic neuropsychological evaluation. Subsequent analyses examined the relationship between EVI scores and intrapersonal variables in 83 of these defendants.

Results

Half of the EVIs (within the Wechsler Adult Intelligence Scale Digit Span Total, Conners’ Continuous Performance Test Commissions, Wechsler Memory Scale Logical Memory I and II, Controlled Oral Word Association Test, Trail Making Test Part B, and Stroop Word and Color) performed as intended in this sample. The EVIs that did not perform as intended were significantly influenced by relevant intrapersonal variables, including below-average intellectual functioning and history of moderate–severe traumatic brain injury and neurodevelopmental disorder.

Conclusions

This study identifies multiple EVIs appropriate for use in criminal-forensic settings. However, based on these findings, practitioners may wish to be selective in choosing and interpreting EVIs for forensic evaluations of criminal court defendants.

The age differences and effect of mild cognitive impairment on perceptual-motor and executive functions

It is unclear whether the decline in executive function (EF) and perceptual-motor function (PMF) found in older adults with mild cognitive impairment (MCI) is the result of a normal aging process or due to MCI. This study aimed to determine age-related and MCI-related cognitive impairments of the EF and PMF. The EF and PMF were investigated across four groups of 240 participants, 60 in each group, including early adult, middle adult, older adult, and older adult with probable MCI. The EF, working memory, inhibition, and cognitive flexibility were evaluated using digit span backward tasks, the Stroop color-word test, and the modified switching verbal fluency test, respectively. The PMF, visual perception, visuoconstructional reasoning, and perceptual-motor coordination were evaluated using the clock reading test, stick design test, and stick catching test, respectively. Group differences were found for all subdomains of EF and PMF (p < 0.05), except for perceptual-motor coordination, indicating that this subdomain could be maintained in older adults and was not affected by MCI. For the age difference, working memory, cognitive flexibility, visual perception, and visuoconstructional reasoning remained stable across middle adults and started to decline in older adults, while cognitive inhibition began to decrease in middle adults and it further declined in older adults. To control the confounding effect of education level, the results showed that only cognitive flexibility was further decreased in older adults with probable MCI compared to those without MCI (p < 0.05). In conclusion, cognitive inhibition decreased earlier in middle adults, whereas EF and PMF started to decline in older adults. Cognitive flexibility was the only MCI-sensitive cognitive function.

Are TOPF and WRAT WR Interchangeable Measures among Psychiatric Inpatients?

OBJECTIVE

To examine whether Test of Premorbid Functioning (TOPF) and Wide Range Achievement Test-Word Reading subtest (WRAT WR) are interchangeable measures, and the relationship between these measures and intelligence, among patients with schizophrenia.

METHOD

In this archival study, the authors examined neuropsychology referrals of an inpatient forensic state hospital. Patients with a schizophrenia spectrum disorder (SSD) who received the Wechsler Adult Intelligence Scale-Fourth Edition or the Wechsler Abbreviated Scale of Intelligence-Second Edition and either TOPF or WRAT WR were considered for inclusion. The final sample consisted of 119 individuals (73.1% male).

RESULTS

Although there was a linear relationship between most TOPF variables and WRAT WR, their concordance was weak (concordance correlation coefficients [CCC] < 0.90). Poor concordance was also observed between current FSIQ and all standard scores (SS) derived from word reading measures. FSIQ-word reading measure discrepancy scores differed significantly from a hypothesized mean of 0 (mean discrepancy range = -7.42 to -16.60). Discrepancies greater than one standard deviation (>1 SD) were highest among demographics-based SS (i.e. TOPF Predicted and Simple without TOPF). Performance-based SS, particularly TOPF Actual and WRAT4 WR, had the fewest discrepancy scores >1 SD fromFSIQ.

CONCLUSIONS

TOPF and WRAT WR should not be used interchangeably among institutionalized patients with SSDs. TOPF and WRAT WR were discrepant from FSIQ, with demographic variables producing higher SS relative to performance-based variables. Future research is needed to determine which of these measures more accurately estimates intelligence among inpatients withSSDs.

American Academy of Clinical Neuropsychology (AACN) 2021 consensus statement on validity assessment: Update of the 2009 AACN consensus conference statement on neuropsychological assessment of effort, response bias, and malingering

Objective: Citation and download data pertaining to the 2009 AACN consensus statement on validity assessment indicated that the topic maintained high interest in subsequent years, during which key terminology evolved and relevant empirical research proliferated. With a general goal of providing current guidance to the clinical neuropsychology community regarding this important topic, the specific update goals were to: identify current key definitions of terms relevant to validity assessment; learn what experts believe should be reaffirmed from the original consensus paper, as well as new consensus points; and incorporate the latest recommendations regarding the use of validity testing, as well as current application of the term 'malingering.' Methods: In the spring of 2019, four of the original 2009 work group chairs and additional experts for each work group were impaneled. A total of 20 individuals shared ideas and writing drafts until reaching consensus on January 21, 2021. Results: Consensus was reached regarding affirmation of prior salient points that continue to garner clinical and scientific support, as well as creation of new points. The resulting consensus statement addresses definitions and differential diagnosis, performance and symptom validity assessment, and research design and statistical issues. Conclusions/Importance: In order to provide bases for diagnoses and interpretations, the current consensus is that all clinical and forensic evaluations must proactively address the degree to which results of neuropsychological and psychological testing are valid. There is a strong and continually-growing evidence-based literature on which practitioners can confidently base their judgments regarding the selection and interpretation of validity measures.

The prevalence and features of schizophrenia among individuals with gambling disorder

BACKGROUND-OBJECTIVES

Few studies have analyzed the comorbid presence of gambling disorder (GD) with schizophrenia, its sociodemographic correlates and clinical implications. This study estimated the prevalence of the dual diagnosis (GD with schizophrenia) and the differences in the profiles of patients with and without the dual condition.

METHOD

The sample included n = 3,754 patients consecutively accepted for treatment for GD. Sociodemographics, gambling-related variables, psychopathological state and personality traits were assessed and compared between the groups.

RESULTS

The prevalence of schizophrenia within patients who met clinical criteria for GD was 4.4% (95% confidence interval: 3.8%-5.1%). Variables related to the dual presence of GD with schizophrenia were single marital status, lower education level, inactive working status, socioeconomic disadvantage, younger age, earlier onset of gambling problems, worse global psychopathological state and more dysfunctional personality profile (higher level in harm avoidance and lower level in cooperativeness, reward dependence, persistence and self-directedness).

CONCLUSION

The presence of schizophrenia among patients with GD was around 4 times higher than the prevalence rate estimated in the reference general population. The differences in the profiles of GD patients with and without schizophrenia suggest that individuals with the dual diagnosis condition require unique assessment considerations and tailored treatment interventions specifically designed for the clinical and functioning higher risk.