A meta-analysis of the accuracy of embedded performance validity indicators from the repeatable battery for the assessment of neuropsychological status

Performance validity of the Dot Counting Test in a dementia clinic setting

OBJECTIVE

This study examined the utility of a performance validity test (PVT), the Dot Counting Test (DCT), in individuals undergoing neuropsychological evaluations for dementia. We investigated specificity rates of the DCT Effort Index score (E-Score) and various individual DCT scores (based on completion time/errors) to further establish appropriate cutoff scores.

METHOD

This cross-sectional study included 56 non-litigating, validly performing older adults with no/minimal, mild, or major cognitive impairment. Cutoffs associated with ≥90% specificity were established for 7 DCT scoring methods across impairment severity subgroups.

RESULTS

Performance on 5 of 7 DCT scoring methods significantly differed based on impairment severity. Overall, more severely impaired participants had significantly higher E-Scores and longer completion times but demonstrated comparable errors to their less impaired counterparts. Contrary to the previously established E-Score cutoff of ≥17, a cutoff of ≥22 was required to maintain adequate specificity in our total sample, with significantly higher adjustments required in the Mild and Major Neurocognitive Disorder subgroups (≥27 and ≥40, respectively). A cutoff of >3 errors achieved adequate specificity in our sample, suggesting that error scores may produce lower false positive rates than E-Scores and completion time scores, both of which overemphasize speed and could inadvertently penalize more severely impaired individuals.

CONCLUSIONS

In a dementia clinic setting, error scores on the DCT may have greater utility in detecting non-credible performance than E-Scores and completion time scores, particularly among more severely impaired individuals. Future research should establish and cross-validate the sensitivity and specificity of the DCT for assessing performance validity.

Dynamic Impact of the Sleep Disorder, Depression and Anxiety on the Cognitive Function in the First-Episode Depressive Patients

Background

Sleep disorder is closely related to depressive and anxious status as well as cognitive symptoms.

Materials and Methods

A total of 173 cases with the first-episode major depressive disorder (MDD) were involved in this study. The Hamilton Depression Scale (HAMD-17), Hamilton Anxiety Scale (HAMA), Pittsburgh Sleep Quality Index (PSQI), and Repeatable battery for the Assessment of Neuropsychological Status (RBANS) were used to assess the patients. Three visits were set at baseline at the 4th and the 8th weeks. Latent Growth Curve Models (LGCM) were used to analyze the changing tendency and correlation between sleep disorder, depression, anxiety status, and cognitive function in patients with MDD.

Results

Baseline sleep status in patients with MDD could predict cognitive function (p=0.043) and changes in cognitive function (p=0.016), and changes in depressive symptoms could negatively predict cognitive function (p=0.021). Changes in depressive status negatively predictability of its cognitive function (p=0.005). Changes in sleep status negatively predict cognitive function (p=0.099). Sex, age, educational duration, and nature of work were included in the LGCM. The comparison among the subgroups in the LGCM indicated that these four dimensions showed consistency in dynamic tendency, demonstrating that cognitive function changes with sleep status.

Conclusion

The more severe the sleep disorder in patients with first-episode MDD, the more obvious was the damage to cognition. The dynamic impact of sleep quality on cognitive function is positively correlated, and over time, there is an association between the remission speed of depressive or anxiety symptoms and improving the speed of cognitive function in patients with MDD.

Preliminary findings from reevaluating the MMPI Response Bias Scale items in veterans undergoing neuropsychological evaluation

The Response Bias Scale (RBS) was developed to predict non-credible cognitive presentations among disability claimants without head injury. Developers used empirical keying, which is independent of apparent content, to select items from the Minnesota Multiphasic Personality Inventory-2 (MMPI-2) item pool that distinguished between individuals passing or failing performance validity tests (PVTs). No study has examined which of these items would have psychometric value when used in clinical neuropsychological evaluations. This study reexamined items comprising RBS with reference to manifest item content, internal consistency, PVTs, and a symptom validity test (SVT) in a sample of 173 predominately White male veterans (MAGE = 50.70, MEDU = 13.73) in a VA outpatient neuropsychology clinic. Participants completed the MMPI-2 Restructured Form (MMPI-2-RF), PVTs, and an SVT. The 28-item RBS appears to contain three types of items: those that manifestly address cognitive functioning, those that are supported but do not appear to address cognitive functioning, and nine items that were unrelated to cognition and not statistically supported. The 19 empirically supported items, or RBS-19, predicted PVT and SVT failures marginally better than the RBS. Both the RBS and RBS-19 had stronger relationships with SVTs relative to PVTs. Although the removal of the nine problematic items improved the diagnostic accuracy of the scale, it still did not reach the level that is generally considered to be clinically optimal. The RBS-19 offers a measure with improved internal consistency and predictive validity compared to the RBS and warrants additional research.

Abnormalities of the Amygdala in schizophrenia: a real world study

BACKGROUND

Amygdala plays an important role in schizophrenia (SC), but its mechanisms are still unclear. Therefore, we investigated the relationship between the resting-state magnetic resonance imaging (rsMRI) signals of the amygdala and cognitive functions, providing references for future research in this area.

METHODS

We collected 40 drug-naïve SC patients and 33 healthy controls (HC) from the Third People's Hospital of Foshan. We used rsMRI and the automatic segmentation tool to extract the structural volume and local neural activity values of the amygdala and conducted Pearson correlation analysis with the Positive and Negative Syndrome Scale (PANSS) and the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) scores. Finally, we compared the clinical data, as well as the volume and functional changes of the amygdala in SC patients before and after treatment.

RESULTS

Compared with HC, SC had widespread cognitive impairments, significant abnormalities in left amygdala function, while the reduction in volume of SC was not significant. Further Pearson correlation analysis with Bonferroni correction showed that only Immediate memory (learning) was significantly negatively correlated with fractional amplitude of low-frequency fluctuation (FALFF, r = -0.343, p = 0.001, p' = 0.014 (Bonferroni correction)). When compared and analyzed the data difference of SC before and after treatment, we found that immediate memory and delayed memory of SC showed varying degrees of recovery after treatment (tlearning = -2.641, plearning = 0.011; tstory memory = -3.349, pstory memory = 0.001; tlist recall = -2.071, plist recall = 0.043; tstory recall = -2.424, pstory recall = 0.018). But the brain structure and function did not recover.

CONCLUSION

There was significant dysfunction in the amygdala in SC, and after conventional treatment, the function of the amygdala did not improve with the improvement of clinical symptoms and cognitive function.

Amygdala signal abnormality and cognitive impairment in drug-naïve schizophrenia

BACKGROUND

Recently studies had showed that the amygdala may take part in the cognitive impairment in schizophrenia (SC). However, the mechanism is still unclear, so we explored the relationship between the amygdala resting state magnetic resonance imaging (rsMRI) signal and cognitive function, to provide a reference for the follow-up study.

METHODS

We collected 59 drug-naïve SCs and 46 healthy controls (HCs) from the Third People's Hospital of Foshan. The rsMRI technique and automatic segmentation tool were used to extract the volume and functional indicators of the SC's amygdala. The Positive and Negative Syndrome Scale (PANSS) was used to assess the severity of the disease, and the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) was used to assess cognitive function. Pearson correlation analysis was used to compare the relationship between the structural and functional indicators of the amygdala and PANSS and RBANS.

RESULTS

(1) There was no significant difference between SC and HC in age, gender and years of education. Compared with HC, the PANSS score of SC increased and the RBANS score decreased significantly. Meanwhile, the left amygdala volume decreased (t=-3.675, p < 0.001), and the Fractional amplitude of low-frequency fluctuations (FALFF) values of bilateral amygdala increased (t_L=3.916, p < 0.001; t_R=3.131, p = 0.002). (2) The volumes of the left amygdala were negatively correlated with the PANSS score (r_L=-0.243, p = 0.039). While the FALFF values of the bilateral amygdala were positively correlated with the PANSS score (r_L=0.257, p = 0.026; r_R=0.259, p = 0.026). Bilateral amygdala volumes and FALFF values were positively correlated (r_L=0.445, p < 0.001; r_R=0.326, p = 0.006) and negatively correlated with RBANS score (r_L=-0.284, p = 0.014; r_R=-0.272, p = 0.020), respectively.

CONCLUSION

The abnormal volume and function of the amygdala play important roles in the disease process of SC, and are closely related to cognitive impairment.

Examining the repeatable battery for the assessment of neuropsychological status validity indices in people with schizophrenia spectrum disorders

Objective: We examined the frequency of possible invalid test scores on the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) in patients with schizophrenia spectrum disorders, and whether there was an association between scores on the embedded RBANS performance validity tests (PVTs) and self-reported symptoms of apathy as measured by the Initiate Scale of the Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A). Methods: Participants included 250 patients (M = 24.4 years-old, SD = 5.7) with schizophrenia spectrum disorders. Base rates of RBANS Effort Index (EI), Effort Scale (ES), and Performance Validity Index (PVI) test scores were computed. Spearman correlations were used to examine the associations between the RBANS PVTs, the RBANS Index scores, and the BRIEF-A Initiate Scale. Regression analyses were used to investigate how well the RBANS PVTs predicted scores on the BRIEF-A Initiate Scale. Results: The frequency of invalid scores on the EI (>3) and the PVI (<42) in participants with schizophrenia spectrum disorders was 6%. The frequency of invalid ES scores (<12) was 28% in the patients compared to 15% in the U.S. standardization sample. There was a small significant correlation between the EI and the BRIEF-A Initiate Scale (rho=.158, p<.05). Conclusions: The rates of invalid scores were similar to previously published studies. Invalid scores on the BRIEF-A were uncommon. Apathy measured with the BRIEF-A Initiate Scale was not associated with performance on the RBANS validity measures or with measures of cognition.

RBANS Validity Measures and the TOMM in Veterans Undergoing Seizure Monitoring

OBJECTIVE

To assess the validity of embedded measures of performance validity, the effort index (EI) and effort scale (ES) of the repeatable battery for the assessment of neuropsychological status (RBANS), in Veterans with seizures; to compare the frequency of failure on the test of memory malingering (TOMM) in patients with epileptic versus psychogenic nonepileptic seizures (PNES).

METHODS

Seizure diagnosis was established for 309 participants in epilepsy monitoring units using conventional diagnostic criteria who completed both the TOMM and RBANS. The criterion for performance invalidity was failure on any trial of the TOMM. We examined multiple EI and ES cutoffs to establish optimal sensitivity and specificity.

RESULTS

An RBANS EI cutoff score of greater than three was optimal with specificity of .98, sensitivity of.19, and positive Likelihood Ratio of 10 but was not useful when below this cutoff. Confidence intervals indicate the need for confirmation of a failed EI with another performance validity test (PVT). No ES cutoff had sufficient specificity for clinical use. Invalid TOMM performance but not invalid RBANS performance was significantly more common in persons with PNES than in persons with epileptic seizures.

CONCLUSIONS

In Veterans undergoing seizure monitoring, the RBANS EI was useful as a screen when positive that requires confirmation with another PVT. The RBANS ES was not useful. Invalid performance on the TOMM was more common in persons with PNES than in persons with epileptic seizures.

Reconsidering the RBANS Factor Structure: a Systematic Literature Review and Meta-Analytic Factor Analysis

The primary aim was to perform a systematic literature review and extract data necessary for a meta-analytic factor analysis of the RBANS. Secondary aims were to examine the potential validity and utility of the resulting factor structure. Literature was identified through a review of PsycINFO, PubMed, MEDLINE, Academic Search Complete, Psychology & Behavioral Sciences Collection, CINAHL Complete, Health Source: Nursing/Academic Edition, and SocINDEX. A two-stage meta-analytic structural equation modeling method was implemented to pool correlation matrices from primary studies and perform confirmatory factor analyses. Following model selection, factor scores were computed for two datasets and subjected to correlation and diagnostic accuracy analyses. A pooled correlation matrix was computed from 24 sample correlation matrices (N = 5299). Confirmatory factor analysis revealed that the theoretical five-factor model produced the best fit but only when error terms between Story Memory and Story Recall as well as between Figure Copy and Figure Recall were included. Regression-based factor scores showed mixed relationships with the manual-defined indices, and the overall diagnostic accuracy of the factor scores was adequate in both samples examined (AUC = 0.71 and 0.87). The five-factor model was an unexpected result given the failure of multiple previous studies to find support for that model. The five-factor model demonstrates several areas of potential improvement, including better representation of the factors by the indicators. The factor scores implied by this model also require further validation.