Validation of the structured interview section of the penn computerized adaptive test for neurocognitive and clinical psychopathology assessment (CAT GOASSESS)

Large-scale studies and burdened clinical settings require precise, efficient measures that assess multiple domains of psychopathology. Computerized adaptive tests (CATs) can reduce administration time without compromising data quality. We examined feasibility and validity of an adaptive psychopathology measure, GOASSESS, in a clinical community-based sample (N = 315; ages 18-35) comprising three groups: healthy controls, psychosis, mood/anxiety disorders. Assessment duration was compared between the Full and CAT GOASSESS. External validity was tested by comparing how the CAT and Full versions related to demographic variables, study group, and socioeconomic status. The relationships between scale scores and criteria were statistically compared within a mixed-model framework to account for dependency between relationships. Convergent validity was assessed by comparing scores of the CAT and the Full GOASSESS using Pearson correlations. The CAT GOASSESS reduced interview duration by more than 90 % across study groups and preserved relationships to external criteria and demographic variables as the Full GOASSESS. All CAT GOASSESS scales could replace those of the Full instrument. Overall, the CAT GOASSESS showed acceptable psychometric properties and demonstrated feasibility by markedly reducing assessment time compared to the Full GOASSESS. The adaptive version could be used in large-scale studies or clinical settings for intake screening.

Validation of the cognitive section of the Penn computerized adaptive test for neurocognitive and clinical psychopathology assessment (CAT-CCNB)

BACKGROUND

The Penn Computerized Neurocognitive Battery is an efficient tool for assessing brain-behavior domains, and its efficiency was augmented via computerized adaptive testing (CAT). This battery requires validation in a separate sample to establish psychometric properties.

METHODS

In a mixed community/clinical sample of N = 307 18-to-35-year-olds, we tested the relationships of the CAT tests with the full-form tests. We compared discriminability among recruitment groups (psychosis, mood, control) and examined how their scores relate to demographics. CAT-Full relationships were evaluated based on a minimum inter-test correlation of 0.70 or an inter-test correlation within at least 0.10 of the full-form correlation with a previous administration of the full battery. Differences in criterion relationships were tested via mixed models.

RESULTS

Most tests (15/17) met the minimum criteria for replacing the full-form with the updated CAT version (mean r = 0.67; range = 0.53-0.80) when compared to relationships of the full-forms with previous administrations of the full-forms (mean r = 0.68; range = 0.50-0.85). Most (16/17) CAT-based relationships with diagnostics and other validity criteria were indistinguishable (interaction p > 0.05) from their full-form counterparts.

CONCLUSIONS

The updated CNB shows psychometric properties acceptable for research. The full-forms of some tests should be retained due to insufficient time savings to justify the loss in precision.

Construction of a computerized adaptive test (CAT-CCNB) for efficient neurocognitive and clinical psychopathology assessment

BACKGROUND

Traditional paper-and-pencil neurocognitive evaluations and semi-structured mental health interviews can take hours to administer and score. Computerized assessment has decreased that burden substantially, and contemporary psychometric tools such as item response theory and computerized adaptive testing (CAT) allow even further abbreviation.

NEW METHOD

The goal of this paper was to describe the application of CAT and related methods to the Penn Computerized Neurocognitive Battery (CNB) and a well-validated clinical assessment in order to increase efficiency in assessment and relevant domain coverage. To calibrate item banks for CAT, N = 5053 participants (63% female; mean age 45 years, range 18-80) were collected from across the United States via crowdsourcing, providing item parameters that were then linked to larger item banks and used in individual test construction. Tests not amenable to CAT were abbreviated using complementary short-form methods.

RESULTS

The final "CAT-CCNB" battery comprised 21 cognitive tests (compared to 14 in the original) and five adaptive clinical scales (compared to 16 in the original).

COMPARISON WITH EXISTING METHODS

This new battery, derived with contemporary psychometric approaches, provides further improvements over existing assessments that use collections of fixed-length tests developed for stand-alone administration. The CAT-CCNB provides an improved version of the CNB that shows promise as a maximally efficient tool for neuropsychiatric assessment.

CONCLUSIONS

We anticipate CAT-CCNB will help satisfy the clear need for broad yet efficient measurement of cognitive and clinical domains, facilitating implementation of large-scale, "big science" approaches to data collection, and potential widespread clinical implementation.

Development of Network Topology and Functional Connectivity of the Prefrontal Cortex

The prefrontal cortex (PFC) comprises distinct regions and networks that vary in their trajectories across development. Further understanding these diverging trajectories may elucidate the neural mechanisms by which distinct PFC regions contribute to cognitive maturity. In particular, it remains unclear whether PFC regions of distinct network affiliations differ in topology and their relationship to cognition. We examined 615 individuals (8–21 years) to characterize age-related effects in participation coefficient of 28 PFC regions of distinct networks, evaluating connectivity profiles of each region to understand patterns influencing topological maturity. Findings revealed that PFC regions of attention, frontoparietal, and default mode networks (DMN) displayed varying rates of decline in participation coefficient with age, characterized by stronger connectivity with each PFC’s respective network; suggesting that PFC regions largely aid network segregation. Conversely, PFC regions of the cinguloopercular/salience network increased in participation coefficient with age, marked by stronger between-network connections, suggesting that some PFC regions feature a distinctive ability to facilitate network integration. PFC topology of the DMN, in particular, predicted improvements in global cognition, including motor speed and higher order abilities. Together, these findings elucidate systematic differences in topology across PFC regions of different network affiliation, representing important neural signatures of typical brain development.

Spatial and Temporal Organization of the Individual Human Cerebellum

The cerebellum contains the majority of neurons in the human brain and is unique for its uniform cytoarchitecture, absence of aerobic glycolysis, and role in adaptive plasticity. Despite anatomical and physiological differences between the cerebellum and cerebral cortex, group-average functional connectivity studies have identified networks related to specific functions in both structures. Recently, precision functional mapping of individuals revealed that functional networks in the cerebral cortex exhibit measurable individual specificity. Using the highly sampled Midnight Scan Club (MSC) dataset, we found the cerebellum contains reliable, individual-specific network organization that is significantly more variable than the cerebral cortex. The frontoparietal network, thought to support adaptive control, was the only network overrepresented in the cerebellum compared to the cerebral cortex (2.3-fold). Temporally, all cerebellar resting state signals lagged behind the cerebral cortex (125-380 ms), supporting the hypothesis that the cerebellum engages in a domain-general function in the adaptive control of all cortical processes.

Brain Volume, Connectivity, and Neuropsychological Performance in Mild Traumatic Brain Injury: The Impact of Post-Traumatic Stress Disorder Symptoms

Post-traumatic stress disorder (PTSD) is commonly associated with mild traumatic brain injury (mTBI). To better understand their relationship, we examined neuroanatomical structures and neuropsychological performance in a sample of individuals with mTBI, with and without PTSD symptoms. Thirty-nine subjects with mTBI were dichotomized into those with (n = 12) and without (n = 27) significant PTSD symptoms based on scores on the PTSD Checklist. Using a region-of-interest approach, fronto-temporal volumes, fiber bundles obtained by diffusion tensor imaging, and neuropsychological scores were compared between the two groups. After controlling for total intracranial volume and age, subjects with mTBI and PTSD symptoms exhibited volumetric differences in the entorhinal cortex, an area associated with memory networks, relative to mTBI-only patients (F = 4.28; p = 0.046). Additionally, subjects with PTSD symptoms showed reduced white matter integrity in the right cingulum bundle (axial diffusivity, F = 6.04; p = 0.020). Accompanying these structural alterations, mTBI and PTSD subjects also showed impaired performance in encoding (F = 5.98; p = 0.019) and retrieval (F = 7.32; p = 0.010) phases of list learning and in tests of processing speed (Wechsler Adult Intelligence Scale Processing Speed Index, F = 12.23; p = 0.001; Trail Making Test A, F = 5.56; p = 0.024). Increased volume and white matter disruptions in these areas, commonly associated with memory functions, may be related to functional disturbances during cognitively demanding tasks. Differences in brain volume and white matter integrity between mTBI subjects and those with mTBI and co-morbid PTSD symptoms point to neuroanatomical differences that may underlie poorer recovery of mTBI subjects who experience PTSD symptoms. These findings support theoretical models of PTSD and its relationship to learning deficits.

Quantitative morphology of the corpus callosum in obsessive-compulsive disorder

Neuroimaging studies have implicated the corpus callosum (CC) in the pathophysiology of obsessive-compulsive disorder (OCD). Putative dysfunctions in prefrontal cortical regions suggest anomalies in anterior segments of the CC. However, recent studies have also implicated the middle and posterior CC. The present study soughts to examine the CC using parcellation scheme informed by diffusion tensor imaging. Anatomic brain magnetic resonance scans were obtained from 21 OCD subjects (mean age=26.9 ± 9.93) and 42 healthy age- and sex-matched controls (mean age=26.6 ± 9.46) between the ages of 14 and 49. Area and volume measures of five subregions of the CC were obtained via manual tracings. A multivariate analysis of variance (after correcting for multiple comparisons) identified smaller area and volume in the mid-anterior region of the CC in OCD patients relative to controls. These findings implicate medio-frontal regions of the cortex in the pathophysiology of OCD.

Dosage effects of X and Y chromosomes on language and social functioning in children with supernumerary sex chromosome aneuploidies: implications for idiopathic language impairment and autism spectrum disorders

BACKGROUND

 Supernumerary sex chromosome aneuploidies (X/Y-aneuploidies), the presence of extra X and/or Y chromosomes, are associated with heightened rates of language impairments and social difficulties. However, no single study has examined different language domains and social functioning in the same sample of children with tri-, tetra-, and pentasomy X/Y-aneuploidy. The current research sought to fill this gap in the literature and to examine dosage effects of X and Y chromosomes on language and social functioning.

METHODS

Participants included 110 youth with X/Y-aneuploidies (32 female) and 52 with typical development (25 female) matched on age (mean ∼12 years; range 4-22) and maternal education. Participants completed the Wechsler intelligence scales, and parents completed the children's communication checklist-2 and the social responsiveness scale to assess language skills and autistic traits, respectively.

RESULTS

Both supernumerary X and Y chromosomes were related to depressed structural and pragmatic language skills and increased autistic traits. The addition of a Y chromosome had a disproportionately greater impact on pragmatic language; the addition of one or more X chromosomes had a disproportionately greater impact on structural language.

CONCLUSIONS

Given that we link extra X chromosomes with structural language impairments and an extra Y chromosome with pragmatic language impairments, X/Y-aneuploidies may provide clues to genetic mechanisms contributing to idiopathic language impairment and autism spectrum disorders.