Development, Administration, and Structural Validity of a Brief, Computerized Neurocognitive Battery: Results From the Army Study to Assess Risk and Resilience in Servicemembers

The Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS) is a research project aimed at identifying risk and protective factors for suicide and related mental health outcomes among Army Soldiers. The New Soldier Study component of Army STARRS included the assessment of a range of cognitive- and emotion-processing domains linked to brain systems related to suicidal behavior including posttraumatic stress disorder, mood disorders, substance use disorders, and impulsivity. We describe the design and application of the Army STARRS neurocognitive test battery to a sample of 56,824 soldiers. We investigate its structural and concurrent validity through factor analysis and correlation of scores with demographics. We conclude that, in addition to being composed of previously well-validated measures, the Army STARRS neurocognitive battery as a whole demonstrates good psychometric properties. Correlations of scores with age and sex differences mostly replicate previously published findings, highlighting moderate to large effect sizes even within this restricted age range. Factor structures of scores conform to theoretical expectations. This neurocognitive battery provides a brief, valid measurement of neurocognition that may be helpful in predicting mental health and military performance. These measures can be integrated with neuroimaging to offer a powerful tool for assessing neurocognition in Servicemembers.

Development of an itemwise efficiency scoring method: Concurrent, convergent, discriminant, and neuroimaging-based predictive validity assessed in a large community sample

Traditional "paper-and-pencil" testing is imprecise in measuring speed and hence limited in assessing performance efficiency, but computerized testing permits precision in measuring itemwise response time. We present a method of scoring performance efficiency (combining information from accuracy and speed) at the item level. Using a community sample of 9,498 youths age 8-21, we calculated item-level efficiency scores on 4 neurocognitive tests, and compared the concurrent, convergent, discriminant, and predictive validity of these scores with simple averaging of standardized speed and accuracy-summed scores. Concurrent validity was measured by the scores' abilities to distinguish men from women and their correlations with age; convergent and discriminant validity were measured by correlations with other scores inside and outside of their neurocognitive domains; predictive validity was measured by correlations with brain volume in regions associated with the specific neurocognitive abilities. Results provide support for the ability of itemwise efficiency scoring to detect signals as strong as those detected by standard efficiency scoring methods. We find no evidence of superior validity of the itemwise scores over traditional scores, but point out several advantages of the former. The itemwise efficiency scoring method shows promise as an alternative to standard efficiency scoring methods, with overall moderate support from tests of 4 different types of validity. This method allows the use of existing item analysis methods and provides the convenient ability to adjust the overall emphasis of accuracy versus speed in the efficiency score, thus adjusting the scoring to the real-world demands the test is aiming to fulfill. (PsycINFO Database Record

Impact of psychiatric comorbidity and cognitive deficit on function in 22q11.2 deletion syndrome

OBJECTIVE

Presence of psychiatric comorbidity is associated with poor functioning and is an important consideration in treatment. Many individuals with 22q11.2 deletion syndrome (22q11DS) develop comorbid psychiatric disorders, yet its pattern and impact on functioning have not been formally investigated. In this cross-sectional study, we examined the relationship between comorbid psychopathology and neurocognitive deficits and their association with global functioning. We hypothesized that higher psychiatric burden and psychosis-spectrum features would be associated with reduced functioning and increased neurocognitive deficits.

METHOD

The cohort included 171 individuals with 22q11DS and mean (SD) age of 17.4 (8.1) years, recruited from a tertiary children's hospital and nationally through social media between September 2010 and December 2013. Psychiatric diagnoses and functioning were assessed using semistructured interviews and the Global Assessment of Functioning (GAF) scale, respectively. On the basis of psychopathology and number of comorbid diagnoses, participants were assigned to unaffected (n = 32), nonpsychosis spectrum (n = 24), nonpsychosis spectrum-plus (n = 15), psychosis spectrum (n = 29), and psychosis spectrum-plus (n = 71) groups. Executive function, episodic memory, complex cognition, social cognition, and praxis speed were assessed using a computerized neurocognitive battery (CNB). Cognitive profile and GAF scores were compared among the groups, and the association of GAF with cognitive performance and psychopathology was examined.

RESULTS

We observed high rates of comorbid psychiatric disorders. Approximately 50% of the participants had ≥ 2 diagnoses. Psychosis spectrum disorders were most frequently comorbid with other disorders. GAF score was progressively worse with increased psychiatric burden. Mean (SD) GAF score for the unaffected group (81.1 [8.9]) was significantly different from those of nonpsychosis spectrum (68.6 [12.1]), nonpsychosis spectrum-plus (63.4 [8.8]), psychosis spectrum (58.7 [13.1]), or psychosis spectrum-plus (55.5 [13.3]) (P < .05) groups. All groups performed poorly and were comparable to each other on the CNB (P = .273). Notably, verbal memory (P = .003), spatial processing (P = .001), and parent education level (P < .001) were significantly associated with GAF.

CONCLUSIONS

Individuals with 22q11DS have high rates of comorbid psychiatric disorders and diffuse cognitive deficits regardless of psychiatric burden. Those with psychotic spectrum disorders and comorbid psychiatric disorders are at an increased risk for poor overall functioning.

Development of an abbreviated form of the Penn Line Orientation Test using large samples and computerized adaptive test simulation

Visuospatial processing is a commonly assessed neurocognitive domain with deficits linked to dysfunction in right posterior regions of the brain. With the growth of large-scale clinical research studies, there is an increased need for efficient and scalable assessments of neurocognition, including visuospatial processing. The purpose of the current study was to use a novel method that combines item response theory (IRT) and computerized adaptive testing (CAT) approaches to create an abbreviated form of the computerized Penn Line Orientation Test (PLOT). The 24-item PLOT was administered to 8,498 youths (aged 8-21 years) as part of the Philadelphia Neurodevelopmental Cohort study and, by Web-based data collection, in an independent sample of 4,593 adults from Great Britain as part of a TV documentary. IRT-based CAT simulations were used to select the best PLOT items for an abbreviated form by performing separate simulations in each group and choosing only items that were selected as useful (i.e., high item discrimination and in the appropriate difficulty range) in at least 1 of the simulations. Fifteen items were chosen for the final, short form of the PLOT, indicating substantial agreement among the models in how they evaluated each item's usefulness. Moreover, this abbreviated version performed comparably to the full version in tests of sensitivity to age and sex effects. This abbreviated version of the PLOT cuts administration time by 50% without detectable loss of information, which points to its feasibility for large-scale clinical and genomic studies.

Neurocognitive growth charting in psychosis spectrum youths

IMPORTANCE

Psychosis-risk studies have examined help-seeking adolescents and young adults. Population-based studies evaluating psychotic symptoms and neurocognitive performance across childhood are needed for "growth charting" cognitive development. We hypothesized that psychosis spectrum youths have delayed neurocognitive age relative to chronological age. We expected larger lags with increased symptom severity and in late adolescence and early adulthood.

OBJECTIVES

To examine neurocognitive age and compare typically developing participants with psychosis spectrum participants.

DESIGN, SETTING, AND PARTICIPANTS

The Philadelphia Neurodevelopmental Cohort is a genotyped sample, with electronic medical records, enrolled in the study of brain behavior. In an academic and children's hospital health care network, a structured psychiatric evaluation was performed and a computerized neurocognitive battery administered to evaluate performance in several domains. From 18,344 youths in the recruitment pool who were aged 8 to 21 years, physically and cognitively capable of participating, and proficient in English, participants were randomly selected with stratification for age, sex, and ethnicity. A total of 9138 participants were enrolled in the study between November 1, 2009, and November 30, 2011, and 2321 endorsed psychotic symptoms: 1423 significant (psychosis spectrum) and 898 limited (psychosis limited). They had no comorbid medical conditions. They were compared with 981 participants endorsing significant other psychiatric symptoms and with 1963 typically developing children with no psychiatric or medical disorders.

MAIN OUTCOMES AND MEASURES

The computerized neurocognitive battery provides accuracy and speed measures on 12 tests and speed measures alone on 2, yielding 26 measures used in a regression analysis to predict chronological age. Prediction was performed on the entire set and separately for each domain (executive, episodic memory, complex cognition, social cognition, and sensorimotor speed).

RESULTS

Throughout childhood and adolescence, the psychosis spectrum group had lower predicted age compared with the typically developing group and the group with other psychiatric symptoms. The psychosis spectrum group had a greater developmental lag than the psychosis limited group. The lags were most pronounced for complex cognition and social cognition and were smallest for sensorimotor speed.

CONCLUSIONS AND RELEVANCE

Individuals who endorse psychotic symptoms are neurocognitively delayed across the age range; this delay relates to symptom severity and is not prominent in other psychiatric disorders. Combined clinical and neurocognitive assessment can facilitate early detection and targeted intervention to delay or ameliorate disease progression.