Using the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with traumatic brain injury

Degenerative cervical myelopathy: establishing severity thresholds for neuromotor dysfunction in the aging spine using the NIH Toolbox Assessment Scale

Degenerative cervical myelopathy (DCM) is a leading cause of age-related non-traumatic spinal cord disorders resulting from chronic degeneration of the cervical spine. While traditional clinical assessments rely on patient-reported measures, this study used the NIH Toolbox Motor Battery (NIHTBm) as an objective, quantitative measure to determine DCM severity. The objective is to define NIHTBm cutoff values that can accurately classify the severity of DCM neuromotor dysfunction. A case-controlled pilot study of patients with DCM and age-matched controls. The focus was an in-depth quantitative motor assessment using the NIHTBm to understand the severity of neuromotor deficits due to degenerative spine disease. Motor assessments, dexterity, grip strength, balance, and gait speed were measured in 45 DCM patients and 37 age-matched healthy subjects (HC). Receiver operating curve (ROC) analysis determined cutoff values for mild and moderate-to-severe myelopathy which were validated by comparing motor assessment scores with disability scores. The ROC curves identified thresholds for mild dexterity impairment (T-score range 38.4 - 33.5, AUC 0.77), moderate-to-severe dexterity impairment (< 33.5, AUC 0.70), mild grip strength impairment (47.4 - 32.0, AUC 0.80), moderate-to-severe grip strength impairment (< 32.0, AUC 0.75), mild balance impairment (36.4 - 33.0, AUC 0.61), and moderate-to-severe balance impairment (< 33.0, AUC 0.78). Mild gait speed impairment was defined as 0.78-0.6 m/sec (AUC 0.65), while moderate-to-severe gait speed impairment was < 0.6 m/sec (AUC 0.65). The NIHTB motor score cutoff points correlated negatively with the DCM neck disability index (NDI) and showed balance and dexterity measures as independent indicators of DCM dysfunction. The use of NIHTB allows for precise delineation of DCM severity by establishing cutoff values corresponding to mild and moderate-to-severe myelopathy. The use of NIHTB in DCM allows enhanced clinical precision, enabling clinicians to better pinpoint specific motor deficits in DCM and other neurological disorders with motor deficits, including stroke and traumatic brain injury (TBI). Furthermore, the utility of objective assessment, NIHTB, allows us to gain a better understanding of the heterogeneity of DCM, which will enhance treatment strategies. This study serves as a foundation for future research to facilitate the discovery of innovative treatment strategies for DCM and other neurological conditions.

Test-Retest Reliability and Reliable Change on the NIH Toolbox Cognition Battery

OBJECTIVE

Researchers and practitioners can detect cognitive improvement or decline within a single examinee by applying a reliable change methodology. This study examined reliable change through test-retest data from the English-language National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) normative sample.

METHOD

Participants included adults (n = 138; age: M ± SD = 54.8 ± 20.0, range: 18-85; 51.4% men; 68.1% White) who completed test-retest assessments about a week apart on five fluid cognition tests, providing raw scores, age-adjusted standard scores (SS), and demographic-adjusted T-scores (T).

RESULTS

The Fluid Cognition Composite (SS: ICC = 0.87; T-score: ICC = 0.84) and the five fluid cognition tests had good test-retest reliability (SS: ICC range = 0.66-0.85; T-score: ICC range = 0.64-0.86). The lower and upper bounds of 70%, 80%, and 90% confidence intervals (CIs) were calculated around change scores, which serve as cutoffs for determining reliable change. Using T-scores, 90% CI, and adjustment for practice effects, 32.3% declined on one or more tests, 9.7% declined on two or more tests, 36.6% improved on one or more tests, and 5.4% improved on two or more tests.

CONCLUSIONS

It was common for participants to show reliable change on at least one test score, but not two or more test scores. Per an 80% CI, test-retest difference scores beyond these cutoffs would indicate reliable change: Dimensional Change Card Sort (SS ≥ 14/T ≥ 10), Flanker (SS ≥ 12/T ≥ 8), List Sorting (SS ≥ 14/T ≥ 10), Picture Sequence Memory (SS ≥ 19/T ≥ 13), Pattern Comparison (SS ≥ 11/T ≥ 8), and Fluid Cognition Composite (SS ≥ 10/T ≥ 7). The reliable change cutoffs could be applied in research or practice to detect within-person change in fluid cognition at the individual level.

Performance Validity Testing on the NIH Toolbox Cognition Battery: Base Rates of Failed Embedded Validity Indicators in the Adult Normative Sample

OBJECTIVE

The goal of this study was to determine the base rates of failing proposed embedded validity indicators (EVIs) for the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) in the normative sample.

METHOD

Participants included adults in the NIHTB-CB normative sample with data to calculate age-adjusted standard scores (n = 855; ages: M(SD) = 46.9(17.3), range: 18-85; 65.0% women; education: M(SD) = 14.1(2.5) years) or demographically adjusted T-scores (n = 803; ages: M(SD) = 47.3(17.3), range: 18-85; 65.3% women; education: M(SD) = 14.2(2.5) years) for all tests. The NIHTB-CB includes two tests of crystallized cognition and five tests of fluid cognition. Individual norm-referenced test performances were categorized as falling above or below liberal and conservative cutoffs based on proposed univariate EVIs. The number of univariate EVI failures was summed to compute multivariable EVIs. EVI failure rates above 10% were considered high false-positive rates, indicating specificity < .90. Using chi-square analyses, the frequencies of EVI failures were compared based on gender, race/ethnicity, education, and crystallized composite.

RESULTS

The multivariable EVIs had predominantly low false-positive rates in the normative sample. EVI failure rates were most common among participants with low crystallized composites. Using age-adjusted standard scores, EVI failure rates varied by education, race/ethnicity, and estimated premorbid intelligence. These differences were mostly eliminated when using demographically adjusted T-scores.

CONCLUSIONS

Multivariable EVIs requiring ≥ 4 failures using liberal cutoffs or ≥ 3 failures using conservative cutoffs had acceptable false-positive rates (i.e., < 10%) using both age-adjusted standard scores and demographically adjusted T-scores. These multivariable EVIs could be applied to large data sets with NIHTB-CB data to screen for potentially invalid test performances.

Minimal Detectable Change for the ImPACT Subtests at Baseline

OBJECTIVE

To establish the minimal detectable change (MDC) of the subtests that comprise the composite scores from remotely administered Immediate Post-Concussion Assessment and Cognitive Testing (ImPACT) baselines.

METHOD

Remote ImPACT baseline data from 172 (male = 45, female = 127) National Collegiate Athletic Association Division I student-athletes from the 2020 and 2021 athletic preseasons were used to calculate the MDC at the 95%, 90%, and 80% confidence intervals (CIs) for all subtest scores used to generate the four core composite scores and the impulse control composite.

RESULTS

The MDCs for the verbal memory subtests at the 95% CI were 10.31 for word memory percent correct, 4.68 for symbol match total correct hidden, and 18.25 for three letters percentage correct. Visual memory subtest MDCs were 19.03 for design memory total percent correct and 4.90 for XO total correct memory. Visual motor speed subtest MDCs were 18.89 for XO total correct interference and 5.40 for three letters average counted correctly. Reaction time (RT) MDCs were 0.12 for XO average correct, 0.95 for symbol match average correct RT, and 0.28 for color match average correct. Impulse control MDCs were 5.97 for XO total incorrect and 1.15 for color match total commissions. One-way repeated measures MANOVA, repeated measures ANOVAs, and Wilcoxon signed-ranks test all suggested no significant difference between any subtests across two remote ImPACT baselines.

CONCLUSIONS

The ImPACT subtest scores did not significantly change between athletic seasons. Our study suggests the subtests be evaluated in conjunction with the composite scores to provide additional metrics for clinical interpretation.

Household Food Insecurity and Cognition in Youth and Young Adults with Youth-Onset Diabetes

Objective

We evaluated the association of household food insecurity (FI) with cognition in youth and young adults with type 1 diabetes (T1D) or type 2 diabetes (T2D).

Design

In this cross-sectional study, age-adjusted scores for composite Fluid Cognition, and sub-domain scores for Receptive Language and Inhibitory Control and Attention, were modeled stratified by diabetes-type using linear regression, with FI in the past year as the predictor, controlling for covariates. Tests for processing speed, inhibitory control/attention, working memory, episodic memory, and cognitive flexibility were administered to measure composite Fluid Cognition score. The NIHT-CB Picture Vocabulary Test was used to assess Crystallized Cognition score and rapid identification of congruent versus noncongruent items were used to assess Inhibitory Control and Attention score.

Setting

The SEARCH for Diabetes in Youth study, representative of 5 U.S. states.

Participants

Included 1574 youth and young adults with T1D or T2D, mean age of 21 years, mean diabetes duration of 11 years, 51% non-Hispanic white, and 47% had higher HbA1c levels (>9% HbA1c).

Results

Approximately 18% of the 1,240 participants with T1D and 31% of the 334 with T2D experienced FI. The food-insecure group with T1D had a lower composite Fluid Cognition score (β= -2.5, 95% confidence interval (CI)= -4.8, -0.1) and a lower Crystallized Cognition score (β= -3.4, CI= -5.6, -1.3) than food-secure peers. Findings were attenuated to non-significance after adjustment for demographics. Among T2D participants, no associations were observed. In participants with T1D effect modification by glycemic levels were found in the association between FI and composite Fluid Cognition score but adjustment for socioeconomic characteristics attenuated the interaction (p=0.0531).

Conclusions

Food-insecure youth and young adults with T1D or T2D did not have different cognition compared to those who were food-secure after adjustment for confounders. Longitudinal research is needed to further understand relations amongst these factors.

Suicidal thoughts and behaviours among military veterans: protocol for a prospective, observational, neuroimaging study

INTRODUCTION

This study's overarching goal is to examine the relationship between brain circuits and suicidal thoughts and behaviours (STBs) in a transdiagnostic sample of US military veterans. Because STBs have been linked with maladaptive decision-making and disorders linked to impulsivity, this investigation focuses on valence and inhibitory control circuits.

METHODS AND ANALYSIS

In this prospective, observational study, we will collect functional MRI (fMRI), cognitive and clinical data from 136 veterans (target sample size) recruited from the Providence VA Health System (PVAHS): 68 with STBs and 68 matched controls. Behavioural data will be collected using standardised measures of STBs, psychiatric symptoms, cognition, functioning and medical history. Neuroimaging data will include structural, task and resting fMRI. We will conduct follow-up interviews and assessments at 6, 12 and 24 months post-enrolment. Primary analyses will compare data from veterans with and without STBs and will also evaluate whether activation and connectivity within circuits of valence and inhibition covary with historical and prospective patterns of suicidal ideation and behaviour.

ETHICS AND DISSEMINATION

The PVAHS Institutional Review Board approved this study (2018-051). Written informed consent will be obtained from all participants. Findings from this study will be published in peer-reviewed journals and presented at local, regional, national and international conferences.Nauder Namaky, Ph.D.* nauder_namaky@brown.edu.

Hyperbaric Oxygen Therapy versus placebo for post-concussion syndrome (HOT-POCS): A randomized, double-blinded controlled pilot study

Post-Concussion Syndrome (PCS) refers to the persistence of physical, cognitive, and emotional symptoms following mild traumatic brain injury (mTBI)/concussion, occurring in roughly 15-30% of individuals. Hyperbaric oxygen therapy (HBOT) has been suggested as a potential treatment for PCS; however, the evidence to date is mixed due to inconsistencies in the treatment protocol and focus on veterans with combat-related injuries, which may not be generalizable to the general population. The goal of Hyperbaric Oxygen Therapy for Post-Concussion Syndrome (HOT-POCS) is to assess the efficacy and safety of HBOT for the treatment of PCS in the civilian population. This randomized, controlled pilot study will be using a standardized HBOT protocol (20 sessions of 100% O₂ at 2.0 atm absolute [ATA]) compared with a true placebo gas system that mimics the oxygen composition at room air (20 sessions of 10.5% O₂ and 89.5% nitrogen at 2.0 ATA) in a cohort of 100 adults with persistent post-concussive symptoms 3-12 months following injury. Change in symptoms on the Rivermead Post-concussion Questionnaire (RPQ) will be the primary outcome of interest. Secondary outcomes include the rate of adverse events, change in the quality of life, and change in cognitive function. Exploratory outcome measures will include changes in physical function and changes in cerebral brain perfusion and oxygen metabolism on MRI brain imaging. Overall, the HOT-POCS study will compare the efficacy of a standardized HBOT treatment protocol against a true placebo gas for the treatment of PCS within 12 months after injury.

Normative Reference Values for Crystallized-Fluid Discrepancy Scores for the NIH Toolbox Cognition Battery

INTRODUCTION

The purpose of this study was to translate NIH Toolbox Cognition Battery (NIHTB-CB) Crystallized-Fluid discrepancy scores into research and clinical practice with adults by providing normative data for discrepancy scores for both age-adjusted standard scores (SSs) and demographically adjusted T-scores.

METHOD

We included adult participants from the NIHTB-CB standardization sample who denied having neurodevelopmental, medical, psychiatric, or neurological conditions (n = 730; M = 47.4 years old, SD = 17.6, range: 18-85; 64.4% women; 63.1% White). Descriptive statistics were calculated for the Fluid and Crystallized composite scores and Crystallized-Fluid discrepancy score, along with correlations between the composite scores and reliability estimates of the discrepancy score. Percentiles were calculated for the discrepancy score, with stratifications by the gender, education, and Crystallized composite for the age-adjusted SSs and demographically adjusted T-scores (T).

RESULTS

Crystallized-Fluid discrepancy scores ranged from -40 to 44 (M = -0.63, SD = 14.89, Mdn = -1, interquartile range [IQR]: -11 to 10) for age-adjusted SSs and from -29 to 27 (M = -0.39, SD = 10.49, Mdn = -1, IQR = -8 to 7) for demographically adjusted T-scores. Crystallized-Fluid discrepancy scores of SS = 15 and T = 11 were at the 16th percentile (1 SD below the mean) and discrepancy scores of SS = 21 and T = 15 were at the 7th percentile (1.5 SD below the mean).

CONCLUSIONS

Crystallized-Fluid discrepancy scores may be, with future research, a useful within-person interpretive approach for detecting a decline from pre-injury or pre-disease levels of cognitive functioning. These normative reference values assist clinicians and researchers in determining the frequency at which given Crystallized-Fluid discrepancy scores occurred among healthy adults in the normative sample.

Subjective and objective assessments are associated for physical function but not cognitive function in community-dwelling stroke survivors

PURPOSE

To investigate the relation between subjectively and objectively assessed cognitive and physical functioning among community-dwelling stroke survivors, and to examine the association of stroke severity with subjectively and objectively assessed cognitive and physical impairments.

MATERIALS AND METHODS

Secondary data analysis was conducted with 127 community-dwelling stroke survivors. For cognitive functioning, objective measures included the NIH Toolbox Cognition Battery and the Executive Function Performance Test; subjective measures included the Quality of Life in Neurological Disorders Applied Cognition. Objective and subjective physical functioning was measured by the NIH Toolbox 2-Minute Walk Test and the Patient-Reported Outcomes Measurement Information System Physical Function, respectively.

RESULTS

A positive correlation was observed between subjective and objective physical functioning, whereas the correlation between subjective and objective cognitive functioning was nonsignificant. Stroke severity was associated with objective cognitive impairment and objective and subjective physical impairment, but not subjective cognitive impairment.

CONCLUSIONS

The lack of association between objective and subjective cognitive functioning challenges the conventional assumption that perceived functioning reflects actual performance. We recommend using both objective and subjective measures to accurately identify cognitive and physical impairment following stroke.Implications for RehabilitationSubjective cognitive functioning is not associated with objective cognitive functioning, suggesting that solely relying on stroke patients' reports is inadequate and may inaccurately estimate patients' actual deficits.Both objective and subjective measures should be used to accurately identify cognitive and physical impairment following stroke.Practitioners should be cognizant of stroke patients' behavioral signs associated with underlying cognitive problems that warrant further evaluation.

Neurocognitive monitoring in congenital central hypoventilation syndrome with the NIH Toolbox®

Congenital central hypoventilation syndrome (CCHS) is a rare neurocristopathy, caused by mutations in the paired-like homeobox gene PHOX2B, which alters control of breathing and autonomic nervous system regulation, necessitating artificial ventilation as life-support. A broad range of neurocognitive performance has been reported in CCHS, including an array of cognitive deficits. We administered the NIH Toolbox® Cognition Battery (NTCB), a novel technology comprised of seven tasks presented via an interactive computer tablet application, to a CCHS cohort and studied its convergent and divergent validity relative to traditional clinical neurocognitive measures. The NTCB was administered to 51 CCHS participants, including a subcohort of 24 who also received traditional clinical neurocognitive testing (Wechsler Intelligence Scales). Age-corrected NTCB scores from the overall sample and subcohort were compared to population norms. Associations between NTCB indices and Wechsler Intelligence scores were studied to determine the convergent and divergent validity of the NTCB. NTCB test results indicated reduced Fluid Cognition, which measures new learning and speeded information processing (p < 0.001), but intact Crystallized Cognition, which measures past learning, in CCHS relative to population norms. Moderate to strong associations (r > 0.60) were found between age-corrected NTCB Fluid and Crystallized indices and comparable Wechsler indices, supporting the convergent and discriminant validity of the NTCB. Results reveal deficits of Fluid Cognition in individuals with CCHS and indicate that the NTCB is a valid and sensitive measure of cognitive outcomes in this population. Our findings suggest that the NTCB may play a useful role in tracking neurocognition in CCHS.

Construct validity of the NIH toolbox cognitive domains: A comparison with conventional neuropsychological assessments

OBJECTIVE

Previous studies have assessed the construct validity of individual subtests in the National Institutes of Health (NIH) Toolbox Cognition Battery (NIHTB-CB), though none have examined the construct validity of the cognitive domains. Importantly, the original NIHTB-CB validation studies were administered on a desktop computer, though the NIHTB-CB is now solely administered via an iPad. We examined the construct validity of each cognitive domain assessed in the NIHTB-CB, including a motor dexterity domain using the iPad application compared to a neuropsychological battery in a sample of healthy adults.

METHOD

Eighty-three adults aged 20-66 years (M = 44.35 ± 13.41 years) completed the NIHTB-CB and a comprehensive neuropsychological assessment. Domain scores for each of six cognitive domains (attention and executive function, episodic memory, working memory, processing speed, language, and motor dexterity) and the fluid composite were computed for both batteries. We then assessed the construct validity using Pearson correlations and intraclass correlation coefficients (ICCs) for both demographically corrected and uncorrected domains.

RESULTS

We found the attention and executive function, episodic memory, and processing speed domains had poor-to-adequate construct validity (ICCConsistency = -0.029 to 0.517), the working memory and motor dexterity domains and the fluid composite had poor-to-good construct validity (ICCConsistency = 0.215-0.801), and the language domain had adequate-to-good construct validity (ICCConsistency = 0.408-0.829).

CONCLUSION

The NIHTB-CB cognitive domains have poor-to-good construct validity, thus researchers should be aware that some tests representing cognitive constructs may not fully reflect the cognitive domain of interest. Future investigation of the construct validity and reliability of the NIHTB-CB administered using the iPad is recommended. (PsycInfo Database Record (c) 2022 APA, all rights reserved).

Hippocampal and rostral anterior cingulate blood flow is associated with affective symptoms in chronic traumatic brain injury

OBJECTIVE

The purpose of this study was to assess cerebral blood flow (CBF) and its association with self-reported symptoms in chronic traumatic brain injury (TBI).

PARTICIPANTS

Sixteen participants with mild to severe TBI and persistent self-reported neurological symptoms, 6 to 72 months post-injury were included. For comparison, 16 age- and gender-matched healthy normal control participants were also included.

MAIN MEASURES

Regional CBF and brain volume were assessed using pseudo-continuous Arterial Spin Labeling (PCASL) and T₁-weighted data respectively. Cognitive function and self-reported symptoms were assessed in TBI participants using the national institutes of health (NIH) Toolbox Cognition Battery and Patient-Reported Outcome Measurement Information System respectively. Associations between CBF and cognitive function, symptoms were assessed.

RESULTS

Global CBF and regional brain volumes were similar between groups, but region of interest (ROI) analysis revealed lower CBF bilaterally in the thalamus, hippocampus, left caudate, and left amygdala in the TBI group. Voxel-wise analysis revealed that CBF in the hippocampus, parahippocampus, rostral anterior cingulate, inferior frontal gyrus, and other temporal regions were negatively associated with self-reported anger, anxiety, and depression symptoms. Furthermore, region of interest (ROI) analysis revealed that hippocampal and rostral anterior cingulate CBF were negatively associated with symptoms of fatigue, anxiety, depression, and sleep issues.

CONCLUSION

Regional CBF deficit was observed in the group with chronic TBI compared to the normal control (NC) group despite similar volume of cerebral structures. The observed negative correlation between regional CBF and affective symptoms suggests that CBF-targeted intervention may potentially improve affective symptoms and quality of life after TBI, which needs to be assessed in future studies.

Psychometric properties of the standardized assessment of concussion in youth football: Validity, reliability, and demographic factors

The objective of this study was to determine the psychometrics (reliability, validity) of the original Standardized Assessment of Concussion (SAC) in a youth sample (ages 11 to 13). Demographic factors of race, level of vocabulary knowledge, mother's level of education were also considered. Over 150 youth football athletes completed the SAC and a brief battery of NIH Toolbox cognitive tests as part of a larger study on biomechanical factors in youth sport concussion. This was a within-subjects design (pre-season, post-season assessments), and correlational analysis of convergent and discriminant validity. Between groups analysis based on demographic differences was also employed. The pre-season SAC scores were not different by age; however, SAC scores were statistically different by race: t(155) = 3.162, p = .002, d = .519. Maternal level of education and participant vocabulary scores were related to racial group membership. Convergent and discriminant validity were established compared to NIH Toolbox tests of memory and speed. Pre-post-season tests for 108 participants established marginally acceptable test-retest reliability (ICC = .692). These data support the use of the original SAC in youth football although clinicians must be aware of racial differences in scores.

Cognitive Outcomes in Children with Mild Traumatic Brain Injury: An Examination Using the National Institutes of Health Toolbox Cognition Battery

This study is the first to examine cognitive outcomes after pediatric mild TBI using the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB), a computerized cognitive test battery. The NIHTB-CB includes two complex measures of attention and executive function that allow differentiation of accuracy and response speed. We compared performance on the NIHTB-CB among children 8-16 years of age with mild TBI (n = 143) versus children with orthopedic injuries (OIs; n = 74) recruited in emergency departments and followed for 6 months post-injury. Mixed-model analyses showed that the mild TBI group showed significantly lower Fluid Cognition composite scores than the OI group at 10 days (group intercept, p = 0.018); the magnitude of group differences declined modestly over time (group × time interaction, p = 0.055). Effect sizes were d = 0.34 at 10 days post-injury, d = 0.27 at 3 months, and d = 0.10 at 6 months. No significant effects of group or time were found for the Crystallized Cognition composite. Analyses of Fluid Cognition subtests indicated that children with mild TBI displayed deficits for as long as 3 months on measures of attention and executive function (e.g., cognitive flexibility, inhibitory control), but not on measures of explicit memory, working memory, or processing speed. The poorer performance of the mild TBI group on measures of attention and executive function was attributable largely to slowed reaction time, not decreased accuracy. The findings suggest that children with mild TBI demonstrate persistent deficits in fluid cognition that are most apparent on tasks that combine demands for both speed and executive function.

Application of neuropsychology and imaging to brain injury and use of the integrative cognitive rehabilitation psychotherapy model

BACKGROUND

An early approach to cognitive rehabilitation therapy (CRT) was developed based on A. R. Luria's theory of brain function. Expanding upon this approach, the Integrative Cognitive Rehabilitation Psychotherapy model (ICRP) was advanced.

OBJECTIVE

To describe the ICRP approach to treatment of clients post brain injury and provide a comprehensive list of evaluation tools to determine the client's abilities and needs. Finally, to provide a link between CRT and functional imaging studies designed to improve rehabilitation efforts.

METHODS

History of cognitive rehabilitation and neuropsychological testing is reviewed and description of cognitive, academic, psychiatric, and substance abuse tools are provided. Cognitive and emotional treatment techniques are fully described. Additionally, a method of determining the client's stage of recovery and pertinent functional imaging studies is detailed.

RESULTS

Authors have been able to provide a set of tools and techniques to use in comprehensive treatment of clients with brain injury.

CONCLUSIONS

Inclusive treatment which is outlined in the ICRP model is optimal for the client's recovery and return to a full and satisfying life post brain injury. The model provides a framework for neuropsychologists to integrate issues that tend to co-occur in clients living with brain injury into a unified treatment plan.

Moving Toward Accurate Assessment of Working Memory in Adults With Neurogenically Based Communication Disorders

Purpose This article presents a viewpoint highlighting concerns regarding currently available assessments of working memory in adults with neurogenic communication disorders. Additionally, we provide recommendations for improving working memory assessment in this population. Method This viewpoint includes a critique of clinical and experimental working memory tests relevant to speech-language pathologists. We consider the terminology used to describe memory, as well as discuss language demands and test construction. Results Clinical and experimental testing of working memory in adults with neurogenic communication disorders is challenged due to theoretical, methodological, and practical limitations. The major limitations are characterized as linguistic and task demands, presentation and response modality effects, test administration, and scoring parameters. Taking these limitations into consideration, several modifications to working memory testing and their relevance to neurogenic populations are discussed. Conclusions The recommendations provided in this article can better guide clinicians and researchers to advocate for improved tests of working memory in adults with neurogenic communication disorders. Future research should continue to address these concerns and consider our recommendations.

Latent Factor Structure and Measurement Invariance of the NIH Toolbox Cognition Battery in an Alzheimer's Disease Research Sample

OBJECTIVE

This study investigated the latent factor structure of the NIH Toolbox Cognition Battery (NIHTB-CB) and its measurement invariance across clinical diagnosis and key demographic variables including sex, race/ethnicity, age, and education for a typical Alzheimer's disease (AD) research sample.

METHOD

The NIHTB-CB iPad English version, consisting of 7 tests, was administered to 411 participants aged 45-94 with clinical diagnosis of cognitively unimpaired, dementia, mild cognitive impairment (MCI), or impaired not MCI. The factor structure of the whole sample was first examined with exploratory factor analysis (EFA) and further refined using confirmatory factor analysis (CFA). Two groups were classified for each variable (diagnosis or demographic factors). The confirmed factor model was next tested for each group with CFA. If the factor structure was the same between the groups, measurement invariance was then tested using a hierarchical series of nested two-group CFA models.

RESULTS

A two-factor model capturing fluid cognition (executive function, processing speed, and memory) versus crystalized cognition (language) fit well for the whole sample and each group except for those with age < 65. This model generally had measurement invariance across sex, race/ethnicity, and education, and partial invariance across diagnosis. For individuals with age < 65, the language factor remained intact while the fluid cognition was separated into two factors: (1) executive function/processing speed and (2) memory.

CONCLUSIONS

The findings mostly supported the utility of the battery in AD research, yet revealed challenges in measuring memory for AD participants and longitudinal change in fluid cognition.

Neuropsychological Change After a Single Season of Head Impact Exposure in Youth Football

OBJECTIVES

Head impact exposure (HIE) in youth football is a public health concern. The objective of this study was to determine if one season of HIE in youth football was related to cognitive changes.

METHOD

Over 200 participants (ages 9-13) wore instrumented helmets for practices and games to measure the amount of HIE sustained over one season. Pre- and post-season neuropsychological tests were completed. Test score changes were calculated adjusting for practice effects and regression to the mean and used as the dependent variables. Regression models were calculated with HIE variables predicting neuropsychological test score changes.

RESULTS

For the full sample, a small effect was found with season average rotational values predicting changes in list-learning such that HIE was related to negative score change: standardized beta (β) = -.147, t(205) = -2.12, and p = .035. When analyzed by age clusters (9-10, 11-13) and adding participant weight to models, the R2 values increased. Splitting groups by weight (median split), found heavier members of the 9-10 cohort with significantly greater change than lighter members. Additionaly, significantly more participants had clinically meaningful negative changes: X2 = 10.343, p = .001.

CONCLUSION

These findings suggest that in the 9-10 age cluster, the average seasonal level of HIE had inverse, negative relationships with cognitive change over one season that was not found in the older group. The mediation effects of age and weight have not been explored previously and appear to contribute to the effects of HIE on cognition in youth football players.

Brief report: Evaluation of working memory deficits in children with ADHD using the NIH list sorting working memory task

Variability in working memory (WM) task selection likely contributes to heterogeneity in effect size estimates of deficiencies in youth with attention-deficit/hyperactivity disorder (ADHD). This has resulted in the development of brief, easy to administer assessments such as the NIH List Sorting Working Memory (LSWM) task from the NIH Cognitive Toolbox in hopes of standardizing measurement of this construct. Unfortunately, substantial questions persist regarding the specific constructs being evaluated by this task (e.g., visuospatial [VS] or phonological [PH] WM) as well as the ability of this task to detect WM deficits in previously identified impaired groups (e.g., ADHD). The current study examines the extent to which the LSWM task is associated with VS and PHWM performance as well as symptoms of ADHD. Additionally, we examined the magnitude of differences between ADHD and Typically Developing (TD) youth on this task relative to empirically derived WM tasks utilized in the past. Forty-six children (25 ADHD, 21 TD) completed multiple WM tasks. The LSWM task was moderately associated with PHWM and demonstrated relatively weaker associations with VSWM. Symptoms of inattention and hyperactivity/impulsivity were unrelated to the LSWM task; whereas tasks assessing PH and VSWM were moderately associated with inattention and weakly associated with hyperactivity (VSWM only). No significant between-group differences in performance emerged on the LSWM task; however, significant large-magnitude group differences were observed on both the PH and VSWM tasks. These findings suggest that the LSWM task may lack the ability to detect WM difficulties in youth with ADHD.

Neural and Genetic Bases for Human Ability Traits

The judgement of human ability is ubiquitous, from school admissions to job performance reviews. The exact make-up of ability traits, however, is often narrowly defined and lacks a comprehensive basis. We attempt to simplify the spectrum of human ability, similar to how five personality traits are widely believed to describe most personalities. Finding such a basis for human ability would be invaluable since neuropsychiatric disease diagnoses and symptom severity are commonly related to such differences in performance. Here, we identified four underlying ability traits within the National Institutes of Health Toolbox normative data (n = 1, 369): (1) Motor-endurance, (2) Emotional processing, (3) Executive and cognitive function, and (4) Social interaction. We used the Human Connectome Project young adult dataset (n = 778) to show that Motor-endurance and Executive and cognitive function were reliably associated with specific brain functional networks (r ² = 0.305 ± 0.021), and the biological nature of these ability traits was also shown by calculating their heritability (31 and 49%, respectively) from twin data.

A proof-of-concept trial of a community-based aerobic exercise program for individuals with traumatic brain injury

Objective: To assess the feasibility of conducting an aerobic exercise training study in a community setting for individuals with traumatic brain injury (TBI)Methods: This is a prospective, randomized, and controlled study. Nine participants (three moderate-to-severe and six mild TBI) were randomized to a community-based 3-month individualized aerobic exercise training program (AET). Seven participants (four moderate-to-severe, three mild TBI) were randomized to a stretching and toning program (SAT). Cardiorespiratory fitness (CRF) level was assessed with peak oxygen uptake (VO_2peak) testing.Results: After 3 months of training, the AET trended toward improved VO_2peak when compared with the SAT group (8% vs - 4%, p = .059) with a large effect size of 1.27. Only 50% of participants in the AET group completed more than 70% of the assigned exercise sessions. No adverse events were reported. Both the AET and SAT groups reported small improvements in self-reported mood symptoms, including depression, anxiety, and anger.Conclusions: It is feasible to conduct an exercise training study and improve CRF for persons with TBI in community settings with structured exercise protocols. However, exploring methods to enhance adherence is crucial for future exercise clinical trials to improve brain health in this population.

Obstructive Sleep Apnea Risk Is Associated with Cognitive Impairment after Controlling for Mild Traumatic Brain Injury History: A Chronic Effects of Neurotrauma Consortium Study

The contribution of sleep disturbance to persistent cognitive symptoms following a mild traumatic brain injury (mTBI) remains unclear. Obstructive sleep apnea (OSA) is very common, yet its relationship between risk factors for developing OSA and cognitive performance in those with history of mTBI has not been investigated. The current study examined OSA risk levels and its association with cognitive performance in 391 combat-exposed, post-911 veterans and service members (median age = 37 years) enrolled in the Chronic Effects of Neurotrauma Consortium (CENC) prospective multi-center study. Participants included those with and without mTBI (n = 326 and 65, respectively). When using clinical cut-offs, those with history of mTBI were more likely to be categorized as high risk for OSA (mTBI positive = 65% vs. mTBI negative = 51%). After adjustment for TBI status and demographic variables, increased OSA risk was significantly associated with worse performance on measures of complex processing speed and executive functioning (Wechsler Adult Intelligence Scale Fourth Edition Coding, Trail Making Test, part B) and greater symptom burden (Neurobehavioral Symptom Inventory). Thus, OSA, a modifiable behavioral health factor, likely contributes to cognitive performance following mTBI. Accordingly, OSA serves as a potential point of intervention to improve clinical and cognitive outcomes after injury.

Dynamic Changes in EEG Power Spectral Densities During NIH-Toolbox Flanker, Dimensional Change Card Sort Test and Episodic Memory Tests in Young Adults

Much is known about electroencephalograph (EEG) patterns during sleep, but until recently, it was difficult to study EEG patterns during conscious, awake behavior. Technological advances such as powerful wireless EEG systems have led to a renewed interest in EEG as a clinical and research tool for studying real-time changes in the brain. We report here the first normative study of EEG activity while healthy young adults completed a series of cognitive tests recently published by the National Institutes of Health Toolbox Cognitive Battery (NIH-TCB), a commonly-used standardized measure of cognition primarily used in clinical populations. In this preliminary study using a wireless EEG system, we examined power spectral density (PSD) in four EEG frequency bands. During baseline and cognitive testing, PSD activity for the lower frequency bands (theta and alpha) was greater, relative to the higher frequency bands (beta and gamma), suggesting participants were relaxed and mentally alert. Alpha, beta and gamma activity was increased during a memory test compared to two other, less demanding executive function tests. Gamma activity was also inversely correlated with performance on the memory test, consistent with the neural efficiency hypothesis which proposes that better cognitive performance may link with lower cortical energy consumption. In summary, our study suggests that cognitive performance is related to the dynamics of EEG activity in a normative young adult population.

Associations between NIH Toolbox Cognition Battery and in vivo brain amyloid and tau pathology in non-demented older adults

INTRODUCTION

The National Institutes of Health (NIH) Toolbox Cognition Battery (NIHTB-CB) was developed to be a common assessment metric across a broad array of research studies. We investigated associations between NIHTB-CB and brain amyloid and tau deposition in cognitively unimpaired older adults.

METHODS

One hundred eighteen community-based volunteers completed magnetic resonance imaging (MRI), Pittsburgh compound B (PiB)-PET (positron emission tomography) and AV-1451-PET neuroimaging, a neuropsychological evaluation, NIHTB-CB, and the Clinical Dementia Rating (CDR) scale. Demographically adjusted regression models evaluated cognition-biomarker associations; standardized effect sizes allowed comparison of association strength across measures.

RESULTS

No NIHTB-CB measures were associated with amyloid deposition. NIHTB-CB measures of fluid cognition, including Pattern Comparison Processing Speed, Dimensional Change Card Sort, and Fluid Cognition Composite, were associated with tau deposition in higher Braak regions. Pattern Comparison Processing Speed was the most robust association with sensitivity analyses.

DISCUSSION

NIHTB-CB tasks of processing speed and executive functions may be sensitive to pathologic tau deposition on imaging in normal aging.

Long-term impact of mild traumatic brain injury on postural stability and executive function

OBJECTIVE

A substantial number of individuals present with prolonged symptoms after a mild traumatic brain injury (mTBI) or concussion. This has warranted the development of assessment tools that can reliably detect prolonged symptoms after an mTBI. At present, a gold standard diagnostic tool for accurately identifying such prolonged symptoms is not available. The purpose of this study is to utilize specific measures of standing balance, cognitive function, and bimanual coordination to examine persisting long-term deficits in individuals with mTBI.

METHODS

A total of 18 (medically diagnosed with an mTBI within the last year) and 14 (healthy age-matched controls) individuals participated in the study. Assessment tools included NIH Toolbox Cognition Battery (NIHTB-CB), TEMPA, and Purdue pegboard (bimanual coordination) and standing balance on a force platform.

RESULTS

Individuals with mTBI demonstrated lower scores in all measures of cognition with statistically significant difference (p = 0.03) in executive function. The clinical tests of bimanual coordination did not show any statistically significant differences between groups. Postural stability was significantly reduced (p = 0.039) in the mTBI group.

CONCLUSION

Our results show long-term performance deficits (cognition and postural stability) that persist in individuals with mTBI. In addition, to the best of our knowledge, this is the first study to identify cognitive deficits in individuals with mTBI by utilizing NIHTB-CB. Knowledge gained from this study might affect decisions of return-to-play or return-to-learn in individuals with a history of mTBI(s).

A Review of the Role of Auditory Evoked Potentials in Mild Traumatic Brain Injury Assessment

Around 75% to 90% of people who experience a traumatic brain injury (TBI) are classified as having a mild TBI (mTBI). The term mTBI is synonymous with concussion or mild head injury (MHI) and is characterized by symptoms of headache, nausea, dizziness, and blurred vision. Problems in cognitive abilities such as deficits in memory, processing speed, executive functioning, and attention are also considered symptoms of mTBI. Since these symptoms are subtle in nature and may not appear immediately following the injury, mTBI is often undetected on conventional neuropsychological tests. Current neuroimaging techniques may not be sensitive enough in identifying the array of microscopic neuroanatomical and subtle neurophysiological changes following mTBI. To this end, electrophysiological tests, such as auditory evoked potentials (AEPs), can be used as sensitive tools in tracking physiological changes underlying physical and cognitive symptoms associated with mTBI. The purpose of this review article is to examine the body of literature describing the application of AEPs in the assessment of mTBI and to explore various parameters of AEPs which may hold diagnostic value in predicting positive rehabilitative outcomes for people with mTBI.

Psychometric Properties of the NIH Toolbox Cognition Battery in Healthy Older Adults: Reliability, Validity, and Agreement with Standard Neuropsychological Tests

OBJECTIVE

Few independent studies have examined the psychometric properties of the NIH Toolbox Cognition Battery (NIHTB-CB) in older adults, despite growing interest in its use for clinical purposes. In this paper we report the test-retest reliability and construct validity of the NIHTB-CB, as well as its agreement or concordance with traditional neuropsychological tests of the same construct to determine whether tests could be used interchangeably.

METHODS

Sixty-one cognitively healthy adults ages 60-80 completed "gold standard" (GS) neuropsychological tests, NIHTB-CB, and brain MRI. Test-retest reliability, convergent/discriminant validity, and agreement statistics were calculated using Pearson's correlations, concordance correlation coefficients (CCC), and root mean square deviations.

RESULTS

Test-retest reliability was acceptable (CCC = .73 Fluid; CCC = .85 Crystallized). The NIHTB-CB Fluid Composite correlated significantly with cerebral volumes (r's = |.35-.41|), and both composites correlated highly with their respective GS composites (r's = .58-.84), although this was more variable for individual tests. Absolute agreement was generally lower (CCC = .55 Fluid; CCC = .70 Crystallized) due to lower precision in fluid scores and systematic overestimation of crystallized composite scores on the NIHTB-CB.

CONCLUSIONS

These results support the reliability and validity of the NIHTB-CB in healthy older adults and suggest that the fluid composite tests are at least as sensitive as standard neuropsychological tests to medial temporal atrophy and ventricular expansion. However, the NIHTB-CB may generate different estimates of performance and should not be treated as interchangeable with established neuropsychological tests.

Comparability of iPad and Web-Based NIH Toolbox Cognitive Battery Administration in Veterans

OBJECTIVE

The purpose of this study was to evaluate the comparability of National Institutes of Health Toolbox Cognitive Battery test scores across iPad application and web-based personal computer administration platforms. Original test norms were developed using a personal computer-based administration and no previous studies assessing platform comparability have been published.

METHOD

Participants (N = 62; final analyzed sample n = 49) were combat-exposed post-deployment veterans without neurologic disorder, severe mental illness, current substance use disorder, or a history of moderate or severe traumatic brain injury. All participants completed both iPad and web-based versions of tests on the same day in an experimental within-subjects crossover design. Standalone validity measures were incorporated to exclude invalid performance. Outcome measures included the Dimensional Change Card Sort Test, Flanker Inhibitory Control and Attention Test, List Sorting Working Memory Test, and Pattern Comparison Processing Speed Test.

RESULTS

Score differences between platforms were found on the Flanker Inhibitory Control and Attention Test. Scores were moderately correlated across tests, with the exception of low correlations for the Pattern Comparison Processing Speed Test. Most participants preferred iPad to web administration, regardless of administration order.

CONCLUSIONS

Results suggest caution when interpreting iPad-acquired scores, particularly for the Flanker Inhibitory Control and Attention Test. iPad-based testing offers valuable improvements; however, the development of iPad-specific norms may be necessary to ensure valid interpretation of acquired data.

National Institutes of Health Toolbox Emotion Battery: Application of Summary Scores to Adults With Spinal Cord Injury, Traumatic Brain Injury, and Stroke

OBJECTIVE

To examine the validity of factor analytically based summary scores that were developed using the National Institutes of Health Toolbox Emotion Battery (NIHTB-EB); (ie, psychological well-being, social satisfaction, negative affect) normative sample in individuals with neurologic conditions.

DESIGN

Cross-sectional, observational cohort.

SETTING

Community.

PARTICIPANTS

A total of 1036 English-speaking adults from the National Institutes of Health Toolbox (NIHTB) normative project and 604 community-dwelling adults with neurologic conditions including spinal cord injury (SCI n=209), traumatic brain injury (TBI n=184), and stroke (cerebrovascular accident [CVA] n=211) (N=1640).

INTERVENTION

Not applicable.

MAIN OUTCOME MEASURES

The NIHTB-EB.

RESULTS

A series of univariate analyses comparing summary scores across the 4 groups (SCI, TBI, CVA, normative group) were conducted to identify group differences. Base rates (defined as >1 SD toward the problematic direction) were also identified. The normative group demonstrated better emotional functioning characterized by greater social satisfaction and psychological well-being (normative group > SCI, TBI, CVA; P's <.0001), and less negative affect (normative group < SCI, P=.016; normative group < TBI, P<.001; normative group < CVA; P=.034) compared with each neurologic group. Using base rates to identify problematic emotions for the 3 summary scores, there were higher rates of problematic emotions on all 3 summary scores for the neurologic groups compared with the normative group.

CONCLUSIONS

The NIHTB-EB summary scores demonstrate an increased prevalence of problematic emotions among individuals with 3 neurologic conditions, and might be useful for identifying individuals with similar conditions and potentially in need of psychological support.

Repetitive Transcranial Magnetic Stimulation with Resting-State Network Targeting for Treatment-Resistant Depression in Traumatic Brain Injury: A Randomized, Controlled, Double-Blinded Pilot Study

Repetitive transcranial magnetic stimulation (rTMS) has demonstrated antidepressant efficacy but has limited evidence in depression associated with traumatic brain injury (TBI). Here, we investigate the use of rTMS targeted with individualized resting-state network mapping (RSNM) of dorsal attention network (DAN) and default mode network (DMN) in subjects with treatment-resistant depression associated with concussive or moderate TBI. The planned sample size was 50 with first interim analysis planned at 20, but only 15 were enrolled before the study was terminated for logistical reasons. Subjects were randomized to 20 sessions of bilateral rTMS (4000 left-sided excitatory pulses, 1000 right-sided inhibitory pulses) or sham. Treatment was targeted to the dorsolateral prefrontal cluster with maximal difference between DAN and DMN correlations based on resting-state functional magnetic resonance imaging with individualized RSNM. Mean improvement in the primary outcome, Montgomery-Asberg Depression Rating Scale (MADRS), was 56% ± 14% (n = 9) with active treatment and 27% ± 25% (n = 5) with sham (Cohen's d = 1.43). One subject randomized to sham withdrew before starting treatment. There were no seizures or other significant adverse events. MADRS improvement was inversely correlated with functional connectivity between the right-sided stimulation site and the subgenual anterior cingulate cortex (sgACC; r = -0.68, 95% confidence interval 0.03-0.925). Active treatment led to increased sgACC-DMN connectivity (d = 1.55) and increased sgACC anti-correlation with the left- and right-sided stimulation sites (d = -1.26 and -0.69, respectively). This pilot study provides evidence that RSNM-targeted rTMS is feasible in TBI patients with depression. Given the dearth of existing evidence-based treatments for depression in this patient population, these preliminarily encouraging results indicate that larger controlled trials are warranted.

Utility of the NIH Toolbox for assessment of prodromal Alzheimer's disease and dementia

Introduction

The NIH Toolbox Cognition Battery (NIHTB-CB) is a computer-based protocol not yet validated for clinical assessment.

Methods

We administered the NIHTB-CB and traditional neuropsychological tests to 247 Memory Disorders and Alzheimer's Prevention Clinic patients with subjective cognitive decline, mild cognitive impairment, mild dementia due to Alzheimer's disease, and normal cognition. Principal component analysis, partial correlations, and univariate general linear model tests were performed to assess construct validity. Discriminant function analyses compared classification accuracy.

Results

Principal component analysis identified three conceptually coherent factors: memory (MEM_NIH), executive function (EF_NIH), and crystallized intelligence (CI_NIH). These factors were strongly associated with corresponding traditional tests and differed across diagnostic groups as expected. Both NIHTB and traditional batteries yielded strong overall discriminative ability (>80%).

Discussion

The NIHTB-CB is a valid method to assess neurocognitive domains pertinent to aging and dementia and has utility for applications in a memory clinic setting.

Nih toolbox premorbid ability adjustments: Application in a traumatic brain injury sample

PURPOSE/OBJECTIVE

Metrics to estimate premorbid cognitive ability, such as word reading tests, are important for clinical determination of cognitive changes following brain injury. In the present study, reading adjusted scores for the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) fluid tests were developed and validated with a sample of individuals with traumatic brain injury (TBI), to evaluate the clinical utility of reading-adjusted scores. Research Method/Design: The development sample included 843 adult participants, ages 20-85, from the NIHTB-CB standardization sample. A sample of 158 participants with complicated mild or moderate TBI (n = 74) or severe TBI (n = 84) were administered the NIHTB-CB, and comprised the validation sample. Scores were derived for the five fluid tests using four adjustment models: age-only, demographic-only, age-and-reading, and demographic-and-reading referenced scores.

RESULTS

Estimated premorbid ability varies depending on the reference model. Scores from each of the four reference models differentiated the comparison and TBI samples at the group level. However, performance varied by premorbid ability.

CONCLUSIONS/IMPLICATIONS

Premorbid ability affects identification of cognitive difficulties after TBI. Reading referenced scores provide an individualized estimate of the effects of premorbid ability than demographic characteristics alone. Each model identified a similar number of individuals as having cognitive difficulties; however, the models differed on which individuals had cognitive difficulties. The models had higher disagreement rates in the clinical compared with the comparison sample, particularly for individuals with lower premorbid ability. Clinical use and caveats are discussed. (PsycINFO Database Record

NIH toolbox cognition tests following traumatic brain injury: Frequency of low scores

PURPOSE/OBJECTIVE

To apply multivariate base rate analyses to the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) to facilitate the identification of cognitive impairment in individuals with traumatic brain injury (TBI). Research Method/Design: In a multisite cross-sectional design, 158 participants who sustained a complicated mild or moderate TBI (n = 74) or severe TBI (n = 84) at least 1 year earlier were administered the NIHTB-CB. The NIHTB-CB is comprised of 2 crystallized cognition tests (reflecting premorbid ability) and 5 fluid cognition tests, measuring processing speed, memory, and executive functioning. Base rates for obtaining 0 to 5 low fluid cognition scores were calculated across a range of cutoffs for defining a low test score (≤25th to 5th percentiles). Base rates of low scores in the TBI sample were compared to the NIHTB-CB normative sample using diagnostic accuracy statistics.

RESULTS

The proportion of the TBI sample obtaining low scores decreased as the cutoff for defining a low score decreased. Individuals with lower premorbid cognitive ability, as measured by NIHTB-CB Crystallized Composite score, tended to produce more low scores on the NIHTB-CB fluid cognition tests, even when using fully demographically adjusted scores. Certain patterns of low scores were associated with TBI (defined as likelihood ratio >2.0), whereas others were nonspecific, occurring almost as often in participants without TBI.

CONCLUSIONS/IMPLICATIONS

Premorbid ability stratified base rate tables provided in this article can guide researchers and clinicians in the interpretation of NIHTB-CB performance in adults with TBI. (PsycINFO Database Record

Test accommodations for individuals with neurological conditions completing the NIH Toolbox-Cognition Battery: An evaluation of frequency and appropriateness

OBJECTIVES

First, to evaluate the frequency with which individuals with neurological conditions require test administration accommodations for the NIH Toolbox-Cognition Battery (NIHTB-CB). Second, to evaluate the appropriateness of accommodations provided by administrators, including adherence to NIHTB-CB Reasonable Accommodations Guidelines.

METHOD

Adults with traumatic brain injury, spinal cord injury, or stroke (n = 604) completed the NIHTB-CB and other assessments as part of a multisite study. We provide a descriptive, secondary analysis of test administrator notes to determine use and appropriateness of accommodations.

RESULTS

Of the 604 participants, 450 (75%) completed the NIHTB-CB using standard administration procedures, but 137 (22.6%) encountered accessibility challenges that required accommodations. Participants with motor function impairments were most likely to receive at least 1 of 3 kinds of accommodations: (a) use of nonstandard methods of entering responses using standard input devices, (b) use of alternate input devices, or (c) help from the test administrator to enter a response. Fatigue and/or impulsivity led to nonstandard administration by 48 (7.9%) individuals. Post hoc audit of test administrator notes revealed that despite careful instructions and supervision, 49 (56.3%) of the accommodated administrations breached standardization and scores could not be interpreted using test norms.

CONCLUSION

Although the NIHTB-CB was developed for individuals without neurological impairment, most individuals with neurological conditions completed the standardized administration without accommodations. When accommodations were needed, administrators did not adhere to the official Reasonable Accommodations Guidelines in more than half of the cases. (PsycINFO Database Record

Motor-free composites from the National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) for people with disabilities

PURPOSE/OBJECTIVE

The National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) includes a group of brief measures (i.e., 30 min) designed to assess language, processing speed, working memory, episodic memory, and executive functioning. These subtests can be combined to create composite scores that reflect fluid and crystallized cognition, as well as overall cognition. The battery is of limited utility with individuals who have impaired upper extremity motor functioning. This manuscript examines the accuracy of the Oral Symbol Digit Modalities Test as a substitute for the Pattern Comparison Processing Speed Test for computing motor-free composite scores. Research Method/Design: Individuals with spinal cord injury (SCI; n = 188), traumatic brain injury (TBI; n = 159), or stroke (n = 180) completed the NIHTB-CB. We used the Oral Symbol Digit Modalities Test to create a Motor-Free Pattern Comparison score; this was used to create revised, Motor-Free Composite scores for Fluid Cognition and Overall Cognition.

RESULTS

Although there were statistically significant overall differences between the two Fluid and Overall Cognition composite scores for some of the clinical groups (scores based on the motor-free approach were significantly higher than the original score), these differences were small and partly because of overclassification of impaired processing speed in participants with motor impairment. There was good to substantial agreement with regard to "impairment" classification between the two sets of Original and Motor-Free composite scores.

CONCLUSIONS/IMPLICATIONS

Although the Motor-Free scores are not a perfect match for the Original Composite scores, they provide a reliable and valid way to examine overall and fluid cognition in individuals with upper extremity motor impairments. (PsycINFO Database Record

Factor structure of the NIH Toolbox Cognition Battery in individuals with acquired brain injury

OBJECTIVE

The National Institutes of Health Toolbox Cognition Battery (NIHTB-CB) measures reading, vocabulary, episodic memory, working memory, executive functioning, and processing speed. While previous research has validated the factor structure in healthy adults, the factor structure has not been examined in adults with neurological impairments. Thus, this study evaluated the NIHTB-CB factor structure in individuals with acquired brain injury.

METHOD

A sample of 392 individuals (ages 18-84) with acquired brain injury (n = 182 TBI, n = 210 stroke) completed the NIHTB-CB along with neuropsychological tests as part of a larger, multisite research project.

RESULTS

Confirmatory factor analyses supported a 5-factor solution that included reading, vocabulary, episodic memory, working memory, and processing speed/executive functioning. This structure generally held in TBI and stroke subsamples as well as in subsamples of those with severe TBI and stroke injuries.

CONCLUSIONS

The factor structure of the NIHTB-CB is similar in adults with acquired brain injury to adults from the general population. We discuss the implications of these findings for clinical practice and clinical research. (PsycINFO Database Record

The clinical utility and construct validity of the NIH Toolbox Cognition Battery (NIHTB-CB) in individuals with disabilities

A State-of-the-Science conference on measurement with disability populations recommended "...the development of cognitive and psychosocial outcome measures, using computer-adaptive testing...that are low in respondent burden and valid across patient populations," (Clohan et al., 2007, p. 1537). Following this recommendation, the National Institute on Disability, Independent Living, and Rehabilitation Research (NIDILRR) prioritized the development of measures of cognitive functioning for individuals with disabilities, noting that measures of cognitive functioning "have not been developed for systemic application in the field of medical rehabilitation. Cognition is both a rehabilitation outcome and a factor related to broader functional and community outcomes for individuals with a wide variety of disabling conditions" (Office of Special Education & Rehabilitation Services, 2009, p. 37193). From this came the NIH Toolbox for the Assessment of Neurological and Behavioral Function project (NIH Toolbox) which provides a comprehensive set of cognitive, motor, sensory, and emotional health and function measures for use in clinical, longitudinal, and epidemiological research. The nine papers comprising this special section of Rehabilitation Psychology reflect the sustained collaborative efforts of more than two dozen investigators working at six sites over the past 8 years. They are an initial attempt to validate the NIHTB-CB in disability samples, and they provide initial evidence that the NIHTB-CB can be used with individuals who have TBI, SCI, or stroke. The articles published here reflect the fulfillment of recommendations made during a state-of-the-science conference in 2007. (PsycINFO Database Record

Interpreting Patterns of Low Scores on the NIH Toolbox Cognition Battery

INTRODUCTION

The National Institutes of Health Toolbox for Assessment of Neurological and Behavioral Function Cognition Battery is comprised of seven cognitive tests, including two tests measuring crystallized cognitive ability (i.e., vocabulary and reading) and five tests measuring fluid cognitive functioning (i.e., working memory, memory, speed of processing, and executive functioning). This study presents comprehensive base rate tables for the frequency of low scores in adults and older adults from the normative sample.

METHODS

Participants were 843 adults, ages 20-85, from the NIH Toolbox standardization sample who completed all seven cognition tests. Rates of low scores were derived for standard age-adjusted and fully-demographically-adjusted scores at multiple cut-scores. Base rates were stratified by education, crystallized intellectual ability, and cognitive domain.

RESULTS

Using the five demographically-adjusted fluid cognitive test scores, 45.9% of adults obtained one or more scores at or below the 16th percentile, and 16.8% obtained one or more score at or below the 5th percentile, which is consistent with findings from other neurocognitive test batteries.

DISCUSSION

Based on the study findings, nearly 50% of adults in the general population would meet psychometric criteria for a diagnosis of the Diagnostic and Statistical Manual of Mental Disorders-Fifth Edition (DSM-5) Mild Neurocognitive Disorder (MND). We developed new psychometric criteria for identifying MND using the NIH Toolbox Cognition Battery that reduce the false positive rate. Knowing these multivariate normative base rates will help researchers and clinicians interpret NIH Toolbox scores in people with neurodevelopmental, psychiatric, medical, neurological, and neurodegenerative disorders that affect cognitive functioning.