Uses of the NIH Toolbox® in Clinical Samples: A Scoping Review

A clinical evaluation program to monitor neurocognitive risk in children and adolescents with sickle cell disease

Objective: Sickle cell disease (SCD) is an inherited hematologic disorder that impacts approximately 100,000 Americans. This disease is associated with progressive organ damage, cerebral vascular accident, and neurocognitive deficits. Recent guidelines from the American Society of Hematology (ASH) recommend cognitive screening with a psychologist to help manage cerebrovascular risk and cognitive impairment in this population. SCD patients benefit from neuropsychology services and several institutions already have programs in place to monitor cognitive risk. Program Description: We describe a longitudinal neurocognitive evaluation program at our institution that serves all patients with SCD, regardless of disease severity or referral question. The Sickle Cell Assessment of Neurocognitive Skills (SCANS) program was established in 2012. We outline the program's theoretical framework, timepoints for evaluation, test battery, logistics, patient demographics, integration with research programming, and multidisciplinary collaboration to support optimal outcomes. Program Outcomes: Our program has provided 716 targeted neuropsychological evaluations for patients over the last decade. Nearly 26% of patients in the program have been followed longitudinally. The most common diagnoses generated across cross-sectional and longitudinal evaluations include cognitive disorder (n = 191), attention-deficit/hyperactivity disorder (n = 75), and specific learning disorder (n = 75). Approximately 87% of patients who participated in SCANS during late adolescence successfully transitioned from pediatric to adult care. Conclusion: We discuss considerations for developing programming to meet the needs of this population, including tiered assessment models, timing of evaluations, scope, and reimbursement. Program models that utilize prevention-based tiered models or targeted evaluations can assist with serving large volumes of patients.

Measuring Cognitive Impairments Associated With Schizophrenia in Clinical Practice: Overview of Current Challenges and Future Opportunities

BACKGROUND

Cognitive impairment associated with schizophrenia (CIAS) negatively impacts daily functioning, quality of life, and recovery, yet effective pharmacotherapies and practical assessments for clinical practice are lacking. Despite the pivotal progress made with establishment of the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) Consensus Cognitive Battery (MCCB) for clinical research, implementation of the full MCCB is too time-consuming and cost-ineffective for most clinicians in clinical practice.

STUDY DESIGN

Here we discuss current assessments in relation to delivery format (interview-based and performance-based), validity, ease of use for clinicians and patients, reliability/reproducibility, cost-effectiveness, and suitability for clinical implementation. Key challenges and future opportunities for improving cognitive assessments are also presented.

STUDY RESULTS

Current assessments that require 30 min to complete would have value in clinical settings, but the associated staff training and time required might preclude their application in most clinical settings. Initial profiling of cognitive deficits may require about 30 min to assist in the selection of evidence-based treatments; follow-up monitoring with brief assessments (10-15 min in duration) to detect treatment-related effects on global cognition may complement this approach. Guidance on validated brief cognitive tests for the strategic monitoring of treatment effects on CIAS is necessary.

CONCLUSIONS

With increased advancements in technology-based and remote assessments, development of validated formats of remote and in-person assessment, and the necessary training models and infrastructure required for implementation, are likely to be of increasing clinical relevance for future clinical practice.

Measuring Multidimensional Aspects of Health in the Oldest Old Using the NIH Toolbox: Results From the ARMADA Study

OBJECTIVE

The percentage of older adults living into their 80s and beyond is expanding rapidly. Characterization of typical cognitive performance in this population is complicated by a dearth of normative data for the oldest old. Additionally, little attention has been paid to other aspects of health, such as motor, sensory, and emotional functioning, that may interact with cognitive changes to predict quality of life and well-being. The current study used the NIH Toolbox (NIHTB) to determine age group differences between persons aged 65-84 and 85+ with normal cognition.

METHOD

Participants were recruited in two age bands (i.e., 65-84 and 85+). All participants completed the NIHTB Cognition, Motor, Sensation, and Emotion modules. Independent-samples t-tests determined age group differences with post-hoc adjustments using Bonferroni corrections. All subtest and composite scores were then regressed on age and other demographic covariates.

RESULTS

The 65-84 group obtained significantly higher scores than the 85+ group across all cognitive measures except oral reading, all motor measures except gait speed, and all sensation measures except pain interference. Age remained a significant predictor after controlling for covariates. Age was not significantly associated with differences in emotion scores.

CONCLUSIONS

Results support the use of the NIHTB in persons over 85 with normal cognition. As expected, fluid reasoning abilities and certain motor and sensory functions decreased with age in the oldest old. Inclusion of motor and sensation batteries is warranted when studying trajectories of aging in the oldest old to allow for multidimensional characterization of health.

The protocol for an observational Australian cohort study of CADASIL: The AusCADASIL study

Introduction

Cerebral Autosomal Dominant Arteriopathy with Subcortical Infarcts and Leukoencephalopathy (CADASIL) is a rare genetic condition with a broad phenotypic presentation. This study aims to establish the first Australian cohort of individuals affected by CADASIL (AusCADASIL) and examine its clinical features and longitudinal course, and to investigate neuroimaging and blood biomarkers to assist in early diagnosis and identify disease progression.

Methods

Participants will be recruited from six study centres across Australia for an observational study of CADASIL. We aim to recruit 150 participants with diagnosed CADASIL, family history of CADASIL or suspected CADASIL symptoms, and 150 cognitively normal NOTCH3 negative individuals as controls. Participants will complete: 1) online questionnaires on medical and family history, mental health, and wellbeing; 2) neuropsychological evaluation; 3) neurological examination and brain MRI; 4) ocular examination and 5) blood sample donation. Participants will have annual follow-up for 4 years to assess their progression and will be asked to invite a study partner to corroborate their self-reported cognitive and functional abilities.Primary outcomes include cognitive function and neuroimaging abnormalities. Secondary outcomes include investigation of genetics and blood and ocular biomarkers. Data from the cohort will contribute to an international consortium, and cohort participants will be invited to access future treatment/health intervention trials.

Discussion

AusCADASIL will be the first study of an Australian cohort of individuals with CADASIL. The study will identify common pathogenic variants in this cohort, and characterise the pattern of clinical presentation and longitudinal progression, including imaging features, blood and ocular biomarkers and cognitive profile.

Utility of the NIH Toolbox Cognition Battery in middle to older aged adults with longstanding type 1 diabetes: The DCCT/EDIC study

Objective: Adults with type 1 diabetes (T1D) face an increased risk for cognitive decline and dementia. Diabetes-related and vascular risk factors have been linked to cognitive decline using detailed neuropsychological testing; however, it is unclear if cognitive screening batteries can detect cognitive changes associated with aging in T1D. Method: 1,049 participants with T1D (median age 59 years; range 43-74) from the Diabetes Control and Complications Trial (DCCT), and the follow-up Epidemiology of Diabetes Interventions and Complications (EDIC) study, completed the NIH Toolbox Cognition Battery (NIHTB-C) and Montreal Cognitive Assessment (MoCA). Neuropsychological assessments, depression, glycated hemoglobin levels (HbA1c), severe hypoglycemia, T1D complications, and vascular risk factors were assessed repeatedly over 32 years to determine associations with current NIHTB-C performance. Available cognitive data was clinically adjudicated to determine cognitive impairment status. Results: NIHTB-C scores had moderate associations (r = 0.36-0.53) with concurrently administered neuropsychological tests. In multivariate models, prior severe hypoglycemic episodes, depression symptoms, nephropathy, lower BMI, and higher HbA1c and LDL cholesterol were associated with poorer NIHTB-C Fluid Cognition Composite scores. The NIHTB-C adequately detected adjudicated cognitive impairment (Area Under the Curve = 0.86; optimal cut score ≤90). The MoCA performed similarly (Area Under the Curve = 0.83; optimal cut score ≤25). Conclusions: The NIHTB-C is sensitive to the cognitive effects of diabetes-related and vascular risk factors, correlated with neuropsychological testing, and accurately detects adjudicated cognitive impairment. These data support its use as a screening test in middle to older aged adults with T1D to determine if referral for detailed neuropsychological assessment is needed.

Psychometric properties of the NIH Toolbox Cognition and Emotion Batteries among children and adolescents with congenital heart defects

The NIH Toolbox offers brief, computerized measures of cognitive and psychosocial functioning. However, its psychometric properties were established among typically developing children and adolescents. The current study provides the first comprehensive assessment of its psychometric properties among young patients with congenital heart defects (CHD). We prospectively recruited 58 patients with CHD and 80 healthy controls between the ages of 6 and 17. Participants completed the NIH Toolbox Cognition and Emotion Batteries, a battery of clinician-administered neuropsychological tests, and ratings of their quality of life. Their parents also completed ratings of their functioning. On the Cognition Battery, we found expectable group differences and developmentally expected gains across ages. For the most part, composites and subtests were significantly correlated with neuropsychological measures of similar constructs. Higher scores were generally associated with ratings of better day-to-day functioning among children with CHD. On the Emotion Battery, we found no significant group differences, echoing prior research. For the most part, scales showed acceptable internal consistency among both groups. There was adequate construct coherence for most of questionnaires among healthy control but not participants with CHD. Correlations with a comparison tool were largely within expectable directions. The NIH Toolbox may provide a valid and useful assessment of cognitive functioning among youths with CHD. While it may offer reliable and valid scales of psychosocial functioning, further research is needed to understand the meaningfulness of the scales for participants with CHD.

Remote Cognitive Screening Of Healthy Older Adults for Primary Care With the MyCog Mobile App: Iterative Design and Usability Evaluation

BACKGROUND

Annual cognitive screening in adults aged >65 years can improve early detection of cognitive impairment, yet less than half of all cases are identified in primary care. Time constraints in primary care settings present a major barrier to routine screening. A remote cognitive screener completed on a patient's own smartphone before a visit has the potential to save primary care clinics time, encourage broader screening practices, and increase early detection of cognitive decline.

OBJECTIVE

We described the iterative design and proposed the implementation of a remote cognitive screening app, MyCog Mobile, to be completed on a patient's smartphone before an annual wellness visit. The research questions were as follows: What would motivate primary care clinicians and clinic administrators to implement a remote cognitive screening process? How might we design a remote cognitive screener to fit well with existing primary care workflows? What would motivate an older adult patient to complete a cognitive screener on a smartphone before a primary care visit? How might we optimize the user experience of completing a remote cognitive screener on a smartphone for older adults?

METHODS

To address research questions 1 and 2, we conducted individual interviews with clinicians (n=5) and clinic administrators (n=3). We also collaborated with clinic administrators to create user journey maps of their existing and proposed MyCog Mobile workflows. To address research questions 3 and 4, we conducted individual semistructured interviews with cognitively healthy older adults (n=5) and solicited feedback from a community stakeholder panel (n=11). We also tested and refined high-fidelity prototypes of the MyCog Mobile app with the older adult interview participants, who rated the usability on the Simplified System Usability Scale and After-Scenario Questionnaire.

RESULTS

Clinicians and clinic administrators were motivated to adopt a remote cognitive screening process if it saved time in their workflows. Findings from interviews and user journey mapping informed the proposed implementation and core functionality of MyCog Mobile. Older adult participants were motivated to complete cognitive screeners to ensure that they were cognitively healthy and saw additional benefits to remote screening, such as saving time during their visit and privacy. Older adults also identified potential challenges to remote smartphone screening, which informed the user experience design of the MyCog Mobile app. The average rating across prototype versions was 91 (SD 5.18) on the Simplified System Usability Scale and 6.13 (SD 8.40) on the After-Scenario Questionnaire, indicating above-average usability.

CONCLUSIONS

Through an iterative, human-centered design process, we developed a viable remote cognitive screening app and proposed an implementation strategy for primary care settings that was optimized for multiple stakeholders. The next steps include validating the cognitive screener in clinical and healthy populations and piloting the finalized app in a community primary care clinic.