Univariate and Multivariate Base Rates of Score Elevations, Reliable Change, and Inter-Rater Discrepancies in the BRIEF-A Standardization Samples

Self-Reported Executive Functioning in Young Adult Survivors of Childhood Bacterial Meningitis

OBJECTIVE

This study investigated executive functions (EFs) in young adult survivors of childhood bacterial meningitis (BM). These skills are important for normal development, and their potential vulnerability in early years suggests that childhood BM could affect executive functions in the longer term.

METHOD

The adult self-report Behavior Rating Inventory of Executive Function was administered to 474 young adult survivors of childhood BM who participated in the 20|30 Dutch Postmeningitis study. Average scores were compared to population-norm group scores. Subgroup scores were compared according to causative pathogen and age at onset.

RESULTS

Young adult survivors of childhood BM scored lower on overall metacognition than the age-matched population norm group. Young adult survivors of childhood BM caused by Streptococcus pneumoniae, S. agalactiae, or Escherichia coli had lower scores than cases caused by Neisseria meningitidis. Survivors with age-at-onset below 12 months had a higher (worse) overall EF score than survivors with age-at-onset above 12 months.

CONCLUSIONS

Young adult survivors of childhood BM experience difficulties in EF. However, most of the self-reported EF scores were within the norm. Future studies need to additionally assess EF in adult survivors of childhood BM using performance-based tests.

Multivariate base rates of potentially problematic scores on the NIH Toolbox Emotion Battery

OBJECTIVE

To examine the normal frequency of obtaining one or more scores considered potentially problematic based on normative comparisons when completing the NIH Toolbox Emotion Battery (NIHTB-EB).

METHOD

Participants (N = 753; ages 18-85, 62.4% women, 66.4% non-Hispanic White) from the NIHTB norming study completed 17 scales of emotional functioning fitting into three subdomains (i.e., Negative Affect, Psychological Well-being, Social Satisfaction). Scores were considered potentially problematic if they were 1 SD above/below the mean, depending on the orientation of the scale, and cutoffs for 1.5 and 2 SD were also included for reference. Multivariate base rates quantified the rate at which participants obtained one or more potentially problematic scale or subdomain scores.

RESULTS

The portion of participants obtaining one or more potentially problematic scores on the NIHTB-EB scales and subdomains was 61.2 and 23.2%, respectively. Participants who were younger (i.e., 18-49) or had less education had higher rates of potentially problematic scores within specific subdomains. There were no significant differences by sex or race/ethnicity.

CONCLUSIONS

Elevated scores on the NIHTB-EB were common in the normative sample and related to education/age. The multivariate base rates provided indicate obtaining one or more potentially problematic scores on the NIHTB-EB is broadly normal among adults, which may guard against overinterpreting a single score as clinically significant. These base rates should be considered in the context of other assessment findings, such as interviews, medical history or informant reports, to ensure that true emotional problems are not dismissed, and normal variation in emotional functioning is not pathologized.

Cognitive, Sleep-Arousal, Physical, and Affective Domain Scores on the Post-Concussion Symptom Scale: Added Utility in Detecting Symptom Elevations among Student-Athletes with a Remote History of Concussion

OBJECTIVE

The evaluation of self-reported symptoms is a standard component of concussion assessment and management. Clinicians typically evaluate a total symptom severity score rather than scores corresponding to specific symptom domains (i.e., cognitive, sleep-arousal, physical, and affective symptoms). This study examined (i) whether elevations in specific symptom domains would be missed when interpreting only the total symptom severity score and (ii) if a single symptom domain elevation was more common than having elevated symptoms across multiple domains.

METHOD

Adolescent student-athletes (N = 1,008) with concussion history (i.e., ≥6 months since last concussion) completed the Post-Concussion Symptom Scale (PCSS). The PCSS total score and cognitive, sleep-arousal, physical, and affective domain scores were calculated. To determine if symptoms were elevated, scores were compared to normative data matched on gender and pre-existing conditions, with scores considered elevated if they were ≥84th percentile. The frequency of total and domain score elevations were calculated and stratified by gender and number of prior concussions (i.e., 1 or ≥2 prior concussions).

RESULTS

Overall, 26% of student-athletes had an elevated symptom domain score without being elevated on the total score. The most common symptom presentation was to have a single elevated symptom domain (21%), followed by two (11%), three (8%), or four elevated domains (6%).

CONCLUSIONS

Interpreting PCSS symptom domains may be beneficial in detecting student-athletes with elevated symptoms following a remote concussion. Roughly a quarter of student-athletes have domain-specific symptom elevations that would be missed by interpreting the total score alone.

Psychometric properties of the Behavior Rating Inventory of Executive Function, second edition (BRIEF2) self-report form in Iranian adolescents

BACKGROUND

This study investigated the psychometric properties of a Persian translation of the Behavior Rating Inventory of Executive Function, Second Edition (BRIEF2) Self-Report form.

METHOD

Participants were 589 typically developing adolescents (336 girls and 253 boys), ages 11-18 years old (M = 15.16; SD = 2.04), in Iran. They completed the Persian version of the BRIEF2 Self-Report form and Teenage Executive Functioning Inventory (TEXI). The Persian translated BRIEF2 psychometric properties were examined via internal consistency, test-retest reliability, convergent validity via associations with TEXI scores, and internal structure using structural equation modeling (SEM) to evaluate fit of the three-factor structure from the original English version BRIEF2.

RESULTS

Findings indicated the Persian version of BRIEF2 Self-Report form yielded scores with robust reliability, with internal consistency ranging from .87 to .93 and test-retest correlations ranging from .89 to .96, and adequate convergent validity, with correlations with the TEXI ranging from .48 to .79. SEM revealed that a three-factor solution was the best fitting model for the seven subscales of the Persian BRIEF2.

CONCLUSION

These findings support the clinical use of the Persian BRIEF2 in Iranian adolescents, including the interpretation of the BRIEF2 three-factor structure, as well as the multidimensional nature of executive functions.

BRIEF-A: Factor structure and measurement invariance across self-report and informant forms

OBJECTIVE

This study analyzes the psychometric properties of the two forms (self-report and informant) of the Behavior Rating Inventory of Executive Function-Adult version (BRIEF-A) in a sample of healthy Portuguese adults.

METHOD

The participants were 608 adults, 304 of whom answered the self-report form (ages 18-59; 137 male and 167 female) and 304 who answered the informant form (ages 18-70; 110 male and 194 female).

RESULTS

The internal consistency for the indexes and the Global Executive Composite was very good (≥.90), whereas for the scales they were either acceptable (between .70 and .80) or good (≥.80), except for the Inhibit scale in both forms. Confirmatory factor analysis was used to test seven competing factor models for each of the forms. The original two-factor model (Behavioral Regulation and Metacognition Indexes) showed a slightly better model fit than the three-factor model (Behavioral Regulation, Emotional Regulation, and Metacognition Indexes) in both forms. The multiple-group analysis of the two-correlated-factor model across forms was supported (configural, metric, and partial scalar invariance).

CONCLUSIONS

Overall, the BRIEF-A showed adequate psychometric properties, suggesting that it is a useful instrument to assess everyday executive functioning in healthy Portuguese adults.

Enhanced interpretation of the BRIEF2: multivariate base rates of elevated scores in the standardization samples

The Behavior Rating Inventory of Executive Function, Second Edition (BRIEF2) is a standardized rating (self, parent, and teacher) scale of executive functioning in children and adolescents. Here, we provide multivariate base rate (MBR) information (for the Self, Parent, and Teacher forms), which is not included in the BRIEF2 Professional Manual. Participants were children and adolescents for the BRIEF2 Self-Report (ages = 11-18; N = 803), Parent-Report (ages = 5-18; N = 1,400), and Teacher-Report (ages = 5-18; N = 1,400) standardization samples. We focused on cumulative (e.g., % of sample with oneor more elevated scores) MBRs across scales, which were examined at three elevation levels on each form: T≥ 60, ≥65, and ≥70. Across forms, MBRs predictably decreased with increasing number of elevated scores and at higher cutoffs. The cumulative MBR of having at least one score at T≥ 60 was common (37.5-42.2%), but less frequent at T≥ 70 (15.4-17.4%). The probability of having elevated scores on all scales was very low, irrespective of form, age, or elevation threshold (T≥ 60 = 2.4-4.4%; T≥ 65 = 1.0-1.4%; T≥ 70 = 0.0-0.7%). There was no clinically meaningful relation between demographic factors (age, gender, race, and parental education) and MBRs. These data provide clinicians and researchers with an enhanced way of concurrently interpreting multiple BRIEF2 scales.