Trait and State Variance in Multi-Informant Assessments of ADHD and Academic Impairment in Spanish First-Grade Children

Psychometric and Normative Information on the Child and Adolescent Behavior Inventory With Parent Ratings in a Nationally Representative Sample of Spanish Youth

Psychometric and normative information is provided for the Child and Adolescent Behavior Inventory (CABI) cognitive disengagement syndrome, anxiety, depression, attention-deficit/hyperactivity disorder (ADHD)-inattention, ADHD-hyperactivity/impulsivity, oppositional defiant disorder, social impairment, peer rejection, withdrawal from peer interactions, and academic impairment scales with a nationally representative sample of Spanish youth. Parents of 5,525 Spanish youth (ages 5-16, 56.1% males) completed the CABI scales on their sons and daughters. Scores on the 10 CABI scales demonstrated excellent reliability, invariance, and validity for males and females within early childhood (ages 5-8), middle childhood (ages 9-12), and adolescence (ages 13-16). Normative information (T-scores) is provided for females and males within each age group for the 10 CABI scales. The new psychometric and normative information increase the usefulness of the CABI scale scores for research and clinical activities. Copies of the CABI and the norms are available at no cost to professionals.

Momentary Dynamics Implicate Emotional Features in the ADHD Phenotype

Emotional dysregulation is increasingly recognized as important to the attention-deficit/hyperactivity disorder (ADHD) phenotype alongside inattention and hyperactivity-impulsivity. Studies of ADHD have relied primarily on trait-based conceptualizations that emphasize stability of symptoms across moderate developmental timescales (i.e., months to years). Trait-based conceptualizations provide a critical view but fail to account for short-term dynamic variations in the expression of ADHD symptoms and emotion. This leaves a gap in our understanding of the short-term variation in ADHD symptom expression and the dynamic relationships among ADHD symptoms and emotion. Here, we assessed caregiver report of ADHD symptoms and positive and negative emotion using ecological momentary approaches over 2 weeks in a sample of 36 children with and without ADHD between the ages of 7-12 years old. Between-person (RKF) and within-person (RC) reliability were estimated. Multilevel models tested specific covariation hypotheses between ADHD symptoms and emotion. Analyses confirmed that ADHD and emotion ratings were reliable as individual differences (i.e., between-person; RKF range 0.93-1.0) and moment-to-moment change (i.e., within-person; Rc range 0.66-0.88) measures. Multilevel models found little evidence for lagged effects between domains, but consistently identified concurrent expression of ADHD symptoms and emotions; inattention covaried most strongly with negative emotion and hyperactivity-impulsivity covaried most strongly with positive emotion. Results demonstrate the importance of complementing trait-level conceptualizations with assessment of momentary dynamics. Momentary assessment suggests important covariation of ADHD symptoms and emotion as part of the ADHD phenotype.

Investigating the Measurement Invariance and Method-Trait Effects of Parent and Teacher SNAP-IV Ratings of Preschool Children

The Swanson, Nolan, and Pelham scale version IV (SNAP-IV) is widely used to assess symptoms of attention deficit hyperactivity disorder (ADHD) and oppositional defiant disorder (ODD) in children and adolescents. Nevertheless, there is insufficient data to support its use in preschool children. The study had three goals: First, to test the factorial validity of the three correlated-factors model of ADHD and ODD items of the SNAP-IV. Second, to investigate the measurement invariance of the items over time (6-month longitudinal interval) and by sex. Third, to investigate the convergent validity and method-specific influences on ADHD/ODD assessments with respect to multiple raters (parents/teachers) of children's symptoms. Participants were 618 preschool children (3.5-6 years) at baseline and 6-month follow-up. For model testing, we used confirmatory factor analysis for categorical observed variables. Method and trait effects were examined using the CT-C(M-1) model. The analyses showed partial measurement invariance over time and according to sex. Moreover, strong rater-specific effects were detected. The implication of the results for construct validation of the instrument and clinical assessment of ADHD and ODD traits are discussed.

Convergent and Discriminant Validity of the Child and Adolescent Behavior Inventory Scale Scores With Well-Established Psychopathology and Academic Achievement Measures in Adolescents With ADHD

The convergent and discriminant validity of the parent version of the Child and Adolescent Behavior Inventory (CABI) symptom and impairment scale scores were evaluated with the scale scores from multiple methods including a semistructured diagnostic interview, rating scales, and an academic achievement test. Participants were 82 adolescents (70% male, 78% non-Hispanic White) aged 13 to 17 years (M = 15.01) diagnosed with attention-deficit/hyperactivity disorder (77% predominantly inattentive presentation) and parents. CABI scale scores showed moderate (rs = .42 to .49) to substantial (rs = .62 to .91) convergent correlations with scores from similar measures. CABI scale scores also showed significant discriminant validity (convergent correlation significantly larger than discriminant correlation) with the scores on the other measures. These findings provide additional support for use of the CABI in research and clinical practice, and copies of the scale and norms are freely available.

Consistency of Limited Prosocial Emotions Across Occasions, Sources, and Settings: Trait- or State-Like Construct in a Young Community Sample?

Limited prosocial emotions (LPE, also referred to as callous-unemotional [CU] traits) are considered to reflect a more trait- than state-like construct. Our first objective was to determine the amount true score variance in CU/LPE that was consistent (trait consistency) over two occasions (12-month interval) of measurement versus specific (occasion-specificity) to each occasion. Our second objective was to determine the convergent validity of the consistent (trait) and occasion-specific (state) variance in CU/LPE symptom ratings within and across settings. Mothers, fathers, primary teachers, and ancillary teachers rated the CU/LPE symptoms in sample of 811 Spanish children (55% boys) on two occasions (i.e., end of first and second grades). CU/LPE symptom ratings showed more trait consistency than occasion-specificity for mothers and fathers, slightly more occasion-specificity than trait consistency for primary teachers, and much more occasion-specificity than trait consistency for ancillary teachers. Convergent validity for trait consistency was strong for fathers with mothers but weaker for primary with ancillary teachers. There was essentially no convergent validity for either trait consistency or occasion-specificity across home and school settings. CU/LPE symptom ratings within this age range represented a more trait-like construct for mothers and fathers and more state-like construct for primary teachers and ancillary teachers. In contrast, earlier studies showed ADHD and ODD ratings to be trait-like within and across home and school. The study of CU/LPE in young children should therefore include multiple sources in multiple settings across occasions to better understand the consistent and occasion-specific nature of the CU/LPE construct.

Are Sluggish Cognitive Tempo, ADHD, and Oppositional Defiant Disorder Trait- or State-Like Constructs from Prekindergarten to Fourth Grade?

The objective was to determine the proportion of trait (consistency across occasions) and occasion-specific variance in sluggish cognitive tempo (SCT), attention deficit/hyperactivity disorder (ADHD)-inattention (IN), ADHD-hyperactivity/impulsivity (HI), and oppositional defiant disorder (ODD) symptom ratings. A single trait factor-multiple state factors model was applied to parent ratings of SCT, ADHD-IN, ADHD-HI, and ODD symptoms for 978 children (50% female) across prekindergarten (M = 4.90 years), kindergarten (M = 6.27 years), 1st-grade (M = 7.42 years), 2nd-grade (M = 8.45 years), and 4th-grade (M = 10.45 years) assessments. For the prekindergarten assessment, SCT, ADHD-IN, ADHD-HI, and ODD contained more occasion-specific than trait variance (54%, 64%, 56%, and 55% occasion-specific variance, respectively). In contrast, SCT, ADHD-IN, ADHD-HI, and ODD contained more trait than occasion-specific variance for the kindergarten through 4th-grade assessments (62%-72%, 65%-68%, 71%-75%, and 60%-69% trait variance, respectively). SCT, ADHD-IN, ADHD-HI, and ODD are slightly to moderately more state-like than trait-like during the prekindergarten developmental period but are more stable traits than fluctuating states from kindergarten to 4th grade. Findings indicate that, particularly after children start formal schooling, these psychopathology dimensions are primarily stable traits; implications for assessment are discussed.

Should We Subtype ADHD According to the Context in Which Symptoms Occur? Criterion Validity of Recognising Context-Based ADHD Presentations

ADHD symptoms show considerable individual variation in the contexts in which they are expressed. It has previously been proposed that subtyping individuals according to the contexts in which symptoms are expressed may be clinically useful. We examined context-based patterns of ADHD symptoms in a longitudinal cohort study of n = 1388 children, as well as context-specific and context-general predictors of symptoms. Participants were community-ascertained and provided ADHD symptom data at ages 7, 9, and 11. Using growth mixture modelling we identified five inattention and five hyperactivity/impulsivity categories that differed in the developmental patterns of symptoms reported by parent and teacher informants. We found some evidence that context-specific predictors were related to context-specific expressions. Specifically, after controlling for other risk factors for ADHD symptoms, relationships with teachers predicted school-specific (teacher-reported) but not home-specific (parent-reported) symptom levels. However, no subtypes defined by exclusively home-based symptoms emerged, suggesting that while symptoms may sometimes be specific to the school context, they are only rarely confined to the home context. Subtyping by context could be informative; however, further work will required to uncover the nature of any etiological, functional, or outcome differences between those who show symptom expression in different contexts.

Longitudinal relation between state-trait maternal irritability and harsh parenting

According to Belsky's process model of parenting, parents' personality represents the most important factor influencing parenting and child development. While an extensive literature has empirically corroborated the role of irritability traits in predicting aggressive behaviors in laboratory-based studies, only a few studies have examined the role of irritability in predicting aggressive behaviors within family contexts. The present study addressed this gap by examining the longitudinal association between maternal irritability and harsh parenting. Referencing latent state-trait theory (LST), first we estimated the amount of variance in mothers' irritability due to trait and state components, and, next, we examined the relation between mothers' irritability (both at trait- and state- levels) and harsh parenting over time. A sample of 204 mothers from Naples and Rome provided data over 5 years in four waves. Mothers averaged 40.30 years (SD = 5.33) at Time 1 and 44.01 years (SD = 5.43) at Time 4. Their children (50% girls) were 9.45 years (SD = 0.74) at Time 1 and 13.18 years (SD = 0.66) at Time 4. Results of LST analysis showed that, on average, 39% of variability in irritability was due to trait-like factors and only 12% to state-like factors. A multitrait-multistate model revealed that the irritability trait associated with mother's lack of control predicted her harsh parenting 1-year later, while controlling for the rank-order stability of harsh parenting.

How Consistent Is Sluggish Cognitive Tempo Across Occasions, Sources, and Settings? Evidence From Latent State-Trait Modeling

Research has yet to determine how much of the variance in sluggish cognitive tempo (SCT) symptom ratings is consistent across occasions, sources, and settings versus specific to occasion, source, and setting. Our first objective was to determine the amount of variance in SCT ratings that was consistent ( trait consistency) across three occasions of measurement over 12 months versus specific to the occasion ( occasion-specificity) with ratings by mothers, fathers, primary teachers, and secondary teachers of 811 Spanish children. Our second objective was then to determine the convergent validity for trait consistency and occasion-specificity variance components within and across settings. SCT ratings reflected mostly trait consistency for mothers, fathers, and primary teachers (less so for secondary teachers) with the convergent validity for trait consistency also being strong for mothers with fathers and for primary teachers with secondary teachers. Across home and school, however, convergent validity for trait consistency was low and even lower for occasion-specificity. SCT appears to be more trait-like rather than state-like, with similar levels of trait consistency across occasions and convergent validity within settings as attention-deficit/hyperactivity disorder (ADHD) symptoms in a prior study. However, SCT symptoms had slightly weaker convergent validity for trait consistency across settings relative to ADHD symptoms.

Differential impact of trait sluggish cognitive tempo and ADHD inattention in early childhood on adolescent functioning

BACKGROUND

Sluggish cognitive tempo (SCT) is distinct from attention-deficit/hyperactivity disorder inattention (ADHD-IN) and concurrently associated with a range of impairment domains. However, few longitudinal studies have examined SCT as a longitudinal predictor of adjustment. Studies to date have all used a relatively short longitudinal time span (6 months to 2 years) and only rating scale measures of adjustment. Using a prospective, multi-method design, this study examined whether SCT and ADHD-IN were differentially associated with functioning over a 10-year period between preschool and the end of ninth grade.

METHODS

Latent state-trait modeling determined the trait variance (i.e. consistency across occasions) of SCT and ADHD-IN across four measurement points (preschool and the end of kindergarten, first grade, and second grade) in a large population-based longitudinal sample (N = 976). Regression analyses were used to examine trait SCT and ADHD-IN factors in early childhood as predictors of functioning at the end of ninth grade (i.e. parent ratings of psychopathology and social/academic functioning, reading and mathematics academic achievement scores, processing speed and working memory).

RESULTS

Both SCT and ADHD-IN contained more trait variance (Ms = 65% and 61%, respectively) than occasion-specific variance (Ms = 35% and 39%) in early childhood, with trait variance increasing as children progressed from preschool through early elementary school. In regression analyses: (a) SCT significantly predicted greater withdrawal and anxiety/depression whereas ADHD-IN did not uniquely predict these internalizing domains; (b) ADHD-IN uniquely predicted more externalizing behaviors whereas SCT uniquely predicted fewer externalizing behaviors; (c) SCT uniquely predicted shyness whereas both SCT and ADHD-IN uniquely predicted global social difficulties; and (d) ADHD-IN uniquely predicted poorer math achievement and slower processing speed whereas SCT more consistently predicted poorer reading achievement.

CONCLUSIONS

Findings of this study - from the longest prospective sample to date - provide the clearest evidence yet that SCT and ADHD-IN often differ when it comes to the functional outcomes they predict.

Disagreeing about development: An analysis of parent-teacher agreement in ADHD symptom trajectories across the elementary school years

OBJECTIVES

It is well-known that in cross-sectional analyses, agreement between informants is modest as best when rating attention-deficit/hyperactivity disorder and other disruptive behaviour disorder symptoms. We here aimed to develop recommendations for the use of multi-informant data in the context of longitudinal developmental analyses that examine symptom trajectories over time.

METHOD

Using parallel process modelling, we estimated parent-teacher agreement in inattention and hyperactivity/impulsivity symptom initial levels and slopes across the elementary school years (ages 7, 9, and 11) for a community sample of n = 1,388 youth. We also used these models to examine whether initial levels and slopes differed significantly across informants.

RESULTS

Informant agreement was low to moderate and higher for inattention slopes (r = .47) than for hyperactivity/impulsivity slopes (r = .23). Parents and teachers reported opposite developmental trends for inattention with teachers reporting declines and parents reporting increases over time. Parents reported overall higher levels of hyperactivity/impulsivity, but there were no average informant differences in slopes.

CONCLUSION

Of the options available, we recommend specifying separate but correlated factors for different informants in developmental analyses of attention-deficit/hyperactivity disorder. This can be achieved within latent growth curve and growth mixture models.

A latent state-trait model for analyzing states, traits, situations, method effects, and their interactions

OBJECTIVE

Studies on situation and Person × Situation interaction effects often use only one method of measurement, so that the extent to which the effects may be method-specific cannot be determined. We introduce a new multimethod latent state-trait model for random and fixed situations (MM-LST-RF), which allows examining person, situation, and Person × Situation interaction effects in the context of multimethod measurement designs (e.g., studies with multiple reporters), and discuss potential areas of application for the new model in personality research.

METHOD

The new model allows analyzing novel features of multimethod, multi-situation data, including (a) the convergent validity and method specificity of trait (person) effects, situation effects, and Person × Situation interaction effects; (b) the degree of situation specificity of method effects; and (c) potential Method × Situation interactions. An application to smoker's affect (N = 235; 57% female; 93% Caucasian) before and after quitting smoking is presented with positively and negatively worded items as methods.

RESULTS

The MM-LST-RF model fit the smoking data well. Method specificity of many effects was high.

CONCLUSIONS

The MM-LST-RF model provides researchers with a new framework for testing method specificity of person, situation, and interaction effects.

Informant-related effects of neurofeedback and cognitive training in children with ADHD including a waiting control phase: a randomized-controlled trial

There is controversy regarding the clinical efficacy of neurofeedback (NF) and computerized cognitive training (CogT) as treatments for ADHD. Meta-analyses claim that probably blinded teachers observe smaller effects than parents, because they are less biased. We investigated informant-specific effects by manipulating the involvement of informants, by controlling for waiting time effects, and by adding a blinded outcome measure. Seventy-seven children with ADHD were randomly allocated to slow cortical potential NF or to individualized CogT (of attention, working memory or inhibition). The training was conducted in schools (NF: n = 19, CogT: n = 19) or in outpatient clinics (NF: n = 19, CogT: n = 20). Three assessments were scheduled: baseline, followed by a waiting period, pre-training, and post-training. Multivariate Analyses of Variance were conducted to assess parent- and teacher-rated changes in ADHD symptoms and executive functions (EF), and changes according to standardized classroom observations. Both treatments resulted in significant improvements according to informants, with larger effects for parents (ADHD symptoms: parent η _p²  = .32; teacher η _p²  = .10), and according to observations (η _p²  = .19). The setting had no effect on outcome. Considerable waiting time effects were revealed for ADHD symptom ratings by both informants, for EF ratings only by teachers. Changed classroom behavior was uncorrelated with teacher-rated changes. Overall, the results do not support the notion that teachers are more objective while being as sensitive to change as parents. The three sources seem to contribute differential and mostly unrelated pieces of information to the evaluation of treatments.

Latent State-Trait Modeling: A New Tool to Refine Temperament Methodology

Questions concerning longitudinal stability and multi-method consistency are critical to temperament research. Latent State-Trait (LST) analyses address these directly, and were utilized in this study. Thus, our primary objective was to apply LST analyses in a temperament context, using longitudinal and multi-method data to determine the amount of trait vs. state variance, as well as convergence for measures of Distress to Limitations (DL) facets. Mothers' ratings and independent observations of DL behaviors collected on two occasions (8 months old and 12 months old) for 148 infants (49.2% female) were utilized. Single source latent state-trait (LST) analyses indicated that parent ratings of DL behavior (PDL) contained more trait (M = 61%) than state residual (M = 39%) variance, whereas independent observations (IO) of DL behavior contained substantially more state residual (75%) than trait (25%) variance. A multiple source LST analysis indicated virtually zero convergence for either trait or state residual variance between PDL and IO ratings (M = 2%). In conclusion, PDL ratings were more trait-like across the four-month interval, whereas IO ratings of DL were more state-like in nature. Also, no convergence was found between the two methods of measurement. Results are discussed with an emphasis on implications for the utility of LST analyses in temperament research.

Trait and state variance in oppositional defiant disorder symptoms: A multi-source investigation with Spanish children

The objective was to determine and compare the trait and state components of oppositional defiant disorder (ODD) symptom reports across multiple informants. Mothers, fathers, primary teachers, and secondary teachers rated the occurrence of the ODD symptoms in 810 Spanish children (55% boys) on 2 occasions (end first and second grades). Single source latent state-trait (LST) analyses revealed that ODD symptom ratings from all 4 sources showed more trait (M = 63%) than state residual (M = 37%) variance. A multiple source LST analysis revealed substantial convergent validity of mothers' and fathers' trait variance components (M = 68%) and modest convergent validity of state residual variance components (M = 35%). In contrast, primary and secondary teachers showed low convergent validity relative to mothers for trait variance (Ms = 31%, 32%, respectively) and essentially zero convergent validity relative to mothers for state residual variance (Ms = 1%, 3%, respectively). Although ODD symptom ratings reflected slightly more trait- than state-like constructs within each of the 4 sources separately across occasions, strong convergent validity for the trait variance only occurred within settings (i.e., mothers with fathers; primary with secondary teachers) with the convergent validity of the trait and state residual variance components being low to nonexistent across settings. These results suggest that ODD symptom reports are trait-like across time for individual sources with this trait variance, however, only having convergent validity within settings. Implications for assessment of ODD are discussed. (PsycINFO Database Record