A Paradigm for Understanding Adolescent Social Anxiety with Unfamiliar Peers: Conceptual Foundations and Directions for Future Research

Seeking contexts that promote neurodiverse social success: Patterns of behavior during minimally-structured interaction settings in autistic and non-autistic youth

While peer interaction differences are considered a central feature of autism, little is known regarding the nature of these interactions via directly-observed measurement of naturalistic (i.e., minimally-structured) groups of autistic and non-autistic adolescent peers. 148 autistic and non-autistic adolescents (111 male, Mage = 14.22, SDage = 1.90; MIQ = 103.22, SDIQ = 15.80) participated in a 50-minute, minimally-structured, naturalistic peer interaction paradigm with activities of varying social demands: an incidental social demand (eating in a room with peers), a physical social demand (playing a physically-interactive game), and a verbal social demand (playing a verbal game). While autistic youth exhibited fewer overall interaction behaviors than non-autistic youth, the two groups did not differ in amount of positive, negative, and low-level interaction behaviors. Within activities, autistic and non-autistic youth only differed in positive interaction behaviors during the context of a verbal social demand. Youth who displayed more positive interaction behaviors during this same activity had less autism spectrum disorder symptomatology, controlling for nested group effects and relevant covariates. These results point toward subtle differences in social demands across naturalistic settings that can either support or impede prosocial interaction for autistic youth, providing a guidepost for identifying settings that best promote social success for neurodiverse populations.

The Proposed Specifiers for Conduct Disorder - Parent (PSCD-P): Convergent Validity, Incremental Validity, and Reactions to Unfamiliar Peer Confederates

Youth who experience psychopathy display multiple impairments across interpersonal (grandiose-manipulative [GM]), affective (callous-unemotional [CU]), lifestyle (daring-impulsive [DI]), and potentially antisocial and behavioral features. Recently, it has been acknowledged that the inclusion of psychopathic features can offer valuable information in relation to the etiology of Conduct Disorder (CD). Yet, prior work largely focuses on the affective component of psychopathy, namely CU. This focus creates uncertainty in the literature on the incremental value of a multicomponent approach to understanding CD-linked domains. Consequently, researchers developed the Proposed Specifiers for Conduct Disorder (PSCD; Salekin & Hare, 2016) as a multicomponent approach to assess GM, CU, and DI features in combination with CD symptoms. The notion of considering the wider set of psychopathic features for CD specification requires testing whether multiple personality dimensions predict domain-relevant criterion outcomes above-and-beyond a CU-based approach. Thus, we tested the psychometric properties of parents' reports on the PSCD (PSCD-P) in a mixed clinical/community sample of 134 adolescents (M_age = 14.49, 66.4% female). Confirmatory factor analyses resulted in a 19-item PSCD-P displaying acceptable reliability estimates and a bifactor solution consisting of GM, CU, DI, and CD factors. Findings supported the incremental validity of scores taken from the PSCD-P across multiple criterion variables, including (a) an established survey measure of parent-adolescent conflict; and (b) trained independent observers' ratings of adolescents' behavioral reactions to laboratory controlled tasks designed to simulate social interactions with unfamiliar peers. These findings have important implications for future research on the PSCD and links to adolescents' interpersonal functioning.

The Operations Triad Model and Youth Mental Health Assessments: Catalyzing a Paradigm Shift in Measurement Validation

Researchers strategically assess youth mental health by soliciting reports from multiple informants. Typically, these informants (e.g., parents, teachers, youth themselves) vary in the social contexts where they observe youth. Decades of research reveal that the most common data conditions produced with this approach consist of discrepancies across informants' reports (i.e., informant discrepancies). Researchers should arguably treat these informant discrepancies as domain-relevant information: data relevant to understanding youth mental health domains (e.g., anxiety, depression, aggression). Yet, historically, in youth mental health research as in many other research areas, one set of paradigms has guided interpretations of informant discrepancies: Converging Operations and the Multi-Trait Multi-Method Matrix (MTMM). These paradigms (a) emphasize shared or common variance observed in multivariate data, and (b) inspire research practices that treat unique variance (i.e., informant discrepancies) as measurement confounds, namely random error and/or rater biases. Several yearsw ago, the Operations Triad Model emerged to address a conceptual problem that Converging Operations does not address: Some informant discrepancies might reflect measurement confounds, whereas others reflect domain-relevant information. However, addressing this problem requires more than a conceptual paradigm shift beyond Converging Operations. This problem necessitates a paradigm shift in measurement validation. We advance a paradigm (Classifying Observations Necessitates Theory, Epistemology, and Testing [CONTEXT]) that addresses problems with using the MTMM in youth mental health research. CONTEXT optimizes measurement validity by guiding researchers to leverage (a) informants that produce domain-relevant informant discrepancies, (b) analytic procedures that retain domain-relevant informant discrepancies, and (c) study designs that facilitate detecting domain-relevant informant discrepancies.

Introduction to the Special Issue. A Dozen Years of Demonstrating That Informant Discrepancies are More Than Measurement Error: Toward Guidelines for Integrating Data from Multi-Informant Assessments of Youth Mental Health

Validly characterizing youth mental health phenomena requires evidence-based approaches to assessment. An evidence-based assessment cannot rely on a "gold standard" instrument but rather, batteries of instruments. These batteries include multiple modalities of instrumentation (e.g., surveys, interviews, performance-based tasks, physiological readings, structured clinical observations). Among these instruments are those that require soliciting reports from multiple informants: People who provide psychometrically sound data about youth mental health (e.g., parents, teachers, youth themselves). The January 2011 issue of the Journal of Clinical Child and Adolescent Psychology (JCCAP) included a Special Section devoted to the most common outcome of multi-informant assessments of youth mental health, namely discrepancies across informants' reports (i.e., informant discrepancies). The 2011 JCCAP Special Section revolved around a critical question: Might informant discrepancies contain data relevant to understanding youth mental health (i.e., domain-relevant information)? This Special Issue is a "sequel" to the 2011 Special Section. Since 2011, an accumulating body of work indicates that informant discrepancies often contain domain-relevant information. Ultimately, we designed this Special Issue to lay the conceptual, methodological, and empirical foundations of guidelines for integrating multi-informant data when informant discrepancies contain domain-relevant information. In this introduction to the Special Issue, we briefly review the last 12 years of research and theory on informant discrepancies. This review highlights limitations inherent to the most commonly used strategies for integrating multi-informant data in youth mental health. We also describe contributions to the Special Issue, including articles about informant discrepancies that traverse multiple content areas (e.g., autism, implementation science, measurement validation, suicide).

Assessing Peer-Related Impairments Linked to Adolescent Social Anxiety: Strategic Selection of Informants Optimizes Prediction of Clinically Relevant Domains

Socially anxious adolescents commonly experience impaired interpersonal functioning with unfamiliar, same-age peers. Yet, we lack short screening tools for assessing peer-related impairments. Recent work revealed that a parent-reported, three-item screening tool produced scores that uniquely related to social anxiety concerns. However, this tool ought to go beyond linking impairments to service needs (i.e., social anxiety symptoms). This tool should also inform the goals of services, in particular by linking impairments to key domains relevant to therapeutically addressing adolescents' anxiety-related needs, such as social skills when interacting with unfamiliar peers. This requires an assessment approach that involves strategic selection of informants who vary in their expertise for observing anxiety-related needs, as well as the therapeutic goals for addressing anxiety-related impairments (e.g., social skills within peer interactions). We leveraged parents' reports to link impairments to social anxiety-related needs. To link impairments to social skills, we leveraged informants (i.e., unfamiliar untrained observers [UUOs]) who observed adolescents within tasks designed to simulate interactions with same-age, unfamiliar peers. We tested this approach using a mixed-clinical/community sample of 134 adolescents, ages 14- to 15 years old. We leveraged multi-informant survey reports to assess adolescent social anxiety, and trained independent observers rated adolescents' social skills within unfamiliar peer interactions. Parents' reports performed best when distinguishing adolescents on referral status and predicting survey-reported social anxiety, whereas only UUOs' reports predicted independent observers' social skills ratings. These findings inform the strategic selection of informants for assessing impairments that commonly prompt the need for adolescents to access mental health services for social anxiety.

Developmental Considerations for Understanding Perceptions and Impacts of Identity-Related Differences: Focusing on Adolescence

Biological psychiatry, similar to many other scientific fields, is grappling with the challenge of revising its practices with an eye toward promoting diversity, equity, and inclusivity. One arena in which much of this work will have significant impact is in developmental science generally and the study of adolescence specifically. Adolescence is a critical period during human development during which important social, neural, and cognitive maturation processes take place. It is also a time marked by risky behaviors and the onset of a range of mental disorders. Social and developmental research has provided insight into the cognitive and neural processes by which perceptions of identity-related differences emerge. Clinical research aimed at understanding how individuals from diverse backgrounds navigate the transition period of adolescence is critical for identifying the unique factors underlying risk and resilience in minoritized populations. Taking a developmental perspective, we review processes by which the brain understands group differences and how the developmental timing of this can influence antecedents of psychological distress. We close with a call to action, pointing to important understudied areas within the field of biological psychiatry that are critical for supporting mental health among diverse adolescent populations.

When Adolescents Experience Co-Occurring Social Anxiety and ADHD Symptoms: Links With Social Skills When Interacting With Unfamiliar Peer Confederates

Adolescents with elevated social anxiety commonly experience peer-related impairments - particularly with same-age, unfamiliar peers - stemming from their avoidant behaviors. Yet, peer-related impairments are not unique to social anxiety. For example, adolescents who experience social anxiety may also experience symptoms of attention deficit/hyperactivity disorder (ADHD), which also increase risk for peer-related impairments. Relative to social anxiety, peer-related impairments linked to ADHD symptoms more likely stem from hyperactivity (i.e., approach behaviors). These distinct pathways point to adolescents with elevated social anxiety and ADHD symptoms (i.e., social anxiety + ADHD) experiencing particularly high peer-related impairments, which commonly manifest as behavioral displays of low social skills when interacting with unfamiliar peers. We tested this notion in a mixed-clinical/community sample of 134 14- to 15-year-old adolescents and their parents. Adolescents participated in a series of social interaction tasks designed to simulate how adolescents interact with same-age, unfamiliar peers. Trained observers independently rated adolescents on observed social skills within these interactions. Both parents and adolescents completed parallel surveys of social anxiety and ADHD symptoms, which we used to identify social anxiety + ADHD adolescents as well as other combinations of social anxiety and ADHD symptoms (i.e., neither, elevated on one but not the other). Adolescents with social anxiety + ADHD displayed significantly lower social skills, relative to all other groups. Among adolescents, social anxiety + ADHD may have a compounding effect on social skills. As such, therapists working with social anxiety + ADHD adolescents should probe for peer-related impairments and factors implicated in the development and maintenance of these impairments.

Integrating multi-informant reports of youth mental health: A construct validation test of Kraemer and colleagues’ (2003) Satellite Model

Accurately assessing youth mental health involves obtaining reports from multiple informants who typically display low levels of correspondence. This low correspondence may reflect situational specificity. That is, youth vary as to where they display mental health concerns and informants vary as to where and from what perspective they observe youth. Despite the frequent need to understand and interpret these informant discrepancies, no consensus guidelines exist for integrating informants’ reports. The path to building these guidelines starts with identifying factors that reliably predict the level and form of these informant discrepancies, and do so for theoretically and empirically relevant reasons. Yet, despite the knowledge of situational specificity, few approaches to integrating multi-informant data are well-equipped to account for these factors in measurement, and those that claim to be well-positioned to do so have undergone little empirical scrutiny. One promising approach was developed roughly 20 years ago by Kraemer and colleagues (2003). Their Satellite Model leverages principal components analysis (PCA) and strategic selection of informants to instantiate situational specificity in measurement, namely components reflecting variance attributable to the context in which informants observe behavior (e.g., home/non-home), the perspective from which they observe behavior (e.g., self/other), and behavior that manifests across contexts and perspectives (i.e., trait). The current study represents the first construct validation test of the Satellite Model. A mixed-clinical/community sample of 134 adolescents and their parents completed six parallel surveys of adolescent mental health. Adolescents also participated in a series of simulated social interactions with research personnel trained to act as same-age, unfamiliar peers. A third informant (unfamiliar untrained observer) viewed these interactions and completed the same surveys as parents and adolescents. We applied the Satellite Model to each set of surveys and observed high internal consistency estimates for each of the six-item trait (α = 0.90), context (α = 0.84), and perspective (α = 0.83) components. Scores reflecting the trait, context, and perspective components displayed distinct patterns of relations to a battery of criterion variables that varied in the context, perspective, and source of measurement. The Satellite Model instantiates situational specificity in measurement and facilitates unifying conceptual and measurement models of youth mental health.

Change in Adolescents' Perceived ADHD Symptoms Across 17 Days of Ecological Momentary Assessment

OBJECTIVE

To test whether adolescents' perceived ADHD symptoms may improve while monitoring them throughout the day.

METHOD

In a sample of 90 adolescents (Mage = 14.7; 66% boys, 34% girls; 76.7% White, 13.3% Black or African American, 8.9% more than one race, 1.1% "other") treated for ADHD by their pediatricians, this study examined: (1) whether self-rated ADHD symptoms decreased across 17 days of 4 times daily ecological momentary assessment (EMA) of symptoms and (2) whether completing versus missing an EMA survey was associated with lower self-rated ADHD symptoms in the subsequent hours.

RESULTS

Multilevel regression analyses showed that, on average, adolescents' perceived ADHD symptoms (inattention, hyperactivity, impulsivity, and total across domains) decreased across 17 days of EMA. Within person, symptoms were lower following completed versus missed EMA surveys. Significant moderating effects showed that the effect of completing the prior EMA survey weakened across the day and over the course of the 17 days.

CONCLUSIONS

This study is the first to document acute improvements in self-rated ADHD symptoms using EMA in adolescents' naturalistic environments. Symptom monitoring throughout the day may help adolescents improve their day-to-day ADHD, at least acutely, and holds promise as one component of mobile-health ADHD interventions.

How Robust Is the p Factor? Using Multitrait-Multimethod Modeling to Inform the Meaning of General Factors of Youth Psychopathology

We used multitrait-multimethod (MTMM) modeling to examine general factors of psychopathology in three samples of youth (Ns = 2119, 303, 592) for whom three informants reported on the youth's psychopathology (e.g., child, parent, teacher). Empirical support for the p-factor diminished in multi-informant models compared with mono-informant models: the correlation between externalizing and internalizing factors decreased and the general factor in bifactor models essentially reflected externalizing. Widely used MTMM-informed approaches for modeling multi-informant data cannot distinguish between competing interpretations of the patterns of effects we observed, including that the p-factor reflects, in part, evaluative consistency bias or that psychopathology manifests differently across contexts (e.g., home vs. school). Ultimately, support for the p-factor may be stronger in mono-informant designs, although it is does not entirely vanish in multi-informant models. Instead, the general factor of psychopathology in any given mono-informant model likely reflects a complex mix of variances, some substantive and some methodological.

Adolescent Safety Behaviors and Social Anxiety: Links to Psychosocial Impairments and Functioning with Unfamiliar Peer Confederates

Socially anxious adolescents often endure anxiety-provoking situations using safety behaviors: strategies for minimizing in-the-moment distress (e.g., avoiding eye contact, rehearsing statements before entering a conversation). Studies linking safety behaviors to impaired functioning have largely focused on adults. In a sample of one hundred thirty-four 14 to 15 year-old adolescents, we tested whether levels of safety behaviors among socially anxious adolescents relate to multiple domains of impaired functioning. Adolescents, parents, and research personnel completed survey measures of safety behaviors and social anxiety, adolescents and parents reported about adolescents' evaluative fears and psychosocial impairments, and adolescents participated in a set of tasks designed to simulate social interactions with same-age, unfamiliar peers. Relative to other adolescents in the sample, adolescents high on both safety behaviors and social anxiety displayed greater psychosocial impairments, evaluative fears, and observed social skills deficits within social interactions. These findings have important implications for assessing and treating adolescent social anxiety.

Unfamiliar Untrained Observers' Ratings of Adolescent Safety Behaviors Within Social Interactions with Unfamiliar Peer Confederates

Adolescents experiencing social anxiety often engage in safety behaviors-covert avoidance strategies for managing distress (e.g., avoiding eye contact)-that factor into the development and maintenance of their concerns. Prior work supports the psychometric properties of the Subtle Avoidance Frequency Examination (SAFE), a self-report survey of safety behaviors. Yet, we need complementary methods for assessing these behaviors within contexts where adolescents often experience concerns, namely, interactions with unfamiliar peers. Recent work indicates that, based on short, direct social interactions with adolescents, individuals posing as unfamiliar peers (i.e., peer confederates) and without assessment training can capably report about adolescent social anxiety. We built on prior work by testing whether we could gather valid SAFE reports from unfamiliar untrained observers (UUOs), who observed adolescents within archived recordings of these short social interactions. A mixed clinical/community sample of 105 adolescents self-reported on their functioning and participated in a series of social interaction tasks with peer confederates, who also provided social anxiety reports about the adolescent. Based on video recordings of these tasks, trained independent observers rated adolescents' observed social skills, and an additional set of UUOs completed SAFE reports of these same adolescents. Unfamiliar untrained observers' SAFE reports (a) related to adolescents' SAFE self-reports, (b) distinguished adolescents on clinically elevated social anxiety concerns, (c) related to trained independent observers' ratings of adolescent social skills within interactions with peer confederates, and (d) related to adolescents' self-reported arousal within these same interactions. Our findings support use of unfamiliar observers' perspectives to understand socially anxious adolescents' interpersonal functioning.

Using Evaluative Criteria to Review Youth Anxiety Measures, Part II: Parent-Report

This Evidence Base Update of parent-report measures of youth anxiety symptoms is a companion piece to our update on youth self-report anxiety symptom measures (Etkin et al., 2021). We rate the psychometric properties of the parent-report measures as Adequate, Good, or Excellent using criteria developed by Hunsley and Mash (2008) and Youngstrom et al. (2017). Our review reveals that the evidence base for parent-report measures is considerably less developed compared with the evidence base for youth self-report measures. Nevertheless, several measures, the parent-report Screen for Child Anxiety-Related Emotional Disorders, Multidimensional Anxiety Scale for Children, and Spence Children's Anxiety Scale, were found to have Good to Excellent psychometric properties. We conclude our review with suggestions about which parent-report youth anxiety measures are best suited to perform different assessment functions and directions for additional research to expand and strengthen the evidence base.

Using Evaluative Criteria to Review Youth Anxiety Measures, Part I: Self-Report

Evidence-based assessment serves several critical functions in clinical child psychological science, including being a foundation for evidence-based treatment delivery. In this Evidence Base Update, we provide an evaluative review of the most widely used youth self-report measures assessing anxiety and its disorders. Guided by a set of evaluative criteria (De Los Reyes & Langer, 2018), we rate the measures as Excellent, Good, or Adequate across their psychometric properties (e.g., construct validity). For the eight measures evaluated, most ratings assigned were Good followed by Excellent, and the minority of ratings were Adequate. We view these results overall as positive and encouraging, as they show that these youth anxiety self-report measures can be used with relatively high confidence to accomplish key assessment functions. Recommendations and future directions for further advancements to the evidence base are discussed.