Understanding and using informants' reporting discrepancies of youth victimization: a conceptual model and recommendations for research

The validity of the multi-informant approach to assessing child and adolescent mental health

Child and adolescent patients may display mental health concerns within some contexts and not others (e.g., home vs. school). Thus, understanding the specific contexts in which patients display concerns may assist mental health professionals in tailoring treatments to patients' needs. Consequently, clinical assessments often include reports from multiple informants who vary in the contexts in which they observe patients' behavior (e.g., patients, parents, teachers). Previous meta-analyses indicate that informants' reports correlate at low-to-moderate magnitudes. However, is it valid to interpret low correspondence among reports as indicating that patients display concerns in some contexts and not others? We meta-analyzed 341 studies published between 1989 and 2014 that reported cross-informant correspondence estimates, and observed low-to-moderate correspondence (mean internalizing: r = .25; mean externalizing: r = .30; mean overall: r = .28). Informant pair, mental health domain, and measurement method moderated magnitudes of correspondence. These robust findings have informed the development of concepts for interpreting multi-informant assessments, allowing researchers to draw specific predictions about the incremental and construct validity of these assessments. In turn, we critically evaluated research on the incremental and construct validity of the multi-informant approach to clinical child and adolescent assessment. In so doing, we identify crucial gaps in knowledge for future research, and provide recommendations for "best practices" in using and interpreting multi-informant assessments in clinical work and research. This article has important implications for developing personalized approaches to clinical assessment, with the goal of informing techniques for tailoring treatments to target the specific contexts where patients display concerns. (PsycINFO Database Record

The validity of the multi-informant approach to assessing child and adolescent mental health

Child and adolescent patients may display mental health concerns within some contexts and not others (e.g., home vs. school). Thus, understanding the specific contexts in which patients display concerns may assist mental health professionals in tailoring treatments to patients' needs. Consequently, clinical assessments often include reports from multiple informants who vary in the contexts in which they observe patients' behavior (e.g., patients, parents, teachers). Previous meta-analyses indicate that informants' reports correlate at low-to-moderate magnitudes. However, is it valid to interpret low correspondence among reports as indicating that patients display concerns in some contexts and not others? We meta-analyzed 341 studies published between 1989 and 2014 that reported cross-informant correspondence estimates, and observed low-to-moderate correspondence (mean internalizing: r = .25; mean externalizing: r = .30; mean overall: r = .28). Informant pair, mental health domain, and measurement method moderated magnitudes of correspondence. These robust findings have informed the development of concepts for interpreting multi-informant assessments, allowing researchers to draw specific predictions about the incremental and construct validity of these assessments. In turn, we critically evaluated research on the incremental and construct validity of the multi-informant approach to clinical child and adolescent assessment. In so doing, we identify crucial gaps in knowledge for future research, and provide recommendations for "best practices" in using and interpreting multi-informant assessments in clinical work and research. This article has important implications for developing personalized approaches to clinical assessment, with the goal of informing techniques for tailoring treatments to target the specific contexts where patients display concerns. (PsycINFO Database Record

Family conflict, mood, and adolescents' daily school problems: moderating roles of internalizing and externalizing symptoms

Using daily diary data, this study examined cross-day associations between family conflict and school problems and tested mediating effects of daily negative mood and moderating effects of psychological symptoms. For 2 weeks, parents and adolescents (N = 106; Mage = 15.4) reported daily conflict; adolescents reported daily negative mood and school problems. Results indicated bidirectional, multiday spillover between parent-adolescent conflict and school problems with daily negative mood statistically accounting for spillover both within and across days. Externalizing symptoms strengthened links between father-adolescent conflict and school problems, whereas depressive and anxious symptoms strengthened links between parent-adolescent conflict and daily negative mood. By demonstrating cross-domain transmission of daily problems, these findings highlight the salience of everyday events as possible intervention targets.

The covariates of parent and youth reporting differences on youth secondary exposure to community violence

Survey data for studying youth's secondary exposure to community violence (i.e., witnessing or hearing violence in the community) come from both parents and their children. There are benefits of considering multiple informants in psychosocial assessments, but parents and youths often disagree about comparable information. These reporting differences present challenges for both researchers and clinicians. To shed new light on the individual, family, and neighborhood factors that contribute to parent and youth reporting differences regarding youth's secondary exposure to community violence, this study analyzed hierarchical item response models on a sample of youth respondents from the Project on Human Development in Chicago Neighborhoods. Participants were aged approximately 9, 12, and 15 years (trimodal distribution; mean age = 12.0 years) at baseline (N = 2,344; 49.6% female). Descriptive analyses indicated that parents significantly underestimated their children's exposure to community violence. Logistic hierarchical item response models indicated that absolute discrepancies between parent and youth reports were a function of youth demographic characteristics (male, Hispanic or African American as compared to white, age, 3rd as compared to 1st generation immigrant), individual difference factors (lower levels of self-control, higher levels of violent peer exposure), and family factors (lower household socioeconomic status). Parental under-reporting of youth's exposure to violence was associated with youth demographic characteristics (male, age, 2nd as compared to 3rd generation immigrant), family factors (lower levels of parental supervision), and neighborhood characteristics (higher levels of violence, less access to youth services). The results suggest that a constellation of individual and contextual factors may contribute to the understanding of parent and youth reporting differences. The findings speak to the utility of examining parent and youth reporting differences from a hierarchical lens.

Discrepancies between parent and adolescent beliefs about daily life topics and performance on an emotion recognition task

Parents and children and adolescents commonly disagree in their perceptions of a variety of behaviors, including the family relationship and environment, and child and adolescent psychopathology. To this end, numerous studies have examined to what extent increased discrepant perceptions-particularly with regard to perceptions of the family relationship and environment-predict increased child and adolescent psychopathology. Parents' and children and adolescents' abilities to decode and identify others' emotions (i.e., emotion recognition) may play a role in the link between discrepant perceptions and child and adolescent psychopathology. We examined parents' and adolescents' emotion recognition abilities in relation to discrepancies between parent and adolescent perceptions of daily life topics. In a sample of 50 parents and adolescents ages 14-to-17 years (M = 15.4 years, 20 males, 54 % African-American), parents and adolescents were each administered a widely used performance-based measure of emotion recognition. Parents and adolescents were also administered a structured interview designed to directly assess each of their perceptions of the extent to which discrepancies existed in their beliefs about daily life topics (e.g., whether adolescents should complete their homework and carry out household chores). Interestingly, lower parent and adolescent emotion recognition performance significantly related to greater parent and adolescent perceived discrepant beliefs about daily life topics. We observed this relation whilst accounting for adolescent age and gender and levels of parent-adolescent conflict. These findings have important implications for understanding and using informant discrepancies in both basic developmental psychopathology research and applied research in clinic settings (e.g., discrepant views on therapeutic goals).

Strategic objectives for improving understanding of informant discrepancies in developmental psychopathology research

Developmental psychopathology researchers and practitioners commonly conduct behavioral assessments using multiple informants' reports (e.g., parents, teachers, practitioners, children, and laboratory observers). These assessments often yield inconsistent conclusions about important questions in developmental psychopathology research, depending on the informant (e.g., psychiatric diagnoses and risk factors of disorder). Researchers have theorized why informant discrepancies exist and advanced methodological models of informant discrepancies. However, over 50 years of empirical data has uncovered little knowledge about these discrepancies beyond that they exist, complicate interpretations of research findings and assessment outcomes in practice, and correlate with some characteristics of the informants providing reports (e.g., demographics and mood levels). Further, recent studies often yield take-home messages about the importance of taking a multi-informant approach to clinical and developmental assessments. Researchers draw these conclusions from their work, despite multi-informant approaches to assessment long being a part of best practices in clinical and developmental assessments. Consequently, developmental psychopathology researchers and practitioners are in dire need of a focused set of research priorities with the key goal of rapidly advancing knowledge about informant discrepancies. In this paper, I discuss these research priorities, review work indicating the feasibility of conducting research addressing these priorities, and specify what researchers and practitioners would gain from studies advancing knowledge about informant discrepancies in developmental psychopathology research.

Discrepancies between parent and adolescent beliefs about daily life topics and performance on an emotion recognition task

Parents and children and adolescents commonly disagree in their perceptions of a variety of behaviors, including the family relationship and environment, and child and adolescent psychopathology. To this end, numerous studies have examined to what extent increased discrepant perceptions-particularly with regard to perceptions of the family relationship and environment-predict increased child and adolescent psychopathology. Parents' and children and adolescents' abilities to decode and identify others' emotions (i.e., emotion recognition) may play a role in the link between discrepant perceptions and child and adolescent psychopathology. We examined parents' and adolescents' emotion recognition abilities in relation to discrepancies between parent and adolescent perceptions of daily life topics. In a sample of 50 parents and adolescents ages 14-to-17 years (M = 15.4 years, 20 males, 54 % African-American), parents and adolescents were each administered a widely used performance-based measure of emotion recognition. Parents and adolescents were also administered a structured interview designed to directly assess each of their perceptions of the extent to which discrepancies existed in their beliefs about daily life topics (e.g., whether adolescents should complete their homework and carry out household chores). Interestingly, lower parent and adolescent emotion recognition performance significantly related to greater parent and adolescent perceived discrepant beliefs about daily life topics. We observed this relation whilst accounting for adolescent age and gender and levels of parent-adolescent conflict. These findings have important implications for understanding and using informant discrepancies in both basic developmental psychopathology research and applied research in clinic settings (e.g., discrepant views on therapeutic goals).

Testing informant discrepancies as predictors of early adolescent psychopathology: why difference scores cannot tell you what you want to know and how polynomial regression may

Multiple informants commonly disagree when reporting child and family behavior. In many studies of informant discrepancies, researchers take the difference between two informants' reports and seek to examine the link between this difference score and external constructs (e.g., child maladjustment). In this paper, we review two reasons why difference scores cannot serve as unambiguous predictors of outcomes. Further, we use polynomial regression analyses to both test the validity of difference scores and provide a more direct test of the hypothesis that discrepancies in parent and child reports predict child psychopathology. Data from 218 parent-adolescent dyads (M adolescent age = 11.5 years, 51 % female; 49 % European American, 47 % African American) were used to predict adolescent-reported antisocial behavior and depression from parent and adolescent reports of parent-adolescent conflict, parental knowledge, parental acceptance, adolescent rule-breaking behavior, and adolescent pubertal development. Results demonstrate that analyses using difference scores do not provide valid tests of the utility of informant discrepancies in predicting adolescent psychosocial maladjustment. However, interaction terms in polynomial regression analyses provide evidence that informant discrepancies predict child psychopathology. Parent-adolescent informant discrepancies predict adolescent psychopathology but researchers should avoid using difference scores to measure informant discrepancies. Polynomial regression analyses provide more comprehensive and accurate tests of whether informant discrepancies predict child and adolescent psychopathology.

Parent-youth discrepancies in ratings of youth victimization: associations with psychological adjustment

This study extends research examining the implications of parent-youth informant discrepancies on youth victimization. Latent class analysis (LCA) identified dyads distinguished by patterns of parent and youth report of victimization. Analyses examined how latent classes were related to adjustment (i.e., anxiety/depression, aggression, and delinquency) concurrently and at follow-up assessment (~2.5 years) in a socioeconomically and ethnically diverse sample. Participants were 485 youths (58.1% male; M age = 12.83 years, SD = 1.60) and their primary caregivers from the Project on Human Development in Chicago Neighborhoods. This study compared three classes of youths: (a) Parent > Youth (24.0%), (b) Youth > Parent (21.5%), and (c) Relative Agreement (54.5%). Findings did not support the hypothesis that groups reflecting parental underreporting of youth victimization experiences would show poor adjustment relative to all other classes longitudinally. Surprisingly, youths who self-reported lower levels of victimization than parents reported were at risk for maladjustment over time. This type of discrepant dyad may deserve more careful attention than previously considered in the literature.

Correlates of parent-youth discordance about youth-witnessed violence: a brief report

Studies have consistently demonstrated a lack of agreement between youth and parent reports regarding youth-witnessed violence (YWV). However, little empirical investigation has been conducted on the correlates of disagreement. Concordance between youth and parents about YWV was examined in 766 parent-youth dyads from the Longitudinal Studies of Child Abuse and Neglect (LONGSCAN). Results showed that significantly more youth (42%) than parents (15%) reported YWV. Among the dyads in which at least one informant reported YWV (N = 344), we assessed whether youth delinquency, parental monitoring, parent-child relationship quality, history of child maltreatment, income, and parental depression were predictive of parent-youth concordance. Findings indicated that youth engagement in delinquent activities was higher in the groups in which the youth reported violence exposure. More empirical study is needed to assess correlates of agreement in high-risk youth to better inform associations found between exposures and outcomes as well as practice and policy for violence exposed youth.

Principles underlying the use of multiple informants' reports

Researchers use multiple informants' reports to assess and examine behavior. However, informants' reports commonly disagree. Informants' reports often disagree in their perceived levels of a behavior ("low" versus "elevated" mood), and examining multiple reports in a single study often results in inconsistent findings. Although researchers often espouse taking a multi-informant assessment approach, they frequently address informant discrepancies using techniques that treat discrepancies as measurement error. Yet, recent work indicates that researchers in a variety of fields often may be unable to justify treating informant discrepancies as measurement error. In this review, the authors advance a framework (Operations Triad Model) outlining general principles for using and interpreting informants' reports. Using the framework, researchers can test whether or not they can extract meaningful information about behavior from discrepancies among multiple informants' reports. The authors provide supportive evidence for this framework and discuss its implications for hypothesis testing, study design, and quantitative review.

Parent-youth discordance about youth-witnessed violence: associations with trauma symptoms and service use in an at-risk sample

OBJECTIVE

Studies have consistently demonstrated a lack of agreement between youth and parent reports regarding youth-witnessed violence. However, little is known about whether disagreement is associated with poorer outcomes and less utilization of mental health services. The purpose of the current study was to examine disagreement among youth and parents about youth witnessed violence, and determine whether concordance predicted trauma symptoms and recognition of need and receipt of counseling services.

METHODS

Concordance about youth-witnessed violence was examined in 766 dyads from the Longitudinal Studies of Child Abuse and Neglect (LONGSCAN). Youth participants self-reported trauma symptoms, caregivers indicated youth need for and receipt of services. Both youth and parents provided information about youth-witnessed violence exposure in the last year.

RESULTS

Results showed youth and caregivers differed significantly about youth-witnessed violence. Specifically, 42% of youth reported youth-witnessed violence, compared to only 15% of parents. For those parents who reported youth-witnessed violence, only 29% reported an identified need for services and only 17% reported the youth had received any mental health services. Concordance between parent-youth dyads was associated with greater identified need for services but was not associated with the use of counseling services or trauma symptoms.

CONCLUSIONS

Youth who reported witnessing violence reported more frequent trauma symptoms regardless of concordance. Parents from dyads in which both informants reported youth-witnessed violence were more likely to endorse need for, but not receipt of counseling services. Given this association between youth-witnessed violence and mental health problems, more work is needed to identify barriers to concordance as well as service utilization.

Testing informant discrepancies as predictors of early adolescent psychopathology: why difference scores cannot tell you what you want to know and how polynomial regression may

Multiple informants commonly disagree when reporting child and family behavior. In many studies of informant discrepancies, researchers take the difference between two informants' reports and seek to examine the link between this difference score and external constructs (e.g., child maladjustment). In this paper, we review two reasons why difference scores cannot serve as unambiguous predictors of outcomes. Further, we use polynomial regression analyses to both test the validity of difference scores and provide a more direct test of the hypothesis that discrepancies in parent and child reports predict child psychopathology. Data from 218 parent-adolescent dyads (M adolescent age = 11.5 years, 51 % female; 49 % European American, 47 % African American) were used to predict adolescent-reported antisocial behavior and depression from parent and adolescent reports of parent-adolescent conflict, parental knowledge, parental acceptance, adolescent rule-breaking behavior, and adolescent pubertal development. Results demonstrate that analyses using difference scores do not provide valid tests of the utility of informant discrepancies in predicting adolescent psychosocial maladjustment. However, interaction terms in polynomial regression analyses provide evidence that informant discrepancies predict child psychopathology. Parent-adolescent informant discrepancies predict adolescent psychopathology but researchers should avoid using difference scores to measure informant discrepancies. Polynomial regression analyses provide more comprehensive and accurate tests of whether informant discrepancies predict child and adolescent psychopathology.

Examining the link between neighborhood context and parental messages to their adolescent children about violence

PURPOSE

Living in violent neighborhoods has been shown to alter adolescent's social cognitions and increase aggressive behavior. A similar process may also occur for parents and result in parental support of aggressive behavior. This research examines the influence of perceived neighborhood violence and neighborhood collective efficacy on parental attitudes toward violence and the messages they give their adolescent children about how to resolve interpersonal conflict.

METHOD

Data were collected from 143 African American parents and their adolescent children recruited from three inner-city middle schools to participate in a parenting intervention. Models were fit using structural equation modeling in Mplus.

RESULTS

Contrary to expectations, exposure to neighborhood violence was not predictive of either aggressive attitudes or conflict solutions for parents or adolescents. Rather, a mixed effect was found for neighborhood collective efficacy, with higher perceived neighborhood collective efficacy related to less violent attitudes for adolescents but not for parents. Collective efficacy also predicted the messages that parents gave their adolescents about interpersonal conflict, with higher collective efficacy related to messages that were less supportive of violence.

CONCLUSION

Parent and adolescent perception of neighborhood collective efficacy influences the messages that adolescents receive about interpersonal conflict resolution. This suggests that for parents living in violent neighborhoods, their appraisal of the neighborhood is more important in shaping conflict resolution messages than their own experiences with violence. Parent- and family-based programs to prevent youth violence need to address neighborhood factors that influence the messages adolescents receive about how to resolve conflict.