Agreement in Youth-Parent Perceptions of Parenting Behaviors: A Case for Testing Measurement Invariance in Reporter Discrepancy Research

The Associations Between Parenting and Bullying Among Children and Adolescents: A Systematic Review and Meta-Analysis

Parenting styles are closely related to bullying behavior in children and adolescents. However, differences in study design and inconsistent results create uncertainty regarding the relationship between parenting and bullying. This study aimed to evaluate the associations between four parenting styles and bullying perpetration/victimization through a meta-analysis, identifying sources of study heterogeneity by examining moderating effects. This meta-analysis included 107 studies with 624 effect sizes and 162203 participants (49.28% female, Mage = 13.51, SDage = 2.56). Results indicated that positive parenting was negatively correlated with bullying perpetration and victimization, while negative/harsh parenting and uninvolved parenting were positively correlated with bullying perpetration and victimization. A positive correlation was also found between psychologically controlling parenting and bullying victimization (not perpetration). Significant moderating variables included the identity of the caregiver, country of origin, ethnic group, reporter of parenting, reporter of bullying, and measure of bullying. Specifically, the mother's psychological control was more related to bullying perpetration and victimization than the father's. Compared to other countries and ethnic groups, the relationships between psychologically controlling parenting or negative/harsh parenting and bullying were more positive in studies of Chinese and Asians. The relationship between negative/harsh parenting and bullying demonstrated a greater effect size in self-reported measures of parenting and bullying. Finally, a stronger correlation was found between negative/harsh parenting and bullying victimization when using the Olweus Bully/Victim Questionnaire to measure bullying. The current study deepens the understanding of the relationship between different parenting styles and bullying, emphasizing that adopting appropriate parenting, particularly positive parenting behaviors, helps mitigate bullying issues and achieve positive developmental outcomes for children and adolescents.

Associations Between Internet-Specific Parenting, General Parenting, and Adolescents' Online Behaviors: A Cross-Lagged Panel Network Analysis

Parents play a crucial role in adolescents' Internet use. Both general parenting (i.e., autonomy-supportive and controlling parenting) and Internet-specific parenting (i.e., restrictive mediation, active mediation, and parental encouragement) are related to adolescents' online behaviors. However, existing studies have focused either on an Internet-specific parenting or general parenting strategy and have neglected their interaction, failing to capture the intricate nature of the parenting context of youth's online behaviors. Few studies have examined parental encouragement or acknowledged the bidirectional influence of parenting on adolescents' online behaviors. To address this gap, this study employed a cross-lagged panel network model to examine the associations among restrictive and active mediation, parental encouragement, and autonomy-supportive and controlling parenting, as well as the interplay of all five parenting strategies with adolescents' online behaviors. A total of 564 Chinese students (51.1% male; mean age = 14.54, SD = 0.7) completed the survey at two time points. The results indicate that in most cases, previous online behaviors are significant and strong predictors of subsequent parenting strategies and not vice versa, corroborating the child effect. The parent and reciprocal effects were observed in the problematic smartphone-use domain, suggesting that the effects may differ for distinct behavioral domains. The effects of parental mediation extend beyond parental encouragement, implying that risk-prevention-related parenting is an effective means of guiding adolescents' online behaviors. Autonomy-relevant general parenting is closely related to active mediation and parental encouragement, while restrictive general parenting is closely related to restrictive mediation, suggesting a consistency between Internet-specific and general parenting strategies.

Network analysis of maternal parenting practices and adolescent mental health problems: a longitudinal study

BACKGROUND

An extensive literature has shown a strong connection between maternal parenting practices and adolescent mental health problems. However, it has been difficult for previous research to map a dynamic concurrent and prospective relationships within and between types of parenting practices and adolescent mental health problems. The present study addressed these issues using a network analysis approach and a longitudinal design.

METHODS

This study involved 591 Chinese adolescents (249 males; mean age at T1 = 13.53) and their mothers (mean age at T1 = 39.71) at two time points (T1 and T2) with eighteen months apart. Mothers reported their parenting practices including warmth, monitoring, inductive reasoning, hostility, and harshness, while adolescents reported their mental health problems including anxiety, depression, aggression, and conduct problems. Network analysis was conducted for contemporaneous networks at T1 and T2 and temporal networks from T1 to T2.

RESULTS

The contemporaneous networks revealed the negative association between monitoring and conduct problems served as the main pathway through which parenting practices and adolescent mental health mutually influenced each other, and further, warmth was the most influential parenting practice on adolescent mental health. The temporal network revealed that maternal hostility exerted the most influence on adolescent mental health problems, whereas adolescents' depression was most influenced by maternal parenting practices. Moreover, maternal hostility was most predicted by maternal harshness.

CONCLUSIONS

This study presents a novel perspective to gain a better understanding of the dynamics between and within maternal parenting practices and adolescent mental health problems. Findings highlight maternal harshness and warmth as potential prevention and intervention targets for adolescent mental health problems.

Measurement Invariance of Alabama Parenting Questionnaire Across Age, Gender, Clinical Status, and Informant

This study aimed to investigate the measurement invariance of the Alabama Parenting Questionnaire (for both long [APQ-lg] and short [APQ-9] forms) across age, gender, clinical status, and informant (i.e., parent vs. child reports). The sample was composed of adolescents (community sample: N = 1,746; clinical sample: N = 166) and parents (N = 149). The analyses were conducted in R. Measurement invariance was assessed via multi-group confirmatory factor analysis, equivalence test, and subsampling approach. The original model of APQ-lg (five factors) showed a significantly better fit than other concurrent models (five concurrent models were specified, based on prior literature). For APQ-lg, we found measurement invariance across gender and partial measurement invariance across age, clinical status, and informant. For APQ-9, we confirmed the measurement invariance across gender and clinical status, while across age and informant partial measurement invariance was attested. Overall, our study indicated that APQ-lg and APQ-9 are two valid tools for measuring parenting practices with some caveats.

The Operations Triad Model and Youth Mental Health Assessments: Catalyzing a Paradigm Shift in Measurement Validation

Researchers strategically assess youth mental health by soliciting reports from multiple informants. Typically, these informants (e.g., parents, teachers, youth themselves) vary in the social contexts where they observe youth. Decades of research reveal that the most common data conditions produced with this approach consist of discrepancies across informants' reports (i.e., informant discrepancies). Researchers should arguably treat these informant discrepancies as domain-relevant information: data relevant to understanding youth mental health domains (e.g., anxiety, depression, aggression). Yet, historically, in youth mental health research as in many other research areas, one set of paradigms has guided interpretations of informant discrepancies: Converging Operations and the Multi-Trait Multi-Method Matrix (MTMM). These paradigms (a) emphasize shared or common variance observed in multivariate data, and (b) inspire research practices that treat unique variance (i.e., informant discrepancies) as measurement confounds, namely random error and/or rater biases. Several yearsw ago, the Operations Triad Model emerged to address a conceptual problem that Converging Operations does not address: Some informant discrepancies might reflect measurement confounds, whereas others reflect domain-relevant information. However, addressing this problem requires more than a conceptual paradigm shift beyond Converging Operations. This problem necessitates a paradigm shift in measurement validation. We advance a paradigm (Classifying Observations Necessitates Theory, Epistemology, and Testing [CONTEXT]) that addresses problems with using the MTMM in youth mental health research. CONTEXT optimizes measurement validity by guiding researchers to leverage (a) informants that produce domain-relevant informant discrepancies, (b) analytic procedures that retain domain-relevant informant discrepancies, and (c) study designs that facilitate detecting domain-relevant informant discrepancies.

Longitudinal Linkages Between Parent-Child Discrepancies in Reports on Parental Autonomy Support and Informants' Depressive Symptoms

Although parent-child discrepancies in reports of parenting are known to be associated with child depressive symptoms, the direction of causality is unknown. To address this knowledge gap, this study contributes to existing literature by examining longitudinal within-family linkages between parent-child discrepancies in their reports on autonomy support and depressive symptoms of children, while also assessing these linkages with parents' depressive symptoms. In addition, this study explored whether these linkages differ for father- versus mother-child discrepancies. Longitudinal data (six annual waves) of 497 adolescents (56.9% boys, M_age at T₁ = 13.03, SD = 0.46), their mothers (N = 495), and their fathers (N = 446) of the Dutch study Research on Adolescent Development and Relationships (RADAR) were used. Counter to expectations, the results of a Random Intercept Cross-Lagged Panel Model provided no evidence for within-family cross-lagged effects. Instead, stable differences between families explained linkages; in families where children reported on average higher levels of depressive symptoms, children also reported lower levels of autonomy support relative to their parents. There were no associations between parent-child discrepancies and parents' depressive symptoms. Thus, the findings suggest that depressive symptoms are neither a consequence, nor a predictor of parent-child discrepancies in adolescence. The hypotheses and analytical plan of this study were preregistered in a project on the Open Science Framework.

How are parenting practices associated with bullying in adolescents? A cross-sectional study

BACKGROUND

Parenting styles have been previously associated with bullying, but some parenting practices have not received strong attention in the literature. We aimed to assess how parenting practices are associated with cyberbullying and traditional bullying involvement in adolescents.

METHOD

A cross-sectional survey of 2,218 secondary-school students in London (UK) was conducted. The Olweus Bully/Victim Questionnaire and the Alabama Parenting Questionnaire (APQ-child form) were used.

RESULTS

Positive parenting significantly protected against cyberbullying involvement but not against traditional bullying. Inconsistent discipline was associated with being a cyberbully but not being a traditional one. Lower levels of monitoring were associated with being a cyberbully, a cyberbully-victim, a traditional bully, or a traditional bully-victim.

CONCLUSIONS

Parenting practices seem to be more relevant in cyberbullying than traditional bullying. Effective parenting practices such as positive parenting deserve attention as a potentially modifiable factor to protect against cyberbullying involvement. Ineffective parenting practices such as inconsistent discipline are relevant in cyberaggression, whereas poor monitoring is associated with both cyberbullying and traditional bullying. Clinical and research implications are discussed.

Conceptual, methodological, and measurement factors that disqualify use of measurement invariance techniques to detect informant discrepancies in youth mental health assessments

On page 1 of his classic text, Millsap (2011) states, "Measurement invariance is built on the notion that a measuring device should function the same way across varied conditions, so long as those varied conditions are irrelevant [emphasis added] to the attribute being measured." By construction, measurement invariance techniques require not only detecting varied conditions but also ruling out that these conditions inform our understanding of measured domains (i.e., conditions that do not contain domain-relevant information). In fact, measurement invariance techniques possess great utility when theory and research inform their application to specific, varied conditions (e.g., cultural, ethnic, or racial background of test respondents) that, if not detected, introduce measurement biases, and, thus, depress measurement validity (e.g., academic achievement and intelligence). Yet, we see emerging bodies of work where scholars have "put the cart before the horse" when it comes to measurement invariance, and they apply these techniques to varied conditions that, in fact, may reflect domain-relevant information. These bodies of work highlight a larger problem in measurement that likely cuts across many areas of scholarship. In one such area, youth mental health, researchers commonly encounter a set of conditions that nullify the use of measurement invariance, namely discrepancies between survey reports completed by multiple informants, such as parents, teachers, and youth themselves (i.e., informant discrepancies). In this paper, we provide an overview of conceptual, methodological, and measurement factors that should prevent researchers from applying measurement invariance techniques to detect informant discrepancies. Along the way, we cite evidence from the last 15 years indicating that informant discrepancies reflect domain-relevant information. We also apply this evidence to recent uses of measurement invariance techniques in youth mental health. Based on prior evidence, we highlight the implications of applying these techniques to multi-informant data, when the informant discrepancies observed within these data might reflect domain-relevant information. We close by calling for a moratorium on applying measurement invariance techniques to detect informant discrepancies in youth mental health assessments. In doing so, we describe how the state of the science would need to fundamentally "flip" to justify applying these techniques to detect informant discrepancies in this area of work.

Integrating multi-informant reports of youth mental health: A construct validation test of Kraemer and colleagues' (2003) Satellite Model

Accurately assessing youth mental health involves obtaining reports from multiple informants who typically display low levels of correspondence. This low correspondence may reflect situational specificity. That is, youth vary as to where they display mental health concerns and informants vary as to where and from what perspective they observe youth. Despite the frequent need to understand and interpret these informant discrepancies, no consensus guidelines exist for integrating informants' reports. The path to building these guidelines starts with identifying factors that reliably predict the level and form of these informant discrepancies, and do so for theoretically and empirically relevant reasons. Yet, despite the knowledge of situational specificity, few approaches to integrating multi-informant data are well-equipped to account for these factors in measurement, and those that claim to be well-positioned to do so have undergone little empirical scrutiny. One promising approach was developed roughly 20 years ago by Kraemer and colleagues (2003). Their Satellite Model leverages principal components analysis (PCA) and strategic selection of informants to instantiate situational specificity in measurement, namely components reflecting variance attributable to the context in which informants observe behavior (e.g., home/non-home), the perspective from which they observe behavior (e.g., self/other), and behavior that manifests across contexts and perspectives (i.e., trait). The current study represents the first construct validation test of the Satellite Model. A mixed-clinical/community sample of 134 adolescents and their parents completed six parallel surveys of adolescent mental health. Adolescents also participated in a series of simulated social interactions with research personnel trained to act as same-age, unfamiliar peers. A third informant (unfamiliar untrained observer) viewed these interactions and completed the same surveys as parents and adolescents. We applied the Satellite Model to each set of surveys and observed high internal consistency estimates for each of the six-item trait (α = 0.90), context (α = 0.84), and perspective (α = 0.83) components. Scores reflecting the trait, context, and perspective components displayed distinct patterns of relations to a battery of criterion variables that varied in the context, perspective, and source of measurement. The Satellite Model instantiates situational specificity in measurement and facilitates unifying conceptual and measurement models of youth mental health.

Latent Congruence Model to Investigate Similarity and Accuracy in Family Members' Perception: The Challenge of Cross-National and Cross-Informant Measurement (Non)Invariance

Several methods are available to answer questions regarding similarity and accuracy, each of which has specific properties and limitations. This study focuses on the Latent Congruence Model (LCM; Cheung, 2009), because of its capacity to deal with cross-informant measurement invariance issues. Until now, no cross-national applications of LCM are present in the literature, perhaps because of the difficulty to deal with both cross-national and cross-informant measurement issues implied by those models. This study presents a step-by-step procedure to apply LCM to dyadic cross-national research designs controlling for both cross-national and cross-informant measurement invariance. An illustrative example on parent–child support exchanges in Italy and Germany is provided. Findings help to show the different possible scenarios of partial invariance, and a discussion related to how to deal with those scenarios is provided. Future perspectives in the study of parent–child similarity and accuracy in cross-national research will be discussed.

Approximate Measurement Invariance of Willingness to Sacrifice for the Environment Across 30 Countries: The Importance of Prior Distributions and Their Visualization

Nationwide opinions and international attitudes toward climate and environmental change are receiving increasing attention in both scientific and political communities. An often used way to measure these attitudes is by large-scale social surveys. However, the assumption for a valid country comparison, measurement invariance, is often not met, especially when a large number of countries are being compared. This makes a ranking of countries by the mean of a latent variable potentially unstable, and may lead to untrustworthy conclusions. Recently, more liberal approaches to assessing measurement invariance have been proposed, such as the alignment method in combination with Bayesian approximate measurement invariance. However, the effect of prior variances on the assessment procedure and substantive conclusions is often not well understood. In this article, we tested for measurement invariance of the latent variable "willingness to sacrifice for the environment" using Maximum Likelihood Multigroup Confirmatory Factor Analysis and Bayesian approximate measurement invariance, both with and without alignment optimization. For the Bayesian models, we used multiple priors to assess the impact on the rank order stability of countries. The results are visualized in such a way that the effect of different prior variances and models on group means and rankings becomes clear. We show that even when models appear to be a good fit to the data, there might still be an unwanted impact on the rank ordering of countries. From the results, we can conclude that people in Switzerland and South Korea are most motivated to sacrifice for the environment, while people in Latvia are less motivated to sacrifice for the environment.

Measuring Dimensions of Family Interaction in Adolescence

Abstract. The aim of this study was to evaluate the convergent and discriminant validity of adolescent and parent ratings of family interaction. Adolescent and parent ratings of democratic parenting, parental warmth, and adolescent free disclosure were measured using a multitrait–multimethod confirmatory factor analytic approach. Participants included 3,959 Swedish youth in seventh grade (average age 13 years), with follow-up measurements in eighth and ninth grades. At each grade, findings provided support for trait discriminant validity and discriminant validity of methods. However, findings failed to provide support for convergent validity. Overall, the present findings suggest that measurement of family interactions should include the perspectives of both parents and adolescents because their perceptions of family interactions may represent different family interaction constructs.

Informant discrepancies in assessments of psychosocial functioning in school-based services and research: Review and directions for future research

Psychosocial functioning plays a key role in students' wellbeing and performance inside and outside of school. As such, techniques designed to measure and improve psychosocial functioning factor prominently in school-based service delivery and research. Given that the different contexts (e.g., school, home, community) in which students exist vary in the degree to which they influence psychosocial functioning, educators and researchers often rely on multiple informants to characterize intervention targets, monitor intervention progress, and inform the selection of evidence-based services. These informants include teachers, students, and parents. Across research teams, domains, and measurement methodologies, researchers commonly observe discrepancies among informants' reports. We review theory and research-occurring largely outside of school-based service delivery and research-that demonstrates how patterns of informant discrepancies represent meaningful differences that can inform our understanding of psychosocial functioning. In turn, we advance a research agenda to improve use and interpretation of informant discrepancies in school-based services and research.

Identifying Symptoms of Distress in Youth Living with Neurofibromatosis Type 1 (NF1)

Children and adolescents with Neurofibromatosis type 1 (NF1) are at increased risk for wide-ranging behavioral, developmental, and cognitive impairments and decreased quality of life. To date, no psychosocial screening tool has been developed to quickly assess the symptoms that 1) can be addressed during routine medical appointments in children with NF1, 2) can produce interpretable and actionable results, 3) can be integrated into medical care, and 4) can quickly identify patients at risk in order to better address that the provision of appropriate care are available. This study was conducted to test the overall usability of the Distress Thermometer (DT) and symptom checklist and concordance of DT ratings between pediatric patients, their caregivers and medical providers. Eighty youth (ages 7-21) living with NF1 completed the DT and an accompanying checklist. The findings of this study suggest the DT and symptom checklist was acceptable and feasible to complete in a clinic setting. A small subset reported high distress that required further assessment and intervention. Significant discordance between distress ratings of caregivers and children and healthcare providers was also found. Overall, the DT and accompanying symptom checklist provide important information to identify the presence of distress and contextualize the child's distress but is limited by not assessing whether these symptoms interfere with the child's daily life.

Measuring Anxiety in Children: The Importance of Separate Mother and Father Reports

Background

Previous research suggests that it is important to use parental reports when assessing children’s anxiety, but it remains unclear to what extent there are differences between mothers’ and fathers’ scores and whether these potential differences have any repercussions for the psychometric properties of the scale being used.

Objective

This study was conducted to investigate parental differences on the Parent version of the Screen for Child Anxiety Related Emotional Disorders-Revised (SCARED-RP), a rating scale for measuring child anxiety symptoms. The second aim was to re-examine the reliability and validity of the SCARED-RP, in light of these possible differences.

Methods

The SCARED-RP and the Child Behaviour Checklist (CBCL) were administered to parents of clinically anxious children (n = 81), and control children (n = 108). All children (n = 189) completed the SCARED-R.

Results

Significant correlations between mother and father reports were found within the clinically anxious sample. Mothers showed significantly more correspondence with their children in the control group than fathers. The SCARED-RP internal consistency on total scale was excellent (mothers: .94; fathers: .94) and moderate to good for all subscales (from .66 Situational-Environmental Phobia to .93 Animal Phobia). The SCARED-RP differentiated well between clinically anxious and control children (mother and father data). The concurrent validity was supported by strong correlations with the CBCL anxious-depressed scale.

Conclusion

Differences between mother and father reports suggest the importance of obtaining information from both parents separately. Furthermore, the SCARED-RP is a useful instrument for assessing children’s anxiety disorder symptoms in clinical and research settings.

Cross-Cultural Perspectives on Parent-Adolescent Discrepancies: Existing Findings and Future Directions

As summarized in this commentary, the first generation of cross-informant agreement research focused on perceptions of child and adolescent mental health. Contributions of this research include demonstrating that modest cross-informant agreement is a very robust phenomenon, utilizing numerous statistical approaches to measure degree of agreement, and identifying many factors that moderate agreement. An important focus of this work has been using multi-society international comparisons to examine cross-cultural similarities and differences in cross-informant agreement. The articles in this Special Issue represent a significant paradigm shift in which cross-informant agreement is examined as an independent variable predicting a wide variety of outcomes. Furthermore, moving beyond perceptions of adolescent mental health, these articles compare parent and adolescent perceptions of diverse aspects of family functioning (e.g., family conflict, parent-adolescent communication, family relationships, parental authority). Additionally, the research presented in this Special Issue employs innovative and sophisticated statistical techniques. Although the Special Issue represents some first steps toward considering cross-cultural aspects of perceptions of family functioning, much work still needs to be done in this area. Some suggestions for future research strategies to accomplish this goal conclude this commentary.

Introduction to the Special Issue: Discrepancies in Adolescent-Parent Perceptions of the Family and Adolescent Adjustment

Researchers commonly rely on adolescents' and parents' reports to assess family functioning (e.g., conflict, parental monitoring, parenting practices, relationship quality). Recent work indicates that these reports may vary as to whether they converge or diverge in estimates of family functioning. Further, patterns of converging or diverging reports may yield important information about adolescent adjustment and family functioning. This work is part of a larger literature seeking to understand and interpret multi-informant assessments of psychological phenomena, namely mental health. In fact, recent innovations in conceptualizing, measuring, and analyzing multi-informant mental health assessments might meaningfully inform efforts to understand multi-informant assessments of family functioning. Therefore, in this Special Issue we address three aims. First, we provide a guiding framework for using and interpreting multi-informant assessments of family functioning, informed by recent theoretical work focused on using and interpreting multi-informant mental health assessments. Second, we report research on adolescents' and parents' reports of family functioning that leverages the latest methods for measuring and analyzing patterns of convergence and divergence between informants' reports. Third, we report research on measurement invariance and its role in interpreting adolescents' and parents' reports of family functioning. Research and theory reported in this Special Issue have important implications for improving our understanding of the links between multi-informant assessments of family functioning and adolescent adjustment.