Screening for Student Mental Health Risk: Diagnostic Accuracy, Measurement Invariance, and Predictive Validity of the Social, Academic, and Emotional Behavior Risk Screener-Student Rating Scale (SAEBRS-SRS)

Gender, racial-ethnic, and socioeconomic disparities in the development of social-emotional competence among elementary school students

Social-emotional competence (SEC) has been demonstrated to be a crucial factor for student mental health and is malleable through the high-quality implementation of effective school-based social and emotional learning (SEL) programs. SEL is now widely practiced in the United States as a Tier 1 strategy for the entire student body, yet it remains unclear whether disparities exist in the development of SEC across socio-culturally classified subgroups of students. Also, despite the field's widespread concern about teacher bias in assessing SEC within diverse student bodies, little evidence is available on the measurement invariance of the SEC assessment tools used to explore and facilitate SEC development. Based on a sociocultural view of student SEC development, this study aimed to measure and examine the extent to which gender, racial-ethnic, and socioeconomic disparities exist in SEC developmental trajectories during elementary school years. Specifically, using 3 years of SEC assessment data collected from a districtwide SEL initiative (N = 5452; Grades K-2 at baseline; nine measurement occasions), this study (a) tested the measurement invariance of a widely-used, teacher-rated SEC assessment tool (DESSA-Mini) across student gender, race and ethnicity, and socioeconomic status (SES); and (b) examined the extent to which multiyear SEC growth trajectories differed across these subgroups under a routine SEL practice condition. The invariance testing results supported strict factorial invariance of the DESSA-Mini across all the examined subgroups, thereby providing a foundation for valid cross-group comparisons of student SEC growth. The piecewise latent growth modeling results indicated that boys (vs. girls), Black students (vs. White students), Hispanic students (vs. White students), and low-income students (vs. middle-to-high-income students) started with a lower level of SEC, with these gaps being sustained or slightly widened throughout 3 elementary school years. Based on these findings, this study calls for future research that can inform practice efforts to ensure equitable SEC assessments and produce more equitable SEL outcomes, thereby promoting equity in school mental health.

Multi-informant Assessment of Internalizing Concerns: Rater Concordance and Implications for Decision-Making

Rising rates of mental health challenges among youths have become a significant concern following the COVID 19 pandemic. Although strong evidence supports the implementation of universal screening as a preventative approach to address unmet mental health concerns, the research is less clear surrounding the use of such data in decision-making processes when significant discrepancies between informants (e.g., students and teachers) exist. The purpose of the study was twofold. First, the study aimed to determine the degree of rater concordance between teachers and students on students' internalizing concerns. The second objective was to determine whether concordance on internalizing behaviors differs across ages/grades and if this differentially impacts distal (i.e., academic) outcomes. Results indicated that teachers and students demonstrated limited agreement on ratings of internalizing behaviors. However, when students and teachers agreed, higher and more positive emotional behaviors were linked to higher reading/math performance. Furthermore, patterns of informant dis/agreement and relationships between internalizing concerns and academic outcomes were similar across grade levels. Implications and areas for future research are discussed.

Supporting School Mental Health Providers: Evidence from a Short-Term Telementoring Model

Background

To support student mental health, school staff must have knowledge of evidence-based practices and the capacity to implement them. One approach used to address this challenge is a group-based telementoring model called Extension for Community Healthcare Outcomes (ECHO). In other applications (e.g., healthcare settings), ECHO has been shown to increase healthcare professionals' self-efficacy and knowledge of evidence-based practices leading to improved patient outcomes.

Objectives

This study examined the potential for ECHO to be used as a method for increasing school staff engagement and knowledge of evidence-based school mental health practices.

Methods

Using a quasi-experimental design, this study compared outcomes across two professional development experiences aimed at promoting school staff ability to provide evidence-based mental health services. School staff from four school districts participated in a school mental health training initiative. All participants (N = 57) had access to asynchronous, online mental health modules. A sub-sample (n = 33) was also offered monthly ECHO sessions.

Results

Tests of group difference in outcomes revealed significant increases in engagement with online learning (d = 0.58) and satisfaction (d = 0.82) for those who participated in ECHO as compared to those who did not. Knowledge about evidence-based practices was not significantly different between groups.

Conclusions

Results suggest that group-based telementoring may be a promising approach for improving engagement and satisfaction with training initiatives aimed at promoting evidence-based school mental health practices. However, further study of ProjectECHO using experimental designs is needed to make causal inferences about its effect on provider outcomes.

Examining the validity of the Early Identification System - Student Version for screening in an elementary school sample

As many as 1 in 5 youth in the United States experience social, emotional, and behavioral problems. However, many students with mental health concerns are unidentified and do not receive adequate care. The purpose of this study was to evaluate the factor structure, measurement invariance, and the concurrent and predictive validity of the Early Identification System-Student Report (EIS-SR), a screener for social, emotional, and behavioral problems, using a sample of over 5000 students from Grades 3 to 5. The EIS-SR was developed by using extant literature on the risk indicators that lead to social, emotional, and behavioral challenges among children and youth. As expected, seven subscales were identified as having adequate factor loadings. Furthermore, the measure was determined to be invariant across grade level (n = 5005), gender (n = 5005), and between Black and White students (n = 1582). The concurrent validity of the Internalizing Behavior, Attention and Academic Issues, Emotion Dysregulation, and School Disengagement subscales was supported by correlations with comparable subscales of the Behavior Assessment System for Children-3rd Edition (BASC-3; n = 382). Additionally, the EIS-SR subscales administered in the fall of the school year were predictive of important outcomes in spring, including attendance (n = 4780), disciplinary referrals (n = 4938), bully victimization (n = 4670), math academic achievement scores (n = 4736), and reading (n = 4772) academic achievement scores. The EIS-SR holds promise as a feasible and technically adequate screening tool for use in elementary schools.

Does Test Anxiety Predispose Poor School-Related Wellbeing and Enhanced Risk of Emotional Disorders?

Background

Previous studies have shown that children and adolescents who report high levels of test anxiety also report symptoms of, and meet clinical criteria for, emotion disorders (anxiety and depression). However, the directionality of this relation cannot be established from existing studies: Is high test anxiety predisposing persons at elevated risk for developing emotion disorders or vice versa? In the present study, we addressed this question in a sample of adolescents. In addition to the risk of developing an emotion disorder, based on the Dual Factor Model of Mental Health, we also considered school-related wellbeing.

Method

Self-reported data were collected over two waves from 1198 participants, aged 16–19 years, in upper secondary education.

Results

Data were analysed using a structural equation model controlling for gender and age. We found reciprocal relations between test anxiety and elevated risk for developing emotion disorders, and between school-related wellbeing and elevated risk for developing emotion disorders. School-related wellbeing was negatively related to subsequent test anxiety but not vice versa.

Conclusions

Our findings imply that there would be downstream benefits to improved mental health from using interventions to address test anxiety but also, from addressing emotion disorders, to improve school-related wellbeing and test anxiety.

The Development and Validation of a New Multidimensional Test Anxiety Scale (MTAS)

Abstract. Although test anxiety has a long history in the educational and psychological literature there is a lack of census over its dimensionality. The aim of the present study was to clarify the dimensionality of test anxiety and develop a new instrument to reflect this dimensionality. Across two empirical studies we tested and refined a new multidimensional instrument comprising of two cognitive dimensions (Worry and Cognitive Interference) and two affective-physiological dimensions (Tension and Physiological Indicators). In both studies, four-correlated-factors and higher order models showed a good fit to the data. Test anxiety was positively related to an existing test anxiety measure (the Test Anxiety Inventory) and an elevated risk of mental health problems, and negatively related to school well-being and examination performance. This new instrument will prove a welcome addition for practitioners, to assist in the identification of highly test anxious students who may require support or intervention, and test anxiety researchers.

Multi-informant universal screening: Evaluation of rater, item, and construct variance using a trifactor model

Universal screening is a proactive method for identifying student risk, yet remains under-utilized in school systems. Instead, many schools rely on teacher reports and referrals without accounting for different informant perspectives. In the current study, multi-informant universal screening in evaluated using a trifactor model. The study utilized the Social, Academic, and Emotional Behavior Risk Screener (SAEBRS), specifically the teacher (SAEBRS-TRS) and student (mySAEBRS) self-report forms, with items indicating risk for social, academic, and emotional behavior. Data from a national sample of over 24,000 K-12 teacher-student dyads were used to examine the extent and variance of discrepant reports between students and teachers of common, perspective, and item factors. Results demonstrated that informant perspective factors were a strong predictor for student and teacher emotional behavior item ratings. Whereas age had a positive effect on younger student reports of risk on the behavior items compared to older student reports, teachers showed the opposite effect. The teacherperspective of social and emotional behaviors of students was predicted by gender. Implications and directions for future research are further discussed.