Challenges and ideas from a research program on high-quality, evidence-based practice in school mental health

Implementation strategies to promote measurement-based care in schools: evidence from mental health experts across the USA

BACKGROUND

Despite an established taxonomy of implementation strategies, minimal guidance exists for how to select and tailor strategies to specific practices and contexts. We employed a replicable method to obtain stakeholder perceptions of the most feasible and important implementation strategies to increase mental health providers' use of measurement-based care (MBC) in schools. MBC is the routine use of patient-reported progress measures throughout treatment to inform patient-centered, data-driven treatment adjustments.

METHODS

A national sample of 52 school mental health providers and researchers completed two rounds of modified Delphi surveys to rate the relevance, importance, and feasibility of 33 implementation strategies identified for school settings. Strategies were reduced and definitions refined using a multimethod approach. Final importance and feasibility ratings were plotted on "go-zone" graphs and compared across providers and researchers to identify top-rated strategies.

RESULTS

The initial 33 strategies were rated as "relevant" or "relevant with changes" to MBC in schools. Importance and feasibility ratings were high overall for both survey rounds; on a scale of 1 to 5, importance ratings (3.61-4.48) were higher than feasibility ratings (2.55-4.06) on average. Survey 1 responses resulted in a reduced, refined set of 21 strategies, and six were rated most important and feasible on Survey 2: (1) assess for readiness and identify barriers and facilitators; (2) identify and prepare champions; (3) develop a usable implementation plan; (4) offer a provider-informed menu of free, brief measures; (5) develop and provide access to training materials; and (6) make implementation easier by removing burdensome documentation tasks. Provider and researcher ratings were not significantly different, with a few exceptions: providers reported higher feasibility and importance of removing burdensome paperwork than researchers, providers reported higher feasibility of train-the trainer approaches than researchers, and researchers reported higher importance of monitoring fidelity than providers.

CONCLUSIONS

The education sector is the most common setting for child and adolescent mental health service delivery in the USA. Effective MBC implementation in schools has the potential to elevate the quality of care received by many children, adolescents, and their families. This empirically derived, targeted list of six implementation strategies offers potential efficiencies for future testing of MBC implementation in schools.

Promoting educator social emotional competence, well-being, and student-educator relationships: A pilot study

Educator mental health and well-being have received increased attention in response to the additional stress experienced during the coronavirus pandemic. Cultivating mental health and well-being can be facilitated by enhancing adult social emotional competencies. However, relatively limited research has explored how prevention programs promoting social emotional competencies have enhanced educator well-being and related attributes of self-care, efficacy, and skillful interactions with students. In this pilot study, we implemented and evaluated an innovative prevention program called Resilience in Schools and Educators (RISE) in eight Colorado schools with 53 educators. RISE builds knowledge and skills that promote educator social-emotional competencies, trauma responsivity, cultural responsivity, resilience, and well-being. The first study aim was to explore the fidelity and feasibility of the RISE program implemented in a school-based context. The second study aim was to explore whether RISE is associated with increases in educators' self-reported social emotional competencies, well-being, self-care practices, self-efficacy, and quality of interactions with students. As compared to field standards, facilitators reported high levels of fidelity and feasibility of RISE. Educators' pre- and post- self-report measures indicate significant improvements in social emotional competencies (emotional awareness, emotional clarity, non-reactivity, nonjudging), self-care practices, well-being, and student-educator conflict, with effect sizes indicating small to medium impacts. No findings emerged for self-efficacy or perceived closeness of student-teacher relationships. Theoretical and practical implications are discussed.

The Effect of Cognitive Behavioral Group Therapy on Children's Self-Esteem

(1) Background: Self-esteem plays an important role in developing emotional resilience and wellbeing in children. Yet, there has been little related research on Cognitive Behavioral Group Therapy on this topic. Our aims were to assess the effect of the Child Self-Esteem CBT (CSE-CBT) protocol on children's self-esteem in grades five and six; to assess the effect of the CSE-CBT protocol on the therapeutic process; and to explore the feasibility of delivering the CSE-CBT protocol in a school setting. (2) Methods: Eighty elementary school children in grades five and six, divided into four intervention and four control groups, attended 12 structured sessions using the CSE-CBT protocol, led by specially trained teachers. The children completed questionnaires to assess their self-esteem at the beginning and at the end of the study, and answered weekly questionnaires that assessed therapeutic process. Hierarchical linear modeling was used to analyze the data. (3) Results: The CSE-CBT protocol had a significant effect on improving children's self-esteem over the course of the study, regardless of the children's working alliance with the teacher leading the group. (4) Conclusions: The findings suggest that the CSE-CBT protocol has the potential to benefit children's self-esteem and indicate that school teachers can be trained to administer the CBT-protocol.

Evaluating the efficacy of the Family Check-Up Online: A school-based, eHealth model for the prevention of problem behavior during the middle school years

This study evaluated the efficacy of a family-centered preventive intervention, the Family Check-Up (FCU), delivered as an online, eHealth model to middle school families. To increase accessibility of family-centered prevention in schools, we adapted the evidence-based FCU to an online format, with the goal of providing a model of service delivery that is feasible, given limited staffing and resources in many schools. Building on prior research, we randomly assigned participants to waitlist control (n = 105), FCU Online as a web-based intervention (n = 109), and FCU Online with coaching support (n = 108). We tested the effects of the intervention on multiple outcomes, including parental self-efficacy, child self-regulation, and child behavior, in this registered clinical trial (NCT03060291). Families engaged in the intervention at a high rate (72% completed the FCU assessment) and completed 3-month posttest assessments with good retention (94% retained). Random assignment to the FCU Online with coaching support was associated with reduced emotional problems for children (p = .003, d = -0.32) and improved parental confidence and self-efficacy (p = .018, d = 0.25) when compared with waitlist controls. Risk moderated effects: at-risk youth showed stronger effects than did those with minimal risk. The results have implications for online delivery of family-centered interventions in schools.

The Family Check-Up Online Program for Parents of Middle School Students: Protocol for a Randomized Controlled Trial

Background

Research has established that skillful family management during adolescence protects youth from a variety of mental health and behavioral problems. Interventions associated with this research have focused on parenting skills as the mediator that links early risk factors with a profile of later behavioral risk, including problem behavior, substance use, and school failure. Fortunately, positive changes in family management skills have been linked to meaningful improvements in adolescent behavior, and these improvements have been significant across a variety of cultural groups.

Objective

We describe the background, research design, and intervention components of an electronic health version of the Family Check-Up program that is targeting middle school children and is being evaluated in a randomized controlled trial for its usability, feasibility, and efficacy.

Methods

We used an iterative formative research process to develop an electronic health version of the Family Check-Up program. In our ongoing randomized controlled trial, eligible families are randomly assigned to 1 of 3 conditions: Family Check-Up Online-only (n≈100), Family Check-Up Online + Coach (n≈100), and a waitlist control condition (middle school as usual; n≈100). We are conducting assessments at baseline, 3 months following randomization (posttest), and at follow-ups scheduled for 6 months and 12 months.

Results

This randomized controlled trial project was funded in 2015. Participant recruitment was completed in spring 2018 and enrollment is ongoing. Follow-up assessments will be completed in 2019.

Conclusions

The innovative Family Check-Up Online program has the potential to help address many of the barriers that more traditional school-based behavioral mental health implementation strategies have yet to solve, including staffing and resources to implement family-centered support within schools.

Trial Registration

ClinicalTrials.gov NCT03060291; https://clinicaltrials.gov/ct2/show/NCT03060291 (Archived by WebCite at http://www.webcitation.org/70f8keeN4)

Trial Registration

RR1-10.2196/11106

A Review of Effective Youth Engagement Strategies for Mental Health and Substance Use Interventions

The majority of adult mental health and substance use (MH&SU) conditions emerge in adolescence. Prevention, diagnosis, and treatment programs targeting this age group have a unique opportunity to significantly impact the well-being of the future generation of adults. At the same time, youth are reluctant to seek treatment and have high rates of dropout from interventions. An emphasis on youth engagement in prevention and treatment interventions for MH&SU results in better health outcomes for those youth. This literature review was undertaken to evaluate opportunities to improve youth engagement in MH&SU programs. The intent was to determine best practices in the field that combined community-level improvement in clinical outcomes with proven strategies in engagement enhancement to inform program development at a local level. The results discuss 40 studies, reviews, and program reports demonstrating effective youth engagement. These have been grouped into six themes based on the underlying engagement mechanism: youth participation in program development, parental relationships, technology, the health clinic, school, and social marketing. A broad range of tools are discussed that intervention developers can leverage to improve youth engagement in prevention or treatment programs.

Toward Dynamic Adaptation of Psychological Interventions for Child and Adolescent Development and Mental Health

Children's and adolescents' mental health needs emphasize the necessity of a new era of translational research to enhance development and yield better lives for children, families, and communities. Developmental, clinical, and translational research serves as a powerful tool for managing the inevitable complexities in pursuit of these goals. This article proposes key ideas that will strengthen current evidence-based intervention practices by creating stronger links between research, practice, and complex systems contexts, with the potential of extending applicability, replicability, and impact. As exemplified in some of the articles throughout this special issue, new research and innovative implementation models will likely contribute to better ways of assessing and dynamically adapting structure and intervention practice within mental health systems. We contend that future models for effective interventions with children and adolescents will involve increased attention to (a) the connection of research on the developmental needs of children and adolescents to practice models; (b) consideration of informed contextual and cultural adaptation in implementation; and (c) a rational model of evidence-based planning, using a dynamic, inclusive approach with high support for adaptation, flexibility, and implementation fidelity. We discuss future directions for translational research for researchers, practitioners, and administrators in the field to continue and transform these ideas and their illustrations.

Consumer attitudes towards evidence based mental health services among American mental health consumers

The Consumer Attitudes towards Evidence Based Services (CAEBS) scale is a 29-item questionnaire designed to assess public views on the role of science in helping to guide mental health treatment. The aim of the current study was to assess the Factor structure the CAEBS in an online sample of adults seeking information about mental health services. The CAEBS was administered to a nationwide sample of participants from websites offering classified advertisements for mental health related study participation (n = 312). An Exploratory Factor Analysis (EFA) suggested four factors based on 26 of the items: Beliefs Regarding Therapists' Practices, Attitudes about Mental Health Policy, Negative Personal-Level Attitudes toward EBPs, and Negative Societal-Level Attitudes towards EBPs. In order to increase consumer empowerment within the mental health-care system and develop policies supporting EBP usage, mental health professionals need to increase communication with the public to address these concerns and leverage positive attitudes.

Examining Effectiveness of Group Cognitive-Behavioral Therapy for Externalizing and Internalizing Disorders in Urban Schools

This article presents outcome data of the implementation of three group cognitive-behavioral therapy (GCBT) interventions for children with externalizing behavior problems, anxiety, and depression. School counselors and graduate students co-led the groups in two low-income urban schools. Data were analyzed to assess pre-treatment to post-treatment changes in diagnostic severity level. Results of the exploratory study indicated that all three GCBT protocols were effective at reducing diagnostic severity level for children who had a primary diagnosis of an externalizing disorder, anxiety disorder, or depressive disorder at the clinical or intermediate (at-risk) level. All three GCBT protocols were implemented with relatively high levels of fidelity. Data on the effectiveness of the interventions for reducing diagnostic severity level for externalizing and internalizing spectrum disorders and for specific disorders are presented. A discussion of implementation of mental health evidence-based interventions in urban schools is provided.

Implementing clinical outcomes assessment in everyday school mental health practice

Evidence-based assessment (EBA) has been shown to improve clinical outcomes, but this practice is frequently not implemented in school mental health practice. This article reviews potential barriers to implementation and offers practical strategies for addressing these challenges. Several valid and reliable tools for assessment are reviewed, and information is provided on clinical use. Case examples of EBA implementation in school mental health settings are provided to illustrate how these tools can be used in everyday practice by school mental health clinicians.