User testing to drive the iterative development of a strategy to improve implementation of evidence-based practices in school mental health

Protocol for a hybrid type 3 effectiveness-implementation trial of a pragmatic individual-level implementation strategy for supporting school-based prevention programming

BACKGROUND

For approximately one in five children who have social, emotional, and behavioral (SEB) challenges, accessible evidence-based prevention practices (EBPPs) are critical. In the USA, schools are the primary setting for children's SEB service delivery. Still, EBPPs are rarely adopted and implemented by front-line educators (e.g., teachers) with sufficient fidelity to see effects. Given that individual behavior change is ultimately required for successful implementation, focusing on individual-level processes holds promise as a parsimonious approach to enhance impact. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a pragmatic, multifaceted pre-implementation strategy targeting volitional and motivational mechanisms of educators' behavior change to enhance implementation and student SEB outcomes. This study protocol describes a hybrid type 3 effectiveness-implementation trial designed to evaluate the main effects, mediators, and moderators of the BASIS-T implementation strategy as applied to Positive Greetings at the Door, a universal school-based EBPP previously demonstrated to reduce student disruptive behavior and increase academic engagement.

METHODS

This project uses a blocked randomized cohort design with an active comparison control (ACC) condition. We will recruit and include approximately 276 teachers from 46 schools randomly assigned to BASIS-T or ACC conditions. Aim 1 will evaluate the main effects of BASIS-T on proximal implementation mechanisms (attitudes, subjective norms, self-efficacy, intentions to implement, and maintenance self-efficacy), implementation outcomes (adoption, reach, fidelity, and sustainment), and child outcomes (SEB, attendance, discipline, achievement). Aim 2 will examine how, for whom, under what conditions, and how efficiently BASIS-T works, specifically by testing whether the effects of BASIS-T on child outcomes are (a) mediated via its putative mechanisms of behavior change, (b) moderated by teacher factors or school contextual factors, and (c) cost-effective.

DISCUSSION

This study will provide a rigorous test of BASIS-T-a pragmatic, theory-driven, and generalizable implementation strategy designed to target theoretically-derived motivational mechanisms-to increase the yield of standard EBPP training and support strategies.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT05989568. Registered on May 30, 2023.

Propelling the Global Advancement of School Mental Health

Rates of mental health problems and disorders in children and youth have been increasing for at least three decades, and these have escalated due to the pandemic and multiple other societal stressors. It is increasingly recognized that students and families frequently struggle to receive needed care through traditional locations such as specialty mental health centers. Upstream mental health promotion and prevention strategies are gaining support as a public health approach to supporting overall population well-being, better utilizing a limited specialty workforce, and reducing illness. Based on these recognitions, there has been a progressive and escalating movement toward the delivery of mental health support to children and youth "where they are," with a prominent and more ecologically valid environment being schools. This paper will provide a brief review of the escalating mental health needs of children and youth, advantages of school mental health (SMH) programs in better meeting these needs, example model SMH programs from the United States and Canada, and national and international SMH centers/networks. We conclude with strategies for further propelling the global advancement of the SMH field through interconnected practice, policy, and research.

Acceptability, appropriateness, and feasibility of Rural School Support Strategies for behavioral interventions: a mixed methods evaluation over two years of a hybrid type 3 implementation-effectiveness trial

BACKGROUND

Positive Behavioral Interventions and Supports (PBIS) is a framework for implementing evidence-based interventions for preventing behavioral issues and improving climate in schools. The implementation of school-wide PBIS with fidelity is complex, requiring leadership commitment, teaming, and coordination of systems for tracking behaviors and consequences. Putting these components in place while ensuring alignment with the values and needs of the school community can be difficult for schools with fewer resources, such as rural schools. Implementation supports are needed, including strategies such as technical assistance, but it is unclear whether lower-cost modalities such as virtual support are acceptable, appropriate, and feasible and whether perceptions vary throughout the implementation process.

METHODS

A type 3 hybrid implementation-effectiveness trial is taking place in 40 Idaho schools, testing a bundle of implementation supports selected to meet the needs of schools in rural areas. Supports include technical assistance from an implementation support practitioner (ISP), didactic trainings, virtual learning sessions, and an online resource portal. Surveys and interviews in the first 2 years of implementation (fall 2019 to spring 2021) explored outcomes of acceptability, appropriateness, and feasibility regarding the implementation supports among more than 150 school stakeholders.

RESULTS

Evaluations showed high acceptability and appropriateness of the PBIS concepts and training. The 20 schools receiving additional implementation support rated the technical assistance and support from the project's ISPs as the most acceptable and appropriate resource. Reasons for acceptability were the relationship built with the ISP, the ISP's expertise, and being a "neutral party." Although in-person support from the ISP was preferred, remote support was acceptable and increased feasibility of attendance. Virtual learning sessions were acceptable for learning and collaboration, particularly in the second year of implementation, once ISPs had developed closer relationships with school teams.

CONCLUSIONS

School staff found training, technical assistance, and virtual learning sessions to be acceptable and appropriate. Virtual formats of training and technical assistance decreased in acceptability but increased feasibility of attendance. In-person support was preferred during initial implementation, and virtual support was more acceptable thereafter.

TRIAL REGISTRATION

This trial was prospectively registered on ClinicalTrials.gov ( NCT03736395 ), on November 9, 2018.

Iterative redesign of a caregiver-mediated intervention for use in educational settings

LAY ABSTRACT

Teachers often report concerns about behavior challenges in their students with autism spectrum disorder (ASD) in the school setting. Furthermore, teachers often report that they do not have adequate training in how to manage these challenging behaviors effectively. The RUBI program is an intervention initially developed for parents of children with ASD and co-occurring challenging behavior in clinic settings. The present project used school staff input to systematically redesign RUBI to be used with educators in schools. School staff gave input at multiple stages of development to ensure the adapted intervention was appropriate to use in a school setting. Responses were coded and analyzed to identify strengths and weaknesses of the RUBI manual in schools and adaptations were made accordingly. Scores of how appropriate, possible, likable, and usable RUBI would be in schools rose after the intervention was redesigned. The redesigned RUBIES manual may give school staff the tools they need to manage disruptive behaviors. In addition, collaborating with providers over multiple stages to redesign established interventions for new contexts may be a promising way to help bring research tools to practice in the future.

Cluster-randomized trial comparing organizationally tailored versus standard approach for integrating an evidence-based cancer control intervention into African American churches

The field of implementation science has devoted increasing attention to optimizing the fit of evidence-based interventions to the organizational settings in which they are delivered. Institutionalization of health promotion into routine organizational operations is one way to achieve this. However, less is known about how to maximize fit and achieve institutionalization, particularly in settings outside of the healthcare system. This paper reports on findings from a parallel cluster-randomized trial that compared an organizationally tailored with a standard (core components only) approach for institutionalizing ("integrating") an evidence-based cancer control intervention into African American churches. Churches randomized to the organizationally tailored condition identified three or more implementation strategies from a menu of 20, with an implementation time frame for each. The primary study outcome was assessed through the Faith-Based Organization Health Integration Inventory, a measure of institutionalization of health promotion activities in church settings, completed by pastors at baseline and 12-month follow-up. Seventeen churches were randomized and 14 were analyzed as 3 did not implement the study protocol. Though the percent increase in total integration score was greater in the tailored condition (N = 9; 18%) than in the standard condition (N = 5; 12%), linear mixed-effect models did not detect a statistically significant group × time interaction. Despite the challenges of integrating health promotion activities outside of healthcare organizations, the current approach shows promise for fostering sustainable health promotion in community settings and merits further study.