Evaluating the implementation of the SWITCH® school wellness intervention and capacity-building process through multiple methods

Connecting the Dots: Facilitating Resource Access for Health and Wellness in Chicago Public Schools (CPS) Through the Healthy CPS Network Specialist

CONTEXT

To comply with local, state, and federal health and wellness policies, districts and schools must connect students with needed services and resources (eg, mobile medical units and community health educators). Yet, schools struggle to navigate fragmented service landscapes. In Chicago Public Schools (CPS), the Healthy CPS Network Specialist position was created to help connect schools to such resources and services.

OBJECTIVES

This study explores how the Specialist connects schools to resources and services and describes the experiences of schools working with the Specialist.

DESIGN

This mixed-methods study includes key informant interviews and survey data.

SETTING

The study was conducted in one of CPS's geographic networks, serving roughly 2 dozen schools on the district's West side.

PARTICIPANTS

Interviews with the Specialist and interviews and surveys with school-level staff served by the Specialist were conducted from 2021 through 2023.

MAIN OUTCOME MEASURES

Interviews and surveys measured participants' reported experiences working with the Specialist to get connected to 12 needed health and wellness resources and services.

RESULTS

Over 50% of schools reported being connected to resources and services by working with the Specialist. The most common supports were connections to sexual health education supports (75%), nutrition education supports (71%), and supports for LGBTQ+ students (68%). Interviewees reported that the Specialist makes connections internally, between schools and district-level staff, as well as externally across the city. Connections are made both through planning conversations and in response to school requests. Interviewees saw value in these connections, noting the Specialist addresses gaps in schools' knowledge, helps them plan for resource use, eases burdens, builds trusting relationships, and ensures follow-through.

CONCLUSIONS

The Specialist position serves as a model for how to help schools build capacity to achieve health and wellness policy compliance through the connections made in a fragmented service landscape, ensuring services meet students' needs.

Policy, Systems, and Environmental Strategies to Support Healthy Eating Behaviors in Early Childhood: A Scoping Review of Existing Evaluation Tools

BACKGROUND

Policy, systems, and environmental (PSE) change strategies aimed at supporting healthy eating behaviors work to enhance optimal nutrition by making healthy foods more available and accessible in the community. PSE change strategies can complement and strengthen knowledge, skills, and behaviors obtained through individual-level nutrition education.

OBJECTIVE

This scoping review aimed to identify existing literature evaluating early childhood (ie, children younger than age 5 years) PSE change strategies supporting healthy eating behaviors and to describe the evaluation tools used to assess the identified PSE change strategies.

METHODS

Three databases (PubMed, Cumulated Index in Nursing and Allied Health Literature, and Web of Science) were used to systematically search for articles published between 2013 and 2023 written in English and conducted in the United States that evaluated PSE change strategies supporting healthy eating behaviors in young children (ie, children younger than age 5 years). Two study members conducted the review, discussing and reconciling discrepancies until a consensus was reached for interobserver reliability.

RESULTS

Findings from this review identified 48 studies evaluating early childhood PSE change strategies supporting healthy eating behaviors, with 36 studies using 25 PSE-focused evaluation tools to evaluate these strategies. Most tools (80%) assessed PSE change strategies supporting access and availability of healthy food and beverage options in early childhood education settings. Studies did not evaluate child-level outcomes (ie, attitudes, preferences, and behaviors) to showcase improvement of early childhood nutrition. Only 60% of the tools reported evidence of validity or reliability.

CONCLUSIONS

Most of the studies identified in this scoping review were aimed to evaluate healthy eating PSE change strategies focused on improving access to and availability of healthy foods and beverages in early childhood education settings. Future research is needed to develop and validate PSE-focused evaluation tools assessing child-level healthy eating practices and behaviors.

An implementation evaluation of a sports-based health intervention for underrepresented middle school youth in Philadelphia

Multicomponent, community-based programs aiming to improve health behaviors in youth are needed but can be challenging to implement. Research is needed to better understand the factors that facilitate and inhibit effective implementation of these programs especially for youth at increased risk of health disparities. This study aimed to identify and explore the implementation determinants and outcomes of a multicomponent health intervention conducted from 2021 to 2022 for middle school students living in underserved communities in Philadelphia, PA, USA. Mixed methods approaches, including self-report surveys and semi-structured qualitative interviews, were administered to 18 members of the implementation staff at the end of the program, including coaches (n = 7), assistant coaches (n = 2), school champions (n = 6), administrative leaders (n = 2), and a school district administrator (n = 1). Survey and interview questions were guided by the Consolidated Framework for Implementation Research (CFIR), and interviews were thematically coded following transcription based on 26 CFIR constructs. Innovation source, evidence strength and quality, cosmopolitanism, and the personal attributes of individuals were key constructs associated with implementation effectiveness. Data revealed three multidimensional themes that highlighted broader challenges influencing implementation: (i) broad consensus, different interpretations, (ii) staffing challenges, and (iii) continuity is key. The need for the program was clearly recognized and overall belief in the purpose of the intervention was strong among key program staff and administration. However, issues including limited engagement with training, staffing turnover, and the rotational programming design hindered implementation. Future projects aiming to implement multicomponent after-school time interventions must ensure a consistent vision among partners and continuity in program delivery.

Relationship between the inner setting of CFIR and the delivery of the Healthy School Recognized Campus initiative: a mixed-methods analysis

INTRODUCTION

Healthy School Recognized Campus (HSRC) is a Texas A&M AgriLife Extension initiative that promotes the delivery of multiple evidence-based physical activity and nutrition programs in schools. Simultaneous delivery of programs as part of HSRC can result in critical implementation challenges. The study examines how the inner setting constructs from the Consolidated Framework for Implementation Research (CFIR) impact HSRC program delivery.

METHODS

We surveyed (n = 26) and interviewed (n = 20) HSRC implementers (n = 28) to identify CFIR inner setting constructs related to program acceptability, appropriateness, and feasibility. Using a concurrent mixed-methods design, we coded interviews using the CFIR codebook, administered an inner setting survey, tested for relationships between constructs and implementation outcomes via chi-square tests, and compared quantitative and qualitative results.

RESULTS

Stakeholders at schools that implemented one program vs. more than one program reported no differences in acceptability, appropriateness, or feasibility outcomes (p > .05); however, there was a substantial difference in reported program minutes (1118.4 ± 951.5 vs. 2674.5 ± 1940.8; p = .036). Available resources and leadership engagement were related to HSRC acceptability (r = .41; p = .038 and r = .48; p = .012, respectively) and appropriateness (r = .39; p = .046 and r = 0.63; p = .001, respectively). Qualitative analyses revealed that tangible resources (e.g., curriculum, a garden) enabled implementation, whereas intangible resources (e.g., lack of time) hindered implementation. Participants also stressed the value of buy-in from many different stakeholders. Quantitative results revealed that implementation climate was related to HSRC acceptability (r = .46; p = .018), appropriateness (r = .50; p = .009), and feasibility (r = .55; p = .004). Learning climate was related to HSRC appropriateness (r = .50; p = .009). However, qualitative assessment of implementation climate subconstructs showed mixed perspectives about their relationship with implementation, possibly due to differences in the compatibility/priority of different programs following COVID-19. Networks/communication analysis showed that schools have inner and outer circles of communication that can either benefit or hinder implementation.

CONCLUSION

Few differences were found by the number of programs delivered. Implementation climate (i.e., compatibility, priority) and readiness for implementation (i.e., resources and leadership engagement) were important to HSRC implementation. Strategies that focus on reducing time-related burdens and engaging stakeholders may support HSRC's delivery. Other constructs (e.g., communication, access to knowledge) may be important to the implementation of HSRC but need further exploration.

Process Evaluation of a Scaled-Up School-Based Physical Activity Program for Adolescents: Physical Activity 4 Everyone

BACKGROUND

Physical Activity 4 Everyone (PA4E1) is a whole-school physical activity program, with demonstrated efficacy (2012-2014). PA4E1 was adapted (scaled-up) and tested in a scale-up trial (2017-2020). This process evaluation study of the scale-up trial had 2 aims. First, to describe the acceptability, appropriateness, and feasibility of PA4E1 in the scale-up trial, from the perspective of school staff involved in the program management and delivery. Second, to generate themes that may explain school staff assessments of acceptability, appropriateness, and feasibility.

METHODS

Data were collected at various time points throughout the 2-year implementation phase. Online surveys were collected from In-School Champions, Head Physical Education teachers, Principals, and Physical Education teachers (quantitative data). Focus groups and interviews were conducted with In-School Champions, Principals, and Physical Education teachers (qualitative data). Existing published data on website engagement, adaptations, modifications, and the scale-up trial primary outcome (implementation of physical activity practices) were triangulated with the quantitative and qualitative during analysis, to generate themes.

RESULTS

School staff delivering PA4E1 reported it was highly acceptable, appropriate, and feasible. Seven themes were generated relating to acceptability, appropriateness, and feasibility. The themes related to how the program was funded, the delivery modes of implementation support, the identification of easy-wins, the recruitment of the right in-school champion, facilitating principal buy-in, mitigating the impact of school staff turnover, and engaging the whole school.

CONCLUSIONS

Recommendations are made to inform future adaptations for PA4E1 and potentially school-based physical activity programs more generally. The findings may inform future scalability assessments of the suitability of programs for scale-up.

Multilevel Interventions Targeting Obesity: State of the Science and Future Directions

A seminal report, released in 2001 by the Institute of Medicine, spurred research on the design, implementation, and evaluation of multilevel interventions targeting obesity and related behaviors. By addressing social and environmental factors that support positive health behavior change, interventions that include multiple levels of influence (e.g., individual, social, structural) aim to bolster effectiveness and, ultimately, public health impact. With more than 20 years of multilevel obesity intervention research to draw from, this review was informed by published reviews (n = 51) and identified intervention trials (n = 103), inclusive of all ages and countries, to elucidate key learnings about the state of the science. This review provides a critical appraisal of the scientific literature related to multilevel obesity interventions and includes a description of their effectiveness on adiposity outcomes and prominent characteristics (e.g., population, setting, levels). Key objectives for future research are recommended to advance innovations to improve population health and reduce obesity.

The Secret Sauce? Taking the Mystery Out of Scaling-Up School-Based Physical Activity Interventions

Over the last 4 decades, physical activity researchers have invested heavily in determining "what works" to promote healthy behaviors in schools. Single and multicomponent school-based interventions that target physical education, active transportation, and/or classroom activity breaks effectively increased physical activity among children and youth. Yet, few of these interventions are ever scaled-up and implemented under real-world conditions and in diverse populations. To achieve population-level health benefits, there is a need to design school-based health-promoting interventions for scalability and to consider key aspects of the scale-up process. In this opinion piece, we aim to identify challenges and advance knowledge and action toward scaling-up school-based physical activity interventions. We highlight the key roles of planning for scale-up at the outset, scale-up pathways, trust among partners and program support, program adaptation, evaluation of scale-up, and barriers and facilitators to scaling-up. We draw upon our experience scaling-up effective school-based interventions and provide a solid foundation from which others can work toward bridging the implementation-to-scale-up gap.

Implementation Science in School-Based, Universal-Level Intervention Research: A Scoping Review

PURPOSE

The aim of this study was to map the use of implementation science frameworks, models, and theories in intervention research targeting learning needs in the classroom.

METHOD

A scoping review was conducted. Electronic database and manual searches were conducted. Two reviewers independently completed screening, data extraction, and quality appraisal. Qualitative content analysis was undertaken using Nilsen's taxonomy and the domains of the Consolidated Framework for Implementation Research (CFIR). The data were further analyzed using the CFIR valence and strength rating scales.

RESULTS

Included papers (n = 22) used a diverse sample of implementation science frameworks and models. Most studies used determinant frameworks to guide data collection and analysis. Few studies used implementation science theory. Most studies were mixed methods (n = 11), published since 2019 (n = 20), and conducted in North America (n = 15). Over half of the interventions targeted social, emotional, and mental health (n = 13). A complex interplay of inner setting factors was identified as having a strong influence on implementation. Teachers' knowledge and beliefs, adaptability, and complexity of interventions were also identified as important considerations when conducting research in this context.

CONCLUSIONS

Early engagement with stakeholders in education is recommended when designing universal level speech, language, and communication interventions for use in the ordinary classroom. Adaptive, hybrid designs that test both implementation strategies and effectiveness of interventions may be warranted given the influence of inner setting factors on implementation outcomes.

Individual and Contextual Factors Associated with Classroom Teachers' Intentions to Implement Classroom Physical Activity

Classroom-based physical activity (CPA) is an evidence-based practice that improves student physical activity outcomes, but national data suggest implementation is insufficient in US classrooms. The purpose of this study was to examine individual and contextual factors associated with elementary school teachers' intentions to implement CPA. We collected input survey data from 181 classroom teachers (10 schools; 98.4% participation among eligible teachers) across three separate cohorts to examine associations between individual and contextual constructs and future CPA implementation intentions. Data were analyzed using multilevel logistic regression. Individual-level characteristics of perceived autonomy for using CPA, perceived relative advantage/compatibility of CPA, and general openness to educational innovations were positively associated with intentions to implement CPA (p < 0.05). Teacher perceptions of contextual factors such as administrator support for CPA were also associated with implementation intentions. This study adds to prior evidence about the importance of theoretically determined constructs for understanding behavioral intentions among front-line implementers such as classroom teachers. Additional research is needed to evaluate interventions designed to change malleable factors, including teachers' perceptions, as well as changing school environments so that teachers perceive more autonomy to use CPA and have the training and resources that build skills for implementation.

Opportunities to advance implementation science and nutrition research: a commentary on the Strategic Plan for NIH Nutrition Research

Despite population-wide recommendations by the U.S. Dietary Guidelines for Americans and others to encourage health-promoting dietary patterns, the proportion of Americans following dietary recommendations remains low. The gaps in the adoption and integration of evidence-based dietary interventions, practices, programs, and policies (EBIs) into community and clinical settings signal the need to strengthen efforts in implementation science (IS) in nutrition research to understand and alleviate barriers to adopting and sustaining healthy dietary behaviors and practices. Equally important is the translation of this research into practice in a variety of settings and across the diversity of populations. Recognizing this need, the U.S. National Institutes of Health (NIH) 2020-2030 Strategic Plan for NIH Nutrition Research calls for the expansion of IS as a key opportunity to advancing nutrition research. This commentary highlights three scientific opportunities to stimulate IS in nutrition research and provides examples for each opportunity. These include: (a) Advance consideration of implementation and dissemination early in the design of interventions to facilitate opportunities for equitable scale-up and sustainability of EBIs, (b) Develop and test strategies for equitable implementation of nutrition and diet EBIs in health care and community settings, and (c) Build and strengthen the infrastructure, capacity, and expertise needed to increase use of IS in clinical and community nutrition research to swiftly move the research into practice. By advancing the three opportunities identified in this commentary, the scientific community has the potential to advance the field of nutrition research and IS with the ultimate goal of improving public health.

A cluster-randomized trial comparing two SWITCH implementation support strategies for school wellness intervention effectiveness

BACKGROUND

The School Wellness Integration Targeting Child Health (SWITCH) intervention has demonstrated feasibility as an implementation approach to help schools facilitate changes in students' physical activity (PA), sedentary screen time (SST), and dietary intake (DI). This study evaluated the comparative effectiveness of enhanced (individualized) implementation and standard (group-based) implementation.

METHODS

Twenty-two Iowa elementary schools participated, with each receiving standardized training (wellness conference and webinars). Schools were matched within region and randomized to receive either individualized or group implementation support. The PA, SST, and DI outcomes of 1097 students were assessed at pre- and post-intervention periods using the Youth Activity Profile. Linear mixed models evaluated differential change in outcomes by condition, for comparative effectiveness, and by gender.

RESULTS

Both implementation conditions led to significant improvements in PA and SST over time (p < 0.01), but DI did not improve commensurately (p value range: 0.02‒0.05). There were no differential changes between the group and individualized conditions for PA (p = 0.51), SST (p = 0.19), or DI (p = 0.73). There were no differential effects by gender (i.e., non-significant condition-by-gender interactions) for PA (pfor interaction = 0.86), SST (pfor interaction = 0.46), or DI (pfor interaction = 0.15). Effect sizes for both conditions equated to approximately 6 min more PA per day and approximately 3 min less sedentary time.

CONCLUSION

The observed lack of difference in outcomes suggests that group implementation of SWITCH is equally effective as individualized implementation for building capacity in school wellness programming. Similarly, the lack of interaction by gender suggests that SWITCH can be beneficial for both boys and girls. Additional research is needed to understand the school-level factors that influence implementation (and outcomes) of SWITCH.

Assessing the Impacts of Creating Active Schools on Organisational Culture for Physical Activity

BACKGROUND

National and international guidance recommends whole-school approaches to physical activity, but there are few studies assessing their effectiveness, especially at an organisational level. This study assesses the impact of the Creating Active School's (CAS) programme on organisational changes to physical activity provision.

METHODS

In-school CAS leads completed a 77-item questionnaire assessing school-level organisational change. The questionnaire comprised 19 domains aligned with the CAS framework and COM-B model of behaviour change. Wilcoxon Signed Rank Tests assessed the pre-to-nine-month change.

RESULTS

>70% of schools (n = 53) pre-CAS had inadequate whole-school physical activity provision. After nine months (n = 32), CAS had a significant positive effect on organisational physical activity. The positive change was observed for: whole-school culture and ethos, teachers and wider school staff, academic lessons, physical education (PE) lessons, commute to/from school and stakeholder behaviour.

CONCLUSIONS

This study provides preliminary evidence that CAS is a viable model to facilitate system-level change for physical activity in schools located within deprived areas of a multi-ethnic city. To confirm the results, future studies are required which adopt controlled designs combined with a holistic understanding of implementation determinants and underlying mechanisms.

Predictors of sustainment of two distinct nutrition and physical activity programs in early care and education

Introduction

The goal of the present study was to investigate factors associated with sustainment of two evidence-based programs for nutrition promotion in early care and education (ECE) settings - Food Friends (FF) and Together, We Inspire Smart Eating (WISE).

Materials and methods

In a cross-sectional study design, ECE directors (N = 55) from centers that had previously been trained in WISE or FF completed a survey. Program-specific measures included Steckler's Perception of Innovations, the Program Sustainability Assessment Tool (PSAT), and the Organizational Readiness for Change Assessment (ORCA). For our primary outcomes, two measures of sustainment were examined: Nutrition Continued Practice (i.e., the use of or general focus on nutrition programs) and Program Fidelity (i.e., how well centers used specific evidence-based practices of WISE or FF). Multiple regression was used to determine the association of these outcomes with program, years since last implementation, and overall scores on predictors. Follow-up correlation analyses were used to investigate outcome relationships with context submeasures due to high intercorrelations between predictor submeasures.

Results

Nutrition Continued Practice was significantly predicted by program and overall PSAT score. WISE programs had significantly higher Nutrition Continued Practice scores than FF program (p = 0.03). All subscales of the PSAT (e.g., environmental support, funding stability, organizational capacity, program adaptation, communications, and strategic planning) were significantly correlated with Nutrition Continued Practice (all rs > 0.30, all ps < 0.03). Program Fidelity was significantly predicted by PSAT and Steckler Perception of Innovation scores. All subscales of the PSAT were strongly positively correlated with Program Fidelity (all rs > 0.48, all ps < 0.001); relative advantage (r = 0.54, p < 0.001) and level of institutionalization (r = 0.61, p < 0.001) were positively correlated with Program Fidelity.

Conclusion

This study suggests that factors associated with the continued practice of program principles are partially distinct from those that are associated with the sustainment of specific practices driving program fidelity. Results suggest capacity building strategies may be important for both continued attention to nutrition and physical activity as well as sustaining fidelity to specific evidence-based practices.

Implementation evaluation of an Irish secondary-level whole school programme: a qualitative inquiry

Whole-of-school programmes (WSPs) are recommended to promote physical activity for adolescents. The Active School Flag (ASF) programme for secondary-level schools is one such WSP. Due to the difficulties of incorporating WSPs into the complex school system, there is a risk of poor implementation. The monitoring of unanticipated influences can help to understand key implementation processes prior to scale-up. The aims of this study were to identify perceived facilitators and barriers to implementing the ASF and recommend evidence-based implementation strategies. Focus groups and interviews (N = 50) were conducted in three schools with stakeholders involved in programme implementation, i.e. school management (n = 5), ASF coordinator (n = 4), student-leaders (aged 15–16 years) (n = 64) and staff committee (n = 25). Transcripts were analysed using codebook thematic analysis and were guided by the Consolidated Framework for Implementation Research. Implementation strategies were identified and were selected systematically to address contextual needs. Three themes surrounding the facilitators and barriers to implementation were generated: intervention design factors (e.g. capacity building and knowledge of implementers; and interest and buy-in for the programme), organizational factors (e.g. optimization of people and the busy school environment) and interpersonal factors (e.g. communication and collaboration). The examination of facilitators and barriers to implementation of the ASF has assisted with the identification of implementation strategies including (not limited to) a shared leadership programme for student leaders and a more flexible timeline for completion. These facilitative implementation strategies may assist in the effective implementation of the ASF.

Dissemination and Implementation Science to Advance Health Equity: An Imperative for Systemic Change

Innovations in public health research and evidence-based interventions targeting chronic and infectious diseases are only effective if they reach their target populations. Individuals from low socioeconomic background, racial and ethnic minorities, and sexual/gender minority communities are most susceptible to chronic diseases such as obesity and cancer, and infectious diseases such as HIV and COVID-19. These disparities are driven by social and structural conditions including stigma and discrimination, housing instability and food insecurity, among others. Accordingly, interventions that aim to improve population health must be targeted toward marginalized communities who are often systematically excluded from decision making processes. This article introduces dissemination and implementation science as a key opportunity to advance health equity through integrating measures and metrics that evaluate if an intervention is successful at improving health outcomes in marginalized populations. Implementation science also provides frameworks to help evaluate the key determinants to implementation success which can inform subsequent health outcomes. Examples of how researchers have engaged with community stakeholders are provided, along with strategies in which dissemination has gone beyond traditional practices. Finally, ways in which universities can build capacity for implementation science as a means to address health disparities are provided with the goal of improving the translation of research to practice.

Evaluation of a Large-Scale School Wellness Intervention Through the Consolidated Framework for Implementation Research (CFIR): Implications for Dissemination and Sustainability

Background

Numerous studies have tested school-based interventions promoting healthy behaviors in youth, but few have integrated dissemination and implementation (D&I) frameworks. Using D&I frameworks can inform if and how an evidence-based intervention is implemented and maintained and provide strategies to address contextual barriers. Such application is necessary to understand how and why interventions are sustained over time. We evaluated a school wellness initiative called SWITCH® (School Wellness Integration Targeting Child Health) to (1) assess implementation outcomes of adoption, fidelity, and penetration, (2) discern implementation determinants through the Consolidated Framework for Implementation Research (CFIR), and (3) examine differences among inexperienced and experienced schools and influential factors to sustainment.

Methods

A total of 52 schools from Iowa, United States enrolled in the 2019-2020 iteration of SWITCH (22 inexperienced; 30 experienced). The CFIR guided the adaptation of mixed methods data collection and analysis protocols for school settings. Specific attention was focused on (1) fidelity to core elements; (2) adoption of best practices; and (3) penetration of behavior change practices. Determinants were investigated through in-depth qualitative interviews and readiness surveys with implementation leaders. A systematic process was used to score CFIR domains (between -2 and +2) indicating positive or negative influence. Independent t-tests were conducted to capture differences between samples, followed by a cross-case analysis to compare determinants data. Inductive coding yielded themes related to sustainment of SWITCH beyond formal implementation support.

Results

Experienced schools had higher scores on fidelity/compliance (t = -1.86 p = 0.07) and adoption (t = -2.03 p = 0.04). CFIR determinants of innovation source, culture, relative priority, and leadership engagement were positive implementation determinants, whereas tension for change and networks and communications were negative determinants. Distinguishing factors between experienced and inexperienced schools were Readiness for Implementation and Self-efficacy (experienced significantly higher; p < 0.05). Strategies to enhance sustainability were increasing student awareness/advocacy, keeping it simple, and integrating into school culture.

Conclusions

Findings provide specific insights related to SWITCH implementation and sustainability but more generalized insights about the type of support needed to help schools implement and sustain school wellness programming. Tailoring implementation support to both inexperienced and experienced settings will ultimately enhance dissemination and sustainability of evidence-based interventions.

Elementary Schools' Response to Student Wellness Needs during the COVID-19 Shutdown: A Qualitative Exploration Using the R = MC2 Readiness Heuristic

During spring of 2020, the COVID-19 pandemic and accompanying public health advisories forced K-12 schools throughout the United States to suspend in-person instruction. School personnel rapidly transitioned to remote provision of academic instruction and wellness services such as school meals and counseling services. The aim of this study was to investigate how schools responded to the transition to remote supports, including assessment of what readiness characteristics schools leveraged or developed to facilitate those transitions. Semi-structured interviews informed by school wellness implementation literature were conducted in the spring of 2020. Personnel (n = 50) from 39 urban and rural elementary schools nationwide participated. The readiness = motivation capacity² (R = MC²) heuristic, developed by Scaccia and colleagues, guided coding to determine themes related to schools' readiness to support student wellness in innovative ways during the pandemic closure. Two distinct code sets emerged, defined according to the R = MC² heuristic (1) Innovations: roles that schools took on during the pandemic response, and (2) Readiness: factors influencing schools' motivation and capacity to carry out those roles. Schools demonstrated unprecedented capacity and motivation to provide crucial wellness support to students and families early in the COVID-19 pandemic. These efforts can inform future resource allocation and new strategies to implement school wellness practices when schools resume normal operations.

A protocol for coordinating rural community stakeholders to implement whole-of-community youth physical activity surveillance through school systems

Accurate and effective local data collection systems are needed to inform community change on youth health behaviors such as physical activity (PA). Systematic methods are particularly important for understanding PA behaviors that may be influenced by individual, interpersonal, organizational, and regional factors. The purpose of this study was to describe a protocol for coordinating community stakeholders to implement an online youth PA surveillance instrument. The research team collaborated with local health departments (LHDs) from two rural communities to coordinate schools in implementing school-wide youth PA surveillance. A data sharing agreement was established between all partners. School administrators and teachers attended in-person training sessions for an online PA survey and how to use the data. Following the training, students were provided individualized logins to complete the survey once a semester over a two-year academic period. Across both communities, 23 teachers and administrators attended the training sessions that were facilitated by the LHDs and research team. In Year 1 (Y1), a total of 465 3rd through 6th grade students were enrolled in the participating schools (community 1 = 227; community 2 = 238). Survey response rates ranged from 86.1% to 95.4% completion, depending on the community and semester. In Year 2 (Y2), a total of 501 3rd through 6th grade students were enrolled (community 1 = 260; community 2 = 241). Response rates ranged from 86.3% to 89.6% in the fall term. A protocol for coordinating LHD and community stakeholders was an effective strategy for implementing population-level youth PA surveillance with high levels of reach.

A systematic review of school health policy measurement tools: implementation determinants and outcomes

BACKGROUND

Governments in some countries or states/provinces mandate school-based policies intended to improve the health and well-being of primary and secondary students and in some cases the health of school staff. Examples include mandating a minimum time spent per week in programmed physical activity, mandating provision of healthy foods and limiting fat content of school meals, and banning tobacco products or use on school campuses. Although school health researchers have studied whether schools, districts, or states/provinces are meeting requirements, it is unclear to what extent implementation processes and determinants are assessed. The purposes of the present systematic review of quantitative measures of school policy implementation were to (1) identify quantitative school health policy measurement tools developed to measure implementation at the school, district, or state/provincial levels; (2) describe the policy implementation outcomes and determinants assessed and identify the trends in measurement; and (3) assess pragmatic and psychometric properties of identified implementation measures to understand their quality and suitability for broader application.

METHODS

Peer-reviewed journal articles published 1995-2020 were included if they (1) had multiple-item quantitative measures of school policy implementation and (2) addressed overall wellness, tobacco, physical activity, nutrition, obesity prevention, or mental health/bullying/social-emotional learning. The final sample comprised 86 measurement tools from 67 peer-review articles. We extracted study characteristics, such as psychometric and pragmatic measure properties, from included articles based on three frameworks: (1) Implementation Outcomes Framework, (2) Consolidated Framework for Implementation Research, and (3) Policy Implementation Determinants Framework.

RESULTS

Most implementation tools were developed to measure overall wellness policies which combined multiple policy topics (n = 35, 40%) and were in survey form (n = 75, 87%). Fidelity was the most frequently prevalent implementation outcome (n = 70, 81%), followed by adoption (n = 32, 81%). The implementation determinants most assessed were readiness for implementation, including resources (n = 43, 50%), leadership (n = 42, 49%), and policy communication (n = 41, 48%). Overall, measures were low-cost and had easy readability. However, lengthy tools and lack of reported validity/reliability data indicate low transferability.

CONCLUSIONS

Implementation science can contribute to more complete and rigorous assessment of school health policy implementation processes, which can improve implementation strategies and ultimately the intended health benefits. Several high-quality measures of implementation determinants and implementation outcomes can be applied to school health policy implementation assessment. Dissemination and implementation science researchers can also benefit from measurement experiences of school health researchers.