Evaluating the Wellness School Assessment Tool for use in public health practice to improve school nutrition and physical education policies in New York

Strength and Comprehensiveness of Drinking Water Language in California School District Wellness Policies

OBJECTIVE(S)

Assess the quality of water language in California school district wellness policies and examine how language quality relates to school drinking water access.

DESIGN

Cross-sectional study.

PARTICIPANTS

Random sample of 240 schools selected from all California public schools, stratified by geography and grades served.

VARIABLES MEASURED

Policies (2016-2018) were coded for quality (strength and comprehensiveness) using an adapted school wellness policy tool. School administrators completed phone interviews about drinking water access on their campus.

ANALYSIS

Descriptive statistics (eg, means, standard deviations) summarized school-level characteristics and main outcomes. Mixed-effects linear regression models were used to examine the relationship between the strength and comprehensiveness of water policy language and water access.

RESULTS

On a scale of 0-100, mean strength was 11.3 (SD, 5.7), and mean comprehensiveness was 28.8 (SD, 8.7). There was an inverse association between the quality of water language in policies and excellence in drinking water access in schools.

CONCLUSIONS AND IMPLICATIONS

The strength and comprehensiveness of water language in California school district wellness policies were low. Districts would benefit from improving the quality of water language in their wellness policies and examining challenges to implementing policies.

Development of a Comprehensive Tool for School Health Policy Evaluation: The WellSAT WSCC

BACKGROUND

Stakeholders increasingly recognize the role of policy in implementing Whole School, Whole Community, Whole Child (WSCC) frameworks in schools; however, few tools are currently available to assess alignment between district policies and WSCC concepts. The purpose of this study was to expand the Wellness School Assessment Tool (WellSAT) for evaluation of policies related to all 10 domains of the WSCC model.

METHODS

Developing the WellSAT WSCC was an iterative process that involved (1) identifying items for each domain based on key concepts and best practice recommendations; (2) expert review of the draft measure; (3) cognitive pre-testing; (4) developing scoring criteria; and (5) pilot-testing the measure.

RESULTS

Ratings from expert reviewers indicated that the tool included items that were both relevant and important to each of the 10 WSCC domains. Results of cognitive pre-testing indicated that the items were understood as intended. Feedback from expert reviews, cognitive pre-testing, and pilot-testing was used to further revise and refine the measure and develop a final version of the tool. Acceptable interrater reliability was established for the final selection of items.

CONCLUSIONS

The WellSAT WSCC provides a reliable means for assessing integration and alignment between WSCC model concepts and district policies.

A Systems Approach Helps Explain Significant Improvements in Local Wellness Policies Among SNAP-Ed-Supported School Districts

OBJECTIVE

To assess changes in written local wellness policies (LWPs) across time within Supplemental Nutrition Assistance Program Education (SNAP-Ed)-participating districts.

DESIGN

Sequential, explanatory mixed methods.

SETTING

From October 1, 2015 to September 30, 2016, SNAP-Ed agencies submitted LWPs from partner school districts in Arizona. They received back scores and customized recommendations. To assess changes, LWPs were rescored between October 1, 2017 and September 30, 2018.

PARTICIPANTS

Sixteen local SNAP-Ed agencies worked with 57 districts.

INTERVENTIONS

Districts' LWP revisions supported by SNAP-Ed agencies during the 2-year pre-post period.

MAIN OUTCOME MEASURES

Policy comprehensiveness and strength from 0 (worst) to 100 (best), measured by the Wellness School Assessment Tool.

ANALYSIS

Paired t test to compare pre-post scores. Content analysis of State Educational Agency administrative reviews and thematic analysis of SNAP-Ed narrative reports to explore causation.

RESULTS

Total scores increased (comprehensiveness: +12.4, P < .001, 95% confidence interval, 8.1-16.7; strength: +13.5, P < .001, 95% CI, 9.3-17.7). Improvements were also found for comprehensiveness by section, except Nutrition Education, and for strength across all sections. Qualitative findings suggest that SNAP-Ed interventions combined with state and federal influence contributed to the improvements.

CONCLUSIONS AND IMPLICATIONS

Local wellness policies in SNAP-Ed-supported districts improved over time. State and federal LWP guidelines can work synergistically with SNAP-Ed interventions to influence improvements.

Wellness School Assessment Tool Version 3.0: An Updated Quantitative Measure of Written School Wellness Policies

Schools play an important role in promoting student wellness. As directed by the Healthy Hunger-Free Kids Act, the US Department of Agriculture updated the requirements for written school wellness policies in 2016. The WellSAT (Wellness School Assessment Tool) is an online tool that provides a quantitative score for wellness policy comprehensiveness and strength. The WellSAT has been updated 3 times over the past decade to remain current with federal law and best practices. In this article, we describe the process of updating to WellSAT 3.0. The steps included: reviewing the language of each item linked to a federal provision; adding and deleting items based on frequencies from the National Wellness Policy Study and the empirical support for specific policies; gathering feedback from a survey of experts (N = 77) about best practices and measure usability; and establishing intercoder reliability in a national sample (N = 50) of policies. We conclude with recommendations and guidance for the use of WellSAT 3.0.

The Relationship between Written District Policies and School Practices among High-Need Districts in New York State

BACKGROUND

This study tested the hypothesis that written district wellness policies are associated with higher rates of implementation of nutrition and physical activity practices.

METHODS

Written wellness policies and building level practices were assessed for schools (N = 295) within high-need districts (N = 70) in New York State. The relationship between policies and practices was measured using multi-level mixed-effects logistic regressions.

RESULTS

Overall, stronger written district policies significantly increase the likelihood of practice implementation in schools. This relationship is strongest for physical education and physical activity items, followed by nutrition standards for competitive foods in middle and high schools. Most elementary schools implemented nutrition practices with or without a policy and there were differences in implementation rates between elementary and middle/high schools. When examined separately, policies were for the most part not significantly associated with implementation of corresponding practices.

CONCLUSIONS

Strong and comprehensive written policies are associated with higher rates of practice implementation overall, but the consistency of this relationship varies by policy-practice domain. The newer policy topics areas of school wellness promotion and marketing were less frequently included in written policies. Future research should examine whether districts that strengthen their written policies achieve greater implementation over time.

Parents' Perceptions of Childhood Obesity and Support of the School Wellness Policy

OBJECTIVE

Investigate differences in familiarity of parents of school-aged children with school wellness polices (SWP) and perceptions of the problem of childhood obesity related to support for the SWP and school's role in providing a healthy environment.

METHODS

Descriptive, cross-sectional study using telephone surveys conducted in spring, 2016. T test statistics compared differences between parents with high vs low SWP familiarity and agreement vs disagreement of childhood obesity as problematic.

RESULTS

Nearly half of parents (49.5%) had low familiarity with SWP. Overall, fewer parents agreed that obesity was a local school problem compared with a statewide problem (P < .001). Differences in agreement about childhood obesity explained some differences in SWP support.

CONCLUSIONS AND IMPLICATIONS

Greater awareness is needed among parents of schoolchildren regarding the SWP as well as the prevalence of childhood obesity. This could be achieved through increased development, implementation, and evaluation of communication efforts between schools and families regarding health-promoting environments.

Development and Validation of the Policies, Opportunities, Initiatives and Notable Topics (POINTS) Audit for Campuses and Worksites

Background: Workplace or campus wellness/obesity-prevention policies and initiatives can improve health. Research tools to assess worksite or campus policies/initiatives are scarce. Thus, the aim of this research is to develop and validate the policies, opportunities, initiatives, and notable topics (POINTS) audit. Methods: POINTS was developed and refined via expert review, pilot-testing, and field testing. Trained researchers completed a web-based review from a student-focus or employee-focus regarding 34 health-promoting topics for colleges. Each topic was evaluated on a 0⁻2 scale: 0 = no policy/initiative, 1 = initiatives, 2 = written policy. When a written policy was detected, additional policy support questions (administered, monitored, reviewed) were completed. Results: Cronbach's Alpha for the student-focused POINTS audit was α = 0.787 (34 items, possible points = 65), and for the employee-focused POINTS audit was α = 0.807 (26 items, possible points = 50). A total of 115 student-focused and 33 employee-focused audits were completed. Although there was little evidence of policy presence beyond stimulant standards (smoking and alcohol), there were extensive examples of health initiatives. The student-focused POINTS audit was validated using the Healthier Campus Initiative's survey. Conclusions: POINTS is a web-based audit tool that is valid and useful for pre-assessment, advocacy, benchmarking, and tracking policies for health and well-being for students (campus) and employees (worksite).

School environment assessment tools to address behavioural risk factors of non-communicable diseases: A scoping review

We aimed to identify, describe and analyse school environment assessment (SEA) tools that address behavioural risk factors (unhealthy diet, physical inactivity, tobacco and alcohol consumption) for non-communicable diseases (NCD). We searched in MEDLINE and Web of Science, hand-searched reference lists and contacted experts. Basic characteristics, measures assessed and measurement properties (validity, reliability, usability) of identified tools were extracted. We narratively synthesized the data and used content analysis to develop a list of measures used in the SEA tools. Twenty-four SEA tools were identified, mostly from developed countries. Out of these, 15 were questionnaire based, 8 were checklists or observation based tools and one tool used a combined checklist/observation based and telephonic questionnaire approach. Only 1 SEA tool had components related to all the four NCD risk factors, 2 SEA tools has assessed three NCD risk factors (diet/nutrition, physical activity, tobacco), 10 SEA tools has assessed two NCD risk factors (diet/nutrition and physical activity) and 11 SEA tools has assessed only one of the NCD risk factor. Several measures were used in the tools to assess the four NCD risk factors, but tobacco and alcohol was sparingly included. Measurement properties were reported for 14 tools. The review provides a comprehensive list of measures used in SEA tools which could be a valuable resource to guide future development of such tools. A valid and reliable SEA tool which could simultaneously evaluate all NCD risk factors, that has been tested in different settings with varying resource availability is needed.

School district wellness policy quality and weight-related outcomes among high school students in Minnesota

Weight-related outcomes were examined among high school students in Minnesota public school districts according to the quality of district wellness policies. Wellness policy strength and comprehensiveness were scored using the Wellness School Assessment Tool (WellSAT) for 325 Minnesota public school districts in 2013. The associations between WellSAT scores and district-level means of high school student responses to a statewide survey of health behaviors were examined in this ecologic study. WellSAT Total Strength and Total Comprehensiveness scores were positively associated with both student mean Body Mass Index (BMI) percentile (Strength: P = 0.018, Comprehensiveness: P = 0.031) and mean percent overweight or obese (Strength: P = 0.008, Comprehensiveness: P = 0.026), but only in districts with > 50% of students eligible for Free or Reduced-Price Lunches (FRPLs), or 'high FRPL districts'. WellSAT Physical Education and Physical Activity subscale scores were also positively associated with the mean days per week students engaged in physical activity for ≥ 60 min in high FRPL districts (Strength: P = 0.008, Comprehensiveness: P = 0.003) and in low FRPL districts (< 35% eligible) for Strength score: (P = 0.027). In medium FRPL districts (35-50% eligible), Nutrition Education and Wellness Promotion Strength and Comprehensiveness subscale scores were positively associated with, respectively, daily servings of vegetables (P = 0.037) and fruit (P = 0.027); and WellSAT Total scores were positively associated with daily vegetable servings (Strength: P = 0.037, Comprehensiveness: P = 0.012). Administrators of economically disadvantaged school districts with a higher percentage of overweight students may be recognizing the need for stronger wellness policies and the specific importance of implementing policies pertaining to physical activity as a means to improve student health.

District wellness policies and school-level practices in Minnesota, USA

OBJECTIVE

To compare the strength of district wellness policies with corresponding school-level practices reported by principals and teachers.

DESIGN

District-level wellness policy data were collected from school district websites and, if not available online, by requests made to district administrators in the autumn of 2013. The strength of district policies was scored using the Wellness School Assessment Tool. School-level data were drawn from the 2012 Minnesota School Health Profiles principal and teacher surveys and the National Center for Education Statistics Common Core Data. Generalized estimating equations which accounted for school-level demographics and the nesting of up to two schools within some districts were used to examine ten district policy items and fourteen school-level practices of relevance to nutrition standards, nutrition education and wellness promotion, and physical activity promotion.

SETTING

State-wide sample of 180 districts and 212 public schools in Minnesota, USA.

RESULTS

The mean number of energy-dense, nutrient-poor snack foods and beverages available for students to purchase at school was inversely related to the strength of district wellness policies regulating vending machines and school stores (P=0·01). The proportion of schools having a joint use agreement for shared use of physical activity facilities was inversely related to the strength of district policies addressing community use of school facilities (P=0·03). No associations were found between the strength of other district policies and school-level practices.

CONCLUSIONS

Nutrition educators and other health professionals should assist schools in periodically assessing their wellness practices to ensure compliance with district wellness policies and environments supportive of healthy behaviours.