Process evaluation of an environmental walking and healthy eating pilot in small rural worksites

Preventive health measures in small and medium-sized enterprises: A scoping review on implementation strategies

OBJECTIVE

To describe implementation strategies for preventive health measures in SMEs and the effectiveness of the strategies on implementation outcomes.

METHODS

A literature search was performed in multiple electronic databases. Studies published between 2000 and 2021 that evaluated the implementation of preventive health measures in SMEs were included. Classification of implementation strategies was based on two complementary classification systems.

RESULTS

Nineteen studies, of which 5 RCTs were included. Eighteen distinct implementation strategies were reported. All studies applied a combination of implementation strategies, and nearly all reported a positive effect on one or more implementation outcomes: sustainability, acceptability, feasibility, penetration, fidelity, adoption, and appropriateness.

CONCLUSIONS

Overall, a positive effect of combined implementation strategies on the implementation outcome(s) was found. The 'distribution of educational materials' and 'provide ongoing consultation' combined show positive effects on sustainability.

Who We Seek and What We Eat? Sources of Food Choice Inspirations and Their Associations with Adult Dietary Patterns before and during the COVID-19 Lockdown in New Zealand

Research shows the shaping of food choices often occurs at home, with the family widely recognised as significant in food decisions. However, in this digital age, our eating habits and decision-making processes are also determined by smartphone apps, celebrity chefs, and social media. The ‘COVID Kai Survey’ online questionnaire assessed cooking and shopping behaviours among New Zealanders during the 2020 COVID-19 ‘lockdown’ using a cross-sectional study design. This paper examines how sources of food choice inspirations (cooking-related advice and the reasons for recipe selection) are related to dietary patterns before and during the lockdown. Of the 2977 participants, those influenced by nutrition and health experts (50.9% before; 53.9% during the lockdown) scored higher for the healthy dietary pattern. Participants influenced by family and friends (35% before; 29% during the lockdown) had significantly higher scores for the healthy and the meat dietary patterns, whereas participants influenced by celebrity cooks (3.8% before; 5.2% during the lockdown) had significantly higher scores in the meat dietary pattern. There was no evidence that associations differed before and during the lockdown. The lockdown was related to modified food choice inspiration sources, notably an increase in ‘comforting’ recipes as a reason for recipe selection (75.8%), associated with higher scoring in the unhealthy dietary pattern during the lockdown. The lockdown in New Zealand saw an average decrease in nutritional quality of diets in the ‘COVID Kai Survey’, which could be partly explained by changes in food choice inspiration sources.

Development of a Wellness Committee Implementation Index for Workplace Health Promotion Programs in Small Businesses

PURPOSE

To construct a wellness committee (WC) implementation index and determine whether this index was associated with evidence-based intervention implementation in a workplace health promotion program.

DESIGN

Secondary data analysis of the HealthLinks randomized controlled trial.

SETTING

Small businesses assigned to the HealthLinks plus WC study arm.

SAMPLE

Small businesses (20-200 employees, n = 23) from 6 low-wage industries in King County, Washington.

MEASURES

Wellness committee implementation index (0%-100%) and evidence-based intervention implementation (0%-100%).

ANALYSIS

We used descriptive and bivariate statistics to describe worksites' organizational characteristics. For the primary analyses, we used generalized estimating equations with robust standard errors to assess the association between WC implementation index and evidence-based intervention implementation over time.

RESULTS

Average WC implementation index scores were 60% at 15 months and 38% at 24 months. Evidence-based intervention scores among worksites with WCs were 27% points higher at 15 months (64% vs 37%, P < .001) and 36% points higher at 24 months (55% vs 18%, P < .001). Higher WC implementation index scores were positively associated with evidence-based intervention implementation scores over time (P < .001).

CONCLUSION

Wellness committees may play an essential role in supporting evidence-based intervention implementation among small businesses. Furthermore, the degree to which these WCs are engaged and have leadership support, a set plan or goals, and multilevel participation may influence evidence-based intervention implementation and maintenance over time.

Process evaluation of a tailored workplace intervention designed to promote sustainable working in a rapidly changing world

Increasing numbers of people are employed in sedentary occupations, spending large amounts of time sitting at work which is detrimental to health and wellbeing. Evidence-based guidance is required to intervene to reduce sedentary behaviour, encourage physical activity and promote sustainable working. This article presents a process evaluation of a successful workplace intervention Walking Works Wonders, shown to be effective in improving health, job satisfaction and motivation (Haslam et al. 2018). In this qualitative process evaluation employees reported an increased awareness of their sedentary time and they particularly valued the monitoring of activity using pedometers. They described changes to their working and leisure time activity to accumulate more steps. Participants reported improved physiological and psychological health outcomes, improved working relations with colleagues, changes in dietary behaviour and involving their families in physical activity. The results highlight elements of the intervention that encouraged healthy and more sustainable working practices.Practitioner summary: This study provides the employees' perspective on the effective elements of a workplace intervention which encouraged physical activity and reduced sitting time. The results offer valuable insights for practitioners aiming to develop interventions to improve health and facilitate more sustainable working practices in a rapidly changing world of work.Abbreviations: BMI: body mass index; PDF: portable document format.

Rural physical activity interventions in the United States: a systematic review and RE-AIM evaluation

Background

Previous reviews of rural physical activity interventions were focused on intervention effectiveness and had reported overall mixed findings. The purpose of this systematic review was to apply the Reach, Efficacy, Adoption, Implementation and Maintenance (RE-AIM) framework to evaluate the extent to which rural physical activity interventions in the U.S. have reported on dimensions of internal and external validity and to offer suggestions for future physical activity interventions for rural U.S. populations.

Methods

Pubmed, PsychINFO, CINAHL, PAIS, and Web of Science were searched through February 2019 to identify physical activity intervention studies conducted in rural regions in the U.S. with adult populations. Titles, abstracts, and full texts of articles were reviewed against inclusion and exclusion criteria. Data extraction from included articles included a summary of study details, rural classification system used, and the presence or absence of a total 61 RE-AIM indicators, including reach (n = 13), efficacy/effectiveness (n = 10), adoption (n = 21), implementation (n = 9), and maintenance (n = 8).

Results

A total of 40 full-text articles representing 29 unique studies were included. Classifications of rurality included self-statements by authors (n = 19, 65.5%), population/census-based definitions (n = 3, 10.3%), Rural Urban Continuum Codes (n = 3, 10.3%), Rural Urban Commuting Area codes (n = 2, 6.9%), the 2014 Alabama Rural Health Association classification system (n = 1, 3.4%) and the U.S. Office of Management and Budget classification system (n = 1, 3.4%). Individual studies reported between 14.8 to 52.5% of total RE-AIM indicators. Studies reported 15.4 to 84.6% indicators for reach; 20.0 to 70.0% indicators for efficacy/effectiveness; 4.8 to 47.6% indicators for adoption; 11.1 to 88.9% indicators for implementation; and 0 to 25.0% indicators for maintenance.

Conclusions

We found an overall poor reporting of components related to external validity, which hinders the generalizability of intervention findings, and a lack of consistency in the definition of rurality. Future research should focus on balancing factors of internal and external validity, and should aim to develop a greater understanding of how rurality influences health and behavior to provide contextual knowledge needed to advance the translation of physical activity interventions into practice in rural communities and reduce rural health disparities.

Trial registration

The review protocol was registered with PROSPERO: CRD42019116308.

Mixed methods evaluation of an employer-led, free lunch initiative in Northern Ireland

BACKGROUND

The objective of this study was to evaluate the acceptance of an employer-led free lunch initiative and its effect on health, diet, and attitudes towards health and diet amongst employees in a small workplace in Northern Ireland.

METHODS

This was a controlled, employer-led pilot intervention, which was evaluated through a mixed methods approach.

RESULTS

Seventeen participants from the intervention site and 14 participants from the control site completed all assessments. Post-intervention, there was no difference in change in dietary measures between the sites, except for saturated fat intake during weekdays (IS: - 1.3% of calories, SD: 4.3; CS: 2.8% of calories, SD: 6.6; P-value < 0.05). Qualitative information was summarised to highlight employees' expectations and experiences with the intervention.

CONCLUSION

This study highlights the challenges that need to be considered when implementing a free lunch initiative for staff.

Evaluating Structural Change Approaches to Health Promotion: An Exploratory Scoping Review of a Decade of U.S. Progress

Structural change approaches—also known as policy and environmental changes—are becoming increasingly common in health promotion, yet our understanding of how to evaluate them is still limited. An exploratory scoping review of the literature was conducted to understand approaches and methods used to evaluate structural change interventions in health promotion and public health literature. Two analysts—along with health sciences librarian consultation—searched PubMed, Web of Science, and EMBASE for peer-reviewed U.S.-based, English language studies published between 2005 and 2016. Data were extracted on the use of evaluation frameworks, study designs, duration of evaluations, measurement levels, and measurement types. Forty-five articles were included for the review. Notably, the majority (73%) of studies did not report application of a specific evaluation framework. Studies used a wide range of designs, including process evaluations, quasi- or nonexperimental designs, and purely descriptive approaches. In addition, 15.6% of studies only measured outcomes at the individual level. Last, 60% of studies combined more than one measurement type (e.g., site observation + focus groups) to evaluate interventions. Future directions for evaluating structural change approaches to health promotion include more widespread use and reporting of evaluation frameworks, developing validated tools that measure structural change, and shifting the focus to health-directed approaches, including an expanded consideration for evaluation designs that address health inequities.

Use of a mixed-method approach to evaluate the implementation of retention promotion strategies in the New York State WIC program

This research assessed the implementation of strategies piloted at 10 Special Supplemental Nutrition Program for Women, Infants and Children (WIC) clinics aimed at increasing retention in the program, by enhancing participants' shopping experiences. Under WIC Retention Promotion Study: Keep, Reconnect, Thrive (WIC RPS), clinics were recruited and assigned to implement one or a combination of strategies: a standardized Shopping Orientation (SO) curriculum, a Guided Shopping Tour (GST), and a Pictorial Foods Card (PFC) from November 2012 through August 2013. This paper presents results from the process evaluation of the retention strategies, using a mixed-methods comparative case study design employing WIC administrative data, interviews, and focus groups. Qualitative data were inductively coded, analyzed and mapped to the following implementation constructs: organizational capacity, fidelity, allowable adaptations, implementation challenges, and participant responsiveness, while quantitative data were analyzed using SAS to assess reach and dose. Several sites implemented the SO and PFC interventions with the necessary fidelity and dose needed to assess impact on participants' shopping experiences. Sites that were assigned the GST strategy struggled to implement this strategy. However, use of the standardized SO enabled staff to use a "consistent list of shopping tips" to educate participants about the proper use of checks, while use of the PFC increased participants' awareness of the variety of WIC-allowable foods. During follow-up telephone calls, 91 percent of participants reported the shopping tips as helpful. Future analyses will assess the impact of enhanced shopping experience on retention at intervention sites.

Methods used to address fidelity of receipt in health intervention research: a citation analysis and systematic review

BACKGROUND

The American Behaviour Change Consortium (BCC) framework acknowledges patients as active participants and supports the need to investigate the fidelity with which they receive interventions, i.e. receipt. According to this framework, addressing receipt consists in using strategies to assess or enhance participants' understanding and/or performance of intervention skills. This systematic review aims to establish the frequency with which receipt is addressed as defined in the BCC framework in health research, and to describe the methods used in papers informed by the BCC framework and in the wider literature.

METHODS

A forward citation search on papers presenting the BCC framework was performed to determine the frequency with which receipt as defined in this framework was addressed. A second electronic database search, including search terms pertaining to fidelity, receipt, health and process evaluations was performed to identify papers reporting on receipt in the wider literature and irrespective of the framework used. These results were combined with forward citation search results to review methods to assess receipt. Eligibility criteria and data extraction forms were developed and applied to papers. Results are described in a narrative synthesis.

RESULTS

19.6% of 33 studies identified from the forward citation search to report on fidelity were found to address receipt. In 60.6% of these, receipt was assessed in relation to understanding and in 42.4% in relation to performance of skill. Strategies to enhance these were present in 12.1% and 21.1% of studies, respectively. Fifty-five studies were included in the review of the wider literature. Several frameworks and operationalisations of receipt were reported, but the latter were not always consistent with the guiding framework. Receipt was most frequently operationalised in relation to intervention content (16.4%), satisfaction (14.5%), engagement (14.5%), and attendance (14.5%). The majority of studies (90.0%) included subjective assessments of receipt. These relied on quantitative (76.0%) rather than qualitative (42.0%) methods and studies collected data on intervention recipients (50.0%), intervention deliverers (28.0%), or both (22.0%). Few studies (26.0%) reported on the reliability or validity of methods used.

CONCLUSIONS

Receipt is infrequently addressed in health research and improvements to methods of assessment and reporting are required.

Physical Activity-Related Policy and Environmental Strategies to Prevent Obesity in Rural Communities: A Systematic Review of the Literature, 2002-2013

INTRODUCTION

Health disparities exist between rural and urban residents; in particular, rural residents have higher rates of chronic diseases and obesity. Evidence supports the effectiveness of policy and environmental strategies to prevent obesity and promote health equity. In 2009, the Centers for Disease Control and Prevention recommended 24 policy and environmental strategies for use by local communities: the Common Community Measures for Obesity Prevention (COCOMO); 12 strategies focus on physical activity. This review was conducted to synthesize evidence on the implementation, relevance, and effectiveness of physical activity-related policy and environmental strategies for obesity prevention in rural communities.

METHODS

A literature search was conducted in PubMed, PsycINFO, Web of Science, CINHAL, and PAIS databases for articles published from 2002 through May 2013 that reported findings from physical activity-related policy or environmental interventions conducted in the United States or Canada. Each article was extracted independently by 2 researchers.

RESULTS

Of 2,002 articles, 30 articles representing 26 distinct studies met inclusion criteria. Schools were the most common setting (n = 18 studies). COCOMO strategies were applied in rural communities in 22 studies; the 2 most common COCOMO strategies were "enhance infrastructure supporting walking" (n = 11) and "increase opportunities for extracurricular physical activity" (n = 9). Most studies (n = 21) applied at least one of 8 non-COCOMO strategies; the most common was increasing physical activity opportunities at school outside of physical education (n = 8). Only 14 studies measured or reported physical activity outcomes (10 studies solely used self-report); 10 reported positive changes.

CONCLUSION

Seven of the 12 COCOMO physical activity-related strategies were successfully implemented in 2 or more studies, suggesting that these 7 strategies are relevant in rural communities and the other 5 might be less applicable in rural communities. Further research using robust study designs and measurement is needed to better ascertain implementation success and effectiveness of COCOMO and non-COCOMO strategies in rural communities.

Health promotion in small business: a systematic review of factors influencing adoption and effectiveness of worksite wellness programs

OBJECTIVE

To assess the evidence regarding the adoption and efficacy of worksite health promotion programs (WHPPs) in small businesses.

METHODS

Peer-reviewed research articles were identified from a database search. Included articles were published before July 2013, described a study that used an experimental or quasiexperimental design and either assessed adoption of WHPPs or conducted interventions in businesses with fewer than 500 employees. A review team scored the study's rigor using the WHO-adapted GRADEprofiler "quality of evidence" criteria.

RESULTS

Of the 84 retrieved articles, 19 met study inclusion criteria. Of these, only two met criteria for high rigor.

CONCLUSIONS

Fewer small businesses adopt WHPPs compared with large businesses. Two high-rigor studies found that employees were healthier postintervention. Higher quality research is needed to better understand why small businesses rarely adopt wellness programs and to demonstrate the value of such programs.

An innovative medical and dental hygiene clinic for street youth: results of a process evaluation

Canada has a noteworthy reputation for high quality health care. Nonetheless, street youth are one of our most vulnerable yet underserved populations. Consequently, a medical and dental clinic was created in downtown Ottawa, Ontario to respond to their needs. The purpose of this study is to describe a process evaluation of the clinic during its first year of operation with a focus on program fidelity, dose, reach, and satisfaction. A mixed methods approach was used involving interviews with providers, focus groups with street youth, analysis of Electronic Medical Record (EMR) data, and supplemental information such as document reviews. The evaluation identified areas that were working well along with challenges to program implementation. Areas of concerns and possible solutions were presented to the management team that then helped to plan and make improvements to the clinic. Our evaluation design and working relationship with clinic management promoted the integration of real-time evidence into program improvements.