Process evaluation of a regional public health model to reduce chronic disease through policy and systems changes, Washington State, 2010-2014

Municipal community centers as healthy settings: evaluation of a real-world health promotion intervention in Jerusalem

Background

This study presents an intervention designed to foster the implementation of health promotion programs within District Municipality Community Centers (DMCCs) in Jerusalem, and the creation of a peer network of healthy settings with a shared aspiration of collaborating and implementing health-promoting policies at the community level. We also present the evaluation strategy, based on the EQUIHP and RE-AIM frameworks.

Methods

Twenty DMCCs completed our program. This evaluation research involved a comprehensive seminar during the first year for DMCCs coordinators, teaching them the principles of health promotion. An educational kit was distributed during the second year. The evaluation strategy included a process evaluation and annual evaluations based on the EQUIHP and RE-AIM frameworks. The EQUIHP tool was divided into four dimensions of evaluation: 1) Framework of health promotion principles, 2) Project development and implementation, 3) Project management, and 4) Sustainability; while the RE-AIM domains included: 1)Reach, 2)Effectiveness, 3)Adoption, 4)Implementation and 5)Maintenance.

Results

The program led to high responsiveness among DMCCs and to the implementation of diverse health promotion initiatives, with a participation of approximately 29,191 residents. The EQUIHP evaluation showed an improvement in program quality in Year 2. The final RE-AIM evaluation presented a total median score of 0.61 for all domains, where 0 was non-performance and 1.0 was full performance. The ‘Framework of health promotion principles’ and ‘Reach’ components received the highest median score (0.83, 1.0 and 0.87), while the ‘Sustainability and ‘Maintenance’ components received the lowest (0.5).

Conclusions

This innovative program adapts the Healthy Cities approach (initiated by the World Health Organization in 1986) to the development of community center health-promoting settings within the larger municipal framework, training local community center staff members to assess and address local health concerns and build community capacity. The local focus and efforts may help community actors to create health promotion programs more likely to be adopted, feasible in the ‘real-world’ and able to produce public health impact in the communities where people live. Moreover, collaboration and cooperation among DMCCs may lead to a broader community health vision, forging coalitions that can advocate more powerfully for health promotion.

Trial registration

NIH trial registration number: NCT04470960.

Retrospectively registered on: 14/07/2020.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-14220-7.

Adoption and Reach of a statewide policy, systems, and environment intervention to increase access to fresh fruits and vegetables in West Virginia

Local public health professionals’ consistency, connections, and presence at meetings were critical to making changes in schools, farmers markets, and retail food stores to improve access to fruits and vegetables in rural, low-income food deserts.

Strengthening complex systems for chronic disease prevention: a systematic review

BACKGROUND

While frameworks exist for strengthening health care systems and public health systems, there are no practical frameworks to describe, assess and strengthen systems for chronic disease prevention (CDP) using complex systems approaches.

METHODS

A systematic and integrative review of peer reviewed literature was conducted to answer the following questions: How can systems for CDP be defined? What are key attributes of effective systems? How are complex systems approaches discussed? Search terms were identified and the Medline, SCOPUS, and Global Health databases were searched December 2017 and January 2018. Reference lists and selected journals were hand searched. A working definition for a system for CDP was developed to provide a guideline for inclusion. Key exclusion criteria were literature did not address the research questions or working definition; was published in a language other than English and before 2000; focused on specific chronic diseases and/or risk factors and not CDP broadly; concentrated on the health care sector and clinical services and/or health status and surveillance data; and described evaluations of setting specific actions such as policies, programs, interventions, approaches, projects, laws, or regulations. Selected literature (n = 141) was coded in terms of the extent to which the research questions and the working definition of systems for CDP were addressed. Data was then analysed and synthesized to determine key themes.

RESULTS

A revised definition of systems for CDP and seven attributes of effective systems for CDP are reported (collaborative capacity, health equity paradigm, leadership and governance, resources, implementation of desired actions, information and complex systems paradigm). A framework was developed to provide a foundation for describing, assessing and strengthening systems for CDP.

CONCLUSIONS

The results of this literature review provide a strong foundation for a framework to help strengthen systems for CDP. The framework consolidates not only well-established attributes of effective CDP but also highlights theoretical and practical insights from complex systems perspectives.

Capacity Building for and Implementation of Policy, Systems, and Environmental Change: Results from a Survey of the National Comprehensive Cancer Control Program

Policy, systems, and environmental (PSE) approaches are commonly used to improve population health. Cancer-related examples include providing data and education to stakeholders about policies that support healthy living, or health systems changes such as universal reminders about recommended cancer screening. The National Comprehensive Cancer Control Program (NCCCP) funds health departments to form cancer coalitions that develop and implement cancer plans. NCCCP initiated a demonstration program in 13 of 65 funded grantees to determine whether skilled, dedicated staffing and using a strategic process to examine data, form a workgroup, and develop an agenda would enhance their capacity to implement PSE approaches, recruit new partners, and provide data and education to stakeholders. The objective of this study was to compare demonstration program grantees to other NCCCP grantees on their ability to develop and implement PSE strategies, and the short-term results that were achieved. Program directors (PDs) from each NCCCP-funded jurisdiction completed web surveys at 2 time points during implementation to assess changes in their capacity for PSE approaches, identify implementation activities, and document short-term outcomes. Responses from demonstration program PDs and other PDs at both time points were compared in a descriptive analysis. Demonstration program grantees experienced greater increases in skills and capacity to address PSE approaches, engaged in necessary implementation activities more often, and achieved greater improvements in stakeholder and decision maker awareness and support for PSE strategies, compared to nonparticipating NCCCP grantees. These findings support continued implementation of PSE approaches for sustainable cancer prevention and control.

Evaluating Structural Change Approaches to Health Promotion: An Exploratory Scoping Review of a Decade of U.S. Progress

Structural change approaches—also known as policy and environmental changes—are becoming increasingly common in health promotion, yet our understanding of how to evaluate them is still limited. An exploratory scoping review of the literature was conducted to understand approaches and methods used to evaluate structural change interventions in health promotion and public health literature. Two analysts—along with health sciences librarian consultation—searched PubMed, Web of Science, and EMBASE for peer-reviewed U.S.-based, English language studies published between 2005 and 2016. Data were extracted on the use of evaluation frameworks, study designs, duration of evaluations, measurement levels, and measurement types. Forty-five articles were included for the review. Notably, the majority (73%) of studies did not report application of a specific evaluation framework. Studies used a wide range of designs, including process evaluations, quasi- or nonexperimental designs, and purely descriptive approaches. In addition, 15.6% of studies only measured outcomes at the individual level. Last, 60% of studies combined more than one measurement type (e.g., site observation + focus groups) to evaluate interventions. Future directions for evaluating structural change approaches to health promotion include more widespread use and reporting of evaluation frameworks, developing validated tools that measure structural change, and shifting the focus to health-directed approaches, including an expanded consideration for evaluation designs that address health inequities.

Prevention Research Center Collaborations With State Departments of Health: Washington State

State health departments and Prevention Research Centers (PRCs) have complementary mandates and expertise important to improving population health. State health departments manage and administer numerous programs with broad population reach. PRCs bridge dissemination and implementation research and public health practice to improve health programming and outcomes. This paper describes the 15-year partnership between the Washington State Department of Health and the PRC at the University of Washington. Through this partnership, the Washington State Department of Health increases their research and evaluation capacity by working with the University of Washington PRC, and the University of Washington PRC receives opportunities to apply evidence in a variety of practice settings, expand the reach of their research-tested programs to new populations, and form new partnerships. The partnership focused initially on improving colorectal cancer screening rates through increased dissemination and implementation of evidence-based interventions. The partnership scope has grown to include small cancer screening projects in worksites and healthcare systems, Washington's Colorectal Cancer Control Program, breast and cervical cancer screening, hypertension control, and worksite health promotion. The partnership yields three main types of outcomes that strengthen practice and science: (1) findings from each major assessment or evaluation activity, published in the peer-reviewed literature when possible; (2) use of the findings to improve public health practice and impact; and (3) training opportunities for employees of local and state health departments and public health students. PRCs, health departments, and the populations they serve have much to gain from this type of partnership.