Exploration of the experiences, practices and needs of health promotion professionals when evaluating their interventions and programmes

What do we want to get out of this? a critical interpretive synthesis of the value of process evaluations, with a practical planning framework

BACKGROUND

Process evaluations aim to understand how complex interventions bring about outcomes by examining intervention mechanisms, implementation, and context. While much attention has been paid to the methodology of process evaluations in health research, the value of process evaluations has received less critical attention. We aimed to unpack how value is conceptualised in process evaluations by identifying and critically analysing 1) how process evaluations may create value and 2) what kind of value they may create.

METHODS

We systematically searched for and identified published literature on process evaluation, including guidance, opinion pieces, primary research, reviews, and discussion of methodological and practical issues. We conducted a critical interpretive synthesis and developed a practical planning framework.

RESULTS

We identified and included 147 literature items. From these we determined three ways in which process evaluations may create value or negative consequences: 1) through the socio-technical processes of 'doing' the process evaluation, 2) through the features/qualities of process evaluation knowledge, and 3) through using process evaluation knowledge. We identified 15 value themes. We also found that value varies according to the characteristics of individual process evaluations, and is subjective and context dependent.

CONCLUSION

The concept of value in process evaluations is complex and multi-faceted. Stakeholders in different contexts may have very different expectations of process evaluations and the value that can and should be obtained from them. We propose a planning framework to support an open and transparent process to plan and create value from process evaluations and negotiate trade-offs. This will support the development of joint solutions and, ultimately, generate more value from process evaluations to all.

Success factors of health promotion: Evaluation by DEMATEL and M-DEMATEL methods - A case study in a non-profit organization

Proper health knowledge and adequate motivation for health activities are key factors that influence an individual to adopt a healthy behavior. Health promotion positively influences progressive behaviors that seek to advance health potential, to continuously improve one's lifestyle. There are many health promotion indications constantly encouraging people to eat healthier food. Based on the successful experience of a non-profit organization promoting a healthier vegetarian diet, this research identifies the operating factors that lead to the success of health promotion. The formulation and implementation of the health promotion strategy must be combined with the key success factors in order to accomplish the objectives. This study assessed seven factors, evaluated using the proposed method. The proposed Decision Making Trial and Evaluation Laboratory (DEMATEL) method constructs the cause and effect model of health promotion, and places forward suggestions and strategies for improvement based on the evaluation of the results. This research compared the original DEMATEL with a Modified DEMATEL (M-DEMATEL) to identify the success factors of health promotion. According to the results of both methods, "leadership", "communication channel" and "budget" are the most important and influential factors when promoting healthy diets. The results have shown the connection and the difference between the two methods. The main purpose of this research is not to determine which method is the best method, instead, to derive the combined effect of both methods.