Building a community-based culture of evaluation

Culturally responsive evaluation: A scoping review of the evaluation literature

Evaluators have become increasingly aware of the influence of culture in evaluation, leading to new evaluation approaches that account for the cultural considerations in which evaluations are situated. This scoping review sought to explore how evaluators understand culturally responsive evaluation and identify promising practices. A search of nine evaluation journals yielded 52 articles that were included in this review. Nearly two-thirds of the articles stated that community involvement was essential to culturally responsive evaluation. Power differentials were discussed in almost half of the articles, and the majority used participatory or collaborative approaches to community engagement. Findings from this review suggest that in culturally responsive evaluation, evaluators prioritize community involvement and have an awareness and attentiveness to power differentials. Yet, gaps exist in how culture and evaluation are defined and interpreted, and consequently, inconsistency in how culturally responsive evaluation is practiced.

Examining the competencies required by evaluation capacity builders in community-based organizations

Increasing demand for evidence generated through program evaluation has led many community-based organizations (CBOs) to seek external support for evaluation capacity building (ECB). However, studies have yet to explore the essential competencies required by evaluation capacity builders working in the community sector. Our qualitative study aimed to examine the perceptions of ECB practitioners (n = 12) regarding essential competencies for building evaluation capacity in this sector. Our findings reveal that ECB practice requires competencies not found in known evaluation competency frameworks, such as instructional design, knowledge of organizational change models, motivating stakeholders, and understanding of the community sector. Our findings provide valuable information to help guide future education and training related to building the evaluation capacity of community organizations.

Laying a Solid Foundation for the Next Generation of Evaluation Capacity Building: Findings from an Integrative Review

Evaluation capacity building (ECB) continues to attract the attention and interest of scholars and practitioners. Over the years, models, frameworks, strategies, and practices related to ECB have been developed and implemented. Although ECB is highly contextual, the evolution of knowledge in this area depends on learning from past efforts in a structured approach. The purpose of the present article is to integrate the ECB literature in evaluation journals. More specifically, the article aims to answer three questions: What types of articles and themes comprise the current literature on ECB? How are current practices of ECB described in the literature? And what is the current status of research on ECB? Informed by the findings of the review, the article concludes with suggestions for future ECB practice and scholarship.

Strengthening child and youth programs: A look at inter-organizational mentoring strategies

Community-based non-profit organizations rarely have access to research or evaluation evidence to inform their programs and often lack the capacity to gather or use this information independently. In 2016, Wisdom2Action-a network of knowledge mobilization (KMb) experts, policy makers and service providers across Canada-launched an inter-organizational mentorship program to facilitate the implementation and sharing of best and promising practices within community-based programs for young people. This article outlines the findings from a developmental evaluation of eight mentoring relationships. Drawing on the Promoting Action on Research in Health Sciences (PARiHS) model of KMb, we look at mentoring as a type of facilitation that supports the increased use of evidence and evaluation information by non-profit organizations and identify key themes that support effective organizational mentorship in this sector. Findings reinforce the importance of establishing connected relationships and understanding context in mentoring relationships, creating adaptive and responsive work plans, ensuring consistent communication, and maintaining a focus on capacity-building if knowledge mobilization is to occur.

The role of relationships in collaborative partnership success: Lessons from the Alaska Fourth R project

Collaborative partnerships are critical to achieving health equity. As such, it is important to understand what contributes to the success of such partnerships. This paper describes the Alaska Fourth R collaborative, a multisectoral group of agencies (including education, health and human services, the violence against women sector, the governor's council on domestic violence, and an external evaluator) that successfully planned, implemented and evaluated a multi-focus health education program statewide. The purpose of this paper was to explore the ways in which seven pre-identified factors contributed to the successful achievement of the collaborative's goals. This project was grounded in community-based research principles, and collectively, the group chose to use Roussos and Fawcett's (2000) seven-factor model as the basis for the project. Using this model as a guide, semi-structured interviews were conducted with five leaders from the key organizations in the collaborative. In interviews, stakeholders described how each of the seven factors functioned in the Alaska collaborative to contribute to project success, with a particular focus on the critical role of relationships. Three specific relationship facets emerged as cross-cutting themes: flexibility, transparency, and prioritization. In sum, taking the time to build deep and authentic relationships, and then developing a shared vision and mission within the context of relationships that are flexible, transparent and prioritized, provided a strong foundation for future success in this collaborative.