A CBPR-Enhanced Delphi Method: The Measurement Approaches to Partnership Success Case Study

As part of a 5-year study to develop and validate an instrument for measuring success in long-standing community-based participatory research (CBPR) partnerships, we utilized the Delphi method with a panel of 16 community and academic CBPR experts to assess face and content validity of the instrument's broad concepts of success and measurement items. In addition to incorporating quantitative and qualitative feedback from two online surveys, we included a 2-day face-to-face meeting with the Expert Panel to invite open discussion and diversity of opinion in line with the CBPR principles framing and guiding the study. The face-to-face meeting allowed experts to review the survey data (with maintained anonymity), convey their perspectives, and offer interpretations that were untapped in the online surveys. Using a CBPR approach facilitated a synergistic process that moved above and beyond the consensus achieved in the initial Delphi rounds, to enhance the Delphi technique and the development of items in the instrument.

Validation of the Measurement Approaches to Partnership Success (MAPS) Questionnaire

Conceptualizing and testing factors that contribute to the success of community-academic partnerships are critical to understanding their contributions to the health and well-being of communities. Most measures to date focus on factors that contribute to the development of new partnerships, and only a few have been adequately tested and validated. Methods. The Measurement Approaches to Partnership Success (MAPS) study followed a community-based participatory research (CBPR) approach and a multiphase process that included the construction and pilot testing of a questionnaire, and a national survey to validate the psychometric properties of the questionnaire in long-standing CBPR partnerships (existing ≥ six years). All members within partnerships were recruited to complete the survey (55 partnerships with 563 partners). We used confirmatory factor analysis (CFA), Cronbach's alpha statistics, and a pairwise correlations approach to assess discriminant and convergent validity, and assessed internal consistency, and test-retest reliability. Results. All MAPS Questionnaire dimensions demonstrated strong validity and reliability and demonstrated agreement over time. Conclusion. The MAPS Questionnaire includes seven dimensions and 81 items related to the MAPS conceptual model and provides a scientific, in-depth measurement tool that allows long-standing CBPR partnerships to evaluate their work toward achieving health equity.

Using a CBPR Approach to Guide Successful Recruitment for an Online Questionnaire: The Measurement Approaches to Partnership Success (MAPS) Case Study

The Measurement Approaches to Partnership Success (MAPS) study team effectively used a community-based participatory research (CBPR) approach to recruit 55 long-standing CBPR partnerships to participate in an online questionnaire to assess factors associated with partnership success. Our recruitment was guided by interconnected values of collaboration, transparency, and relationship-building to maintain fidelity to CBPR principles throughout the process. We operationalized these values into a series of strategies to recruit partnerships and sustain their involvement, including establishing primary points of contact, offering incentives for completion, personalizing recruitment materials, and practicing flexibility in our approach. We aim to inform public health researchers on the strategies that enabled our team to achieve 100% of our study recruitment goal, with the intent that our recommendations can be applied by others to enhance their recruitment efforts and reach their data collection goals for future public health research.

The Measurement Approaches to Partnership Success (MAPS) Questionnaire and Facilitation Guide: A Validated Measure of CBPR Partnership Success

Partnerships that effectively engage in certain key structural and process functions are more likely to meet their research goals and contribute to longer-term health equity outcomes. Ongoing evaluation of partnerships' level of achievement of these key functions, along with their fidelity to the guiding principles of community-based participatory research (CBPR), is therefore essential to understand how they can achieve desired partnership outcomes. This article describes the validated Measurement Approaches to Partnership Success (MAPS) Questionnaire and the use of an accompanying Facilitation Guide in helping members of CBPR partnerships evaluate their partnership's state of development and interpret findings to improve its structure, processes, and outcomes. We describe the conceptual framework guiding the development of the MAPS Questionnaire and its 81-item across seven key outcome dimensions, along with 28 items measuring precursor characteristics of CBPR partnership outcomes. The Facilitation Guide provides general guidelines for sharing, interpreting, and applying results within partnerships using a participatory process, definitions and items for each dimension, an example of presenting summary means, and dimension-specific reflective questions for discussion. We offer recommendations for practical uses of the MAPS Questionnaire and Facilitation Guide. Whether used as a comprehensive tool or by dimension, the MAPS Questionnaire is conceptually sound and empirically validated for evaluating how CBPR partnerships can achieve long-standing success. CBPR partnerships at any stage of development will find the MAPS Questionnaire and Facilitation Guide useful in measuring and interpreting indicators of partnership success, sharing results, and improving their ability to contribute to achieving health equity goals.

Understanding the Benefit-Cost Relationship in Long-standing Community-based Participatory Research (CBPR) Partnerships: Findings from the Measurement Approaches to Partnership Success (MAPS) Study

As part of the Measurement Approaches to Partnership Success (MAPS) study, we investigated the relationship between benefits and costs of participation in long-standing community-based participatory research (CBPR) partnerships using social exchange theory as a theoretical framework. Three major findings were identified: (1) the concept of benefits and costs operating as a ratio, where individual benefits must outweigh costs for participation, applies to early stages of CBPR partnership formation; (2) as CBPR partnerships develop, the benefits and costs of participation include each other's needs and the needs of the group as a whole; and (3) there is a shift in the relationship of benefits and costs over time in long-standing CBPR partnerships, in which partners no longer think in terms of costs but rather investments that contribute to mutual benefits.

A Scoping Review of Strategies to Increase Black Enrollment and Retention in Cancer Clinical Trials

To address health disparities faced by Black patients with cancer, it is critical that researchers conducting cancer clinical trials (CCTs) equitably recruit and retain Black participants, develop strategies toward this aim, and document associated outcomes. This narrative scoping literature review, as part of a larger study, aimed to identify, describe, and categorize strategies and interventions intended to improve the recruitment and retention of Black participants with breast, lung, prostate, colorectal, or multiple myeloma cancer into CCTs. We conducted comprehensive searches in PubMed, Embase, Cochrane Library, PsycInfo, CINAHL, Scopus, and Web of Science with three main concepts: Black persons, neoplasms, and clinical trial recruitment. The search resulted in 1,506 articles, of which 15 met inclusion criteria. Five main categories of recruitment and retention strategies and interventions were identified based on their specific population focus and type of approach: (1) participant identification, (2) provider awareness/resources, (3) focused research staff interventions, (4) patient and community–focused awareness strategies, and (5) participant-directed resources. Thirteen studies had recruitment acceptance rates of over 30%. Eight studies with acceptance rates of ≥ 50% reported implementing ≥ 5 strategies, with an average use of seven strategies across multiple categories. Five studies with acceptance rates ≥ 50% implemented strategies in ≥ 3 categories. Four studies reported retention rates ≥ 74%. Three studies with reported retention rates ≥ 74% used strategies in ≥ 3 categories, and all included strategies aimed at meeting participant needs beyond the study. Our results show that many efforts that aim to increase the recruitment and retention of Black participants into CCTs have great potential, but the most promising strategies use a multiprong approach.

Measurement Approaches to Partnership Success: Theory and Methods for Measuring Success in Long-Standing Community-Based Participatory Research Partnerships

BACKGROUND

Numerous conceptual frameworks have been developed to understand how community-based participatory research (CBPR) partnerships function, and multiple measurement approaches have been designed to evaluate them. However, most measures are not validated, and have focused on new partnerships. To define and assess the meaning of success in long-standing CBPR partnerships, we are conducting a CBPR study, Measurement Approaches to Partnership Success (MAPS). In this article we describe the theoretical underpinnings and methodological approaches used.

OBJECTIVES

The objectives of this study are to 1) develop a questionnaire to evaluate success in long-standing CBPR partnerships, 2) test the psychometric qualities of the questionnaire, 3) assess the relationships between key variables and refine the questionnaire and theoretical model, and 4) develop mechanisms and a feedback tool to apply partnership evaluation findings.

METHODS

Methodological approaches have included: engaged a community-academic national Expert Panel; conducted key informant interviews with Expert Panel; conducted a scoping literature review; conducted a Delphi process with the Expert Panel; and revised the measurement instrument. Additional methods include: conduct cognitive interviews and pilot testing; revise and test final version of the questionnaire with long-standing CBPR partnerships; examine the reliability and validity; analyze the relationship among variables in the framework; revise the framework; and develop a feedback mechanism for sharing partnership evaluation results.

CONCLUSIONS

Through the application of a theoretical model and multiple methodological approaches, the MAPS study will result in a validated measurement instrument and will develop procedures for effectively feeding back evaluation findings in order to strengthen authentic partnerships to achieve health equity.

A Participatory, Mixed Methods Approach to Define and Measure Partnership Synergy in Long-standing Equity-focused CBPR Partnerships

Understanding what contributes to success of community-based participatory research (CBPR) partnerships is essential to ensuring their effectiveness in addressing health disparities and health inequities. Synergy, the concept of accomplishing more together than separately, is central to partnership effectiveness. However, synergy specific to long-standing, equity-focused CBPR partnerships has not been closely examined. To address this, we defined and developed measures of partnership synergy as one dimension of a participatory mixed methods study, Measurement Approaches to Partnership Success (MAPS), to develop a validated instrument to measure success in long-standing CBPR partnerships. Framed by a conceptual model and scoping literature review, we conducted in-depth interviews with a national panel of academic and community experts in CBPR and equity to develop partnership synergy measures. Items were refined through an iterative process, including a three-stage Delphi process, comparison with existing measures, cognitive interviews, and pilot testing. Seven questionnaire items were developed to measure synergy arising from equitable partnerships bringing together diverse partners across power differences to promote equity. Defining and measuring synergy in the context of long-standing partnership success is central to understanding the role of synergy in collaborative approaches to research and action and can strengthen CBPR partnerships to promote healthy communities and advance health equity.