Increasing research literacy: the community research fellows training program

Patient engagement in designing, conducting, and disseminating clinical pain research: IMMPACT recommended considerations

ABSTRACT

In the traditional clinical research model, patients are typically involved only as participants. However, there has been a shift in recent years highlighting the value and contributions that patients bring as members of the research team, across the clinical research lifecycle. It is becoming increasingly evident that to develop research that is both meaningful to people who have the targeted condition and is feasible, there are important benefits of involving patients in the planning, conduct, and dissemination of research from its earliest stages. In fact, research funders and regulatory agencies are now explicitly encouraging, and sometimes requiring, that patients are engaged as partners in research. Although this approach has become commonplace in some fields of clinical research, it remains the exception in clinical pain research. As such, the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials convened a meeting with patient partners and international representatives from academia, patient advocacy groups, government regulatory agencies, research funding organizations, academic journals, and the biopharmaceutical industry to develop consensus recommendations for advancing patient engagement in all stages of clinical pain research in an effective and purposeful manner. This article summarizes the results of this meeting and offers considerations for meaningful and authentic engagement of patient partners in clinical pain research, including recommendations for representation, timing, continuous engagement, measurement, reporting, and research dissemination.

Community Research Fellows Training Program: Evaluation of a COVID-19-Precipitated Virtual Adaptation

Community engagement is important for promoting health equity. However, effective community engagement requires trust, collaboration, and the opportunity for all stakeholders to share in decision-making. Community-based training in public health research can build trust and increase community comfort with shared decision-making in academic and community partnerships. The Community Research Fellows Training (CRFT) Program is a community-based training program that promotes the role of underserved populations in research by enhancing participant knowledge and understanding of public health research and other relevant topics in health. This paper describes the process of modifying the original 15-week in-person training program to a 12-week online, virtual format to assure program continuation. In addition, we provide program evaluation data of the virtual training. Average post-test scores were higher than pre-test scores for every session, establishing the feasibility of virtual course delivery. While the knowledge gains observed were not as strong as those observed for the in-person training program, findings suggest the appropriateness of continuing to adapt CRFT for virtual formats.

Promoting Authentic Academic-Community Engagement to Advance Health Equity

Meaningful community engagement is critical to achieving the lofty goal of health equity. Nonetheless, implementing the principles of community engagement is not easy. Attempting to implement best practices for collaborating on transdisciplinary teams and working with community partners can be challenging, particularly in locales that have a long history of strained university-community relationships. The purpose of this paper is to provide additional context and consideration for researchers, community partners, and institutions interested in conducting community-engaged research. Here, we provide guidance and highlight exemplary programs that offer effective approaches to enhance the strength of community partnerships. These partnerships not only hold promise but are also essential in the development of the local, multi-factor solutions required to address racial/ethnic inequities in health.

Adapting a Research and Community Capacity-Building Program to Address Rural Cancer Burden and Facilitate Partnership Development Between Rural Community Stakeholders and an Urban Comprehensive Cancer Center

While rural-urban cancer disparities persist, the research building capacity between rural communities and high-quality cancer centers remains limited. Thus, we describe how a National Cancer Institute-designated cancer center partnered with rural community stakeholders to adapt a cancer prevention-focused research and community capacity-building workshop. The workshop's goal was to strengthen community-academic partnerships and facilitate the development of sustainable well-resourced rural cancer-focused research. Researchers from the Siteman Cancer Center partnered with community leaders from rural counties in southern Illinois. We adapted the workshop from an existing evidence-based program. We analyzed changes in knowledge and research capacity and relevance to their community work. From February to May 2019, community partners guided all elements of the workshop development. Workshop participants were mostly White race (93%), had a college degree or beyond (75%), reported living in a rural community (93%), and represented an academic, faith-based, or healthcare institution (78%). Participants' mean knowledge scores of the presented content increased significantly after each session, from 9.3 to 9.9 for session 1 (p = 0.05) and 6.8 to 9.7 (p < 0.001) for session two. Through the workshop, participant scores also increased in research capacity skills, confidence, and their understanding of conducting research in the community. The workshop, co-curated and led by rural community leaders and researchers from Siteman Cancer Center, successfully increased knowledge of and interest in building cancer research capacity. Lessons from our work can inform the implementation of similar programs that address rural cancer health through research and community capacity building between rural community partners and urban cancer centers.

Strategies to Achieve Breast Health Equity in the St. Louis Region and Beyond over 15+ Years

Community-based participatory strategies are a promising approach to addressing disparities in community health outcomes. This paper details the efforts of Siteman Cancer Center to achieve breast health equity over the past 15+ years. We begin by describing the activities and successes arising from our breast health community partnerships including identifying priorities, developing recommendations, and implementing patient navigation services to advance breast health. This system-wide coordinated navigation approach that includes primary and specialty care providers helped to increase potential impact on reducing breast health disparities by expediting care, increasing care efficiency, and standardizing referral procedures across systems for all women including those who are uninsured and underinsured. We also discuss a mobile mammography unit that has been deployed to serve women living in both urban and rural regions. The van reached a particularly vulnerable population that was mostly poor, uninsured, and with limited educational backgrounds regardless of their zip code of service. This work shows that collaborations between academic and community partners have resulted in decreased late stage at diagnosis and improved access to mammography. Furthermore, we offer lessons learned and recommendations that may be applicable to other communities.

Strategies of community engagement in research: definitions and classifications

Engagement activities are defined along a continuum that analyzes and represents nonacademic stakeholder activities and interactions with academic researchers. Proposed continua begin with none to limited stakeholder inclusion and input into research and continue with descriptions of increasing presence, input, and participation in decision-making. Despite some agreement in the literature, development of consistent terminology and definitions has been recommended to promote the common understanding of strategies in engaged research. This paper sought to develop and understand classifications and definitions of community-engaged research that can serve as the foundation of a measure of engaged research that permits comparisons among engagement strategies and the outcomes that they produce in health- and healthcare-related research studies. Data on academic and stakeholder perceptions and understandings of classifications and definitions were obtained using Delphi process (N = 19) via online and face-to-face survey and cognitive response interviews (N = 16). Participants suggested the need for more nuanced understanding of engagement along portions of the continuum, with active involvement and decision-making as engagement progressed. Cognitive interview responses suggested that outreach and education is a more advanced level of engagement than previously discussed in the literature and viewed consultation negatively because it required work without guaranteeing community benefit. It is possible to define a continuum of patient- and community-engaged research that is understood and accepted by both academic researchers and community members. However, future research should revisit the understanding and depiction of the strategies that are to be used in measure development.

Resident-Led Neighborhood Development to Support Health: Identifying Strategies Using CBPR

Evidence suggests that where people live, learn, work, and play affects a range of health outcomes for children and adults. Differential access to social, economic, and environmental supports puts some community members at greater risk, leading to disparities in health and well-being. The 2014 release of the For the Sake of All report highlighted persistent health disparities for African Americans in St. Louis, Missouri, and their social and economic impacts on the St. Louis region. This study extends this work by developing partnerships with community organizations and neighborhood residents to address health disparities. Community-based participatory research (CBPR) methods were utilized to engage partners in a 10-month research process to address community concerns that impact health. Seven community residents, neighborhood researchers, engaged in workshops to learn about the research process and used techniques to gather information to implement action strategies. Neighborhood researchers selected 14 vacant lots to implement their action plan, which included visions for repurposing the land into a community park, produced a report for dissemination, and organized a community action forum to communicate their findings. This study highlights a promising approach to promote healthy communities and health equity by empowering neighborhood residents using participatory methodologies.

Community partners' responses to items assessing stakeholder engagement: Cognitive response testing in measure development

Background

Despite recognition of the importance of stakeholder input into research, there is a lack of validated measures to assess how well constituencies are engaged and their input integrated into research design. Measurement theory suggests that a community engagement measure should use clear and simple language and capture important components of underlying constructs, resulting in a valid measure that is accessible to a broad audience.

Objective

The primary objective of this study was to evaluate how community members understood and responded to a measure of community engagement developed to be reliable, valid, easily administered, and broadly usable.

Method

Cognitive response interviews were completed, during which participants described their reactions to items and how they processed them. Participants were asked to interpret item meaning, paraphrase items, and identify difficult or problematic terms and phrases, as well as provide any concerns with response options while responding to 16 of 32 survey items.

Results

The results of the cognitive response interviews of participants (N = 16) suggest concerns about plain language and literacy, clarity of question focus, and the lack of context clues to facilitate processing in response to items querying research experience. Minimal concerns were related to response options. Participants suggested changes in words and terms, as well as item structure.

Conclusion

Qualitative research can improve the validity and accessibility of measures that assess stakeholder experience of community-engaged research. The findings suggest wording and sentence structure changes that improve ability to assess implementation of community engagement and its impact on research outcomes.

Co-producing Progression Criteria for Feasibility Studies: A Partnership between Patient Contributors, Clinicians and Researchers

There is a lack of guidance for developing progression criteria (PC) within feasibility studies. We describe a process for co-producing PC for an ongoing feasibility study. Patient contributors, clinicians and researchers participated in discussions facilitated using the modified Nominal Group Technique (NGT). Stage one involved individual discussion groups used to develop and rank PC for aspects of the trial key to feasibility. A second stage involving representatives from each of the individual groups then discussed and ranked these PC. The highest ranking PC became the criteria used. At each stage all members were provided with a brief education session to aid understanding and decision-making. Fifty members (15 (29%) patients, 13 (25%) researchers and 24 (46%) clinicians) were involved in eight initial groups, and eight (two (25%) patients, five (62%) clinicians, one (13%) researcher) in one final group. PC relating to eligibility, recruitment, intervention and outcome acceptability and loss to follow-up were co-produced. Groups highlighted numerous means of adapting intervention and trial procedures should 'change' criteria be met. Modified NGT enabled the equal inclusion of patients, clinician and researcher in the co-production of PC. The structure and processes provided a transparent mechanism for setting PC that could be replicated in other feasibility studies.

Adaptation, Implementation, and Evaluation of a Public Health Research Methods Training for Youth

Purpose: To adapt, implement, and evaluate a public health research methods training program for youth. The Community Research Fellows Training Program is an evidence-based public health research methods training program for adults (18 years and older). The Youth Research Fellows Training (YRFT) is an adaptation of this program for youth.

Methods: University faculty facilitate didactic training sessions and experiential small group activities in biweekly sessions conducted as part of an existing 4-week summer camp. Participants were African American girls (n=11) ranging from ages 10 to 14 years (most recent grade completed 4th–8th). To evaluate participant knowledge gain and satisfaction pre-tests were administered before each session, and post-test and evaluations were administered after each session. In addition, faculty completed web-based evaluation surveys on their experience teaching in the program.

Results: Mean and median post-test scores were higher than pre-test scores for most (6 of the 7) of the training sessions; one session had no difference in scores. Participants rated the sessions well, on average overall session ratings of 4.3–4.8 on a 5-point Likert scale. Faculty rated their experience teaching in the program as excellent or very good and would be willing to teach in the program again (n=7; 100%).

Conclusion: This pilot implementation of the YRFT program proved highly successful in terms of participant and faculty experience. The program evaluation demonstrates increased knowledge of public health research methods. This program has the potential to prepare youth to engage in public health research as partners not just participants.

Training Community Members in Public Health Research: Development and Implementation of a Community Participatory Research Pilot Project

Purpose: Community-based training in public health research can build capacity for community-based participatory research (CBPR) and foster health partnerships between academics and stakeholders. We describe a community-academic partnership developed from a 15-week program, the Community Research Fellows Training (CRFT), designed to increase research literacy and facilitate equitable relationships in community/researcher collaborations and partnerships. The article provides a description of a community and faculty collaboration to conduct a participatory pilot research project that followed program completion. Methods: Four CRFT program alumni formed a community research team and selected a faculty mentor. After a request for proposal release, the team developed a pilot research proposal that addressed a concern for mental health among women experiencing economic stress. After completion of the pilot research, the community researchers elected to participate in two dissemination efforts, including a manuscript reflecting on their research experience. Team successes, challenges, and recommendations for future training are discussed. Results: Each member of the CRFT pilot research team reflects on how training prepared community members to conduct CBPR research through development and implementation of a pilot research project. Community researchers gained experience in grant proposal development, choosing appropriate health interventions, conducting in-person surveys and telephone interviews, and disseminating study findings. Conclusions: Providing training in public health research before community/researcher collaboration can increase community capacity to engage in research as equitable partners in research question development, study design, and data interpretation and dissemination. The project success suggests that this and similar programs maximize the potential of community-academic health partnerships to address health disparities.

Assessing Acceptability, Feasibility, and Preliminary Effectiveness of a Community-Based Participatory Research Curriculum for Community Members: A Contribution to the Development of a Community-Academia Research Partnership

Purpose: The community-based participatory research approach has been identified as a great asset in reducing health disparities through the integration of community members in all phases of the research process. It is essential to provide skills to community members to achieve successful research partnerships. The purpose of this study is to evaluate the feasibility, acceptability, and preliminary efficacy of the community-based participatory research training curriculum for community members.

Methods: Using mixed-methods, noncomparative design, eight workshops were developed and tested. Workshops covered topics such as community-based participatory research principles, health disparities, ethics in community-based participatory research, and fundamentals of research methodology. A total of 25 community leaders were trained. Pre-/post-test knowledge (unpaired t-test), retention rate, workshop satisfaction, and cognitive debriefing sessions were used to assess knowledge gained and acceptability and feasibility of the curriculum.

Results: A retention rate of 100% and an average satisfaction of 92.68% were obtained. Preliminary effectiveness results indicate that there was an overall significant change in participant's knowledge before and after the curriculum (p<0.001). In the cognitive debriefing, participants were satisfied with the organization and structure and found the curriculum feasible. Furthermore, participants identified the skills acquired to aid in being more effective in their communities and work with academic researchers. The following changes were recommended: workshops' order, time, practical activities, and level of language.

Discussion: Findings from this study suggest that the curriculum was acceptable and feasible to community leaders and that it might provide skills to actively incorporate community members in research activities. A large randomized clinical trial (RCT) study to evaluate curriculum effectiveness is recommended.

Comprehensive strategy for capturing and integrating community input into community research training curricula

Introduction

Community stakeholders often participate in community research training curricula development. There is limited information describing how their input informs curricula. This paper describes input solicitation methods, input received, and examples of its integration.

Methods

From June 2014 to June 2016, community members (CMs) and community-based organizations (CBOs) guided curricula development tailored for CMs and CBOs, respectively. Engagement methods included a strategic planning retreat, surveys, a listening session, workgroup meetings, and community engagement studios. Descriptive statistics were used to summarize survey input. For other methods, input was extracted and compiled from facilitator notes.

Results

CMs (n=37) and CBOs (n=83) providing input included patients and caregivers and advocacy, community service, and faith-based organizations, respectively. The major feedback categories were training topic priorities, format (e.g., face-to-face vs. online), logistics (e.g., training frequency), and compensation (e.g., appropriateness). Input directly guided design of CBO and CM curricula (e.g., additional time devoted to specific topics based on feedback) or helped to finalize logistics.

Conclusions

Multiple quantitative and qualitative methods can be used to elicit input from community stakeholders to inform the development of community research training curricula. This input is essential for the development of training curricula that are culturally relevant and acceptable.

Increasing Research Capacity in Underserved Communities: Formative and Summative Evaluation of the Mississippi Community Research Fellows Training Program (Cohort 1)

Background

The Mississippi Community Research Fellows Training Program (MSCRFTP) is a 15-week program conducted in Jackson, MS, USA consisting of training in the areas of evidence-based public health, research methods, research ethics, and cultural competency. The purpose of the program was to increase community knowledge and understanding of public health research, develop community-based projects that addressed health disparity in the participants’ community, increase individual and community capacity, and to engage community members as equal partners in the research process.

Methods

A comprehensive evaluation of the MSCRFTP was conducted that included both quantitative and qualitative methods. All participants were asked to complete a baseline, midterm, and final assessment as part of their program requirements. Knowledge gained was assessed by comparing baseline assessment responses to final assessment responses related to 27 key content areas addressed in the training sessions. Assessments also collected participants’ attitudes toward participating in research within their communities, their perceived influence over community decisions, and their perceptions of community members’ involvement in research, satisfaction with the program, and the program’s impact on the participants’ daily practice and community work.

Results

Twenty-one participants, the majority of which were female and African-American, completed the MSCRFTP. Knowledge of concepts addressed in 15 weekly training sessions improved significantly on 85.2% of 27 key areas evaluated (p < 0.05). Two mini-grant community based participatory research projects proposed by participants were funded through competitive application. Most participants agreed that by working together, the people in their community could influence decisions that affected the community. All participants rated their satisfaction with the overall program as “very high” (76.2%, n = 16) or “high” (23.8%, n = 5).

Conclusion

The evaluation of the MSCRFTP demonstrates that participants have the necessary knowledge to engage as research partners, and the pilot projects provided an opportunity for application of this objective to be realized. Overall, the MSCRFTP was an intervention that assisted community members in identifying their communities’ strengths and weaknesses, interpret knowledge in a meaningful way, and create a self-reflective community of inquiry for change.

Increasing Community Research Capacity to Address Health Disparities

The Community Research Fellows Training program is designed to enhance capacity for community-based participatory research; program participants completed a 15-week, Master of Public Health curriculum. We conducted qualitative, semistructured interviews with 81 participants from two cohorts to evaluate the learning environment and how the program improved participants' knowledge of public health research. Key areas that provided a conducive learning environment included the once-a-week schedule, faculty and participant diversity, and community-focused homework assignments. Participants discussed how the program enhanced their understanding of the research process and raised awareness of public health-related issues for application in their personal lives, professional occupations, and in their communities. These findings highlight key programmatic elements of a successful public health training program for community residents.

The science of stakeholder engagement in research: classification, implementation, and evaluation

In this commentary, we discuss the science of stakeholder engagement in research. We propose a classification system with definitions to determine where projects lie on the stakeholder engagement continuum. We discuss the key elements of implementation and evaluation of stakeholder engagement in research posing key questions to consider when doing this work. We commend and critique the work of Hamilton et al. in their multilevel stakeholder engagement in a VA implementation trial of evidence-based quality improvement in women's health primary care. We also discuss the need for more work in this area to enhance the science of stakeholder engagement in research.

EVALUATING COMMUNITY ENGAGEMENT IN RESEARCH: QUANTITATIVE MEASURE DEVELOPMENT

Although the importance of community engagement in research has been previously established, there are few evidence-based approaches for measuring the level of community engagement in research projects. A quantitative community engagement measure was developed, aligned with 11 engagement principles (EPs) previously established in the literature. The measure has 96 Likert response items; 3-5 quality items and 3-5 quantity items measure each EP. Cronbach's alpha is used to examine the internal consistency of items that measure a single EP. Every EP item group had a Cronbach's alpha > .85, which indicates strong internal consistency for all question groups across both scales (quality and quantity). This information determines the level of community engagement, which can be correlated with other research outcomes.

The HIV and Drug Abuse Prevention Research Ethics Training Institute: Training Early-Career Scientists to Conduct Research on Research Ethics

The responsible conduct of HIV/drug abuse prevention research requires investigators with both the knowledge of and ability to generate empirical data that can enhance global ethical practices and policies. This article describes a multidisciplinary program offering early-career professionals a 2-year intensive summer curriculum along with funding to conduct a mentored research study on a wide variety of HIV/drug abuse research ethics topics. Now in its fifth year, the program has admitted 29 trainees who have to date demonstrated increased knowledge of research ethics, produced 17 peer-reviewed publications, 46 professional presentations, and submitted or been awarded five related federal grants. The institute also hosts a global information platform providing general and HIV/drug abuse relevant research ethics educational and research resources that have had more than 38,800 unique visitors from more than 150 countries.

Quantitative Evaluation of the Community Research Fellows Training Program

Context

The community research fellows training (CRFT) program is a community-based participatory research (CBPR) initiative for the St. Louis area. This 15-week program, based on a Master in Public Health curriculum, was implemented by the Division of Public Health Sciences at Washington University School of Medicine and the Siteman Cancer Center.

Objectives

We measure the knowledge gained by participants and evaluate participant and faculty satisfaction of the CRFT program both in terms of meeting learning objectives and actively engaging the community in the research process.

Participants

We conducted analyses on 44 community members who participated in the CRFT program and completed the baseline and follow-up knowledge assessments.

Main outcome measures

Knowledge gain is measured by a baseline and follow-up assessment given at the first and final session. Additionally, pre- and post-tests are given after the first 12 sessions. To measure satisfaction, program evaluations are completed by both the participants and faculty after each topic. Mid-way through the program, a mid-term evaluation was administered to assess the program’s community engagement. We analyzed the results from the assessments, pre- and post-tests, and evaluations.

Results

The CRFT participants’ knowledge increased at follow-up as compared with baseline on average by a 16.5 point difference (p < 0.0001). Post-test scores were higher than pre-test scores for 11 of the 12 sessions. Both participants and faculty enjoyed the training and rated all session well.

Conclusion

The CRFT program was successful in increasing community knowledge, participant satisfaction, and faculty satisfaction. This success has enhanced the infrastructure for CBPR as well as led to CBPR pilot projects that address health disparities in the St. Louis Greater Metropolitan Area.

Building Capacity in a Rural North Carolina Community to Address Prostate Health Using a Lay Health Advisor Model

Background Prostate cancer is a critical concern for African Americans in North Carolina (NC), and innovative strategies are needed to help rural African American men maximize their prostate health. Engaging the community in research affords opportunities to build capacity for teaching and raising awareness. Approach and Strategies A community steering committee of academicians, community partners, religious leaders, and other stakeholders modified a curriculum on prostate health and screening to include interactive knowledge- and skill-building activities. This curriculum was then used to train 15 African American lay health advisors, dubbed Prostate Cancer Ambassadors, in a rural NC community. Over the 2-day training, Ambassadors achieved statistically significant improvements in knowledge of prostate health and maintained confidence in teaching. The Ambassadors, in turn, used their personal networks to share their knowledge with over 1,000 individuals in their community. Finally, the Ambassadors became researchers, implementing a prostate health survey in local churches. Discussion and Conclusions It is feasible to use community engagement models for raising awareness of prostate health in NC African American communities. Mobilizing community coalitions to develop curricula ensures that the curricula meet the communities' needs, and training lay health advisors to deliver curricula helps secure community buy-in for the information.