Modeling the sustainability of community health networks: novel approaches for analyzing collaborative organization partnerships across time

Protocol for a hybrid type 3 cluster randomized trial of a technical assistance system supporting coalitions and evidence-based drug prevention programs

BACKGROUND

Over 5000 community anti-drug coalitions operating in the USA serve as a cornerstone of federal drug prevention. These coalitions, however, have demonstrated effectiveness in preventing substance use only when they use technical assistance (TA) and implement evidence-based programs (EBPs). The absence of TA and EBP implementation by coalitions is a key research-to-practice gap. The Coalition Check-Up TA system is designed to fill this gap by supporting community coalition implementation of EBPs. Existing TA models for evidence-based coalition approaches are resource intensive and coalition model specific. The Coalition Check-Up is a lower cost strategy that works with a variety of types of coalitions to support sustainable implementation of EBPs. This study protocol describes a hybrid type 3 effectiveness-implementation trial applying Wandersman's Interactive Systems Framework to test the effects of the Coalition Check-Up on coalition EBP implementation capacity and outcomes. The Interactive Systems Framework outlines how the prevention support system-especially TA-bolsters EBP dissemination and implementation.

METHODS

Using a cluster randomized controlled design, this trial will test the overall effectiveness of the Coalition Check-Up, including how it contributes to EBP implementation and prevention of youth substance use. The first aim is to estimate the impact of the Coalition Check-Up on coalitions' capacity to do their work. We will recruit 68 anti-drug coalitions for random assignment to the Coalition Check-Up or "TA as usual" condition. We will evaluate whether the Coalition Check-Up improves coalition capacity using measures of coalition member responses about team processes, coalition network composition, and collaborative structure. Our second aim is to estimate the impact of the Coalition Check-Up on implementation of EBPs, and our third aim is to estimate the impact of the Coalition Check-Up on youth substance use.

DISCUSSION

This project will clarify how the Coalition Check-Up, a scalable approach to TA due to its low cost, affects coalition capacity to support EBP implementation. Analyses also provide insight into causal pathways from the prevention support system to the prevention delivery system outlined by the Interactive Systems Framework. Results will build the evidence-base for how to support community coalitions' sustainable implementation of evidence-based prevention programs and policies.

TRIAL REGISTRATION

Clinicaltrials.gov registration number NCT04592120 . Registered on October 19, 2020.

Measurement Approaches to Partnership Success: Theory and Methods for Measuring Success in Long-Standing Community-Based Participatory Research Partnerships

BACKGROUND

Numerous conceptual frameworks have been developed to understand how community-based participatory research (CBPR) partnerships function, and multiple measurement approaches have been designed to evaluate them. However, most measures are not validated, and have focused on new partnerships. To define and assess the meaning of success in long-standing CBPR partnerships, we are conducting a CBPR study, Measurement Approaches to Partnership Success (MAPS). In this article we describe the theoretical underpinnings and methodological approaches used.

OBJECTIVES

The objectives of this study are to 1) develop a questionnaire to evaluate success in long-standing CBPR partnerships, 2) test the psychometric qualities of the questionnaire, 3) assess the relationships between key variables and refine the questionnaire and theoretical model, and 4) develop mechanisms and a feedback tool to apply partnership evaluation findings.

METHODS

Methodological approaches have included: engaged a community-academic national Expert Panel; conducted key informant interviews with Expert Panel; conducted a scoping literature review; conducted a Delphi process with the Expert Panel; and revised the measurement instrument. Additional methods include: conduct cognitive interviews and pilot testing; revise and test final version of the questionnaire with long-standing CBPR partnerships; examine the reliability and validity; analyze the relationship among variables in the framework; revise the framework; and develop a feedback mechanism for sharing partnership evaluation results.

CONCLUSIONS

Through the application of a theoretical model and multiple methodological approaches, the MAPS study will result in a validated measurement instrument and will develop procedures for effectively feeding back evaluation findings in order to strengthen authentic partnerships to achieve health equity.

Health in All local Policies: Lessons learned on intersectoral collaboration in a community-based health promotion network in Denmark

Health promotion increasingly involves collaboration with civil society organisations and the private sector rather than being implemented exclusively by public sector stakeholders. Health in All Policies (HiAP) is an approach that promotes health in policy-making across public sectors. This study explored intersectoral integration and collaboration for health promotion at a local community level through a qualitative single case study of a local community network in Denmark: the Husum Health Network. The paper describes and discusses strengths, weaknesses, and challenges of HiAP-inspired local efforts to build alliances and supportive environments for health within an inter-organisational community-based network. The data were generated from participant observations made at 11 meetings and events organised by the network partners and nine qualitative, semi-structured interviews with Husum Health Network partners conducted from August 2014 to February 2015. The data were analysed using a theoretical framework introduced by Axelsson and Axelsson (2006) to characterise aspects of integration and differentiation between organisations. With high levels of structural and functional differentiation between the partners, the network provided an opportunity to exercise inter-organisational integration at the local level. Integration was fostered by knowledge sharing, face-to-face interaction, and communal events. However, the loose structure of the network was a challenge to its sustainability and achievement. We argue that Health in All local Policies is a meaningful concept in the context of local community development only when referring to the polices and strategies of all stakeholder organisations involved in decision-making and agenda setting, and not just local government institutions.

Examination of sustainability indicators for fall prevention strategies in three states

With 1-in-4 older adults suffering a fall each year, fall prevention efforts have emerged as a public health priority. Multi-level, evidence-based fall prevention programs have been promoted by the CDC and other government agencies. To ensure participants and communities receive programs' intended benefits, organizations must repeatedly deliver the programs over time and plan for program sustainability as part of 'scaling up' the initiative. The State Falls Prevention Project (SFPP) began in 2011 when the CDC provided 5 years of funding to State Departments of Health in Colorado, New York, and Oregon to simultaneously implement four fall prevention strategies: 1) Tai Chi: Moving for Better Balance; 2) Stepping On; 3) Otago Exercise Program; and 4) STEADI (STopping Elderly Accidents, Deaths, and Injuries) toolkit. Surveys were performed to examine systems change and perceptions about sustainability across states. The purposes of this study were to: 1) examine how funding influenced the capacity for program implementation and sustainability within the SFPP; and 2) assess reported Program Sustainability Assessment Tool (PSAT) scores to learn about how best to sustain fall preventing efforts after funding ends. Data showed that more organizations offered evidence-based fall prevention programs in participants' service areas with funding, and the importance of programming implementation, evaluation, and reporting efforts were likely to diminish once funding concluded. Participants' reported PSAT scores about perceived sustainability capacity did not directly align with previously reported perceptions about PSAT domain importance or modifiability. Findings suggest the importance of grantees to identify potential barriers and enablers influencing program sustainability during the planning phase of the programs.

The Sustainability of Evidence-Based Interventions and Practices in Public Health and Health Care

There is strong interest in implementation science to address the gap between research and practice in public health. Research on the sustainability of evidence-based interventions has been growing rapidly. Sustainability has been defined as the continued use of program components at sufficient intensity for the sustained achievement of desirable program goals and population outcomes. This understudied area has been identified as one of the most significant translational research problems. Adding to this challenge is uncertainty regarding the extent to which intervention adaptation and evolution are necessary to address the needs of populations that differ from those in which interventions were originally tested or implemented. This review critically examines and discusses conceptual and methodological issues in studying sustainability, summarizes the multilevel factors that have been found to influence the sustainability of interventions in a range of public health and health care settings, and highlights key areas for future research.

Rapid organizational network analysis to assess coordination of services for HIV testing clients: an exploratory study

Recognizing that HIV testing provides a gateway opportunity to connect with at-risk populations, we explored an approach to collect, analyze and present data on the network of connections between HIV testing organizations and other health and social service agencies operating in Durham County, NC. We surveyed 26 health and social service organizations, including 6 providing HIV testing services, and presented the results including frequency tabulations, network visualizations and metrics, and GIS maps to the participating organizations. Mapping the landscape of organizational relationships was seen as a practical and expedient approach to facilitating cross-sector collaborative efforts to improve community health.

A catalyst for system change: a case study of child health network formation, evolution and sustainability in Canada

BACKGROUND

The purpose of this study was to examine key processes and supportive and inhibiting factors involved in the development, evolution, and sustainability of a child health network in rural Canada. This study contributes to a relatively new research agenda aimed at understanding inter-organizational and cross-sectoral health networks. These networks encourage collaboration focusing on complex issues impacting health - issues that individual agencies cannot effectively address alone. This paper presents an overview of the study findings.

METHODS

An explanatory qualitative case study approach examined the Network's 13-year lifespan. Data sources were documents and Network members, including regional and 71 provincial senior managers from 11 child and youth service sectors. Data were collected through 34 individual interviews and a review of 127 documents. Interview data were analyzed using framework analysis methods; Prior's approach guided document analysis.

RESULTS

Three themes related to network development, evolution and sustainability were identified: (a) Network relationships as system triggers, (b) Network-mediated system responsiveness, and (c) Network practice as political.

CONCLUSIONS

Study findings have important implications for network organizational development, collaborative practice, interprofessional education, public policy, and public system responsiveness research. Findings suggest it is important to explicitly focus on relationships and multi-level socio-political contexts, such as supportive policy environments, in understanding health networks. The dynamic interplay among the Network members; central supportive and inhibiting factors; and micro-, meso-, and macro-organizational contexts was identified.

How is the sustainability of chronic disease health programmes empirically measured in hospital and related healthcare services?-a scoping review

OBJECTIVES

Programmes to address chronic disease are a focus of governments worldwide. Despite growth in 'implementation science', there is a paucity of knowledge regarding the best means to measure sustainability. The aim of this review was to summarise current practice for measuring sustainability outcomes of chronic disease health programmes, providing guidance for programme planners and future directions for the academic field.

SETTINGS

A scoping review of the literature spanning 1985-2015 was conducted using MEDLINE, CINAHL, PsychINFO and The Cochrane Library limited to English language and adults. Main search terms included chronic disease, acute care, sustainability, institutionalisation and health planning. A descriptive synthesis was required. Settings included primary care, hospitals, mental health centres and community health.

PARTICIPANTS

Programmes included preventing or managing chronic conditions including diabetes, heart disease, depression, respiratory disease, cancer, obesity, dental hygiene and multiple chronic diseases.

PRIMARY AND SECONDARY OUTCOME MEASURES

Outcome measures included clarifying a sustainability definition, types of methodologies used, timelines for assessment, criteria levels to determine outcomes and how methodology varies between intervention types.

RESULTS

Among 153 abstracts retrieved, 87 were retained for full article review and 42 included in the qualitative synthesis. Five definitions for sustainability outcome were identified with 'maintenance of programme activities' most frequent. Achieving sustainability was dependent on inter-relationships between various organisational and social contexts supporting a broad scale approach to evaluation. An increasing trend in use of mixed methods designs over multiple time points to determine sustainability outcomes was found.

CONCLUSIONS

Despite the importance and investment in chronic disease programmes, few studies are undertaken to measure sustainability. Methods to evaluate sustainability are diverse with some emerging patterns in measurement found. Use of mixed methods approaches over multiple time points may serve to better guide measurement of sustainability. Consensus on aspects of standardised measurement would promote the future possibility of meta-analytic syntheses.

Integrating Systems Science and Community-Based Participatory Research to Achieve Health Equity

Unanswered questions about racial and socioeconomic health disparities may be addressed using community-based participatory research and systems science. Community-based participatory research is an orientation to research that prioritizes developing capacity, improving trust, and translating knowledge to action. Systems science provides research methods to study dynamic and interrelated forces that shape health disparities. Community-based participatory research and systems science are complementary, but their integration requires more research. We discuss paradigmatic, socioecological, capacity-building, colearning, and translational synergies that help advance progress toward health equity.

The National Cancer Institute's Community Networks Program Initiative to Reduce Cancer Health Disparities: Outcomes and Lessons Learned

BACKGROUND

We describe reach, partnerships, products, benefits, and lessons learned of the 25 Community Network Programs (CNPs) that applied community-based participatory research (CBPR) to reduce cancer health disparities.

METHODS

Quantitative and qualitative data were abstracted from CNP final reports. Qualitative data were grouped by theme.

RESULTS

Together, the 25 CNPs worked with more than 2,000 academic, clinical, community, government, faith-based, and other partners. They completed 211 needs assessments, leveraged funds for 328 research and service projects, trained 719 new investigators, educated almost 55,000 community members, and published 991 articles. Qualitative data illustrated how use of CBPR improved research methods and participation; improved knowledge, interventions, and outcomes; and built community capacity. Lessons learned related to the need for time to nurture partnerships and the need to attend to community demand for sustained improvements in cancer services.

IMPLICATIONS

Findings demonstrate the value of government-supported, community-academic, CBPR partnerships in cancer prevention and control research.