Developing Theory to Guide Building Practitioners' Capacity to Implement Evidence-Based Interventions

Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers

Hundreds of millions of dollars are spent each year by U.S. federal agencies for training and technical assistance (TTA) to be delivered by training and technical assistance centers (TTACs) to "delivery system organizations" (e.g., federally qualified health centers, state departments of health, substance abuse treatment centers, schools, and healthcare organizations). TTACs are often requested to help delivery system organizations implement evidence-based interventions. Yet, counterintuitively, TTACs are rarely required to use evidence-based approaches when supporting delivery systems (in the use of evidence-based programs). In fact, evaluations of TTAC activities tend to be minimal; evaluation of technical assistance (if conducted at all) often emphasizes outputs (number of encounters), satisfaction, and self-reports of knowledge gained-more substantive outcomes are not evaluated. The gap between (a) the volume of TTA services being funded and provided and (b) the evaluation of those services is immense and has the potential to be costly. The basic question to be answered is: how effective are TTA services? This article introduces the special issue on Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers. The special issue promotes 1) knowledge of the state of the art of evaluation of TTACs and 2) advances in what to evaluate in TTA. A major goal of the issue is to improve the science and practice of implementation support, particularly in the areas of TTA.

Barriers to smoking interventions in community healthcare settings: a scoping review

Smoking is one of the major causes of preventable death and is considered the greatest threat to global public health. While the prevalence of smoking has decreased, population growth has led to an increase in the absolute number of smokers. There are many proven smoking cessation interventions available to support smokers in their quit attempts. Most people who smoke, however, underutilize the treatments available to them. This scoping review aimed to identify the current barriers experienced by all stakeholders (smokers, service providers and policymakers) to existing evidence-based smoking cessation interventions in community healthcare settings. Five electronic databases (CINAHL, Ovid MEDLINE, PsycINFO, Scopus and Web of Science) were searched for relevant literature. A total of 40 eligible articles from different countries published between 2015 and 2022 were included in the review and content analysis carried out to identify the key barriers to smoking cessation interventions. Seven key themes were found to be common to all stakeholders: (i) literacy, (ii) competing demands and priorities, (iii) time, (iv) access to product, (v) access to service, (vi) workforce and (vii) motivation/readiness. These themes were mapped to the Capability, Opportunity, Motivation-Behaviour (COM-B) model. This study presents the effect the barriers within these themes have on current smoking cessation services and highlights priorities for future interventions.

Navigating the field of implementation science towards maturity: challenges and opportunities

BACKGROUND

The field of implementation science has significantly expanded in size and scope over the past two decades, although work related to understanding implementation processes have of course long preceded the more systematic efforts to improve integration of evidence-based interventions into practice settings. While this growth has had significant benefits to research, practice, and policy, there are some clear challenges that this period of adolescence has uncovered.

MAIN BODY

This invited commentary reflects on the development of implementation science, its rapid growth, and milestones in its establishment as a viable component of the biomedical research enterprise. The authors reflect on progress in research and training, and then unpack some of the consequences of rapid growth, as the field has grappled with the competing challenges of legitimacy among the research community set against the necessary integration and engagement with practice and policy partners. The article then enumerates a set of principles for the field's next developmental stage and espouses the aspirational goal of a "big tent" to support the next generation of impactful science.

CONCLUSION

For implementation science to expand its relevance and impact to practice and policy, researchers must not lose sight of the original purpose of the field-to support improvements in health and health care at scale, the importance of building a community of research and practice among key partners, and the balance of rigor, relevance, and societal benefit.

Twenty years of capacity building across the cancer prevention and control research network

PURPOSE

To improve population health, community members need capacity (i.e., knowledge, skills, and tools) to select and implement evidence-based interventions (EBIs) to fit the needs of their local settings. Since 2002, the Centers for Disease Control and Prevention has funded the national Cancer Prevention and Control Research Network (CPCRN) to accelerate the implementation of cancer prevention and control EBIs in communities. The CPCRN has developed multiple strategies to build community members' capacity to implement EBIs. This paper describes the history of CPCRN's experience developing and lessons learned through the use of five capacity-building strategies: (1) mini-grant programs, (2) training, (3) online tools, (4) evidence academies, and (5) evaluation support for partners' capacity-building initiatives.

METHODS

We conducted a narrative review of peer-reviewed publications and grey literature reports on CPCRN capacity-building activities. Guided by the Interactive Systems Framework, we developed histories, case studies, and lessons learned for each strategy. Lessons were organized into themes.

RESULTS

Three themes emerged: the importance of (1) community-engagement prior to and during implementation of capacity-building strategies, (2) establishing and sustaining partnerships, and (3) co-learning at the levels of centers, networks, and beyond.

CONCLUSION

CPCRN activities have increased the ability of community organizations to compete for external funds to support implementation, increased the use of evidence in real-world settings, and promoted the broad-scale implementation of cancer control interventions across more than eight states. Lessons from this narrative review highlight the value of long-term thematic networks and provide useful guidance to other research networks and future capacity-building efforts.

Implementation studio: implementation support program to build the capacity of rural community health educators serving immigrant communities to implement evidence-based cancer prevention and control interventions

PURPOSE

Rural community-based organizations (CBOs) serving immigrant communities are critical settings for implementing evidence-based interventions (EBIs). The Implementation Studio is a training and consultation program focused on facilitating the selection, adaptation, and implementation of cancer prevention and control EBIs. This paper describes implementation and evaluation of the Implementation Studio on CBO's capacity to implement EBIs and their clients' knowledge of colorectal cancer (CRC) screening and intention to screen.

METHODS

Thirteen community health educators (CHEs) from two CBOs participated in the Implementation Studio. Both CBOs selected CRC EBIs during the Studio. The evaluation included two steps. The first step assessed the CHEs' capacity to select, adapt, and implement an EBI. The second step assessed the effect of the CHEs-delivered EBIs on clients' knowledge of CRC and intention to screen (n = 44).

RESULTS

All CHEs were Hispanic and women. Pre/post-evaluation of the Studio showed an increase on CHEs knowledge about EBIs (pre: 23% to post: 75%; p < 0.001). CHEs' ability to select, adapt, and implement EBIs also increased, respectively: select EBI (pre: 21% to post: 92%; p < 0.001), adapt EBI (pre: 21% to post: 92%; p < 0.001), and implement EBI (pre: 29% to post: 75%; p = 0.003). Pre/post-evaluation of the CHE-delivered EBI showed an increase on CRC screening knowledge (p < 0.5) and intention to screen for CRC by their clients.

CONCLUSION

Implementation Studio can address unique needs of low resource rural CBOs. An implementation support program with training and consultation has potential to build the capacity of rural CBOs serving immigrant communities to implementation of cancer prevention and control EBIs.

CLINICAL TRIALS REGISTRATION NUMBER

NCT04208724 registered.

Creating healthy food environments in recreation and sport settings using choice architecture: a scoping review

Recreation and sport settings (RSS) are ideal for health promotion, however, they often promote unhealthy eating. Choice architecture, a strategy to nudge consumers towards healthier options, has not been comprehensively reviewed in RSS and indicators for setting-based multi-level, multi-component healthy eating interventions in RSS are lacking. This scoping review aimed to generate healthy food environment indicators for RSS by reviewing peer-reviewed and grey literature evidence mapped onto an adapted choice architecture framework. One hundred thirty-two documents were included in a systematic search after screening. Data were extracted and coded, first, according to Canada's dietary guideline key messages, and were, second, mapped onto a choice architecture framework with eight nudging strategies (profile, portion, pricing, promotion, picks, priming, place and proximity) plus two multi-level factors (policy and people). We collated data to identify overarching guiding principles. We identified numerous indicators related to foods, water, sugary beverages, food marketing and sponsorship. There were four cross-cutting guiding principles: (i) healthy food and beverages are available, (ii) the pricing and placement of food and beverages favours healthy options, (iii) promotional messages related to food and beverages supports healthy eating and (iv) RSS are committed to supporting healthy eating and healthy food environments. The findings can be used to design nested, multipronged healthy food environment interventions. Future research is needed to test and systematically review the effectiveness of healthy eating interventions to identify the most promising indicators for setting-based health promotion in RSS.

Getting to implementation: Adaptation of an implementation playbook

Introduction

Implementation strategies supporting the translation of evidence into practice need to be tailored and adapted for maximum effectiveness, yet the field of adapting implementation strategies remains nascent. We aimed to adapt "Getting To Outcomes"® (GTO), a 10-step implementation playbook designed to help community-based organizations plan and evaluate behavioral health programs, into "Getting To Implementation" (GTI) to support the selection, tailoring, and use of implementation strategies in health care settings.

Methods

Our embedded evaluation team partnered with operations, external facilitators, and site implementers to employ participatory methods to co-design and adapt GTO for Veterans Health Administration (VA) outpatient cirrhosis care improvement. The Framework for Reporting Adaptations and Modifications to Evidenced-based Implementation Strategies (FRAME-IS) guided documentation and analysis of changes made pre- and post-implementation of GTI at 12 VA medical centers. Data from multiple sources (interviews, observation, content analysis, and fidelity tracking) were triangulated and analyzed using rapid techniques over a 3-year period.

Results

Adaptations during pre-implementation were planned, proactive, and focused on context and content to improve acceptability, appropriateness, and feasibility of the GTI playbook. Modifications during and after implementation were unplanned and reactive, concentrating on adoption, fidelity, and sustainability. All changes were collaboratively developed, fidelity consistent at the level of the facilitator and/or implementer.

Conclusion

GTO was initially adapted to GTI to support health care teams' selection and use of implementation strategies for improving guideline-concordant medical care. GTI required ongoing modification, particularly in steps regarding team building, context assessment, strategy selection, and sustainability due to difficulties with step clarity and progression. This work also highlights the challenges in pragmatic approaches to collecting and synthesizing implementation, fidelity, and adaptation data.

Trial registration

This study was registered on ClinicalTrials.gov (Identifier: NCT04178096).

Mechanisms of change in external implementation support: A conceptual model and case examples to guide research and practice

Background

External implementation support (EIS) is a well-recognized feature of implementation science and practice, often under related terms such as technical assistance and implementation facilitation. Existing models of EIS have gaps related to addressing practice outcomes at both individual and organizational levels, connecting practice activities to intended outcomes, or grounding in well-established theories of behavior and organization change. Moreover, there have been calls to clarify the mechanisms of change through which EIS influences related outcomes.

Method

In this article, we theorize about mechanisms of change within EIS. Our theorizing process aligns with the approach advocated by Kislov et al. We aim to consolidate prior EIS literature, combining related constructs from previous empirical and conceptual work while drawing on our extensive EIS experience to develop a higher-order, midrange theory of change.

Results

Our theory of change is empirically and practically informed, conceptually situated within an established grand theory of change, and guided by eight practice principles and social cognitive theory. The theory of change proposes 10 core practice components as mechanisms of change within EIS. When used according to underlying theory and principles, they are believed to contribute to favorable practice outcomes at individual, team, organizational, and system levels. The model offers flexibility by recognizing the need for sequential support processes and the demand to practice in dynamic and responsive ways. Case examples are presented to illustrate major themes and patterns of the model in action.

Conclusions

The proposed model is intended to support prospective EIS studies by conceptualizing discernable practice components with hypothesized relationships to proximal and distal practice outcomes. The model can be behaviorally operationalized to compliment and extend competency-based approaches to implementation support practitioner (ISP) training and coaching. Over time, the model should be refined based on new empirical findings and contributions from ISPs across the field.

How central support built capacity to deliver a health-promoting intervention for older adults in Canada

Most implementation frameworks note that a central support unit (CSU) is key to successful implementation and scale-up of evidence-based interventions (EBIs). However, few studies investigated core functions of CSUs-such as capacity building-to better understand their essential role in implementing EBIs at scale. Therefore, the aims of our study are to (1) describe the role that a CSU plays to build capacity in delivery partner organisations, to enable implementation and scale-up of a health-promoting intervention (Choose to Move [CTM]) for older adults, and (2) identify elements within capacity-building strategies deemed essential to effectively implement CTM in diverse community contexts. CTM is a flexible, scalable, community-based health-promoting physical activity (PA) and social connectedness intervention for older adults. In 2018-2020, eight health and social service societies, rural or remote municipalities or community-based organisations delivered 22 CTM programmes that served 322 older adults. We conducted in-depth interviews with delivery partners (n = 23), and a focus group with the central support system (n = 4). CSU provided a sounding board to organisations to create buy-in (adoption) and plan ahead. Essential elements within capacity-building strategies included: a support unit champion, enhanced delivery partner skills, self-efficacy and confidence; interactive assistance to answer questions and clarify materials. There is a key role for capacity-building under the stewardship of the CSU to promote implementation success. Investigating specific elements within capacity-building strategies that drive implementation success continues to be a relevant question for implementation science researchers, that deserves further attention.

Supporting community overdose response planning in Ontario, Canada: Findings from a situational assessment

Background

Many communities across North America are coming together to develop comprehensive plans to address and respond to the escalating overdose crisis, largely driven by an increasingly toxic unregulated drug supply. As there is a need to build capacity for successful implementation, the objective of our mixed methods study was to identify the current planning and implementation practices, needs, and priority areas of support for community overdose response plans in Ontario, Canada.

Methods

We used a situational assessment methodology to collect data on current planning and implementation practices, needs, and challenges related to community overdose response plans in Ontario, consisting of three components. Between November 2019 to February 2020, we conducted ten semi-structured key informant interviews, three focus groups with 25 participants, and administered an online survey (N = 66). Purposeful sampling was used to identify professionals involved in coordinating, supporting, or partnering on community overdose response plans in jurisdictions with relevant information for Ontario including other Canadian provinces and American states. Key informants included evaluators, representatives involved in centralised supports, as well as coordinators and partners on community overdose response plans. Focus group participants were coordinators or leads of community overdose response plans in Ontario.

Results

Sixty-six professionals participated in the study. The current planning and implementation practices of community overdose response plans varied in Ontario. Our analysis generated four overarching areas for needs and support for the planning and implementation of community overdose response plans: 1) data and information; 2) evidence and practice; 3) implementation/operational factors; and 4) partnership, engagement, and collaboration. Addressing stigma and equity within planning and implementation of community overdose response plans was a cross-cutting theme that included meaningful engagement of people with living and lived expertise and meeting the service needs of different populations and communities.

Conclusions

Through exploring the needs and related supports for community overdose response plans in Ontario, we have identified key priority areas for building local capacity building to address overdose-related harms. Ongoing development and refinement, community partnership, and evaluation of our project will highlight the influence of our supports to advance the capacity, motivation, and opportunities of community overdose response plans.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13762-0.

Prevention of Cardiovascular Diseases in Community Settings and Primary Health Care: A Pre-Implementation Contextual Analysis Using the Consolidated Framework for Implementation Research

Cardiovascular diseases are the world’s leading cause of mortality, with a high burden especially among vulnerable populations. Interventions for primary prevention need to be further implemented in community and primary health care settings. Context is critically important to understand potential implementation determinants. Therefore, we explored stakeholders’ views on the evidence-based SPICES program (EBSP); a multicomponent intervention for the primary prevention of cardiovascular disease, to inform its implementation. In this qualitative study, we conducted interviews and focus groups with 24 key stakeholders, 10 general practitioners, 9 practice nurses, and 13 lay community partners. We used adaptive framework analysis. The Consolidated Framework for Implementation Research guided our data collection, analysis, and reporting. The EBSP was valued as an opportunity to improve risk awareness and health behavior, especially in vulnerable populations. Its relative advantage, evidence-based design, adaptability to the needs and resources of target communities, and the alignment with policy evolutions and local mission and vision, were seen as important facilitators for its implementation. Concerns remain around legal and structural characteristics and intervention complexity. Our results highlight context dimensions that need to be considered and tailored to primary care and community needs and capacities when planning EBSP implementation in real life settings.

"We're categorized in these sizes-that's all we are": uncovering the social organization of young women's weight work through media and fashion

Background

For decades, dominant weight discourses have led to physical, mental, and social health consequences for young women in larger bodies. While ample literature has documented why these discourses are problematic, knowledge is lacking regarding how they are socially organized within institutions, like fashion and media, that young women encounter across their lifespan. Such knowledge is critical for those in public health trying to shift societal thinking about body weight. Therefore, we aimed to investigate how young women’s weight work is socially organized by discourses enacted in fashion and media, interpreting work generously as any activity requiring thought or intention.

Methods

Using institutional ethnography, we learned from 14 informants, young women aged 15–21, in Edmonton, Canada about the everyday work of growing up in larger bodies. We conducted 14 individual interviews and five repeated group interviews with a subset (n = 5) of our informants. A collaborative investigation of weight-related YouTube videos (n = 45) elicited further conversations with two informant-researchers about the work of navigating media. Data were integrated and analyzed holistically.

Results

Noticing the perpetual lack of larger women’s bodies in fashion and media, informants learned from an early age that thinness was required for being seen and heard. Informants responded by performing three types of work: hiding their weight, trying to lose weight, and resisting dominant weight discourses. Resistance work was aided by social media, which offered informants a sense of community and opportunities to learn about alternative ways of knowing weight. However, social media alleging body acceptance or positivity content often still focused on weight loss. While informants recognized the potential harm of engagement with commercial weight loss industries like diet and exercise, they felt compelled to do whatever it might take to achieve a “normal woman body”.

Conclusions

Despite some positive discursive change regarding body weight acceptance in fashion and media, this progress has had little impact on the weight work socially expected of young women. Findings highlight the need to broaden public health thinking around how weight discourses are (re)produced, calling for intersectoral collaboration to mobilize weight stigma evidence beyond predominantly academic circles into our everyday practices.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13607-w.

Measuring capacity to use evidence-based interventions in community-based organizations: A comprehensive, scoping review

Introduction:

Community-based organizations (CBOs) are well-positioned to incorporate research evidence, local expertise, and contextual factors to address health inequities. However, insufficient capacity limits use of evidence-based interventions (EBIs) in these settings. Capacity-building implementation strategies are popular, but a lack of standard models and validated measures hinders progress in the field. To advance the literature, we conducted a comprehensive scoping review.

Methods:

With a reference librarian, we executed a comprehensive search strategy of PubMed/Medline, Web of Science Core Collection, and EBSCO Global Health. We included articles that addressed implementation science, capacity-building, and CBOs. Of 5527 articles, 99 met our inclusion criteria, and we extracted data using a double-coding process

Results:

Of the 99 articles, 47% defined capacity explicitly, 31% defined it indirectly, and 21% did not define it. Common concepts in definitions were skills, knowledge/expertise, and resources. Of the 57 articles with quantitative analysis, 48 (82%) measured capacity, and 11 (23%) offered psychometric data for the capacity measures. Of the 99 studies, 40% focused exclusively on populations experiencing inequities and 22% included those populations to some extent. The bulk of the studies came from high-income countries.

Conclusions:

Implementation scientists should 1) be explicit about models and definitions of capacity and strategies for building capacity, 2) specify expected multi-level implementation outcomes, 3) develop and use validated measures for quantitative work, and 4) integrate equity considerations into the conceptualization and measurement of capacity-building efforts. With these refinements, we can ensure that the necessary supports reach CBO practitioners and critical partners for addressing health inequities.

Building implementation capacity in health care and welfare through team training-study protocol of a longitudinal mixed-methods evaluation of the building implementation capacity intervention

Background

To ensure the provision of high-quality safety and cost-effective health and welfare services, managers and professionals are required to introduce and ensure the routine use of clinical guidelines and other evidence-based interventions. Despite this, they often lack training and support in implementation. This project aims to investigate how a team training intervention, with the goal to build implementation capacity, influences participants’ implementation knowledge and skills, as well as how it influences implementation activities and implementation capacity within participating health and welfare organizations. Furthermore, the aim is to investigate how the organizations’ contexts influence the intervention outcomes.

Methods

The building implementation capacity (BIC) intervention builds on the behavior change wheel, which considers implementation as a matter of behavior change. The intervention will be provided to teams of managers and professionals working in health and welfare organizations and seeking support to implement a guideline- or evidence-based intervention. The intervention consists of a series of interactive workshops that provides the participating teams with the knowledge and skills to apply a systematic implementation model. A longitudinal mixed-methods evaluation, including interviews, surveys, and document analysis, will be applied over 24 months. The normalization process theory measure will be used to assess how the intervention influences implementation activities in practice and implementation capacity in the teams and the wider organizations.

Discussion

This project has an ambition to add to the knowledge concerning how to promote the uptake of research findings into health care by building implementation capacity through team training in implementation. The project’s uniqueness is that it is designed to move beyond individual-level outcomes and evaluate implementation activities and implementation capacity in participating organizations. Further, the intervention will be evaluated over 24 months to investigate long-term outcomes of implementation training.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-021-00233-7.

Local Health Departments' Capacity for Workplace Health Promotion Programs to Prevent Chronic Disease: Comparison of Rural, Micropolitan, and Urban Contexts

OBJECTIVE

To examine local health department (LHD) contexts, capacity for, and interest in partnering with employers on workplace health promotion programs (WHPPs) for chronic disease prevention.

DESIGN

Qualitative interviews with LHD directors.

SETTING

LHDs from 21 counties in 10 states.

PARTICIPANTS

Twenty-one LHD directors.

MAIN OUTCOME MEASURESS

Experiences and perceptions of existing partnerships, decision making, funding, data needs, and organizational capacity for WHPP partnerships with employers.

RESULTS

We identified 3 themes: (1) LHDs see the value of partnering with employers but lack the capacity to do so effectively; (2) while LHDs base priorities on community need, funding ultimately drives decision making; and (3) rural, micropolitan, and urban LHDs differ in their readiness and capacity to work with employers.

CONCLUSIONS

Understanding LHDs' partnership capacity and context is essential to the successful implementation of WHPP partnerships with employers. Expanding these partnerships may require additional financial investments, particularly among rural LHDs.

Examining the external validity of the CRUZA study, a randomized trial to promote implementation of evidence-based cancer control programs by faith-based organizations

The CRUZA trial tested the efficacy of an organizational-level intervention to increase capacity among Catholic parishes to implement evidence-based interventions (EBIs) for cancer control. This paper examines the external generalizability of the CRUZA study findings by comparing characteristics of parishes that agreed to participate in the intervention trial versus those that declined participation. Sixty-five Roman Catholic parishes that offered Spanish-language mass in Massachusetts were invited to complete a four-part survey assessing organization-level characteristics that, based on the Consolidated Framework for Implementation Research (CFIR), may be associated with EBI implementation. Forty-nine parishes (75%) completed the survey and were invited to participate in the CRUZA trial, which randomized parishes to either a "capacity enhancement intervention" or a "standard dissemination" group. Of these 49 parishes, 31 (63%) agreed to participate in the trial, whereas 18 parishes (37%) declined participation. Parishes that participated in the CRUZA intervention trial were similar to those that did not participate with respect to "inner organizational setting" characteristics of the CFIR, including innovation and values fit, implementation climate, and organizational culture. Change commitment, a submeasure of organizational readiness that reflects the shared resolve of organizational members to implement an innovation, was significantly higher among the participating parishes (mean = 3.93, SD = 1.08) as compared to nonparticipating parishes (mean = 3.27, SD = 1.08) (Z = -2.16, p = .03). Parishes that agreed to participate in the CRUZA intervention trial were similar to those that declined participation with regard to organizational characteristics that may predict implementation of EBIs. Pragmatic tools to assess external generalizability in community-based implementation trials and to promote readiness among faith-based organizations to implement EBIs are needed to enhance the reach and impact of public health research. Clinical Trial information: The CRUZA trial identifier number with clinicaltrials.gov is NCT01740219.

Key considerations for designing capacity-building interventions to support evidence-based programming in underserved communities: a qualitative exploration

Increasing the use of evidence-based programs (EBPs) in community settings is critical for improving health and reducing disparities. Community-based organizations (CBOs) and faith-based organizations (FBOs) have tremendous reach and trust within underserved communities, but their impact is constrained by limited staff capacity to use EBPs. This exploratory study sought to identify design and delivery considerations that could increase the impact of capacity-building interventions for CBOs and FBOs working with underserved communities. Data come from a community-based participatory research project addressing cancer disparities in Black, Latino, and Brazilian communities from Greater Boston and Greater Lawrence, Massachusetts. We conducted four focus group discussions with program coordinators in CBOs and FBOs (n = 27) and key informant interviews with CBO and FBO leaders (n = 15). Three researchers analyzed the data using a multi-stage coding process that included both prefigured and emergent codes. Key design considerations included embedding customized capacity-building interventions into community networks with local experts, supporting ongoing engagement with the intervention via a range of resources and communication channels, and addressing resource constraints. Regarding the contextual factors that should influence capacity-building intervention content, participants highlighted resource constraints, environments in which EBP use is not the norm, and challenges linking available programs with the multi-level barriers to good health faced by community members. Overall, the study highlights the need for integrated, long-term capacity-building efforts developed in partnership with, and ultimately sustained by, local organizations.

Examining the feasibility and characteristics of realistic weight management support for patients: Focus groups with rural, micropolitan, and metropolitan primary care providers

The purpose of this investigation was to understand perspectives of physicians, nurses, and staff regarding the feasibility of implementing an evidence-based weight management program to support primary care practice. An exploratory aim was to examine differences in responses based on the clinic location. Ten focus groups were conducted with primary care staff from rural, micropolitan, and metropolitan clinics. The Promoting Action on Research in Health Services (PARIHS) framework was used to inform the interview guide. Transcripts were reviewed to identify common themes among PARIHS constructs (evidence, context, and facilitation). Presence of comorbidities (e.g., diabetes, hypertension) were typical prompts for provider-led discussions about patient weight. Metropolitan clinics reported the availability of health coaching, diabetes education, or dietician consultation, but no clinic reported offering a comprehensive weight management program. Participants agreed it is possible to implement a weight management program through primary care, but cited potential facilitation challenges such as costs, clinic resources, and individual patient barriers. More enthusiasm arose for a referral program with patient tracking. Program characteristics such as proven efficacy, individual tailoring, program accessibility, and patient feedback to the providers were desired. Rural focus group participants reported unique barriers (lack of local resources) and facilitators (more flexibility in practice changes) to weight management when compared to metropolitan and micropolitan focus groups. Primary care staff are interested in weight management solutions for their patients and would prefer an evidence-based program to which they could refer patients, receive feedback on patient progress, and sustainably include as part of their regular services.

Active & Safe Central: using a mixed-methods design and the RE-AIM framework to evaluate a sport and recreational injury prevention resource for practitioners in Canada

OBJECTIVES

An online, evidence-based resource was created to support the development of sport and recreational injury prevention programmes. The resource, called Active & Safe Central (www.activesafe.ca), provides evidence-based information across the public health approach for a number of sport and recreational activities. The objective of this project was to evaluate the perceived usefulness of Active & Safe Central as an educational tool.

DESIGN

A mixed-methods study design, guided by the RE-AIM (reach, effectiveness, adoption, implementation and maintenance) framework, was used to evaluate Active & Safe Central.

SETTING

Data were collected using an online survey, available to all users of the site, and focus groups (n=2) that took place in Vancouver and Toronto, Canada.

PARTICIPANTS

Survey respondents (n=87) were recruited online, including parents, coaches, youth and adult athletes, and teachers. Focus group participants (n=16) were key stakeholders and end users, recruited from academia, local health sectors, sport and recreational organisations, and not-for-profit injury prevention organisations.

RESULTS

Post launch, there were 1712 users visiting the website 2306 times (sessions), with the majority representing new users, over returning users (87.5% and 12.5%, respectively). There were 6340 page visits, with the most popular pages including soccer, playgrounds and ice hockey. Active & Safe Central was reported as a credible source of evidence-based sport and recreational information and that the site would be recommended to others. Information collected from focus group participants was used to inform necessary adaptations to the online platform, including critical navigation issues, visualisations and interactivity. The major themes that emerged from focus group and survey data included increased awareness of injury prevention recommendations and that the recommendations would be used in one's own sporting activity and/or practice.

CONCLUSIONS

The results of the evaluation suggest the tool is a useful resource for sport and recreational injury information that has significant potential to impact prevention practice.

The use of the PARIHS framework in implementation research and practice-a citation analysis of the literature

BACKGROUND

The Promoting Action on Research Implementation in Health Services (PARIHS) framework was developed two decades ago and conceptualizes successful implementation (SI) as a function (f) of the evidence (E) nature and type, context (C) quality, and the facilitation (F), [SI = f (E,C,F)]. Despite a growing number of citations of theoretical frameworks including PARIHS, details of how theoretical frameworks are used remains largely unknown. This review aimed to enhance the understanding of the breadth and depth of the use of the PARIHS framework.

METHODS

This citation analysis commenced from four core articles representing the key stages of the framework's development. The citation search was performed in Web of Science and Scopus. After exclusion, we undertook an initial assessment aimed to identify articles using PARIHS and not only referencing any of the core articles. To assess this, all articles were read in full. Further data extraction included capturing information about where (country/countries and setting/s) PARIHS had been used, as well as categorizing how the framework was applied. Also, strengths and weaknesses, as well as efforts to validate the framework, were explored in detail.

RESULTS

The citation search yielded 1613 articles. After applying exclusion criteria, 1475 articles were read in full, and the initial assessment yielded a total of 367 articles reported to have used the PARIHS framework. These articles were included for data extraction. The framework had been used in a variety of settings and in both high-, middle-, and low-income countries. With regard to types of use, 32% used PARIHS in planning and delivering an intervention, 50% in data analysis, 55% in the evaluation of study findings, and/or 37% in any other way. Further analysis showed that its actual application was frequently partial and generally not well elaborated.

CONCLUSIONS

In line with previous citation analysis of the use of theoretical frameworks in implementation science, we also found a rather superficial description of the use of PARIHS. Thus, we propose the development and adoption of reporting guidelines on how framework(s) are used in implementation studies, with the expectation that this will enhance the maturity of implementation science.

Overcoming Challenges Resulting From COVID-19: New York State's Creating Healthy Schools and Communities Initiative

“Upstream” interventions that increase access or reduce barriers to healthy foods and opportunities for physical activity — referred to as policy, systems, or environmental strategies — are central to encouraging and supporting healthy behaviors that prevent chronic disease at a population level. However, they are complex and challenging to execute, especially during coronavirus disease 2019 (COVID-19), and efforts to build practitioner capacity are warranted. In this commentary, we describe a user or human-centered design (HCD) capacity-building approach to support practitioners in accomplishing the goals of the New York State Creating Healthy Schools and Communities (CHSC) initiative. This approach has been especially helpful during COVID-19, as it enables support to be responsive to practitioners’ constantly changing needs. Given that CHSC is a project specific to New York State and that the efforts of the Obesity Prevention Center for Excellence were tailored to obesity prevention, more research and evaluations should be conducted to better understand how the use of HCD could support practitioners addressing other complex public health issues in the United States.

Strengthening public health nutrition: findings from a situational assessment to inform system-wide capacity building in Ontario, Canada

Objective:

To assess public health nutrition practice within the public health system in Ontario, Canada to identify provincial-wide needs for scientific and technical support.

Design:

A qualitative descriptive study was conducted to identify activities, strengths, challenges and opportunities in public health nutrition practice using semi-structured key informant interviews (n 21) and focus groups (n 10). Recorded notes were analysed concurrently with data generation using content analysis. System needs were prioritised through a survey.

Setting:

Public health units.

Participants:

Eighty-nine practitioners, managers, directors, medical officers of health, researchers and other stakeholders were purposively recruited through snowball and extreme case sampling.

Results:

Five themes were generated: (i) current public health nutrition practice was broad, complex, in transition and collaborative; (ii) data/evidence/research relevant to public health needs were insufficiently available and accessible; (iii) the amount and specificity of guidance/leadership was perceived to be mismatched with strong evidence that diet is a risk factor for poor health; (iv) resources/capacity were varied but insufficient and (v) understanding of nutrition expertise in public health among colleagues, leadership and other organisations can be improved. Top ranked needs were increased understanding, visibility and prioritisation of healthy eating and food environments; improved access to data and evidence; improved collaboration and coordination; and increased alignment of activities and goals.

Conclusions:

Collective capacity in the public health nutrition can be improved through strategic system-wide capacity-building interventions. Research is needed to explore how improvements in data, evidence and local contexts can bridge research and practice to effectively and efficiently improve population diets and health.

Quality Enhancement Research Initiative Implementation Roadmap: Toward Sustainability of Evidence-based Practices in a Learning Health System

BACKGROUND

Learning Health Systems strive to continuously integrate innovations and evidence-based practices (EBPs) into routine care settings. Few models provide a specified pathway to accelerate adoption and spread of EBPs across diverse settings.

OBJECTIVE

The US Department of Veterans Affairs Quality Enhancement Research Initiative (QUERI) Implementation Roadmap facilitates uptake of EBPs in routine practice by aligning research and health system priorities.

METHODS

The Roadmap is based on earlier iterations of the QUERI translational research pipeline, incorporating recent advancements in quality improvement and implementation science. Progressive, dynamic phases were operationalized to form an implementation process that promoted a participatory approach which enables stakeholders (health care consumers, clinicians, administrators, and leaders) to systematically plan, deploy, evaluate, and sustain EBPs using implementation strategies within a Learning Health System framework.

RESULTS

The Roadmap consists of Preimplementation, Implementation, and Sustainment phases. Preimplementation identifies a high-priority need, selects EBPs to address the need, engages stakeholders to build implementation capacity, specifies needed EBP adaptions and evaluation goals, and activates leadership support. During Implementation, clinical and research leaders use implementation strategies to promote EBP technical competency and adaptive skills to motivate providers to own and sustain EBPs. Sustainment includes evaluation analyses that establish the EBP business case, and hand-off to system leadership to own EBP implementation maintenance over time.

CONCLUSIONS

The QUERI Implementation Roadmap systematically guides identification, implementation, and sustainment of EBPs, demystifying implementation science for stakeholders in a Learning Health System to ensure that EBPs are more rapidly implemented into practice to improve overall consumer health.

Implementation support practitioners - a proposal for consolidating a diverse evidence base

Background

Workforce development for implementation practice has been identified as a grand challenge in health services. This is due to the embryonic nature of the existing research in this area, few available training programs and a general shortage of frontline service staff trained and prepared for practicing implementation in the field. The interest in the role of “implementation support” as a way to effectively build the implementation capacities of the human service sector has therefore increased. However, while frequently used, little is known about the skills and competencies required to effectively provide such support.

Main body

To progress the debate and the research agenda on implementation support competencies, we propose the role of the “implementation support practitioner” as a concept unifying the multiple streams of research focused on e.g. consultation, facilitation, or knowledge brokering. Implementation support practitioners are professionals supporting others in implementing evidence-informed practices, policies and programs, and in sustaining and scaling evidence for population impact. They are not involved in direct service delivery or management and work closely with the leadership and staff needed to effectively deliver direct clinical, therapeutic or educational services to individuals, families and communities. They may be specialists or generalists and be located within and/or outside the delivery system they serve. To effectively support the implementation practice of others, implementation support practitioners require an ability to activate implementation-relevant knowledge, skills and attitudes, and to operationalize and apply these in the context of their support activities. In doing so, they aim to trigger both relational and behavioral outcomes. This thinking is reflected in an overarching logic outlined in this article.

Conclusion

The development of implementation support practitioners as a profession necessitates improved conceptual thinking about their role and work and how they enable the uptake and integration of evidence in real world settings. This article introduces a preliminary logic conceptualizing the role of implementation support practitioners informing research in progress aimed at increasing our knowledge about implementation support and the competencies needed to provide this support.

How can we support best practice? A situational assessment of injury prevention practice in public health

BACKGROUND

To effectively impact the significant population burden of injury, we completed a situational assessment of injury prevention practice within a provincial public health system to identify system-wide priorities for capacity-building to advance injury prevention in public health.

METHODS

A descriptive qualitative study was used to collect data on the current practice, challenges and needs of support for injury prevention. Data was collected through semi-structured interviews (n = 20) and focus groups (n = 19). Participants included a cross-section of injury prevention practitioners and leadership from public health units reflecting different population sizes and geographic characteristics, in addition to public health researchers and experts from academia, public health and not-for-profit organizations. Thematic analysis was used to code all of the data by one reviewer, followed by a second independent reviewer who coded a random selection of interview notes. Major codes and sub codes were identified and final themes were decided through iterations of coding comparisons and categorization. Once data were analysed, we confirmed the findings with the field, in addition to participating in a prioritization exercise to surface the top three needs for support.

RESULTS

Major themes that were identified from the data included: current public health practice challenges; capacity and resource constraints, and; injury as a low priority area. Overall, injury prevention is a broad, complex topic that competes with other areas of public health. Best practices are challenged by system-wide factors related to resources, direction, coordination, collaboration, and emerging injury public health issues. Injury is a reportedly under prioritized and under resourced public health area of practice. Practitioners believe that increasing access to data and evidence, and improving collaboration and networking is required to promote best practice.

CONCLUSIONS

The results of this study suggest that there are several system level needs to support best practice in public health injury prevention in Ontario including reducing research to practice gaps and supporting opportunities for collaboration. Our research contributes to the literature of the complexity of public health practice, and presents several mechanisms of support to increase capacity at a system level to improve injury prevention practice, and eventually lessen the population burden of injury.

Supporting public health practice in healthy growth and development in the Province of Ontario, Canada

BACKGROUND

As public health services are modernized in Ontario, Canada, there is a need to inform the system-level roles and responsibilities of government agencies. The aim of this study was to identify how Public Health Ontario (PHO) can optimally support evidence-based planning and programming in Healthy Growth and Development (HGD) across Ontario.

METHODS AND DESIGN

A situational assessment was conducted with key informants from public health and other HGD fields.

SAMPLE

Key informants were identified using purposeful snowball sampling and included public health nurses, health promoters, and medical officers of health. Analytic strategy: Twenty telephone interviews and seven focus groups were used to collect data. A thematic analysis was conducted concurrently with data collection.

RESULTS

Five themes were identified: (a) Transition to the new Ontario Public Health Standards (OPHS) included experiences of adopting the new OPHS within local public health units (PHUs). (b) Collaborating and networking referred to the ability to work with community partners. (c) Data, evidence, and research described the presence of data, evidence, and research to support practice. (d) Decision making, planning, and priority setting described resources available that influenced decision making. (e) Current and emerging issues in HGD included high-priority topics.

CONCLUSION

Public health practice in HGD is complex with many challenges in data and evidence, and making programming decisions without adequate or measurable indicators. A specialized position at PHO is an opportunity to support some of these system-wide needs.

Evaluating the NICHE program in an Academic Medical Center: Uncovering the missing link between training and effective practice change in the care of older adults

PURPOSE

This paper recounts the history and experiences of one academic medical center that sought to improve the care of elderly patients by adopting and adapting the Geriatric Resource Nurse (GRN) model recommended by the Nurses Improving the Care of Healthsystem Elderly (NICHE) program. A formal evaluation examined the perceptions, opinions and attitudes of non-GRN nursing peers, Nurse Managers (NMs) and members of the Inter-Professional Advisory Board (IAB) regarding GRN practices and the institution's NICHE program.

DESIGN

A qualitative research design with purposive sampling was utilized.

METHODS

Semi-structured interviews and focus groups conducted in the fall/winter 2017 were analyzed using standard content analysis methods of isolating and grouping contextual themes without a predefined framework.

FINDINGS

The institution's GRN training program, a hybrid of the national NICHE program and organization-developed components, has strong support among NMs, members of the IAB and other RNs. However, there exist many misconceptions, erroneous information and misunderstandings about the program and the roles and expectations of GRNs that have hindered the likelihood of producing desired outcomes.

CONCLUSIONS

Training GRNs was insufficient in disseminating and implementing evidenced-based geriatric practices in this hospital. Future work in this area would benefit from integrating concepts and methods from dissemination and implementation science when developing, launching, and sustaining NICHE programs.

CLINICAL RELEVANCE

Integrating principles and models of dissemination and implementation science can increase consistent use of evidence based practices and the likelihood of improved geriatric patient outcomes in NICHE hospitals.

Knowledge translation and implementation of housing first in Canada: A qualitative assessment of capacity building needs for an evidence-based program

We examined communities' expressed needs for capacity building in the implementation of Housing First (HF) for persons experiencing homelessness. The findings are based on thematic analyses of qualitative data obtained from participants (n = 77) in 11 focus groups conducted in seven Canadian cities. We identified capacity building needs in the areas of training (e.g., HF principles, clinical services, landlord engagement) and technical assistance (e.g., intake coordination, client prioritization, fidelity assessment). These findings were used to tailor training and technical assessment (TTA) to the stages of HF implementation in these cities. Limitations and implications for future theory, research, and practice are discussed.

Eat, play, live: a randomized controlled trial within a natural experiment examining the role of nutrition policy and capacity building in improving food environments in recreation and sport facilities

Background

Recreation and sport facilities often have unhealthy food environments that may promote unhealthy dietary patterns among children. In response, some Canadian provinces have released voluntary nutrition guidelines for recreation and sport facilities, however implementation has been limited. Organizational capacity building may overcome barriers to implementing guidelines. Eat, Play, Live was a randomized controlled trial embedded within a natural experiment that tested the impact of an 18 month capacity building intervention (CBI) in enhancing implementation of provincial nutrition guidelines, and whether nutrition guidelines were associated with positive changes. Primary outcomes were facility capacity, policy development and food environment quality.

Methods

Recreation and sport facilities in three guideline provinces were randomized into a guideline + CBI (GL + CBI; n = 17) or a guideline only comparison condition (GL-ONLY; n = 15). Facilities in a province without guidelines constituted a second comparison condition (NO-GL; n = 17). Facility capacity, policy development, and food environment quality (vending and concession) were measured and compared at baseline and follow-up across conditions using repeated measures ANOVA and Chi-square statistics. Healthfulness of vending and concession items was rated as Do Not Sell (least nutritious), Sell Sometimes or Sell Most (most nutritious).

Results

There were significant time by condition effects, with significant increases in facility capacity (mean ± SD: 30.8 ± 15.6% to 62.3 ± 22.0%; p <  0.01), nutrition policy development (17.6% developed new policies; p = 0.049), overall quality of the concession food environment (14.7 ± 8.4 to 17.5 ± 7.2; p <  0.001), and in the proportion of Sell Most (3.7 ± 4.4% to 11.0 ± 9.0%; p = 0.002) and Sell Sometimes vending snacks (22.4 ± 14.4% to 43.8 ± 15.8%; p <  0.001) in GL + CBI facilities, with a significant decline in Do Not Sell vending snacks (74.0 ± 16.6% to 45.2 ± 20.1%; p <  0.001).

Conclusions

Significant improvements in facility capacity, policy development and food environment quality occurred in recreation and sport facilities that were exposed to nutrition guidelines and participated in a CBI. Outcomes did not improve in facilities that were only passively or not at all exposed to guidelines. Ongoing capacity building may enhance implementation of voluntary nutrition guidelines, however food environments remained overwhelmingly unhealthy, suggesting additional scope to enhance implementation.

Trials registration

Clinical trials registration (retrospectively registered): ISRCTN14669997 Jul 3, 2018.

Electronic supplementary material

The online version of this article (10.1186/s12966-019-0811-8) contains supplementary material, which is available to authorized users.

Data-Powered Participatory Decision Making: Leveraging Systems Thinking and Simulation to Guide Selection and Implementation of Evidence-Based Colorectal Cancer Screening Interventions

A robust evidence base supports the effectiveness of timely colorectal cancer (CRC) screening, follow-up of abnormal results, and referral to care in reducing CRC morbidity and mortality. However, only two-thirds of the US population is current with recommended screening, and rates are much lower for those who are vulnerable because of their race/ethnicity, insurance status, or rural location. Multiple, multilevel factors contribute to observed disparities, and these factors vary across different populations and contexts. As highlighted by the Cancer Moonshot Blue Ribbon Panel working groups focused on Prevention and Early Detection and Implementation Science inadequate CRC screening and follow-up represent an enormous missed opportunity in cancer prevention and control. To measurably reduce CRC morbidity and mortality, the evidence base must be strengthened to guide the identification of (1) multilevel factors that influence screening across different populations and contexts, (2) multilevel interventions and implementation strategies that will be most effective at targeting those factors, and (3) combinations of strategies that interact synergistically to improve outcomes. Systems thinking and simulation modeling (systems science) provide a set of approaches and techniques to aid decision makers in using the best available data and research evidence to guide implementation planning in the context of such complexity. This commentary summarizes current challenges in CRC prevention and control, discusses the status of the evidence base to guide the selection and implementation of multilevel CRC screening interventions, and describes a multi-institution project to showcase how systems science can be leveraged to optimize selection and implementation of CRC screening interventions in diverse populations and contexts.

Lung Cancer Screening and Epigenetics in African Americans: The Role of the Socioecological Framework

Lung cancer is the leading cause of cancer morbidity and mortality in the U.S. and racial/ethnic minorities carry the greatest burden of lung cancer disparities with African Americans (AAs) impacted disproportionately. Inequities in lung cancer health disparities are often associated with multiple bio-behavioral and socio-cultural factors among racial/ethnic minorities. Epigenetic research has advanced the understanding of the intersectionality between biological and socio-cultural factors in lung cancer disparities among AAs. However, gaps exist in the engagement of diverse populations in epigenetic lung cancer research, which poses a challenge in ensuring the generalizability and implementation of epigenetic research in populations that carry an unequal cancer burden. Grounding epigenetic lung cancer research within a socio-ecological framework may prove promising in implementing a multi-level approach to community engagement, screening, navigation, and research participation among AAs. The University of Illinois Cancer Center (UI Cancer Center) is employing an evidence–based (EB) model of community/patient engagement utilizing the socio-ecological model (SEM) to develop a culturally sensitive epigenetic lung cancer research program that addresses multiple factors that impact lung cancer outcomes in AAs. By implementing epigenetic research within a group of Federally Qualified Health Centers (FQHCs) guided by the SEM, the UI Cancer Center is proposing a new pathway in mitigating lung cancer disparities in underserved communities. At the individual level, the framework examines tobacco use among patients at FQHCs (the organizational level) and also tailors epigenetic research to explore innovative biomarkers in high risk populations. Interpersonal interventions use Patient Navigators to support navigation to EB tobacco cessation resources and lung cancer screening. Community level support within the SEM is developed by ongoing partnerships with local and national partners such as the American Lung Association (ALA) and the American Cancer Society (ACS). Lastly, at the policy level, the UI Cancer Center acknowledges the role of policy implications in lung cancer screening and advocates for policies and screening recommendations that examine the current guidelines from the United States Preventive Services Task Force (USPTF).

Participatory development and pilot testing of iChoose: an adaptation of an evidence-based paediatric weight management program for community implementation

BACKGROUND

To describe the identification, adaptation, and testing of an evidence-based pediatric weight management program for a health disparate community.

METHODS

A community advisory board (CAB) of decision-makers and staff from local health care, public health, and recreation organizations engaged with academic partners to select an evidence-based program (EBP) for local implementation. Three EBPs were identified (Traffic Light, Bright Bodies, Golan and colleagues Home Environmental Model) and each EBP was rated on program characteristics, implementation and adaptation, and adoptability. Following selection of the EBP that was rated highest, the POPS-CAB made adaptations based on the program principles described in peer-reviewed publications. The adapted intervention, iChoose, was then pilot tested in 3 iterative phases delivered initially by research partners, then co-delivered by research and community partners, then delivered by community partners. The RE-AIM framework was used to plan and evaluate the iChoose intervention across all waves with assessments at baseline, post program (3 months), and follow-up (6 months).

RESULTS

Bright Bodies rated highest on program characteristics and adoptability (p's < 0.05), while Home Environmental Model rated highest on implementation factors (p < 0.05). Qualitatively, the selection focused on important program characteristics and on matching those characteristics to the potential to fit within the community partner services. The adapted program-iChoose-had 18% reach and with participants that were representative of the target population on age, gender, ethnicity, and race. Effectiveness was demonstrated by modest, but significant reductions in BMI z-scores at post-program compared to baseline (MΔ = - 0.047; t = - 2.11, p = 0.046). This decrease returned to values similar to baseline 3 months (MΔ = 0.009) after the program was completed. Implementation fidelity was high and implementation fidelity did not differ between community or research delivery agents.

CONCLUSION

The process to help organizations identify and select evidence-based programs appropriate for their community led to consensus on a single EBP. While iChoose was successful in initiating changes in BMI z-scores, could be implemented in a low resource community with fidelity, it was insufficient to lead to sustained child BMI z-scores. In response to these data, maintenance of program effects and delivery are the current focus of the CBPR team.

Service Coordination by Public Sector Managers in a Human Service Contracting Environment

Despite emerging evidence of contracting for evidence-based practices (EBP), little research has studied how managers lead contract-based human service delivery. A 2015 survey of 193 managers from five San Francisco Bay Area county human service departments examined the relationship between contract-based service coordination (i.e., structuring cross-sector services, coordinating client referrals and eligibility, overseeing EBP implementation) and the predictors of managerial role, involvement, and boundary spanning. Multivariate regression results suggested that county managers identified fewer service coordination challenges if they were at the executive and program levels, had greater contract involvement, and engaged in contract-focused boundary spanning. In conclusion, we underscore the organizational and managerial dimensions of contract-based service delivery.

Innovative Implementation Studies Conducted in US Safety Net Health Care Settings: A Systematic Review

Little is known about dissemination and implementation in safety net settings. The authors conducted a literature review of innovation/implementation studies in US safety net health care settings between 2008 and 2017. Each article was coded for (1) intervention characteristics, (2) implementation stage, (3) internal versus external ownership, and (4) prespecified implementation outcomes (eg, acceptability and fidelity). Twenty studies were identified; the majority were implemented within community clinics or integrated safety net systems (15 articles), most involved care process improvements (13 articles), and most were internally developed (13 articles). The internally developed innovations reported fewer barriers to acceptability among staff/providers, higher leadership involvement and organizational alignment, greater amounts of customization to the local setting, and better sustainment. Future work should harness the high levels of alignment and acceptability in implementation research within safety net settings, with an eye toward maintaining fidelity to facilitate dissemination across sites.

Effectiveness of a multi-level implementation strategy for ASD interventions: study protocol for two linked cluster randomized trials

BACKGROUND

The Centers for Disease Control (2018) estimates that 1 in 59 children has autism spectrum disorder, and the annual cost of ASD in the U.S. is estimated to be $236 billion. Evidence-based interventions have been developed and demonstrate effectiveness in improving child outcomes. However, research on generalizable methods to scale up these practices in the multiple service systems caring for these children has been limited and is critical to meet this growing public health need. This project includes two, coordinated studies testing the effectiveness of the Translating Evidence-based Interventions (EBI) for ASD: Multi-Level Implementation Strategy (TEAMS) model. TEAMS focuses on improving implementation leadership, organizational climate, and provider attitudes and motivation in order to improve two key implementation outcomes-provider training completion and intervention fidelity and subsequent child outcomes. The TEAMS Leadership Institute applies implementation leadership strategies and TEAMS Individualized Provider Strategies for training applies motivational interviewing strategies to facilitate provider and organizational behavior change.

METHODS

A cluster randomized implementation/effectiveness Hybrid, type 3, trial with a dismantling design will be used to understand the effectiveness of TEAMS and the mechanisms of change across settings and participants. Study #1 will test the TEAMS model with AIM HI (An Individualized Mental Health Intervention for ASD) in publicly funded mental health services. Study #2 will test TEAMS with CPRT (Classroom Pivotal Response Teaching) in education settings. Thirty-seven mental health programs and 37 school districts will be randomized, stratified by county and study, to one of four groups (Standard Provider Training Only, Standard Provider Training + Leader Training, Enhanced Provider Training, Enhanced Provider Training + Leader Training) to test the effectiveness of combining standard, EBI-specific training with the two TEAMS modules individually and together on multiple implementation outcomes. Implementation outcomes including provider training completion, fidelity (coded by observers blind to group assignment) and child behavior change will be examined for 295 mental health providers, 295 teachers, and 590 children.

DISCUSSION

This implementation intervention has the potential to increase quality of care for ASD in publicly funded settings by improving effectiveness of intervention implementation. The process and modules will be generalizable to multiple service systems, providers, and interventions, providing broad impact in community services.

TRIAL REGISTRATION

This study is registered with Clinicaltrials.gov ( NCT03380078 ). Registered 20 December 2017, retrospectively registered.

Building Capacity for Evidence-Based Public Health: Reconciling the Pulls of Practice and the Push of Research

Timely implementation of principles of evidence-based public health (EBPH) is critical for bridging the gap between discovery of new knowledge and its application. Public health organizations need sufficient capacity (the availability of resources, structures, and workforce to plan, deliver, and evaluate the preventive dose of an evidence-based intervention) to move science to practice. We review principles of EBPH, the importance of capacity building to advance evidence-based approaches, promising approaches for capacity building, and future areas for research and practice. Although there is general agreement among practitioners and scientists on the importance of EBPH, there is less clarity on the definition of evidence, how to find it, and how, when, and where to use it. Capacity for EBPH is needed among both individuals and organizations. Capacity can be strengthened via training, use of tools, technical assistance, assessment and feedback, peer networking, and incentives. Modest investments in EBPH capacity building will foster more effective public health practice.

School health implementation tools: a mixed methods evaluation of factors influencing their use

Background

The U.S. Centers for Disease Control and Prevention (CDC) develops tools to support implementation of evidence-based interventions for school health. To advance understanding of factors influencing the use of these implementation tools, we conducted an evaluation of state, school district, and local school staffs’ use of four CDC tools to support implementation of physical activity, nutrition, health education, and parent engagement. Two frameworks guided the evaluation: Interactive Systems Framework (ISF) for Dissemination and Implementation and Consolidated Framework for Implementation Research (CFIR).

Methods

The evaluation applied a mixed methods, cross-sectional design that included online surveys (n = 69 state staff from 43 states), phone interviews (n = 13 state staff from 6 states), and in-person interviews (n = 90 district and school staff from 8 districts in 5 states). Descriptive analyses were applied to surveys and content analysis to interviews.

Results

The survey found that the majority of state staff surveyed was aware of three of the CDC tools but most were knowledgeable and confident in their ability to use only two. These same two tools were the ones for which states were most likely to have provided training and technical assistance in the past year. Interviews provided insight into how tools were used and why use varied, with themes organized within the ISF domain “support strategies” (e.g., training, technical assistance) and four CFIR domains: (1) characteristics of tools, (2) inner setting, (3) outer setting, and (4) individuals. Overall, tools were valued for the credibility of their source (CDC) and evidence strength and quality. Respondents reported that tools were too complex for use by school staff. However, if tools were adaptable and compatible with inner and outer setting factors, state and district staff were willing and able to adapt tools for school use.

Conclusions

Implementation tools are essential to supporting broad-scale implementation of evidence-based interventions. This study illustrates how CFIR and ISF might be applied to evaluate factors influencing tools’ use and provides recommendations for designing tools to fit within the multi-tiered systems involved in promoting, supporting, and implementing evidence-based interventions in schools. Findings have relevance for the design of implementation tools for use by other multi-tiered systems.

Building practitioner networks to support dissemination and implementation of evidence-based programs in community settings

Insufficient capacity to use evidence-based programs (EBPs) limits the impact of community-based organizations (CBOs) to improve population health and address health disparities. PLANET MassCONECT was a community-based participatory research (CBPR) project conducted in three Massachusetts communities. Researchers and practitioners co-created an intervention to build capacity among CBO staff members to systematically find, adapt, and evaluate EBPs. The project supported development of trainee social networks and this cross-sectional study examines the association between network engagement and EBP usage, an important goal of the capacity-building program. Trainee cohorts were enrolled from June 2010 to April 2012 and we collected community-specific network data in late 2013. The relationship of interest was communication among network members regarding the systematic approach to program planning presented in the intervention. For Communities A, B, and C, 39/59, 36/61, and 50/59 trainees responded to our survey, respectively. We conducted the full network analysis in Community C. The average degree, or number of connections with other trainees, is a useful marker of engagement; respondents averaged 6.6 reported connections. Degree was associated with recent use of EBPs, in a linear regression, adjusting for important covariates. The results call for further attention to practitioner networks that support the use of research evidence in community settings. Consideration of key contextual factors, including resource levels, turnover rates, and community complexity will be vital for success.

A Sequential Implementation Model for Workforce Development: A Case Study of Medical Residency Training for Substance Use Concerns

PROBLEM

In graduate medical education, residency programs are often educationally isolated from each other, with varying needs and patient populations, so strategies are needed when attempting to implement training in evidence-based practices across multiple residencies.

INTERVENTION

Using implementation science as a guide, we adapted a community development model to sequentially implement an evidence-based intervention, Screening, Brief Intervention, and Referral to Treatment (SBIRT) for alcohol and drug use problems, across internal medicine, pediatrics, emergency medicine, psychiatry, and obstetrics and gynecology residency programs.

CONTEXT

A grant-funded "executive" team coordinated the implementation, enrolled a new residency program annually, and served as the consultative team to span the programs. The team was attentive to aligning implementation with the needs of each program. To assist in planning, the team included a program champion 1 year prior to SBIRT implementation to provide the opportunity to develop resources and work with peers. We evaluated this model through an implementation science lens using a case study approach that included interviews and quantitative tabulation of products and resident perceptions.

OUTCOME

We successfully instituted SBIRT training in all 5 residency programs through the use of a supported local champion model. Teams developed 90 curricular products and had 57 presentations and publications. Residents reported satisfaction with the SBIRT activities. Champions reported that SBIRT was a useful approach and that they gained valuable knowledge and relationships from working with the executive team when designing learning materials appropriate for their residency. Champions successfully incorporated SBIRT into routine clinical practice.

LESSONS LEARNED

Having a strong team to support subsequent SBIRT champions was essential for implementation. The champions needed financial support to have the necessary time to implement training. The strategy of building a peer network across programs was critical for sustaining the implementation. Collecting and sharing resources aided the champions in developing their materials.

Scaling Up and Tailoring the "Putting Public Health in Action" Training Curriculum

Despite access to a growing menu of evidence-based interventions, public health practitioners continue to underuse them, in part because practitioners may require new knowledge, skills, and resources to do so. Numerous foundations, universities, governmental agencies, and consultants are providing trainings to address the gaps in practitioners' capacity. To most significantly affect population health, these trainings need to reach practitioners who may have limited access to on-site trainings. Despite the number of organizations offering trainings, little is known about how to scale up trainings to efficiently extend their reach or how to tailor trainings to the needs of different intervention. The Cancer Prevention and Control Research Network and its collaborating centers have developed a training curriculum and delivered it in both in-person and distance formats to a range of audiences. The purpose of this article is to describe the training curriculum and findings from the Network's evaluation of approaches used to scale up delivery of the "Putting Public Health Evidence in Action" curriculum and tailor content for specific evidence-based interventions.

Theories, models and frameworks used in capacity building interventions relevant to public health: a systematic review

Background

There is limited research on capacity building interventions that include theoretical foundations. The purpose of this systematic review is to identify underlying theories, models and frameworks used to support capacity building interventions relevant to public health practice. The aim is to inform and improve capacity building practices and services offered by public health organizations.

Methods

Four search strategies were used: 1) electronic database searching; 2) reference lists of included papers; 3) key informant consultation; and 4) grey literature searching. Inclusion and exclusion criteria are outlined with included papers focusing on capacity building, learning plans, professional development plans in combination with tools, resources, processes, procedures, steps, model, framework, guideline, described in a public health or healthcare setting, or non-government, government, or community organizations as they relate to healthcare, and explicitly or implicitly mention a theory, model and/or framework that grounds the type of capacity building approach developed. Quality assessment were performed on all included articles. Data analysis included a process for synthesizing, analyzing and presenting descriptive summaries, categorizing theoretical foundations according to which theory, model and/or framework was used and whether or not the theory, model or framework was implied or explicitly identified.

Results

Nineteen articles were included in this review. A total of 28 theories, models and frameworks were identified. Of this number, two theories (Diffusion of Innovations and Transformational Learning), two models (Ecological and Interactive Systems Framework for Dissemination and Implementation) and one framework (Bloom’s Taxonomy of Learning) were identified as the most frequently cited.

Conclusions

This review identifies specific theories, models and frameworks to support capacity building interventions relevant to public health organizations. It provides public health practitioners with a menu of potentially usable theories, models and frameworks to support capacity building efforts. The findings also support the need for the use of theories, models or frameworks to be intentional, explicitly identified, referenced and for it to be clearly outlined how they were applied to the capacity building intervention.

Electronic supplementary material

The online version of this article (10.1186/s12889-017-4919-y) contains supplementary material, which is available to authorized users.

Beyond "implementation strategies": classifying the full range of strategies used in implementation science and practice

Background

Strategies are central to the National Institutes of Health’s definition of implementation research as “the study of strategies to integrate evidence-based interventions into specific settings.” Multiple scholars have proposed lists of the strategies used in implementation research and practice, which they increasingly are classifying under the single term “implementation strategies.” We contend that classifying all strategies under a single term leads to confusion, impedes synthesis across studies, and limits advancement of the full range of strategies of importance to implementation. To address this concern, we offer a system for classifying implementation strategies that builds on Proctor and colleagues’ (2013) reporting guidelines, which recommend that authors not only name and define their implementation strategies but also specify who enacted the strategy (i.e., the actor) and the level and determinants that were targeted (i.e., the action targets).

Main body

We build on Wandersman and colleagues’ Interactive Systems Framework to distinguish strategies based on whether they are enacted by actors functioning as part of a Delivery, Support, or Synthesis and Translation System. We build on Damschroder and colleague’s Consolidated Framework for Implementation Research to distinguish the levels that strategies target (intervention, inner setting, outer setting, individual, and process). We then draw on numerous resources to identify determinants, which are conceptualized as modifiable factors that prevent or enable the adoption and implementation of evidence-based interventions. Identifying actors and targets resulted in five conceptually distinct classes of implementation strategies: dissemination, implementation process, integration, capacity-building, and scale-up. In our descriptions of each class, we identify the level of the Interactive System Framework at which the strategy is enacted (actors), level and determinants targeted (action targets), and outcomes used to assess strategy effectiveness. We illustrate how each class would apply to efforts to improve colorectal cancer screening rates in Federally Qualified Health Centers.

Conclusions

Structuring strategies into classes will aid reporting of implementation research findings, alignment of strategies with relevant theories, synthesis of findings across studies, and identification of potential gaps in current strategy listings. Organizing strategies into classes also will assist users in locating the strategies that best match their needs.

Active involved community partnerships: co-creating implementation infrastructure for getting to and sustaining social impact

Active involved community partnerships (AICPs) are essential to co-create implementation infrastructure and translate evidence into real-world practice. Across varied forms, AICPs cultivate community and tribal members as agents of change, blending research and organizational knowledge with relationships, context, culture, and local wisdom. Unlike selective engagement, AICPs enable active involvement of partners in the ongoing process of implementation and sustainability. This includes defining the problem, developing solutions, detecting practice changes, aligning organizational supports, and nurturing shared responsibility, accountability, and ownership for implementation. This paper builds on previously established active implementation and scaling functions by outlining key AICP functions to close the research-practice gap. Part of a federal initiative, California Partners for Permanency (CAPP) integrated AICP functions for implementation and system change to reduce disproportionality and disparities in long-term foster care. This paper outlines their experience defining and embedding five AICP functions: (1) relationship-building; (2) addressing system barriers; (3) establishing culturally relevant supports and services; (4) meaningful involvement in implementation; and (5) ongoing communication and feedback for continuous improvement. Planning for social impact requires the integration of AICP with other active implementation and scaling functions. Through concrete examples, authors bring multilevel AICP roles to life and discuss implications for implementation research and practice.

Implementation strategies to promote community-engaged efforts to counter tobacco marketing at the point of sale

The US tobacco industry spends $8.2 billion annually on marketing at the point of sale (POS), a practice known to increase tobacco use. Evidence-based policy interventions (EBPIs) are available to reduce exposure to POS marketing, and nationwide, states are funding community-based tobacco control partnerships to promote local enactment of these EBPIs. Little is known, however, about what implementation strategies best support community partnerships' success enacting EBPI. Guided by Kingdon's theory of policy change, Counter Tools provides tools, training, and other implementation strategies to support community partnerships' performance of five core policy change processes: document local problem, formulate policy solutions, engage partners, raise awareness of problems and solutions, and persuade decision makers to enact new policy. We assessed Counter Tools' impact at 1 year on (1) partnership coordinators' self-efficacy, (2) partnerships' performance of core policy change processes, (3) community progress toward EBPI enactment, and (4) salient contextual factors. Counter Tools provided implementation strategies to 30 partnerships. Data on self-efficacy were collected using a pre-post survey. Structured interviews assessed performance of core policy change processes. Data also were collected on progress toward EBPI enactment and contextual factors. Analysis included descriptive and bivariate statistics and content analysis. Following 1-year exposure to implementation strategies, coordinators' self-efficacy increased significantly. Partnerships completed the greatest proportion of activities within the "engage partners" and "document local problem" core processes. Communities made only limited progress toward policy enactment. Findings can inform delivery of implementation strategies and tests of their effects on community-level efforts to enact EBPIs.

The Effectiveness and Cost of Lifestyle Interventions Including Nutrition Education for Diabetes Prevention: A Systematic Review and Meta-Analysis

BACKGROUND

Type 2 diabetes is a significant public health concern. With the completion of the Diabetes Prevention Program, there has been a proliferation of studies attempting to translate this evidence base into practice. However, the cost, effectiveness, and cost-effectiveness of these adapted interventions is unknown.

OBJECTIVE

The purpose of this systematic review was to conduct a comprehensive meta-analysis to synthesize the effectiveness, cost, and cost-effectiveness of lifestyle diabetes prevention interventions and compare effects by intervention delivery agent (dietitian vs non-dietitian) and channel (in-person vs technology-delivered).

METHODS

English and full-text research articles published up to July 2015 were identified using the Cochrane Library, PubMed, Education Resources Information Center, CAB Direct, Science Direct, and Google Scholar. Sixty-nine studies met inclusion criteria. Most employed both dietary and physical activity intervention components (four of 69 were diet-only interventions). Changes in weight, fasting and 2-hour blood glucose concentration, and hemoglobin A1c were extracted from each article. Heterogeneity was measured by the I2 index, and study-specific effect sizes or mean differences were pooled using a random effects model when heterogeneity was confirmed.

RESULTS

Participants receiving intervention with nutrition education experienced a reduction of 2.07 kg (95% CI 1.52 to 2.62; P<0.001; I2=90.99%, 95% CI 88.61% to 92.87%) in weight at 12 months with effect sizes over time ranging from small (0.17, 95% CI 0.04 to 0.30; P=0.012; I2= 86.83%, 95% CI 80.42% to 91.14%) to medium (0.65, 95% CI 0.49 to 0.82; P<0.001; I2=98.75%, 95% CI 98.52% to 98.94). Effect sizes for 2-hour blood glucose and hemoglobin A1c level changes ranged from small to medium. The meta-regression analysis revealed a larger relative weight loss in dietitian-delivered interventions than in those delivered by nondietitians (full sample: -1.0 kg; US subsample: -2.4 kg), and did not find statistical evidence that the delivery channel was an important predictor of weight loss. The average cost per kilogram weight loss ranged from $34.06 over 6 months to $1,005.36 over 12 months. The cost of intervention per participant delivered by dietitians was lower than interventions delivered by non-dietitians, although few studies reported costs.

CONCLUSIONS

Lifestyle interventions are effective in reducing body weight and glucose-related outcomes. Dietitian-delivered interventions, compared with those delivered by other personnel, achieved greater weight reduction. No consistent trend was identified across different delivery channels.

Impact of the Cancer Prevention and Control Research Network: Accelerating the Translation of Research Into Practice

The Cancer Prevention and Control Research Network (CPCRN) is a thematic network dedicated to accelerating the adoption of evidence-based cancer prevention and control practices in communities by advancing dissemination and implementation science. Funded by the Centers for Disease Control and Prevention and National Cancer Institute, CPCRN has operated at two levels: Each participating network center conducts research projects with primarily local partners as well as multicenter collaborative research projects with state and national partners. Through multicenter collaboration, thematic networks leverage the expertise, resources, and partnerships of participating centers to conduct research projects collectively that might not be feasible individually. Although multicenter collaboration is often advocated, it is challenging to promote and assess. Using bibliometric network analysis and other graphical methods, this paper describes CPCRN's multicenter publication progression from 2004 to 2014. Searching PubMed, Scopus, and Web of Science in 2014 identified 249 peer-reviewed CPCRN publications involving two or more centers out of 6,534 total. The research and public health impact of these multicenter collaborative projects initiated by CPCRN during that 10-year period were then examined. CPCRN established numerous workgroups around topics such as: 2-1-1, training and technical assistance, colorectal cancer control, federally qualified health centers, cancer survivorship, and human papillomavirus. This paper discusses the challenges that arise in promoting multicenter collaboration and the strategies that CPCRN uses to address those challenges. The lessons learned should broadly interest those seeking to promote multisite collaboration to address public health problems, such as cancer prevention and control.