Is implementation research out of step with implementation practice? Pathways to effective implementation support over the last decade

Organizing the dissemination and implementation field: who are we, what are we doing, and how should we do it?

Two decades into its tenure as a field, dissemination and implementation (D&I) scientists have begun a process of self-reflection, illuminating a missed opportunity to bridge the gap between research and practice-one of the field's foundational objectives. In this paper, we, the authors, assert the research-to-practice gap has persisted, in part due to an inadequate characterization of roles, functions, and processes within D&I. We aim to address this issue, and the rising tension between D&I researchers and practitioners, by proposing a community-centered path forward that is grounded in equity.We identify key players within the field and characterize their unique roles using the translational science spectrum, a model originally developed in the biomedical sciences to help streamline the research-to-practice process, as a guide. We argue that the full translational science spectrum, from basic science research, or "T0," to translation to community, or "T4," readily applies within D&I and that in using this framework to clarify roles, functions, and processes within the field, we can facilitate greater collaboration and respect across the entire D&I research-to-practice continuum. We also highlight distinct opportunities (e.g., changes to D&I scientific conference structures) to increase regular communication and engagement between individuals whose work sits at different points along the D&I translational science spectrum that can accelerate our efforts to close the research-to-practice gap and achieve the field's foundational objectives.

External relationships as implementation determinants in community-engaged, equity-focused COVID-19 vaccination events

Background

While relationships and connectedness among organizations have been included in implementation theories, models, and frameworks, the increased attention to health equity in implementation science raises the urgency of understanding the role of relationships external to the implementing organization. This paper addresses this gap through an exploration of the role of external relationships in community-based, equity-focused interventions.

Methods

This study focuses on an equity-focused, community-based COVID-19 vaccination intervention in Arkansas, drawing upon long-term community-engaged relationships among University of Arkansas for Medical Sciences and the Hispanic and Marshallese Islander communities. We used an exploratory qualitative descriptive design to examine barriers and facilitators to implementation of COVID-19 vaccination events analyzing in-depth qualitative interviews with implementation team members (n = 17).

Results

All participants described pre-existing relationships among the implementing organization, partner organizations, and communities as a key implementation determinant for this equity-focused program. At the inter-organizational level, external relationships included formal connections and informal relationships among staff (e.g., communication channels from prior partnerships). At the individual level, strong external relationships with the community were facilitators leveraging long-term engagement, community familiarity, and staff from the communities of focus. Strong external relationships facilitated program reach in underserved communities through three mechanisms: (1) reduced time required to establish functional working relationships among partners; (2) accessibility and cultural congruence of health services; and (3) increased trust among community members. Barriers to implementation also existed in external relationships, but had less influence than facilitators.

Conclusions

Achieving health equity in implementation science requires greater understanding of external relationships as implementation determinants. This exploratory study makes a significant contribution to the literature by describing the types of external relationships that facilitate equitable implementation and identifying the mechanisms through which they may work. We argue that approaches to community engagement drawn from community-engaged research approaches may be useful, as these processes require investment in building/maintaining formal and informal organizational and interpersonal relationships. Further research is needed to understand connections among external relationships and other implementation determinants.

'It depends': what 86 systematic reviews tell us about what strategies to use to support the use of research in clinical practice

BACKGROUND

The gap between research findings and clinical practice is well documented and a range of strategies have been developed to support the implementation of research into clinical practice. The objective of this study was to update and extend two previous reviews of systematic reviews of strategies designed to implement research evidence into clinical practice.

METHODS

We developed a comprehensive systematic literature search strategy based on the terms used in the previous reviews to identify studies that looked explicitly at interventions designed to turn research evidence into practice. The search was performed in June 2022 in four electronic databases: Medline, Embase, Cochrane and Epistemonikos. We searched from January 2010 up to June 2022 and applied no language restrictions. Two independent reviewers appraised the quality of included studies using a quality assessment checklist. To reduce the risk of bias, papers were excluded following discussion between all members of the team. Data were synthesised using descriptive and narrative techniques to identify themes and patterns linked to intervention strategies, targeted behaviours, study settings and study outcomes.

RESULTS

We identified 32 reviews conducted between 2010 and 2022. The reviews are mainly of multi-faceted interventions (n = 20) although there are reviews focusing on single strategies (ICT, educational, reminders, local opinion leaders, audit and feedback, social media and toolkits). The majority of reviews report strategies achieving small impacts (normally on processes of care). There is much less evidence that these strategies have shifted patient outcomes. Furthermore, a lot of nuance lies behind these headline findings, and this is increasingly commented upon in the reviews themselves.

DISCUSSION

Combined with the two previous reviews, 86 systematic reviews of strategies to increase the implementation of research into clinical practice have been identified. We need to shift the emphasis away from isolating individual and multi-faceted interventions to better understanding and building more situated, relational and organisational capability to support the use of research in clinical practice. This will involve drawing on a wider range of research perspectives (including social science) in primary studies and diversifying the types of synthesis undertaken to include approaches such as realist synthesis which facilitate exploration of the context in which strategies are employed.

Partnership-building considerations for implementation science in learning health systems: a case study of the Implementation Science Collaborative in Alberta, Canada

Introduction

Implementation of health innovations is inherently collaborative, requiring trans-sectoral partnerships between implementation researchers, innovation teams, and implementation practitioners. Implementation science has been shown to improve implementation successes; however, challenges that hinder partnerships to advance implementation science continue to persist. Using a whole-system approach to assess and respond to implementation science partnership barriers may shed light on effective responses.

Methods

We conducted a case study of Alberta's learning health system, using semi-structured group and individual interviews to create a nuanced understanding of the considerations required for implementation research collaborations. We interviewed 53 participants representing 21 offices in the health system, academia, professional associations, and government who regularly plan, evaluate, and/or study health system implementation initiatives in Alberta. Using the Partnership Model for Research Capacity Building, we identified current facilitators and challenges for partnerships for conducting and using implementation science, at different levels of Alberta's health-research ecosystem.

Results

Alberta's healthcare system is well set up to readily embed intervention effectiveness and efficacy research. Infrastructure was also in place to strengthen implementation practice. However, weaknesses around exchanging knowledge and skills, providing feedback and mentoring, and accommodating diversity affected the ability of both individuals and teams to build implementation science capacity. Without this capacity, teams could not participate in embedded implementation research collaborations. We report the response of the Alberta Strategy for Patient-Oriented Research SUPPORT Unit to these barriers to provide practical guidance on various program options to strengthen individual- and organization-level implementation science capacity.

Discussion

This study applied a whole-system approach to assess factors across Alberta's health-research ecosystem, which affect partnerships to advance implementation science. Our findings illustrated that partnership considerations go beyond interpersonal factors and include system-wide considerations. With the results, health organization leaders have (1) a method for assessing organizational capability to readily embed implementation research and (2) a catalog of potential responses to create conditions to readily engage with implementation science in their day-to-day implementation processes.

Integrating Implementation Science with Quality Improvement to Improve Perinatal Outcomes

Implementation science is an interdisciplinary field that seeks to contribute generalizable knowledge that can improve the translation of clinical evidence in routine care. To promote the integration of implementation science approaches with health care quality improvement, the authors offer a framework that links the Model for Improvement with implementation strategies and methods. Perinatal quality improvement teams can leverage the robust frameworks of implementation science to diagnose implementation barriers, select implementation strategies, and assess the strategies' contribution to improving care. Partnerships between implementation scientists and quality improvement teams could accelerate efforts by both groups to achieve measurable improvements in care.

Developing a practice-driven research agenda in implementation science: Perspectives from experienced implementation support practitioners

Background

Attention is being placed on the "ironic gap" or "secondary" research-to-practice gap in the field of implementation science. Among several challenges posited to exacerbate this research-to-practice gap, we call attention to one challenge in particular-the relative dearth of implementation research that is tethered intimately to the lived experiences of implementation support practitioners (ISPs). The purpose of this study is to feature a qualitative approach to engaging with highly experienced ISPs to inform the development of a practice-driven research agenda in implementation science. In general, we aim to encourage ongoing empirical inquiry that foregrounds practice-driven implementation research questions.

Method

Our analytic sample was comprised of 17 professionals in different child and family service systems, each with long-term experience using implementation science frameworks to support change efforts. Data were collected via in-depth, semi-structured interviews. Our analysis followed a qualitative content analysis approach. Our focal conceptual category centered on the desired areas of future research highlighted by respondents, with subcategories reflecting subsets of related research question ideas.

Results

Interviews yielded varying responses that could help shape a practice-driven research agenda for the field of implementation science. The following subcategories regarding desired areas for future research were identified in respondents' answers: (a) stakeholder engagement and developing trusting relationships, (b) evidence use, (c) workforce development, and (d) cost-effective implementation.

Conclusions

There is significant promise in bringing implementation research and implementation practice together more closely and building a practice-informed research agenda to shape implementation science. Our findings point not only to valuable practice-informed gaps in the literature that could be filled by implementation researchers, but also topics for which dissemination and translation efforts may not have yielded optimal reach. We also highlight the value in ISPs bolstering their own capacity for engaging with the implementation science literature to the fullest extent possible.

Implementation readiness for evidence-based autism practices in school systems

Background

The increase in the number of autistic children being identified has led to increased demand on public schools to provide high-quality services. Effectively scaling up evidence-based practice (EBP) use for autistic students is challenging, given the complicated organization of special education. Teachers have significant challenges implementing autism EBP with fidelity. Factors such as implementation leadership and climate and attitudes toward EBP are linked to successful EBP use and may vary at different levels of the education system. Examining mechanisms of successful implementation is a critical step to support scale-up.

Method

In this observational study, conducted from September 2018 to March 2020, California school personnel (n = 2273) at multiple levels of the system completed surveys related to implementation climate, leadership, and attitudes toward EBP. Data were collected throughout California at the Special Education Local Plan Areas, County Office of Education, and district and school levels from educators and administrators working in public schools supporting autistic students. Multi-level modeling was conducted to characterize implementation readiness.

Results

Overall, implementation climate and leadership scores are low across levels with regional levels rated more positively than districts or schools. Attitudes toward EBP were moderate, with those working in schools having the poorest ratings and specialists/trainers and related service providers (e.g., speech-language pathologists) having the highest ratings.

Conclusions

Outcomes provide a unique opportunity to compare implementation factors across organizational levels with a large, statewide sample. These data provide guidance for developing implementation interventions at multiple levels of the education system to increase readiness for effective scale-up of autism EBP in schools. Personnel and leaders at different organizational levels may need differentiated training targeting improved implementation climate and leadership. Personnel within districts and schools may experience a particular benefit from leadership support for EBP implementation.

Implementation Outcomes of National Convergence Action Policy to Accelerate Stunting Prevention and Reduction at the Local Level in Indonesia: A Qualitative Study

The study aims to explore the implementation outcome variables of Indonesia's national policy convergence action in the stunting reduction intervention at district, sub-district, and village levels. The study design was qualitative with an implementation research approach at District Cirebon, Indonesia. Data were collected through in-depth interviews, focus group discussions, study documents, and 6 months of participant observation. We recruited 172 respondents. The assessment instrument used was formed on was implementation outcomes variables. Data were analyzed through coding, categorizing and thematic content analysis based on a predetermined theme. Comparative cross district activity-site analysis was applied between sub-districts and villages. The implementation outcome variables for the convergence action policy were performed well at the district level, in line with the central government's adequate regulation, control, and budget. Meanwhile, the sub-district and village levels only performed aspects of acceptability, appropriateness, and coverage for specific interventions. The acceptability level in the village was only partially running. The barriers at the sub-district and village levels were issues of commitment, staff capacity, and poor coordination. Superficial understanding and capacity weaknesses drove the convergence of the stunting reduction responsibility back into the burden of the health sector at the forefront. Local politics also colored the implementation in the village.

Building trusting relationships to support implementation: A proposed theoretical model

This paper presents a theory of change that articulates (a) proposed strategies for building trust among implementation stakeholders and (b) the theoretical linkages between trusting relationships and implementation outcomes. The theory of change describes how trusting relationships cultivate increases in motivation, capability, and opportunity for supporting implementation among implementation stakeholders, with implications for commitment and resilience for sustained implementation, and ultimately, positive implementation outcomes. Recommendations related to the measurement of key constructs in the theory of change are provided. The paper highlights how the development of a testable causal model on trusting relationships and implementation outcomes can provide a bridge between implementation research and implementation practice.

Intervening for sustainable change: Tailoring strategies to align with values and principles of communities

This paper presents a rationale for tailoring implementation strategies within a values-driven implementation approach. Values-driven implementation seeks to organize implementers around clarifying statements of their shared values in ways that harmonize implementation dynamics related to individual and group mental models, relationships among implementers, and the implementation climate. The proposed approach to tailoring strategies is informed by systems theory and emphasizes the need to focus on both tangible events and behaviors, as well deeper patterns, structures, relationships, and mental models, in order to increase the likelihood of sustaining implementation efforts and improving outcomes for people and communities. We offer for consideration three specific sets of context determinants that are under-represented in the implementation literature and that emerge as especially relevant within a systems approach to identifying and successfully tailoring implementation strategies in the implementation setting including relationships, mental models, and implementation climate.