A systematic review of empirical studies examining mechanisms of implementation in health

Health-care organization characteristics in cancer care delivery: an integrated conceptual framework with content validation

Context can influence cancer-related outcomes. For example, health-care organization characteristics, including ownership, leadership, and culture, can affect care access, communication, and patient outcomes. Health-care organization characteristics and other contextual factors can also influence whether and how clinical discoveries reduce cancer incidence, morbidity, and mortality. Importantly, policy, market, and technology changes are transforming health-care organization design, culture, and operations across the cancer continuum. Consequently, research is essential to examine when, for whom, and how organizational characteristics influence person-level, organization-level, and population-level cancer outcomes. Understanding organizational characteristics-the structures, processes, and other features of entities involved in health care delivery-and their dynamics is an important yet understudied area of care delivery research across the cancer continuum. Research incorporating organizational characteristics is critical to address health inequities, test care delivery models, adapt interventions, and strengthen implementation. The field lacks conceptual grounding, however, to help researchers identify germane organizational characteristics. We propose a framework identifying organizational characteristics relevant for cancer care delivery research based on conceptual work in health services, organizational behavior, and management science and refined using a systematic review and key informant input. The proposed framework is a tool for organizing existing research and enhancing future cancer care delivery research. Following a 2012 Journal of the National Cancer Institute monograph, this work complements National Cancer Institute efforts to stimulate research addressing the relationship between cancer outcomes and contextual factors at the patient, provider, team, delivery organization, community, and health policy levels.

Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers

Hundreds of millions of dollars are spent each year by U.S. federal agencies for training and technical assistance (TTA) to be delivered by training and technical assistance centers (TTACs) to "delivery system organizations" (e.g., federally qualified health centers, state departments of health, substance abuse treatment centers, schools, and healthcare organizations). TTACs are often requested to help delivery system organizations implement evidence-based interventions. Yet, counterintuitively, TTACs are rarely required to use evidence-based approaches when supporting delivery systems (in the use of evidence-based programs). In fact, evaluations of TTAC activities tend to be minimal; evaluation of technical assistance (if conducted at all) often emphasizes outputs (number of encounters), satisfaction, and self-reports of knowledge gained-more substantive outcomes are not evaluated. The gap between (a) the volume of TTA services being funded and provided and (b) the evaluation of those services is immense and has the potential to be costly. The basic question to be answered is: how effective are TTA services? This article introduces the special issue on Strengthening the Science and Practice of Implementation Support: Evaluating the Effectiveness of Training and Technical Assistance Centers. The special issue promotes 1) knowledge of the state of the art of evaluation of TTACs and 2) advances in what to evaluate in TTA. A major goal of the issue is to improve the science and practice of implementation support, particularly in the areas of TTA.

Sustainability of an outcome measure in outpatient stroke rehabilitation: A realist evaluation

RATIONALE

Only half of newly implemented evidence-based practices are sustained. Though poor sustainment can lead to negative consequences for clinical teams, organizations and patients, the causal explanations of sustainment are largely unknown.

AIMS AND OBJECTIVES

We aimed to ascertain how (mechanisms) and in what circumstances (context) a newly implemented outcome measure in rehabilitation was sustained or not (outcome).

METHODOLOGY

Informed by an integrated knowledge translation approach, we conducted a realist evaluation using a mixed method, embedded single case study design with data collection up to 18 months following the implementation of the Mayo-Portland Adaptability Inventory - version 4 (MPAI-4), a rehabilitation outcome measure. Quantitative data (survey and patient charts) was analysed using descriptive statistics, then integrated with qualitative data (interviews with 10 key informants) and analysed using inductive and deductive retroduction. We integrated the data to develop a case description and ultimately, to refine the programme theory to better understand the sustainability of the MPAI-4.

RESULTS

We linked context, mechanisms and outcomes, and also emphasized sustainability strategies in 18 explanations of how sustainability works. These explanations provide evidence for four overarching patterns: (1) implementation and sustainability phases are interconnected, (2) outcomes build on each other recursively, with patient benefits as the keystone outcome, (3) sustainment is achieved to varying levels across different sustainability outcomes [e.g., high level (e.g., rate of MPAI-4 scoring: 77.7%) to low level (e.g., rate of MPAI-4 application to clinical decision-making: 3.7%)] and (4) the work of sustaining the MPAI-4 is shared amongst different stakeholders.

CONCLUSION

Implementation teams can draw from this programme theory to improve the sustainment of outcomes measures while researchers could continue to refine the theory. Continued investigation of sustainability, including diverse and continuous sustainability outcomes, is needed to understand how to maintain improvements in quality of care and patient outcomes.

How do oilcloth sessions work? A realist evaluation approach to exploring ripple effects in an implementation strategy

PURPOSE

To explore the mechanisms of the implementation strategy, "oilcloth sessions" and understand and explain the ripple effects of oilcloth sessions as a strategy to implement a new emergency department.

DESIGN/METHODOLOGY/APPROACH

A qualitative design was used whereby data were collected using field notes from an ethnographic study of the oilcloth sessions and follow-up semi-structured interviews with staff, managers and key employees who participated in the oilcloth sessions. The data analysis was inspired by the realist evaluation approach of generative causality proposed by Pawson and Tilley.

FINDINGS

The primary ripple effect was that the oilcloth sessions were used for different purposes than the proposed program theory, including being used as: (1) a stage, (2) a battlefield, (3) a space for imagination and (4) a strategic management tool influencing the implementation outcomes. The results bring essential knowledge that may help to explain why and how a well-defined implementation strategy has unplanned outcomes.

ORIGINALITY/VALUE

Unintended outcomes of implementation strategies are an underexplored issue. This study may help implementation researchers rethink the activities required to reduce unintended negative outcomes or explore potential unplanned outcomes and, in this way, hinder or enhance outcomes, effectiveness and sustainability. Future studies within implementation research should incorporate attention to unintended outcomes to fully understand the impact of implementation strategies.

Allied Health Clinicians' Uptake of Evidence in Stroke Rehabilitation: A Systematic Review of Determinants Targeted in Implementation Studies

OBJECTIVE

This study aimed to determine whether targeting specific implementation determinants is associated with allied health clinicians' uptake of evidence when implemented within stroke rehabilitation settings.

DATA SOURCES

7 key databases were searched to identify articles published between 1990 and 2022 for inclusion. Reference lists of relevant articles were hand searched.

STUDY SELECTION

Studies were independently screened by 2 authors and included if the implementation intervention targeted allied health clinical practice in any stroke rehabilitation context and reported at least 1 quantitative measure of evidence uptake. Thirty studies met inclusion criteria.

DATA EXTRACTION

Data were independently extracted by the first and second author. Implementation outcomes for each study were categorized as either mostly successful, partially successful, or not successful based on the degree of evidence uptake achieved. Determinants targeted were categorized using the Consolidated Framework for Implementation Research (CFIR).

DATA SYNTHESIS

Patterns between the degree of evidence uptake and determinants targeted across studies were analyzed by the first and second authors in 1 of 3 groups: A (pre-post statistical analysis), B (pre-post descriptive analysis), or C (post-only descriptive analysis). Patterns between evidence uptake and determinants targeted were first identified within groups A and B, with group C consulted to support findings. All studies categorized as "mostly successful" targeted facilitation in combination with establishing face-to-face networks and communication strategies. Conversely, no studies rated "not successful" targeted either of these determinants. Studies rated "partially successful" targeted either 1, but seldom both, of these determinants.

CONCLUSIONS

This review has provided descriptive evidence of determinants which may be important to target for allied health clinicians' uptake of evidence within stroke rehabilitation settings.

Bridges and Mechanisms: Integrating Systems Science Thinking into Implementation Research

We present a detailed argument for how to integrate, or bridge, systems science thinking and methods with implementation science. We start by showing how fundamental systems science principles of structure, dynamics, information, and utility are relevant for implementation science. Then we examine the need for implementation science to develop and apply richer theories of complex systems. This can be accomplished by emphasizing a causal mechanisms approach. Identifying causal mechanisms focuses on the "cogs and gears" of public health, clinical, and organizational interventions. A mechanisms approach focuses on how a specific strategy will produce the implementation outcome. We show how connecting systems science to implementation science opens new opportunities for examining and addressing social determinants of health and conducting equitable and ethical implementation research. Finally, we present case studies illustrating successful applications of systems science within implementation science in community health policy, tobacco control, health care access, and breast cancer screening.

Implementation Science and Practice-Oriented Research: Convergence and Complementarity

Implementation science is the scientific study of methods to promote the uptake of research findings and other evidence-based practices in routine care, with the goal of improving the quality and effectiveness of health services (Bauer et al., 2015). In addition to this common goal, practice-oriented psychotherapy research (and researchers) and implementation science (and scientists) share a common focus on the people and the places where treatment happens. Thus, there exists strong potential for combining these two approaches. In this article, we provide a primer on implementation science for psychotherapy researchers and highlight important areas and examples of convergence and complementarity between implementation science and practice-oriented psychotherapy research. Specifically, we (a) define and describe the core features of implementation science; (b) discuss similarities and areas of complementarity between implementation science and practice-oriented psychotherapy research; (c) discuss a case example that exemplifies the integration of implementation science and practice-oriented research; and (d) propose directions for future research and collaborations that leverage both implementation science and practice-oriented research.

Implementation of Health IT for Cancer Screening in US Primary Care: Scoping Review

BACKGROUND

A substantial percentage of the US population is not up to date on guideline-recommended cancer screenings. Identifying interventions that effectively improve screening rates would enhance the delivery of such screening. Interventions involving health IT (HIT) show promise, but much remains unknown about how HIT is optimized to support cancer screening in primary care.

OBJECTIVE

This scoping review aims to identify (1) HIT-based interventions that effectively support guideline concordance in breast, cervical, and colorectal cancer screening provision and follow-up in the primary care setting and (2) barriers or facilitators to the implementation of effective HIT in this setting.

METHODS

Following scoping review guidelines, we searched MEDLINE, CINAHL Plus, Web of Science, and IEEE Xplore databases for US-based studies from 2015 to 2021 that featured HIT targeting breast, colorectal, and cervical cancer screening in primary care. Studies were dual screened using a review criteria checklist. Data extraction was guided by the following implementation science frameworks: the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework; the Expert Recommendations for Implementing Change taxonomy; and implementation strategy reporting domains. It was also guided by the Integrated Technology Implementation Model that incorporates theories of both implementation science and technology adoption. Reporting was guided by PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews).

RESULTS

A total of 101 studies met the inclusion criteria. Most studies (85/101, 84.2%) involved electronic health record-based HIT interventions. The most common HIT function was clinical decision support, primarily used for panel management or at the point of care. Most studies related to HIT targeting colorectal cancer screening (83/101, 82.2%), followed by studies related to breast cancer screening (28/101, 27.7%), and cervical cancer screening (19/101, 18.8%). Improvements in cancer screening were associated with HIT-based interventions in most studies (36/54, 67% of colorectal cancer-relevant studies; 9/14, 64% of breast cancer-relevant studies; and 7/10, 70% of cervical cancer-relevant studies). Most studies (79/101, 78.2%) reported on the reach of certain interventions, while 17.8% (18/101) of the included studies reported on the adoption or maintenance. Reported barriers and facilitators to HIT adoption primarily related to inner context factors of primary care settings (eg, staffing and organizational policies that support or hinder HIT adoption). Implementation strategies for HIT adoption were reported in 23.8% (24/101) of the included studies.

CONCLUSIONS

There are substantial evidence gaps regarding the effectiveness of HIT-based interventions, especially those targeting guideline-concordant breast and colorectal cancer screening in primary care. Even less is known about how to enhance the adoption of technologies that have been proven effective in supporting breast, colorectal, or cervical cancer screening. Research is needed to ensure that the potential benefits of effective HIT-based interventions equitably reach diverse primary care populations.

Family cascade screening for equitable identification of familial hypercholesterolemia: study protocol for a hybrid effectiveness-implementation type III randomized controlled trial

BACKGROUND

Familial hypercholesterolemia (FH) is a heritable disorder affecting 1.3 million individuals in the USA. Eighty percent of people with FH are undiagnosed, particularly minoritized populations including Black or African American people, Asian or Asian American people, and women across racial groups. Family cascade screening is an evidence-based practice that can increase diagnosis and improve health outcomes but is rarely implemented in routine practice, representing an important care gap. In pilot work, we leveraged best practices from behavioral economics and implementation science-including mixed-methods contextual inquiry with clinicians, patients, and health system constituents-to co-design two patient-facing implementation strategies to address this care gap: (a) an automated health system-mediated strategy and (b) a nonprofit foundation-mediated strategy with contact from a foundation-employed care navigator. This trial will test the comparative effectiveness of these strategies on completion of cascade screening for relatives of individuals with FH, centering equitable reach.

METHODS

We will conduct a hybrid effectiveness-implementation type III randomized controlled trial testing the comparative effectiveness of two strategies for implementing cascade screening with 220 individuals with FH (i.e., probands) per arm identified from a large northeastern health system. The primary implementation outcome is reach, or the proportion of probands with at least one first-degree biological relative (parent, sibling, child) in the USA who is screened for FH through the study. Our secondary implementation outcomes include the number of relatives screened and the number of relatives meeting the American Heart Association criteria for FH. Our secondary clinical effectiveness outcome is post-trial proband cholesterol level. We will also use mixed methods to identify implementation strategy mechanisms for implementation strategy effectiveness while centering equity.

DISCUSSION

We will test two patient-facing implementation strategies harnessing insights from behavioral economics that were developed collaboratively with constituents. This trial will improve our understanding of how to implement evidence-based cascade screening for FH, which implementation strategies work, for whom, and why. Learnings from this trial can be used to equitably scale cascade screening programs for FH nationally and inform cascade screening implementation efforts for other genetic disorders.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT05750667. Registered 15 February 2023-retrospectively registered, https://clinicaltrials.gov/study/NCT05750667 .

Protocol for the process evaluation of an intervention to improve antenatal smoking cessation support (MOHMQuit) in maternity services in New South Wales, Australia

INTRODUCTION

Smoking cessation in pregnancy remains a public health priority. Our team used the Behaviour Change Wheel to develop the Midwives and Obstetricians Helping Mothers to Quit smoking (MOHMQuit) intervention with health system, leader (including managers and educators) and clinician components. MOHMQuit addresses a critical evidence to practice gap in the provision of smoking cessation support in antenatal care. It involves nine maternity services in New South Wales in a cluster randomised stepped-wedge controlled trial of effectiveness. This paper describes the design and rationale for the process evaluation of MOHMQuit. The process evaluation aims to assess to what extent and how MOHMQuit is being implemented (acceptability; adoption/uptake; appropriateness; feasibility; fidelity; penetration and sustainability), and the context in which it is implemented, in order to support further refinement of MOHMQuit throughout the trial, and aid understanding and interpretation of the results of the trial.

METHODS AND ANALYSIS

The process evaluation is an integral part of the stepped-wedge trial. Its design is underpinned by implementation science frameworks and adopts a mixed methods approach. Quantitative evidence from participating leaders and clinicians in our study will be used to produce individual and site-level descriptive statistics. Qualitative evidence of leaders' perceptions about the implementation will be collected using semistructured interviews and will be analysed descriptively within-site and thematically across the dataset. The process evaluation will also use publicly available data and observations from the research team implementing MOHMQuit, for example, training logs. These data will be synthesised to provide site-level as well as individual-level implementation outcomes.

ETHICS AND DISSEMINATION

The study received ethical approval from the Population Health Services Research Ethics Committee for NSW, Australia (Reference 2021/ETH00887). Results will be communicated via the study's steering committee and will also be published in peer-reviewed journals and presented at conferences.

TRIAL REGISTRATION NUMBER

Australian New Zealand Trials Registry ACTRN12622000167763. https://www.australianclinicaltrials.gov.au/anzctr/trial/ACTRN12622000167763.

Using Causative Methods to Determine System-Level Factors Driving the Uptake and Use of Evidence-Based Practices in a Public Early Intervention System

Part C Early Intervention (EI) systems are an entry point to services for autistic toddlers and can be leveraged to facilitate access to autism evidence-based practices (EBPs). However, EI systems are complex and limited research has examined how an EI system's infrastructure (i.e. system-level factors) impacts the adoption and implementation of EBPs. To address this gap, 36 EI providers and 9 EI administrators completed a semi-structured interview or focus group about factors impacting the implementation of autism EBPs. Qualitative analysis included a combination of grounded theory and causative coding. Analyses were refined by input from providers, administrators, and family stakeholders in the form of round tables and presentations at the state's interagency coordinating council. Primary themes centered on: (1) the costs associated with independent contracting structures; (2) operational demands; (3) workforce stability; (4) communication consistency; and (5) implementation supports for EBP implementation. Causative coding helped to demonstrate the perceived relationships between these factors and underscored the important role of incentivization structures, collaboration opportunities, and championing in supporting the use of EBPs within a system that primarily uses independent contracting structures. The current study extends previous research by demonstrating how several system-level factors are perceived to play a role in the adoption and implementation of EBPs by independently contracted EI providers. These findings underscore the need for implementation strategies, such as incentivization strategies and social network building, to increase providers' implementation of autism EBPs within EI systems.

Protocol for a hybrid type 3 effectiveness-implementation trial of a pragmatic individual-level implementation strategy for supporting school-based prevention programming

BACKGROUND

For approximately one in five children who have social, emotional, and behavioral (SEB) challenges, accessible evidence-based prevention practices (EBPPs) are critical. In the USA, schools are the primary setting for children's SEB service delivery. Still, EBPPs are rarely adopted and implemented by front-line educators (e.g., teachers) with sufficient fidelity to see effects. Given that individual behavior change is ultimately required for successful implementation, focusing on individual-level processes holds promise as a parsimonious approach to enhance impact. Beliefs and Attitudes for Successful Implementation in Schools for Teachers (BASIS-T) is a pragmatic, multifaceted pre-implementation strategy targeting volitional and motivational mechanisms of educators' behavior change to enhance implementation and student SEB outcomes. This study protocol describes a hybrid type 3 effectiveness-implementation trial designed to evaluate the main effects, mediators, and moderators of the BASIS-T implementation strategy as applied to Positive Greetings at the Door, a universal school-based EBPP previously demonstrated to reduce student disruptive behavior and increase academic engagement.

METHODS

This project uses a blocked randomized cohort design with an active comparison control (ACC) condition. We will recruit and include approximately 276 teachers from 46 schools randomly assigned to BASIS-T or ACC conditions. Aim 1 will evaluate the main effects of BASIS-T on proximal implementation mechanisms (attitudes, subjective norms, self-efficacy, intentions to implement, and maintenance self-efficacy), implementation outcomes (adoption, reach, fidelity, and sustainment), and child outcomes (SEB, attendance, discipline, achievement). Aim 2 will examine how, for whom, under what conditions, and how efficiently BASIS-T works, specifically by testing whether the effects of BASIS-T on child outcomes are (a) mediated via its putative mechanisms of behavior change, (b) moderated by teacher factors or school contextual factors, and (c) cost-effective.

DISCUSSION

This study will provide a rigorous test of BASIS-T-a pragmatic, theory-driven, and generalizable implementation strategy designed to target theoretically-derived motivational mechanisms-to increase the yield of standard EBPP training and support strategies.

TRIAL REGISTRATION

ClinicalTrials.gov ID: NCT05989568. Registered on May 30, 2023.

Instrumental variables for implementation science: exploring context-dependent causal pathways between implementation strategies and evidence-based interventions

BACKGROUND

The impact of both implementation strategies (IS) and evidence-based interventions (EBI) can vary across contexts, and a better understanding of how and why this occurs presents fundamental but challenging questions that implementation science as a field will need to grapple with. We use causal epidemiologic methods to explore the mechanisms of why sharp distinctions between implementation strategies (IS) and efficacy of an evidence-based intervention (EBI) may fail to recognize that the effect of an EBI can be deeply intertwined and dependent on the context of the IS leading to its uptake.

METHODS

We explore the use of instrumental variable (IV) analyses as a critical tool for implementation science methods to isolate three relevant quantities within the same intervention context when exposure to an implementation strategy is random: (1) the effect of an IS on implementation outcomes (e.g., uptake), (2) effect of EBI uptake on patient outcomes, and (3) overall effectiveness of the IS (i.e., ~ implementation*efficacy). We discuss the mechanisms by which an implementation strategy can alter the context, and therefore effect, of an EBI using the underlying IV assumptions. We illustrate these concepts using examples of the implementation of new ART initiation guidelines in Zambia and community-based masking programs in Bangladesh.

RESULTS

Causal questions relevant to implementation science are answered at each stage of an IV analysis. The first stage assesses the effect of the IS (e.g., new guidelines) on EBI uptake (e.g., same-day treatment initiation). The second stage leverages the IS as an IV to estimate the complier average causal effect (CACE) of the EBI on patient outcomes (e.g., effect of same-day treatment initiation on viral suppression). The underlying assumptions of CACE formalize that the causal effect of EBI may differ in the context of a different IS because (1) the mechanisms by which individuals uptake an intervention may differ and (2) the subgroup of individuals who take up an EBI may differ. IV methods thus provide a conceptual framework for how IS and EBIs are linked and that the IS itself needs to be considered a critical contextual determinant. Moreover, it also provides rigorous methodologic tools to isolate the effect of an IS, EBI, and combined effect of the IS and EBI.

DISCUSSION

Leveraging IV methods when exposure to an implementation strategy is random helps to conceptualize the context-dependent nature of implementation strategies, EBIs, and patient outcomes. IV methods formalize that the causal effect of an EBI may be specific to the context of the implementation strategy used to promote uptake. This integration of implementation science concepts and theory with rigorous causal epidemiologic methods yields novel insights and provides important tools for exploring the next generation of questions related to mechanisms and context in implementation science.

Audit and feedback to reduce unwarranted clinical variation at scale: a realist study of implementation strategy mechanisms

BACKGROUND

Unwarranted clinical variation in hospital care includes the underuse, overuse, or misuse of services. Audit and feedback is a common strategy to reduce unwarranted variation, but its effectiveness varies widely across contexts. We aimed to identify implementation strategies, mechanisms, and contextual circumstances contributing to the impact of audit and feedback on unwarranted clinical variation.

METHODS

Realist study examining a state-wide value-based healthcare program implemented between 2017 and 2021 in New South Wales, Australia. Three initiatives within the program included audit and feedback to reduce unwarranted variation in inpatient care for different conditions. Multiple data sources were used to formulate the initial audit and feedback program theory: a systematic review, realist review, program document review, and informal discussions with key program stakeholders. Semi-structured interviews were then conducted with 56 participants to refute, refine, or confirm the initial program theories. Data were analysed retroductively using a context-mechanism-outcome framework for 11 transcripts which were coded into the audit and feedback program theory. The program theory was validated with three expert panels: senior health leaders (n = 19), Agency for Clinical Innovation (n = 11), and Ministry of Health (n = 21) staff.

RESULTS

The program's audit and feedback implementation strategy operated through eight mechanistic processes. The strategy worked well when clinicians (1) felt ownership and buy-in, (2) could make sense of the information provided, (3) were motivated by social influence, and (4) accepted responsibility and accountability for proposed changes. The success of the strategy was constrained when the audit process led to (5) rationalising current practice instead of creating a learning opportunity, (6) perceptions of unfairness and concerns about data integrity, 7) development of improvement plans that were not followed, and (8) perceived intrusions on professional autonomy.

CONCLUSIONS

Audit and feedback strategies may help reduce unwarranted clinical variation in care where there is engagement between auditors and local clinicians, meaningful audit indicators, clear improvement plans, and respect for clinical expertise. We contribute theoretical development for audit and feedback by proposing a Model for Audit and Feedback Implementation at Scale. Recommendations include limiting the number of audit indicators, involving clinical staff and local leaders in feedback, and providing opportunities for reflection.

A grounded theory-based qualitative approach for examining local implementation of public health policies during crises

Background

COVID-19's emergence questions the agility of health policy deployment in a context of urgency. This exceptional pandemic offers a unique Implementation Science study opportunity. It reveals how actors adapt, coordinate, and mitigate an unknown global threat to safeguard populations from an initially mysterious virus. Limited research has explored how involved players act and adapt their practices to fulfil health protection missions during a global health crisis. Bridging the gap between public policy expectations and achievements requires a methodology for stakeholder identification and implementation practice description.

Objective

Focusing on COVID-19 management in France's second-largest region, we investigate ministerial recommendation implementation and the emergence of new links, coordination modes, and practices.

Methods

Due to the novel subject, we adopted grounded theory. Initial documentary data collection identifies stakeholders for subsequent interviews. Open-ended coding of collected discourse enables content analysis.

Results

Findings reveal a crisis-driven re-evaluation of stakeholder relationships. This research identifies three levels of implementation of health policies at the local level (administrative, organizational and operational) and reveals different types of coordination specific to each of these levels. Our results provide insights on how to better coordinate and implement healthcare policies in a period of crisis. Recommendations include real-life simulations of large-scale crises.

Conclusion

Our work establishes a methodological foundation for analysing coordination dynamics. Future research could compare these findings with other unpredictable health emergencies, such as episiotomic veterinary health crises.•The first step of the method is to analyse the guidelines of health policy implementation during the Covid-19 crisis and to identify the main stakeholders in charge of the local health policy implementation.•The second step consists of interviewing these stakeholders using a co-constructed sample and structural coding of their speech to reveal the forms of coordination between stakeholders.

Champion and audit and feedback strategy fidelity and their relationship to depression intervention fidelity: A mixed method study

Background

Globally, mental health disorders rank as the greatest cause of disability. Low and middle-income countries (LMICs) hold a disproportionate share of the mental health burden, especially as it pertains to depression. Depression is highly prevalent among those with non-communicable diseases (NCDs), creating a barrier to successful treatment. While some treatments have proven efficacy in LMIC settings, wide dissemination is challenged by multiple factors, leading researchers to call for implementation strategies to overcome barriers to care provision. However, implementation strategies are often not well defined or documented, challenging the interpretation of study results and the uptake and replication of strategies in practice settings. Assessing implementation strategy fidelity (ISF), or the extent to which a strategy was implemented as designed, overcomes these challenges. This study assessed fidelity of two implementation strategies (a 'basic' champion strategy and an 'enhanced' champion + audit and feedback strategy) to improve the integration of a depression intervention, measurement based care (MBC), at 10 NCD clinics in Malawi. The primary goal of this study was to assess the relationship between the implementation strategies and MBC fidelity using a mixed methods approach.

Methods

We developed a theory-informed mixed methods fidelity assessment that first combined an implementation strategy specification technique with a fidelity framework. We then created corresponding fidelity indicators to strategy components. Clinical process data and one-on-one in-depth interviews with 45 staff members at 6 clinics were utilized as data sources. Our final analysis used descriptive statistics, reflexive-thematic analysis (RTA), data merging, and triangulation to examine the relationship between ISF and MBC intervention fidelity.

Results

Our mixed methods analysis revealed how ISF may moderate the relationship between the strategies and MBC fidelity. Leadership engagement and implementation climate were critical for clinics to overcome implementation barriers and preserve implementation strategy and MBC fidelity. Descriptive statistics determined champion strategy fidelity to range from 61 to 93% across the 10 clinics. Fidelity to the audit and feedback strategy ranged from 82 to 91% across the 5 clinics assigned to that condition. MBC fidelity ranged from 54 to 95% across all clinics. Although correlations between ISF and MBC fidelity were not statistically significant due to the sample of 10 clinics, associations were in the expected direction and of moderate effect size. A coefficient for shared depression screening among clinicians had greater face validity compared to depression screening coverage and functioned as a proximal indicator of implementation strategy success.

Conclusion

Fidelity to the basic and enhanced strategies varied by site and were influenced by leadership engagement and implementation climate. Champion strategies may benefit from the addition of leadership strategies to help address implementation barriers outside the purview of champions. ISF may moderate the relationship between strategies and implementation outcomes.

Guideline evaluation and implementation mechanisms in school health services (GuideMe): protocol for a hybrid randomized factorial trial

BACKGROUND

Norwegian school health services received a national best-practice guideline in 2017. To promote healthy life skills and identify adolescents needing support, the guideline includes strong recommendations for individual consultations with all 8th graders and increased collaboration with schools. To help implement the recommendations, a blended implementation strategy (SchoolHealth) was co-created with school nurses, students, and stakeholders. SchoolHealth consists of three implementation elements: Digital dialog and administration tool (audit and feedback +), Dialog support (external consultation), and Collaboration materials (targeted dissemination). This hybrid study will test the main and combined effects of the elements on guideline fidelity and effectiveness.

METHODS

The GuideMe study is a factorial cluster randomized controlled trial examining SchoolHealth's effectiveness on guideline fidelity and guideline effectiveness goals. Forty Norwegian secondary schools will be randomized to eight different combinations of the elements in SchoolHealth. Participants will include school nurses and school personnel from these schools, and 8th grade students (n = 1200). Primary outcomes are school nurses' fidelity to the guidelines and student's ability to cope with their life (i.e., health literacy, positive health behaviors and self-efficacy). Quantitative methods will be used to test effects and mechanisms, while mixed- and qualitative methods will be used to explore mechanisms, experiences, and other phenomena in depth. Participants will complete digital questionnaires at the start and end of the schoolyear, and after the consultation during the schoolyear. The study will run in two waves, each lasting for one school year. The multifactorial design allows testing of interactions and main effects due to equal distribution of all factors within each main effect. Sustainment and scale-up of optimized SchoolHealth elements using national infrastructure are simultaneously prepared.

DISCUSSION

The study will investigate possible effects of the implementation elements in isolation and in combination, and hypothesized implementation mechanisms. In-depth study of user experiences will inform improvements to elements in SchoolHealth. The results will yield causal knowledge about implementation strategies and the mechanisms through which they assert effects. Mixed-methods will provide insights into how and when the elements work. Optimizing guideline implementation elements can support adolescents in a crucial life phase.

TRAIL REGISTRATION

ISRCTN24173836. Registration date 8 August 2022.

Applying the Theoretical Domains Framework to Develop an Intervention to 'Re-implement' Parent-Child Interaction Therapy (PCIT)

Parent-Child Interaction Therapy (PCIT) is an empirically supported treatment for childhood conduct problems, with increasing numbers of clinicians being trained in Aotearoa/New Zealand. However, ensuring sustained delivery of effective treatments by trained clinicians in routine care environments is notoriously challenging. The aims of this qualitative study were to (1) systematically examine and prioritise PCIT implementation barriers and facilitators, and (2) develop a well specified and theory-driven 're-implementation' intervention to support already-trained clinicians to resume or increase their implementation of PCIT. To triangulate and refine existing understanding of PCIT implementation determinants from an earlier cross-sectional survey, we integrated previously unanalysed qualitative survey data (54 respondents; response rate 60%) with qualitative data from six new focus groups with 15 PCIT-trained clinicians and managers in Aotearoa/New Zealand. We deductively coded data, using a directed content analysis process and the Theoretical Domains Framework, resulting in the identification of salient theoretical domains and belief statements within these. We then used the Theory and Techniques Tool to identify behaviour change techniques, possible intervention components, and their hypothesised mechanisms of action. Eight of the 14 theoretical domains were identified as influential on PCIT-trained clinician implementation behaviour (Knowledge; Social/Professional Role and Identity; Beliefs about Capabilities; Beliefs about Consequences; Memory, Attention and Decision Processes; Environmental Context and Resources; Social Influences; Emotion). Two of these appeared to be particularly salient: (1) 'Environmental Context and Resources', specifically lacking suitable PCIT equipment, with (lack of) access to a well-equipped clinic room appearing to influence implementation behaviour in several ways. (2) 'Social/Professional Role and Identity', with beliefs relating to a perception that colleagues view time-out as harmful to children, concerns that internationally-developed PCIT is not suitable for non-Māori clinicians to deliver to Indigenous Māori families, and clinicians feeling obligated yet isolated in their advocacy for PCIT delivery. In conclusion, where initial implementation has stalled or languished, re-implementation may be possible, and makes good sense, both fiscally and practically. This study suggests that re-implementation of PCIT in Aotearoa/New Zealand may be facilitated by intervention components such as ensuring access to a colleague or co-worker who is supportive of PCIT delivery, access to suitable equipment (particularly a time-out room), and targeted additional training for clinicians relating to the safety of time-out for children. The feasibility and acceptability of these intervention components will be tested in a future clinical trial.

Application of the Expert Recommendations for Implementing Change (ERIC) compilation of strategies to health intervention implementation in low- and middle-income countries: a systematic review

BACKGROUND

The Expert Recommendations for Implementing Change (ERIC) project developed a compilation of implementation strategies that are intended to standardize reporting and evaluation. Little is known about the application of ERIC in low- and middle-income countries (LMICs). We systematically reviewed the literature on the use and specification of ERIC strategies for health intervention implementation in LMICs to identify gaps and inform future research.

METHODS

We searched peer-reviewed articles published through March 2023 in any language that (1) were conducted in an LMIC and (2) cited seminal ERIC articles or (3) mentioned ERIC in the title or abstract. Two co-authors independently screened all titles, abstracts, and full-text articles, then abstracted study, intervention, and implementation strategy characteristics of included studies.

RESULTS

The final sample included 60 studies describing research from all world regions, with over 30% published in the final year of our review period. Most studies took place in healthcare settings (n = 52, 86.7%), while 11 (18.2%) took place in community settings and four (6.7%) at the policy level. Across studies, 548 distinct implementation strategies were identified with a median of six strategies (range 1-46 strategies) included in each study. Most studies (n = 32, 53.3%) explicitly matched implementation strategies used for the ERIC compilation. Among those that did, 64 (87.3%) of the 73 ERIC strategies were represented. Many of the strategies not cited included those that target systems- or policy-level barriers. Nearly 85% of strategies included some component of strategy specification, though most only included specification of their action (75.2%), actor (57.3%), and action target (60.8%). A minority of studies employed randomized trials or high-quality quasi-experimental designs; only one study evaluated implementation strategy effectiveness.

CONCLUSIONS

While ERIC use in LMICs is rapidly growing, its application has not been consistent nor commonly used to test strategy effectiveness. Research in LMICs must better specify strategies and evaluate their impact on outcomes. Moreover, strategies that are tested need to be better specified, so they may be compared across contexts. Finally, strategies targeting policy-, systems-, and community-level determinants should be further explored.

TRIAL REGISTRATION

PROSPERO, CRD42021268374.

A structured approach to applying systems analysis methods for examining implementation mechanisms

BACKGROUND

It is challenging to identify and understand the specific mechanisms through which an implementation strategy affects implementation outcomes, as implementation happens in the context of complex, multi-level systems. These systems and the mechanisms within each level have their own dynamic environments that change frequently. For instance, sequencing may matter in that a mechanism may only be activated indirectly by a strategy through another mechanism. The dosage or strength of a mechanism may vary over time or across different health care system levels. To elucidate the mechanisms relevant to successful implementation amidst this complexity, systems analysis methods are needed to model and manage complexity.

METHODS

The fields of systems engineering and systems science offer methods-which we refer to as systems analysis methods-to help explain the interdependent relationships between and within systems, as well as dynamic changes to systems over time. When applied to studying implementation mechanisms, systems analysis methods can help (i) better identify and manage unknown conditions that may or may not activate mechanisms (both expected mechanisms targeted by a strategy and unexpected mechanisms that the methods help detect) and (ii) flexibly guide strategy adaptations to address contextual influences that emerge after the strategy is selected and used.

RESULTS

In this paper, we delineate a structured approach to applying systems analysis methods for examining implementation mechanisms. The approach includes explicit steps for selecting, tailoring, and evaluating an implementation strategy regarding the mechanisms that the strategy is initially hypothesized to activate, as well as additional mechanisms that are identified through the steps. We illustrate the approach using a case example. We then discuss the strengths and limitations of this approach, as well as when these steps might be most appropriate, and suggest work to further the contributions of systems analysis methods to implementation mechanisms research.

CONCLUSIONS

Our approach to applying systems analysis methods can encourage more mechanisms research efforts to consider these methods and in turn fuel both (i) rigorous comparisons of these methods to alternative mechanisms research approaches and (ii) an active discourse across the field to better delineate when these methods are appropriate for advancing mechanisms-related knowledge.

Use of a multi-phased approach to identify and address facilitators and barriers to the implementation of a population-wide genomic screening program

INTRODUCTION

Population-wide genomic screening for CDC Tier-1 conditions offers the ability to identify the 1-2% of the US population at increased risk for Hereditary Breast and Ovarian Cancer, Lynch Syndrome, and Familial Hypercholesterolemia. Implementation of population-wide screening programs is highly complex, requiring engagement of diverse collaborators and implementation teams. Implementation science offers tools to promote integration of these programs through the identification of determinants of success and strategies to address potential barriers.

METHODS

Prior to launching the program, we conducted a pre-implementation survey to assess anticipated barriers and facilitators to reach, effectiveness, adoption, implementation, and maintenance (RE-AIM), among 51 work group members (phase 1). During the first year of program implementation, we completed coding of 40 work group meetings guided by the Consolidated Framework for Implementation Research (CFIR) (phase 2). We matched the top barriers to implementation strategies identified during phase 2 using the CFIR-ERIC (Expert Recommendation for Implementing Change) matching tool.

RESULTS

Staffing and workload concerns were listed as the top barrier in the pre-implementation phase of the program. Top barriers during implementation included adaptability (n = 8, 20%), complexity (n = 14, 35%), patient needs and resources (n = 9, 22.5%), compatibility (n = 11, 27.5%), and self-efficacy (n = 9, 22.5%). We identified 16 potential implementation strategies across six ERIC clusters to address these barriers and operationalized these strategies for our specific setting and program needs.

CONCLUSION

Our findings provide an example of successful use of the CFIR-ERIC tool to guide implementation of a population-wide genomic screening program.

The implementation and effectiveness of multi-tasked, paid community health workers on maternal and child health: A cluster-randomized pragmatic trial and qualitative process evaluation in Tanzania

Community health worker programs have proliferated worldwide based on evidence that they help prevent mortality, particularly among children. However, there is limited evidence from randomized studies on the processes and effectiveness of implementing community health worker programs through public health systems. This paper describes the results of a cluster-randomized pragmatic implementation trial (registration number ISRCTN96819844) and qualitative process evaluation of a community health worker program in Tanzania that was implemented from 2011-2015. Program effects on maternal, newborn and child health service utilization, childhood morbidity and sick childcare seeking were evaluated using difference-in-difference regression analysis with outcomes measured through pre- and post-intervention household surveys in intervention and comparison trial arms. A qualitative process evaluation was conducted between 2012 and 2014 and comprised of in-depth interviews and focus group discussions with community health workers, community members, facility-based health workers and staff of district health management teams. The community health worker program reduced incidence of illness and improved access to timely and appropriate curative care for children under five; however, there was no effect on facility-based maternal and newborn health service utilization. The positive outcomes occurred because of high levels of acceptability of community health workers within communities, as well as the durability of community health workers' motivation and confidence. Implementation factors that generated these effects were the engagement of communities in program startup; the training, remuneration and supervision of the community health workers from the local health system and community. The lack of program effects on maternal and newborn health service utilization at facilities were attributed to lapses in the availability of needed care at facilities. Strategies that strengthen and align communities' and health systems core capacities, and their ability to learn, adapt and integrate evidence-based interventions, are needed to maximize the health impact of community health workers.

A scoping review of implementation science theories, models, and frameworks - an appraisal of purpose, characteristics, usability, applicability, and testability

BACKGROUND

A proliferation of theories, models, and frameworks (TMFs) have been developed in the implementation science field to facilitate the implementation process. The basic features of these TMFs have been identified by several reviews. However, systematic appraisals on the quality of these TMFs are inadequate. To fill this gap, this study aimed to assess the usability, applicability, and testability of the current TMFs in a structured way.

METHODS

A scoping review method was employed. Electronic databases were searched to locate English and Chinese articles published between January 2000 and April 2022. Search terms were specific to implementation science. Additionally, hand searches were administered to identify articles from related reviews. Purpose and characteristics such as the type of TMF, analytical level, and observation unit were extracted. Structured appraisal criteria were adapted from Birken et al.'s Theory Comparison and Selection Tool (T-CaST) to conduct an in-depth analysis of the TMFs' usability, applicability, and testability.

RESULTS

A total of 143 TMFs were included in this analysis. Among them, the most common purpose was to identify barriers and facilitators. Most TMFs applied the descriptive method to summarize the included constructs or the prescriptive method to propose courses of implementation actions. TMFs were mainly mid-range theories built on existing conceptual frameworks or demonstrated grand theories. The usability of the TMFs needs to be improved in terms of the provision of conceptually matched strategies to barriers and facilitators and instructions on the TMFs usage. Regarding the applicability, little attention was paid to the constructs of macro-level context, stages of scale-up and sustainability, and implementation outcomes like feasibility, cost, and penetration. Also, fewer TMFs could propose recommended research and measurement methods to apply the TMFs. Lastly, explicit hypotheses or propositions were lacking in most of the TMFs, and empirical evidence was lacking to support the claimed mechanisms between framework elements in testability.

CONCLUSIONS

Common limitations were found in the usability, application, and testability of the current TMFs. The findings of this review could provide insights for developers of TMFs for future theoretical advancements.

Effectiveness of de-implementation strategies for low-value prescribing in secondary care: a systematic review

BACKGROUND/AIMS

Considerable efforts have been made to improve guideline adherence in healthcare through de-implementation, such as decreasing the prescription of inappropriate medicines. However, we have limited knowledge about the effectiveness, barriers, facilitators and consequences of de-implementation strategies targeting inappropriate medication prescribing in secondary care settings. This review was conducted to understand these factors to contribute to better replication and optimisation of future de-implementation efforts to reduce low-value care.

METHODS

A systematic review of randomised control trials was conducted. Papers were identified through CINAHL, EMBASE, MEDLINE and Cochrane register of controlled trials to February 2021. Eligible studies were randomised control trials evaluating behavioural strategies to de-implement inappropriate prescribing in secondary healthcare. Risk of bias was assessed using the Cochrane Risk of Bias tool. Intervention characteristics, effectiveness, barriers, facilitators and consequences were identified in the study text and tabulated.

RESULTS

Eleven studies were included, of which seven were reported as effectively de-implementing low-value prescribing. Included studies were judged to be mainly at low to moderate risk for selection biases and generally high risk for performance and reporting biases. The majority of these strategies were clinical decision support at the 'point of care'. Clinical decision support tools were the most common and effective. They were found to be a low-cost and simple strategy. However, barriers such as clinician's reluctance to accept recommendations, or the clinical setting were potential barriers to their success. Educational strategies were the second most reported intervention type however the utility of educational strategies for de-implementation remains varied. Multiple barriers and facilitators relating to the environmental context, resources and knowledge were identified across studies as potentially influencing de-implementation. Various consequences were identified; however, few measured the impact of de-implementation on usual appropriate practice.

CONCLUSION

This review offers insight into the intervention strategies, potential barriers, facilitators and consequences that may affect the de-implementation of low-value prescribing in secondary care. Identification of these key features helps understand how and why these strategies are effective and the wider (desirable or undesirable) impact of de-implementation. These findings can contribute to the successful replication or optimisation of strategies used to de-implement low-value prescribing practices in future.

TRIAL REGISTRATION

The review protocol was registered at PROSPERO (ID: CRD42021243944).

Assessment of Adoption and Early Implementation Barriers and Facilitators of the Safe Environment for Every Kid (SEEK) Model

OBJECTIVE

Although the use of interventions for screening for social determinants of health of families in pediatric primary care clinics has increased in the past decade, research on the barriers and facilitators of implementing such interventions has been limited. We explored barriers, facilitators, and the mechanisms clarifying their roles in the adoption and implementation of the Safe Environment for Every Kid (SEEK) model, an approach for strengthening families, promoting children's health and development, and preventing child maltreatment.

METHODS

A total of 28 semistructured interviews were completed with 9 practice champions, 11 primary care professionals, 5 behavioral health professionals, and 3 nursing/administrative staff representing 12 pediatric primary care practices participating in a larger randomized control trial of implementing SEEK.

RESULTS

We identified several barriers and facilitators in the stages of SEEK's adoption and early implementation. Barriers associated with outer and inner setting determinants and poor innovation-organization fit declined in importance over time, while facilitators associated with SEEK characteristics increased in importance based on participants' responses. Barriers and facilitators were linked by mechanisms of comparison and contrast of burdens and benefits, and problem-solving to address limited capacity with available resources.

CONCLUSIONS

Any screening for and addressing social determinants of health demands greater attention to adoption and implementation mechanisms and the processes by which primary care professionals assess and utilize facilitators to address barriers. This occurs in a context defined by perceived burdens and benefits of innovation adoption and implementation, the capacity of the practice, and changes in perception with experiencing the innovation.

Physical activity interventions in older adults with a cognitive impairment: A critical review of reviews

This critical review explores the review material on physical activity combined with cognitive stimulation interventions in older adults with cognitive impairment and/or dementia. A critical, systematic, review of the review method was used, considering four electronic databases: WEB OF SCIENCE, SCOPUS, MEDLINE, and the COCHRANE ELECTRONIC LIBRARY. The search terms "exercise," "physical activity," "cognitive impairment," "dementia," and "systematic review" were used. All available reviews were marked against predetermined inclusion and exclusion criteria. There were 32 reviews that met the inclusion criteria. A combination of various types of training and aerobic exercises were the most frequently reported interventions; meanwhile, dual task training programs (combining physical exercise with cognitive stimulation), functional training programs along with exercises combination, aerobic exercise as well as strength, stretching, or balance workouts were also reported. The evidence is compelling; exercise can improve physical health by ensuring cognitive, psychological, and behavioral benefits. Overall, exercise can improve the physical and mental health of people living with dementia: there is sufficient evidence to recommend multimodal exercise.

Systematic development of a set of implementation strategies for transitional care innovations in long-term care

BACKGROUND

Numerous transitional care innovations (TCIs) are being developed and implemented to optimize care continuity for older persons when transferring between multiple care settings, help meet their care needs, and ultimately improve their quality of life. Although the implementation of TCIs is influenced by contextual factors, the use of effective implementation strategies is largely lacking. Thus, to improve the implementation of TCIs targeting older persons receiving long-term care services, we systematically developed a set of viable strategies selected to address the influencing factors.

METHODS

As part of the TRANS-SENIOR research network, a stepwise approach following Implementation Mapping (steps 1 to 3) was applied to select implementation strategies. Building on the findings of previous studies, existing TCIs and factors influencing their implementation were identified. A combination of four taxonomies and overviews of change methods as well as relevant evidence on their effectiveness were used to select the implementation strategies targeting each of the relevant factors. Subsequently, individual consultations with scientific experts were performed for further validation of the process of mapping strategies to implementation factors and for capturing alternative ideas on relevant implementation strategies.

RESULTS

Twenty TCIs were identified and 12 influencing factors (mapped to the Consolidated Framework for Implementation Research) were designated as priority factors to be addressed with implementation strategies. A total of 40 strategies were selected. The majority of these target factors at the organizational level, e.g., by using structural redesign, public commitment, changing staffing models, conducting local consensus discussions, and organizational diagnosis and feedback. Strategies at the level of individuals included active learning, belief selection, and guided practice. Each strategy was operationalized into practical applications.

CONCLUSIONS

This project developed a set of theory and evidence-based implementation strategies to address the influencing factors, along further tailoring for each context, and enhance the implementation of TCIs in daily practice settings. Such work is critical to advance the use of implementation science methods to implement innovations in long-term care successfully.

Barriers and facilitators of implementation of evidence-based interventions in children and young people's mental health care - a systematic review

BACKGROUND

Effective evidence-based practices (EBP) for children and young people's (CYP) mental health exist, however, there is low uptake in clinical practice and interventions do not always reach those in need. This review aimed to comprehensively identify and synthesise the barriers and facilitators to implementing EBP in CYP mental health care, mapped according to an implementation framework in order to make pragmatic recommendations for practitioners, commissioners and researchers.

METHODS

Following the PRISMA guidelines, an electronic search of PsycINFO, MEDLINE, CINAHL and Embase in 2021 yielded 1830 results. In total, 107 abstracts were screened, 57 of which were included for full-text review and 26 were included for data extraction and analysis.

RESULTS

We identified a number of organisational and clinician-level barriers which impede the implementation of evidence in 'real world' practice. Barriers included lack of access to funding; poor access to resources; clinician attitudes and flexibility of EBP. Facilitators included targeted funding and access to resources; supportive staff and leadership committed to innovation and skills in the EBP.

CONCLUSIONS

Although the process of translating research into practice is challenging and the solutions are not straightforward, we have identified a set of practical recommendations for ways in which implementation practices can improve. Researchers, commissioners, funders and practitioners can work together to improve the implementation of EBP in CYP mental health settings by ensuring funding is available, prioritise implementation beyond the end of trials, upskill staff on integrating EBP into care, ensure EBPs are flexible and are co-produced with service users.

REGISTRATION

This review was registered on PROSPERO international prospective register of systematic reviews (CRD42021252995).

Rapid implementation mapping to identify implementation determinants and strategies for cervical cancer control in Nigeria

Background

Cervical cancer constitutes a huge burden among women in Nigeria, particularly HIV-infected women. However, the provision and uptake of cervical cancer screening and treatment is limited in Nigeria. Understanding implementation determinants is essential for the effective translation of such evidence-based interventions into practice, particularly in low-resource settings. COVID-19 pandemic necessitated online collaboration making implementation mapping challenging in some ways, while providing streamlining opportunities. In this study, we describe the use of a virtual online approach for implementation mapping (steps 1-3) to identify implementation determinants, mechanisms, and strategies to implement evidence-based cervical cancer screening and treatment in existing HIV infrastructure in Nigeria.

Methods

This study used a mixed methods study design with a virtual modified nominal group technique (NGT) process aligning with Implementation Mapping steps 1-3. Eleven stakeholders (six program staff and five healthcare providers and administrators) participated in a virtual NGT process which occurred in two phases. The first phase utilized online surveys, and the second phase utilized an NGT and implementation mapping process. The Exploration, Preparation, Implementation and Sustainment (EPIS) framework was used to elicit discussion around determinants and strategies from the outer context (i.e., country and regions), inner organizational context of existing HIV infrastructure, bridging factors that relate to bi-directional influences, and the health innovation to be implemented (in this case cervical cancer screening and treatment). During the NGT, the group ranked implementation barriers and voted on implementation strategies using Mentimeter.

Results

Eighteen determinants to integrating cervical cancer screening and treatment into existing comprehensive HIV programs were related to human resources capacity, access to cervical cancer services, logistics management, clinic, and client-related factors. The top 3 determinants included gaps in human resources capacity, poor access to cervical cancer services, and lack of demand for services resulting from lack of awareness about the disease and servicesA set of six core implementation strategies and two enhanced implementation strategies were identified.

Conclusions

Rapid Implementation Mapping is a feasible and acceptable approach for identifying and articulating implementation determinants, mechanisms, and strategies for complex healthcare interventions in LMICs.

Acceptability, appropriateness, and feasibility of Rural School Support Strategies for behavioral interventions: a mixed methods evaluation over two years of a hybrid type 3 implementation-effectiveness trial

BACKGROUND

Positive Behavioral Interventions and Supports (PBIS) is a framework for implementing evidence-based interventions for preventing behavioral issues and improving climate in schools. The implementation of school-wide PBIS with fidelity is complex, requiring leadership commitment, teaming, and coordination of systems for tracking behaviors and consequences. Putting these components in place while ensuring alignment with the values and needs of the school community can be difficult for schools with fewer resources, such as rural schools. Implementation supports are needed, including strategies such as technical assistance, but it is unclear whether lower-cost modalities such as virtual support are acceptable, appropriate, and feasible and whether perceptions vary throughout the implementation process.

METHODS

A type 3 hybrid implementation-effectiveness trial is taking place in 40 Idaho schools, testing a bundle of implementation supports selected to meet the needs of schools in rural areas. Supports include technical assistance from an implementation support practitioner (ISP), didactic trainings, virtual learning sessions, and an online resource portal. Surveys and interviews in the first 2 years of implementation (fall 2019 to spring 2021) explored outcomes of acceptability, appropriateness, and feasibility regarding the implementation supports among more than 150 school stakeholders.

RESULTS

Evaluations showed high acceptability and appropriateness of the PBIS concepts and training. The 20 schools receiving additional implementation support rated the technical assistance and support from the project's ISPs as the most acceptable and appropriate resource. Reasons for acceptability were the relationship built with the ISP, the ISP's expertise, and being a "neutral party." Although in-person support from the ISP was preferred, remote support was acceptable and increased feasibility of attendance. Virtual learning sessions were acceptable for learning and collaboration, particularly in the second year of implementation, once ISPs had developed closer relationships with school teams.

CONCLUSIONS

School staff found training, technical assistance, and virtual learning sessions to be acceptable and appropriate. Virtual formats of training and technical assistance decreased in acceptability but increased feasibility of attendance. In-person support was preferred during initial implementation, and virtual support was more acceptable thereafter.

TRIAL REGISTRATION

This trial was prospectively registered on ClinicalTrials.gov ( NCT03736395 ), on November 9, 2018.

Ten years of implementation outcomes research: a scoping review

BACKGROUND

Proctor and colleagues' 2011 paper proposed a taxonomy of eight implementation outcomes and challenged the field to address a research agenda focused on conceptualization, measurement, and theory building. Ten years later, this paper maps the field's progress in implementation outcomes research. This scoping review describes how each implementation outcome has been studied, research designs and methods used, and the contexts and settings represented in the current literature. We also describe the role of implementation outcomes in relation to implementation strategies and other outcomes.

METHODS

Arksey and O'Malley's framework for conducting scoping reviews guided our methods. Using forward citation tracing, we identified all literature citing the 2011 paper. We conducted our search in the Web of Science (WOS) database and added citation alerts sent to the first author from the publisher for a 6-month period coinciding with the WOS citation search. This produced 1346 titles and abstracts. Initial abstract screening yielded 480 manuscripts, and full-text review yielded 400 manuscripts that met inclusion criteria (empirical assessment of at least one implementation outcome).

RESULTS

Slightly more than half (52.1%) of included manuscripts examined acceptability. Fidelity (39.3%), feasibility (38.6%), adoption (26.5%), and appropriateness (21.8%) were also commonly examined. Penetration (16.0%), sustainability (15.8%), and cost (7.8%) were less frequently examined. Thirty-two manuscripts examined implementation outcomes not included in the original taxonomy. Most studies took place in healthcare (45.8%) or behavioral health (22.5%) organizations. Two-thirds used observational designs. We found little evidence of progress in testing the relationships between implementation strategies and implementation outcomes, leaving us ill-prepared to know how to achieve implementation success. Moreover, few studies tested the impact of implementation outcomes on other important outcome types, such as service systems and improved individual or population health.

CONCLUSIONS

Our review presents a comprehensive snapshot of the research questions being addressed by existing implementation outcomes literature and reveals the need for rigorous, analytic research and tests of strategies for attaining implementation outcomes in the next 10 years of outcomes research.

The Polarization of Clinician and Service Staff Perspectives After the Use of Health Information Technology in Youth Mental Health Services: Implementation and Evaluation Study

BACKGROUND

Highly personalized care is substantially improved by technology platforms that assess and track patient outcomes. However, evidence regarding how to successfully implement technology in real-world mental health settings is limited.

OBJECTIVE

This study aimed to naturalistically monitor how a health information technology (HIT) platform was used within 2 real-world mental health service settings to gain practical insights into how HIT can be implemented and sustained to improve mental health service delivery.

METHODS

An HIT (The Innowell Platform) was naturally implemented in 2 youth mental health services in Sydney, Australia. Web-based surveys (n=19) and implementation logs were used to investigate staff attitudes toward technology before and after implementation. Descriptive statistics were used to track staff attitudes over time, whereas qualitative thematic analysis was used to explore implementation log data to gain practical insights into useful implementation strategies in real-world settings.

RESULTS

After the implementation, the staff were nearly 3 times more likely to agree that the HIT would improve care for their clients (3/12, 25% agreed before the implementation compared with 7/10, 70% after the implementation). Despite this, there was also an increase in the number of staff who disagreed that the HIT would improve care (from 1/12, 8% to 2/10, 20%). There was also decreased uncertainty (from 6/12, 50% to 3/10, 30%) about the willingness of the service to implement the technology for its intended purpose, with similar increases in the number of staff who agreed and disagreed with this statement. Staff were more likely to be uncertain about whether colleagues in my service are receptive to changes in clinical processes (not sure rose from 5/12, 42% to 7/10, 70%). They were also more likely to report that their service already provides the best mental health care (agreement rose from 7/12, 58% to 8/10, 80%). After the implementation, a greater proportion of participants reported that the HIT enabled shared or collaborative decision-making with young people (2/10, 20%, compared with 1/12, 8%), enabled clients to proactively work on their mental health care through digital technologies (3/10, 30%, compared with 2/12, 16%), and improved their response to suicidal risk (4/10, 40% compared with 3/12, 25%).

CONCLUSIONS

This study raises important questions about why clinicians, who have the same training and support in using technology, develop more polarized opinions on its usefulness after implementation. It seems that the uptake of HIT is heavily influenced by a clinician's underlying beliefs and attitudes toward clinical practice in general as well as the role of technology, rather than their knowledge or the ease of use of the HIT in question.

Individual-level associations between implementation leadership, climate, and anticipated outcomes: a time-lagged mediation analysis

BACKGROUND

Leaders can improve implementation outcomes by developing an organizational climate conducive to the implementation of evidence-based practices (EBP). This study tested the lagged associations between individual-level perceptions of implementation leadership, implementation climate, and three anticipated implementation outcomes, that is EBP acceptability, appropriateness, and feasibility.

METHODS

Screening tools and treatment methods for posttraumatic stress disorder were implemented in 43 Norwegian mental health services. A sample of 494 child and adult mental health care professionals (M = 43 years, 78% female) completed surveys addressing perceptions of first-level leaders' (n = 47) implementation leadership and their clinics' implementation climate. Single-level structural equation models estimating both direct, indirect, and total effects were used to investigate whether perceived implementation climate mediated the association between perceived implementation leadership and perceived acceptability, appropriateness, and feasibility of screening tools and treatment methods.

RESULTS

Regarding the treatment methods, implementation leadership was associated with therapists' perceptions of acceptability, appropriateness, and feasibility. Implementation climate also mediated between implementation leadership and the outcomes. Regarding the screening tools, implementation leadership was not associated with the outcomes. However, implementation climate mediated between implementation leadership and therapists' perceptions of acceptability and feasibility, but not appropriateness. Analyses with the implementation climate subscales showed stronger associations for therapists' perceptions of the treatment methods than of screening tools.

CONCLUSIONS

Leaders may promote positive implementation outcomes, both directly and through implementation climate. With regard to the effect sizes and explained variance, results indicated that both implementation leadership and implementation climate were more strongly associated with the therapists' perceptions of the treatment methods, implemented by one group of therapists, than the screening tools, implemented by all therapists. This may imply that implementation leadership and climate may have stronger effects for smaller implementation teams within a larger system than for system-wide implementations or when the clinical interventions being implemented are more complex rather than simple ones.

TRIAL REGISTRATION

ClinicalTrials NCT03719651, 25 October 2018.

Implementation of Home-Based Telerehabilitation of Patients With Stroke in the United States: Protocol for a Realist Review

BACKGROUND

Stroke is a common cause of mortality and morbidity. Insufficient and untimely rehabilitation has been associated with inadequate recovery. Telerehabilitation provides an opportunity for timely and accessible services for individuals with stroke, especially in remote areas. Telerehabilitation is defined as a health care team's use of a communication mode (eg, videoconferencing) to remotely provide rehabilitation services. Telerehabilitation is as effective as facility-based rehabilitation; however, it is infrequently used due to implementation barriers.

OBJECTIVE

The aim of the study is to explore the interaction between the implementation strategies, context, and outcomes of telerehabilitation of patients with stroke.

METHODS

This review will follow four steps: (1) defining the review scope, (2) literature search and quality appraisal, (3) data extraction and evidence synthesis, and (4) narrative development. PubMed via MEDLINE, the PEDro database, and CINAHL will be queried till June 2023 and supplemented with citation tracking and a gray literature search. The relevance and rigor of papers will be appraised using the TAPUPAS (Transparency, Accuracy, Purposivity, Utility, Propriety, Accessibility, and Specificity) and Weight of Evidence frameworks. The reviewers will extract and synthesize data iteratively and develop explanatory links between contexts, mechanisms, and outcomes. The results will be reported according to the Realist Synthesis publication standards set by Wong and colleagues in 2013.

RESULTS

The literature search and screening will be completed in July 2023. Data extraction and analysis will be completed in August 2023, and findings will be synthesized and reported in October 2023.

CONCLUSIONS

This will be the first realist synthesis, uncovering the causal mechanisms to explain how, why, and to what extent implementation strategies impact telerehabilitation adoption and implementation.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/47009.

Overcoming challenges in conducting systematic reviews in implementation science: a methods commentary

Consolidation of the literature using systematic reviews is a critical way to advance a discipline and support evidence-based decision-making in healthcare. However, unique challenges exist that impact the conduct of systematic reviews in implementation science. In this commentary, we reflect on our combined experience to describe five key challenges unique to systematic reviews of primary implementation research. These challenges include (1) descriptors used in implementation science publications, (2) distinction between evidence-based interventions and implementation strategies, (3) assessment of external validity, (4) synthesis of implementation studies with substantial clinical and methodological diversity, and (5) variability in defining implementation 'success'. We outline possible solutions and highlight resources that can be used by authors of primary implementation research, as well as systematic review and editorial teams, to overcome the identified challenges and optimise the utility of future systematic reviews in implementation science.

Quantifying the Implementation and Cost of a Multisite Antibiotic Stewardship Intervention for Asymptomatic Bacteriuria

Objective

The intensity of an antibiotic stewardship intervention to achieve clinical impact is not known. We conducted a multisite dissemination project of an intervention to reduce treatment of asymptomatic bacteriuria (ASB) and studied: (1) the association between implementation metrics and clinical outcomes and (2) the cost of implementation.

Design/Setting/Participants

A central site facilitated a multimodality intervention to decrease unnecessary urine cultures and antibiotic treatment in patients with ASB at 4 Veterans Affairs medical centers.

Methods

The intervention consisted of a decision support aid algorithm and interactive teaching cases that provided in the moment audit and feedback on how to manage ASB. Implementation outcomes included minutes spent in intervention delivery, number of healthcare professionals reached, and number of sessions delivered. Clinical outcomes included days of antibiotic therapy (DOT), length of antibiotic therapy (LOT), and number of urine cultures ordered per 1000 bed days. Personnel reported weekly time logs.

Results

Minutes spent in intervention delivery were inversely correlated with two clinical outcomes, DOT (R -0.3, P = .04) and LOT (R -0.3, P = .02). Number of healthcare professionals reached and number of sessions delivered were not correlated with clinical outcomes of DOT (R -0.003, P = .98, R = -0.059, P = .69) or LOT (R +0.073, P = .62, R -0.102, P = .49). Physician champions spent an average of 3.8% of effort on the intervention. The implementation cost was USD 22,299/year per site on average.

Conclusions

The amount of time local teams spent in delivery of an antibiotic stewardship intervention was correlated with the desired decrease in antibiotic use. Implementing this successful antibiotic stewardship intervention required minimal time.

Complex implementation mechanisms in primary care: do physicians' beliefs about the effectiveness of innovation play a mediating role? Applying a realist inquiry and structural equation modeling approach in a formative evaluation study

BACKGROUND

The adoption of digital health technologies can improve the quality of care for polypharmacy patients, if the underlying complex implementation mechanisms are better understood. Context effects play a critical role in relation to implementation mechanisms. In primary care research, evidence on the effects of context in the adoption of digital innovation for polypharmacy management is lacking.

STUDY AIM

This study aims to identify contextual factors relevant to physician behavior and how they might mediate the adoption process.

METHODS

The physicians who participated in this formative evaluation study (n = 218) were part of the intervention group in a cluster-randomized controlled trial (AdAM). The intervention group implemented a digital innovation for clinical decision making in polypharmacy. A three-step methodological approach was used: (1) a realist inquiry approach, which involves the description of a context-mechanism-outcome configuration for the primary care setting; (2) a belief elicitation approach, which involves qualitative content analysis and the development of a quantitative latent contextualized scale; and (3) a mediation analysis using structural equation modeling (SEM) based on quantitative survey data from physicians to assess the mediating role of the contextualized scale (n = 179).

RESULTS

The key dimensions of a (1) context-mechanism-outcome model were mapped and refined. A (2) latent construct of the physicians' innovation beliefs related to the effectiveness of polypharmacy management practices was identified. Innovation beliefs play a (3) mediating role between the organizational readiness to implement change (p < 0.01) and the desired behavioral intent of physicians to adopt digital innovation (p < 0.01; R² = 0.645). Our contextualized model estimated significant mediation, with a relative size of 38% for the mediation effect. Overall, the model demonstrated good fit indices (CFI = 0.985, RMSEA = 0.034).

CONCLUSION

Physician adoption is directly affected by the readiness of primary care organizations for the implementation of change. In addition, the mediation analysis revealed that this relationship is indirectly influenced by primary care physicians' beliefs regarding the effectiveness of digital innovation. Both individual physician beliefs and practice organizational capacity could be equally prioritized in developing implementation strategies. The methodological approach used is suitable for the evaluation of complex implementation mechanisms. It has been proven to be an advantageous approach for formative evaluation.

TRIAL REGISTRATION

NCT03430336 . First registration: 12/02/2018.

CLINICALTRIALS

gov.

"Now is the time for institutions to be investing in growing exercise programs as part of standard of care": a multiple case study examining the implementation of exercise oncology interventions

BACKGROUND

Implementation science seeks to systematically identify determinants, strategies, and outcomes within a causal pathway to help explain successful implementation. This process is applied to evidence-based interventions (EBIs) to improve their adoption, implementation, and sustainment. However, this method has not been applied to exercise oncology services, meaning we lack knowledge about implementing exercise EBIs in routine practice. This study aimed to develop causal pathways from the determinants, strategies (including mechanism of change), and implementation outcomes to explain exercise EBIs implementation in routine cancer care.

METHODS

A multiple-case study was conducted across three healthcare sites in Australia. Sites selected had implemented exercise within routine care for people diagnosed with cancer and sustained the delivery of services for at least 12 months. Four data sources informed the study: semi-structured interviews with staff, document reviews, observations, and the Program Sustainability Assessment Tool (survey). Framework analysis was applied to understand the findings. The Implementation Research Logic Model was used to identify commonalities in implementation across sites and develop causal pathways.

RESULTS

Two hundred and eighteen data points informed our findings. Across sites, 18 determinants and 22 implementation strategies were consistent. Sixteen determinants and 24 implementation strategies differed across sites and results of implementation outcomes varied. We identified 11 common pathways that when combined, help explain implementation processes. The mechanisms of implementation strategies operating within the pathways included (1) knowledge, (2) skills, (3) secure resources, (4) optimism, and (5) simplified decision-making processes associated with exercise; (6) relationships (social and professional) and support for the workforce; (7) reinforcing positive outcomes; (8) capability to action plan through evaluations and (9) interactive learning; (10) aligned goals between the organisation and the EBI; and (11) consumer-responsiveness.

CONCLUSION

This study developed causal pathways that explain the how and why of successful implementation of exercise EBIs in cancer care. These findings can support future planning and optimisation activities by creating more opportunities for people with cancer to access evidence-based exercise oncology services.

IMPLICATIONS FOR CANCER SURVIVORS

Understanding how to implement exercise within routine cancer care successfully is important so cancer survivors can experience the benefits of exercise.

Team-focused implementation strategies to improve implementation of mental health screening and referral in rural Children's Advocacy Centers: study protocol for a pilot cluster randomized hybrid type 2 trial

BACKGROUND

Children's Advocacy Centers (CACs) use multidisciplinary teams to investigate and respond to maltreatment allegations. CACs play a critical role in connecting children with mental health needs to evidence-based mental health treatment, especially in low-resourced rural areas. Standardized mental health screening and referral protocols can improve CACs' capacity to identify children with mental health needs and encourage treatment engagement. In the team-based context of CACs, teamwork quality is likely to influence implementation processes and outcomes. Implementation strategies that target teams and apply the science of team effectiveness may enhance implementation outcomes in team-based settings.

METHODS

We will use Implementation Mapping to develop team-focused implementation strategies to support the implementation of the Care Process Model for Pediatric Traumatic Stress (CPM-PTS), a standardized screening and referral protocol. Team-focused strategies will integrate activities from effective team development interventions. We will pilot team-focused implementation in a cluster-randomized hybrid type 2 effectiveness-implementation trial. Four rural CACs will implement the CPM-PTS after being randomized to either team-focused implementation (n = 2 CACs) or standard implementation (n = 2 CACs). We will assess the feasibility of team-focused implementation and explore between-group differences in hypothesized team-level mechanisms of change and implementation outcomes (implementation aim). We will use a within-group pre-post design to test the effectiveness of the CPM-PTS in increasing caregivers' understanding of their child's mental health needs and caregivers' intentions to initiate mental health services (effectiveness aim).

CONCLUSIONS

Targeting multidisciplinary teams is an innovative approach to improving implementation outcomes. This study will be one of the first to test team-focused implementation strategies that integrate effective team development interventions. Results will inform efforts to implement evidence-based practices in team-based service settings.

TRIAL REGISTRATION

Clinicaltrials.gov, NCT05679154 . Registered on January 10, 2023.

Evaluating the implementation of the Mayo-Portland Adaptability Inventory-4 (MPAI-4) in three rehabilitation settings in Quebec: a mixed-methods study protocol

INTRODUCTION

Stroke is a leading cause of morbidity and mortality worldwide, placing an immense burden on patients and the health system. Timely access to rehabilitation services can improve stroke survivors' quality of life. The use of standardised outcome measures is endorsed for optimising patient rehabilitation outcomes and improving clinical decision-making. This project results from a provincially mandated recommendation to use the fourth version of the Mayo-Portland Adaptability Inventory (MPAI-4) to measure changes in social participation of stroke survivors and to maintain commitment to evidence-informed practices in stroke care. This protocol outlines the implementation process of the MPAI-4 for three rehabilitation centres. The objectives are to: (a) describe the context of MPAI-4 implementation; (b) determine clinical teams' readiness for change; (c) identify barriers and enablers to implementing the MPAI-4 and match the implementation strategies; (d) evaluate the MPAI-4 implementation outcomes including the degree of integration of the MPAI-4 into clinical practice and (e) explore participants' experiences using the MPAI-4.

METHODS AND ANALYSIS

We will use a multiple case study design within an integrated knowledge translation (iKT) approach with active engagement from key informants. Each case is a rehabilitation centre implementing MPAI-4. We will collect data from clinicians and programme managers using mixed methods guided by several theoretical frameworks. Data sources include surveys, focus groups and patient charts. We will conduct descriptive, correlational and content analyses. Ultimately, we will analyse, integrate data from qualitative and quantitative components and report them within and across participating sites. Results will provide insights about iKT within stroke rehabilitation settings that could be applied to future research projects.

ETHICS AND DISSEMINATION

The project received Institutional Review Board approval from the Centre for Interdisciplinary Research in Rehabilitation of Greater Montreal. We will disseminate results in peer-reviewed publications and at local, national and international scientific conferences.

Protocol for a scoping review of health equity frameworks and models applied in empirical studies of chronic disease prevention and control

BACKGROUND

Chronic diseases, such as cancers and cardiovascular diseases, present the greatest burden of morbidity and mortality worldwide. This burden disproportionately affects historically marginalized populations. Health equity is rapidly gaining increased attention in public health, health services, and implementation research, though many health inequities persist. Health equity frameworks and models (FM) have been called upon to guide equity-focused chronic disease and implementation research. However, there is no clear synthesis of the health equity FM used in chronic disease research or how these are applied in empirical studies. This scoping review seeks to fill this gap by identifying and characterizing health equity FM applied in empirical studies along the chronic disease prevention and control continuum, describing how these FM are used, and exploring potential applications to the field of implementation science.

METHODS

We follow established guidance for conducting scoping reviews, which includes six stages: (1) identify the research question; (2) identify relevant studies; (3) select studies for inclusion; (4) data extraction; (5) collating, summarizing, and reporting the results; and (6) consultation. This protocol presents the iterative, collaborative approach taken to conceptualize this study and develop the search strategy. We describe the criteria for inclusion in this review, methods for conducting two phases of screening (title and abstract, full text), data extraction procedures, and quality assurance approaches taken throughout the project.

DISCUSSION

The findings from this review will inform health-equity focused chronic disease prevention and control research. FM identified through this review will be added to an existing website summarizing dissemination and implementation science frameworks, and we will offer case examples and recommendations for utilizing a health equity FM in empirical studies. Our search strategy and review methodology may serve as an example for scholars seeking to conduct reviews of health equity FM in other health disciplines.

SYSTEMATIC REVIEW REGISTRATION

Open Science Framework Registration https://doi.org/10.17605/OSF.IO/SFVE6.

Clinician Intentions to use the Components of Parent Coaching Within Community Early Intervention Systems

PURPOSE

Parent coaching is a complex, psychosocial intervention with multiple core components. Clinicians' use of these core components may be influenced by distinct factors; no research has examined whether clinician perceptions of parent coaching vary across core coaching components. This study aimed to examine the extent to which clinicians working with families of young autistic children in publicly funded early intervention intend to use core parent coaching components, and to examine how closely psychological factors relate to providers' intentions to use each component.

METHODS

Using the Theory of Planned Behavior as a framework, this study compared the strength of clinicians' intentions across five core parent coaching components: collaboration with parents, delivering the intervention within daily routines, demonstrating the intervention, providing in-vivo feedback, and reflection and problem solving. We examined the associations between intentions and psychological determinants of intentions (i.e., attitudes, norms, and self-efficacy) for each component.

RESULTS

Clinicians' average intentions varied by core component, with strongest intentions for demonstrating the intervention strategy for a parent. The associations between intentions and psychological determinants also varied by core component. Attitudes, injunctive norms, and self-efficacy, but not descriptive norms, significantly related to clinicians' intentions to use collaboration and daily routines, whereas attitudes and descriptive norms, but not injunctive norms and self-efficacy, significantly related to clinicians' intentions to use feedback and reflection and problem solving.

CONCLUSION

These results suggest that implementation strategies should be tailored to the specific intervention component to be most efficient and effective. The results also provide examples of potentially malleable factors that implementation strategies can strategically target.

The impact thinking framework: a process for advancing research-to-practice initiatives in neuroaesthetics

Neuroaesthetics research explores brain, body and behavioral responses to engagement with the arts and other aesthetic sensory experiences. Evidence indicates that such experiences can help address various psychological, neurological and physiological disorders, and that they can support mental and physical well-being and learning in the general population. The interdisciplinary nature of this work contributes to its impact and promise; however, it also creates challenges as various disciplines approach and define research and practice in varied ways. Recent field-wide reports have noted that a consensus translational framework is needed to support further neuroaesthetics research that can deliver meaningful knowledge and interventions. The Impact Thinking Framework (ITF) was designed to meet this need. Through a description of the framework's nine iterative steps and a presentation of three case studies, this paper posits that the ITF can support researchers and practitioners in understanding and applying aesthetic experiences and the arts to advance health, well-being, and learning.

Protocol for a process evaluation of SCALA study - Intervention targeting scaling up of primary health care-based prevention and management of heavy drinking and comorbid depression in Latin America

This paper describes the plan for a process evaluation of a quasi-experimental study testing the municipal level scale-up of primary health care-based measurement and brief advice programmes to reduce heavy drinking and comorbid depression in Colombia, Mexico, and Peru. The main aims of the evaluation are to assess the implementation of intervention components; mechanisms of impact that influenced the outcomes; and characteristics of the context that influenced implementation and outcomes. Based on this information, common drivers of successful outcomes will be identified. A range of data collection methods will be used: questionnaires; interviews; observations; logbooks; and document analysis. All participating providers will complete a pen-and-paper questionnaire at recruitment and two time points during the implementation period. Providers attending training will complete post-training questionnaires. Additionally, 1080 patients will be invited to self-complete a patient questionnaire. One-in-ten participating providers and fifteen other key stakeholders will participate in semi-structured interviews. Training sessions and community advisory board meetings will be observed by a neutral observer. Logbooks will be kept by local research teams to document events affecting the implementation. Project related documentation and other relevant reports describing the context will be examined.

Bridging HCI and Implementation Science for Innovation Adoption and Public Health Impact

Human computer interaction (HCI) and implementation science (IS) each have been applied to improve the adoption and delivery of innovative health interventions, and the two fields have complementary goals, foci, and methods. While the IS community increasingly draws on methods from HCI, there are many unrealized opportunities for HCI to draw from IS and to catalyze bidirectional collaborations. This workshop will explore similarities and differences between fields, with a goal of articulating a research agenda at their intersection.

Climate for evidence-based mental health care implementation in Germany: psychometric investigation of the Implementation Climate Scale (ICS)

Organizational implementation climate is an important construct in implementation research to describe to what extent implementation is expected, supported, and rewarded. Efforts in bridging the research-practice gap by implementing evidence-based practice (EBP) can benefit from consideration of implementation climate. The Implementation Climate Scale (ICS) is a psychometrically strong measure assessing employees' perceptions of the implementation climate. The present cross-sectional study aimed at providing a German translation and investigating its psychometric properties. The translation followed standard procedures for adapting psychometric instruments. German psychotherapists (N = 425) recruited online completed the ICS, the Evidence Based Practice Attitudes Scale (EBPAS-36D) and the Intention Scale for Providers (ISP). We conducted standard item and reliability analyses. Factorial validity was assessed by comparing an independent cluster model of Confirmatory Factorial Analysis (ICM-CFA), a Bifactor CFA, a Second-order CFA and an (Bifactor) Exploratory Structural Equation Model (ESEM). Measurement invariance was tested using multiple-group CFA and ESEM, convergent validity with correlation analysis between the ICS and the ISP subjective norms subscale (ISP-D-SN). The mean item difficulty was pi = .47, mean inter-item correlation r = .34, and mean item-total correlation ritc = .55. The total scale (ω = 0.91) and the subscales (ω = .79-.92) showed acceptable to high internal consistencies. The model fit indices were comparable and acceptable (Second-order CFA: RMSEA [90% CI] = .077 [.069; .085], SRMR = .078, CFI = .93). Multiple-group CFA and ESEM indicated scalar measurement invariance across gender and presence of a psychotherapy license. Psychotherapists in training reported higher educational support for EBP than licensed psychotherapists (T = 2.09, p = .037, d = 0.25). The expected high correlation between the ICS and the ISP-D-SN was found (r = .59, p < .001). Results for the German ICS confirm good psychometric properties including validity.

Qualitative evaluation of the implementation of “Tuning in to Kids” in Norwegian Kindergartens

Background

From January to June 2020, 22 FUS kindergartens across Norway implemented Tuning in to Kids for Kindergarten Teachers (TIK-KT) as part of a randomized control trial (RCT). Between the evaluation of an intervention and use of it in daily practice, a research-to-practice gap can often occur. The theory of planned behavior constituted the theoretical basis for the qualitative interviews that were administered to explore these gaps. This study aimed to explore motivation among kindergarten staff regarding the implementation of TIK-KT.

Methods

Participants from the FUS kindergartens RCT were part of the current study. A stepwise deductive inductive strategy was used in the thematic content analysis. The data were from eleven semi-structured telephone interviews with kindergarten leaders and teachers. Codes from interviews before and after implementation were grouped based on thematic connections, and code groups were further combined into themes. The Consolidated criteria for reporting qualitative research were used as a reporting standard.

Results

The interviews resulted in four main themes: (1) understanding the rationale of implementation, (2) "aha"-experiences, (3) the research-to-practice gap and (4) the main motivation. Kindergarten leaders and teachers expressed positive attitudes toward the intervention ideas and motivation to practice emotion coaching skills and toward implementing TIK-KT both before and after implementation.

Conclusion

Kindergarten leaders’ and teachers’ motivation for implementation came from having a good understanding of the ideas of Tuning in to Kids for Kindergarten Teachers (TIK-KT), experiencing moments of “aha” regarding the intervention, not being held back by practical issues, and working toward their ultimate goal, the wellbeing of the children. These findings have implications for future implementation of TIK-KT and other mental health-promoting interventions and guide further areas of research to examine implementation mechanisms.

Trial registration: The study was registered with the Clinical Trials Registry (NCT03985124), June 13th, 2019.

A sequential, multiple assignment randomized trial comparing web-based education to mobile video interpreter access for improving provider interpreter use in primary care clinics: the mVOCAL hybrid type 3 study protocol

BACKGROUND

Individuals who use a language other than English for medical care are at risk for disparities related to healthcare safety, patient-centered care, and quality. Professional interpreter use decreases these disparities but remains underutilized, despite widespread access and legal mandates. In this study, we compare two discrete implementation strategies for improving interpreter use: (1) enhanced education targeting intrapersonal barriers to use delivered in a scalable format (interactive web-based educational modules) and (2) a strategy targeting system barriers to use in which mobile video interpreting is enabled on providers' own mobile devices.

METHODS

We will conduct a type 3 hybrid implementation-effectiveness study in 3-5 primary care organizations, using a sequential multiple assignment randomized trial (SMART) design. Our primary implementation outcome is interpreter use, calculated by matching clinic visits to interpreter invoices. Our secondary effectiveness outcome is patient comprehension, determined by comparing patient-reported to provider-documented visit diagnosis. Enrolled providers (n = 55) will be randomized to mobile video interpreting or educational modules, plus standard interpreter access. After 9 months, providers with high interpreter use will continue as assigned; those with lower use will be randomized to continue as before or add the alternative strategy. After another 9 months, both strategies will be available to enrolled providers for 9 more months. Providers will complete 2 surveys (beginning and end) and 3 in-depth interviews (beginning, middle, and end) to understand barriers to interpreter use, based on the Theoretical Domains Framework. Patients who use a language other than English will be surveyed (n = 648) and interviewed (n = 75) following visits with enrolled providers to understand their experiences with communication. Visits will be video recorded (n = 100) to assess fidelity to assigned strategies. We will explore strategy mechanism activation to refine causal pathway models using a quantitative plus qualitative approach. We will also determine the incremental cost-effectiveness of each implementation strategy from a healthcare organization perspective, using administrative and provider survey data.

DISCUSSION

Determining how these two scalable strategies, alone and in sequence, perform for improving interpreter use, the mechanisms by which they do so, and at what cost, will provide critical insights for addressing a persistent cause of healthcare disparities.

TRIAL REGISTRATION

NCT05591586.

Theorizing is for everybody: Advancing the process of theorizing in implementation science

There has been a call to shift from treating theories as static products to engaging in a process of theorizing that develops, modifies, and advances implementation theory through the accumulation of knowledge. Stimulating theoretical advances is necessary to improve our understanding of the causal processes that influence implementation and to enhance the value of existing theory. We argue that a primary reason that existing theory has lacked iteration and evolution is that the process for theorizing is obscure and daunting. We present recommendations for advancing the process of theorizing in implementation science to draw more people in the process of developing and advancing theory.