Intensification of Implementation Strategies: Developing a Model of Foundational and Enhanced Implementation Approaches to Support National Adoption and Scale-up

Developing a new pragmatic tool for assessing contextual fit and feasibility of evidence-based interventions towards effective implementation in global health

INTRODUCTION

Understanding the contextual fit and feasibility of evidence-based interventions (EBIs) constitutes an important aspect of implementation research to inform policy decisions for their uptake and sustainability in any given context (eg, setting, sector and population). Yet current methodologies, which attempt to assess contextual fit and feasibility of EBI as key preimplementation outcomes using a reductionist approach with summative scores, fall short in capturing the multiple forms of interactions and influences of constructs and contextual factors associated with EBI implementation in a real-world situation.

METHODS

Between 18 February 2023 and 5 August 2023, we designed a novel tool through an ongoing collaborative effort of researchers, global health practitioners, policy makers and populations from low- and middle-income countries and high-income countries using a five-step sequential process. This process included step 1 (stakeholder envisioning), step 2 (evidence synthesis), step 3 (evidence deconstruction), step 4 (stakeholder consensus and conceptual framework development) and step 5 (tool development, deployment and standardisation).

RESULTS

Following this process, a pragmatic contextual fit and feasibility (PCoF) tool was developed with acceptability and preference derived as potentially stable constructs for contextual fit outcome and willingness to use and resource availability for feasibility outcome. The assessment of contextual fit and feasibility outcomes with strong, somewhat, and weak ratings was determined by a total of nine real-world scenarios of construct interactions in either case. Strong, somewhat and weak ratings of contextual fit or feasibility accounted for one, seven and one construct interaction(s), respectively.

CONCLUSION

This initial development of PCoF is a step in the right direction for addressing the complexity associated with EBI implementation that is in part posed by contextual factors and cannot be completely explained by summative scoring and arbitrary rating approaches of existing tools. The use of PCoF as a research and policy decision-support tool, once extensively refined, validated and standardised across multiple contexts, has the potential to generate robust evidence on the contextual fit and feasibility of EBI and to meaningfully support researchers, policy makers and other stakeholders in informing the prioritisation, adaptation and equity-focused uptake and scale-up of EBI for improved population health and social outcomes.

Development and Delivery of Enhanced Implementation Support to Disseminate a National Caregiver Skills Training Program

Background and Objectives

As the population ages there is an increasing need for caregiver training programs, but little is known about how to deliver implementation support for diverse sites in large-scale implementation efforts. External group-based implementation facilitation may be one promising approach. This study's objective is to detail the development and delivery of a pragmatic implementation facilitation approach to support the national rollout of caregiver training, Caregivers FIRST, at over 140 Veterans Health Administration (VHA) sites.

Research Design and Methods

Using administrative, survey, and project data, we describe the process of developing and delivering enhanced support to 13 VHA sites unable to meet adoption benchmarks as part of a national mandate. Enhanced support consisted of 4 group-based calls delivered within a 12-week period that used tailored external facilitation to address barriers, facilitators, and strategies for program implementation. We present key implementation barriers, implementation strategies, and sites' perceptions of highly valued elements of enhanced support.

Results

Enhanced support calls focused on 3 implementation barriers commonly identified by implementing staff (n = 25) in a site-level needs assessment survey: recruiting and retaining caregivers (83%), balancing program delivery alongside competing demands (57%), and support from other departments in program delivery (44%). Sites attended a median of 3 out of 4 enhanced support calls. In postimplementation quantitative surveys, the average response of perceived helpfulness of enhanced support (ranging from 1 to 5) was 3.4 at 6 months, increasing to 4.2 at 12 months. Respondents valued collaborative problem-solving and the ability to learn best practices from other implementing sites during enhanced support calls.

Discussion and Implications

Describing the process of developing and delivering enhanced support via group-based external facilitation for Caregivers FIRST in VHA may provide useful information to guide similar efforts in other healthcare systems as they broadly disseminate interventions to support caregivers across diverse sites.

Clinical Trial Registration

NCT05319535.

Adaptations and early adoption of a family caregiver intervention in the Veterans Affairs Health Care System: A multimethod pragmatic approach for national scaling

OBJECTIVE

To examine the relationship between site-level adaptation and early adoption of Caregivers Finding Important Resources, Support, and Training (FIRST) training during national implementation across diverse Veteran Health Administration (VA) medical centers.

DATA SOURCES AND STUDY SETTING

We enrolled and evaluated 25 VA medical centers (VAMCs). Along with administrative data on site characteristics, we examined site-reported data on adaptations and intervention adoption, defined as ≥4 training classes delivered to ≥5 caregivers at 6 months from April through October 2022.

STUDY DESIGN

A type III hybrid implementation-effectiveness cluster randomized controlled trial, randomized VAMCs 1:1 to receive foundational (low-touch) implementation support (n = 12) or the addition of enhanced (high-touch) implementation support (n = 13).

DATA COLLECTION/EXTRACTION METHODS

At key implementation phases, VAMCs were asked to report adaptations including content, contextual modifications (format, setting, personnel, and population), and training of providers. We describe site-level adaptations by arm and by organizational characteristics that included VAMC complexity level, staffing, rurality, and organizational readiness to change. We used qualitative comparative analysis to identify unique adaptations that contributed to intervention adoption at 6 months.

PRINCIPAL FINDINGS

VAMCs randomized to receive enhanced support reported slightly more adaptations than those randomized to foundational support. At 6 months, VAMCs with two or more adaptations adopted Caregivers FIRST at a higher rate than those with fewer adaptations (90% vs. 44%). Staffing adaptations (e.g., who delivered the intervention), format and content (e.g., modified delivery pace), and referring provider training were unique adaptations to adopting sites.

CONCLUSIONS

Site-level adaptations were diverse and occurred more frequently in sites with early adoption of Caregivers FIRST. Future research should identify best practices of supporting and monitoring intervention adaptation. Understanding the role of adaptation in early adoption success could assist other healthcare systems in implementing interventions for caregivers.

The business case for hospital mobility programs in the veterans health care system: Results from multi-hospital implementation of the STRIDE program

OBJECTIVE

To conduct a business case analysis for Department of Veterans Affairs (VA) program STRIDE (ASsisTed EaRly MobIlization for hospitalizeD older VEterans), which was designed to address immobility for hospitalized older adults.

DATA SOURCES AND STUDY SETTING

This was a secondary analysis of primary data from a VA 8-hospital implementation trial conducted by the Function and Independence Quality Enhancement Research Initiative (QUERI). In partnership with VA operational partners, we estimated resources needed for program delivery in and out of the VA as well as national implementation facilitation in the VA. A scenario analysis using wage data from the Bureau of Labor Statistics informs implementation decisions outside the VA.

STUDY DESIGN

This budget impact analysis compared delivery and implementation costs for two implementation strategies (Replicating Effective Programs [REP]+CONNECT and REP-only). To simulate national budget scenarios for implementation, we estimated the number of eligible hospitalizations nationally and varied key parameters (e.g., enrollment rates) to evaluate the impact of uncertainty.

DATA COLLECTION

Personnel time and implementation outcomes were collected from hospitals (2017-2019). Hospital average daily census and wage data were estimated as of 2022 to improve relevance to future implementation.

PRINCIPAL FINDINGS

Average implementation costs were $9450 for REP+CONNECT and $5622 for REP-only; average program delivery costs were less than $30 per participant in both VA and non-VA hospital settings. Number of walks had the most impact on delivery costs and ranged from 1 to 5 walks per participant. In sensitivity analyses, cost increased to $35 per participant if a physical therapist assistant conducts the walks. Among study hospitals, mean enrollment rates were higher among the REP+CONNECT hospitals (12%) than the REP-only hospitals (4%) and VA implementation costs ranged from $66 to $100 per enrolled.

CONCLUSIONS

STRIDE is a low-cost intervention, and program participation has the biggest impact on the resources needed for delivering STRIDE.

TRIAL REGISTRATION

ClinicalsTrials.gov NCT03300336. Prospectively registered on 3 October 2017.

Implementation outcomes from a multi-site stepped wedge cluster randomized family caregiver skills training trial

OBJECTIVE

To assess whether a team collaboration strategy (CONNECT) improves implementation outcomes of a family caregiver skills training program (iHI-FIVES).

DATA SOURCES AND STUDY SETTING

iHI-FIVES was delivered to caregivers at eight Veterans Affairs (VA) medical centers. Data sources were electronic health records, staff surveys, and interviews.

STUDY DESIGN

In a stepped wedge cluster randomized trial, sites were randomized to a 6-month time interval start date for iHI-FIVES launch. Sites were then randomized 1:1 to either (i) CONNECT, a team collaboration training strategy plus Replicating Effective Programs (REP), brief technical support training for staff, or (ii) REP only (non-CONNECT arm). Implementation outcomes included reach (proportion of eligible caregivers enrolled) and fidelity (proportion of expected trainings delivered). Staff interviews and surveys assessed team function including communication, implementation experience, and their relation to CONNECT and iHI-FIVES implementation outcomes.

DATA COLLECTION/EXTRACTION METHODS

The sample for assessing implementation outcomes included 571 Veterans referred to VA home- and community-based services and their family caregivers eligible for iHI-FIVES. Prior to iHI-FIVES launch, staff completed 65 surveys and 62 interviews. After the start of iHI-FIVES, staff completed 52 surveys and 38 interviews. Mixed methods evaluated reach and fidelity by arm.

PRINCIPAL FINDINGS

Fidelity was high overall with 88% of expected iHI-FIVES trainings delivered, and higher among REP only (non-CONNECT) compared with CONNECT sites (95% vs. 80%). Reach was 18% (average proportion of reach across eight sites) and higher among non-CONNECT compared with CONNECT sites (22% vs. 14%). Qualitative interviews revealed strong leadership support at high-reach sites. CONNECT did not influence self-reported team function.

CONCLUSIONS

A team collaboration strategy (CONNECT), added to REP, required more resources to implement iHI-FIVES than REP only and did not substantially enhance reach or fidelity. Leadership support was a key condition of implementation success and may be an important factor for improving iHI-FIVES reach with national expansion.

Enhancing team communication to improve implementation of a supervised walking program for hospitalized veterans: Evidence from a multi-site trial in the Veterans Health Administration

INTRODUCTION

The timely translation of evidence-based programs into real-world clinical settings is a persistent challenge due to complexities related to organizational context and team function, particularly in inpatient settings. Strategies are needed to promote quality improvement efforts and implementation of new clinical programs.

OBJECTIVE

This study examines the role of CONNECT, a complexity science-based implementation intervention to promote team readiness, for enhancing implementation of the 'Assisted Early Mobility for Hospitalized Older Veterans' program (STRIDE), an inpatient, supervised walking program.

DESIGN

We conducted a stepped-wedge cluster randomized trial using a convergent mixed-methods design. Within each randomly assigned stepped-wedge sequence, Veterans Affairs Medical Centers (VAMCs) were randomized to receive standardized implementation support only or additional training via the CONNECT intervention. Data for the study were obtained from hospital administrative and electronic health records, surveys, and semi-structured interviews with clinicians before and after implementation of STRIDE.

SETTING

Eight U.S. VAMCs.

PARTICIPANTS

Three hundred fifty-three survey participants before STRIDE implementation and 294 surveys after STRIDE implementation. Ninety-two interview participants.

INTERVENTION

CONNECT, a complexity-science-based intervention to improve team function.

MAIN OUTCOME MEASURES

The implementation outcomes included STRIDE reach and fidelity. Secondary outcomes included validated measures of team function (i.e., team communication, coordination, role clarity).

RESULTS

At four VAMCs randomized to CONNECT, reach was higher (mean 12.4% vs. 3.8%), and fidelity was similar to four non-CONNECT VAMCs. VAMC STRIDE delivery teams receiving CONNECT reported improvements in team function domains, similar to non-CONNECT VAMCs. Qualitative findings highlight CONNECT's impact and the influence of team characteristics and contextual factors, including team cohesion, leadership support, and role clarity, on reach and fidelity.

CONCLUSION

CONNECT may promote greater reach of STRIDE, but improvement in team function among CONNECT VAMCs was similar to improvement among non-CONNECT VAMCs. Qualitative findings suggest that CONNECT may improve team function and implementation outcomes but may not be sufficient to overcome structural barriers related to implementation capacity.

Building a Program Theory of Implementation Using Process Evaluation of a Complex Quality Improvement Trial in Nursing Homes

BACKGROUND AND OBJECTIVES

Significant quality problems exist in long-term care (LTC). Interventions to improve care are complex and often have limited success. Implementation remains a black box. We developed a program theory explaining how implementation of a complex intervention occurs in LTC settings-examining mechanisms of impact, effects of context on implementation, and implementation outcomes such as fidelity.

RESEARCH DESIGN AND METHODS

Concurrent process evaluation of Safer Care for Older Persons in residential Environments (SCOPE)-a frontline worker (care aide) led improvement trial in 31 Canadian LTC homes. Using a mixed-methods exploratory sequential design, qualitative data were analyzed using grounded theory to develop a conceptual model illustrating how teams implemented the intervention and how it produced change. Quantitative analyses (mixed-effects regression) tested aspects of the program theory.

RESULTS

Implementation fidelity was moderate. Implementation is facilitated by (a) care aide engagement with core intervention components; (b) supportive leadership (internal facilitation) to create positive team dynamics and help negotiate competing workplace priorities; (c) shifts in care aide role perceptions and power differentials. Mixed-effects model results suggest intervention acceptability, perceived intervention benefits, and leadership support predict implementation fidelity. When leadership support is high, fidelity is high regardless of intervention acceptability or perceived benefits.

DISCUSSION AND IMPLICATIONS

Our program theory addresses important knowledge gaps regarding implementation of complex interventions in nursing homes. Results can guide scaling of complex interventions and future research.

Group physical therapy for knee osteoarthritis: protocol for a hybrid type III effectiveness-implementation trial

BACKGROUND

Knee osteoarthritis (OA) is a leading cause of chronic pain and disability and one of the most common conditions treated in outpatient physical therapy (PT). Because of the high and growing prevalence of knee OA, there is a need for efficient approaches for delivering exercise-based PT to patients with knee OA. A prior randomized controlled trial (RCT) showed that a 6-session Group Physical Therapy Program for Knee OA (Group PT) yields equivalent or greater improvements in pain and functional outcomes compared with traditional individual PT, while requiring fewer clinician hours per patient to deliver. This manuscript describes the protocol for a hybrid type III effectiveness-implementation trial comparing two implementation packages to support delivery of Group PT.

METHODS

In this 12-month embedded trial, a minimum of 16 Veterans Affairs Medical Centers (VAMCs) will be randomized to receive one of two implementation support packages for their Group PT programs: a standard, low-touch support based on Replicating Effective Programs (REP) versus enhanced REP (enREP), which adds tailored, high-touch support if sites do not meet Group PT adoption and sustainment benchmarks at 6 and 9 months following launch. Implementation outcomes, including penetration (primary), adoption, and fidelity, will be assessed at 6 and 12 months (primary assessment time point). Additional analyses will include patient-level effectiveness outcomes (pain, function, satisfaction) and staffing and labor costs. A robust qualitative evaluation of site implementation context and experience, as well as site-led adaptations to the Group PT program, will be conducted.

DISCUSSION

To our knowledge, this study is the first to evaluate the impact of tailored, high-touch implementation support on implementation outcomes when compared to standardized, low-touch support for delivering a PT-based intervention. The Group PT program has strong potential to become a standard offering for PT, improving function and pain-related outcomes for patients with knee OA. Results will provide information regarding the effectiveness and value of this implementation approach and a deeper understanding of how healthcare systems can support wide-scale adoption of Group PT.

TRIAL REGISTRATION

This study was registered on March 7, 2022 at ClinicalTrials.gov (identifier NCT05282927 ).

Implementation intensification to disseminate a skills-based caregiver training program: protocol for a type III effectiveness-implementation hybrid trial

BACKGROUND

Family caregiver training decreases caregiver psychological burden and improves caregiver depressive symptoms and health-related quality of life. Caregivers FIRST is an evidence-based group skills training curriculum for family caregivers and was announced for national dissemination in partnership with the Veterans Health Administration (VHA) National Caregiver Support Program (CSP). Previous evaluations of Caregivers FIRST implementation highlighted that varying support was needed to successfully implement the program, ranging from minimal technical assistance to intensive assistance and support. However, we do not know the optimal level of support needed to inform cost-effective national scaling of the program. We describe a protocol for randomizing 24 non-adopting VA medical centers 1:1 to a tailored, high-touch implementation support or a standard, low-touch implementation support to test the primary hypothesis that high-touch support increases Caregivers FIRST penetration, fidelity, and adoption. Additionally, we describe the methods for evaluating the effect of Caregivers FIRST participation on Veteran outcomes using a quasi-experimental design and the methods for a business case analysis to examine cost of delivery differences among sites assigned to a low or high-touch implementation support.

METHODS

We use a type III hybrid implementation-effectiveness study design enrolling VA medical centers that do not meet Caregivers FIRST adoption benchmarks following the announcement of the program as mandated within the CSP. Eligible medical centers will be randomized to receive a standard low-touch implementation support based on Replicating Effective Programs (REP) only or to an enhanced REP (high-touch) implementation support consisting of facilitation and tailored technical assistance. Implementation outcomes include penetration (primary), fidelity, and adoption at 12 months. Mixed methods will explore sites' perceptions and experiences of the high-touch intensification strategy. Additional analyses will include a patient-level effectiveness outcome (Veteran days at home and not in an institution) and a business case analysis using staffing and labor cost data.

DISCUSSION

This pragmatic trial will lead to the development and refinement of implementation tools to support VA in spreading and sustaining Caregivers FIRST in the most efficient means possible.

TRIAL REGISTRATION

This study was registered on April 8, 2022, at ClinicalTrials.gov (identifier NCT05319535).

Effects of Implementation of a Supervised Walking Program in Veterans Affairs Hospitals : A Stepped-Wedge, Cluster Randomized Trial

BACKGROUND

In trials, hospital walking programs have been shown to improve functional ability after discharge, but little evidence exists about their effectiveness under routine practice conditions.

OBJECTIVE

To evaluate the effect of implementation of a supervised walking program known as STRIDE (AssiSTed EaRly MobIlity for HospitalizeD VEterans) on discharge to a skilled-nursing facility (SNF), length of stay (LOS), and inpatient falls.

DESIGN

Stepped-wedge, cluster randomized trial. (ClinicalTrials.gov: NCT03300336).

SETTING

8 Veterans Affairs hospitals from 20 August 2017 to 19 August 2019.

PATIENTS

Analyses included hospitalizations involving patients aged 60 years or older who were community dwelling and admitted for 2 or more days to a participating medicine ward.

INTERVENTION

Hospitals were randomly assigned in 2 stratified blocks to a launch date for STRIDE. All hospitals received implementation support according to the Replicating Effective Programs framework.

MEASUREMENTS

The prespecified primary outcomes were discharge to a SNF and hospital LOS, and having 1 or more inpatient falls was exploratory. Generalized linear mixed models were fit to account for clustering of patients within hospitals and included patient-level covariates.

RESULTS

Patients in pre-STRIDE time periods (n = 6722) were similar to post-STRIDE time periods (n = 6141). The proportion of patients with any documented walk during a potentially eligible hospitalization ranged from 0.6% to 22.7% per hospital. The estimated rates of discharge to a SNF were 13% pre-STRIDE and 8% post-STRIDE. In adjusted models, odds of discharge to a SNF were lower among eligible patients hospitalized in post-STRIDE time periods (odds ratio [OR], 0.6 [95% CI, 0.5 to 0.8]) compared with pre-STRIDE. Findings were robust to sensitivity analyses. There were no differences in LOS (rate ratio, 1.0 [CI, 0.9 to 1.1]) or having an inpatient fall (OR, 0.8 [CI, 0.5 to 1.1]).

LIMITATION

Direct program reach was low.

CONCLUSION

Although the reach was limited and variable, hospitalizations occurring during the STRIDE hospital walking program implementation period had lower odds of discharge to a SNF, with no change in hospital LOS or inpatient falls.

PRIMARY FUNDING SOURCE

U.S. Department of Veterans Affairs Quality Enhancement Research Initiative (Optimizing Function and Independence QUERI).