Identifying existing approaches used to evaluate the sustainability of evidence-based interventions in healthcare: an integrative review

Knowledge translation strategies to support the sustainability of evidence-based interventions in healthcare: a scoping review

BACKGROUND

Knowledge translation (KT) strategies are widely used to facilitate the implementation of EBIs into healthcare practices. However, it is unknown what and how KT strategies are used to facilitate the sustainability of EBIs in institutional healthcare settings.

OBJECTIVES

This scoping review aimed to consolidate the current evidence on (i) what and how KT strategies are being used for the sustainability of EBIs in institutional healthcare settings; (ii) the reported KT strategy outcomes (e.g., acceptability) for EBI sustainability, and (iii) the reported EBI sustainability outcomes (e.g., EBI activities or component of the intervention continue).

METHODS

We conducted a scoping review of five electronic databases. We included studies describing the use of specific KT strategies to facilitate the sustainability of EBIs (more than 1-year post-implementation). We coded KT strategies using the clustered ERIC taxonomy and AIMD framework, we coded KT strategy outcomes using Tierney et al.'s measures, and EBI sustainability outcomes using Scheirer and Dearing's and Lennox's taxonomy. We conducted descriptive numerical summaries and a narrative synthesis to analyze the results.

RESULTS

The search identified 3776 studies for review. Following the screening, 25 studies (reported in 27 papers due to two companion reports) met the final inclusion criteria. Most studies used multi-component KT strategies for EBI sustainability (n = 24). The most common ERIC KT strategy clusters were to train and educate stakeholders (n = 38) and develop stakeholder interrelationships (n = 34). Education was the most widely used KT strategy (n = 17). Many studies (n = 11) did not clearly report whether they used different or the same KT strategies between EBI implementation and sustainability. Seven studies adapted KT strategies from implementation to sustainability efforts. Only two studies reported using a new KT strategy for EBI sustainability. The most reported KT strategy outcomes were acceptability (n = 10), sustainability (n = 5); and adoption (n = 4). The most commonly measured EBI sustainability outcome was the continuation of EBI activities or components (n = 23), followed by continued benefits for patients, staff, and stakeholders (n = 22).

CONCLUSIONS

Our review provides insight into a conceptual problem where initial EBI implementation and sustainability are considered as two discrete time periods. Our findings show we need to consider EBI implementation and sustainability as a continuum and design and select KT strategies with this in mind. Our review has emphasized areas that require further research (e.g., KT strategy adaptation for EBI sustainability). To advance understanding of how to employ KT strategies for EBI sustainability, we recommend clearly reporting the dose, frequency, adaptations, fidelity, and cost of KT strategies. Advancing our understanding in this area would facilitate better design, selection, tailored, and adapted use of KT strategies for EBI sustainability, thereby contributing to improved patient, provider, and health system outcomes.

The SITS framework: sustaining innovations in tertiary settings

Background

To date, little attention has focused on what the determinants are and how evidence-based practices (EBPs) are sustained in tertiary settings (i.e., acute care hospitals). Current literature reveals several frameworks designed for implementation of EBPs (0-2 years), yet fewer exist for the sustainment of EBPs (>2 years) in clinical practice. Frameworks containing both phases generally list few determinants for the sustained use phase, but rather state ongoing monitoring or evaluation is necessary. Notably, a recent review identified six constructs and related strategies that facilitate sustainment, however, the pairing of determinants and how best to sustain EBPs in tertiary settings over time remains unclear. The aim of this paper is to present an evidence-informed framework, which incorporates constructs, determinants, and knowledge translation interventions (KTIs) to guide implementation practitioners and researchers in the ongoing use of EBPs over time.

Methods

We combined the results of a systematic review and theory analysis of known sustainability frameworks/models/theories (F/M/Ts) with those from a case study using mixed methods that examined the ongoing use of an organization-wide pain EBP in a tertiary care center (hospital) in Canada. Data sources included peer-reviewed sustainability frameworks (n = 8) related to acute care, semi-structured interviews with nurses at the department (n = 3) and unit (n = 16) level, chart audits (n = 200), and document review (n = 29). We then compared unique framework components to the evolving literature and present main observations.

Results

We present the Sustaining Innovations in Tertiary Settings (SITS) framework which consists of 7 unique constructs, 49 determinants, and 29 related KTIs that influence the sustainability of EBPs in tertiary settings. Three determinants and 8 KTIs had a continuous influence during implementation and sustained use phases. Attention to the level of application and changing conditions over time affecting determinants is required for sustainment. Use of a participatory approach to engage users in designing remedial plans and linking KTIs to target behaviors that incrementally address low adherence rates promotes sustainability.

Conclusions

The SITS framework provides a novel resource to support future practice and research aimed at sustaining EBPs in tertiary settings and improving patient outcomes. Findings confirm the concept of sustainability is a "dynamic ongoing phase".

Developing a sustainability readiness strategy for health systems: Toolkit, interactive tools, and virtual support system

While the literature strongly supports the need for sustainability of evidence-based interventions (EBIs), we present a review of the literature that indicates only three articles discuss a health-focused sustainability strategy. The aims of our sustainability readiness strategy (SRS) are to increase infrastructure capacity and EBI advocacy to impact the level of sustainability readiness. In this article, we describe the development of an evidence-informed promising practice sustainability readiness strategy (SRS) with three evidence-based components. This strategy: 1) is based on an adaptation of the Getting To Outcomes® (GTO) evidence-based implementation process, 2) includes a logic model with documented evidence of the connection between targeted readiness factors and sustainability outcomes, and 3) describes resources considered necessary to support implementation of the readiness strategy, namely a step-by-step Toolkit, Excel™ Tools, webinar coaching and evaluation guides, and a coaching and evaluation training guide. The national SRS survey results are presented. Lessons learned and future dissemination and implementation plans are described.

"It's all about the money": an interpretive description of embedding physical therapy-led falls prevention group exercise in long-term care

BACKGROUND

Falls prevention interventions are effective for community dwelling older adults however, the same cannot be said for older adults living in long-term care (LTC). The Staying UpRight (SUp) randomized controlled trial was designed to test the effectiveness of a progressive strength and balance group exercise program delivered to LTC residents. This paper explores the factors impacting LTC providers' decisions to continue the program on completion of the funded trial period.

METHODS

A qualitative study using an Interpretive Description approach. Semi-structured interviews and focus groups were conducted with 15 LTC staff involved in the randomized controlled trial. Data were analysed using conventional content analysis.

RESULTS

Practice change occurred following participation in the trial with some facilities starting exercise groups, some increasing the number of exercise groups offered and physical therapists selecting elements of the program to adopt into their practice. Decisions about continuing with SUp as designed were constrained by organizational decisions regarding funding and resources. Three factors were identified which informed decision-making: business models and philosophies, requirements for evidence, and valuing physical therapy.

CONCLUSIONS

Managers and facilitators adapted SUp by selecting and delivering components of the program in response to the changes they had observed in participating residents. However, our findings highlight that while SUp was valued, the tight financial environment created by the current funding model in New Zealand did not support funding physical therapist delivered falls prevention exercise programs in LTC. This study may provide policy makers with important information on changes needed to support falls prevention service delivery in LTC.

TRIAL REGISTRATION

This study is a sub-study of a randomized controlled trial which was registered to the Australian New Zealand Clinical Trials Registry ACTRN12618001827224 on 09/11/2018. Universal trial number U1111-1217-7148.