The Impact of Teachers' Modifications of an Evidenced-Based HIV Prevention Intervention on Program Outcomes

Maintaining Program Fidelity in a Changing World: National Implementation of a School-Based HIV Prevention Program

Large-scale, evidence-based interventions face challenges to program fidelity of implementation. We developed implementation strategies to support teachers implementing an evidence-based HIV prevention program in schools, Focus on Youth in The Caribbean (FOYC) and Caribbean Informed Parents and Children Together (CImPACT) in The Bahamas. We examined the effects of these implementation strategies on teachers' implementation in the subsequent year after the initial implementation during the COVID-19 pandemic. Data were collected from 79 Grade 6 teachers in 24 government elementary schools. Teachers completed training workshops and a pre-implementation questionnaire to record their characteristics and perceptions that might affect their program fidelity. School coordinators and peer mentors provided teachers with monitoring, feedback, and mentoring. In Year 1, teachers on average taught 79.3% of the sessions and 80.8% of core activities; teachers in Year 2 covered 84.2% of sessions and 72.9% of the core activities. Teachers with "good" or "excellent" school coordinators in the second year taught significantly more sessions on average (7.8 vs. 7.0, t = 2.04, P < 0.05) and more core activities (26.3 vs. 23.0, t = 2.41, P < 0.05) than teachers with "satisfactory" coordinators. Teachers who had a "good" or "satisfactory" mentor taught more sessions than teachers who did not have a mentor (7.9 vs. 7.3; t = 2.22; P = 0.03). Two-level mixed-effects model analysis indicated that teachers' program fidelity in Year 1, confidence in the execution of core activities, and school coordinators' performance were significantly associated with Year 2 implementation dose. Implementation of FOYC + CImPACT was significantly associated with improved student outcomes. Teachers maintained high fidelity to a comprehensive HIV prevention program over 2 years during the COVID-19 pandemic. Future program implementers should consider additional implementation support to improve the implementation of school-based programs.

Comparing standard versus enhanced implementation of an evidence-based HIV prevention program among Bahamian sixth grade students: findings from nationwide implementation trials

BACKGROUND

Effective implementation strategies are needed to address the challenges encountered by teachers in implementation of evidence-based HV prevention programs in schools. The current study: 1) compares implementation fidelity of Focus on Youth in the Caribbean (FOYC) plus Caribbean Informed Parents and Children Together (CImPACT) intervention using enhanced implementation strategies (including biweekly monitoring/feedback and site-based mentoring) to those using more traditional approach (teacher training only); and 2) evaluates the impact of school coordinators' and mentors' performance on teachers' implementation fidelity and student outcomes.

METHODS

Data from an enhanced implementation trial in 2019-2020, involving 24 government primary schools, 79 teachers, and 2252 students, were compared to data from a standard implementation trial in 2011-2012, involving 35 government primary schools, 110 teachers and 2811 students using mixed-effects modeling and structural equation modeling.

FINDINGS

Teachers in the 2019-2020 trial taught more core activities (28.3 vs. 16.3, t = 10.80, P < 0.001) and sessions (7.2 vs. 4.4, t = 9.14, P < 0.001) than those participating in the 2011-2012 trial. Teachers taught > 80% of the intervention curriculum in 2019-2020 compared to 50% curriculum delivery in 2011-2012. Teachers who had a "very good" or "excellent" school coordinator in their schools taught more core activities than those who had a "satisfactory" school coordinator (30.4 vs. 29.6 vs. 22.3, F = 18.54, P < 0.001). Teachers who worked in a school which had a "very good" mentor, taught more core activities than those teachers who did not have a mentor or had only a "satisfactory" mentor (30.4 vs. 27.6; t = 2.96; p = 0.004). Teachers' confidence in implementing core activities, comfort level with the curriculum, attitudes towards sex education in schools, and perceived principal support were significantly related to increased self-efficacy, which in turn was related to teachers' implementation fidelity. The degree of implementation was significantly associated with improved student outcomes.

IMPLICATIONS/CONCLUSION

An evidence-based HIV prevention intervention can achieve a high degree of implementation when delivered with enhanced implementation strategies and implementation monitoring. Future program implementers should consider the purposeful selection and training of school coordinators and mentors to support low-implementing teachers as a potentially important strategy when attempting to achieve high-quality implementation of school-based interventions.

Implementation practice models for development in low- and middle-income countries: systematic review of peer-reviewed literature

Introduction

This study operationally defines a relatively small, but growing field of study on implementation practice models for health behavior change in the context of international development. We define ‘implementation practice models’ as theoretical models that take a practical and practitioner-focused approach to behavior change, and we illustrate how these models have been developed and applied. The paper examines the continuum of behavioral theories and their application in the context of development programs and research in low- and middle-income countries (LMICs). We describe implementation practice models, examine how they have been used to design and evaluate theory-based interventions in LMIC, and describe the state of evidence in this field of study.

Methods

The authors conducted a systematic search of the published, peer-reviewed literature following the widely accepted PRISMA methods for systematic reviews. We aimed to identify all relevant manuscripts published in the English language in health, social science, and business literature that apply implementation practice models, located in an LMIC, with a behavior change objective. We located 1,078 articles through database searching and 106 through other means. Ultimately, we identified 25 relevant articles for inclusion.

Results

We found that the peer-reviewed literature on implementation practice models for development has been growing in recent years, with 80% of reviewed papers published since 2015. There was a wide range of different models revealed by this review but none demonstrated clear-cut evidence of being most effective. However, the models found in this review share common characteristics of focusing on the three central tenets of Opportunity, Ability, and Motivation (OAM).

Conclusions

This review found that implementation practice models for development are a promising and growing approach to behavior change in LMICs. Intervention practice models research should be expanded and applied in new domains, such as vaccination.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13530-0.

An analysis of adaptations to multi-level intervention strategies to enhance implementation of clinical practice guidelines for treating tobacco use in dental care settings

Introduction

Our team conducted a cluster randomized controlled trial (DUET) that compared the effectiveness of three theory-driven, implementation strategies on dental provider adherence to tobacco dependence treatment guidelines (TDT). In this paper we describe the process of adapting the implementation strategies to the local context of participating dental public health clinics in New York City.

Methods

Eighteen dental clinics were randomized to one of three study arms testing several implementation strategies: Current Best Practices (CBP) (i.e. staff training, clinical reminder system and Quitline referral system); CBP + Performance Feedback (PF) (i.e. feedback reports on provider delivery of TDT); and CBP + PF + Pay-for-Performance (i.e. financial incentives for provision of TDT). Through an iterative process, we used Stirman's modification framework to classify, code and analyze modifications made to the implementation strategies.

Results

We identified examples of six of Stirman's twelve content modification categories and two of the four context modification categories. Content modifications were classified as: tailoring, tweaking or refining (49.8%), adding elements (14.1%), departing from the intervention (9.3%), loosening structure (4.4%), lengthening and extending (4.4%) and substituting elements (4.4%). Context modifications were classified as those related to personnel (7.9%) and to the format/channel (8.8%) of the intervention delivery. Common factors associated with adaptations that arose during the intervention included staff changes, time constraints, changes in leadership preferences and functional limitations of to the Electronic Dental Record.

Conclusions

This study offers guidance on how to capture intervention adaptation in the context of a multi-level intervention aimed at implementing sustainable changes to optimize TDT in varying public health dental settings.