Fidelity of implementation of an evidence-based HIV prevention program among Bahamian sixth grade students

Knowledge and uptake of contraceptive and other sexual reproductive health services among in-school adolescents in three South African townships: Baseline findings from the Girls Achieve Power (GAP Year) Trial

Background

South African adolescents experience barriers to sexual and reproductive health (SRH) knowledge and uptake. This study provides insight into contraceptive and other SRH service knowledge, perceptions, and uptake among adolescents in high HIV prevalence settings.

Methods

A baseline cross sectional survey was conducted among 3432 grade 8s enrolled into the Girls Achieve Power (GAP Year) trial from 26 public high schools across three South African townships (Soweto, Thembisa and Khayelitsha) (2017 - 2018). An interviewer-led survey collected information on SRH knowledge and perceptions; an audio computer-assisted self-interviewing technique gathered SRH service uptake. Descriptive analysis indicates frequency distribution of socio-demographics and knowledge, uptake and perceptions of SRH services. Chi-square test tested for associations between age and sex and selected variables that measure SRH knowledge and uptake.

Results

In total, 2383 participants completed both survey components. Of these, 63.1% (n=1504) were female and 81.4% (n=1938) aged 12-14. Almost a fifth (18.3%, n=436) had ever had sex and less than 1% had accessed SRH services in the last year. Of the 157 females who had ever had sex, 50.9% had ever used contraception. Of those who had sex in the last three months, 59.0% reported using a contraceptive method. Condom use was inconsistent: almost all females said they had not used or could not remember if a condom was used at last sex.

Conclusion

This paper contributes to the evidence strengthening learner SRH education, including the national Integrated School Health Programme. Key themes include the need for age-appropriate, differentiated comprehensive sexuality education (CSE) for the range of ages found in the same grade in South African schools. Education on different contraceptive methods, informed decision-making, and emergency contraception is key. School-based interventions should embrace integrated HIV, STI, and pregnancy prevention messages. Closer links with health services need to be constantly fostered and reinforced.

Effects of Teacher Training and Continued Support on the Delivery of an Evidence-Based HIV Prevention Program: Findings From a National Implementation Study in the Bahamas

BACKGROUND

Few studies have investigated the effects of teacher training and continued support on teachers' delivery of evidence-based HIV prevention programs. We examined these factors in a national implementation study of an evidence-based HIV risk reduction intervention for adolescents in the sixth grade in the Bahamas.

METHODS

Data were collected from 126 grade 6 teachers and 3,118 students in 58 government elementary schools in the Bahamas in 2019-2021. This is a Hybrid Type III implementation study guided by the Exploration, Preparation, Implementation, Sustainment (EPIS) model. Teachers attended 2-day training workshops. Trained school coordinators and peer mentors provided biweekly monitoring and mentorship. We used mixed-effects models to assess the effects of teacher training and continued support on implementation fidelity.

RESULTS

Teachers who received training in-person or both in-person and online taught the most core activities (27.0 and 27.2 of 35), versus only online training (21.9) and no training (14.9) (F = 15.27, p < .001). Teachers with an "excellent" or "very good" school coordinator taught more core activities than those with a "satisfactory" coordinator or no coordinator (29.2 vs. 27.8 vs. 19.3 vs. 14.8, F = 29.20, p < .001). Teachers with a "very good" mentor taught more core activities and sessions than those with a "satisfactory" mentor or no mentor (30.4 vs. 25.0 vs. 23.1; F = 7.20; p < .01). Teacher training, implementation monitoring, peer mentoring, teachers' self-efficacy, and school-level support were associated with implementation fidelity, which in turn was associated with improved student outcomes (HIV/AIDS knowledge, preventive reproductive health skills, self-efficacy, and intention to use protection).

CONCLUSION

Teachers receiving in-person training and those having higher-rated school coordinator and mentor support taught a larger number of HIV prevention core activities. Effective teacher training, implementation monitoring, and peer mentoring are critical for improving implementation fidelity and student outcomes.

Knowledge, uptake and patterns of contraception use among in-school adolescents in three South African townships: Baseline findings from the Girls Achieve Power (GAP Year) Trial

Background: South African adolescents experience barriers to sexual and reproductive health (SRH) knowledge and uptake. This study provides insight into contraceptive and other SRH service knowledge, perceptions, and uptake among adolescents in high HIV prevalence settings. Methods: A baseline cross sectional survey was conducted among 3432 grade 8’s enrolled into the Girls Achieve Power (GAP Year) trial from 26 public high schools across three South African townships (Soweto, Thembisa and Khayelitsha) (2017 - 2018). An interviewer-led survey collected information on SRH knowledge and perceptions; an audio computer-assisted self-interviewing technique gathered SRH service uptake. Descriptive analysis indicates frequency distribution of socio-demographics and knowledge, uptake and perceptions of SRH services. Chi-square test tested for associations between age and sex and selected variables that measure SRH knowledge and uptake. Results: In total, 2383 learners, completed both survey components. Of these, 63.1% (n=1504) were female and 81.4% (n=1938) aged 12-14. Almost a fifth (18.3%, n=436) had ever had sex and less than 1% had accessed SRH services in the last year. Of the 157 females who had ever had sex, 50.9% had ever used contraception. Of those who had sex in the last three months, 59.0% reported using a contraceptive method. Condom use was inconsistent: almost all females said they had not used or could not remember if a condom was used at last sex. Conclusion: This paper contributes to the evidence strengthening learner SRH education, including the national Integrated School Health Programme. Key themes include the need for age-appropriate, differentiated comprehensive sexuality education (CSE) for the range of ages found in the same grade in South African schools. Education on different contraceptive methods, informed decision-making, and emergency contraception is key. School-based interventions should embrace integrated HIV, STI, and pregnancy prevention messages. Closer links with health services need to be constantly fostered and reinforced.

Impact evaluation of scripted lesson plans for HIV-related content in a life orientation curriculum: results from two provinces in South Africa

BACKGROUND

Young people under age 25 years are a key population at risk of unintended pregnancies, HIV and other sexually transmitted infections. School-based programming, focusing on youth under 17 years is strategic given that many in this age group are in school or are required to be in school and spend a considerable amount of their time at school. Prior evaluations of school-based HIV prevention programs for young people often employed weak study designs or lacked biomarkers (e.g., HIV or STI testing) to inform outcomes.

METHODS

This study used longitudinal data collected in 2016 from a cohort of grade-8 girls from Mpumalanga and KwaZulu-Natal Provinces in South Africa. We followed them for 2 years to examine the impact of the South African Department of Basic Education's revised scripted lesson plans for the HIV and sexual content of a "life orientation" curriculum on knowledge, attitudes, condom use behaviors, pregnancy incidence, and genital herpes incidence. Schools were randomized to intervention and control arms. Multivariable analyses were undertaken using hazard modeling for incidence-based outcomes (genital herpes and pregnancy) and generalized linear latent and mixed modeling for outcomes measured at each time period (knowledge, attitudes, and condom use).

RESULTS

At end line, 105 schools were included from the two provinces (44 from Mpumalanga and 61 from KwaZulu-Natal). Fifty-five were intervention and fifty were control schools. A total of 2802 girls were surveyed at both time periods (1477 intervention and 1325 control). At baseline, participating girls were about 13.6 years; by end line, they were about 2 years older. Longitudinal data demonstrated few differences between intervention and control groups on knowledge, attitudes, condom use, genital herpes, and pregnancy experience. Monitoring data demonstrated that the program was not implemented as intended. Our results demonstrated 7% incidence of genital herpes in the two-year follow-up period indicating sexual risk-taking among our cohort.

CONCLUSIONS

We did not find significant effects of the revised life orientation curriculum on key outcomes; however, this may reflect poor implementation. Future HIV prevention programs for young people need to be implemented with fidelity to ensure they meet the crucial needs of the next generation.

TRIAL REGISTRATION

This study has been registered at ClinicalTrials.gov . The trial registration number is: NCT04205721 . The trial was retrospectively registered on December 18, 2019.

HIV-Related Knowledge, Attitudes, and Behaviors among Grade 10 Girls and Boys in Mpumalanga and KwaZulu-Natal: Cross-Sectional Results

BACKGROUND

Young people in KwaZulu-Natal and Mpumalanga South Africa are at high risk of HIV and other sexually transmitted infections. Programs are needed to reach these young people and change their knowledge, attitudes, and behaviors.

OBJECTIVE

The objective of this study is to use cross-sectional data from grade 10 female and male learners in randomly assigned intervention and control schools to examine knowledge, attitudes, and sexual behaviors.

METHODS

Participants were in grade 10 in the 2018 school year and were attending schools randomly assigned to the intervention and control arms for implementation of the Department of Basic Education's adapted life orientation curriculum that included scripted lesson plans. The study took place in two high HIV prevalence provinces in South Africa. Participants completed self-administered tablet-based surveys and female participants provided a dried blood spot for HIV testing.

RESULTS

Results demonstrate that two-fifths to one-half of male learners reported being sexually experienced and a quarter (KwaZulu-Natal) to a third (Mpumalanga) of the female learners reported the same. A greater percentage of learners in Mpumalanga reported consistent condom use than learners in KwaZulu-Natal. HIV prevalence among female grade 10 learners in both provinces was about 6-7%. No notable differences are observed between intervention and control school learners on the knowledge, attitudes, and behavior outcomes.

CONCLUSION

The findings demonstrate the importance of developing HIV prevention programs for young people in high HIV prevalence provinces since these young people remain at high risk for HIV and other negative outcomes.

TRIAL REGISTRATION

This study has been registered at ClinicalTrials.gov. The trial registration number is: NCT04205721. The trial was retrospectively registered on December 18, 2019.

Bahamas National Implementation Project: Proposal for Sustainability of an Evidence-based HIV Prevention Intervention in a School Setting

BACKGROUND

Sustained implementation of school-based prevention programs is low. Effective strategies are needed to enhance both high-level implementation fidelity and sustainability of prevention programs.

OBJECTIVE

This proposed study aims to determine if the provision of either biweekly monitoring and feedback and site-based assistance and mentorship or both to at-risk and moderate-performing teachers with monitoring through an enhanced decision-making platform by the Ministry of Education (MOE) and Ministry of Health (MOH) based on the real-time implementation data will increase national implementation fidelity and result in sustained implementation over time.

METHODS

This study will target government schools including 200 grade 6 teachers in 80 primary schools and 100 junior/middle high school teachers (and their classes) on 12 Bahamian islands. Teacher and school coordinator training will be conducted by the MOE in year 1, followed by an optimization trial among teachers in the capital island. Informed by these results, an implementation intervention will be conducted to train using different levels of educational intensity all at-risk and moderate-performing teachers. Subsequently selected training and implementation strategies will be evaluated for the national implementation of Focus on Youth in the Caribbean and Caribbean Informed Parents and Children Together in years 2 to 5.

RESULTS

It is hypothesized that a more intensive training and supervision program for at-risk and moderate-performing teachers will enhance their implementation fidelity to the average level of the high-performing group (85%), an HIV prevention program delivered at the national level can be implemented with fidelity in grade 6 and sustained over time (monitored annually), and student outcomes will continue to be highly correlated with implementation fidelity and be sustained over time (assessed annually through grade 9). The proposed study is funded by the National Institute of Child Health and Human Development from August 1, 2018, through May 31, 2023.

CONCLUSIONS

The study will explore several theory-driven implementation strategies to increase sustained teacher implementation fidelity and thereby increase the general public health impact of evidence-based interventions. The proposed project has potential to make significant contributions to advancing school-based HIV prevention research and implementation science and serve as a global model for the Fast Track strategy.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/14816.

Addressing the Adherence-Adaptation Debate: Lessons from the Replication of an Evidence-Based Sexual Health Program in School Settings

Whether high adherence to programs is necessary to achieve program outcomes is an area of great debate. The objectives of this study were to determine the frequency, type, and rationale of adaptations made in the implementation of an evidence-based program and to determine program outcomes for intervention program participants, as compared to comparison participants, by the level of adaptations. A total of 1608 participants in 45 classrooms participated. Percent adaptations was calculated by classroom. Thematic qualitative analysis was used to categorize types and rationales for adaptations. Program outcomes by level of adaptations were determined using logistic regression analyses and mean differences. Propensity score matching methods were used to create comparability between adaptation subgroup participants and comparison participants. Adaptations ranged from 2 to 97% across classrooms, with mean adaptations of 63%. Thematic analysis revealed that the adaptations made were related to delivery of content, rather than to the content itself and in response to participant needs and setting constraints. Program outcomes did not appear to be reduced for the high-adaptation subgroup. Understanding both rationale (intent) and type of adaptation made is crucial to understanding the complexity of adaptations. These finding support the argument for allowing facilitators some flexibility and autonomy to adapt the delivery of prescribed content to participant needs and setting constraints.

Studies evaluating of health interventions at schools: an integrative literature review

OBJECTIVE

to identify and analyze the available evidence on the strategies used in the studies evaluating health interventions at school.

METHOD

this is an integrative review searching in LILACS, CINAHL, CUIDEN, ScienceDirect, and PubMed. From the pre-defined inclusion and exclusion criteria, there were 121 articles chosen to compose the sample.

RESULTS

english studies (97.5%), with a quantitative approach (80.2%), related to the interventions carried out in the Region of the Americas (54.6%) and the European Region (23.1%) predominated. For the most part, they are interventions as programs (70.2%), interested in evaluating results (73.5%) from the value judgment (83.4%). Prevalence of interventions focused on efficacy, effects or impact, and activities carried out on interventions were focused on physical activity, healthy eating, sexual and reproductive health, mental health, and use of tobacco, alcohol, and other drugs. They are worked through activities of clinical monitoring, health promotion and disease prevention.

CONCLUSION

the evidence indicates that the evaluations of health interventions in the school focus the results produced in programs through the judgment of value. The topics most addressed were healthy eating, physical activity, prevention of alcohol and other drugs, among others.

Multi-year school-based implementation and student outcomes of an evidence-based risk reduction intervention

Background

Intervention effects observed in efficacy trials are rarely replicated when the interventions are broadly disseminated, underscoring the need for more information about factors influencing real-life implementation and program impact. Using data from the ongoing national implementation of an evidence-based HIV prevention program [Focus on Youth in The Caribbean (FOYC)] in The Bahamas, this study examines factors influencing teachers’ patterns of implementation, the impact of teachers’ initial implementation of FOYC, and subsequent delivery of the booster sessions on students’ outcomes.

Methods

Data were collected from the 80 government elementary and 34 middle schools between 2011 and 2014, involving 208 grade 6, 75 grade 7, and 58 grade 8 teachers and 4411 students initially in grade 6 and followed for 3 years. Student outcomes include HIV/AIDS knowledge, reproductive health skills, self-efficacy, and intention to use protection. Data from teachers includes implementation and modification of the curriculum, attitudes towards the prevention program, comfort level with the curriculum, and attendance at training workshops. Structural equation modeling and mixed-effect modeling analyses were applied to examine the impact of teachers’ implementation.

Results

Teachers’ attitudes towards and comfort with the intervention curriculum, and attendance at the curriculum training workshop had a direct effect on teachers’ patterns of implementation, which had a direct effect on student outcomes. Teachers’ attitudes had a direct positive effect on student outcomes. Teachers’ training in interactive teaching methods and longer duration as teachers were positively associated with teachers’ comfort with the curriculum. High-quality implementation in grade 6 was significantly related to student outcomes in grades 6 and 7 post-implementation. Level of implementation of the booster sessions in grades 7 and 8 were likewise significantly related to subsequent student outcomes in both grades.

Conclusions

High-quality initial implementation of a prevention program is significantly related to better program outcomes. Poor subsequent delivery of booster sessions can undermine the positive effects from the initial implementation while strong subsequent delivery of booster sessions can partially overcome poor initial implementation.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-016-0539-7) contains supplementary material, which is available to authorized users.

The Impact of Teachers' Modifications of an Evidenced-Based HIV Prevention Intervention on Program Outcomes

The degree to which evidence-based program outcomes are affected by modifications is a significant concern in the implementation of interventions. The ongoing national implementation of an evidence-based HIV prevention program targeting grade 6 students in The Bahamas [Focus on Youth in The Caribbean (FOYC)] offers an opportunity to explore factors associated with teachers' modification of FOYC lessons and to examine the impact of types and degrees of modifications on student outcomes. Data were collected in 2012 from 155 teachers and 3646 students in 77 government elementary schools. Results indicate that teachers taught 16 of 30 core activities, 24.5 of 46 total activities and 4.7 of 8 sessions. Over one-half of the teachers made modifications to FOYC core activities; one-fourth of the teachers modified 25 % or more core activities that they taught (heavily modified FOYC). Omitting core activities was the most common content modification, followed by lengthening FOYC lessons with reading, writing assignments or role-play games, and shortening core activities or adding educational videos. Mixed-effects modeling revealed that omitting core activities had negative impacts on all four student outcomes. Shortening core activities and adding videos into lessons had negative impacts on HIV/AIDS knowledge and/or intention to use condom protection. Heavy modifications (>1/4 core activities) were associated with diminished program effectiveness. Heavy modifications and omitting or shortening core activities were negatively related to teachers' level of implementation. We conclude that poorer student outcomes were associated with heavy modifications.

Experiences in implementation and publication of operations research interventions: gaps and a way forward

INTRODUCTION

According to UNAIDS, the world currently has an adequate collection of proven HIV prevention, treatment and diagnostic tools, which, if scaled up, can lay the foundation for ending the AIDS epidemic. HIV operations research (OR) tests and promotes the use of interventions that can increase the demand for and supply of these tools. However, current publications of OR mainly focus on outcomes, leaving gaps in reporting of intervention characteristics, which are essential to address for the utilization of OR findings. This has prompted WHO and other international public health agencies to issue reporting requirements for OR studies. The objective of this commentary is to review experiences in HIV OR intervention design, implementation, process data collection and publication in order to identify gaps, contribute to the body of knowledge and propose a way forward to improve the focus on "implementation" in implementation research.

DISCUSSION

Interventions in OR, like ordinary service delivery programmes, are subject to the programme cycle, which continually uses insights from implementation and the local context to modify service delivery modalities. Given that some of these modifications in the intervention may influence study outcomes, the documentation of process data becomes vital in OR. However, a key challenge is that study resources tend to be skewed towards documentation and the reporting of study outcomes to the detriment of process data, even though process data is vital for understanding factors influencing the outcomes.

CONCLUSIONS

Interventions in OR should be viewed using the lens of programme evaluation, which includes formative assessment (to determine concept and design), followed by process evaluation (to monitor inputs and outputs) and effectiveness evaluation (to assess outcomes and effectiveness). Study resources should be equitably used between process evaluation and outcome measurement to facilitate inclusion of data about fidelity and dose in publications in order to enable explanation of the relationship between dosing and study outcomes for purposes of scaling up and further refinement through research.

School-based interventions for improving contraceptive use in adolescents

BACKGROUND

Young women, especially adolescents, often lack access to modern contraception. Reasons vary by geography and regional politics and culture. The projected 2015 birth rate in 'developing' regions was 56 per 1000 compared with 17 per 1000 for 'developed' regions.

OBJECTIVES

To identify school-based interventions that improved contraceptive use among adolescents

SEARCH METHODS

Until 6 June 2016, we searched for eligible trials in PubMed, CENTRAL, ERIC, Web of Science, POPLINE, ClinicalTrials.gov and ICTRP.

SELECTION CRITERIA

We considered randomized controlled trials (RCTs) that assigned individuals or clusters. The majority of participants must have been 19 years old or younger.The educational strategy must have occurred primarily in a middle school or high school. The intervention had to emphasize one or more effective methods of contraception. Our primary outcomes were pregnancy and contraceptive use.

DATA COLLECTION AND ANALYSIS

We assessed titles and abstracts identified during the searches. One author extracted and entered the data into RevMan; a second author verified accuracy. We examined studies for methodological quality.For unadjusted dichotomous outcomes, we calculated the Mantel-Haenszel odds ratio (OR) with 95% confidence interval (CI). For cluster randomized trials, we used adjusted measures, e.g. OR, risk ratio, or difference in proportions. For continuous outcomes, we used the adjusted mean difference (MD) or other measures from the models. We did not conduct meta-analysis due to varied interventions and outcome measures.

MAIN RESULTS

The 11 trials included 10 cluster RCTs and an individually randomized trial. The cluster RCTs had sample sizes from 816 to 10,954; the median number of clusters was 24. Most trials were conducted in the USA and UK; one was from Mexico and one from South Africa.We focus here on the trials with moderate quality evidence and an intervention effect. Three addressed preventing pregnancy and HIV/STI through interactive sessions. One trial provided a multifaceted two-year program. Immediately after year one and 12 months after year two, the intervention group was more likely than the standard-curriculum group to report using effective contraception during last sex (reported adjusted ORs 1.62 ± standard error (SE) 0.22) and 1.76 ± SE 0.29), condom use during last sex (reported adjusted ORs 1.91 ± SE 0.27 and 1.68 ± SE 0.25), and less frequent sex without a condom in the past three months (reported ratios of adjusted means 0.50 ± SE 0.31 and 0.63 ± SE 0.23). Another trial compared multifaceted two-year programs on sexual risk reduction and risk avoidance (abstinence-focused) versus usual health education. At 3 months, the risk reduction group was less likely than the usual-education group to report no condom use at last intercourse (reported adjusted OR 0.67, 95% CI 0.47 to 0.96) and sex without a condom in the last three months (reported adjusted OR 0.59, 95% CI 0.36 to 0.95). At 3 and after 15 months, the risk avoidance group was also less likely than the usual-education group to report no condom use at last intercourse (reported adjusted ORs 0.70, 95% CI 0.52 to 0.93; and 0.61, 95% CI 0.45 to 0.85). At the same time points, the risk reduction group had a higher score than the usual-education group for condom knowledge. The third trial provided a peer-led program with eight interactive sessions. At 17 months, the intervention group was less likely than the teacher-led group to report oral contraceptive use during last sex (OR 0.57, 95% CI 0.36 to 0.91). This difference may not have been significant if the investigators had adjusted for the clustering. At 5 and 17 months, the peer-led group had a greater mean increase in knowledge of HIV and pregnancy prevention compared with the control group. An additional trial showed an effect on knowledge only. The group with an emergency contraception (EC) session was more likely than the group without the EC unit to know the time limits for using hormonal EC (pill) and the non-hormonal IUD as EC.

AUTHORS' CONCLUSIONS

Since most trials addressed preventing STI/HIV and pregnancy, they emphasized condom use. However, several studies covered a range of contraceptive methods. The overall quality of evidence was low. Main reasons for downgrading the evidence were having limited information on intervention fidelity, analyzing a subsample rather than all those randomized, and having high losses.

Teachers' patterns of implementation of an evidence-based intervention and their impact on student outcomes: results from a nationwide dissemination over 24-months follow-up

More information is needed about factors influencing real-life implementation and program impact of interventions effective in controlled study conditions. Ongoing national implementation of an evidence-based HIV prevention program targeting grade 6 students in The Bahamas offers the opportunity to examine patterns of implementation and relate them to student outcomes. Data were collected from 208 grade 6 teachers, 75 grade 7 teachers and 4411 grade 6 students followed over 2 years. Mixed-effects modeling analysis examined the association of teachers' patterns of implementation with student outcomes. High quality program implementation in grade 6 (high implementation dosage and fidelity) was significantly related to student outcomes six and 18 months post-intervention. Quality of implementation of the booster session in grade 7 was also significantly related to student outcomes in grade 7. Quality of delivery of the brief booster session a year after initial implementation is important in maintaining or resetting the student outcome trajectory.

Factors influencing implementation dose and fidelity thereof and related student outcomes of an evidence-based national HIV prevention program

Background

Teachers’ implementation of evidence-based prevention programs in schools is inconsistent. Using data gathered from the national implementation among grade six students in The Bahamas of an evidence-based HIV intervention [Focus on Youth in the Caribbean (FOYC)], this study examines differences in the degree of implementation (“dose”) and adherence to the core activities (“fidelity of implementation”) by teachers according to theoretically and historically relevant teachers’ characteristics, attitudes, and experiences pre-intervention and post-intervention. The relationship of implementation dose and implementation fidelity is assessed according to student outcomes.

Methods

Beginning in 2008, the Bahamian Ministry of Education (MOE) included FOYC in the grade six curriculum nationwide. Consistent with standard practice, teachers were offered MOE training workshops in FOYC prior to delivery. The MOE conducted an anonymous curricular assessment among the grade six students at the beginning and end of the school year. Teachers agreeing to participate in the research component were asked to complete a pre-implementation and post-implementation assessment of attitudes and prior experiences.

Results

Teachers taught 15.6 out of 30 core activities, 24 out of the 46 total activities, and 4.6 out of 8 sessions on average. Three teachers’ implementation groups were identified: 1) High Implementation Group (31.7% of the teachers), characterized by high levels of implementation dose and fidelity of implementation; 2) Moderate Implementation Group (52.8%), showing moderate levels of implementation dose but high levels of fidelity of implementation; and 3) Low Implementation Group (15.6%), with low levels of implementation dose and fidelity of implementation. Low Implementation Group teachers compared to teachers in the two higher performing groups had less training in interactive teaching, limited prior exposure to the FOYC curriculum, incomplete attendance at FOYC training workshops, and low levels of comfort in teaching FOYC lessons. Students taught by teachers in the Low Implementation Group demonstrated poorer outcomes relevant to the four student outcomes (HIV/AIDS knowledge, preventive reproductive health skills, self-efficacy, and intention to use protection if they were to have sex).

Conclusions

Both implementation dose and implementation fidelity are related to student outcomes. Teachers at risk for limited implementation can be identified pre-intervention, thus opening the possibility for focused pre-intervention training.