Educators' perceptions of organisational readiness for implementation of a pre-adolescent transdisciplinary school health intervention for inter-generational outcomes

Organizational readiness and implementation fidelity of an early childhood education and care-specific physical activity policy intervention: findings from the Play Active trial

BACKGROUND

Many children do not accumulate sufficient physical activity for good health and development at early childhood education and care (ECEC). This study examined the association between ECEC organizational readiness and implementation fidelity of an ECEC-specific physical activity policy intervention.

METHODS

Play Active aimed to improve the ECEC educator's physical activity practices. We investigated the implementation of Play Active using a Type 1 hybrid study (January 2021-March 2022). Associations between organizational readiness factors and service-level implementation fidelity were examined using linear regressions. Fidelity data were collected from project records, educator surveys and website analytics.

RESULTS

ECEC services with higher levels of organizational commitment and capacity at pre-implementation reported higher fidelity scores compared to services with lower organizational commitment and capacity (all Ps < 0.05). Similarly, services who perceived intervention acceptability and appropriateness at pre-implementation to be high had higher fidelity scores (P < 0.05). Perceived feasibility and organizational efficacy of Play Active were associated with higher but nonsignificant fidelity scores.

CONCLUSIONS

Results indicate that organizational readiness factors may influence the implementation of ECEC-specific physical activity policy interventions. Therefore, strategies to improve organizational readiness should be developed and tested. These findings warrant confirmation in the ECEC and other settings and with other health behavior interventions.

A Comparison of the Readiness of Youth Service Agencies to Implement a Technology-Based Toolkit to Support Treatment Delivery

Implementation initiatives and technology-based resources aim to address barriers to Evidence-Based Practice (EBP) use by creating generalizable techniques that can be used for a variety of youth-serving agencies. However, research has not carefully examined unique differences between agency types or individual programs in readiness to use such technologies and implementation strategies. The current study explored differences between community mental health clinics and child advocacy centers on organizational cultural factors (e.g., ability to change and commitment for change) to implement a novel technology-based toolkit to support delivery of Trauma Focused Cognitive Behavioral Therapy (TF-CBT). Results indicated that TF-CBT providers from child advocacy centers reported greater commitment to change and more support to use the technology-based system than those from community mental health centers. Findings suggest that implementation initiatives should address the needs of individual agencies and service settings and adaptations should be explored to best meet the needs of these settings.

Measuring Organizational Readiness for Implementing Change in Primary Care Facilities in Rural Bushbuckridge, South Africa

Meaningful gains in health outcomes require successful implementation of evidence-based interventions. Organizations such as health facilities must be ready to implement efficacious interventions, but tools to measure organizational readiness have rarely been validated outside of high-income settings. We conducted a pilot study of the organizational readiness to implement change (ORIC) measure in public primary care facilities serving Bushbuckridge Municipality in South Africa in early 2019. We administered the 10-item ORIC to 54 nurses and lay counsellors in 9 facilities to gauge readiness to implement the national Central Chronic Medicine Dispensing and Distribution (CCMDD) programme intended to declutter busy health facilities. We used exploratory factor analysis (EFA) to identify factor structure. We used Cronbach alpha and intraclass correlation (ICC) to assess reliability at the individual and facility levels. To assess validity, we drew on existing data from routine clinic monitoring and a 2018 quality assessment to test the correlation of ORIC with facility resources, value of CCMDD programme, and better programme uptake and service quality. Six items from the ORIC loaded onto a single factor with Cronbach's alpha of 0.82 and ICC of 0.23. While facility ORIC score was not correlated with implementation of CCMDD, higher scores were correlated with facility resources, perceived value of the CCMDD program, patient satisfaction with wait time, and greater linkage to care following positive HIV testing. The study is limited by measuring ORIC after programme implementation. The findings support the relevance of ORIC, but identify a need for greater adaptation and validation of the measure.

Process evaluation of a pre-adolescent transdisciplinary health intervention for inter-generational outcomes

Background

The CIrCLE of Life Initiative was implemented to 537 grade 6 learners and their parents, in five Government-run South African primary schools. The transdisciplinary intervention was intended to increase knowledge and skills on HIV and obesity. The study aim was to assess and report on the implementation process.

Methods

Data was collected on an adapted Proctor’s taxonomy of implementation outcomes, and to assess participants’ experiences. Qualitative and quantitative data were collected through educator logbooks, researcher observations, and learner-parent workbooks.

Results

Differentiations between the various school contexts were observed. The process evaluation revealed high learner penetration (97.2%), but lower learner and parent exposure (44.3% and 55.5%, respectively). All educators thought that the intervention was a fit for both rural and urban schools, different socio-economic groups, and people of different ethnic and cultural backgrounds. The intervention was perceived to be sustainable, and there were recommendations for adoption into the school curriculum and scale-up if found to be effective.

Conclusion

The process evaluation facilitated the assessment of the implementation outcomes, described its processes, and acknowledged fundamental characteristics that could justify variability in the intervention impact and outcomes. The value of process evaluations and their benefit to the science of implementation were demonstrated.

Effectiveness of a pre-adolescent inter-generational intervention to address HIV and obesity in South Africa, using a pretest-posttest design

BACKGROUND

Strengthening pre-adolescents knowledge and skills through an age- and culturally-appropriate intervention could prevent health issues later in life. Early interventions could influence the trajectory of future risky behaviour, and may influence health behaviour amongst their parents. The CIrCLE of Life Initiative was developed to address HIV and obesity. We evaluated whether the combined intervention increased knowledge, enhanced skills, and/or promoted healthy behaviour among students (9-12 years old) and their parents.

METHODS

The study was conducted from May to December 2018. Trained educators delivered 30-min lessons over ten consecutive weeks with 537 Grade 6 students at five government-run schools, in a district, in South Africa. Schools were purposively selected based on socioeconomic status and urban-rural classification. Students communicated with parents through shared homework activities. A pretest-posttest study design was used, with a 3-month follow up. Both groups completed self-administered paper-based questionnaires. A score of subscales was used in analysis. The pretest and posttest scores were compared for students and parents using a dependent t-test. Differences in outcomes by school quintile were compared using one-way ANOVA.

RESULTS

Response rates were high for both students (80.6%) and their parents (83.4%). Statistically significant differences were observed in HIV knowledge in students pretest (mean 8.04, SD 3.10) and posttest scores (mean 10.1, SD 2.70; p < 0.01), and their parents (mean 10.32, SD 2.80 vs 11.0, SD 2.50; p < 0.01). For both students and parents, pre- and post-test obesity awareness mean scores were similar, 1.93, SD 0.92 and 2.78, SD 0.57; p < 0.01, for students; and 2.47, SD 0.82 and 2.81, SD 0.54; p < 0.01, for parents. In the posttest, statistically significant changes were also observed in both groups, enhancing skills in measuring body mass index and pulse rate, and interpreting food labels. Students had a high intention to share gained knowledge with parents who had a high intention to receive it (89.4 and 89.5%, respectively).

CONCLUSION

The intervention increased knowledge about HIV and obesity-related awareness, and it enhanced skills in selected outcomes among pre-adolescents and parents. Accurate messages and enhanced communication skills could support inter-generational knowledge transfer.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT04307966 retrospectively registered on 12 March 2020.

School Coordinators' Perceptions of Organizational Readiness Is Associated with Implementation Fidelity in a Smoking Prevention Program: Findings from the X:IT II Study

School organizational readiness to implement interventions may play an important role for the actual obtained implementation level, and knowledge about organizational readiness prior to intervention start can help pinpoint how to optimize support to the schools. In this study, we applied a novel heuristic, R = MC2 to assess school organizational readiness prior to implementation of a multicomponent smoking prevention program. Furthermore, we examined the association to actual implementation after the first year of study. We used questionnaire data from school coordinators at 40 schools in Denmark who had accepted to implement the multi-component smoking prevention intervention-X:IT II-in the school year 2017-2018 including three main components: (1) Rules on smoke-free school time, (2) A smoke-free curriculum, and (3) Parental involvement. On behalf of the school, a school coordinator answered a baseline questionnaire about the organizational readiness and a follow-up questionnaire about implementation of the three components after first year of study. Readiness was measured by summing aspects of motivation (relative advantage, compatibility, complexity, and priority), general capacity (culture, climate, and staff capacity), and innovation-specific capacity (knowledge, skills, and abilities). Based on school coordinators' perceptions, almost all schools had good general capacity while the other two areas of readiness varied across schools; overall, 56.8% of schools (N = 25) had good motivation for implementing the X:IT II intervention and 61.3% (N = 27) had high innovation-specific capacity. Half of the schools had high overall readiness defined as high motivation and high innovation-specific capacity. Schools with high overall readiness implemented the rules on smoke-free school time, smoke-free curriculum, and parental involvement to a higher degree than schools with low overall readiness. All participating schools possessed sufficient levels of general capacity, e.g., a well-functioning organizational culture and sufficient staff capacity. High levels of motivation and innovation-specific capacity were positively associated with the schools' actual implementation of the main intervention components. This way of conceptualizing and measuring organizational readiness may be useful in future studies, i.e., in studies where enhancing readiness is a main objective.