Evaluating and Refining the Conceptual Model Used in the Study of Health and Activity in Preschool Environments (SHAPES) Intervention

A Summary of One Research Team's Contributions to Understanding Physical Activity Behavior in Children and Youth

Schools are well-positioned to provide physical activity opportunities to help youth achieve the recommended 60 or more daily minutes of moderate-to-vigorous physical activity. The Children's Physical Activity Research Group (CPARG) at the University of South Carolina has focused on understanding physical activity in school-aged youth for 30+ years. The purpose of this article was to critically review (CPARG) contributions to the field in school settings and school-age youth. We reviewed 127 published CPARG articles from six research projects conducted between 1993-2019. The review was guided by questions in five categories: measurement of physical activity and its determinants, characteristics of physical activity behavior, correlates/determinants of physical activity, physical activity interventions, and race/ethnicity and physical activity. Results were summarized by question and synthesized across categories. CPARG contributions included assessing physical activity levels, patterns, forms, and contexts; identifying and measuring physical activity correlates/determinants; and conducting school-based physical activity interventions. Identifying multiple domains of physical activity determinants enables researchers and practitioners to select/design age-appropriate, valid, and reliable instruments to assess determinants. Focusing on determinants enables them to create effective physical activity interventions, environments, programs, and policies in schools. These efforts must address race/ethnicity differences, ensuring that measurement instruments and intervention strategies are culturally appropriate.

In It for the Long Haul: RE-AIM Evaluation of a Preschool Programme Implementing and Maintaining Adult-Initiated Motor Skill Development and Physical Activity across a Two-Year Period

Good motor skills (MS) are considered important for children's social, psychological and physical development and general physical activity (PA) levels. The Motor skill in Preschool study (MiPS) aimed to optimize children's MS through weekly PA sessions. The aim of this study is to use the RE-AIM framework to report the two-year implementation process of MiPS since the programme's initiation. Data were collected through a staff questionnaire based on the RE-AIM framework. Data were collected at three months, one year and two years after initiation. Results show that the pedagogical staff believes that the programme promotes MS in children. Implementation measures only showed medium to low fidelity concerning the core element of performing adult-initiated PA sessions with a duration of at least 45 min 4 days a week. The largest barrier was finding the time to plan these PA sessions. Still, the content of the PA sessions achieved high fidelity scores and the programme was deemed suitable for staff's everyday practice and in alignment with the stated pedagogical goals. The mandatory competence development course was highly valued as strong implementation support. It is notable that there is a large variation in the implementation among the preschools with some struggling more than others.

The Role of Local Leaders in the Implementation of Adult-Initiated Motor Skill Development and Physical Activity in Preschool-A Case Study

Good motor skills (MS) and physical activity (PA) are considered important for children’s physical, social, and psychological development. The Motor skills in PreSchool (MiPS) study-Denmark aimed to optimize children’s MS through weekly PA sessions. The aim of this paper is to explore the role of local preschool leaders and their strategies in influencing the implementation of MiPS into daily practice. Leaders from all seven preschools in the project were interviewed. The results show that preschool leaders used communication (setting an agenda and dedicating speaking time to address the program at staff meetings) and reflective questioning about the pedagogic staff’s current practice in relation to the program (adding focus on MS and PA) as their main course of action. Through this form of communication and reflective questioning, the preschool leaders aimed to involve the staff and heighten their sensemaking in the existing practice while also ensuring that the implementation of the program was kept in progress. In sum, future implementation of an MS and PA initiative in preschools should put emphasis on a shared responsibility between leaders and staff combined with an adaptive approach in which the existing practice is reshaped rather than just increasing the workload of the pedagogic staff.

Changing the preschool setting to promote healthy energy balance-related behaviours of preschoolers: a qualitative and quantitative process evaluation of the SuperFIT approach

Background

The Early Care and Education (ECE) setting plays an important role in the promotion of a healthy lifestyle in young children. SuperFIT is a comprehensive, integrated intervention approach designed to promote healthy energy balance-related behaviours in preschoolers. Insight in the process of implementation and the context in which SuperFIT was implemented supports the understanding of how the intervention works in practice. This process evaluation examined factors that influenced the implementation and maintenance, as well as the (perceived) changes in the ECE setting.

Methods

A mixed-methods study was conducted. SuperFIT was implemented at twelve preschools in the south of the Netherlands. The process evaluation was performed among preschool teachers, managers of the preschool organisation, and implementers. Semi-structured in-depth (group) interviews, quantitative process questionnaires, the Child-care Food and Activity Practices Questionnaire (CFAPQ) and the Environmental and Policy Assessment and Observation (EPAO) were used to evaluate the implementation and maintenance of SuperFIT and the changes in the preschool setting. The interviews were analysed using a theoretical framework based on the Implementation Framework of Fleuren and Damschröder’s Consolidated Framework for Implementation Research. Descriptive analyses were performed on the quantitative data.

Results

Various intervention activities were implemented in the preschool setting. Although the intention to maintain SuperFIT was present, this was hindered by time constraints and lack of financial resources. Important factors that influenced implementation and maintenance were incongruence with current practice, limited perceived capabilities to integrate SuperFIT in daily practice, group composition at the preschools, and the perceived top-down implementation. Organizational vision and societal attention regarding healthy behaviour in general were perceived to be supportive for implementation and maintenance. Predominantly, favourable changes were seen in the nutrition- and physical activity-related practices of preschool teachers and other aspects of the social preschool environment such as the use of play materials. Limited changes were observed in the physical preschool environment.

Conclusions

Several factors influenced the implementation and maintenance of SuperFIT in the preschool setting. Some factors evolved over time from hindering to facilitating, emphasising the importance of allowing sufficient time for intervention implementation. SuperFIT changed mainly the social preschool environment.

Trial registration

Clinicaltrials.gov, NCT03021980, date registered: January 16, 2017, prospectively registered

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01161-9.

Implementation Monitoring of a Promotora-Led, Home-Based Obesity Prevention Pilot Study With Latino Preschool Children and Their Mothers

BACKGROUND

Latino preschool children have higher rates of obesity than children from other racial/ethnic backgrounds. Few effective, culturally-tailored obesity prevention interventions exist that have focused on Latino preschool children, and even fewer have published results of the process evaluation. The purpose of this paper was to monitor reach, fidelity, and completeness of implementation to determine whether ANDALE, a promising promotora-led, home-based pilot study to prevent obesity in Latino preschool children, was implemented as planned.

METHODS

Guided by a logic model, we assessed reach, implementation fidelity and completeness through descriptive analyses of multiple data sources. Reach was assessed through attendance records. Fidelity was assessed via observation checklist and completeness was assessed via survey with both parents and promotoras in a subsample of 12 families.

RESULTS

Promotoras recruited participants primarily through their own social networks and delivered the intervention to 50 families (mother-child dyads); the majority were of Mexican-origin, low-acculturation, dual-parent households. Nearly all (98%) families completed the whole 10-week intervention. Results demonstrated completeness and fidelity of implementation were acceptable in a subsample of 12 families. In sum, 75% of families in the subsample met the criteria (≥75%) for overall implementation of essential program elements (i.e., reach, completeness, and fidelity).

CONCLUSION

Evidence suggests that ANDALE was delivered with high levels of completeness and fidelity in this sample of Latino families with preschool-aged children. These results support implementation of ANDALE in a large, randomized trial.

The translation of an evidence-based preschool physical activity intervention from in-person to online delivery of professional development to preschool teachers

Study of Health and Activity in Preschool Environments (SHAPES) aimed to increase preschoolers' physical activity by engaging preschool teachers in professional development designed to modify instructional practices. SHAPES originated as a randomized controlled trial, tested in 16 preschools and disseminated to 4 control schools, and was shown to be effective in increasing preschool children's physical activity (Phase I, 2008-2012). This article describes the steps taken to translate an evidence-based physical activity intervention, SHAPES, from in-person delivery to online delivery of professional development to preschool teachers. In Phase II (2013-2016), professional development delivery was modified from an in-person to an online program for preschool teachers. Teacher implementation completeness and fidelity were examined in 10 pilot preschools and then replicated in 30 preschools. Large-scale dissemination of SHAPES began in Phase III (2017-2019), reaching 818 teachers from 228 unique centers after 2 years. The final SHAPES program consisted of six online modules, an accompanying guidebook, over 90 activities, self-assessment techniques, a video library, and an electronic community forum. The SHAPES core elements, defined in Phase I, were retained throughout all three phases. The Phase II change to online delivery was characterized by high levels of implementation completeness and fidelity. Results of Phase III statewide dissemination revealed comparable implementation completeness and fidelity. An intervention shown to be effective in a randomized controlled trial can be translated into an online professional development program and disseminated on a large scale in a timely manner.

A systematic review of the use and reporting of evaluation frameworks within evaluations of physical activity interventions

BACKGROUND

Evaluation of physical activity interventions is vital to inform, and justify, evidence-based policy and practice to support population-wide changes in physical activity. Several evaluation frameworks and guidance documents have been developed to facilitate the evaluation and reporting of evaluation studies in public health. However, there is a lack of evidence about whether frameworks are being used to guide evaluation. There continues to be claims of poor and inconsistent reporting in evaluation studies. The aim of this review was to assess the use of evaluation frameworks and the quality of reporting of how they were applied within evaluation studies of physical activity interventions.

OBJECTIVES

1. To identify whether evaluation frameworks are reported to have been used within evaluation studies of physical activity interventions, and which frameworks have been used. 2. To appraise the quality of reporting with regards to how evaluation frameworks have been used.

METHOD

We developed a checklist of indicators to enable a critical appraisal of the use and reporting of different evaluation frameworks in evaluation studies. We conducted a systematic search and review of evaluation studies published between 2015 and the date of the search to appraise the use and reporting of evaluation frameworks. A narrative synthesis is provided.

RESULTS

The review identified 292 evaluation studies of physical activity interventions, only 69 (23%) of these mentioned using an evaluation framework, and only 16 different frameworks were referred to. There was variation in the quality of reporting of framework use. 51 (74%) studies were identified as being explicitly based on the stated framework, however only 26 (38%) provided detailed descriptions consistently across all the checklist indicators. Details of adaptations and limitations in how frameworks were applied were less frequently reported. The review also highlighted variability in the reporting of intervention components. More consistent and precise reporting of framework and intervention components is needed.

CONCLUSION

Evaluation frameworks can facilitate a more systematic evaluation report and we argue their limited use suggests missed opportunities to apply frameworks to guide evaluation and reporting in evaluation studies. Variability in the quality of reporting of framework use limits the comparability and transferability of evidence. Where a framework has been used, the checklist of indicators can be employed to facilitate the reporting of an evaluation study and to review the quality of an evaluation report.

Development of the DAGIS intervention study: a preschool-based family-involving study promoting preschoolers' energy balance-related behaviours and self-regulation skills

Background

Preschoolers’ energy balance-related behaviours (EBRBs) and self-regulation skills are important for their later health. Few preschool-based interventions aiming to promote preschoolers’ EBRBs and self-regulation skills, simultaneously reducing differences in EBRBs, due to children’s socio-economic status (SES) background, have been conducted. This study will present the Increased Health and Wellbeing in Preschools (DAGIS) intervention development process applying the Intervention Mapping (IM) framework.

Methods

The development of the DAGIS intervention study, a preschool level clustered randomized controlled trial (RCT), was based on the IM framework. The protocol in IM guides the development process of an intervention through six steps: needs assessment and logic model of the problem, programme outcomes and objectives, design of the programme, production, implementation plan, and evaluation plan.

Results

The needs assessment, part of the step 1 in IM, yielded the base for the DAGIS logic model of change. The model includes objectives related to changes in children’s EBRBs, self-regulation skills, and in psychosocial and physical environment that is determined by parents and early educators. A 22-week programme was developed, and materials for preschools and families were produced. A feasibility study of the recruitment processes, acceptability of the materials and methods, and implementation was conducted. The DAGIS intervention study was conducted September 2017–May 2018 as a clustered RCT including a comprehensive effectiveness and process evaluation. The process evaluation was run throughout the intervention targeting preschools and families.

Conclusion

A preschool-based family-involving programme was developed in the DAGIS intervention study by applying the IM protocol. It was a time- and resource-consuming process. However, the systematic planning, development, and running of the programme have reinforced a comprehensive evaluation, which is a strength in the intervention. The results from the evaluation will enhance the knowledge of how to promote EBRBs and self-regulation skills among preschoolers, and diminish SES differences in them.

Trial registration

ISRCTN57165350 (Prospectively registered January the 8th, 2015).

Physical activity and sedentary time among preschoolers in centre-based childcare: a systematic review

Background

Many preschoolers spend a substantial portion of their day enrolled in centre-based childcare; the amounts of physical activity and sedentary time accumulated in this environment are critical to preschoolers’ ability to meet movement guidelines. The purpose of this systematic review was to provide a comprehensive overview of the objectively assessed physical activity and sedentary time of preschoolers in centre-based childcare (registration no. CRD42016033502).

Methods

Eight online databases were searched using terms related to physical activity, sedentary time, preschoolers and centre-based childcare. Published, peer-reviewed primary studies written in English that objectively assessed (via accelerometry) the physical activity and sedentary time of preschoolers (2-5 years) in centre-based childcare were included.

Results

Fifty-five studies (published 2004-2017) from 11 countries, representing 13,956 participants were included. Studies reported light physical activity (n=38) ranging from 2.94 to 29.96 mins/hr, moderate-to-vigorous physical activity (n=46) which ranged from 1.29 to 22.66 mins/hr, and total physical activity (n=42) ranging from 4.23 to 47.17 mins/hr. Sedentary time (n=47) ranged from 12.38 to 55.77 mins/hr.

Conclusion

Physical activity and sedentary time were highly varied and inconsistent between studies; therefore, it is difficult to determine preschoolers’ true amount of physical activity and sedentary time during childcare hours. Despite this variability, preschoolers were noted to participate in high rates of sedentary time in this setting. The lack of homogeneity is an important finding in and of itself as it highlights the lack of consistency in measuring, processing, and reporting paediatric physical activity data.

Feasibility and Effectiveness of a Wearable Technology-Based Physical Activity Intervention in Preschoolers: A Pilot Study

The purpose of this pilot study was to evaluate the feasibility and the effectiveness of an intervention that employed a technology-based physical activity (PA) monitoring system and teacher-regulated strategies to promote PA in preschoolers. A total of 93 preschoolers (53% girls, 4.7 years) from 5 child care centers were recruited for a one-week intervention and randomly assigned into control (2 centers, n = 45) or intervention (3 centers, n = 48) group. Key intervention components included: (1) wearable device-based, real-time monitoring of children’s PA by classroom teachers and (2) teacher-regulated strategies for providing more opportunities for PA. Sedentary behavior (SED) and PA were measured using accelerometers. Overall, children in the intervention group showed significantly lower level of SED (31.6 vs. 33.6 min/h) and higher level of total PA (28.4 vs. 26.4 min/h) than children in the control group, after adjusting for age, sex, race, parent education level, parent perception of their child’s PA, BMI, and childcare centers. Teachers in the intervention group reported that the intervention was highly feasible to be implemented in their current classroom settings. In conclusion, we observed high acceptability and initial effectiveness of the current intervention. Subsequent research at larger-scale is warranted to fully evaluate the effectiveness of the intervention strategies tested in this study.

The Implementation and Feasibility of the Supporting Physical Activity in the Childcare Environment (SPACE) Intervention: A Process Evaluation

This study describes the process evaluation of the Supporting Physical Activity in the Childcare Environment (SPACE) intervention, consisting of educator physical activity training, provision of portable play equipment, and a modified outdoor schedule (i.e., 4 × 30-minute periods). Educators ( N = 49) from 11 childcare centers in London, Ontario, Canada, delivered the 8-week intervention to 200 preschoolers ( M_age = 3.38 years). Workshop attendance was documented while adherence to the outdoor schedule and number and timing of outdoor sessions offered (i.e., dose) were recorded in a daily log. Questionnaire-based program evaluation ( n = 41) and in-person group interviews ( n = 7) were completed postintervention to assess educator perspectives on the barriers and facilitators to implementation (i.e., context), the feasibility and perceived effectiveness of the intervention, educator and preschooler enjoyment, communication among researchers and childcare personnel, and the future implementation of the intervention. Descriptive statistics were calculated, and responses to open-ended questions were inductively coded. Educator workshop attendance was 96%, and 88% of classrooms adhered to the four daily outdoor periods. Educators delivered 90% of the scheduled outdoor sessions, and 87% of these met the 30-minute criteria. Educators expressed that the increase in number of transitions made the outdoor playtimes challenging to implement, yet rated the feasibility of the training and equipment as high. Educators perceived the intervention to be both enjoyable and effective at increasing preschoolers' physical activity. They indicated effective communication and revealed that they intended to continue to use their physical activity knowledge and to offer the play equipment once the intervention had concluded. These findings demonstrate that the SPACE intervention is viable in center-based childcare.

The effects of mothers' musical background on sedentary behavior, physical activity, and exercise adherence in their 5-6-years-old children using movement-to-music video program

Objectives

The purpose of this study was to examine whether mothers’ musical background has an effect on their own and their children’s sedentary behavior (SB) and physical activity (PA). The aim was also to assess children’s and their mothers’ exercise adherence when using movement-to-music video program.

Design

Sub-group analysis of an intervention group in a randomized controlled trial (ISRCTN33885819).

Method

Seventy-one mother-child-pairs were divided into two categories based on mothers’ musical background. Each pair performed 8 weeks exercise intervention using movement-to-music video program. SB and PA were assessed objectively by accelerometer, and exercise activity, fidelity, and enjoyment were assessed via exercise diaries and questionnaires. Logistic regression model was used to analyze associations in the main outcomes between the groups.

Results

Those children whose mothers had musical background (MB) had greater probability to increase their light PA during the intervention, but not moderate-to-vigorous PA compared to those children whose mothers did not have musical background (NMB). SB increased in both groups. Mothers in the NMB group had greater probability to increase their light and moderate-to-vigorous PA and decrease their SB than mothers in the MB group. However, exercise adherence decreased considerably in all groups. Completeness, fidelity, and enjoyment were higher among the NMB group compared to the MB group.

Conclusions

The present results showed that mothers without musical background were more interested in movement-to-music exercises, as well as their children. For further studies it would be important to evaluate an effect of children’s own music-based activities on their SB and PA.