Feasibility and principal acceptability of school-based mobile communication applications to disseminate healthy lunchbox messages to parents

A collaborative network trial to evaluate the effectiveness of implementation strategies to maximize adoption of a school-based healthy lunchbox program: a study protocol

Introduction

An important impediment to the large-scale adoption of evidence-based school nutrition interventions is the lack of evidence on effective strategies to implement them. This paper describes the protocol for a "Collaborative Network Trial" to support the simultaneous testing of different strategies undertaken by New South Wales Local Health Districts to facilitate the adoption of an effective school-based healthy lunchbox program ('SWAP IT'). The primary objective of this study is to assess the effectiveness of different implementation strategies to increase school adoption of the SWAP across New South Wales Local Health Districts.

Methods

Within a Master Protocol framework, a collaborative network trial will be undertaken. Independent randomized controlled trials to test implementation strategies to increase school adoption of SWAP IT within primary schools in 10 different New South Wales Local Health Districts will occur. Schools will be randomly allocated to either the intervention or control condition. Schools allocated to the intervention group will receive a combination of implementation strategies. Across the 10 participating Local Health Districts, six broad strategies were developed and combinations of these strategies will be executed over a 6 month period. In six districts an active comparison group (containing one or more implementation strategies) was selected. The primary outcome of the trial will be adoption of SWAP IT, assessed via electronic registration records captured automatically following online school registration to the program. The primary outcome will be assessed using logistic regression analyses for each trial. Individual participant data component network meta-analysis, under a Bayesian framework, will be used to explore strategy-covariate interactions; to model additive main effects (separate effects for each component of an implementation strategy); two way interactions (synergistic/antagonistic effects of components), and full interactions.

Discussion

The study will provide rigorous evidence of the effects of a variety of implementation strategies, employed in different contexts, on the adoption of a school-based healthy lunchbox program at scale. Importantly, it will also provide evidence as to whether health service-centered, collaborative research models can rapidly generate new knowledge and yield health service improvements.

Clinical trial registration

This trial is registered prospectively with the Australian New Zealand Clinical Trials Registry (ACTRN12623000558628).

Methodological approaches to study context in intervention implementation studies: an evidence gap map

BACKGROUND

Within implementation science studies, contextual analysis is increasingly recognized as foundational to interventions' successful and sustainable implementation. However, inconsistencies between methodological approaches currently limit progress in studying context and guidance to standardize the use of those approaches is scant. Therefore, this study's objective was to systematically review and map current methodological approaches to contextual analysis in intervention implementation studies. The results would help us both to systematize the process of contextual analysis and identify gaps in the current evidence.

METHODS

We conducted an evidence gap map (EGM) based on literature data via a stepwise approach. First, using an empirically developed search string, we randomly sampled 20% of all intervention implementation studies available from PubMed per year (2015-2020). Second, we assessed included studies that conducted a contextual analysis. Data extraction and evaluation followed the Basel Approach for CoNtextual ANAlysis (BANANA), using a color-coded rating scheme. Also based on BANANA and on the Context and Implementation of Complex Interventions (CICI) framework-an implementation framework that pays ample attention to context- we created visual maps of various approaches to contextual analysis.

RESULTS

Of 15, 286 identified intervention implementation studies and study protocols, 3017 were screened for inclusion. Of those, 110 warranted close examination, revealing 22% that reported on contextual analysis. Only one study explicitly applied a framework for contextual analysis. Data were most commonly collected via surveys (n = 15) and individual interviews (n = 13). Ten studies reported mixed-methods analyses. Twenty-two assessed meso-level contextual and setting factors, with socio-cultural aspects most commonly studied. Eighteen described the use of contextual information for subsequent project phases (e.g., intervention development/adaption, selecting implementation strategies). Nine reported contextual factors' influences on implementation and/or effectiveness outcomes.

CONCLUSIONS

This study describes current approaches to contextual analysis in implementation science and provides a novel framework for evaluating and mapping it. By synthesizing our findings graphically in figures, we provide an initial evidence base framework that can incorporate new findings as necessary. We strongly recommend further development of methodological approaches both to conduct contextual analysis and to systematize the reporting of it. These actions will increase the quality and consistency of implementation science research.

Parents’ Communication with Teachers about Food and Nutrition Issues of Primary School Students

Parents and teachers have a major influence in the formation of primary school children’s eating behaviours. Although the cooperation of parents and teachers has frequently been recommended in the promotion of healthy eating habits among primary school children, little is known about the communication between these two groups regarding food- and nutrition-related issues. This paper reports findings from semi-structured interviews with primary school parents (n = 19) and primary teachers (n = 17), as well as findings from a survey of 787 parents in Australia. Audio-recorded interviews were analysed using NVivo and descriptive statistics were calculated for the survey questions. The results indicated that their communications involved various topics, including allergies, lunchbox content, and supervision requests, through diverse communication channels. The risk of offending each other and time scarcity were reported as communication barriers. Parents mainly expected teachers to ensure that their children were given enough time to eat their lunch, teach healthy eating, and be good role models of healthy eating. This study highlights the need to overcome communication barriers between parents and teachers and support teachers in their multifaceted professional roles.

A Multicomponent mHealth-Based Intervention (SWAP IT) to Decrease the Consumption of Discretionary Foods Packed in School Lunchboxes: Type I Effectiveness-Implementation Hybrid Cluster Randomized Controlled Trial

Background

There is significant opportunity to improve the nutritional quality of foods packed in children’s school lunchboxes. Interventions that are effective and scalable targeting the school and home environment are therefore warranted.

Objective

This study aimed to assess the effectiveness of a multicomponent, mobile health–based intervention, SWAP IT, in reducing the energy contribution of discretionary (ie, less healthy) foods and drinks packed for children to consume at school.

Methods

A type I effectiveness–implementation hybrid cluster randomized controlled trial was conducted in 32 primary schools located across 3 local health districts in New South Wales, Australia, to compare the effects of a 6-month intervention targeting foods packed in children’s lunchboxes with those of a usual care control. Primary schools were eligible if they were not participating in other nutrition studies and used the required school communication app. The Behaviour Change Wheel was used to co-design the multicomponent SWAP IT intervention, which consisted of the following: school lunchbox nutrition guidelines, curriculum lessons, information pushed to parents digitally via an existing school communication app, and additional parent resources to address common barriers to packing healthy lunchboxes. The primary outcome, mean energy (kilojoules) content of discretionary lunchbox foods and drinks packed in lunchboxes, was measured via observation using a validated school food checklist at baseline (May 2019) and at 6-month follow-up (October 2019). Additional secondary outcomes included mean lunchbox energy from discretionary foods consumed, mean total lunchbox energy packed and consumed, mean energy content of core lunchbox foods packed and consumed, and percentage of lunchbox energy from discretionary and core foods, all of which were also measured via observation using a validated school food checklist. Measures of school engagement, consumption of discretionary foods outside of school hours, and lunchbox cost were also collected at baseline and at 6-month follow-up. Data were analyzed via hierarchical linear regression models, with controlling for clustering, socioeconomic status, and remoteness.

Results

A total of 3022 (3022/7212, 41.90%) students consented to participate in the evaluation (mean age 7.8 years; 1487/3022, 49.22% girls). There were significant reductions between the intervention and control groups in the primary trial outcome, mean energy (kilojoules) content of discretionary foods packed in lunchboxes (–117.26 kJ; 95% CI –195.59 to –39.83; P=.003). Relative to the control, the intervention also significantly reduced secondary outcomes regarding the mean total lunchbox energy (kilojoules) packed (–88.38 kJ; 95% CI –172.84 to –3.92; P=.04) and consumed (–117.17 kJ; 95% CI –233.72 to –0.62; P=.05). There was no significant difference between groups in measures of student engagement, consumption of discretionary foods outside of school hours, or cost of foods packed in children’s lunchboxes.

Conclusions

The SWAP IT intervention was effective in reducing the energy content of foods packed for and consumed by primary school–aged children at school. Dissemination of the SWAP IT program at a population level has the potential to influence a significant proportion of primary school–aged children, impacting weight status and associated health care costs.

Trial Registration

Australian Clinical Trials Registry ACTRN12618001731280; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=376191&isReview=true

International Registered Report Identifier (IRRID)

RR2-10.1186/s12889-019-7725-x

A systematic evaluation of digital nutrition promotion websites and apps for supporting parents to influence children's nutrition

Background

Globally children’s diet quality is poor. Parents are primary gatekeepers to children’s food intake; however, reaching and engaging parents in nutrition promotion can be challenging. With growth in internet and smartphone use, digital platforms provide potential to disseminate information rapidly to many people. The objectives of this review were to conduct a comprehensive and systematic evaluation of nutrition promotion via websites and apps supporting parents to influence children’s nutrition, from three different perspectives: 1) current evidence base, 2) end user (parent) experience and 3) current commercial offerings.

Methods

Three systematic reviews were undertaken of (1) studies evaluating the effectiveness for digital platforms for improving nutrition in children and parents, (2) studies conducting user-testing of digital tools with parents, (3) websites and apps providing lunch-provision information to parents. Searches were conducted in five databases for reviews one and two, and systematic search of Google and App Store for review three. Randomised controlled trials, cohort and cross-sectional and qualitative studies (study two only) were included if published in English, from 2013, with the intervention targeted at parents and at least 50% of intervention content focused on nutrition. Search results were double screened, with data extracted into standardised spreadsheets and quality appraisal of included search results.

Results

Studies evaluating digital nutrition interventions targeting parents (n = 11) demonstrated effectiveness for improving nutrition outcomes, self-efficacy and knowledge. Six of the included randomised controlled trials reported digital interventions to be equal to, or better than comparison groups. User-testing studies (n = 9) identified that digital platforms should include both informative content and interactive features. Parents wanted evidence-based information from credible sources, practical tools, engaging content and connection with other users and health professionals. Websites targeting lunch provision (n = 15) were developed primarily by credible sources and included information-based content consistent with dietary guidelines and limited interactive features. Lunchbox apps (n = 6), developed mostly by commercial organisations, were more interactive but provided less credible information.

Conclusions

Digital nutrition promotion interventions targeting parents can be effective for improving nutrition-related outcomes in children and parents. As demonstrated from the lunchbox context and user-testing with parents, they need to go beyond just providing information about positive dietary changes, to include the user-desired features supporting interactivity and personalisation.

Protocol for an effectiveness- implementation hybrid trial to assess the effectiveness and cost-effectiveness of an m-health intervention to decrease the consumption of discretionary foods packed in school lunchboxes: the 'SWAP IT' trial

BACKGROUND

At a population level, small reductions in energy intake have the potential to contribute to a reduction in the prevalence of childhood obesity. In many school systems, there is the potential to achieve a reduction in energy intake through modest improvements in foods packed in children's school lunchboxes. This study will assess the effectiveness and cost-effectiveness of a multi-component intervention that uses an existing school-based communication application to reduce the kilojoule content from discretionary foods and drinks consumed by children from school lunchboxes whilst at school.

METHODS

A Type I hybrid effectiveness-implementation cluster randomised controlled trial will be conducted in up to 36 primary schools in the Hunter New England, Central Coast and Mid North Coast regions of New South Wales, Australia. Designed using the Behaviour Change Wheel, schools will be randomly allocated to receive either a 5-month (1.5 school terms) multi-component intervention that includes: 1) school lunchbox nutrition guidelines; 2) curriculum lessons; 3) information pushed to parents via an existing school-based communication application and 4) additional parent resources to address common barriers to packing healthy lunchboxes or a control arm (standard school practices). The study will assess both child level dietary outcomes and school-level implementation outcomes. The primary trial outcome, mean energy (kJ) content of discretionary lunchbox foods packed in children's lunchboxes, will be assessed at baseline and immediately post intervention (5 months or 1.5 school terms). Analyses will be performed using intention to treat principles, assessing differences between groups via hierarchical linear regression models.

DISCUSSION

This study will be the first fully powered randomised controlled trial internationally to examine the impact of an m-health intervention to reduce the mean energy from discretionary food and drinks packed in the school lunchbox. The intervention has been designed with scalability in mind and will address an important evidence gap which, if shown to be effective, has the potential to be applied at a population level.

TRIAL REGISTRATION

Australian Clinical Trials Registry ACTRN:12618001731280 registered on 17/10/2018. Protocol Version 1.

A randomized controlled trial to assess the potential efficacy, feasibility and acceptability of an m-health intervention targeting parents of school aged children to improve the nutritional quality of foods packed in the lunchbox 'SWAP IT'

BACKGROUND

Scalable interventions that improve the nutritional quality of foods in children's lunchboxes have considerable potential to improve child public health nutrition. This study assessed the potential efficacy, feasibility and acceptability of an m-health intervention, 'SWAP IT', to improve the energy and nutritional quality of foods packed in children's lunchboxes.

METHODS

The study employed a 2X2 factorial cluster randomized-controlled trial design. Twelve primary schools in New South Wales, Australia were randomly allocated to one of four groups: (i) no intervention;(ii) physical activity intervention only;(iii) lunchbox intervention only; or(iv) physical activity and lunchbox intervention combined. The two intervention strategies were evaluated separately. This paper focuses on the effects of the lunchbox intervention only. The lunchbox intervention comprised four strategies: 1) school nutrition guidelines; 2) lunchbox lessons; 3) information pushed to parents via a school-communication app and 4) parent resources addressing barriers to packing healthy lunchboxes. Outcome measures were taken at baseline and immediately post-intervention (10 weeks) and included measures of effectiveness (mean energy (kJ) packed in lunchboxes, total energy and percentage energy from recommended foods consistent with Australian Dietary Guidelines), feasibility (of delivering intervention to schools, parent app engagement and behaviour change) and acceptability to school staff and parents. Linear mixed models were used to assess intervention efficacy.

RESULTS

Of the 1915 lunchbox observations, at follow-up there was no significant differences between intervention and control group in mean energy of foods packed within lunchboxes (- 118.39 kJ, CI = -307.08, 70.30, p = 0.22). There was a significant increase favouring the intervention in the secondary outcome of mean lunchbox energy from recommended foods (79.21 kJ, CI = 1.99, 156.43, p = 0.04), and a non-significant increase in percentage of lunchbox energy from recommended foods in intervention schools (4.57%, CI = -0.52, 9.66, p = 0.08). The views of the messages pushed via the app ranged from 387 to 1550 views per week (mean views =1025 per week). A large proportion (71%) of parents reported awareness of the intervention, making healthier swaps in the lunchbox (55%), and pushed content was helpful (84%).

CONCLUSION

The study is the first RCT to assess the potential of a multi-component m-health lunchbox intervention. The intervention was feasible, acceptable and potentially effective in improving the nutritional quality of foods packed within children's lunchboxes.

TRIAL REGISTRATION

Australian Clinical Trials Registry ACTRN: ACTRN12616001228471 .

Cluster randomised controlled trial of an m-health intervention in centre-based childcare services to reduce the packing of discretionary foods in children's lunchboxes: study protocol for the 'SWAP IT Childcare' trial

INTRODUCTION

In many developed nations, including Australia, a substantial number of children aged under 5 years attend centre-based childcare services that require parents to pack food in lunchboxes. These lunchboxes often contain excessive amounts of unhealthy ('discretionary') foods. This study aims to assess the impact of a mobile health (m-health) intervention on reducing the packing of discretionary foods in children's childcare lunchboxes.

METHODS AND ANALYSIS

A cluster randomised controlled trial will be undertaken with parents from 18 centre-based childcare services in the Hunter New England region of New South Wales, Australia. Services will be randomised to receive either a 4-month m-health intervention called 'SWAP IT Childcare' or usual care. The development of the intervention was informed by the Behaviour Change Wheel model and will consist primarily of the provision of targeted information, lunchbox food guidelines and website links addressing parent barriers to packing healthy lunchboxes delivered through push notifications via an existing app used by childcare services to communicate with parents and carers. The primary outcomes of the trial will be energy (kilojoules) from discretionary foods packed in lunchboxes and the total energy (kilojoules), saturated fat (grams), total and added sugars (grams) and sodium (milligrams) from all foods packed in lunchboxes. Outcomes will be assessed by weighing and photographing all lunchbox food items at baseline and at the end of the intervention.

ETHICS AND DISSEMINATION

The study was approved by the Hunter New England Local Health District Human Ethics Committee (06/07/26/4.04) and ratified by the University of Newcastle, Human Research Ethics Committee (H-2008-0343). Evaluation and process data collected as part of the study will be disseminated in peer-reviewed publications and local, national and international presentations and will form part of PhD student theses.

TRIAL REGISTRATION NUMBER

ACTRN12618000133235; Pre-results.