Optimisation: defining and exploring a concept to enhance the impact of public health initiatives

Research outcomes informing the selection of public health interventions and strategies to implement them: A cross-sectional survey of Australian policy-maker and practitioner preferences

BACKGROUND

A key role of public health policy-makers and practitioners is to ensure beneficial interventions are implemented effectively enough to yield improvements in public health. The use of evidence to guide public health decision-making to achieve this is recommended. However, few studies have examined the relative value, as reported by policy-makers and practitioners, of different broad research outcomes (that is, measures of cost, acceptability, and effectiveness). To guide the conduct of research and better inform public health policy and practice, this study aimed at describing the research outcomes that Australian policy-makers and practitioners consider important for their decision-making when selecting: (a) public health interventions; (b) strategies to support their implementation; and (c) to assess the differences in research outcome preferences between policy-makers and practitioners.

METHOD

An online value-weighting survey was conducted with Australian public health policy-makers and practitioners working in the field of non-communicable disease prevention. Participants were presented with a list of research outcomes and were asked to select up to five they considered most critical to their decision-making. They then allocated 100 points across these - allocating more points to outcomes perceived as more important. Outcome lists were derived from a review and consolidation of evaluation and outcome frameworks in the fields of public health knowledge translation and implementation. We used descriptive statistics to report relative preferences overall and for policy-makers and practitioners separately.

RESULTS

Of the 186 participants; 90 primarily identified as policy-makers and 96 as public health prevention practitioners. Overall, research outcomes of effectiveness, equity, feasibility, and sustainability were identified as the four most important outcomes when considering either interventions or strategies to implement them. Scores were similar for most outcomes between policy-makers and practitioners.

CONCLUSION

For Australian policy-makers and practitioners working in the field of non-communicable disease prevention, outcomes related to effectiveness, equity, feasibility, and sustainability appear particularly important to their decisions about the interventions they select and the strategies they employ to implement them. The findings suggest researchers should seek to meet these information needs and prioritize the inclusion of such outcomes in their research and dissemination activities. The extent to which these outcomes are critical to informing the decision of policy-makers and practitioners working in other jurisdictions or contexts warrants further investigation.

An initial typology of approaches used by policy and practice agencies to achieve sustained implementation of interventions to improve health

BACKGROUND

Scientific investigation of how to sustain the implementation of evidence-based interventions (EBI) is emerging. Sustaining the implementation of EBIs helps ensure their effects on improving health endure. External policy or practice agencies, such as government health departments, are often tasked with supporting individual organisations with sustaining their delivery of EBIs, for example, through financing, training or the provision of other supports. However, to our knowledge, the approaches taken by policy and practice agencies to support the sustainment of EBIs have not been consolidated, categorised and described as a typology.

MAIN BODY

To improve conceptual clarity and support both research and practice, we developed an initial working typology of the practical approaches to sustain implementation of EBIs (i.e. sustainment) in order to improve long term health from the perspective of these agencies. The working typology includes three broad approaches. The first, termed 'Self-Sustainment', is when implementation of the EBI by an organisation (e.g. hospital, clinic, school) is expected to continue (sustain) in the absence of external (agency) support. The second, termed 'Static Sustainment Support', involves the provision of pre-defined external (agency) support to assist organisations to continue implementation of an EBI. The final approach is termed 'Dynamic Sustainment Support', whereby support provided by an external agency is dynamic (continues to be adapted) overtime to assist organisations continue implementation of an intervention which may itself also evolve.

CONCLUSIONS

We describe the contexts and circumstances where each may be most appropriate in achieving sustained implementation and discuss their research and practice implications.

Organizing implementation in healthcare: Balancing orders of worth

In this paper we direct attention to unavoidable conflicts between disparate value systems co-existing within organizations. Drawing on John Law's concept of ordering and Boltanski and Thévenot's orders of worth, we understand incompatibilities inherent in implementation and governance as competing orders. In extracting and articulating competing orders from our abductive analysis of semi-structured interviews with primary care managers (n = 32) in a Swedish county council, we hope to enable actors to utilise and address them as they engage in implementation work. The potential of such an approach is exemplified by analysing a regional case of health promotion implementation pursued in 2019, in a Swedish county council. Early approaches to implementation and governance have entailed linear models emphasizing program fidelity. Critics have broadened this view by calling for optimization of multiple values and more room for professional judgment. We seek to add to this development by attending to how healthcare practices often entail different and at times conflicting configurations of patients, professionals and priorities. The county council in our case study attempted to steer primary care providers towards health promotion work. To capture the realities of the organization that primary care managers described, we propose that three competing orders can be discerned in primary care: the order of immediate care, focusing on professional judgments of the most pressing needs of patients; the order of accessible care, in which patients themselves define what needs should be cared for; and the order of future health emphasizing prevention of health in the future population. Each order enacts a specific prioritization between patients and a vision of what is or should be primary in primary care. Organizing implementation, we suggest, requires a balancing of orders of worth.

Disseminating health research to public health policy-makers and practitioners: a survey of source, message content and delivery modality preferences

BACKGROUND

Understanding the views of policy-makers and practitioners regarding how best to communicate research evidence is important to support research use in their decision-making.

AIM

To quantify and describe public health policy-makers and practitioners' views regarding the source, content and form of messages describing public health research findings to inform their decision-making. We also sought to examine differences in preferences between public health policy-makers and practitioners.

METHODS

A cross sectional, value-weighting survey of policy-makers and practitioners was conducted. Participants were asked to allocate a proportion of 100 points across different (i) sources of research evidence, (ii) message content and (iii) the form in which evidence is presented. Points were allocated based on their rating of influence, usefulness and preference when making decisions about health policy or practice.

RESULTS

A total of 186 survey responses were received from 90 policy-makers and 96 practitioners. Researchers and government department agencies were the most influential source of research evidence based on mean allocation of points, followed by knowledge brokers, professional peers and associations. Mean point allocation for perceived usefulness of message content was highest for simple summary of key findings and implications, and then evidence-based recommendations and data and statistical summaries. Finally, based on mean scores, policy-makers and practitioners preferred to receive research evidence in the form of peer-reviewed publications, reports, evidence briefs and plain language summaries. There were few differences in scores between policy-makers and practitioners across source, message content or form assessments or those with experience in different behavioural areas.

CONCLUSIONS

The findings should provide a basis for the future development and optimization of dissemination strategies to this important stakeholder group.

Analysis of Centralized Efficiency Improvement Practices in Australian Public Health Systems

Aim

Analysis of centralized efficiency improvement practices in Australian public health systems.

Introduction

Public health systems seek to maximize outcomes generated for resources used through efficiency improvement (EI) in response to funding and demand pressures. Despite this focus, evidence for EI approaches at the whole-of-system level is lacking in the literature. There is an urgent need for evidence-based approaches to centralized EI to address these pressures. This study aims to address this gap by answering the research question "How is EI conceptualized and managed by central public health system management entities in Australia?".

Material and Methods

Document analysis was selected due to its suitability for systematically searching and appraising health system documentation, with this study following Altheide's approach focusing on whole-of-system strategic plan and management framework documents originating from Australian public health organizations.

Results

Conceptualization of efficiency varied substantially with no consistent definition identified, however common attributes included resource use, management, service and delivery. Forty-two of 43 documents contained approaches associated with improving efficiency at the whole of system level.

Discussion

While no comprehensive framework for centralized EI was evident, we identified nine core approaches which together characterize centralized EI. Together these approaches represent a comprehensive evidence-based approach to EI at the whole of system level.

Conclusion

The approaches to whole-of-system EI identified in this study are likely to be highly transferable across health systems internationally with approaches including strategic priority setting, incentivization, performance support, use of EI evidence, digital enablement and workforce capability development.

Improving academic and public health impact of Cochrane public health reviews: what can we learn from bibliographic metrics and author dissemination strategies? A cross-sectional study

BACKGROUND

To facilitate the development of impactful research dissemination strategies, this study aimed to: (i) survey authors of trials included in a sample of Cochrane reviews to describe strategies to disseminate trial findings, and examine their association with academic and policy impacts and (ii) audit academic and policy impact of CPH reviews.

METHODS

Authors of 104 trials within identified Cochrane reviews completed survey items assessing the dissemination strategies. Field weighted citation (FWCI) data extracted from bibliographic databases served as a measure of academic impact of trials and CPH reviews. Policy and practice impacts of trials were assessed during the survey of trial authors using items based on the Payback Framework, and for CPH reviews using 'policy mention' data collected via Altmetric Explorer.

RESULTS

Among the included trials, univariate (but not multivariable) regression models revealed significant associations between the use of dissemination strategies (i.e. posts on social media; workshops with end-users; media-releases) and policy or practice impacts. No significant associations were reported between dissemination strategies and trial FWCI. The mean FWCI of CPH reviews suggest that they are cited 220% more than other reviews in their field.

CONCLUSIONS

Comprehensive dissemination strategies are likely required to maximize the potential the potential impacts of public health research.

Do the Expert Recommendations for Implementing Change (ERIC) strategies adequately address sustainment?

Background

Sustainability science is an emerging area within implementation science. There is limited evidence regarding strategies to best support the continued delivery and sustained impact of evidence-based interventions (EBIs). To build such evidence, clear definitions, and ways to operationalize strategies specific and/or relevant to sustainment are required. Taxonomies and compilations such as the Expert Recommendations for Implementing Change (ERIC) were developed to describe and organize implementation strategies. This study aimed to adapt, refine, and extend the ERIC compilation to incorporate an explicit focus on sustainment. We also sought to classify the specific phase(s) of implementation when the ERIC strategies could be considered and applied.

Methods

We used a two-phase iterative approach to adapt the ERIC. This involved: (1) adapting through consensus (ERIC strategies were mapped against barriers to sustainment as identified via the literature to identify if existing implementation strategies were sufficient to address sustainment, needed wording changes, or if new strategies were required) and; (2) preliminary application of this sustainment-explicit ERIC glossary (strategies described in published sustainment interventions were coded against the glossary to identify if any further amendments were needed). All team members independently reviewed changes and provided feedback for subsequent iterations until consensus was reached. Following this, and utilizing the same consensus process, the Exploration, Preparation, Implementation and Sustainment (EPIS) Framework was applied to identify when each strategy may be best employed across phases.

Results

Surface level changes were made to the definitions of 41 of the 73 ERIC strategies to explicitly address sustainment. Four additional strategies received deeper changes in their definitions. One new strategy was identified: Communicate with stakeholders the continued impact of the evidence-based practice. Application of the EPIS identified that at least three-quarters of strategies should be considered during preparation and implementation phases as they are likely to impact sustainment.

Conclusion

A sustainment-explicit ERIC glossary is provided to help researchers and practitioners develop, test, or apply strategies to improve the sustainment of EBIs in real-world settings. Whilst most ERIC strategies only needed minor changes, their impact on sustainment needs to be tested empirically which may require significant refinement or additions in the future.

Driving Efficiency Improvement (EI): Exploratory Analysis of a Centralised Model in New South Wales

Introduction

Public healthcare systems face rising demand coupled with reducing funding growth rates, necessitating ongoing approaches to efficiency improvement (EI). Centrally coordinated EI approaches l may support EI leaders, yet few such approaches exist internationally. This study provides evidence to inform system-wide EI by harnessing understanding of the perceptions, role demands and support requirements of key EI stakeholders in the centralised EI model implemented in New South Wales.

Methods

A purposive sample of key informants within NSW Health with responsibility for EI in their organisation were invited to participate. Semi-structured interviews were conducted, recorded and transcribed. A thematic analysis was undertaken using a theoretical deductive approach.

Results

Seventeen respondents participated who occupied EI leadership roles in metro (8) and rural (6) health services as well as non-clinical support (3) services. Four primary themes emerged on the perceptions and experiences of participants in 1. holding a unique skillset which enables them to undertake EI; 2. inheriting EI accountabilities as additional duties rather than holding dedicated EI roles; 3. the importance of senior support for EI success; and 4. feelings of isolation in undertaking EI. An additional underpinning theme that EI is not well conceptualized in public health systems also emerged, whereby EI planners felt that frontline staff generally do not consider efficiency as a component of their duties.

Conclusion

EI leaders provide points of authority, experience and influence across organisations within public health systems. This study finds that EI planners possess a unique skillset, can feel isolated both within their health organisation and within the broader public health system and believe that EI is poorly conceptualized amongst health staff. Centralised support for EI stakeholders across a public health system can promote knowledge sharing and capability development. Addressing the role and support requirements of key EI stakeholders is essential.

Strategies for enhancing the implementation of school-based policies or practices targeting diet, physical activity, obesity, tobacco or alcohol use

BACKGROUND

Several school-based interventions are effective in improving child diet and physical activity, and preventing excessive weight gain, and tobacco or harmful alcohol use. However, schools are frequently unsuccessful in implementing such evidence-based interventions.

OBJECTIVES

1. To evaluate the benefits and harms of strategies aiming to improve school implementation of interventions to address student diet, physical activity, tobacco or alcohol use, and obesity. 2. To evaluate the benefits and harms of strategies to improve intervention implementation on measures of student diet, physical activity, obesity, tobacco use or alcohol use; describe their cost or cost-effectiveness; and any harms of strategies on schools, school staff or students.

SEARCH METHODS

We used standard, extensive Cochrane search methods. The latest search was between 1 September 2016 and 30 April 2021 to identify any relevant trials published since the last published review.

SELECTION CRITERIA

We defined 'Implementation' as the use of strategies to adopt and integrate evidence-based health interventions and to change practice patterns within specific settings. We included any trial (randomised controlled trial (RCT) or non-randomised controlled trial (non-RCT)) conducted at any scale, with a parallel control group that compared a strategy to implement policies or practices to address diet, physical activity, overweight or obesity, tobacco or alcohol use by students to 'no intervention', 'usual' practice or a different implementation strategy.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane methods. Given the large number of outcomes reported, we selected and included the effects of a single outcome measure for each trial for the primary (implementation) and secondary (student health behaviour and obesity) outcomes using a decision hierarchy. Where possible, we calculated standardised mean differences (SMDs) to account for variable outcome measures with 95% confidence intervals (CI). For RCTs, we conducted meta-analyses of primary and secondary outcomes using a random-effects model, or in instances where there were between two and five studies, a fixed-effect model. The synthesis of the effects for non-randomised studies followed the 'Synthesis without meta-analysis' (SWiM) guidelines.

MAIN RESULTS

We included an additional 11 trials in this update bringing the total number of included studies in the review to 38. Of these, 22 were conducted in the USA. Twenty-six studies used RCT designs. Seventeen trials tested strategies to implement healthy eating, 12 physical activity and six a combination of risk factors. Just one trial sought to increase the implementation of interventions to delay initiation or reduce the consumption of alcohol. All trials used multiple implementation strategies, the most common being educational materials, educational outreach and educational meetings. The overall certainty of evidence was low and ranged from very low to moderate for secondary review outcomes. Pooled analyses of RCTs found, relative to a control, the use of implementation strategies may result in a large increase in the implementation of interventions in schools (SMD 1.04, 95% CI 0.74 to 1.34; 22 RCTs, 1917 participants; low-certainty evidence). For secondary outcomes we found, relative to control, the use of implementation strategies to support intervention implementation may result in a slight improvement on measures of student diet (SMD 0.08, 95% CI 0.02 to 0.15; 11 RCTs, 16,649 participants; low-certainty evidence) and physical activity (SMD 0.09, 95% CI -0.02 to 0.19; 9 RCTs, 16,389 participants; low-certainty evidence). The effects on obesity probably suggest little to no difference (SMD -0.02, 95% CI -0.05 to 0.02; 8 RCTs, 18,618 participants; moderate-certainty evidence). The effects on tobacco use are very uncertain (SMD -0.03, 95% CIs -0.23 to 0.18; 3 RCTs, 3635 participants; very low-certainty evidence). One RCT assessed measures of student alcohol use and found strategies to support implementation may result in a slight increase in use (odds ratio 1.10, 95% CI 0.77 to 1.56; P = 0.60; 2105 participants). Few trials reported the economic evaluations of implementation strategies, the methods of which were heterogeneous and evidence graded as very uncertain. A lack of consistent terminology describing implementation strategies was an important limitation of the review.

AUTHORS' CONCLUSIONS

The use of implementation strategies may result in large increases in implementation of interventions, and slight improvements in measures of student diet, and physical activity. Further research is required to assess the impact of implementation strategies on such behavioural- and obesity-related outcomes, including on measures of alcohol use, where the findings of one trial suggest it may slightly increase student risk. Given the low certainty of the available evidence for most measures further research is required to guide efforts to facilitate the translation of evidence into practice in this setting.

Optimising a multi-strategy implementation intervention to improve the delivery of a school physical activity policy at scale: findings from a randomised noninferiority trial

Background

To maximise their potential health benefits, school-based physical activity policies need to be implemented at scale. This paper describes the third in a sequence of trials that sought to optimise an effective strategy (PACE) to assist schools’ implementation of a physical activity policy. Specifically, it aimed to determine the probability that a multi-strategy intervention adapted to reduce in-person contact (Adapted PACE) was “as good as” the original intervention (PACE) in increasing the weekly minutes of structured physical activity implemented by classroom teachers.

Methods

A noninferiority cluster randomised controlled trial was undertaken with 48 primary schools in New South Wales, Australia. Schools were randomised to receive PACE or a model with adaptations made to the delivery modes (Adapted PACE). Teachers’ scheduled minutes of weekly physical activity was assessed at baseline (Oct 2018-Feb 2019) and 12-month follow-up (Oct-Dec 2019). The noninferiority margin was set at − 16.4 minutes based on previous data and decision panel consensus. A linear mixed model analysed within a Bayesian framework was used to explore noninferiority between the two PACE models. A cost minimisation analysis was conducted from the health service provider perspective, using the Australian dollar (AUD).

Results

The posterior estimate for the between group difference at follow-up was − 2.3 minutes (95% credible interval = − 18.02, 14.45 minutes). There was an estimated 96% probability of Adapted PACE being considered noninferior (only 4% of the posterior samples crossed the noninferiority margin of − 16.4 minutes). That is, the minutes of physical activity implemented by teachers at Adapted PACE schools was not meaningfully less than the minutes of physical activity implemented by teachers at PACE schools. The mean total cost was AUD$25,375 (95% uncertainty interval = $21,499, $29,106) for PACE and AUD$16,421 (95% uncertainty interval = $13,974, $19,656) for Adapted PACE; an estimated reduction of AUD$373 (95% uncertainty interval = $173, $560) per school.

Conclusions

It is highly probable that Adapted PACE is noninferior to the original model. It is a cost-efficient alternative also likely to be a more suitable approach to supporting large scale implementation of school physical activity policies.

Trial registration

Retrospectively registered with the Australian New Zealand Clinical Trials Registry (ACTRN12619001229167).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-022-01345-6.

Practice change intervention to improve antenatal care addressing alcohol consumption during pregnancy: a randomised stepped-wedge controlled trial

Background

Clinical guideline recommendations for addressing alcohol consumption during pregnancy are sub-optimally implemented and limited evidence exists to inform practice improvements. The aim of this study was to estimate the effectiveness of a practice change intervention in improving the provision of antenatal care addressing alcohol consumption during pregnancy in public maternity services.

Methods

A randomised stepped-wedge controlled trial was undertaken with all public maternity services in three sectors (one urban, two regional/rural) of a single local health district in New South Wales, Australia. All antenatal care providers were subject to a seven-month multi-strategy intervention to support the introduction of a recommended model of care. For 35 months (July 2017 – May 2020) outcome data were collected from randomly selected women post an initial, 27–28 weeks and 35–36 weeks gestation antenatal visit. Logistic regression models assessed intervention effectiveness.

Results

Five thousand six hundred ninety-four interviews/online questionnaires were completed by pregnant women. The intervention was effective in increasing women’s reported receipt of: assessment of alcohol consumption (OR: 2.63; 95% CI: 2.26–3.05; p < 0.001), advice not to consume alcohol during pregnancy and of potential risks (OR: 2.07; 95% CI: 1.78–2.41; p < 0.001), complete care relevant to alcohol risk level (advice and referral) (OR: 2.10; 95% CI: 1.80–2.44; p < 0.001) and all guideline elements relevant to alcohol risk level (assessment, advice and referral) (OR: 2.32; 95% CI: 1.94–2.76; p < 0.001). Greater intervention effects were found at the 27–28 and 35–36 weeks gestation visits compared with the initial antenatal visit. No differences by sector were found. Almost all women (98.8%) reported that the model of care was acceptable.

Conclusions

The practice change intervention improved the provision of antenatal care addressing alcohol consumption during pregnancy in public maternity services. Future research could explore the characteristics of pregnant women and maternity services associated with intervention effectiveness as well as the sustainment of care practices over time to inform the need for, and development of, further tailored practice change support.

Trial registration

Australian and New Zealand Clinical Trials Registry (Registration number: ACTRN12617000882325; Registration date: 16/06/2017) https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372985&isReview=true

Identifying essential implementation strategies: a mixed methods process evaluation of a multi-strategy policy implementation intervention for schools

BACKGROUND

Physically Active Children in Education (PACE) is composed of eight implementation strategies that improves schools' implementation of a government physical activity policy. A greater understanding of each discrete implementation strategy could inform improvements to PACE for delivery at-scale. This study aimed to: (A) measure the dose delivered, fidelity, adoption and acceptability of each strategy using quantitative data; (B) identify implementation barriers and facilitators using qualitative data; and (C) explore the importance of each strategy by integrating both data sets (mixed methods).

METHODS

This study used data from a cluster randomised noninferiority trial comparing PACE with an adapted version (Adapted PACE) that was delivered with reduced in-person external support to reduce costs and increase scalability. Data were collected from both trials arms for between-group comparison. Descriptive statistics were produced using surveys of principals, in-school champions and teachers; and project records maintained by PACE project officers (objective A). Thematic analysis was performed using in-school champion and project officer interviews (objective B). Both data sets were integrated via a triangulation protocol and findings synthesized in the form of meta-inferences (objective C).

RESULTS

Eleven in-school champions and six project officers completed interviews; 33 principals, 51 in-school champions and 260 teachers completed surveys. Regardless of group allocation, implementation indicators were high for at least one component of each strategy: dose delivered =100%, fidelity ≥95%, adoption ≥83%, acceptability ≥50%; and several implementation barriers and facilitators were identified within three broad categories: external policy landscape, inner organizational structure/context of schools, and intervention characteristics and processes. All strategies were considered important as use varied by school, however support from a school executive and in-school champions' interest were suggested as especially important for optimal implementation.

CONCLUSION

This study highlights the importance of both executive support and in-school champions for successful implementation of school physical activity policies. In particular, identifying and supporting an in-school champion to have high power and high interest is recommended for future implementation strategies. This may reduce the need for intensive external support, thus improving intervention scalability.

Exploring a parent-focused physical literacy intervention for early childhood: a pragmatic controlled trial of the PLAYshop

Background

Parents play a key role in young children’s physical activity and physical literacy development. Little research has explored parent-focused interventions to improve young children’s physical literacy. We examined if a theory-based, feasible physical literacy training workshop (PLAYshop) for parents could improve their physical literacy knowledge and confidence and improve parenting practices related to facilitating the physical literacy development of their preschool-aged child (3-5 years). The secondary objective was to explore implementation facilitators and barriers.

Methods

We conducted a pragmatic controlled trial in two Canadian cities (Edmonton and Victoria) from November 2019 – March 2020. A total of 143/151 parents were eligible and assigned to intervention (n = 71) or control group (n = 72). The PLAYshop included: (i) a 75-min in-person workshop with interactive activities and physical literacy educational messages, (ii) educational materials, (iii) an equipment pack, and (iv) two post-workshop booster emails. Surveys measured parents’ knowledge and confidence at baseline and follow-up. Application of PLAYshop concepts and implementation facilitators and barriers were explored with interviews of parents and workshop leaders. Repeated measures ANOVAs and thematic analyses were completed.

Results

Parents’ knowledge and confidence improved significantly over time; intervention group changes were significantly greater than control group changes (p < 0.001; ɳ² = .32). Parents applied PLAYshop concepts at-home, including child-led play, making activities fun, and promoting child manipulative and locomotor skills. Time was a key parental implementation barrier. Program implementation issues varied by context (location and participants).

Conclusions

PLAYshop participation changed parents’ physical literacy knowledge and confidence and physical literacy enhancing play with their children. Implementation feasibility was high. The findings from this real-world trial highlight an efficacious and scalable intervention that warrants further testing.

Trial registration

ClinicalTrials.gov: NCT04394312. Registered 19/05/2020.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13048-5.

Evaluating the reach, effectiveness, adoption, implementation and maintenance of the Resistance Training for Teens program

BACKGROUND

Physical activity guidelines recommend young people engage in regular muscle-strengthening activities (e.g., resistance training [RT]). However, few school-based physical activity interventions have been delivered at-scale or promoted RT. The aim of this study was to evaluate the reach, effectiveness, adoption, implementation and maintenance of the Resistance Training for Teens (RT for Teens) program.

METHODS

Data were collected between August 2015 and October 2020. RE-AIM was operationalized as: (i) Reach: number and characteristics of students estimated to be exposed to the program; (ii) Effectiveness: impact of the program on student-level outcomes measured in a subsample of 750 students from 17 schools; (iii) Adoption: number and representativeness of schools with one or more teachers trained to deliver the program; (iv) Implementation: extent to which the program was delivered as intended; and (v) Maintenance: extent to which the program was sustained in schools.

RESULTS

The estimated program reach was ~ 10,000 students, out of a total student population of ~ 200,000 (~ 5%). Students were from diverse socioeconomic and ethnic backgrounds. Improvements in muscular fitness, RT self-efficacy, perceived cardiorespiratory fitness and flexibility, and participation in muscle-strengthening physical activities were documented. A total of 30 workshops were delivered, involving 468 teachers from 249 schools from diverse geographical regions. Implementation varied considerably, with teachers adapting the program to suit the context of their school and student cohorts. However, RT skill development and the promotion of muscular fitness were the session components delivered most during sessions. Teachers' adherence to the SAAFE (Supportive, Active, Autonomous, Fair and Enjoyable) teaching principles was high. Approximately 30% of teachers (144/476) registered to use the RT for Teens app. At the school-level, 37% (93/249) of schools had at least one registered user (teacher and/or student). A total of 2,336 workouts and 3,116 fitness tests were completed by registered users. Of the 249 schools represented, 51 (20.5%) sent an additional (previously untrained) teacher to a second workshop.

CONCLUSIONS

The RT for Teens program had broad reach and adoption. However, intervention delivery varied considerably across schools and additional support strategies are required to optimize intervention implementation and maintain program delivery over time. Future studies will benefit from the utilization of accepted frameworks, recommendations and guidelines for implementation research.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry (ACTRN12621000352808), retrospectively registered 1^st February 2021.

Enhancing the potential effects of text messages delivered via an m-health intervention to improve packing of healthy school lunchboxes

OBJECTIVE

The aim of the study was to assess the impact of different lunchbox messages on parents' intention to pack a healthy lunchbox.

DESIGN

This study employed an experimental design.

SETTING

A series of messages were developed to align with the six constructs of the Health Belief Model. Messages were also developed that were (and were not) personalised and varied based on the source of the information provided (university, school, dietitian and health promotion service). During a telephone survey, participants were read the content of each message and asked about their intention to pack a healthy lunchbox.

PARTICIPANTS

Parents of primary school-aged children were randomised to receive different messages to encourage the packing of healthy lunchboxes.

RESULTS

The study was completed by 511 parents. Linear mixed regression analyses identified significant differences (P < 0·05) in intention scores between variant messages targeting the same behavioural constructs for 'susceptibility', 'severity', 'benefits' and 'barriers' but not 'cues to action' or 'self-efficacy'. The highest mean behavioural intention score was for 'benefits', whilst the lowest mean score was for 'barriers'. There were no significant differences in intention scores of parents receiving messages from a dietitian, university, health promotion team or school (P = 0·37). Intention scores did not differ in which messages were personalised based on child's name (P = 0·84) or grade level (P = 0·54).

CONCLUSIONS

The findings suggest that messages that focus on the benefits of packing healthy lunchboxes may be particularly useful in improving intentions of parents to pack healthy foods for their children to consume at school.

Adapting Behavioral Interventions for a Changing Public Health Context: A Worked Example of Implementing a Digital Intervention During a Global Pandemic Using Rapid Optimisation Methods

Background: A rigorous approach is needed to inform rapid adaptation and optimisation of behavioral interventions in evolving public health contexts, such as the Covid-19 pandemic. This helps ensure that interventions are relevant, persuasive, and feasible while remaining evidence-based. This paper provides a set of iterative methods to rapidly adapt and optimize an intervention during implementation. These methods are demonstrated through the example of optimizing an effective online handwashing intervention called Germ Defense. Methods: Three revised versions of the intervention were rapidly optimized and launched within short timeframes of 1-2 months. Optimisations were informed by: regular stakeholder engagement; emerging scientific evidence, and changing government guidance; rapid qualitative research (telephone think-aloud interviews and open-text surveys), and analyses of usage data. All feedback was rapidly collated, using the Table of Changes method from the Person-Based Approach to prioritize potential optimisations in terms of their likely impact on behavior change. Written feedback from stakeholders on each new iteration of the intervention also informed specific optimisations of the content. Results: Working closely with clinical stakeholders ensured that the intervention was clinically accurate, for example, confirming that information about transmission and exposure was consistent with evidence. Patient and Public Involvement (PPI) contributors identified important clarifications to intervention content, such as whether Covid-19 can be transmitted via air as well as surfaces, and ensured that information about difficult behaviors (such as self-isolation) was supportive and feasible. Iterative updates were made in line with emerging evidence, including changes to the information about face-coverings and opening windows. Qualitative research provided insights into barriers to engaging with the intervention and target behaviors, with open-text surveys providing a useful supplement to detailed think-aloud interviews. Usage data helped identify common points of disengagement, which guided decisions about optimisations. The Table of Changes was modified to facilitate rapid collation and prioritization of multiple sources of feedback to inform optimisations. Engagement with PPI informed the optimisation process. Conclusions: Rapid optimisation methods of this kind may in future be used to help improve the speed and efficiency of adaptation, optimization, and implementation of interventions, in line with calls for more rapid, pragmatic health research methods.

"It makes me feel not so alone": features of the Choose to Move physical activity intervention that reduce loneliness in older adults

BACKGROUND

Despite the well-known health benefits of physical activity (PA), older adults are the least active citizens. Older adults are also at risk for loneliness. Given that lonely individuals are at risk for accelerated loss of physical functioning and health with age, PA interventions that aim to enhance social connectedness may decrease loneliness and increase long-term PA participation. The objectives of this mixed-method study are to: (1) evaluate whether an evidence-based PA intervention (Choose to Move; CTM) influenced PA and loneliness differently among self-identified 'lonely' versus 'not lonely' older adults and (2) to describe factors within CTM components most likely to promote social connectedness/reduce loneliness.

METHODS

CTM is a flexible, scalable, community-based health promoting physical activity intervention for older adults. Two community delivery partner organizations delivered 56 CTM programs in 26 urban locations across British Columbia. We collected survey data from participants (n = 458 at baseline) at 0 (baseline), 3 (mid-intervention) and 6 (post-intervention) months. We conducted in depth interviews with a subset of older adults to understand how CTM facilitated or impeded their PA and social connectedness.

RESULTS

PA increased significantly from baseline to 3 months in lonely and not lonely participants. PA decreased significantly from 3 to 6 months in lonely participants; however, PA at 6 months remained significantly above baseline levels in both groups. Loneliness decreased significantly from baseline to 3 and 6 months in participants identifying as lonely at baseline. Factors within CTM components that promote social connectedness/reduce loneliness include: Activity coach characteristics/personality traits and approaches; opportunity to share information and experiences and learn from others; engagement with others who share similar/familiar experiences; increased opportunity for meaningful interaction; and accountability.

CONCLUSION

Health promoting interventions that focus on PA and social connectedness through group-based activities can effectively reduce social isolation and loneliness of older adults. Given the 'epidemic of loneliness' that plagues many countries currently, these kinds of interventions are timely and important. Research that further delineates mechanisms (e.g., sharing experiences vs. lectures), that modify the effect of an intervention on social connectedness outcomes for older adults engaged in community-based PA programs would be a welcome addition to the literature.

Process Evaluation of a School-Based High-Intensity Interval Training Program for Older Adolescents: The Burn 2 Learn Cluster Randomised Controlled Trial

Process evaluations can help to optimise the implementation of school-based physical activity interventions. The purpose of this paper is to describe the process evaluation of a school-based high-intensity interval training (HIIT) program for older adolescent students, known as Burn 2 Learn (B2L). B2L was evaluated via a cluster randomised controlled trial in 20 secondary schools (10 intervention, 10 control) in New South Wales, Australia. Teachers (n = 22 (55% female)) from the 10 intervention schools, delivered the program over three phases (Phases 1 and 2, 6 months; Phase 3, 6 months) to older adolescent students (n = 337 (50% female); mean ± standard deviation (SD) age = 16.0 ± 0.4 years). Process evaluation data were collected across the 12-month study period. Teachers delivered 2.0 ± 0.8 and 1.7 ± 0.6 sessions/week in Phases 1 and 2 respectively (mean total 25.9 ± 5.2), but only 0.6 ± 0.7 sessions/week in Phase 3. Observational data showed that session quality was high, however heart rate (HR) data indicated that only half of the students reached the prescribed threshold of ≥85% predicted HRmax during sessions. Over 80% of teachers reported they intended to deliver the B2L program to future student cohorts. Almost 70% of students indicated they intended to participate in HIIT in the future. Teachers considered the program to be adaptable, and both students and teachers were satisfied with the intervention. B2L was implemented with moderate-to-high fidelity in Phases 1 and 2, but low in Phase 3. Our findings add to the relatively scant process evaluation literature focused on the delivery of school-based physical activity programs.

How to optimise public health interventions: a scoping review of guidance from optimisation process frameworks

Background

Optimisation processes have the potential to rapidly improve the impact of health interventions. Optimisation can be defined as a deliberate, iterative and data-driven process to improve a health intervention and/or its implementation to meet stakeholder-defined public health impacts within resource constraints. This study aimed to identify frameworks used to optimise the impact of health interventions and/or their implementation, and characterise the key concepts, steps or processes of identified frameworks.

Methods

A scoping review of MEDLINE, CINAL, PsycINFO, and ProQuest Nursing & Allied Health Source databases was undertaken. Two reviewers independently coded the key concepts, steps or processes involved in each frameworks, and identified if it was a framework aimed to optimise interventions or their implementation. Two review authors then identified the common steps across included frameworks.

Results

Twenty optimisation frameworks were identified. Eight frameworks were for optimising interventions, 11 for optimising implementation and one covered both intervention and implementation optimisation. The mean number of steps within the frameworks was six (range 3–9). Almost half (n = 8) could be classified as both linear and cyclic frameworks, indicating that some steps may occur multiple times in a single framework. Two meta-frameworks are proposed, one for intervention optimisation and one for implementation strategy optimisation. Steps for intervention optimisation are: Problem identification; Preparation; Theoretical/Literature base; Pilot/Feasibility testing; Optimisation; Evaluation; and Long-term implementation. Steps for implementation strategy optimisation are: Problem identification; Collaborate; Plan/design; Pilot; Do/change; Study/evaluate/check; Act; Sustain/endure; and Disseminate/extend.

Conclusions

This review provides a useful summary of the common steps followed to optimise a public health intervention or its implementation according to established frameworks. Further opportunities to study and/or validate such frameworks and their impact on improving outcomes exist.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-020-09950-5.

Would they trust it? An exploration of psychosocial and environmental factors affecting prescriber acceptance of computerised dose-recommendation software

AIMS

Dose-prediction software can optimise vancomycin therapy, improving therapeutic drug monitoring processes and reducing drug toxicity. Success of software in hospitals may be dependent on prescriber uptake of software recommendations. This study aimed to identify the perceived psychosocial and environmental barriers and facilitators to prescriber acceptance of dose-prediction software.

METHODS

Semi-structured interviews, incorporating prescribing scenarios, were undertaken with 17 prescribers. Participants were asked to prescribe the next maintenance dose of vancomycin for a scenario(s) and then asked if they would accept a recommendation provided by a dose-prediction software. Interviews further explored opinions of dose-prediction software. Interview transcripts were analysed using an inductive approach to identify themes and the Theoretical Domains Framework was used to synthesise barriers and facilitators to software acceptance.

RESULTS

When presented with software recommendations, half of the participants were comfortable with accepting the recommendation. Key barriers to acceptance of software recommendations aligned with 2 Theoretical Domains Framework domains: Knowledge (uncertainty of software capability) and Beliefs about Consequences (perceived impact of software on clinical outcomes and workload). Key facilitators aligned with 2 domains: Beliefs about Consequences (improved efficiency) and Social Influences (influence of peers). A novel domain, Trust, was identified as influential.

CONCLUSION

Prescribers reported barriers to acceptance of dose-prediction software aligned with limited understanding of, and scepticism about, software capabilities, as well as concerns about clinical outcomes. Identification of key barriers and facilitators to acceptance provides essential information to design of implementation strategies to support the introduction of this intervention into the workplace.

Interventions for increasing fruit and vegetable consumption in children aged five years and under

BACKGROUND

Insufficient consumption of fruits and vegetables in childhood increases the risk of future non-communicable diseases, including cardiovascular disease. Testing the effects of interventions to increase consumption of fruit and vegetables, including those focused on specific child-feeding strategies or broader multicomponent interventions targeting the home or childcare environment is required to assess the potential to reduce this disease burden.

OBJECTIVES

To assess the effectiveness, cost effectiveness and associated adverse events of interventions designed to increase the consumption of fruit, vegetables or both amongst children aged five years and under.

SEARCH METHODS

We searched CENTRAL, MEDLINE, Embase and two clinical trials registries to identify eligible trials on 25 January 2020. We searched Proquest Dissertations and Theses in November 2019. We reviewed reference lists of included trials and handsearched three international nutrition journals. We contacted authors of included trials to identify further potentially relevant trials.

SELECTION CRITERIA

We included randomised controlled trials, including cluster-randomised controlled trials and cross-over trials, of any intervention primarily targeting consumption of fruit, vegetables or both among children aged five years and under, and incorporating a dietary or biochemical assessment of fruit or vegetable consumption. Two review authors independently screened titles and abstracts of identified papers; a third review author resolved disagreements.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data and assessed the risks of bias of included trials; a third review author resolved disagreements. Due to unexplained heterogeneity, we used random-effects models in meta-analyses for the primary review outcomes where we identified sufficient trials. We calculated standardised mean differences (SMDs) to account for the heterogeneity of fruit and vegetable consumption measures. We conducted assessments of risks of bias and evaluated the quality of evidence (GRADE approach) using Cochrane procedures.

MAIN RESULTS

We included 80 trials with 218 trial arms and 12,965 participants. Fifty trials examined the impact of child-feeding practices (e.g. repeated food exposure) in increasing child vegetable intake. Fifteen trials examined the impact of parent nutrition education only in increasing child fruit and vegetable intake. Fourteen trials examined the impact of multicomponent interventions (e.g. parent nutrition education and preschool policy changes) in increasing child fruit and vegetable intake. Two trials examined the effect of a nutrition education intervention delivered to children in increasing child fruit and vegetable intake. One trial examined the impact of a child-focused mindfulness intervention in increasing vegetable intake. We judged 23 of the 80 included trials as free from high risks of bias across all domains. Performance, detection and attrition bias were the most common domains judged at high risk of bias for the remaining trials. There is low-quality evidence that child-feeding practices versus no intervention may have a small positive effect on child vegetable consumption, equivalent to an increase of 5.30 grams as-desired consumption of vegetables (SMD 0.50, 95% CI 0.29 to 0.71; 19 trials, 2140 participants; mean post-intervention follow-up = 8.3 weeks). Multicomponent interventions versus no intervention has a small effect on child consumption of fruit and vegetables (SMD 0.32, 95% CI 0.09 to 0.55; 9 trials, 2961 participants; moderate-quality evidence; mean post-intervention follow-up = 5.4 weeks), equivalent to an increase of 0.34 cups of fruit and vegetables a day. It is uncertain whether there are any short-term differences in child consumption of fruit and vegetables in meta-analyses of trials examining parent nutrition education versus no intervention (SMD 0.13, 95% CI -0.02 to 0.28; 11 trials, 3050 participants; very low-quality evidence; mean post-intervention follow-up = 13.2 weeks). We were unable to pool child nutrition education interventions in meta-analysis; both trials reported a positive intervention effect on child consumption of fruit and vegetables (low-quality evidence). Very few trials reported long-term effectiveness (6 trials), cost effectiveness (1 trial) or unintended adverse consequences of interventions (2 trials), limiting our ability to assess these outcomes. Trials reported receiving governmental or charitable funds, except for four trials reporting industry funding.

AUTHORS' CONCLUSIONS

Despite identifying 80 eligible trials of various intervention approaches, the evidence for how to increase children's fruit and vegetable consumption remains limited in terms of quality of evidence and magnitude of effect. Of the types of interventions identified, there was moderate-quality evidence that multicomponent interventions probably lead to, and low-quality evidence that child-feeding practice may lead to, only small increases in fruit and vegetable consumption in children aged five years and under. It is uncertain whether parent nutrition education or child nutrition education interventions alone are effective in increasing fruit and vegetable consumption in children aged five years and under. Our confidence in effect estimates for all intervention approaches, with the exception of multicomponent interventions, is limited on the basis of the very low to low-quality evidence. Long-term follow-up of at least 12 months is required and future research should adopt more rigorous methods to advance the field. This is a living systematic review. Living systematic reviews offer a new approach to review updating, in which the review is continually updated, incorporating relevant new evidence as it becomes available. Please refer to the Cochrane Database of Systematic Reviews for the current status of this review.