Embedding researchers in health service organizations improves research translation and health service performance: the Australian Hunter New England Population Health example

Collaborations between health services and educational institutions to develop research capacity in health services and health service staff: a systematic scoping review

BACKGROUND

Participation of health service staff in research improves health outcomes and adherence to clinical guidelines. To increase research participation, many health services seek to build research capacity which adds to the development of individual and organisational skills and abilities in order to conduct health research. Numerous approaches to research capacity building have been trialed with inter- and intra-institutional, or university-health service collaborative approaches being frequently described strategies. University-health service research collaborations have potential for high impact and mutual benefit, by harnessing respective strengths across both organisations. However, the range and scope of research capacity building approaches, including their relative value and success have not been consolidated. The aim of this review was to examine and describe the collaborative strategies employed by health services in conjunction with educational partners to enhance the research capability of health service staff.

METHODS

The scoping review framework by Arksey and O'Malley was used to inform the review method. A systematic search was conducted of four major databases: Medline, CINAHL, Embase, and Cochrane, focusing on publications after 1995. Inclusion and exclusion criteria were established through iterative team discussions. The two-stage screening process and data extraction was managed in Covidence. Collaboration, Research Capacity, Health Services, and Health workforce were the primary concepts, contexts and populations guiding the search.

RESULTS

Of the 1462 studies identified, 61 were selected for the review. These studies reported on partnerships between universities and health services with a specific focus on building research capacity of health service staff. Studies predominantly hailed from Australia, USA, UK, and Canada. Collaboration approaches varied and leveraged different activities to build research capacity included training, mentoring, shared funding, and networking. Training partnerships emerging as the most prevalent. Findings emphasised the importance of localisation in approaches, with some studies indicating the intrinsic value of such collaborations for both partners involved. Despite the emphasis on individual interventions like training and mentoring, team-level interventions were notably scarce.

CONCLUSION

This review highlights the diverse range of approaches in research capacity building collaborations between health services and educational partners. It advocates for a shared understanding of goals, highlighting the critical nature of relationship-building and the pivotal role of sustainable infrastructure in long-term collaboration success. Future directions should consider the tangible impacts of these models on clinical outcomes.

Barriers and facilitators to dissemination of non-communicable diseases research: a mixed studies systematic review

Background

There is a large number of research studies about the prevention of non-communicable diseases (NCD), with findings taking several years to be translated into practice. One reason for this lack of translation is a limited understanding of how to best disseminate NCD research findings to user-groups in a way that is salient and useful. An understanding of barriers and facilitators to dissemination is key to informing the development of strategies to increase dissemination. Therefore, this review aims to identify and synthesise the barriers and facilitators to dissemination of NCD research findings.

Methods

A mixed studies systematic review was performed following JBI (formerly known as Joanna Briggs Institute) methodology. The search included articles from January 2000 until May 2021. We conducted a comprehensive search of bibliographic and grey literature of five databases to identify eligible studies. Studies were included if they involved end-users of public health research that were decision-makers in their setting and examined barriers/facilitators to disseminating research findings. Two pairs of reviewers mapped data from included studies against the Framework of Knowledge Translation (FKT) and used a convergent approach to synthesise the data.

Results

The database search yielded 27,192 reports. Following screening and full text review, 15 studies (ten qualitative, one quantitative and four mixed methods) were included. Studies were conducted in 12 mostly high-income countries, with a total of 871 participants. We identified 12 barriers and 14 facilitators mapped to five elements of the FKT. Barriers related to: (i) the user-group (n = 3) such as not perceiving health as important and (ii) the dissemination strategies (n = 3) such as lack of understanding of content of guidelines. Several facilitators related to dissemination strategies (n = 5) such as using different channels of communication. Facilitators also related to the user-group (n = 4) such as the user-groups' interest in health and research.

Conclusion

Researchers and government organisations should consider these factors when identifying ways to disseminate research findings to decision-maker audiences. Future research should aim to build the evidence base on different strategies to overcome these barriers.

Systematic review registration

The protocol of this review was deposited in Open Science Framework (https://doi.org/10.17605/OSF.IO/5QSGD).

Learning health systems to implement chronic disease prevention programs: A novel framework and perspectives from an Australian health service

Background

Chronic diseases are a considerable burden to health systems, communities, and patients. Much of this burden, however, could be prevented if interventions effective in reducing chronic disease risks were routinely implemented.

Aims

The aim of this paper is to discuss the role of public health agencies in preventing chronic disease through the application of learning health system (LHS) approaches to improve the implementation of evidence-based interventions.

Materials and Methods

We draw on the literature and our experience operating a local LHS in Australia that has achieved rapid improvements in the implementation of chronic disease prevention interventions.

Results

The proposed LHS framework has been adapted to be both implementation and chronic disease prevention focused. The framework describes both broad improvement processes, and the infrastructure and other support (pillars) recommended to support its core functions.

Conclusion

The framework serves as a basis for further exploration of the potentially transformative role LHS's may have in addressing the chronic disease health crisis.

Process Evaluation of a Scaled-Up School-Based Physical Activity Program for Adolescents: Physical Activity 4 Everyone

BACKGROUND

Physical Activity 4 Everyone (PA4E1) is a whole-school physical activity program, with demonstrated efficacy (2012-2014). PA4E1 was adapted (scaled-up) and tested in a scale-up trial (2017-2020). This process evaluation study of the scale-up trial had 2 aims. First, to describe the acceptability, appropriateness, and feasibility of PA4E1 in the scale-up trial, from the perspective of school staff involved in the program management and delivery. Second, to generate themes that may explain school staff assessments of acceptability, appropriateness, and feasibility.

METHODS

Data were collected at various time points throughout the 2-year implementation phase. Online surveys were collected from In-School Champions, Head Physical Education teachers, Principals, and Physical Education teachers (quantitative data). Focus groups and interviews were conducted with In-School Champions, Principals, and Physical Education teachers (qualitative data). Existing published data on website engagement, adaptations, modifications, and the scale-up trial primary outcome (implementation of physical activity practices) were triangulated with the quantitative and qualitative during analysis, to generate themes.

RESULTS

School staff delivering PA4E1 reported it was highly acceptable, appropriate, and feasible. Seven themes were generated relating to acceptability, appropriateness, and feasibility. The themes related to how the program was funded, the delivery modes of implementation support, the identification of easy-wins, the recruitment of the right in-school champion, facilitating principal buy-in, mitigating the impact of school staff turnover, and engaging the whole school.

CONCLUSIONS

Recommendations are made to inform future adaptations for PA4E1 and potentially school-based physical activity programs more generally. The findings may inform future scalability assessments of the suitability of programs for scale-up.

Learning Health System to rapidly improve the implementation of a school physical activity policy

BACKGROUND

Learning Health Systems (LHS) - characterised by cycles of evidence generation and application - are increasingly recognised for their potential to improve public health interventions and optimise health impacts; however there is little evidence of their application in the context of public health practice. Here, we describe how an Australian public health unit applied a LHS approach to successfully improve a model of support for implementation of a school-based physical activity policy.

METHODS

This body of work was undertaken in the context of a strong research-practice partnership. Core LHS capabilities included: i) partnerships and stakeholder engagement; ii) workforce development and learning health communities; iii) multi-disciplinary scientific expertise; iv) practice data collection and management system; v) evidence surveillance and synthesis; and vi) governance and organisational processes of decision making. Three cycles of data generation and application were used. Within each cycle, randomised controlled trials conducted in NSW primary schools were used to generate data on the support model's effectiveness for improving schools' implementation of a government physical activity policy, its delivery costs, and process measures such as adoption and acceptability. Each type of data were analysed independently, synthesised, and then presented to a multi-disciplinary team of researchers and practitioners, in consult with stakeholders, leading to collaborative decisions for incremental improvements to the support model.

RESULTS

Cycle 1 tested the first version of the support model (composed of five implementation strategies targeting identified barriers of policy implementation) and showed the model's feasibility and efficacy for improving schools' policy implementation. Data-informed changes were made to enhance impact, including the addition of three implementation strategies to address outstanding barriers. Cycle 2 (now, testing a package of eight implementation strategies) established the model's effectiveness and cost-effectiveness for improving school's policy implementation. Data-informed changes were made to reduce delivery costs, specifically adapting the costliest strategies to reduce in-person contact from external support personnel. Cycle 3 showed that the adaptations minimised the relative cost of delivery without adversely impacting on the effect.

CONCLUSIONS

Through this process, we identified an effective, cost-effective, acceptable and scalable policy implementation support model for service delivery. This provides important information to inform or support LHS approaches for other agencies seeking to optimise the health impact of evidence-based interventions.

Developing the embedded researcher role: Learning from the first year of the National Institute for Health and Care Research (NIHR), Health Determinants Research Collaboration (HDRC), Doncaster, UK

Background

Strategies to embed research knowledge into decision making contexts include the Embedded Research (ER) model, which involves the collocation of academic researchers in non-academic organisations such as hospitals and local authorities. A local authority in Doncaster, United Kingdom (UK) has adopted an embedded researcher model within the National Institute for Health and Care Research (NIHR), Health Determinants Research Collaboration (HDRC). This five-year collaboration enables universities and local authorities to work together to reduce health inequalities and target the social determinants of health. Building on previous embedded research models, this approach is unique due to its significant scale and long-term investment. In this opinion paper Embedded Researchers (ERs) reflect on their experiences of the first year of the collaboration.

Study design

A reflective consultation exercise.

Methods

Observation of HDRC delivery meetings, as well as informal discussions and a short proforma with ERs (N = 8).

Results

ERs valued the five-year timeframe which provided a unique opportunity for strengthened relationships and to apply formative learning as the programme progressed. However, differences in knowledge of undertaking research across the HDRC team and between practitioners and academics require each to respect different professional experiences and to avoid potential power imbalances. Diverse projects required researchers to be generalists, applying their expertise to multiple topics. This requires careful priority setting alongside workload and expectation management.

Conclusions

The significant scale and investment of the HDRC provides a unique opportunity for developing the ER role by applying formative learning as the programme progresses. However, success will require careful management of workload allocation and relationships between ERs and practitioners. Further learning on how to embed ERs within local authority contexts will emerge as the programme matures.

Unpacking the cost of the lunchbox for Australian families: a secondary analysis

Ninety per cent of Australian school children bring a home-packed lunch to school, with 44% of the food consumed during school hours being unhealthy. Among other factors, cost is a key consideration for food provision; however, the costs to Australian families are not well understood. Therefore, we aimed to determine what families are currently paying for school lunchboxes in Australian primary schools and to examine associations between food costs and socio-demographic factors with dietary quality. An audit of local retail outlets was used to determine the food costs of lunchbox contents. Costs (AUD) were adjusted for inflation as of early 2023. The lunchboxes of 1026 children aged 4-12 years at 12 Catholic primary schools in New South Wales, Australia, were assessed at the start of the day, using photography assessment methods and a validated School Food Checklist. The mean cost of lunchbox contents was $4.48 AUD (SD 1.53), containing a mean energy of 2699 kJ (SD 859), with 37.3% (SD 23.9) of energy sourced from unhealthy foods. Multiple linear regression analyses found that the strongest predictors of higher lunchbox cost (P < 0.05) were a higher proportion of energy from unhealthy foods (B = 0.016) and lower Socio-Economic Indexes for Areas (B = -0.178), when controlling for child socio-demographics. The results indicated that lunchbox food costs to Australian families are comparable to alternative school food service models in Australia and internationally. Results demonstrate the cost of food is not the only barrier to providing a healthy school lunchbox. Demonstrating a need for cost-considerate systematic interventions addressing food provision challenges and socio-economic disparities faced by families.

Models and approaches for building knowledge translation capacity and capability in health services: a scoping review

BACKGROUND

Building healthcare service and health professionals' capacity and capability to rapidly translate research evidence into health practice is critical to the effectiveness and sustainability of healthcare systems. This review scoped the literature describing programmes to build knowledge translation capacity and capability in health professionals and healthcare services, and the evidence supporting these.

METHODS

This scoping review was undertaken using the Joanna Briggs Institute scoping review methodology. Four research databases (Ovid MEDLINE, CINAHL, Embase, and PsycInfo) were searched using a pre-determined strategy. Eligible studies described a programme implemented in healthcare settings to build health professional or healthcare service knowledge translation capacity and capability. Abstracts and full texts considered for inclusion were screened by two researchers. Data from included papers were extracted using a bespoke tool informed by the scoping review questions.

RESULTS

Database searches yielded 10,509 unique citations, of which 136 full texts were reviewed. Thirty-four papers were included, with three additional papers identified on citation searching, resulting in 37 papers describing 34 knowledge translation capability building programmes. Programmes were often multifaceted, comprising a combination of two or more strategies including education, dedicated implementation support roles, strategic research-practice partnerships and collaborations, co-designed knowledge translation capability building programmes, and dedicated funding for knowledge translation. Many programmes utilised experiential and collaborative learning, and targeted either individual, team, organisational, or system levels of impact. Twenty-seven programmes were evaluated formally using one or more data collection methods. Outcomes measured varied significantly and included participant self-reported outcomes, perceived barriers and enablers of knowledge translation, milestone achievement and behaviour change. All papers reported that programme objectives were achieved to varying degrees.

CONCLUSIONS

Knowledge translation capacity and capability building programmes in healthcare settings are multifaceted, often include education to facilitate experiential and collaborative learning, and target individual, team, organisational, or supra-organisational levels of impact. Although measured differently across the programmes, the outcomes were positive. The sustainability of programmes and outcomes may be undermined by the lack of long-term funding and inconsistent evaluation. Future research is required to develop evidence-informed frameworks to guide methods and outcome measures for short-, medium- and longer-term programme evaluation at the different structural levels.

A cluster randomised controlled trial to assess the effectiveness of a multi-strategy sustainability intervention on teachers' sustained implementation of classroom physical activity breaks (energisers): study protocol

BACKGROUND

Governments internationally have invested hugely in the implementation and scale-up of school-based physical activity interventions, but have little evidence of how to best sustain these interventions once active implementation support ceases. This study will assess the effectiveness of a multi-strategy sustainability intervention on classroom teachers' sustainment of energisers (short 3-5 min physical activity breaks during class-time) scheduled across the school day from baseline to 12 and 24-month follow-up.

METHODS

A cluster randomised controlled trial will be conducted in 50 primary schools within the Hunter New England, Illawarra Shoalhaven, Murrumbidgee and Northern New South Wales (NSW) Local Health Districts of NSW Australia. Schools will be randomly allocated to receive either usual support or the multi-strategy sustainability intervention that includes: centralised technical assistance from a trained project officer; formal commitment and mandated change obtained from school principals; training in-school champions; reminders for teachers; educational materials provided to teachers; capturing and sharing local knowledge; and engagement of parents, carers and the wider school community. The primary trial outcome will be measured via a teacher logbook to determine the between-group difference in the change in mean minutes of energisers scheduled across the school day at 12 and 24-month follow-up compared to baseline. Analyses will be performed using an intention to treat framework. Linear mixed models will be used to assess intervention effects on the primary outcome at both follow-up periods.

DISCUSSION

This study will be one of the first randomised controlled trials to examine the impact of a multi-strategy sustainability intervention to support schools' sustainment of a physical activity intervention. The proposed research will generate new evidence needed for the partnering organisations to protect their considerable investments to date in physical activity promotion in this setting and will provide seminal evidence for the field globally.

TRIAL REGISTRATION

ACTRN12620000372987 version 1 registered 17th March 2020. Version 3 (current version) updated 4th August 2023.

Organisational benefits of undertaking research in healthcare: an approach to uncover impact

There is increasing focus to review the societal impact of research through assessment and research excellence frameworks. These often link to financial and reputational incentives within the academic community. However, timeframes to demonstrate impact using these approaches are often long and are not designed to show benefit to service collaborators who require evidence of improvement and change to their services more immediately. Impacts that are measured this way may also miss out on unintended and positive impacts that occur as by-products of research, or through the 'ripple effect' that research may have on practice. Importantly, demonstrating how research makes a difference can improve the research culture in services, and motivations in service partners to become, and stay involved in research. This article describes, and provides access to, a tool called VICTOR (making Visible the ImpaCT Of Research) that was developed by a community of practice involving 12 NHS organisations through blending evidence from the literature, practice and service users. We describe the types of impact that have been collected by VICTOR and explore how collecting impact in this way might help research-practice partnerships and inform research methodologies and may be useful to show impacts alongside, and shortly after the research process.

The Value and Impacts of Academic Public Health Departments

The academic health department (AHD) is a partnership between an academic institution and a governmental health agency. These partnerships are meant to provide mutual benefits that include opportunities for student field placements and internships, practice-informed curriculum, and practice-based research. The term academic health department dates back only to 2000, although there are several examples of academic-practice partnerships prior to that date. In addition to AHDs that have been established over the past two decades, other forms of academic-practice engagement provide similar mutual benefits, such as prevention research centers and public health training centers. Current research on AHDs explores how these partnerships matter regarding the outputs, outcomes, and impacts of the units that comprise them. This review also considers the most recent perspectives on how AHDs have responded to the COVID-19 pandemic and how they might advance public health's efforts to address structural racism and promote health equity.

Describing the evidence-base for research engagement by health care providers and health care organisations: a scoping review

BACKGROUND

Having a research-engaged health and medical workforce is associated with improvements in clinical outcomes for patients. As such, there has been significant government investment internationally to support health care organisations and services to increase staff engagement with research.

OBJECTIVES

This scoping review sought to provide an overview of the literature describing strategies employed to increase research engagement by health care providers and organisations, and to undertake a qualitative analysis to generate a list of research engagement strategies.

METHODS

A scoping review using systematic search strategies was undertaken to locate peer-review publications and grey literature related to research engagement by health care providers and organisations. Research engagement was defined as a 'deliberate set of intellectual and practical activities undertaken by health care staff and organisations to conduct research'. A database search of electronic records was performed with no limit on publication date. Publications were included regardless of study type (excluding systematic reviews) and categorised as either databased (presenting data or new analysis of existing data) and non-databased (no new data or analyses). Databased publications were further classified according to study type, study design and setting. A qualitative synthesis using a Framework Approach was undertaken with all studies that described a strategy to improve research engagement.

RESULTS

A total of 152 publications were included in this study with 54% categorised as non-databased. Of the databased articles, the majority (72%) were descriptive studies describing prevalence of correlates of research engagement, 17 (25%) described intervention studies where only two were controlled studies. The following research engagement strategies were identified: i) dual skilled team/staff, ii) resources or physical infrastructure, iii) incentives, iv) leadership support of research, v) education/training, vi) networks, vii) forming partnerships or collaborations and viii) overall leadership structure of entity.

CONCLUSIONS

The literature on research engagement is primarily opinion-based and descriptive in nature. To provide the evidence needed to inform strategies, this needs to progress beyond descriptive to more rigorous well-designed intervention research.

"We're Not Providing the Best Care If We Are Not on the Cutting Edge of Research": A Research Impact Evaluation at a Regional Australian Hospital and Health Service

BACKGROUND

Research is central to high functioning health services alongside clinical care and health professional training. The impact of embedded research includes delivery of high-quality care and improved patient outcomes. Evaluations of research impact help health service leadership ensure investments lead to the greatest healthcare benefits for patients. This study aimed to retrospectively evaluate the impact of research investment from 2008 to 2018 at Townsville Hospital and Health Service (THHS), a regional Hospital and Health Service (HHS) in Queensland, Australia. The evaluation also sought to identify contextual conditions that enable or hinder intended impacts.

METHODS

A mixed-methods realist-informed evaluation was conducted using documentation, interviews with 15 staff and available databases to identify and measure research investments, impacts and contextual conditions influencing impact outcomes.

RESULTS

Between 2008 and 2018, THHS increased resources for research by funding research projects, employing research personnel, building research-enabling facilities, hosting research events, and providing research education and training. Clinical practice, policy and workforce impacts were successful in isolated pockets, championed by individual researchers and facilitated by their policy and community-of-practice networks. However, there was little organisational-level support for continuity of research and implementation into practice and policy. Availability of research supports varied geographically across THHS, and across disciplines.

CONCLUSION

Definitive steps in the development of THHS as a credible and productive research centre and leading hospital research centre in Northern Australia are evident. Continuing investments should address support for the research continuum through to translation and establish ongoing, systematic processes for evaluating research investment and impact.

Developing a co-production strategy to facilitate the adoption and implementation of evidence-based colorectal cancer screening interventions for rural health systems: a pilot study

BACKGROUND

Evidence-based colorectal cancer screening (CRCS) interventions have not been broadly adopted in rural primary care settings. Co-production of implementation strategies through a bundled approach may be promising in closing this gap by helping rural healthcare practitioners select and implement the best fitting CRCS interventions to the local context. This paper describes the process and outcomes of co-development and delivery of the bundled implementation strategy to improve adoption and implementation of CRCS interventions with two rural clinics.

METHODS

We used a bundle of implementation strategies with a core focus on academic-clinical partnership development (strategy 1) and Plan-Do-Study-Act cycles (strategy 2) to identify clinical partner interests/preferences on delivery methods and content needed to facilitate intervention identification and implementation that improves CRCS. We also developed an implementation blueprint for each clinic (strategy 3) through an online blueprinting process based on adapted "Putting Public Health Evidence in Action" (PPHEA) training curriculum. Clinic physicians and staff (n = 7) were asked to evaluate the bundled approach based on overall reactions and perceptions of innovation characteristics using 5-point Likert scale. After completing the bundled approach, we collected implementation outcomes and limited intervention effectiveness of the CRCS evidence-based interventions (EBIs) developed through the process.

RESULTS

Our co-production strategy yielded a prototype online blueprinting process consisting of 8 distance-learning PPHEA modules that guide selection and implementation of EBIs tailored to CRCS. Modules were delivered to clinic participants with minor adaptations, using PDSA cycle to improve quality of module contents and formats. Overall, participants in both clinics reported positive reactions toward the bundled approach. Both clinics reported improvements in how they perceived the characteristics of the innovation (the bundled approach) to tailor selected CRCS EBIs. As a result of the bundled strategies, each clinic selected and adopted specific EBI(s) with the varying degrees of implementation and CRCS outcomes.

CONCLUSIONS

The bundle of implementation strategies used were feasible and acceptable in rural primary care practices to facilitate the use of EBIs to improve CRCS.

Critical realist exploration of long-term outcomes, impacts and skill development from an Australian Rural Research Capacity Building Programme: a qualitative study

OBJECTIVES

Research capacity building programmes usually only examine short-term outcomes, following up participants after 1 or 2 years. Capacity building in health research requires a long-term view to understand the influence and impact of capacity building endeavours. This study examined long-term outcomes for individuals regarding the maintenance and use of research skills and the conduct of real-world research in a rural area. We also explored the changes individuals had seen in their career, work team or organisation as a result of this training.

DESIGN

A qualitative study underpinned by critical realism and based on interviews and focus groups with graduates of the Rural Research Capacity Building Programme (RRCBP), a researcher development programme that has been delivered since 2006.

SETTING

Rural and remote areas of New South Wales, Australia.

PARTICIPANTS

22 graduates of the RRCBP from the 2006 to 2015 cohorts (20 female, 2 male). All were experienced rural-based health workers at the time of training.

RESULTS

Focus groups and interviews yielded three themes about capacity building outcomes: (1) developed research capable individuals; (2) embedded research capability into teams and (3) real-world research that makes a difference within an organisation.

CONCLUSIONS

Research training improved graduates' skill, experience, confidence and employability. Research capable individuals enabled others, enhancing team research capacity and raising the profile of research within their organisation.Training in research, alongside tangible organisational support for research activity, creates real-world impacts for policy and clinical practice. Providing ongoing opportunities for researchers to undertake research would enhance return on investment and assist with retention of experienced staff.

Optimising a multi-strategy implementation intervention to improve the delivery of a school physical activity policy at scale: findings from a randomised noninferiority trial

Background

To maximise their potential health benefits, school-based physical activity policies need to be implemented at scale. This paper describes the third in a sequence of trials that sought to optimise an effective strategy (PACE) to assist schools’ implementation of a physical activity policy. Specifically, it aimed to determine the probability that a multi-strategy intervention adapted to reduce in-person contact (Adapted PACE) was “as good as” the original intervention (PACE) in increasing the weekly minutes of structured physical activity implemented by classroom teachers.

Methods

A noninferiority cluster randomised controlled trial was undertaken with 48 primary schools in New South Wales, Australia. Schools were randomised to receive PACE or a model with adaptations made to the delivery modes (Adapted PACE). Teachers’ scheduled minutes of weekly physical activity was assessed at baseline (Oct 2018-Feb 2019) and 12-month follow-up (Oct-Dec 2019). The noninferiority margin was set at − 16.4 minutes based on previous data and decision panel consensus. A linear mixed model analysed within a Bayesian framework was used to explore noninferiority between the two PACE models. A cost minimisation analysis was conducted from the health service provider perspective, using the Australian dollar (AUD).

Results

The posterior estimate for the between group difference at follow-up was − 2.3 minutes (95% credible interval = − 18.02, 14.45 minutes). There was an estimated 96% probability of Adapted PACE being considered noninferior (only 4% of the posterior samples crossed the noninferiority margin of − 16.4 minutes). That is, the minutes of physical activity implemented by teachers at Adapted PACE schools was not meaningfully less than the minutes of physical activity implemented by teachers at PACE schools. The mean total cost was AUD$25,375 (95% uncertainty interval = $21,499, $29,106) for PACE and AUD$16,421 (95% uncertainty interval = $13,974, $19,656) for Adapted PACE; an estimated reduction of AUD$373 (95% uncertainty interval = $173, $560) per school.

Conclusions

It is highly probable that Adapted PACE is noninferior to the original model. It is a cost-efficient alternative also likely to be a more suitable approach to supporting large scale implementation of school physical activity policies.

Trial registration

Retrospectively registered with the Australian New Zealand Clinical Trials Registry (ACTRN12619001229167).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-022-01345-6.

Promises and pitfalls in implementation science from the perspective of US-based researchers: learning from a pre-mortem

BACKGROUND

Implementation science is at a sufficiently advanced stage that it is appropriate for the field to reflect on progress thus far in achieving its vision, with a goal of charting a path forward. In this debate, we offer such reflections and report on potential threats that might stymie progress, as well as opportunities to enhance the success and impact of the field, from the perspective of a group of US-based researchers.

MAIN BODY

Ten mid-career extramurally funded US-based researchers completed a "pre-mortem" or a group brainstorming exercise that leverages prospective hindsight to imagine that an event has already occurred and to generate an explanation for it - to reduce the likelihood of a poor outcome. We came to consensus on six key themes related to threats and opportunities for the field: (1) insufficient impact, (2) too much emphasis on being a "legitimate science," (3) re-creation of the evidence-to-practice gap, (4) difficulty balancing accessibility and field coherence, (5) inability to align timelines and priorities with partners, and (6) overly complex implementation strategies and approaches.

CONCLUSION

We submit this debate piece to generate further discussion with other implementation partners as our field continues to develop and evolve. We hope the key opportunities identified will enhance the future of implementation research in the USA and spark discussion across international groups. We will continue to learn with humility about how best to implement with the goal of achieving equitable population health impact at scale.

Using knowledge brokering activities to promote allied health clinicians' engagement in research: a qualitative exploration

INTRODUCTION

Engaging clinicians in research can improve healthcare organisational performance, patient and staff satisfaction. Emerging evidence suggests that knowledge brokering activities potentially support clinicians' research engagement, but it is unclear how best they should be used.

OBJECTIVES

This study explores how embedded researchers utilised knowledge brokering activities to engage research interested clinicians in research.

DESIGN

A longitudinal qualitative interview based study was co-designed to investigate how experienced research fellows utilise knowledge brokering activities to facilitate allied health clinicians' engagement in research.

SETTING

In one large tertiary level, regional Australian health service, research fellows were matched with research interested clinicians.

METHODS

Qualitative analysis of three longitudinal semi-structured interviews for each research fellow was undertaken. Initial descriptions of their utilisation of knowledge brokering activities were deductively coded. Reflexive thematic analysis was utilised to generate a shared explanation of clinicians' engagement in research.

RESULTS

Three research fellows facilitated 21 clinicians' participation in and leadership of clinical research projects over 12 months. They utilised all ten key knowledge brokering activities with each clinician, with differing patterns and examples. Research fellows described using linkage and exchange activities of communicating and collaborating with key stakeholders, and they tailored knowledge management products for individual's engagement. Further, they described a broader learning journey where they clarified and monitored individuals' capabilities, motivation and their contextual support for research engagement.

CONCLUSION

When research fellows chose and tailored knowledge brokering activities to align and extend clinicians' research capabilities and motivation, they created individualised learning curriculums to support clinicians' participation in and leadership of local research projects. Health and academic leaders should consider structuring embedded researcher positions to include knowledge brokering roles and activities, specifically for research interested clinicians who are ready to participate in and lead research projects.

Understanding the sustainment of population health programmes from a whole-of-system approach

BACKGROUND

Population health prevention programmes are needed to reduce the prevalence of chronic diseases. Nevertheless, sustaining programmes at a population level is challenging. Population health is highly influenced by social, economic and political environments and is vulnerable to these system-level changes. The aim of this research was to examine the factors and mechanisms contributing to the sustainment of population prevention programmes taking a systems thinking approach.

METHODS

We conducted a qualitative study through interviews with population health experts working within Australian government and non-government agencies experienced in sustaining public health programs at the local, state or national level (n = 13). We used a deductive thematic approach, grounded in systems thinking to analyse data.

RESULTS

We identified four key barriers affecting program sustainment: 1) short term political and funding cycles; 2) competing interests; 3) silo thinking within health service delivery; and 4) the fit of a program to population needs. To overcome these barriers various approaches have centred on the importance of long-range planning and resourcing, flexible program design and management, leadership and partnerships, evidence generation, and system support structures.

CONCLUSION

This study provides key insights for overcoming challenges to the sustainment of population health programmes amidst complex system-wide changes.

Development and implementation of a shared governance model in a mainstream health unit: a case study of embedding Aboriginal voices in organisational decision making

This case study focuses on the development and implementation of a governance structure and processes by a mainstream health unit that valued the principles of Aboriginal self-determination, empowerment and leadership by Aboriginal staff in organisational and service delivery decisions and elevated Aboriginal voices by embedding cultural inclusion in such decision making. Various models of embedding Aboriginal voices in the governance of the unit were developed and implemented over time. Ongoing review and reflection identified limitations and opportunities for improving the embedding of Aboriginal voices in organisational decision making. In 2017, Aboriginal staff and senior management implemented a joint governance model for providing strategic leadership of the unit with the objective of enhancing the delivery of culturally appropriate population health services for the benefit of Aboriginal communities. In its 3 years of operation to date, the model has provided strategic oversight of the organisation, implemented several strategic initiatives, including a cultural assessment process, maintaining and strengthening Aboriginal recruitment, monitoring employment vacancies, establishing a wellbeing leadership group, monitoring budget allocation and developing an Aboriginal data management protocol, and has provided additional professional development opportunities for Aboriginal staff. This case study demonstrates the feasibility, importance and benefits of engaging and embedding Aboriginal voices in the governance of a mainstream health service delivery unit, as well as the need for ongoing reflection and improvement. Further translation of the model to the operational levels of the unit is required. The governance model has the potential to be replicated in a tailored manner in other mainstream health units and organisations delivering services to Aboriginal peoples and communities. What is known about the topic? Aboriginal people continue to experience the poorest health outcomes of any population group in Australia. Closing the gap in Aboriginal health requires Aboriginal people to be active and equal participants in all levels of decision making. Governance of mainstream health organisations is predominantly positioned in the Western medical positivist paradigm, which fails to embed Aboriginal voices in organisational and service delivery decision making. What does this paper add? This case study describes the processes taken and the outcomes achieved thus far by a mainstream health service delivery unit developing and implementing a governance model that embedded Aboriginal perspectives in its decision making. It highlights that through commitment and persistence, as well as acknowledging the challenges of working between two worlds, it is possible to reconstruct existing governance models, allowing respectful and meaningful space for Aboriginal people to co-design and co-share the governance of health service delivery. This case study demonstrates the potential of the cultural governance model to be replicated and applied to other mainstream health service delivery units. What are the implications for practitioners? This case study highlights the need for health services to invest in employing and empowering Aboriginal people to co-develop and co-lead a shared approach to organisational governance through processes that are culturally safe, inclusive and appropriate.

Complex Interventions Deserve Complex Evaluations: A Transdisciplinary Approach to Evaluation of a Preventive Personalized Medicine Intervention

Non-communicable diseases (NCDs) are the largest cause of disability and death globally. The human and financial costs of NCDs have raised questions of sustainability for many health systems. Personalized, preventive health interventions are an innovative way to address NCDs, but it is difficult to measure their effectiveness using standard evaluation methods. This article describes a novel approach to evaluation by coupling transdisciplinary methods with realist theory to design and pilot a health outcomes evaluation for a personalized medicine approach to NCD prevention in Istanbul, Turkey. Research and practice stakeholders contributed to study design, research questions, validation of results, and recommendations through interactive workshops, consistent dialogue, and reflection. They co-created a customized outcome measurement framework and recommendations that promote sustainability and continuous improvement of future evaluations. The participatory methods helped resolve the dichotomy between patient, practitioner, and researcher focus in the evaluation and improved stakeholders' data literacy. This research contributes to the body of evidence advocating for the use of non-standard methods such as transdisciplinary research to evaluate the effectiveness of complex interventions. The results of the pilot evaluation are also presented as a case study.

Strategies for effective implementation and scale-up of a multi-level co-designed men's health initiative "Sheds for Life" in Irish Men's Sheds

Sheds for Life is a gender-specific tailored men's health initiative engaging "hard-to-reach" men in the Men's Shed setting in Ireland. It is implemented by multiple stakeholders at individual, provider, organization and systems level and thus multiple contextual factors influence its scalability. This research used established implementation science frameworks to guide participatory research approaches that captured the process and identified facilitators of and barriers to implementation and scale-up. Active recruitment, co-design processes, leadership and stakeholder engagement emerged as key facilitators of implementation. Prominent barriers were institutional capacity and funding. Acceptability, adoption and appropriateness of the initiative were high among stakeholders with sustainability largely contingent on funding and staff resources. Findings make a valuable contribution to knowledge by capturing the process involved in the implementation of a complex multi-level men's health intervention. It provides a "how to" guide of strategies to engage hard-to-reach men with health promotion, the operationalization and application of implementation frameworks in community-based health promotion, and the implementation of health promotion in Men's Sheds. Documented barriers and facilitators that impact implementation of a community-based men's health program are rare and provide a valuable blueprint for practitioners, researchers and policy makers in the field.

Trial collaborators' perceptions of the process of delivering Healthy Beginnings advice via telephone calls or text messages

ISSUE ADDRESSED

One in four Australian children aged between the ages of two and four are affected by overweight. In New South Wales, the Communicating Healthy Beginnings Advice by Telephone (CHAT) trial delivered an intervention to pregnant women and women with infants via telephone calls and text messages. The focus of the intervention was on infant feeding and establishing healthy habits for infants by building the capacity of mothers. This study investigates trial collaborators' perspectives concerning the implementation of this intervention, to obtain insights that will support future translation and scale-up.

METHODS

This research was undertaken during the intervention phase of the trial. Twenty trial collaborators involved in the planning, implementation or delivery of the CHAT trial were invited to participate. Qualitative interviews were conducted with collaborators using open-ended questions based on Steckler and Linnan's process evaluation framework and the Consolidated Framework for Implementation Research. Inductive thematic analysis was employed to identify themes from the interview data.

RESULTS

Fourteen trial collaborators were interviewed. Collaborators included child and family health nurses (intervention providers), nurse managers with extensive child and family health nursing experience, a paediatrician, dietitians, health promotion experts, health service managers, health and nursing executives, program personnel (project coordinator, research fellow and evaluation officer) and university researchers. Following coding of qualitative data, themes were realised from the data as a result of active co-production on the part of the researcher. Five themes were identified: (a) context (organisational support, engagement and partnerships, communication and project leadership); (b) program receipt, benefit and reach; (c) program delivery (intervention providers' experience and skills, mode of intervention delivery, referral to other services, support and training for intervention providers); (d) implementation (program delivered as planned); (e) opportunities for scale-up. Collaborators perceived that the program was implemented and delivered as planned. This specific research addresses the success of the process of implementing and delivering interventions for infant feeding and establishing healthy habits for children by building the capacity of mothers. Collaborators attributed successful program implementation to contextual factors: strong support by the host organisation; good project leadership; clear communication; collaborative internal and external partnerships; intervention provision by experienced nurses. Remote delivery was convenient to program participants and participants were able to resolve other personal concerns in addition to direct immediate benefits. Because of their capacity to influence policy decisions, the absence of policymakers at project meetings was a shortcoming. Collaborative partnerships with health and research partners, understanding of contextual issues and consumer involvement could lead to program expansion. The program has the potential to be scaled up through integration with existing services and gradual expansion into other health districts prior to state-wide rollout.

CONCLUSIONS

The CHAT trial delivered the Healthy Beginnings intervention which resulted in improvements in infant feeding, active play and sedentary behaviours. This evaluation demonstrated that the involvement of key stakeholders from early planning stages through to implementation of the program and the partnerships that evolved contributed to the successful implementation of the program. An unintended benefit to participants from this program was the social support that was provided. Intervention delivery via telephone and text messages enabled easy access to the program. Most importantly, the program has the potential to be scaled up through integration into existing services and gradual expansion prior to state-wide rollout. SO WHAT?: Strong internal and external partnerships, effective communication systems and integration with existing services create the context for potential translation and scaling up of the program to other health promotion settings.

Extent, Type and Reasons for Adaptation and Modification When Scaling-Up an Effective Physical Activity Program: Physical Activity 4 Everyone (PA4E1)

Background: Few studies have described the extent, type and reasons for making changes to a program prior to and during its delivery using a consistent taxonomy. Physical Activity 4 Everyone (PA4E1) is a secondary school physical activity program that was scaled-up for delivery to a greater number of schools. We aimed to describe the extent, type and reasons for changes to the PA4E1 program (the evidence-based physical activity practices, implementation support strategies and evaluation methods) made before its delivery at scale (adaptations) and during its delivery in a scale-up trial (modifications). Methods: The Framework for Reporting Adaptations and Modifications-Enhanced (FRAME) was used to describe adaptations (planned and made prior to the scale-up trial) and modifications (made during the conduct of the trial). A list of adaptations was generated from a comparison of the efficacy and scale-up trials via published PA4E1 protocols, trial registrations and information provided by trial investigators. Monthly trial team meetings tracked and coded modifications in "real-time" during the conduct of the scale-up trial. The extent, type and reasons for both adaptations and modifications were summarized descriptively. Results: In total, 20 adaptations and 20 modifications were identified, these were to physical activity practices (n = 8; n = 3), implementation support strategies (n = 6; n = 16) and evaluation methods (n = 6, n = 1), respectively. Few adaptations were "fidelity inconsistent" (n = 2), made "unsystematically" (n = 1) and proposed to have a "negative" impact on the effectiveness of the program (n = 1). Reasons for the adaptations varied. Of the 20 modifications, all were "fidelity consistent" and the majority were made "proactively" (n = 12), though most were "unsystematic" (n = 18). Fifteen of the modifications were thought to have a "positive" impact on program effectiveness. The main reason for modification was the "available resources" (n = 14) of the PA4E1 Implementation Team. Conclusions: Adaptations and modifications to public health programs are common. Modifications have the potential to impact the implementation and effectiveness of programs. Our findings underscore the importance of comprehensive reporting of the extent, type and reasons for modifications as part of process evaluations, as this data may be important to the interpretation of trial findings. Clinical Trial Registration: https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=372870, Identifier ACTRN12617000681358.

How does embedded implementation research work? Examining core features through qualitative case studies in Latin America and the Caribbean

Innovative strategies are needed to improve the delivery of evidence-informed health interventions. Embedded implementation research (EIR) seeks to enhance the generation and use of evidence for programme improvement through four core features: (1) central involvement of programme/policy decision-makers in the research cycle; (2) collaborative research partnerships; (3) positioning research within programme processes and (4) research focused on implementation. This paper examines how these features influence evidence-to-action processes and explores how they are operationalized, their effects and supporting conditions needed. We used a qualitative, comparative case study approach, drawing on document analysis and semi-structured interviews across multiple informant groups, to examine three EIR projects in Bolivia, Colombia and the Dominican Republic. Our findings are presented according to the four core EIR features. The central involvement of decision-makers in EIR was enhanced by decision-maker authority over the programme studied, professional networks and critical reflection. Strong research-practice partnerships were facilitated by commitment, a clear and shared purpose and representation of diverse perspectives. Evidence around positioning research within programme processes was less conclusive; however, as all three cases made significant advances in research use and programme improvement, this feature of EIR may be less critical than others, depending on specific circumstances. Finally, a research focus on implementation demanded proactive engagement by decision-makers in conceptualizing the research and identifying opportunities for direct action by decision-makers. As the EIR approach is a novel approach in these low-resource settings, key supports are needed to build capacity of health sector stakeholders and create an enabling environment through system-level strategies. Key implications for such supports include: promoting EIR and creating incentives for decision-makers to engage in it, establishing structures or mechanisms to facilitate decision-maker involvement, allocating funds for EIR, and developing guidance for EIR practitioners.

Building capacity from within: qualitative evaluation of a training program aimed at upskilling healthcare workers in delivering an evidence-based implementation approach

Translating evidence into complex health systems is an ongoing challenge. Building the capacity of healthcare workers in behavioral and implementation science methods may facilitate the use of evidence-based implementation approaches, leading to sustainable and effective translation. The aim was to describe the development, contents and evaluation of a training workshop aimed at upskilling hospital-embedded staff to deliver an evidence-based implementation approach. The Hide and Seek Project (HaSP) is a cluster randomized controlled trial testing two implementation approaches for improving hereditary cancer referral at eight Australian hospitals. Healthcare workers were recruited as “Implementation Leads” and trained via a one-day workshop—TRAining in evideNce-baSed ImpLementATion for hEalth (TRANSLATE). The purpose of TRANSLATE was to upskill Implementation Leads in the delivery of HaSP, as well as implementation science methods more broadly. Implementation Leads participated in semi-structured evaluation interviews, which were analyzed using inductive thematic analysis. Nine Implementation Leads from various professional backgrounds completed the training. Four key themes were identified: (i) training day reactions, (ii) learning, (iii) implementation barriers and facilitators, and (iv) building health system capacity for implementation. Participants reported high levels of satisfaction, and anticipated that the knowledge and skills may be useful in the future. We describe a novel training program focused on the delivery of evidence-based implementation within health systems. Guided by insights from this study, methods to deliver the training on a larger scale and across different contexts are being explored. The prolonged impact of TRANSLATE will be further evaluated at trial completion.

Trial registration: ANZCTR, ACTRN12618001072202. Registered on June 27, 2018

Recommendations for strengthening the role of embedded researchers to accelerate implementation in health systems: Findings from a state-of-the-art (SOTA) conference workgroup

BACKGROUND

Traditional research approaches do not promote timely implementation of evidence-based innovations (EBIs) to benefit patients. Embedding research within health systems can accelerate EBI implementation by blending rigorous methods with practical considerations in real-world settings. A state-of-the-art (SOTA) conference was convened in February 2019 with five workgroups that addressed five facets of embedded research and its potential to impact healthcare. This article reports on results from the workgroup focused on how embedded research programs can be implemented into heath systems for greatest impact.

METHODS

Based on a pre-conference survey, participants indicating interest in accelerating implementation were invited to participate in the SOTA workgroup. Workgroup participants (N = 26) developed recommendations using consensus-building methods. Ideas were grouped by thematic clusters and voted on to identify top recommendations. A summary was presented to the full SOTA membership. Following the conference, the workgroup facilitators (LJD, CDH, NR) summarized workgroup findings, member-checked with workgroup members, and were used to develop recommendations.

RESULTS

The workgroup developed 12 recommendations to optimize impact of embedded researchers within health systems. The group highlighted the tension between "ROI vs. R01" goals-where health systems focus on achieving return on their investments (ROI) while embedded researchers focus on obtaining research funding (R01). Recommendations are targeted to three key stakeholder groups: researchers, funders, and health systems. Consensus for an ideal foundation to support optimal embedded research is one that (1) maximizes learning; (2) aligns goals across all 3 stakeholders; and (3) implements EBIs in a consistent and timely fashion.

CONCLUSIONS

Four cases illustrate a variety of ways that embedded research can be structured and conducted within systems, by demonstrating key embedded research values to enable collaborations with academic affiliates to generate actionable knowledge and meaningfully accelerate implementation of EBIs to benefit patients.

IMPLICATIONS

Embedded research approaches have potential for transforming health systems and impacting patient health. Accelerating embedded research should be a focused priority for funding agencies to maximize a collective return on investment.

Organizational supports for knowledge translation in paediatric health centres and research institutes: insights from a Canadian environmental scan

BACKGROUND

Organizational supports are thought to help address wide-ranging barriers to evidence-informed health care (EIHC) and knowledge translation (KT). However, little is known about the nature of the resources and services that exist within paediatric health care and research settings across Canada to facilitate evidence use in health care delivery. This survey examined existing supports for EIHC/KT within these organizations to inform the design of similar EIHC/KT support programmes.

METHODS

A national environmental scan was conducted using a bilingual online survey distributed to leaders at Canadian paediatric academic health science centres and their affiliated research institutes. Participants were invited through email, social media and webinar invitations and snowball sampling. Supports of interest included personnel, resources, services, organizational structures or processes, and partnerships or collaborations; barriers and successes were also probed. Data were compiled by site, reported using descriptive statistics, or grouped thematically. Supports were described using the AIMD (Aims, Ingredients, Mechanism, Delivery) framework.

RESULTS

Thirty-one respondents from 17 sites across seven provinces represented a 49% site response rate. Eleven (65%) sites reported an on-site library with variable staffing and services. Ten (59%) sites reported a dedicated KT support unit or staff person. Supports ranged from education, resource development and consultation to protocol development, funded initiatives and collaborations. Organizations leveraged internal and external supports, with the majority also employing supports for clinical research integration. Supports perceived as most effective included personnel, targeted initiatives, leadership, interdepartmental expertise, external drivers and logistical support. Barriers included operational constraints, individual-level factors and lack of infrastructure.

CONCLUSIONS

This first survey of organizational supports for EIHC/KT identified the range of supports in place in paediatric research and health care organizations across Canada. The diversity of supports reported across sites may reflect differences in resource capacity and objectives. Similarities in EIHC/KT and research integration supports suggest common infrastructure may be feasible. Moreover, stakeholder engagement in research was common, but not pervasive. Tailored support programmes can target multi-faceted barriers. Findings can inform the development, refinement and evaluation of EIHC/KT support programmes and guide the study of the effectiveness and sustainability of these strategies.

The how and why of producing policy relevant research: perspectives of Australian childhood obesity prevention researchers and policy makers

BACKGROUND

Understanding why research is conducted may help address the under-utilisation of research. This study examined the reasons for childhood obesity prevention knowledge production in New South Wales (NSW), Australia, and the factors influencing research choices from the perspective of the researchers and health policy agencies contributing to the research.

METHODS

A literature search of SCOPUS and ISI Web of Knowledge (affiliation and key word searches) was conducted to compile a database of NSW childhood obesity research outputs, published between 2000 and 2015 (n = 543). Descriptive statistics were used to quantify outputs by research type, differentiating measurement, descriptive, and intervention research, systematic reviews and other publications. Interviews were conducted with a sample of researchers drawn from the database (n = 13) and decision makers from health policy agencies who funded and contributed to childhood obesity research in NSW (n = 15). Researcher interviews examined views about societal impacts, why and under what circumstances the research was conducted. Decision-maker interviews examined policy agency research investment and how research was used in decision making. Content analysis and a thematic approach was used to analyse the interview transcripts.

RESULTS

The research in this case was conducted for mix of reasons including those traditionally associated with academic inquiry, as well as intentions to influence policy and practice. Differences in funding mechanisms, administrative and employment arrangements, and 'who' initiated the research, created differing incentives and perspectives for knowledge production. Factors associated with the characteristics and experience of the individuals involved also influenced goals, as did the type of research conducted. Policy agencies played a role in directing research to address policy needs.

CONCLUSIONS

The findings of this study confirm that researchers are strongly influenced by their working environment. Funding schemes and other incentives to support policy relevant knowledge production are important. Contextual factors such as policy priorities, policy-driven research funding and the embedded nature or strong connections between some researchers and the policy agencies involved, are likely to have influenced the extent to which policy goals were reported in this study.

Enhancing the translation of health behaviour change research into practice: a selective conceptual review of the synergy between implementation science and health psychology

Health psychology is at the forefront of developing and disseminating evidence, theories, and methods that have improved the understanding of health behaviour change. However, current dissemination approaches may be insufficient for promoting broader application and impact of this evidence to benefit the health of patients and the public. Nevertheless, behaviour change theory/methods typically directed towards health behaviours are now used in implementation science to understand and support behaviour change in individuals at different health system levels whose own behaviour impacts delivering evidence-based health behaviour change interventions. Despite contributing to implementation science, health psychology is perhaps doing less to draw from it. A redoubled focus on implementation science in health psychology could provide novel prospects for enhancing the impact of health behaviour change evidence. We report a Health Psychology Review-specific review-of-reviews of trials of health behaviour change interventions published from inception to April 2020. We identified 34 reviews and assessed whether implementation readiness of behaviour change interventions was discussed. We then narratively review how implementation science has integrated theory/methods from health psychology and related discipline. Finally, we demonstrate how greater synergy between implementation science and health psychology could promote greater follow-through on advances made in the science of health behaviour change.

Preparing Nursing Contexts for Evidence-Based Practice Implementation: Where Should We Go From Here?

BACKGROUND

Context is important to the adoption and sustainability of evidence-based practices (EBPs). Currently, most published implementation efforts address context in relation to one specific EBP or a bundle of related EBPs. Since EBP and implementation are ongoing and dynamic, more discussion is needed on preparing nursing contexts to be more conducive to implementation generally.

AIM

To discuss the need to create contexts that are more adaptable to ongoing change due to the dynamic nature of EBPs and the ever-changing healthcare environment.

METHODS

This paper builds on a collection of our previous work, as nursing implementation scientists representing the Canadian and American healthcare contexts, and a literature review of the implementation science, knowledge translation, and sustainability literatures from 2006 to 2019.

RESULTS

We argue for a different way of thinking about the influence of context and implementation of EBPs. We contend that nursing contexts must be prepared to be more flexible and conducive to ongoing EBP implementation more generally. Contexts that embrace, facilitate, and have the capacity for change may be more likely to effectively de-implement ineffective interventions or implement and sustain new EBPs. We outline future directions to build a program of research on preparing the soil for implementation of EBPs, including building capacity among nurses, supporting organizations to embrace change, co-producing research evidence, and contributing to implementation science.

LINKING EVIDENCE TO ACTION

Supporting contexts to adopt and sustain evidence in nursing practice is essential for bridging the evidence to practice gap and improving outcomes for patients, clinicians, and the health system. Moving forward, we need to develop a better understanding of how to create contexts that embrace change prior to the implementation of EBPs in order sustain improvements to patient and health system outcomes.

How effective are physical activity interventions when they are scaled-up: a systematic review

Background

The ‘scale-up’ of effective physical activity interventions is required if they are to yield improvements in population health. The purpose of this study was to systematically review the effectiveness of community-based physical activity interventions that have been scaled-up. We also sought to explore differences in the effect size of these interventions compared with prior evaluations of their efficacy in more controlled contexts, and describe adaptations that were made to interventions as part of the scale-up process.

Methods

We performed a search of empirical research using six electronic databases, hand searched reference lists and contacted field experts. An intervention was considered ‘scaled-up’ if it had been intentionally delivered on a larger scale (to a greater number of participants, new populations, and/or by means of different delivery systems) than a preceding randomised control trial (‘pre-scale’) in which a significant intervention effect (p < 0.05) was reported on any measure of physical activity. Effect size differences between pre-scale and scaled up interventions were quantified ([the effect size reported in the scaled-up study / the effect size reported in the pre-scale-up efficacy trial] × 100) to explore any scale-up ‘penalties’ in intervention effects.

Results

We identified 10 eligible studies. Six scaled-up interventions appeared to achieve significant improvement on at least one measure of physical activity. Six studies included measures of physical activity that were common between pre-scale and scaled-up trials enabling the calculation of an effect size difference (and potential scale-up penalty). Differences in effect size ranged from 132 to 25% (median = 58.8%), suggesting that most scaled-up interventions typically achieve less than 60% of their pre-scale effect size. A variety of adaptations were made for scale-up – the most common being mode of delivery.

Conclusion

The majority of interventions remained effective when delivered at-scale however their effects were markedly lower than reported in pre-scale trials. Adaptations of interventions were common and may have impacted on the effectiveness of interventions delivered at scale. These outcomes provide valuable insight for researchers and public health practitioners interested in the design and scale-up of physical activity interventions, and contribute to the growing evidence base for delivering health promotion interventions at-scale.

Trial registration

PROSPERO CRD42020144842.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12966-021-01080-4.

How to optimise public health interventions: a scoping review of guidance from optimisation process frameworks

BACKGROUND

Optimisation processes have the potential to rapidly improve the impact of health interventions. Optimisation can be defined as a deliberate, iterative and data-driven process to improve a health intervention and/or its implementation to meet stakeholder-defined public health impacts within resource constraints. This study aimed to identify frameworks used to optimise the impact of health interventions and/or their implementation, and characterise the key concepts, steps or processes of identified frameworks.

METHODS

A scoping review of MEDLINE, CINAL, PsycINFO, and ProQuest Nursing & Allied Health Source databases was undertaken. Two reviewers independently coded the key concepts, steps or processes involved in each frameworks, and identified if it was a framework aimed to optimise interventions or their implementation. Two review authors then identified the common steps across included frameworks.

RESULTS

Twenty optimisation frameworks were identified. Eight frameworks were for optimising interventions, 11 for optimising implementation and one covered both intervention and implementation optimisation. The mean number of steps within the frameworks was six (range 3-9). Almost half (n = 8) could be classified as both linear and cyclic frameworks, indicating that some steps may occur multiple times in a single framework. Two meta-frameworks are proposed, one for intervention optimisation and one for implementation strategy optimisation. Steps for intervention optimisation are: Problem identification; Preparation; Theoretical/Literature base; Pilot/Feasibility testing; Optimisation; Evaluation; and Long-term implementation. Steps for implementation strategy optimisation are: Problem identification; Collaborate; Plan/design; Pilot; Do/change; Study/evaluate/check; Act; Sustain/endure; and Disseminate/extend.

CONCLUSIONS

This review provides a useful summary of the common steps followed to optimise a public health intervention or its implementation according to established frameworks. Further opportunities to study and/or validate such frameworks and their impact on improving outcomes exist.

A pilot randomised controlled trial of a web-based implementation intervention to increase child intake of fruit and vegetables within childcare centres

Background

As dietary behaviours developed during early childhood are known to track into adulthood, interventions that aim to improve child nutrition at a population level are recommended. Whilst early childhood education and care (ECEC) is a promising setting for interventions targeting children’s nutrition behaviours, previous interventions have largely used high intensity, face-to-face approaches, limiting their reach, implementation and potential impact at a population level. Web-based modalities represent a promising means of supporting the delivery of childcare-based interventions whilst overcoming challenges of previous approaches; however, the feasibility of using such modalities to support implementation is largely unknown. As such, this study sought to collect feasibility and pilot data to inform the design of a web-based intervention together with health promotion officer support within childcare centres. Child dietary intake will also be assessed to provide an estimate of the impact of the implementation intervention.

Methods

A superiority cluster randomised controlled trial with repeat cross-sectional data collection employing an effectiveness-implementation type-II hybrid design will be conducted with childcare centres within the Hunter New England region of New South Wales, Australia. Type-II hybrid designs provide the opportunity to assess intervention efficacy whilst piloting the feasibility of the implementation strategies. Centres allocated to the intervention group will receive access to a web-based program together with health promotion officer support to implement targeted healthy eating practices to improve child diet in care. A number of outcomes will be assessed to inform the feasibility to conduct a larger trial, including childcare centre and parent recruitment and consent rates for each component of data collection, uptake of the implementation strategies, acceptability of the intervention and implementation strategies, appropriateness of the implementation strategies and the contextual factors influencing implementation.

Discussion

This study will provide high-quality evidence regarding the potential feasibility of a web-based intervention and the impact of healthy eating practices on child diet in care. Web-based modalities provide a promising approach for population-wide implementation support to childcare centres given their potential reach and consistency with existing infrastructure.

Trial registration

Prospectively registered with Australian New Zealand Clinical Trial Registry (ACTRN12619001158156).

Supplementary Information

Supplementary information accompanies this paper at 10.1186/s40814-020-00707-w.

Exploring and understanding the scope and value of the Parkinson's nurse in the UK (The USP Project): a realist economic evaluation protocol

INTRODUCTION

There are multiple configurations of specialist nurses working in the field of Parkinson's. Parkinson's Nurse Specialists (PNSs) are recognised as playing a pivotal role; however, there is little published evidence to demonstrate their effectiveness. Further evidence is needed to establish which aspects of the PNSs provide the greatest benefit to people with Parkinson's and their families, and the cost-effectiveness of different models of care.

METHODS AND ANALYSIS

Realist approaches explain how and why programmes work (or not) through striving to answer the question: what works, for whom and under what circumstances. This research uses a realist evaluation and aims to integrate an economic analysis within the realist framework. We refer to this as 'realist economic evaluation'. It comprises four phases: (1) developing resource-sensitive initial programme theories (IPTs) using surveys to gain a better understanding of the role and impact (costs and benefits) of the PNSs; (2) testing the IPTs through qualitative interviews and quantitative data analysis; (3) evaluating the cost and resource use implications alongside the benefits associated with the role of the PNSs and (4) iteratively refining the IPTs throughout the project. The IPTs will draw on both quantitative and qualitative data. The result of the study will be a series of refined programme theories, which will explain how specialist nurses work in the field of Parkinson's in the UK, what impact they have on people with Parkinson's and their families and carers, and at what cost.

ETHICS AND DISSEMINATION

Northumbria University, the Health Research Authority and Health and Care Research Wales have approved this study. Key findings will be disseminated throughout the duration of the project online and through social media, and via annual and regional Parkinson's meetings and the Parkinson's UK Excellence Network. Academic dissemination will occur through publication and conference presentations.

Improving child immunisation rates in a disadvantaged community in New South Wales, Australia: a process evaluation for research translation

The World Health Organization's Tailoring Immunization Programmes approach was used to develop a new strategy to increase child vaccination coverage in a disadvantaged community in New South Wales, Australia, including reminders, outreach and home visiting. After 18 months, the strategy hasn't been fully implemented. A process evaluation was conducted to identify barriers and facilitators for research translation. Participants included child health nurses, Population Health staff, managers and general practitioners. The Capability-Opportunity-Motivation model of behaviour change (COM-B) was used to develop questions. Twenty-four participants took part in three focus groups and four interviews. Five themes emerged: (i) designing and adopting new ways of working is time-consuming and requires new skills, new ways of thinking and changes in service delivery; (ii) genuine engagement and interaction across fields and institutions helps build capacity and strengthen motivation; (iii) implementation of a new strategy requires clarity; who's doing what, when and how?; (iv) it is important not to lose sight of research findings related to the needs of disadvantaged families; and (v) trust in the process and perseverance are fundamental. There was strong motivation and opportunity for change, but a need to enhance service capability. Areas requiring support and resources were identified.

What Is Dissemination and Implementation Science?: An Introduction and Opportunities to Advance Behavioral Medicine and Public Health Globally

There has been a well-documented gap between research (e.g., evidence-based programs, interventions, practices, policies, guidelines) and practice (e.g., what is routinely delivered in real-world community and clinical settings). Dissemination and implementation (D&I) science has emerged to address this research-to-practice gap and accelerate the speed with which translation and real-world uptake and impact occur. In recent years, there has been tremendous development in the field and a growing global interest, but much of the introductory literature has been U.S.-centric. This piece provides an introduction to D&I science and summarizes key concepts and progress of the field for a global audience, provides two case studies that highlight examples of D&I research globally, and identifies opportunities and innovations for advancing the field of D&I research globally.

Effectiveness of Technology-Enabled Knowledge Translation Strategies in Improving the Use of Research in Public Health: Systematic Review

Background

Knowledge translation (KT) aims to facilitate the use of research evidence in decision making. Changes in technology have provided considerable opportunities for KT strategies to improve access and use of evidence in decision making by public health policy makers and practitioners. Despite this opportunity, there have been no reviews that have assessed the effects of digital technology-enabled KT (TEKT) in the field of public health.

Objective

This study aims to examine the effectiveness of digital TEKT strategies in (1) improving the capacity for evidence-based decision making by public health policy makers and practitioners, (2) changing public health policy or practice, and (3) changes in individual or population health outcomes.

Methods

A search strategy was developed to identify randomized trials assessing the effectiveness of digital TEKT strategies in public health. Any primary research study with a randomized trial design was eligible. Searches for eligible studies were undertaken in multiple electronic bibliographic databases (Medical Literature Analysis and Retrieval System Online [MEDLINE], Excerpta Medica dataBASE [EMBASE], PsycINFO, Cumulative Index to Nursing and Allied Health Literature [CINAHL], and Scopus) and the reference lists of included studies. A hand search of 2 journals (Implementation Science and Journal of Medical Internet Research) and a gray literature search were also conducted. Pairs of independent review authors screened studies, assessed the risk of bias, and extracted data from relevant studies.

Results

Of the 6819 citations screened, 8 eligible randomized trials were included in the review. The studies examined the impact of digital TEKT strategies on health professionals, including nurses, child care health consultants, physiotherapists, primary health care workers, and public health practitioners. Overall, 5 of the interventions were web-training programs. The remaining 3 interventions included simulation games, access to digital resource materials and the use of tailored messaging, and a web-based registry. The findings suggest that digital TEKT interventions may be effective in improving the knowledge of public health professionals, relative to control, and may be as effective as a face-to-face KT approach. The effectiveness of digital TEKT strategies relative to a control or other digital KT interventions on measures of health professional self-efficacy to use evidence to enhance practice behavior or behavioral intention outcomes was mixed. The evidence regarding the effects on changes to health policy or practice following exposure to digital TEKT was mixed. No trials assessed the effects on individual or population-level health outcomes.

Conclusions

This review is the first to synthesize the effectiveness of digital TEKT interventions in a public health setting. Despite its potential, relatively few trials have been undertaken to investigate the impacts of digital TEKT interventions. The findings suggest that although a digital TEKT intervention may improve knowledge, the effects of such interventions on other outcomes are equivocal.

Nudge strategies to improve healthcare providers' implementation of evidence-based guidelines, policies and practices: a systematic review of trials included within Cochrane systematic reviews

BACKGROUND

Nudge interventions are those that seek to modify the social and physical environment to enhance capacity for subconscious behaviours that align with the intrinsic values of an individual, without actively restricting options. This study sought to describe the application and effects of nudge strategies on clinician implementation of health-related guidelines, policies and practices within studies included in relevant Cochrane systematic reviews.

METHODS

As there is varied terminology used to describe nudge, this study examined studies within relevant systematic reviews. A two-stage screening process was undertaken where, firstly, all systematic reviews published in the Cochrane Library between 2016 and 2018 were screened to identify reviews that included quantitative studies to improve implementation of guidelines among healthcare providers. Secondly, individual studies within relevant systematic reviews were included if they were (i) randomised controlled trials (RCTs), (ii) included a nudge strategy in at least one intervention arm, and (iii) explicitly aimed to improve clinician implementation behaviour. We categorised nudge strategies into priming, salience and affect, default, incentives, commitment and ego, and norms and messenger based on the Mindspace framework.

SYNTHESIS

The number and percentage of trials using each nudge strategy was calculated. Due to substantial heterogeneity, we did not undertake a meta-analysis. Instead, we calculated within-study point estimates and 95% confidence intervals, and used a vote-counting approach to explore effects.

RESULTS

Seven reviews including 42 trials reporting on 57 outcomes were included. The most common nudge strategy was priming (69%), then norms and messenger (40%). Of the 57 outcomes, 86% had an effect on clinician behaviour in the hypothesised direction, and 53% of those were statistically significant. For continuous outcomes, the median effect size was 0.39 (0.22, 0.45), while for dichotomous outcomes the median Odds Ratio was 1.62 (1.13, 2.76).

CONCLUSIONS

This review of 42 RCTs included in Cochrane systematic reviews found that the impact of nudge strategies on clinician behaviour was at least comparable to other interventions targeting implementation of evidence-based guidelines. While uncertainty remains, the review provides justification for ongoing investigation of the evaluation and application of nudge interventions to support provider behaviour change.

TRIAL REGISTRATION

This review was not prospectively registered.

A Three-Arm Randomised Controlled Trial of High- and Low-Intensity Implementation Strategies to Support Centre-Based Childcare Service Implementation of Nutrition Guidelines: 12-Month Follow-Up

The study aimed to compare the effectiveness of a suite of implementation strategies of varying intensities on centre-based childcare service implementation of nutrition guideline recommendations at 12-month follow-up. A six-month three-arm parallel group randomised controlled trial was undertaken with 69 services, randomised to one of three arms: high-intensity strategies (executive support; group face-to-face training; provision of resources; multiple rounds of audit and feedback; ongoing face-to-face and phone support); low-intensity strategies (group face-to-face training; provision of resources; single round of audit and feedback); or usual care control. Across all study arms, only three high-intensity services were compliant with overall nutrition guidelines. A significant group interaction was found between the three arms for compliance with individual food groups. Relative to control, a significantly greater proportion of low-intensity services were compliant with dairy, and a significantly greater proportion of high-intensity services were compliant with fruit, vegetables, dairy, breads and cereals, and discretionary foods. No significant differences between the high- and low-intensity for individual food group compliance were found. High-intensity implementation strategies may be effective in supporting childcare service implementation of individual food group recommendations. Further research is warranted to identify strategies effective in increasing overall nutrition compliance.

Health system decision-makers at the helm of implementation research: development of a framework to evaluate the processes and effectiveness of embedded approaches

Background

Embedded approaches to implementation research (IR), whereby health system decision-makers participate actively in the research process, are gaining traction as effective approaches to optimise the delivery of health programmes and policies. However, the evidence base on the processes and effectiveness of such collaborative research remains inchoate. Standardised approaches to evaluate these initiatives are needed to identify core elements of ‘embeddedness’, unveil the underlying pathways of change, and assess contribution to evidence uptake in decision-making and overall outcomes of effect. The framework presented in this paper responds to this need, designed to guide the systematic evaluation of embedded IR.

Methods

This evaluation framework for embedded IR approaches is based on the experience of a joint initiative by the Pan American Health Organization/Alliance for Health Policy and Systems Research, which has supported 19 IR grants in 10 Latin American and Caribbean countries from 2014 to 2017. The conceptualisation of this framework drew on various sources of information, including empirical evidence and conceptual insights from the literature, interviews with content experts, and a prospective evaluation of the 2016 cohort that included semi-structured key informant interviews, document analysis, and a research team survey to examine key aspects of embedded research.

Results

We developed a widely applicable conceptual framework to guide the evaluation of embedded IR in various contexts. Focused on uncovering how this collaborative research approach influences programme improvement, it outlines expected processes and intermediate outcomes. It also highlights constructs with which to assess ‘embeddedness’ as well as critical contextual factors. The framework is intended to provide a structure by which to systematically examine such embedded research initiatives, proposing three key stages of evidence-informed decision-making – co-production of evidence, engagement with research, and enactment of programme changes.

Conclusion

Rigorous evaluation of embedded IR is needed to build the evidence on its processes and effectiveness in influencing decision-making. The evaluation framework presented here addresses this gap with consideration of the complexity of such efforts. Its applicability to similar initiatives is bolstered by virtue of being founded on real-world experience; its potential to contribute to a nuanced understanding of embedded IR is significant.

Using Integrated Research-Practice Partnerships to Move Evidence-Based Principles Into Practice

The implementation of evidence-based physical activity interventions is improved when integrated research-practice partnerships are used. These partnerships consider both research- and practice-based evidence that moves beyond only assessing program efficacy. Our novel hypothesis is that integrated research-practice partnerships may lead to interventions that are practical and effective, reach more participants, and are more likely to be sustained in practice.

Optimisation: defining and exploring a concept to enhance the impact of public health initiatives

BACKGROUND

Repeated, data-driven optimisation processes have been applied in many fields to rapidly transform the performance of products, processes and interventions. While such processes may similarly be employed to enhance the impact of public health initiatives, optimisation has not been defined in the context of public health and there has been little exploration of its key concepts.

METHODS

We used a modified, three-round Delphi study with an international group of researchers, public health policy-makers and practitioners to (1) generate a consensus-based definition of optimisation in the context of public health and (2i) describe key considerations for optimisation in that context. A pre-workshop literature review and elicitation of participant views regarding optimisation in public health (round 1) were followed by a daylong workshop and facilitated face-to-face group discussions to refine the definition and generate key considerations (round 2); finally, post-workshop discussions were undertaken to refine and finalise the findings (round 3). A thematic analysis was performed at each round. Study findings reflect an iterative consultation process with study participants.

RESULTS

Thirty of 33 invited individuals (91%) participated in the study. Participants reached consensus on the following definition of optimisation in public health: "A deliberate, iterative and data-driven process to improve a health intervention and/or its implementation to meet stakeholder-defined public health impacts within resource constraints". A range of optimisation considerations were explored. Optimisation was considered most suitable when existing public health initiatives are not sufficiently effective, meaningful improvements from an optimisation process are anticipated, quality data to assess impacts are routinely available, and there are stable and ongoing resources to support it. Participants believed optimisation could be applied to improve the impacts of an intervention, an implementation strategy or both, on outcomes valued by stakeholders or end users. While optimisation processes were thought to be facilitated by an understanding of the mechanisms of an intervention or implementation strategy, no agreement was reached regarding the best approach to inform decisions about modifications to improve impact.

CONCLUSIONS

The study findings provide a strong basis for future research to explore the potential impact of optimisation in the field of public health.

Action, actor, context, target, time (AACTT): a framework for specifying behaviour

BACKGROUND

Designing implementation interventions to change the behaviour of healthcare providers and other professionals in the health system requires detailed specification of the behaviour(s) targeted for change to ensure alignment between intervention components and measured outcomes. Detailed behaviour specification can help to clarify evidence-practice gaps, clarify who needs to do what differently, identify modifiable barriers and enablers, design interventions to address these and ultimately provides an indicator of what to measure to evaluate an intervention's effect on behaviour change. An existing behaviour specification framework proposes four domains (Target, Action, Context, Time; TACT), but insufficiently clarifies who is performing the behaviour (i.e. the Actor). Specifying the Actor is especially important in healthcare settings characterised by multiple behaviours performed by multiple different people. We propose and describe an extension and re-ordering of TACT to enhance its utility to implementation intervention designers, practitioners and trialists: the Action, Actor, Context, Target, Time (AACTT) framework. We aim to demonstrate its application across key steps of implementation research and to provide tools for its use in practice to clarify the behaviours of stakeholders across multiple levels of the healthcare system.

METHODS AND RESULTS

We used French et al.'s four-step implementation process model to describe the potential applications of the AACTT framework for (a) clarifying who needs to do what differently, (b) identifying barriers and enablers, (c) selecting fit-for-purpose intervention strategies and components and (d) evaluating implementation interventions.

CONCLUSIONS

Describing and detailing behaviour using the AACTT framework may help to enhance measurement of theoretical constructs, inform development of topic guides and questionnaires, enhance the design of implementation interventions and clarify outcome measurement for evaluating implementation interventions.

Experience of Health Leadership in Partnering With University-Based Researchers in Canada - A Call to "Re-imagine" Research

BACKGROUND

Emerging evidence that meaningful relationships with knowledge users are a key predictor of research use has led to promotion of partnership approaches to health research. However, little is known about health system experiences of collaborations with university-based researchers, particularly with research partnerships in the area of health system design and health service organization. The purpose of the study was to explore the experience and perspectives of senior health managers in health service organizations, with health organization-university research partnerships.

METHODS

In-depth, semi-structured interviews (n = 25) were conducted with senior health personnel across Canada to explore their perspectives on health system research; experiences with health organization-university research partnerships; challenges to partnership research; and suggested actions for improving engagement with knowledge users and promoting research utilization. Participants, recruited from organizations with regional responsibilities, were responsible for system-wide planning and support functions.

RESULTS

Research is often experienced as unhelpful or irrelevant to decision-making by many within the system. Research, quality improvement (QI) and evaluation are often viewed as separate activities and coordinated by different responsibility areas. Perspectives of senior managers on barriers to partnership differed from those identified in the literature: organizational stress and restructuring, and limitations in readiness of researchers to work in the fast-paced healthcare environment, were identified as major barriers. Although the need for strong executive leadership was emphasized, "multi-system action" is needed for effective partnerships.

CONCLUSION

Common approaches to research and knowledge translation are often not appropriate for addressing issues of health service design and health services organization. Nor is the research community providing expertise to many important activities that the healthcare system is taking to improve health services. A radical rethinking of how we prepare health service researchers; position research within the health system; and fund research activities and infrastructure is needed if the potential benefits of research are to be achieved. Lack of response to health system needs may contribute to research and 'evidence-informed' practice being further marginalized from healthcare operations. Interventions to address barriers must respond to the perspectives and experience of health leadership.

Protocol for a mixed methods realist evaluation of regional District Health Board groupings in New Zealand

INTRODUCTION

Achieving effective integration of healthcare across primary, secondary and tertiary care is a key goal of the New Zealand (NZ) Health Strategy. NZ's regional District Health Board (DHB) groupings are fundamental to delivering integration, bringing the country's 20 DHBs together into four groups to collaboratively plan, fund and deliver health services within their defined geographical regions. This research aims to examine how, for whom and in what circumstances the regional DHB groupings work to improve health service integration, healthcare quality, health outcomes and health equity, particularly for Māori and Pacific peoples.

METHODS AND ANALYSIS

This research uses a mixed methods realist evaluation design. It comprises three linked studies: (1) formulating initial programme theory (IPT) through developing programme logic models to describe regional DHB working; (2) empirically testing IPT through both a qualitative process evaluation of regional DHB working using a case study design; and (3) a quantitative analysis of the impact that DHB regional groupings may have on service integration, health outcomes, health equity and costs. The findings of these three studies will allow refinement of the IPT and should lead to a programme theory which will explain how, for whom and in what circumstances regional DHB groupings improve service integration, health outcomes and health equity in NZ.

ETHICS AND DISSEMINATION

The University of Otago Human Ethics Committee has approved this study. The embedding of a clinician researcher within a participating regional DHB grouping has facilitated research coproduction, the research has been jointly conceived and designed and will be jointly evaluated and disseminated by researchers and practitioners. Uptake of the research findings by other key groups including policymakers, Māori providers and communities and Pacific providers and communities will be supported through key strategic relationships and dissemination activities. Academic dissemination will occur through publication and conference presentations.

Reinvigorating stagnant science: implementation laboratories and a meta-laboratory to efficiently advance the science of audit and feedback

Audit and feedback (A&F) is a commonly used quality improvement (QI) approach. A Cochrane review indicates that A&F is generally effective and leads to modest improvements in professional practice but with considerable variation in the observed effects. While we have some understanding of factors that enhance the effects of A&F, further research needs to explore when A&F is most likely to be effective and how to optimise it. To do this, we need to move away from two-arm trials of A&F compared with control in favour of head-to-head trials of different ways of providing A&F. This paper describes implementation laboratories involving collaborations between healthcare organisations providing A&F at scale, and researchers, to embed head-to-head trials into routine QI programmes. This can improve effectiveness while producing generalisable knowledge about how to optimise A&F. We also describe an international meta-laboratory that aims to maximise cross-laboratory learning and facilitate coordination of A&F research.