Engaging policy-makers, health system managers, and policy analysts in the knowledge synthesis process: a scoping review

Evaluation of an integrated knowledge translation approach used for updating the Cochrane Review of Patient Decision Aids: a pre-post mixed methods study

BACKGROUND

When people who can use or benefit from research findings are engaged as partners on study teams, the quality and impact of findings are better. These people can include patients/consumers and clinicians who do not identify as researchers. They are referred to as "knowledge users". This partnered approach is called integrated knowledge translation (IKT). We know little about knowledge users' involvement in the conduct of systematic reviews. We aimed to evaluate team members' degree of meaningful engagement and their perceptions of having used an IKT approach when updating the Cochrane Review of Patient Decision Aids.

METHODS

We conducted a pre-post mixed methods study. We surveyed all team members at two time points. Before systematic review conduct, all participating team members indicated their preferred level of involvement within each of the 12 steps of the systematic review process from "Screen titles/abstracts" to "Provide feedback on draft article". After, they reported on their degree of satisfaction with their achieved level of engagement across each step and the degree of meaningful engagement using the Patient Engagement In Research Scale (PEIRS-22) across 7 domains scored from 100 (extremely meaningful engagement) to 0 (no meaningful engagement). We solicited their experiences with the IKT approach using open-ended questions. We analyzed quantitative data descriptively and qualitative data using content analysis. We triangulated data at the level of study design and interpretation.

RESULTS

Of 21 team members, 20 completed the baseline survey (95.2% response rate) and 17/20 (85.0% response rate) the follow-up survey. There were 11 (55%) researchers, 3 (15%) patients/consumers, 5 (25%) clinician-researchers, and 1 (5%) graduate student. At baseline, preferred level of involvement in the 12 systematic review steps varied from n = 3 (15%) (search grey literature sources) to n = 20 (100%) (provide feedback on the systematic review article). At follow-up, 16 (94.1%) participants were totally or very satisfied with the extent to which they were involved in these steps. All (17, 100%) agreed that the process was co-production. Total PEIRS-22 scores revealed most participants reported extremely (13, 76.4%) or very (2, 11.8%) meaningful degree of engagement. Triangulated data revealed that participants indicated benefit to having been engaged in an authentic research process that incorporated diverse perspectives, resulting in better and more relevant outputs. Reported challenges were about time, resources, and the logistics of collaborating with a large group.

CONCLUSION

Following the use of an IKT approach during the conduct of a systematic review, team members reported high levels of meaningful engagement. These results contribute to our understanding of ways to co-produce systematic reviews.

Rapid Reviews Methods Series: Involving patient and public partners, healthcare providers and policymakers as knowledge users

Rapid reviews (RRs) are a helpful evidence synthesis tool to support urgent and emergent decision-making in healthcare. RRs involve abbreviating systematic review methods and are conducted in a condensed timeline to meet the decision-making needs of organisations or groups that commission them. Knowledge users (KUs) are those individuals, typically patient and public partners, healthcare providers, and policy-makers, who are likely to use evidence from research, including RRs, to make informed decisions about health policies, programmes or practices. However, research suggests that KU involvement in RRs is often limited or overlooked, and few RRs include patients as KUs. Existing RR methods guidance advocates involving KUs but lacks detailed steps on how and when to do so. This paper discusses the importance of involving KUs in RRs, including patient and public involvement to ensure RRs are fit for purpose and relevant for decision-making. Opportunities to involve KUs in planning, conduct and knowledge translation of RRs are outlined. Further, this paper describes various modes of engaging KUs during the review lifecycle; key considerations researchers should be mindful of when involving distinct KU groups; and an exemplar case study demonstrating substantive involvement of patient partners and the public in developing RRs. Although involving KUs requires time, resources and expertise, researchers should strive to balance 'rapid' with meaningful KU involvement in RRs. This paper is the first in a series led by the Cochrane Rapid Reviews Methods Group to further guide general RR methods.

Decision-maker roles in healthcare quality improvement projects: a scoping review

OBJECTIVES

Evidence suggests that healthcare quality improvement (QI) projects are more successful when decision-makers are involved in the process. However, guidance regarding the engagement of decision-makers in QI projects is lacking. We conducted a scoping review to identify QI projects involving decision-makers published in the literature and to describe the roles decision-makers played.

METHODS

Following the Joanna Briggs Institute framework for scoping reviews, we systematically searched for all types of studies in English or French between 2002 and 2023 in: EMBASE, MEDLINE via PubMed, PsycINFO, and the Cumulative Index to Nursing and Allied Health Literature. Criteria for inclusion consisted of literature describing health sector QI projects that involved local, regional or system-level decision-makers. Descriptive analysis was performed. Drawing on QI and participatory research literature, the research team developed an inductive data extraction grid to provide a portrait of QI project characteristics, decision-makers' contributions, and advantages and challenges associated with their involvement.

RESULTS

After screening and review, we retained 29 references. 18 references described multi-site projects and 11 were conducted in single sites. Local decision-makers' contributions were documented in 27 of the 29 references and regional decision-makers' contributions were documented in 12. Local decision-makers were more often active participants in QI processes, contributing toward planning, implementation, change management and capacity building. Regional decision-makers more often served as initiators and supporters of QI projects, contributing toward strategic planning, recruitment, delegation, coordination of local teams, as well as assessment and capacity building. Advantages of decision-maker involvement described in the retained references include mutual learning, frontline staff buy-in, accountability, resource allocation, effective leadership and improved implementation feasibility. Considerations regarding their involvement included time constraints, variable supervisory expertise, issues concerning centralised leadership, relationship strengthening among stakeholders, and strategic alignment of frontline staff and managerial priorities CONCLUSIONS: This scoping review provides important insights into the various roles played by decision-makers, the benefits and challenges associated with their involvement, and identifies opportunities for strengthening their engagement. The results of this review highlight the need for practical collaboration and communication strategies that foster partnership between frontline staff and decision-makers at all levels.

Developing, implementing, and monitoring tailored strategies for integrated knowledge translation in five sub-Saharan African countries

BACKGROUND

Integrated knowledge translation (IKT) through strategic, continuous engagement with decision-makers represents an approach to bridge research, policy and practice. The Collaboration for Evidence-based Healthcare and Public Health in Africa (CEBHA +), comprising research institutions in Ethiopia, Malawi, Rwanda, South Africa, Uganda and Germany, developed and implemented tailored IKT strategies as part of its multifaceted research on prevention and care of non-communicable diseases and road traffic injuries. The objective of this article is to describe the CEBHA + IKT approach and report on the development, implementation and monitoring of site-specific IKT strategies.

METHODS

We draw on findings derived from the mixed method IKT evaluation (conducted in 2020-2021), and undertook document analyses and a reflective survey among IKT implementers. Quantitative data were analysed descriptively and qualitative data were analysed using content analysis. The authors used the TIDieR checklist to report results in a structured manner.

RESULTS

Preliminary IKT evaluation data (33 interviews with researchers and stakeholders from policy and practice, and 31 survey responses), 49 documents, and eight responses to the reflective survey informed this article. In each of the five African CEBHA + countries, a site-specific IKT strategy guided IKT implementation, tailored to the respective national context, engagement aims, research tasks, and individuals involved. IKT implementers undertook a variety of IKT activities at varying levels of engagement that targeted a broad range of decision-makers and other stakeholders, particularly during project planning, data interpretation, and output dissemination. Throughout the project, the IKT teams continued to tailor IKT strategies informally and modified the IKT approach by responding to ad hoc engagements and involving non-governmental organisations, universities, and communities. Challenges to using systematic, formalised IKT strategies arose in particular with respect to the demand on time and resources, leading to the modification of monitoring processes.

CONCLUSION

Tailoring of the CEBHA + IKT approach led to the inclusion of some atypical IKT partners and to greater responsiveness to unexpected opportunities for decision-maker engagement. Benefits of using systematic IKT strategies included clarity on engagement aims, balancing of existing and new strategic partnerships, and an enhanced understanding of research context, including site-specific structures for evidence-informed decision-making.

Engaging Operational Partners Is Critical for Successful Implementation of Research Products: a Coincidence Analysis of Access-Related Projects in the Veterans Affairs Healthcare System

BACKGROUND/OBJECTIVE

The Veterans Health Administration (VHA) has prioritized timely access to care and has invested substantially in research aimed at optimizing veteran access. However, implementing research into practice remains challenging. Here, we assessed the implementation status of recent VHA access-related research projects and explored factors associated with successful implementation.

DESIGN

We conducted a portfolio review of recent VHA-funded or supported projects (1/2015-7/2020) focused on healthcare access ("Access Portfolio"). We then identified projects with implementable research deliverables by excluding those that (1) were non-research/operational projects; (2) were only recently completed (i.e., completed on or after 1/1/2020, meaning that they were unlikely to have had time to be implemented); and (3) did not propose an implementable deliverable. An electronic survey assessed each project's implementation status and elicited barriers/facilitators to implementing deliverables. Results were analyzed using novel Coincidence Analysis (CNA) methods.

PARTICIPANTS/KEY RESULTS

Among 286 Access Portfolio projects, 36 projects led by 32 investigators across 20 VHA facilities were included. Twenty-nine respondents completed the survey for 32 projects (response rate = 88.9%). Twenty-eight percent of projects reported fully implementing project deliverables, 34% reported partially implementing deliverables, and 37% reported not implementing any deliverables (i.e., resulting tool/intervention not implemented into practice). Of 14 possible barriers/facilitators assessed in the survey, two were identified through CNA as "difference-makers" to partial or full implementation of project deliverables: (1) engagement with national VHA operational leadership; (2) support and commitment from local site operational leadership.

CONCLUSIONS

These findings empirically highlight the importance of operational leadership engagement for successful implementation of research deliverables. Efforts to strengthen communication and engagement between the research community and VHA local/national operational leaders should be expanded to ensure VHA's investment in research leads to meaningful improvements in veterans' care. The Veterans Health Administration (VHA) has prioritized timely access to care and has invested substantially in research aimed at optimizing veteran access. However, implementing research findings into clinical practice remains challenging, both within and outside VHA. Here, we assessed the implementation status of recent VHA access-related research projects and explored factors associated with successful implementation. Only two factors were identified as "difference-makers" to adoption of project findings into practice: (1) engagement with national VHA leadership or (2) support and commitment from local site leadership. These findings highlight the importance of leadership engagement for successful implementation of research findings. Efforts to strengthen communication and engagement between the research community and VHA local/national leaders should be expanded to ensure VHA's investment in research leads to meaningful improvements in veterans' care.

Behaviour change interventions for responsible antimicrobial use on farms

BACKGROUND

In the coming years, major governance changes in the form of policy directives and regulations will catalyse major top-down change with respect to animal health on European farms in an effort to combat the OneHealth threat of antimicrobial resistance. This top-down approach must be met with bottom-up strategies to ensure target actors (namely, farmers and vets) are supported and motivated to change their practices, thus, avoiding unintended consequences of forced change. Although much behavioural research has explored the factors influencing antimicrobial practices on farms, a gap exists translating these findings into evidence-based behaviour change interventions that can be put into practice. The current study aims to fill this gap. It provides insights into identifying, understanding, and changing the behaviours of farmers and veterinarians with respect to the responsible use of antimicrobials in farming.

RESULTS

Through an inter-disciplinary and multi-actor approach, the study combines scientific knowledge from the behavioural sciences and animal health sciences, coupled with tacit knowledge from a co-design, participatory approach to recommend seven behaviour change interventions that can help to support good practices amongst farmers and vets, with respect to animal health, and reduce the use of antimicrobials on farms. The behaviour change interventions include message framing; OneHealth awareness campaign; specialised communications training; on-farm visual prompts and tools; social support strategies (for both farmers and vets); and antimicrobial use monitoring. The study details each intervention with respect to their evidence base and scientific concept, grounded in behavioural science, along with stakeholder feedback on design and delivery of the interventions.

CONCLUSIONS

These behaviour change interventions can be taken, adapted, and put into practice by the agri-food community to support good animal health practices and responsible antimicrobial use on farms.

Recommendations for the extraction, analysis, and presentation of results in scoping reviews

Scoping reviewers often face challenges in the extraction, analysis, and presentation of scoping review results. Using best-practice examples and drawing on the expertise of the JBI Scoping Review Methodology Group and an editor of a journal that publishes scoping reviews, this paper expands on existing JBI scoping review guidance. The aim of this article is to clarify the process of extracting data from different sources of evidence; discuss what data should be extracted (and what should not); outline how to analyze extracted data, including an explanation of basic qualitative content analysis; and offer suggestions for the presentation of results in scoping reviews.

Nursing care management concepts: scoping review

OBJECTIVES

to clarify the concepts of Nursing Care Management and Nursing Care Administration in the scientific literature, highlighting approximations and distances between the terms.

METHODS

scoping review as per Joanna Briggs Institute protocol and preferred reporting items for Systematic Reviews and Meta-analysis extension for Scoping Reviews (PRISMA-ScR). The searches were performed in LILACS, CINAHL, MEDLINE, and Scopus databases.

RESULTS

the qualitative analysis, through content analysis, counted 49 studies published between 2007 and 2020. Hospital care was the most evident level of care. It was identified that nursing care management aims at the macropolitical performance of nurses and mobilizes skills essentially strategic-cognitive, while Nursing Care Administration aims at the micropolitical performance of nurses, requiring essentially strategic-administrative skills.

FINAL CONSIDERATIONS

the study allowed us to propose the conceptualization of the terms and identify the approximations and distances between them.

Conceitos de gestão e gerência do cuidado de enfermagem: revisão de escopo

RESUMO Objetivos: esclarecer os conceitos de Gestão do Cuidado de Enfermagem e Gerência do Cuidado de Enfermagem na literatura científica, destacando aproximações e distanciamentos entre os termos. Métodos: revisão de escopo conforme protocolo do Joanna Briggs Institute e Itens de Relatórios Preferenciais para Revisões Sistemáticas e extensão de Meta-Análises para Revisões de Escopo (PRISMA-ScR). As buscas ocorreram nas bases LILACS, CINAHL, MEDLINE e Scopus. Resultados: a análise qualitativa, mediante a análise de conteúdo, contou com 49 estudos, publicados entre 2007 e 2020. A Atenção Hospitalar foi o nível de atenção mais evidenciado. Identificou-se que a Gestão do Cuidado de Enfermagem objetiva a atuação macropolítica do enfermeiro e mobiliza competências essencialmente estratégico-cognitivas, enquanto a Gerência do Cuidado de Enfermagem visa à atuação micropolítica do enfermeiro, requisitando competências essencialmente estratégico-administrativas. Considerações Finais: o estudo possibilitou propor a conceituação dos termos e identificar as aproximações e distanciamentos entre eles.

Regulation of gambling in Sub-Saharan Africa: findings from a comparative policy analysis

OBJECTIVES

Commercial gambling markets have undergone unprecedented expansion and diversification in territories across Sub-Saharan Africa (SSA). This gambling boom has popularised the uptake of gambling products in existing circuits of popular culture, sport and leisure and raised concerns about the extent to which state legislation is equipped to regulate the differentiated impacts of gambling on public health.

STUDY DESIGN

Comparative policy analysis.

METHODS

This article provides a systematic mapping of the regulatory environment pertaining to gambling across SSA. The review was conducted by obtaining and triangulating data from a desk review of online materials, consultation with regulatory bodies in each territory and the VIXIO Gambling Compliance database.

RESULTS

Gambling is legally regulated in 41 of 49 (83.6%) SSA countries, prohibited in 7 (14.3%) and is not legislated for in 1 (2.0%). Of those countries that regulate gambling, 25 (61.0%) countries had dedicated regulators and 16 (39.0%) countries regulated via a government department. Only 2 of 41 (4.9%) countries have published annual reports continuously since the formation of regulatory bodies, and 3 (7.3%) countries have published an incomplete series of reports since the formation. In 36 (87.8%) countries, no reports were published. Enforcement activities were documented by all five regulators that published reports.

CONCLUSION

The review uncovered a lack of coherence in regulatory measures and the need for more transparent public reporting across SSA territories. There are also variations in regulating online products and marketing, with most countries lacking apt guidelines for the digital age. Our findings suggest an urgent need to address the regulatory void surrounding online forms of gambling and the promotion of gambling products. This underlines the importance of a public health approach to protect against an increase in gambling-related harms.

Collaboration between health system decision makers and professional researchers to coproduce knowledge, a scoping review

BACKGROUND

Recent literature uses different terms and approaches to the collaboration between researchers and health system decision-makers in the research process. In 2012, the World Health Organisation proposed to "Embed research within decision-making processes". Yet, important contributions use other terms and perspectives for the same issue. This scoping review aimed to identify these terms, approaches, their application and eventual influence on the utilization of evidence.

METHODS

We searched papers published between January 2000 and February 2019 in English, Spanish, French and Portuguese in the databases of PubMed, Scielo, Google Scholar and EBSCOhost, thus accessing MedicLatina, MEDLINE Complete and eBook Collection. Our main inclusion criterion was the participation of health personnel in non-clinical research activities. We considered three domains for in depth analysis: Definition, name and description of the participation of decision makers and health staff; Forms of collaboration and actual/effective participation of health staff in research; Eventual influence on the utilization of research results.

RESULTS

We identified 607 articles and selected 74 for full text analysis. Nineteen different terms are currently used in twelve countries to describe the participation of health decision-makers and staff in research activities. Most publications refer to Integrated Knowledge Translation or Embedded Research, and were published in Canada and the United Kingdom. Forty-five papers discuss the participation of health staff in research activities; 20 leading the whole process and 21 as collaborators.

CONCLUSIONS

The identification of the different terms and approaches to the close collaboration of health staff and decision-makers with professional researchers is essential to promote its effective application and influence on the utilization of evidence. Yet, it is also necessary to insist in their co-participation throughout the whole investigation process as a relevant way to improve research results uptake, strengthen health systems and advance towards universal health coverage.

Developing patient safety standards for health-care quality promotion in neonatal intensive care units: A mixed-methods Protocol

BACKGROUND

Neonatal intensive care unit (NICU) is one of the accident-prone settings in the health-care system. There is a series of structural and process threats to the safety of infants hospitalized in this unit, which can be prevented by taking the right actions. For this purpose, developing standards based on current knowledge, available resources, and the context that provides care can determine patient injury prevention requirements. Likewise, it can be a source for national development and application of related guidelines and protocols. This study aims to develop patient safety standards in the NICUs of Iran.

MATERIALS AND METHODS

This mixed-methods study will apply the exploration, preparation, implementation, and sustainment framework to develop patient safety standards. In each phase of this framework, a set of activities take place. Exploration is based on the world health organization model to develop standards. Determining the validity and applicability of standards will be done in Phase 2 (Preparation) and Phase 3 (Implementation), respectively. Since the long-term effects are not desired, the fourth phase (Sustainment) will not be considered.

DISCUSSION

Patient safety standards from this study will contribute to efficient and effective, equitable, and high-quality health-care delivery. The application of them will further promote patient safety and the quality of medical care in Iranian NICUs.

Researchers' and Research Users' Experiences With and Reasons for Working Together in Spinal Cord Injury Research Partnerships: A Qualitative Study

BACKGROUND

Research partnership approaches are becoming popular within spinal cord injury (SCI) health research system, providing opportunities to explore experiences of and learn from SCI research partnership champions. This study aimed to explore and describe SCI researchers' and research users' (RU') experiences with and reasons for conducting and/or disseminating (health) research in partnership in order to gain more insight into potentially ways to build capacity for and foster change to support research partnerships within a health research system.

METHODS

Underpinned by a pragmatic perspective, ten semi-structured timeline interviews were conducted with researchers and RU who have experiences with SCI research partnerships. Interviews focused on experiences in participants' lives that have led them to become a person who conducts and/or disseminates research in partnership. Data were analysed using narrative thematic analysis.

RESULTS

We identified three threads from participants' stories: (1) seeing and valuing different perspectives, (2) inspirational role models, and (3) relational and personal aspect of research partnerships. We identified sub-threads related to experiences that participants draw on how they came to be a person who engage in (health) research partnerships, and sub-threads related to participants' reasons for engaging in research partnerships. While most sub-threads were identified from both researchers' and RU' perspectives (eg, partnership successes and failures), some were unique for researchers (morally the right thing to do) or RU (advocating).

CONCLUSION

Using a narrative and pragmatic approach, this study provided a new understanding of SCI researchers' and RU' partnership experiences over time. We found that participants' research partnership experiences and motivations align with components of leadership theories. The findings from this study may be used to inform strategies and policy programs to build capacity for conducting and disseminating (health) research in partnership, within and beyond SCI research.

Paper 4: a review of reporting and disseminating approaches for rapid reviews in health policy and systems research

BACKGROUND

Transparent reporting of rapid reviews enables appropriate use of research findings and dissemination strategies can strengthen uptake and impact for the targeted knowledge users, including policy-makers and health system managers. The aim of this literature review was to understand reporting and dissemination approaches for rapid reviews and provide an overview in the context of health policy and systems research.

METHODS

A literature review and descriptive summary of the reporting and disseminating approaches for rapid reviews was conducted, focusing on available guidance and methods, considerations for engagement with knowledge users, and optimizing dissemination. MEDLINE, PubMed, Google scholar, as well as relevant websites and reference lists were searched from January 2017 to March 2021 to identify the relevant literature with no language restrictions. Content was abstracted and charted.

RESULTS

The literature review found limited guidance specific to rapid reviews. Building on the barriers and facilitators to systematic review use, we provide practical recommendations on different approaches and methods for reporting and disseminating expedited knowledge synthesis considering the needs of health policy and systems knowledge users. Reporting should balance comprehensive accounting of the research process and findings with what is "good enough" or sufficient to meet the requirements of the knowledge users, while considering the time and resources available to conduct a review. Typical approaches may be used when planning the dissemination of rapid review findings; such as peer-reviewed publications or symposia and clear and ongoing engagement with knowledge users in crafting the messages is essential so they are appropriately tailored to the target audience. Consideration should be given to providing different products for different audiences. Dissemination measures and bibliometrics are also useful to gauge impact and reach.

CONCLUSIONS

Limited guidance specific to the reporting and dissemination of rapid reviews is available. Although approaches to expedited synthesis for health policy and systems research vary, considerations for the reporting and dissemination of findings are pertinent to all.

Paper 2: Performing rapid reviews

BACKGROUND

Health policy-makers must often make decisions in compressed time frames and with limited resources. Hence, rapid reviews have become a pragmatic alternative to comprehensive systematic reviews. However, it is important that rapid review methods remain rigorous to support good policy development and decisions. There is currently little evidence about which streamlined steps in a rapid review are less likely to introduce unacceptable levels of uncertainty while still producing a product that remains useful to policy-makers.

METHODS

This paper summarizes current research describing commonly used methods and practices that are used to conduct rapid reviews and presents key considerations and options to guide methodological choices for a rapid review.

RESULTS

The most important step for a rapid review is for an experienced research team to have early and ongoing engagement with the people who have requested the review. A clear research protocol, derived from a needs assessment conducted with the requester, serves to focus the review, defines the scope of the rapid review, and guides all subsequent steps. Common recommendations for rapid review methods include tailoring the literature search in terms of databases, dates, and languages. Researchers can consider using a staged search to locate high-quality systematic reviews and then subsequently published primary studies. The approaches used for study screening and selection, data extraction, and risk-of-bias assessment should be tailored to the topic, researcher experience, and available resources. Many rapid reviews use a single reviewer for study selection, risk-of-bias assessment, or data abstraction, sometimes with partial or full verification by a second reviewer. Rapid reviews usually use a descriptive synthesis method rather than quantitative meta-analysis. Use of brief report templates and standardized production methods helps to speed final report publication.

CONCLUSIONS

Researchers conducting rapid reviews need to make transparent methodological choices, informed by stakeholder input, to ensure that rapid reviews meet their intended purpose. Transparency is critical because it is unclear how or how much streamlined methods can bias the conclusions of reviews. There are not yet internationally accepted standards for conducting or reporting rapid reviews. Thus, this article proposes interim guidance for researchers who are increasingly employing these methods.

Rapid reviews for health policy and systems decision-making: more important than ever before

BACKGROUND

Due to the explosion in rapid reviews in the literature during COVID-19, their utility in universal health coverage and in other routine situations, there is now a need to document and further advance the application of rapid review methods, particularly in low-resource settings where a scarcity of resources may preclude the production of a full systematic review. This is the introductory article for a series of articles to further the discussion of rapid reviews for health policy and systems decision-making.

MAIN BODY

The series of papers builds on a practical guide on the conduct and reporting of rapid reviews that was published in 2019. The first paper provides an evaluation of a rapid review platform that was implemented in four centers in low-resource settings, the second paper presents approaches to tailor the methods for decision-makers through rapid reviews, the third paper focuses on selecting different types of rapid review products, and the fourth pertains to reporting the results from a rapid review.

CONCLUSION

Rapid reviews have a great potential to inform universal health coverage and global health security interventions, moving forward, including preparedness and response plans to future pandemics. This series of articles will be useful for both researchers leading rapid reviews, as well as decision-makers using the results from rapid reviews.

Considerations for supporting meaningful stakeholder engagement in global mental health research

The need to ensure that research evidence is adopted by health systems and is informed by lived experience expertise has been increasingly recognised in mental health research. In the field of global mental health (GMH), though some progress has been made, the meaningful engagement of key stakeholders in research remains low. This editorial outlines recommendations to support the meaningful engagement of policy makers and people with lived or living experience of mental illness in GMH research. Recommendations include: increasing funding structures that are designed to support meaningful engagement; urging institutions to consider administrative structures that support engagement with lower resourced partners; promoting capacity development opportunities and resources to support researchers to promote meaningful engagement; developing research governance structures that include key stakeholders; and, taking steps to ensure the needs of diverse stakeholders are met through their engagement in research. Examples of good practice from these areas are provided. Though not an exhaustive list of recommendations, this editorial represents a call to the GMH research community to take a deliberate and proactive approach to prioritising meaningful stakeholder engagement in GMH research with the ultimate goal of improving accessible and appropriate mental health care.

Methodological Rigor and Transparency in Clinical Practice Guidelines for Nutrition Care in Critically Ill Adults: A Systematic Review Using the AGREE II and AGREE-REX Tools

Background: To evaluate the methodological quality of (1) clinical practice guidelines (CPGs) that inform nutrition care in critically ill adults using the AGREE II tool and (2) CPG recommendations for determining energy expenditure using the AGREE-REX tool. Methods: CPGs by a professional society or academic group, intended to guide nutrition care in critically ill adults, that used a systematic literature search and rated the evidence were included. Four databases and grey literature were searched from January 2011 to 19 January 2022. Five investigators assessed the methodological quality of CPGs and recommendations specific to energy expenditure determination. Scaled domain scores were calculated for AGREE II and a scaled total score for AGREE-REX. Data are presented as medians (interquartile range). Results: Eleven CPGs were included. Highest scoring domains for AGREE II were clarity of presentation (82% [76–87%]) and scope and purpose (78% [66–83%]). Lowest scoring domains were applicability (37% [32–42%]) and stakeholder involvement (46% [33–51%]). Eight (73%) CPGs provided recommendations relating to energy expenditure determination; scores were low overall (37% [36–40%]) and across individual domains. Conclusions: Nutrition CPGs for critically ill patients are developed using systematic methods but lack engagement with key stakeholders and guidance to support application. The quality of energy expenditure determination recommendations is low.

Effectiveness of different types and levels of social distancing measures: a scoping review of global evidence from earlier stage of COVID-19 pandemic

OBJECTIVE

Social distancing is one of the main non-pharmaceutical interventions used in the control of the COVID-19 pandemic. This scoping review aims to synthesise research findings on the effectiveness of different types and levels of social distancing measures in the earlier stage of COVID-19 pandemic without the confounding effect of mass vaccination.

DESIGN

Scoping review.

DATA SOURCES

MEDLINE, Embase, Global Health and four other databases were searched for eligible studies on social distancing for COVID-19 published from inception of the databases to 30 September 2020.

STUDY SELECTION AND DATA EXTRACTION

Effectiveness studies on social distancing between individuals, school closures, workplace/business closures, public transport restrictions and partial/full lockdown were included. Non-English articles, studies in healthcare settings or not based on empirical data were excluded.

RESULTS

After screening 1638 abstracts and 8 additional articles from other sources, 41 studies were included for synthesis of findings. The review found that the outcomes of social distancing measures were mainly indicated by changes in R_t , incidence and mortality, along with indirect indicators such as daily contact frequency and travel distance. There was adequate empirical evidence for the effect of social distancing at the individual level, and for partial or full lockdown at the community level. However, at the level of social settings, the evidence was moderate for school closure, and was limited for workplace/business closures as single targeted interventions. There was no evidence for a separate effect of public transport restriction.

CONCLUSIONS

In the community setting, there was stronger evidence for the combined effect of different social distancing interventions than for a single intervention. As fatigue of preventive behaviours is an issue in public health agenda, future studies should analyse the risks in specific settings such as eateries and entertainment to implement and evaluate measures which are proportionate to the risk.

Moving from consultation to co-creation with knowledge users in scoping reviews: guidance from the JBI Scoping Review Methodology Group

ABSTRACT

Knowledge user consultation is often limited or omitted in the conduct of scoping reviews. Not including knowledge users within the conduct and reporting of scoping reviews could be due to a lack of guidance or understanding about what consultation requires and the subsequent benefits. Knowledge user engagement in evidence synthesis, including consultation approaches, has many associated benefits, including improved relevance of the research and better dissemination and implementation of research findings. Scoping reviews, however, have not been specifically focused on in terms of research into knowledge user consultation and evidence syntheses. In this paper, we will present JBI's guidance for knowledge user engagement in scoping reviews based on the expert opinion of the JBI Scoping Review Methodology Group. We offer specific guidance on how this can occur and provide information regarding how to report and evaluate knowledge user engagement within scoping reviews. We believe that scoping review authors should embed knowledge user engagement into all scoping reviews and strive towards a co-creation model.

Systematic overviews of partnership principles and strategies identified from health research about spinal cord injury and related health conditions: A scoping review

STUDY DESIGN

Scoping review.

OBJECTIVE

To identify and provide systematic overviews of partnership principles and strategies identified from health research about spinal cord injury (SCI) and related health conditions.

METHODS

Four health electronic databases (Medline, Embase, CINAHL, PsycINFO) were searched from inception to March 2019. We included articles that described, reflected, and/or evaluated one or more collaborative research activities in health research about SCI, stroke, multiple sclerosis, Parkinson's disease, amputation, cerebral palsy, spina bifida, amyotrophic lateral sclerosis, acquired brain injury, or wheelchair-users. Partnership principles (i.e. norms or values) and strategies (i.e. observable actions) were extracted and analyzed using directed qualitative content analysis.

RESULTS

We included 39 articles about SCI (n = 13), stroke (n = 15), multiple sclerosis (n = 5), amputation (n = 2), cerebral palsy (n = 2), Parkinson's disease (n = 1), and wheelchair users (n = 1). We extracted 110 principles and synthesized them into 13 overarching principles. Principles related to building and maintaining relationships between researchers and research users were most frequently reported. We identified 32 strategies that could be applied at various phases of the research process and 26 strategies that were specific to a research phase (planning, conduct, or dissemination).

CONCLUSION

We provided systematic overviews of principles and strategies for research partnerships. These could be used by researchers and research users who want to work in partnership to plan, conduct and/or disseminate their SCI research. The findings informed the development of the new SCI Integrated Knowledge Translation Guiding Principles (www.iktprinciples.com) and will support the implementation of these Principles within the SCI research system.

Search like an expert: Reducing expertise disparity using a hybrid neural index for COVID-19 queries

Consumers from non-medical backgrounds often look for information regarding a specific medical information need; however, they are limited by their lack of medical knowledge and may not be able to find reputable resources. As a case study, we investigate reducing this knowledge barrier to allow consumers to achieve search effectiveness comparable to that of an expert, or a medical professional, for COVID-19 related questions. We introduce and evaluate a hybrid index model that allows a consumer to formulate queries using consumer language to find relevant answers to COVID-19 questions. Our aim is to reduce performance degradation between medical professional queries and those of a consumer. We use a universal sentence embedding model to project consumer queries into the same semantic space as professional queries. We then incorporate sentence embeddings into a search framework alongside an inverted index. Documents from this index are retrieved using a novel scoring function that considers sentence embeddings and BM25 scoring. We find that our framework alleviates the expertise disparity, which we validate using an additional set of crowdsourced-consumer-queries even in an unsupervised setting. We also propose an extension of our method, where the sentence encoder is optimised in a supervised setup. Our framework allows for a consumer to search using consumer queries to match the search performance with that of a professional.

A Canadian model for providing high-quality, timely and relevant evidence to meet health system decision-maker needs: the SPOR Evidence Alliance

Canada has made great progress in synthesizing, disseminating, and integrating research findings into health systems and clinical decision-making; yet gaps exist in the research-to-practice continuum. The Strategy for Patient-Oriented Research (SPOR) Evidence Alliance aims to help close gaps by providing decision-makers with evidence that is timely, context sensitive, and demand driven to better inform patient-oriented practices and policies in health systems. In this article, we introduce a model established in Canada to support decision-maker needs for high-quality evidence that is patient oriented to enhance health systems performance. We provide an overview of how this model was implemented, who is involved, who it serves, as well as its organizational structure and remit. We discuss key milestones achieved to date and the impact this initiative has made within the health research community. The strength of the SPOR Evidence Alliance lies in its unique ability to simultaneously: ( i) serve as a national platform for researchers to stay connected and collaborate to minimize duplication of efforts and ( ii) facilitate access to research knowledge for patient partners and decision-makers. In doing so, the SPOR Evidence Alliance is supporting health policy and practice decisions that support and strengthen Canada’s dynamic health systems.

Introducing the Strategy for Patient Oriented Research (SPOR) Evidence Alliance: a partnership between researchers, patients and health system decision-makers to support rapid-learning and responsive health systems in Canada and beyond

This is the introductory paper in a collection of four papers on the Strategy for Patient-Oriented Research (SPOR) Evidence Alliance, a pan-Canadian research initiative that was funded by the Canadian Institutes of Health Research in September of 2017. Here, we introduce the SPOR enterprise in Canada, provide a rationale for the creation of the SPOR Evidence Alliance, provide information on the mandate and approach, and describe how the SPOR Evidence Alliance adds to the health research ecosystem in Canada and beyond.

Sensor technology to monitor health, well-being and movement among healthcare personnel at workplace: a systematic scoping review protocol

INTRODUCTION

The well-being and health of healthcare personnel is becoming increasingly important in the delivery of high-quality healthcare. The recent developments in technology have provided new opportunities for the objective detection of a wide variety of real-world properties and movement. However, technologies that are used to monitor health, well-being and movement among healthcare personnel have not been fully synthesised. The overall aim of this scoping review is to examine what type of sensor technology is available to monitor the health, well-being and movement of healthcare personnel in healthcare settings. More specifically, we want to explore what types of sensor technology applications, for what purposes and how they have been used to monitor health, well-being and movement among healthcare personnel in different workplace settings.

METHODS AND ANALYSIS

This scoping review protocol will follow Arksey and O'Malley's methodology, complemented by the approach of the Joanna Briggs Institute to scoping reviews and guidance for conducting systematic scoping reviews. Peer-reviewed literature will be identified using a search strategy developed by a librarian, and a wide range of electronic datasets of medical, computer and information systems disciplines will be used. Eligibility of the articles will be determined using a two-stage screening process consisting of (1) a title and abstract scan, and (2) a full-text review. Extracted data will be thematically analysed and validated by an expert of sensor technology and a group of nurses as stakeholders. Descriptive statistics will be calculated when necessary.

ETHICS AND DISSEMINATION

The results obtained from the review will inform what technology has been used, how it has been used in healthcare settings and what types of technology might still be needed for future innovations. Findings of the scoping review will be published in a peer-reviewed journal.

REGISTRATION

This review was submitted in Open Science Framework on 12 December 2020.

Scoping reviews: reinforcing and advancing the methodology and application

Scoping reviews are an increasingly common approach to evidence synthesis with a growing suite of methodological guidance and resources to assist review authors with their planning, conduct and reporting. The latest guidance for scoping reviews includes the JBI methodology and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses-Extension for Scoping Reviews. This paper provides readers with a brief update regarding ongoing work to enhance and improve the conduct and reporting of scoping reviews as well as information regarding the future steps in scoping review methods development. The purpose of this paper is to provide readers with a concise source of information regarding the difference between scoping reviews and other review types, the reasons for undertaking scoping reviews, and an update on methodological guidance for the conduct and reporting of scoping reviews.Despite available guidance, some publications use the term 'scoping review' without clear consideration of available reporting and methodological tools. Selection of the most appropriate review type for the stated research objectives or questions, standardised use of methodological approaches and terminology in scoping reviews, clarity and consistency of reporting and ensuring that the reporting and presentation of the results clearly addresses the review's objective(s) and question(s) are critical components for improving the rigour of scoping reviews.Rigourous, high-quality scoping reviews should clearly follow up to date methodological guidance and reporting criteria. Stakeholder engagement is one area where further work could occur to enhance integration of consultation with the results of evidence syntheses and to support effective knowledge translation. Scoping review methodology is evolving as a policy and decision-making tool. Ensuring the integrity of scoping reviews by adherence to up-to-date reporting standards is integral to supporting well-informed decision-making.

A systematic approach to context-mapping to prepare for health interventions: development and validation of the SETTING-tool in four countries

Effectiveness of health interventions can be substantially impaired by implementation failure. Context-driven implementation strategies are critical for successful implementation. However, there is no practical, evidence-based guidance on how to map the context in order to design context-driven strategies. Therefore, this practice paper describes the development and validation of a systematic context-mapping tool. The tool was cocreated with local end-users through a multistage approach. As proof of concept, the tool was used to map beliefs and behaviour related to chronic respiratory disease within the FRESH AIR project in Uganda, Kyrgyzstan, Vietnam and Greece. Feasibility and acceptability were evaluated using the modified Conceptual Framework for Implementation Fidelity. Effectiveness was assessed by the degree to which context-driven adjustments were made to implementation strategies of FRESH AIR health interventions. The resulting Setting-Exploration-Treasure-Trail-to-Inform-implementatioN-strateGies (SETTING-tool) consisted of six steps: (1) Coset study priorities with local stakeholders, (2) Combine a qualitative rapid assessment with a quantitative survey (a mixed-method design), (3) Use context-sensitive materials, (4) Collect data involving community researchers, (5) Analyse pragmatically and/or in-depth to ensure timely communication of findings and (6) Continuously disseminate findings to relevant stakeholders. Use of the tool proved highly feasible, acceptable and effective in each setting. To conclude, the SETTING-tool is validated to systematically map local contexts for (lung) health interventions in diverse low-resource settings. It can support policy-makers, non-governmental organisations and health workers in the design of context-driven implementation strategies. This can reduce the risk of implementation failure and the waste of resource potential. Ultimately, this could improve health outcomes.

The Primary Care Analytics Team: Integrating research and clinical care within the Veterans Health Administration Office of Primary Care

By designing and evaluating health system improvements and providing evidence to clinical decision-makers, embedded researchers are a critical part of a Learning Health System (LHS). In this article, we describe the evolution and mission of the Primary Care Analytics Team (PCAT), an integrated research team within the Veterans Health Administration Office of Primary Care. We discuss challenges and strategies for success in working with clinical operations partners and provide recommendations for other Learning Health Systems units embedded in large integrated health care organizations.

Fostering innovative behavior in health organizations: a PLS-SEM analysis of Norwegian hospital employees

Background

Health organization research is experiencing a strong refocus on employees’ individual innovative behavior (IIB), revealing that many of the influential factors at work remain uncertain. Hence, this study empirically examines fostering of hospital employees’ IIB by focusing on direct and indirect relationships of organizational culture (here labeled internal market-oriented culture, IMOC), psychological capital (PsyCap), and organizational commitment (OC).

Methods

The study focused on a sample of 1008 hospital employees, using a partial least squares–structural equation modeling method to analyze and test the relationships hypothesized in this study. A multigroup comparison was performed to test the heterogeneity of personal characteristics. The indirect relationships of PsyCap were tested using mediator analyses.

Results

Our results reveal that IMOC has a positive and significant correlation to employees’ PsyCap and IIB. PsyCap is directly related to IIB and indirectly related to IMOC and IIB. Furthermore, the study found that IIB is related to OC.

Conclusions

This study extends the current debate on how IIB is fostered at work by examining PsyCap and IMOC as antecedents of IIB. The study has added to the IIB research area by examining the role of IIB on OC. The study is among the first attempts in its category to contribute to health organizations and managers by empirically examining the role of IMOC on employees’ PsyCap and IIB—and, in turn, their OC.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06505-1.

Improving knowledge translation for increased engagement and impact in healthcare

Ineffective knowledge dissemination contributes to clinical practice and service improvements not being realised. Meaningful knowledge translation can occur through the understanding and matching of appropriate communication mediums that are relevant for different stakeholders or audiences. To this end, we present a dissemination instrument, the 'REAch and Diffusion of health iMprovement Evidence' (README) checklist, for the communication of research findings, integrating both traditional and newer communication mediums. Additionally, we propose a 'Strategic Translation and Engagement Planning' (STEP) tool, for use when deciding which mediums to select. The STEP tool challenges the need for communicating complex and simple information against the desire for passive or active stakeholder interaction. Used collaboratively by academics and health professionals, README and STEP can promote co-production of research, subsequent diffusion of knowledge, and develop the capacity and skills of all stakeholders.

A review of reviews on principles, strategies, outcomes and impacts of research partnerships approaches: a first step in synthesising the research partnership literature

Background

Conducting research in partnership with stakeholders (e.g. policy-makers, practitioners, organisations, patients) is a promising and popular approach to improving the implementation of research findings in policy and practice. This study aimed to identify the principles, strategies, outcomes and impacts reported in different types of reviews of research partnerships in order to obtain a better understanding of the scope of the research partnership literature.

Methods

This review of reviews is part of a Coordinated Multicenter Team approach to synthesise the research partnership literature with five conceptually linked literature reviews. The main research question was ‘What principles, strategies, outcomes and impacts are reported in different types of research partnership approaches?’. We included articles describing a literature review of research partnerships using a systematic search strategy. We used an adapted version of the Revised Assessment of Multiple Systematic Reviews tool to assess quality. Nine electronic databases were searched from inception to April 2018. Principles, strategies, outcomes and impacts were extracted from the included reviews and analysed using direct content analysis.

Results

We included 86 reviews using terms describing several research partnership approaches (e.g. community-based participatory research, participatory research, integrated knowledge translation). After the analyses, we synthesised 17 overarching principles and 11 overarching strategies and grouped them into one of the following subcategories: relationship between partners; co-production of knowledge; meaningful stakeholder engagement; capacity-building, support and resources; communication process; and ethical issues related to the collaborative research activities. Similarly, we synthesised 20 overarching outcomes and impacts on researchers, stakeholders, the community or society, and the research process.

Conclusions

This review of reviews is the first that presents overarching principles, strategies, outcomes and impacts of research partnerships. This review is unique in scope as we synthesised literature across multiple research areas, involving different stakeholder groups. Our findings can be used as a first step to guide the initiation and maintenance of research partnerships and to create a classification system of the key domains of research partnerships, which may improve reporting consistency in the research partnership literature.

Trial registration

This study is registered via Open Science Framework: 10.17605/OSF.IO/GVR7Y.

Embedding implementation research to enhance health policy and systems: a multi-country analysis from ten settings in Latin America and the Caribbean

Background

Progress towards universal health coverage requires health policies and systems that are informed by contextualised and actionable research. Many challenges impede the uptake of evidence to enhance health policy implementation and the coverage, quality, efficiency and equity of health systems. To address this need, we developed an innovative model of implementation research embedded in real-world policy and programme cycles and led directly by policy-makers and health systems decision-makers. The approach was tested in ten settings in Latin America and the Caribbean, supported under a common funding and capacity strengthening initiative. The present study aims to analyse ten embedded implementation research projects in order to identify barriers and facilitators to embedding research into policy and practice as well as to assess the programme, policy and systems improvements and the cross-cutting lessons in conducting research embedded in real-world policy and systems decision-making.

Methods

The multi-country analysis is based on the triangulation of data collected via three methods, namely (1) document review, (2) an electronic questionnaire and (3) in-depth interviews with decision-makers. Data from the document review was charted and narratively synthesised. Data from the questionnaire was used to assess three characteristics of the decision-maker’s participation in embedded research, namely (1) level of engagement in different stages of research; (2) extent to which their capacities to conduct and use research were developed; and (3) the level of confidence in undertaking implementation research activities. Interview data was analysed using a thematic approach.

Results

The main barriers to effective delivery or scale-up of health interventions identified in the research projects were inadequate financing, fragmentation of healthcare services and information systems, limited capacity of health system stakeholders, insufficient time, cultural factors, and a lack of information. Decision-makers’ experience in embedded research showed strong engagement in protocol development, moderate engagement in data collection and low engagement in data analysis. The in-depth interviews identified 17 facilitators and 8 barriers to embedding research into policy and systems. The principal facilitating factors were actionability of findings, relevance of research and engagement of decision-makers, whereas the main barriers were time and political processes. In Argentina, the research led to the development of new monitoring indicators to improve the implementation of the perinatal health policy, while in Chile, empirical findings supported the establishment of a training programme on reproductive rights, targeted to municipal health facilities.

Conclusions

This multi-country analysis contributes to the evidence base for the embedded research approach to support health policy and systems decisions-making. Embedding research into policy and practice stimulates the relevance and applicability of research, while promoting decision-makers’ engagement and likelihood to use research evidence in policy-making and health systems strengthening.

Evaluation of an HIV-specific rapid response service for community-based organisations in Ontario, Canada

Background

To support AIDS service organisations and other community-based organisations’ use of research evidence to inform HIV-related programmes, services and policies, the Ontario HIV Treatment Network (OHTN) developed a Rapid Response Service. The final product of the rapid response process at the OHTN, which is more streamlined than that of traditional systematic reviews, consists of a detailed report answering questions regarding an HIV-specific issue and how the findings apply within the local context. In 2016, the OHTN conducted an evaluation to assess the effectiveness of its Rapid Response Service. This article reports on the development of this service as well as the results of the evaluation.

Methods

All rapid responses published between January 1, 2009, and September 30, 2016, by the OHTN (n = 102) were analysed using univariate analyses. Frequency distributions were determined for the following variables for each rapid response: populations observed, topics covered, requestor affiliations and number of downloads from the OHTN’s website. Requestors of rapid responses were also interviewed regarding perceived helpfulness and utility of the service and final products, and suggestions for changes to the service. Six-month follow-up interviews were conducted to determine how affiliated organisations used the evidence from the rapid response they requested.

Results

The 102 rapid responses published covered 14 different populations of interest. Topics covered included the HIV prevention, engagement and care cascade, determinants of health, syndemics, and comorbidities. Requestor affiliations consisted of AIDS service organisations, government agencies and policy-makers, non-HIV-focused community-based organisations, and hospitals, universities or health centres. Requestors perceived most aspects of the Rapid Response Service as very helpful and most frequently suggested that the rapid responses should provide recommendations. Follow-up interviews regarding the impact of rapid responses show that rapid responses have been used to assist organisations in numerous activities.

Conclusions

Organisations that have used the OHTN’s Rapid Response Service describe it as a valuable service useful for the development of programmes and policies. Improvements in capacity-building efforts may increase its utility. Describing the findings of this evaluation may serve as a reference for similar programmes to increase the use of research evidence among public health decision-makers.

Electronic supplementary material

The online version of this article (10.1186/s12961-019-0476-4) contains supplementary material, which is available to authorized users.

Engaging knowledge users in a systematic review on the comparative effectiveness of geriatrician-led models of care is possible: A cross-sectional survey using the Patient Engagement Evaluation Tool

BACKGROUND

A systematic review (SR) was conducted to evaluate the comparative effectiveness of geriatrician-led models of care, and an integrated knowledge translation (iKT) approach facilitated SR relevance. Activities to engage knowledge users (KUs) in the SR were evaluated for perceived level of engagement.

STUDY DESIGN AND SETTING

KUs included patients, caregivers, geriatricians, and policymakers from three Canadian provinces. Activities included 1) modified Delphi to select outcomes; 2) cross-sectional survey to select outcome measures, and 3) in-person meeting to discuss SR findings. KU engagement was assessed using the Patient Engagement Evaluation Tool (PEET) after the second and third activities. KUs rated the extent of successful engagement using a 7-point Likert scale ranging from "no extent" to "very large extent."

RESULTS

In total, 15 KUs completed the PEET: eight geriatricians, four policymakers, two patients, and one caregiver. Median engagement scores across all activities (median range: 6.00-6.50) indicated that KUs felt engaged. Differences were observed for activity type; perceived engagement at in-person meeting resulted in higher meta-criteria scores for trust (P = 0.005), legitimacy (P = 0.003), fairness (P = 0.013), and competency (P = 0.035) compared with online activities.

CONCLUSIONS

KUs can be engaged meaningfully in SR processes. Their perceived engagement was higher for in-person than for online activities.

A modified Delphi and cross-sectional survey to facilitate selection of optimal outcomes and measures for a systematic review on geriatrician-led care models

OBJECTIVE

The objective of this study was to identify relevant outcomes and measures to inform a systematic review (SR) on the comparative effectiveness of geriatrician-led care models.

STUDY DESIGN AND SETTING

In the modified Delphi to select outcomes for inclusion in the SR, knowledge users (KUs) from Ontario, Alberta, and Saskatchewan rated outcome importance using a Likert scale. A survey was then completed by geriatricians to determine optimal measures for selected outcomes. Findings were analyzed using frequencies, means, and standard deviations (SDs).

RESULTS

Thirty-three KUs (patients, caregivers, policymakers and geriatricians) rated 27 outcomes in round 1 of the modified Delphi. Top-rated outcomes included function (mean 6.85 ± SD 0.36), cognition (6.47 ± SD 0.72), and quality of life (6.38 ± SD 0.91). Twenty-three KUs participated in round 2 and rated 24 outcomes. Top-rated outcomes in round 2 were function (6.87 ± SD 0.34), quality of life (6.45 ± SD 1.10), and cognition (6.43 ± SD 0.73). The survey was completed by 22 geriatricians and the highest ranked measures were Activities of Daily Living (function), Mini-Mental State Examination (cognition), and the Medical Outcomes Study SF-36 (quality of life).

CONCLUSION

We identified the most relevant outcomes and measures for patients, caregivers, policymakers, and geriatricians, allowing us to tailor the SR to KU needs.

Translating behavioral medicine evidence to public policy

Behavioral medicine has made significant contributions to our understanding of how to prevent disease and improve health. However, social and environmental factors continue to have a major influence on health in ways that will be difficult to combat on a population level without concerted efforts to scale interventions and translate the evidence into public health policies. Now is also the right time to increase our efforts to produce policy relevant research and partnerships that will maximize the chances that our evidence is taken to scale in ways that can influence population health broadly, and perhaps contribute to the reduction of the recalcitrant health disparities that plague virtually every area of behavioral medicine focus. As a field we must take an active role in policy translation, learning from the public policy and political science disciplines, and our own pioneers in policy translation. This article discusses importance of accelerating evidence translation to policy, and suggests several factors that could enhance our translation efforts, including embracing policy translation as a key goal in behavioral medicine, increasing our understanding in variability of evidence-based policy adoption across and within states, improving our understanding of how to most effectively communicate our findings to policy makers, conducting research that is responsive to policy makers' needs, and considering the important role of local policy partnerships.

Wide-Scale Continuous Quality Improvement: A Study of Stakeholders' Use of Quality of Care Reports at Various System Levels, and Factors Mediating Use

Introduction: Increasing the use of evidence in healthcare policy and practice requires greater understanding of how stakeholders use evidence to inform policy, refine systems and change practice. Drawing on implementation theory, we have used system-focused participatory research to engage diverse stakeholders in using aggregated continuous quality improvement (CQI) data from Australian Indigenous primary health care settings to identify priority evidence-practice gaps, barriers/enablers and strategies for improvement. This article reports stakeholders' use or intended use of evidence at various levels of the system, and factors mediating use. Material and Methods: Interviews were undertaken with a purposeful sample of 30 healthcare stakeholders in different roles, organization types and settings in one Australian jurisdiction and with national participants, as part of the project's developmental evaluation. Qualitative data were analyzed to identify themes and categories relating to use of evidence. Results: Context-specific aggregated CQI data that were relatable to the diverse professional roles and practices provided an effective starting point for sharing perspectives, generating practice-based evidence and mobilizing evidence-use. Interviewees perceived the co-produced findings as applicable at different levels and useful for planning, policy development, supporting best practice and reflection, capacity strengthening and developing new research. Factors mediating use were commitment to best practice; the credibility of the evidence and its perceived relevance to work roles, contexts and decision needs; report format and language; facilitation and communication; competing work pressures and the organizational environment for change. Conclusions: This study found that primary health care stakeholders used evidence on quality of care for a variety of purposes. This could be linked to the interactive research processes used to engage stakeholders in different roles and settings in interpreting data, sharing and generating knowledge. Findings indicate that system-based participatory research using CQI data and iterative, interactive and systematic CQI-based methods can be applied at scale to support concurrent action for healthcare improvement at different system levels. Factors known to influence implementation should be addressed within the research design to optimize evidence use. Further research is needed to explore the utility of interactive dissemination for engaging healthcare stakeholders in informing policy and system change.

Assessments for Caregivers of Hospitalized Older Adults

A systematic review was conducted to characterize assessments for caregivers of hospitalized older adults. Electronic literature searches of Medline, PsycINFO, and CINAHL of articles on caregiver assessments published in English between 2006 and present were completed. Thirty-three articles underwent full-text review; four included assessments designed to capture caregiver needs in hospital settings. Original articles on the development of these assessments were reviewed for quality appraisal. Four findings emerged from our review. Existing assessments (a) focus on caregivers of specific conditions of older adults, (b) contain a singular caregiving domain, (c) measure caregiver outcomes or simply describe caregiving experiences, and (d) neglect psychometric properties. Health care providers are limited in their selection of assessments with caregivers of hospitalized older adults. This barrier is problematic if we are to equip caregivers to be successful at providing care to older adults. Future research should develop a hospital assessment for caregivers.

Application of the i-PARIHS framework for enhancing understanding of interactive dissemination to achieve wide-scale improvement in Indigenous primary healthcare

Background

Participatory research approaches improve the use of evidence in policy, programmes and practice. Few studies have addressed ways to scale up participatory research for wider system improvement or the intensity of effort required. We used the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework to analyse implementation of an interactive dissemination process engaging stakeholders with continuous quality improvement (CQI) data from Australian Indigenous primary healthcare centres. This paper reports lessons learnt about scaling knowledge translation research, facilitating engagement at a system level and applying the i-PARIHS framework to a system-level intervention.

Methods

Drawing on a developmental evaluation of our dissemination process, we conducted a post-hoc analysis of data from project records and interviews with 30 stakeholders working in Indigenous health in different roles, organisation types and settings in one Australian jurisdiction and with national participants. Content-analysed data were mapped onto the i-PARIHS framework constructs to examine factors contributing to the success (or otherwise) of the process.

Results

The dissemination process achieved wide reach, with stakeholders using aggregated CQI data to identify system-wide priority evidence–practice gaps, barriers and strategies for improvement across the scope of care. Innovation characteristics influencing success were credible data, online dissemination and recruitment through established networks, research goals aligned with stakeholders’ interest in knowledge-sharing and motivation to improve care, and iterative phases of reporting and feedback. The policy environment and infrastructure for CQI, as well as manager support, influenced participation. Stakeholders who actively facilitated organisational- and local-level engagement were important for connecting others with the data and with the externally located research team. Developmental evaluation was facilitative in that it supported real-time adaptation and tailoring to stakeholders and context.

Conclusions

A participatory research process was successfully implemented at scale without intense facilitation efforts. These findings broaden the notion of facilitation and support the utility of the i-PARIHS framework for planning participatory knowledge translation research at a system level. Researchers planning similar interventions should work through established networks and identify organisational- or local-level facilitators within the research design. Further research exploring facilitation in system-level interventions and the use of interactive dissemination processes in other settings is needed.

Electronic supplementary material

The online version of this article (10.1186/s12961-018-0392-z) contains supplementary material, which is available to authorized users.

Moving from formative research to co-creation of interventions: insights from a community health system project in Mozambique, Nepal and Peru

Different methodological approaches for implementation research in global health focusing on how interventions are developed, implemented and evaluated are needed. In this paper, we detail the approach developed and implemented in the COmmunity HEalth System InnovatiON (COHESION) Project, a global health project aimed at strengthening health systems in Mozambique, Nepal and Peru. This project developed innovative formative research at policy, health system and community levels to gain a comprehensive understanding of the barriers, enablers, needs and lessons for the management of chronic disease using non-communicable and neglected tropical diseases as tracer conditions. After formative research, COHESION adopted a co-creation approach in the planning of interventions. The approach included two interactions with each type of stakeholder at policy, health system and community level in each country which aimed to develop interventions to improve the delivery of care of the tracer conditions. Diverse tools and methods were used in order to prioritise interventions based on support, resources and impact. Additionally, a COHESION score that assessed feasibility, sustainability and scaling up was used to select three potential interventions. Next steps for the COHESION Project are to further detail and develop the interventions propositioned through this process. Besides providing some useful tools and methods, this work also highlights the challenges and lessons learned from such an approach.

Closing the gaps in opioid use disorder research, policy and practice: conference proceedings

Drug overdose deaths involving opioids have surged in recent years and the economic cost of the opioid epidemic is estimated to be over $500 billion annually. In the midst of calls for declaring a national emergency, health policy decision makers are considering the best ways to allocate resources to curb the epidemic. On June 9, 2017, 116 invited health researchers, clinicians, policymakers, health system leaders, and other stakeholders met at the University of Pennsylvania to discuss approaches to address the gaps in evidence-based substance use disorder policy and practice, with an emphasis on the opioid epidemic. The conference was sponsored by the Center for Health Economics of Treatment Interventions for Substance Use Disorder, HCV, and HIV (CHERISH), a NIDA-funded National Center of Excellence, and hosted by the Leonard Davis Institute of Health Economics of the University of Pennsylvania. The conference aims were to: (1) foster new relationships between researchers and policymakers through a collaborative work process and (2) generate evidence-based policy recommendations to address the opioid epidemic. The conference concluded with an interactive work session during which attendees self-identified as researchers or policymakers and were divided equally among 13 tables. These groups met to develop and present policy recommendations based on an opioid use disorder case study. Thirteen policy recommendations emerged across four themes: (1) quality of treatment, (2) continuity of care, (3) opioid prescribing and pain management, and (4) consumer engagement. This conference serves as a proposed model to develop equitable, working relationships among researchers, clinicians, and policymakers.

PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation

Scoping reviews, a type of knowledge synthesis, follow a systematic approach to map evidence on a topic and identify main concepts, theories, sources, and knowledge gaps. Although more scoping reviews are being done, their methodological and reporting quality need improvement. This document presents the PRISMA-ScR (Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews) checklist and explanation. The checklist was developed by a 24-member expert panel and 2 research leads following published guidance from the EQUATOR (Enhancing the QUAlity and Transparency Of health Research) Network. The final checklist contains 20 essential reporting items and 2 optional items. The authors provide a rationale and an example of good reporting for each item. The intent of the PRISMA-ScR is to help readers (including researchers, publishers, commissioners, policymakers, health care providers, guideline developers, and patients or consumers) develop a greater understanding of relevant terminology, core concepts, and key items to report for scoping reviews.