Fostering knowledge exchange between researchers and decision-makers: exploring the effectiveness of a mixed-methods approach

A scoping review of theories, models and frameworks used or proposed to evaluate knowledge mobilization strategies

BACKGROUND

Evaluating knowledge mobilization strategies (KMb) presents challenges for organizations seeking to understand their impact to improve KMb effectiveness. Moreover, the large number of theories, models, and frameworks (TMFs) available can be confusing for users. Therefore, the purpose of this scoping review was to identify and describe the characteristics of TMFs that have been used or proposed in the literature to evaluate KMb strategies.

METHODS

A scoping review methodology was used. Articles were identified through searches in electronic databases, previous reviews and reference lists of included articles. Titles, abstracts and full texts were screened in duplicate. Data were charted using a piloted data charting form. Data extracted included study characteristics, KMb characteristics, and TMFs used or proposed for KMb evaluation. An adapted version of Nilsen (Implement Sci 10:53, 2015) taxonomy and the Expert Recommendations for Implementing Change (ERIC) taxonomy (Powell et al. in Implement Sci 10:21, 2015) guided data synthesis.

RESULTS

Of the 4763 search results, 505 were retrieved, and 88 articles were eligible for review. These consisted of 40 theoretical articles (45.5%), 44 empirical studies (50.0%) and four protocols (4.5%). The majority were published after 2010 (n = 70, 79.5%) and were health related (n = 71, 80.7%). Half of the studied KMb strategies were implemented in only four countries: Canada, Australia, the United States and the United Kingdom (n = 42, 47.7%). One-third used existing TMFs (n = 28, 31.8%). According to the adapted Nilsen taxonomy, process models (n = 34, 38.6%) and evaluation frameworks (n = 28, 31.8%) were the two most frequent types of TMFs used or proposed to evaluate KMb. According to the ERIC taxonomy, activities to "train and educate stakeholders" (n = 46, 52.3%) were the most common, followed by activities to "develop stakeholder interrelationships" (n = 23, 26.1%). Analysis of the TMFs identified revealed relevant factors of interest for the evaluation of KMb strategies, classified into four dimensions: context, process, effects and impacts.

CONCLUSIONS

This scoping review provides an overview of the many KMb TMFs used or proposed. The results provide insight into potential dimensions and components to be considered when assessing KMb strategies.

Relevance and quality of implementation research proposals to face the challenges of public health in Latin-America and the Caribbean

OBJECTIVES

To analyse the relevance and quality of the research proposals submitted to the 2016 call for proposals for the initiative Improving Programme Implementation through Embedded Research (iPIER-2016) to address current public health challenges in Latin America and the Caribbean.

METHODS

We performed a cross-sectional study using information from 108 research proposals using quantitative and qualitative methods. We used three frameworks to analyse the relevance of the proposals: The Global Burden of Disease, the WHO Health Systems Conceptual Framework and the Sustainable Development Goals proposed in 2015 by the United Nations. We performed an index to analyse the relevance and quality of the proposals.

RESULTS

Twenty seven percent of the proposals have very good relevance, one third of the proposals have quality flaws. This means their research questions are not related to implementation research or their methods are insufficient or inadequate to respond to the objective.

CONCLUSIONS

The response to this call is proof of health authorities' interest in research as a tool to improve the implementation of health programs in the region. However, proposals show important variations in terms of relevance and quality among countries and training health staff in programme implementation seems a central requirement.

Collaboration between health system decision makers and professional researchers to coproduce knowledge, a scoping review

BACKGROUND

Recent literature uses different terms and approaches to the collaboration between researchers and health system decision-makers in the research process. In 2012, the World Health Organisation proposed to "Embed research within decision-making processes". Yet, important contributions use other terms and perspectives for the same issue. This scoping review aimed to identify these terms, approaches, their application and eventual influence on the utilization of evidence.

METHODS

We searched papers published between January 2000 and February 2019 in English, Spanish, French and Portuguese in the databases of PubMed, Scielo, Google Scholar and EBSCOhost, thus accessing MedicLatina, MEDLINE Complete and eBook Collection. Our main inclusion criterion was the participation of health personnel in non-clinical research activities. We considered three domains for in depth analysis: Definition, name and description of the participation of decision makers and health staff; Forms of collaboration and actual/effective participation of health staff in research; Eventual influence on the utilization of research results.

RESULTS

We identified 607 articles and selected 74 for full text analysis. Nineteen different terms are currently used in twelve countries to describe the participation of health decision-makers and staff in research activities. Most publications refer to Integrated Knowledge Translation or Embedded Research, and were published in Canada and the United Kingdom. Forty-five papers discuss the participation of health staff in research activities; 20 leading the whole process and 21 as collaborators.

CONCLUSIONS

The identification of the different terms and approaches to the close collaboration of health staff and decision-makers with professional researchers is essential to promote its effective application and influence on the utilization of evidence. Yet, it is also necessary to insist in their co-participation throughout the whole investigation process as a relevant way to improve research results uptake, strengthen health systems and advance towards universal health coverage.

Embedded implementation research determinants in Latin American health systems

OBJECTIVE:

To assess the determinants of embedded implementation research (EIR) conduct in seven Latin American and Caribbean countries.

METHODS:

This qualitative interpretative study conducted and analyzed 14 semi-structured interviews based on a grounded theory approach using Atlas-ti© 7.5.7. We grouped the conditions appointed by interviewees as determinants of EIR conduct into six domains.

RESULTS:

The participation of high-level engaged decision makers as research co-producers is an important EIR determinant that fosters research use. Nevertheless, EIR faces challenges such as dealing with key personnel changes and fluctuating political contexts.

CONCLUSIONS:

Despite its limitations, EIR is effective in creating a sense of ownership of research results among implementers, which helps bridge the gap between research and decision-making in health systems.

Initiation is recognized as a fundamental early phase of integrated knowledge translation (IKT): qualitative interviews with researchers and research users in IKT partnerships

Background

Health care researcher-research user partnerships, referred to as integrated knowledge translation (IKT), have been adopted on an international basis, and are an effective means of co-generating and implementing evidence into policy and practice. Prior research suggests that an initiation period is essential for establishing functional partnerships. To characterize IKT initiation and describe determinants of IKT initiation success, this study explored IKT initiation processes, enablers, and barriers among researchers and research users involved in IKT partnerships.

Methods

A descriptive qualitative approach was used compliant with COREQ standards. Canadian researchers and research users in research collaborations were identified on publicly-available directories and web sites, and referred by those interviewed. They were asked to describe how partnerships were initiated, influencing factors, the length of initiation, and interventions needed to support initiation. Sampling was concurrent with data collection and analysis to achieve thematic saturation. Data were analyzed using constant comparative technique by all members of the research team.

Results

In total, 22 individuals from 6 provinces were interviewed (9 researchers, 11 research users, 2 connectors). They confirmed that IKT initiation is a distinct early phase of partnerships. The period ranged from 6 months to 2 years for 75.0% of participants in pre-existing partnerships, to 6 years for newly-formed partnerships. High-level themes were: Newly identifying and securing partners is an intensive process; Processes and activities take place over a protracted period through multiple interactions; Identifying and engaging committed partners is reliant on funding; and Partnership building is challenged by maintaining continuity and enthusiasm. Participants underscored the need for an IKT partner matching forum, IKT initiation toolkit, and funding for non-research activities required during IKT initiation to establish functional researcher-research user partnerships. Themes were largely similar regardless of participant years of experience with IKT or being involved in a new versus pre-existing partnership.

Conclusions

IKT initiation is a recognized and important early phase of IKT that establishes functional partnerships, and once established, ongoing partnership for subsequent projects is likely. Further research is needed to develop and evaluate approaches recommended by participants for stimulating IKT initiation.

Making an IMPACT: A priority setting consultation exercise to improve outcomes in patients with locally advanced, recurrent and metastatic colorectal cancer

AIM

The IMPACT (Improving the Management of Patients with Advanced Colorectal Tumours) initiative was established by the Association of Coloproctology of Great Britain and Ireland in 2017 as a consortium of surgeons (colorectal, hepatobiliary, thoracic), oncologists, radiologists, pathologists, palliative care physicians, patients, carers and charity stakeholders who will work together to improve outcomes in patients with advanced and metastatic colorectal cancer. To establish this initiative, better information is required to establish how further intervention is focused. This paper details the approaches used, and outcomes generated, from a priority setting exercise to inform the design of the IMPACT initiative.

METHODS

A mixed method approach was employed to set the priorities of patients, clinicians and other key stakeholders in the delivery of optimal care. This consisted of two patient centered consultation events and a questionnaire.

RESULTS

A total of 128 participants took part in the consultation exercise; 15 patients, 5 carers/family members, 5 charity representatives and 113 healthcare professionals. Nine key themes for focus were identified, these were: current service provision, specialist services, communication, education, access to care, definitions and standardisation, research and audit, outcome measures, and funding of specialist care.

CONCLUSION

These future priorities will be developed with collaborative engagement in a systematic manner to produce an overall cohesive programme which will deliver a sustainable and efficient clinical and academic service to improving the management of patients with advanced colorectal tumours.

Examining the implementation of clinical practice guidelines for the management of adult cancers: A mixed methods study

RATIONALE, AIMS, AND OBJECTIVES

Focusing on the implementation of clinical practice guidelines (CPGs) for the management of adult cancers, the objectives of this study were to (a) describe the intrinsic elements known to influence CPG use; (b) identify the ways in which CPGs are implemented; and (c) explore how CPG characteristics and contextual factors influence implementation and use.

METHODS

We conducted a sequential mixed methods study. First, we performed a content analysis of all CPGs developed and approved for the management of adult cancers in Nova Scotia, Canada, from 2005 to 2015. CPGs were examined for the presence of 22 elements known to influence CPG use. Next, we conducted semistructured interviews with CPG developers and end users. Participants were purposively sampled, based on the findings of the content analysis. All interviews were audiotaped and transcribed verbatim. Data were analysed by two researchers using the Framework Method.

RESULTS

CPGs (n = 20) demonstrated large variation with respect to elements shown to influence CPG use. For example, 85% included content related to individualization and objectives. Yet no CPGs (0%) had journal or patient versions; discussed the education, training, or competencies needed to deliver recommendations; contained an explicit statement on anticipated work changes, or on potential direct or productivity costs; or identified barriers or facilitators that might influence CPG adoption. Interview data from CPG developers (n = 4) and users (n = 6) revealed five themes related to CPG implementation and use: (a) lack of consistency in CPG development; (b) timing and nature of stakeholder engagement; (c) credibility of the CPG development process and final CPGs; (d) limited understanding of implementation as an active process; and (e) factors at organizational and system levels influence CPG implementation and use.

CONCLUSIONS

This mixed methods study provides complementary data that may help inform more effective CPG implementation efforts and optimize their use in practice.

Knowledge Translation Process among Academic Researchers: A Case Study of Bushehr University of Medical Sciences

Today, most of the results and knowledge obtained from national and international research do not actually change the health status of people, which has led to a gap or distance between knowledge and practice. This research was a descriptive survey and examined the status of the knowledge translation process among the researchers of Bushehr University of Medical Sciences, Iran, from 2011 to 2015. The study population consisted of the researchers of the Bushehr University of Medical Sciences, who were chosen using a completely randomized design. 83 researchers were finally selected by the inclusion criteria of presenting or collaborating on at least five approved areas of research during the 2011–2015 period. Data collection was undertaken using the Assessment Questionnaire of Academic Researchers Knowledge Translation Activities, with its psychometric test also used. The results showed that the researchers’ performance was rated in the fields of transfer of the research question, knowledge production, knowledge transfer and promoting the use of evidence with 64, 75, 63 and 67 % of the total score (mean± SD) of 19.40 ± 3.89, 26.30 ± 3.97, 37.79 ± 6.89 and 13.39 ± 3.41 respectively. Based on the results of this study, the performance of the researchers in the process of knowledge translation was at a desired level while, in the fields of the research tool, the researchers had the best research performance in knowledge production and promoting the use of evidence, transfer of research question and knowledge transfer (all at the desirable level). However, the gap between knowledge and practice of the researchers in the fields of transfer of the research question and knowledge transfer was noticeable. Therefore, in order to strengthen all aspects of the research activities of the knowledge translation process, the provision of proper premises and structure will be a priority for the university’s research and technology departments.

Multi-Stakeholder Informed Guidelines for Direct Admission of Children to Hospital

OBJECTIVES

To develop pediatric direct admission guidelines and prioritize outcomes to evaluate the safety and effectiveness of hospital admission processes.

STUDY DESIGN

We conducted deliberative discussions at 1 children's hospital and 2 community hospitals, engaging parents of hospitalized children and inpatient, outpatient, and emergency department physicians and nurses to identify shared and dissenting perspectives regarding direct admission processes and outcomes. Discussions were audio-recorded, professionally transcribed, and analyzed using a general inductive approach. We then convened a national panel to prioritize guideline components and outcome measures using a RAND/UCLA Modified Delphi approach.

RESULTS

Forty-eight stakeholders participated in 6 deliberative discussions. Emergent themes related to effective multistakeholder communication, resources needed for high quality direct admissions, written direct admission guidelines, including criteria to identify children appropriate for and inappropriate for direct admission, and families' needs. Building on these themes, Delphi panelists endorsed 71 guideline components as both appropriate and necessary at children's hospitals and community hospitals and 13 outcomes to evaluate hospital admission systems. Guideline components include (1) pre-admission communication, (2) written guidelines, (3) hospital resources to optimize direct admission processes, (4) special considerations for pediatric populations that may be at particular risk of nosocomial infection and/or stress in emergency departments, (5) communication with families referred for direct admission, and (6) quality reviews to evaluate admission systems.

CONCLUSIONS

These direct admission guidelines can be adapted by hospitals and health systems to inform hospital admission policies and protocols. Multistakeholder engagement in evaluation of hospital admission processes may improve transitions of care and health system integration.

Identifying public health policymakers' sources of information: comparing survey and network analyses

Background

Research suggests that policymakers often use personal contacts to find information and advice. However, the main sources of information for public health policymakers are not known. This study aims to describe policymakers' sources of information. A questionnaire survey of public health policymakers across Greater Manchester (GM) was carried out (response rate 48%). All policy actors above Director level involved in public health policy (finding, analyzing or producing information, producing or implementing policy) in GM were included in the sampling frame. Respondents were provided with a list of sources of information and asked which they used (categorical data) and to name specific individuals who acted as sources of information (network data). Data were analyzed using frequencies and network analysis. The most frequently chosen sources of information from the categorical data were NICE, government websites and Directors of Public Health. However, the network data showed that the main sources of information in the network were actually mid-level managers in the NHS, who had no direct expertise in public health. Academics and researchers did not feature in the network. Both survey and network analyses provide useful insights into how policymakers access information. Network analysis offers practical and theoretical contributions to the evidence-based policy debate. Identifying individuals who act as key users and producers of evidence allows academics to target actors likely to use and disseminate their work.

The effectiveness of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare: a systematic review

BACKGROUND

It is widely acknowledged that health policy and management decisions rarely reflect research evidence. Therefore, it is important to determine how to improve evidence-informed decision-making. The primary aim of this systematic review was to evaluate the effectiveness of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare. The secondary aim of the review was to describe factors perceived to be associated with effective strategies and the inter-relationship between these factors.

METHODS

An electronic search was developed to identify studies published between January 01, 2000, and February 02, 2016. This was supplemented by checking the reference list of included articles, systematic reviews, and hand-searching publication lists from prominent authors. Two reviewers independently screened studies for inclusion, assessed methodological quality, and extracted data.

RESULTS

After duplicate removal, the search strategy identified 3830 titles. Following title and abstract screening, 96 full-text articles were reviewed, of which 19 studies (21 articles) met all inclusion criteria. Three studies were included in the narrative synthesis, finding policy briefs including expert opinion might affect intended actions, and intentions persisting to actions for public health policy in developing nations. Workshops, ongoing technical assistance, and distribution of instructional digital materials may improve knowledge and skills around evidence-informed decision-making in US public health departments. Tailored, targeted messages were more effective in increasing public health policies and programs in Canadian public health departments compared to messages and a knowledge broker. Sixteen studies (18 articles) were included in the thematic synthesis, leading to a conceptualisation of inter-relating factors perceived to be associated with effective research implementation strategies. A unidirectional, hierarchal flow was described from (1) establishing an imperative for practice change, (2) building trust between implementation stakeholders and (3) developing a shared vision, to (4) actioning change mechanisms. This was underpinned by the (5) employment of effective communication strategies and (6) provision of resources to support change.

CONCLUSIONS

Evidence is developing to support the use of research implementation strategies for promoting evidence-informed policy and management decisions in healthcare. The design of future implementation strategies should be based on the inter-relating factors perceived to be associated with effective strategies.

TRIAL REGISTRATION

This systematic review was registered with Prospero (record number: 42016032947).

Identifying the conditions needed for integrated knowledge translation (IKT) in health care organizations: qualitative interviews with researchers and research users

Background

Collaboration among researchers and research users, or integrated knowledge translation (IKT), enhances the relevance and uptake of evidence into policy and practice. However, it is not widely practiced and, even when well-resourced, desired impacts may not be achieved. Given that large-scale investment is not the norm, further research is needed to identify how IKT can be optimized.

Methods

Interviews were conducted with researchers and research users (clinicians, managers) in a health care delivery (HCDO) and health care monitoring (HCMO) organization that differed in size and infrastructure, and were IKT-naïve. Basic qualitative description was used. Participants were asked about IKT activities and challenges, and recommendations for optimizing IKT. Data were analysed inductively using constant comparative technique.

Results

Forty-three interviews were conducted (28 HCDO, 15 HCMO) with 13 researchers, 8 clinicians, and 22 managers. Little to no IKT took place. Participants articulated similar challenges and recommendations revealing that a considerable number of changes were needed at the organizational, professional and individual levels. Given the IKT-absent state of participating organizations, this research identified a core set of conditions which must be addressed to prepare an environment conducive to IKT. These conditions were compiled into a framework by which organizations can plan for, or evaluate their capacity for IKT.

Conclusions

The IKT capacity framework is relevant for organizations in which there is no current IKT activity. Use of the IKT framework may result in more organizations that are ready to initiate and establish IKT, perhaps ultimately leading to more, and higher-quality collaboration for health system innovation. Further research is needed to confirm these findings in other organizations not yet resourced for, or undertaking IKT, and to explore the resource implications and mechanisms for establishing the conditions identified here as essential to preparing for IKT.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-016-1533-0) contains supplementary material, which is available to authorized users.

What research tells us about knowledge transfer strategies to improve public health in low-income countries: a scoping review

OBJECTIVES

This study describes the current state of research on knowledge transfer strategies to improve public health in low-income countries, to identify the knowledge gaps on this topic.

METHODS

In this scoping review, a descriptive and systematic process was used to analyse, for each article retained, descriptions of research context and methods, types of knowledge transfer activities and results reported.

RESULTS

28 articles were analysed. They dealt with the evaluation of transfer strategies that employed multiple activities, mostly targeting health professionals and women with very young children. Most often these studies used quantitative designs and measurements of instrumental use with some methodological shortcomings. Results were positive and suggested recommendations for improving professional practices, knowledge and health-related behaviours. The review highlights the great diversity of transfer strategies used, strategies and many conditions for knowledge use.

CONCLUSIONS

The review provides specific elements for understanding the transfer processes in low-income countries and highlights the need for systematic evaluation of the conditions for research results utilization.

Analyzing Data Generated Through Deliberative Dialogue: Bringing Knowledge Translation Into Qualitative Analysis

Deliberative dialogue (DD) is a knowledge translation strategy that can serve to generate rich data and bridge health research with action. An intriguing alternative to other modes of generating data, the purposeful and evidence-informed conversations characteristic of DD generate data inclusive of collective interpretations. These data are thus dialogic, presenting complex challenges for qualitative analysis. In this article, we discuss the nature of data generated through DD, orienting ourselves toward a theoretically grounded approach to analysis. We offer an integrated framework for analysis, balancing analytical strategies of categorizing and connecting with the use of empathetic and suspicious interpretive lenses. In this framework, data generation and analysis occur in concert, alongside engaging participants and synthesizing evidence. An example of application is provided, demonstrating nuances of the framework. We conclude with reflections on the strengths and limitations of the framework, suggesting how it may be relevant in other qualitative health approaches.

Designing a knowledge translation mentorship program to support the implementation of evidence-based innovations

Background

Healthcare professionals require training in knowledge translation (KT) to implement evidence-based healthcare innovations. Mentorship is an effective training strategy that could be used to develop KT capacity but it has largely been used to train clinicians. The purpose of this study was to explore preferences for KT mentorship design.

Methods

Interviews were conducted with 54 Canadian researchers and research users who varied by profession, department, career stage and sex. Participants were asked about KT needs, views on mentorship as a strategy to develop KT capacity, and suggestions for program design. Grounded theory technique and thematic analysis were used to collect and analyse data.

Results

Participants uniformly expressed interest in mentorship over other forms of learning about KT because it would provide credible, tailored information when needed. A variety of options for program content, format and delivery were recommended, suggesting the need for flexibility according to KT needs. Leadership, infrastructure, culture change and incentives may also be needed to foster KT mentorship. Views were mixed on whether mentors should be KT experts or subject or clinical experts with KT experience, and embedded in, or external to organizations.

Conclusions

These findings can be used to develop or evaluate KT mentoring programs. Further research is needed to evaluate different models in which the mentor may be an internal or external KT expert or subject expert with experience in KT, and establish the core curriculum of a training program specific to KT and how it could best be reinforced with mentoring.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-015-0863-7) contains supplementary material, which is available to authorized users.

Exploring mentorship as a strategy to build capacity for knowledge translation research and practice: a scoping systematic review

BACKGROUND

Knowledge translation (KT) supports use of evidence in healthcare decision making but is not widely practiced. Mentoring is a promising means of developing KT capacity. The purpose of this scoping systematic review was to identify essential components of mentoring that could be adapted for KT mentorship.

METHODS

Key social sciences and management databases were searched from January 2002 to December 2011 inclusive. Empirical research in non-healthcare settings that examined mentorship design and impact for improving job-specific knowledge and skill were eligible. Members of the study team independently selected eligible studies, and extracted and summarized data.

RESULTS

Of 2,101 search results, 293 were retrieved and 13 studies were eligible for review. All but one reported improvements in knowledge, skill, or behavior. Mentoring program components included combining preliminary workshop-based training with individual mentoring provided either in person or remotely; training of mentors; and periodic mentoring for at least an hour over a minimum period of six months. Barriers included the need for infrastructure for recruitment, matching, and training; lack of clarity in mentoring goals; and limited satisfaction with mentors and their availability. Findings were analyzed against a conceptual framework of factors that influence mentoring design and impact to identify issues warranting further research.

CONCLUSION

This study identified key mentoring components that could be adapted for KT mentorship. Overall, few studies were identified. Thus further research should explore whether and how mentoring should be tailored to baseline knowledge or skill and individual KT needs; evaluate newly developed or existing KT mentorship programs based on the factors identified here; and examine whether and how KT mentorship develops KT capacity. The conceptual framework could be used to develop or evaluate KT mentoring programs.

A systematic review of barriers to and facilitators of the use of evidence by policymakers

Background

The gap between research and practice or policy is often described as a problem. To identify new barriers of and facilitators to the use of evidence by policymakers, and assess the state of research in this area, we updated a systematic review.

Methods

Systematic review. We searched online databases including Medline, Embase, SocSci Abstracts, CDS, DARE, Psychlit, Cochrane Library, NHSEED, HTA, PAIS, IBSS (Search dates: July 2000 - September 2012). Studies were included if they were primary research or systematic reviews about factors affecting the use of evidence in policy. Studies were coded to extract data on methods, topic, focus, results and population.

Results

145 new studies were identified, of which over half were published after 2010. Thirteen systematic reviews were included. Compared with the original review, a much wider range of policy topics was found. Although still primarily in the health field, studies were also drawn from criminal justice, traffic policy, drug policy, and partnership working. The most frequently reported barriers to evidence uptake were poor access to good quality relevant research, and lack of timely research output. The most frequently reported facilitators were collaboration between researchers and policymakers, and improved relationships and skills. There is an increasing amount of research into new models of knowledge transfer, and evaluations of interventions such as knowledge brokerage.

Conclusions

Timely access to good quality and relevant research evidence, collaborations with policymakers and relationship- and skills-building with policymakers are reported to be the most important factors in influencing the use of evidence. Although investigations into the use of evidence have spread beyond the health field and into more countries, the main barriers and facilitators remained the same as in the earlier review. Few studies provide clear definitions of policy, evidence or policymaker. Nor are empirical data about policy processes or implementation of policy widely available. It is therefore difficult to describe the role of evidence and other factors influencing policy. Future research and policy priorities should aim to illuminate these concepts and processes, target the factors identified in this review, and consider new methods of overcoming the barriers described.

A systematic review of barriers to and facilitators of the use of evidence by policymakers

BACKGROUND

The gap between research and practice or policy is often described as a problem. To identify new barriers of and facilitators to the use of evidence by policymakers, and assess the state of research in this area, we updated a systematic review.

METHODS

Systematic review. We searched online databases including Medline, Embase, SocSci Abstracts, CDS, DARE, Psychlit, Cochrane Library, NHSEED, HTA, PAIS, IBSS (Search dates: July 2000 - September 2012). Studies were included if they were primary research or systematic reviews about factors affecting the use of evidence in policy. Studies were coded to extract data on methods, topic, focus, results and population.

RESULTS

145 new studies were identified, of which over half were published after 2010. Thirteen systematic reviews were included. Compared with the original review, a much wider range of policy topics was found. Although still primarily in the health field, studies were also drawn from criminal justice, traffic policy, drug policy, and partnership working. The most frequently reported barriers to evidence uptake were poor access to good quality relevant research, and lack of timely research output. The most frequently reported facilitators were collaboration between researchers and policymakers, and improved relationships and skills. There is an increasing amount of research into new models of knowledge transfer, and evaluations of interventions such as knowledge brokerage.

CONCLUSIONS

Timely access to good quality and relevant research evidence, collaborations with policymakers and relationship- and skills-building with policymakers are reported to be the most important factors in influencing the use of evidence. Although investigations into the use of evidence have spread beyond the health field and into more countries, the main barriers and facilitators remained the same as in the earlier review. Few studies provide clear definitions of policy, evidence or policymaker. Nor are empirical data about policy processes or implementation of policy widely available. It is therefore difficult to describe the role of evidence and other factors influencing policy. Future research and policy priorities should aim to illuminate these concepts and processes, target the factors identified in this review, and consider new methods of overcoming the barriers described.

The Knowledge Exchange-Decision Support Model: application to cancer navigation programs

Purpose

The Knowledge Exchange–Decision Support (KE-DS) Model provides a framework outlining essential components of knowledge generation and exchange. The purpose of this research was to illustrate how the Model makes explicit the different contextual aspects implicit in the planning and implementation of two cancer navigation programs in Canada.

Methods

The KE-DS Model guided the collection and analysis of interviews with program personnel and narrative data. A qualitative thematic analysis was conducted wherein we compared and contrasted the planning and implementation of these two navigation programs.

Results

The planning and implementation of these two programs was conceptualized differently and adapted to meet local contingencies. The KE-DS Model highlighted three factors that influenced program delivery. First, the structure of health services was shaped by the interaction of professionals and services operating in the region, and the existing health services influenced the program’s approach to navigation. Second, while there were similarities in the professional roles and responsibilities of the navigators, these roles and responsibilities also reflected local context in their approaches to patient assessment, referral, education, coordination of services, and advocacy. Third, these two distinct approaches to navigation have responded to the needs of diverse populations being served by improving access to care.

Conclusions

Evidence generated using the KE-DS Model could ensure a more robust and structured approach to the planning and implementation of future navigation programs. The Model prompts users to make explicit the different types of evidence utilized during program planning and implementation. The systematic collection of new information on program implementation using the KE-DS Model in future initiatives will contribute to an improved understanding of the science of knowledge exchange.

What makes or breaks provider-researcher collaborations in HIV research? A mixed method analysis of providers' willingness to partner

Research is lacking about what makes or breaks collaboration between researchers and HIV services providers. This study identified factors that influence providers' levels of willingness to collaborate in HIV prevention scientific research. Survey measures were grounded in in-depth interview data and included providers' "willingness to collaborate," and providers' attitudes toward researchers' availability, benefits of research, and agency preparedness. This survey was administered to 141 providers in New York City. A hierarchical regression model showed that providers' perceptions of researchers' availability (p < .05), research benefits (p < .001), and agency preparedness (p < .05) were associated with providers' willingness to engage with researchers to purse HIV prevention research. Findings indicate that researchers need to be socially and professionally available, future HIV research should benefit providers and consumers, and policy makers should help agency settings develop human and financial resources in preparation for research.

"More bang for the buck": exploring optimal approaches for guideline implementation through interviews with international developers

BACKGROUND

Population based studies show that guidelines are underused. Surveys of international guideline developers found that many do not implement their guidelines. The purpose of this research was to interview guideline developers about implementation approaches and resources.

METHODS

Semi-structured telephone interviews were conducted with representatives of guideline development agencies identified in the National Guideline Clearinghouse and sampled by country, type of developer, and guideline clinical indication. Participants were asked to comment on the benefits and resource implications of three approaches for guideline implementation that varied by responsibility: developers, intermediaries, or users.

RESULTS

Thirty individuals from seven countries were interviewed, representing government (n = 12) and professional (n = 18) organizations that produced guidelines for a variety of clinical indications. Organizations with an implementation mandate featured widely inconsistent funding and staffing models, variable approaches for choosing promotional strategies, and an array of dissemination activities. When asked to choose a preferred approach, most participants selected the option of including information within guidelines that would help users to implement them. Given variable mandate and resources for implementation, it was considered the most feasible approach, and therefore most likely to have impact due to potentially broad use.

CONCLUSIONS

While implementation approaches and strategies need not be standardized across organizations, the findings may be used by health care policy makers and managers, and guideline developers to generate strategic and operational plans that optimize implementation capacity. Further research is needed to examine how to optimize implementation capacity by guideline developers, intermediaries and users.

Collaboration between health services managers and researchers: making a difference?

OBJECTIVE

Our aim was to evaluate whether the involvement of health care managers in research projects improves the quality and relevance of research, and whether collaboration builds capacity in the managerial community.

METHODS

The NIHR Service Delivery and Organization Management Fellowship programme supports the direct involvement of health care managers in research projects. Data were collected from face-to-face interviews with management fellows and chief investigators of research projects at 10 case study sites. Data were analysed thematically using an adapted Kirkpatrick framework for programme evaluation.

RESULTS

Management fellows improved the relevance and quality of research through enhancing its validity, efficiency and credibility. This was achieved by: using their contextual understanding to enable and support access and recruitment participants, data collection tools, processes and analysis; supporting dissemination activities; and undertaking additional work which was complementary to the main project. Capacity was developed through formal courses and exposure to new knowledge, ideas and practices. Factors found to enable or impede improvements in research included management fellows' knowledge and experience of the NHS, their background and personal characteristics, mutual respect, timing and flexibility. Consequences were not always predictable. Costs for management fellows included foregone opportunities, specifically for promoted posts. Researchers reported time-costs associated with administering the fellowship.

CONCLUSIONS

Collaborations between managers and researchers can improve research relevance and quality and research capacity development. Factors critical to success relate to the fit between the project and the management fellow and how clearly the purpose is understood.

Knowledge exchange in the Pacific: The TROPIC (Translational Research into Obesity Prevention Policies for Communities) project

BACKGROUND

Policies targeting obesogenic environments and behaviours are critical to counter rising obesity rates and lifestyle-related non-communicable diseases (NCDs). Policies are likely to be most effective and enduring when they are based on the best available evidence. Evidence-informed policy making is especially challenging in countries with limited resources. The Pacific TROPIC (Translational Research for Obesity Prevention in Communities) project aims to implement and evaluate a tailored knowledge-brokering approach to evidence-informed policy making to address obesity in Fiji, a Pacific nation challenged by increasingly high rates of obesity and concomitant NCDs.

METHODS

The TROPIC project draws on the concept of 'knowledge exchange' between policy developers (individuals; organisations) and researchers to deliver a knowledge broking programme that maps policy environments, conducts workshops on evidence-informed policy making, supports the development of evidence-informed policy briefs, and embeds evidence-informed policy making into organisational culture. Recruitment of government and nongovernment organisational representatives will be based on potential to: develop policies relevant to obesity, reach broad audiences, and commit to resourcing staff and building a culture that supports evidence-informed policy development. Workshops will increase awareness of both obesity and policy cycles, as well as develop participants' skills in accessing, assessing and applying relevant evidence to policy briefs. The knowledge-broking team will then support participants to: 1) develop evidence-informed policy briefs that are both commensurate with national and organisational plans and also informed by evidence from the Pacific Obesity Prevention in Communities project and elsewhere; and 2) collaborate with participating organisations to embed evidence-informed policy making structures and processes. This knowledge broking initiative will be evaluated via data from semi-structured interviews, a validated self-assessment tool, process diaries and outputs.

DISCUSSION

Public health interventions have rarely targeted evidence-informed policy making structures and processes to reduce obesity and NCDs. This study will empirically advance understanding of knowledge broking processes to extend evidence-informed policy making skills and develop a suite of national obesity-related policies that can potentially improve population health outcomes.

The guideline implementability research and application network (GIRAnet): an international collaborative to support knowledge exchange: study protocol

BACKGROUND

Modifying the format and content of guidelines may facilitate their use and lead to improved quality of care. We reviewed the medical literature to identify features desired by different users and associated with guideline use to develop a framework of implementability and found that most guidelines do not contain these elements. Further research is needed to develop and evaluate implementability tools.

METHODS

We are launching the Guideline Implementability Research and Application Network (GIRAnet) to enable the development and testing of implementability tools in three domains: Resource Implications, Implementation, and Evaluation. Partners include the Guidelines International Network (G-I-N) and its member guideline developers, implementers, and researchers. In phase one, international guidelines will be examined to identify and describe exemplar tools. Indication-specific and generic tools will populate a searchable repository. In phase two, qualitative analysis of cognitive interviews will be used to understand how developers can best integrate implementability tools in guidelines and how health professionals use them for interpreting and applying guidelines. In phase three, a small-scale pilot test will assess the impact of implementability tools based on quantitative analysis of chart-based behavioural outcomes and qualitative analysis of interviews with participants. The findings will be used to plan a more comprehensive future evaluation of implementability tools.

DISCUSSION

Infrastructure funding to establish GIRAnet will be leveraged with the in-kind contributions of collaborating national and international guideline developers to advance our knowledge of implementation practice and science. Needs assessment and evaluation of GIRAnet will provide a greater understanding of how to develop and sustain such knowledge-exchange networks. Ultimately, by facilitating use of guidelines, this research may lead to improved delivery and outcomes of patient care.

Use of qualitative methods to identify solutions to selected equine welfare problems in Ireland

This paper explores the views of those in the Irish equine industry, organisations and government regarding necessary improvements to equine welfare in Ireland at unregulated gatherings and during the disposal process. Three qualitative research methods were employed, namely semistructured interviews, focus groups and a structured, facilitated workshop. Representatives from industry, welfare societies, socially disadvantaged groupings and government engaged with this process and shared their views regarding horse welfare and implementable solutions with merit to address welfare problems. A consensus was achieved that equine welfare in Ireland could be improved by the development of a comprehensive identification system, a Code of Practice for horse gatherings, a horse licensing scheme, ring-fenced funding to promote responsible, humane horse disposal and better means of raising awareness of the value of safeguarding horse welfare for the benefit of all parties.

Implementing health research through academic and clinical partnerships: a realistic evaluation of the Collaborations for Leadership in Applied Health Research and Care (CLAHRC)

BACKGROUND

The English National Health Service has made a major investment in nine partnerships between higher education institutions and local health services called Collaborations for Leadership in Applied Health Research and Care (CLAHRC). They have been funded to increase capacity and capability to produce and implement research through sustained interactions between academics and health services. CLAHRCs provide a natural 'test bed' for exploring questions about research implementation within a partnership model of delivery. This protocol describes an externally funded evaluation that focuses on implementation mechanisms and processes within three CLAHRCs. It seeks to uncover what works, for whom, how, and in what circumstances.

DESIGN AND METHODS

This study is a longitudinal three-phase, multi-method realistic evaluation, which deliberately aims to explore the boundaries around knowledge use in context. The evaluation funder wishes to see it conducted for the process of learning, not for judging performance. The study is underpinned by a conceptual framework that combines the Promoting Action on Research Implementation in Health Services and Knowledge to Action frameworks to reflect the complexities of implementation. Three participating CLARHCS will provide in-depth comparative case studies of research implementation using multiple data collection methods including interviews, observation, documents, and publicly available data to test and refine hypotheses over four rounds of data collection. We will test the wider applicability of emerging findings with a wider community using an interpretative forum.

DISCUSSION

The idea that collaboration between academics and services might lead to more applicable health research that is actually used in practice is theoretically and intuitively appealing; however the evidence for it is limited. Our evaluation is designed to capture the processes and impacts of collaborative approaches for implementing research, and therefore should contribute to the evidence base about an increasingly popular (e.g., Mode two, integrated knowledge transfer, interactive research), but poorly understood approach to knowledge translation. Additionally we hope to develop approaches for evaluating implementation processes and impacts particularly with respect to integrated stakeholder involvement.

Policy Delphi with vignette methodology as a tool to evaluate the perception of equine welfare

A three-round Policy Delphi using vignette methodology was employed as a new approach to study stakeholder perceptions and experiences of equine welfare. Forty-four representatives from stakeholder groups in the Irish equine industry participated. In Round 1, vignettes (narratives illustrating potential infringements of equine welfare) were presented to assess perceptions of 'Acceptability' and experiences of 'Frequency of occurrence'. In Round 2, lists of situations where equine welfare might be compromised, possible drivers of behaviour and potential solutions were presented for grading. In Round 3, two composite issues were formed from an analysis of responses to the previous round, namely (1) the disposal of horses trade, and (2) behaviour at unregulated gatherings; these were illustrated using vignettes to establish stakeholder attitudes to the desirability, feasibility and means of improving standards of welfare for horses. All respondents completed all rounds demonstrating their engagement with the method.