Embedding implementation research to enhance health policy and systems: a multi-country analysis from ten settings in Latin America and the Caribbean

Embedding research capacity strengthening in multi-country studies in low-and middle-income countries: learnings from sexual and reproductive health research

Research capacity strengthening (RCS) can empower individuals, institutions, networks, or countries to define and prioritize problems systematically; develop and scientifically evaluate appropriate solutions; and reinforce or improve capacities to translate knowledge into policy and practice. However, how to embed RCS into multi-country studies focusing on sexual and reproductive health and rights (SRHR) is largely undocumented. We used findings from a qualitative study, from a review of the literature, and from a validation exercise from a panel of experts from research institutions that work on SRHR RCS. We provide a framework for embedded RCS; suggest a set of seven concrete actions that research project planners, designers, implementers, and funders can utilise to guide embedded RCS activities in low- and middle-income countries; and present a practical checklist for planning and assessing embedded RCS in research projects.

Burden of disease studies supporting policymaking in the European Union: a systematic review

Burden of disease (BoD) studies quantify the health impact of diseases and risk factors, which can support policymaking, particularly in the European Union (EU). This study aims to systematically analyse BoD studies, which address EU public policies to contribute to the understanding of its policy uptake. A systematic search of six electronic databases and two grey-literature registries was carried out for articles published between 1990 and 2023. The thematic area, type of legislation and the respective policymaking stage were extracted. A textual analysis of the discussion was conducted to assess the inclusion of specific EU policy implications. Overton was used to detect citations in policy documents. Out of the 2054 records screened, 83 were included. Most studies employed secondary data, with 37 utilizing GBD data. Disability-adjusted life year was present in most of the studies (n = 53). The most common type of the EU legislation mentioned was the directive (n = 47), and the most frequent topic was environment (n = 34). Policy implications for EU laws were discussed in most papers (n = 46, 55.4%), with only 8 conducting evaluation of EU policies. Forty-two articles have been cited at the EU-level, in a total of 86 EU policies. Despite increasing efforts in integrating EU legislation impact within BoD studies, these results denote a low consideration of the legal and policy changes. Greater efforts in directing research towards policy effectiveness evaluation might increase their uptake in EU policies.

Current Status of Newborn Bloodspot Screening Worldwide 2024: A Comprehensive Review of Recent Activities (2020-2023)

Newborn bloodspot screening (NBS) began in the early 1960s based on the work of Dr. Robert "Bob" Guthrie in Buffalo, NY, USA. His development of a screening test for phenylketonuria on blood absorbed onto a special filter paper and transported to a remote testing laboratory began it all. Expansion of NBS to large numbers of asymptomatic congenital conditions flourishes in many settings while it has not yet been realized in others. The need for NBS as an efficient and effective public health prevention strategy that contributes to lowered morbidity and mortality wherever it is sustained is well known in the medical field but not necessarily by political policy makers. Acknowledging the value of national NBS reports published in 2007, the authors collaborated to create a worldwide NBS update in 2015. In a continuing attempt to review the progress of NBS globally, and to move towards a more harmonized and equitable screening system, we have updated our 2015 report with information available at the beginning of 2024. Reports on sub-Saharan Africa and the Caribbean, missing in 2015, have been included. Tables popular in the previous report have been updated with an eye towards harmonized comparisons. To emphasize areas needing attention globally, we have used regional tables containing similar listings of conditions screened, numbers of screening laboratories, and time at which specimen collection is recommended. Discussions are limited to bloodspot screening.

[Mental Health Gap Action Programme: a theoretical model of barriers to implementation by health personnel in Chocó, ColombiaPrograma de Ação para Reduzir as Lacunas em Saúde Mental: modelo teórico das barreiras de implementação por profissionais de saúde de Chocó, Colômbia]

Objectives

Mental, neurological, and substance use (MNS) disorders have a high prevalence in Colombia and there is a treatment gap. The World Health Organization (WHO) Mental Health Gap Action Programme (mhGAP) has various components. The mhGAP 2.0 Intervention Guide, aimed at improving primary health care, is a guide for the assessment and management of MNS disorders based on clinical decision-making protocols. The objective of this study was to determine the barriers that may hinder the program implementation process.

Methods

A qualitative study with content analysis was conducted in three phases: i) study preparation, organization, and presentation; ii) open coding, categorization, and abstraction of contents; and iii) information analysis. The study included semi-structured interviews with 21 people involved in the provision of mental health services in Chocó (Colombia): five medical doctors, seven nurses, and three psychologists, as well as six professionals working in the administrative area of the department's health secretariats. The perceptions of these stakeholders were explored. Open-ended questions were asked to explore experiences with the process, as well as the barriers identified in practice.

Results

Four different thematic categories were identified: intersectoral action, long-standing challenges, opportunities, and suitability of tools.

Conclusions

A theoretical model of barriers to implementation of the mhGAP program was constructed, based on stakeholder perceptions. Controlling barriers is perceived as a possible way to contribute significantly to population health.

Replacement of core team members on embedded implementation research teams: experiences from Latin America and the Caribbean

Objective

To understand how replacement of decision-makers (DMs) serving as principal investigators (PI) or co-PIs on research teams may affect the feasibility and value of embedded implementation research (EIR) used to improve health policies, programs, and services in Latin America and the Caribbean.

Methods

This was a descriptive qualitative study based on 39 semistructured interviews with 13 embedded research teams selected by financing agencies to explore team composition, interaction among members, and research results. Interviews were conducted at three points during the study period from September 2018 to November 2019; data were analyzed from 2020 to 2021.

Results

Research teams were found to be operating in one of three situations: (i) permanent core team (no change) with either active DM or inactive DM participation; (ii) replacement of DM-PI or co-PI that did not affect EIR research; and (iii) replacement of DM-PI that affected EIR.

Conclusions

To ensure EIR continuity and stability, research teams should include high-level DMs together with more technical staff performing essential implementation activities. This structure could improve collaboration among professional researchers and ensure greater embeddedness of EIR to strengthen the health system.

Collaboration between health system decision makers and professional researchers to coproduce knowledge, a scoping review

BACKGROUND

Recent literature uses different terms and approaches to the collaboration between researchers and health system decision-makers in the research process. In 2012, the World Health Organisation proposed to "Embed research within decision-making processes". Yet, important contributions use other terms and perspectives for the same issue. This scoping review aimed to identify these terms, approaches, their application and eventual influence on the utilization of evidence.

METHODS

We searched papers published between January 2000 and February 2019 in English, Spanish, French and Portuguese in the databases of PubMed, Scielo, Google Scholar and EBSCOhost, thus accessing MedicLatina, MEDLINE Complete and eBook Collection. Our main inclusion criterion was the participation of health personnel in non-clinical research activities. We considered three domains for in depth analysis: Definition, name and description of the participation of decision makers and health staff; Forms of collaboration and actual/effective participation of health staff in research; Eventual influence on the utilization of research results.

RESULTS

We identified 607 articles and selected 74 for full text analysis. Nineteen different terms are currently used in twelve countries to describe the participation of health decision-makers and staff in research activities. Most publications refer to Integrated Knowledge Translation or Embedded Research, and were published in Canada and the United Kingdom. Forty-five papers discuss the participation of health staff in research activities; 20 leading the whole process and 21 as collaborators.

CONCLUSIONS

The identification of the different terms and approaches to the close collaboration of health staff and decision-makers with professional researchers is essential to promote its effective application and influence on the utilization of evidence. Yet, it is also necessary to insist in their co-participation throughout the whole investigation process as a relevant way to improve research results uptake, strengthen health systems and advance towards universal health coverage.

Health Policy and Systems Research Capacities in Ethiopia and Ghana: Findings From a Self-Assessment

Government investment in strengthening health policy and systems research capacities is needed to enhance the generation of evidence for effective policy making. Researchers’ engagement in the policy-making process helps shape policy-relevant research and support policy-relevant decisions.

Introduction:

Health systems are complex. Policies targeted at health system development may be informed by health policy and systems research (HPSR). This study assesses HPSR capacity to generate evidence and inform policy in Ethiopia and Ghana.

Methods:

We used a mixed-methods approach including a self-administered survey at selected HPSR institutes and in-depth interviews of policy makers.

Results:

Both countries have limited capacity to generate HPSR evidence, especially in terms of mobilizing adequate funding and retaining a critical number of competent researchers who understand complex policy processes, have the skills to influence policy, and know policy makers’ demands for evidence. Common challenges are limited government research funding, rigidity in executing the research budget, and reliance on donor funding that might not respond to national health priorities. There are no large research programs in either country. The annual number of HPSR projects per research institute in Ethiopia (10 projects) was higher than in Ghana (2.5 projects), Ethiopia has a significantly smaller annual budget for health research. Policy makers in the 2 countries increasingly recognize the importance of evidence-informed policy making, but various challenges remain in building effective interactions with HPSR institutes.

Conclusion:

We propose 3 synergistic recommendations to strengthen HPSR capacity in Ethiopia and Ghana. First, strengthen researchers’ capacity and enhance their opportunities to know policy actors; engage with the policy community; and identify and work with policy entrepreneurs, who have attributes, skills, and strategies to achieve a successful policy. Second, deliver policy-relevant research findings in a timely way and embed research into key health programs to guide effective implementation. Third, mobilize local and international funding to strengthen HPSR capacities as well as address challenges with recruiting and retaining a critical number of talented researchers. These recommendations may be applied to other low- and middle-income countries to strengthen HPSR capacities.

The African Health Initiative's Role in Advancing the Use of Embedded Implementation Research for Health Systems Strengthening

The African Health Initiative has demonstrated the feasibility of changing the traditional knowledge generation paradigm by using an embedded implementation research approach to improve health systems’ performance and strengthen capacity for knowledge generation and use.

Using Health Systems and Policy Research to Achieve Universal Health Coverage in Ghana

Ghana is positioned to become the first country in sub-Saharan Africa to implement universal health coverage based on nationwide expansion of geographic access through the Community-based Health Planning and Services initiative. This achievement is the outcome of 3 decades of implementation research that health authorities have used for guiding the development of its primary health care program. This implementation research process has comprised Ghana's official endorsement of the 1978 Alma Ata Declaration, leading to the institutionalization of evidence relevant to the strategic design of primary health care and national health insurance policies and services. Rather than relying solely upon the dissemination of project results, Ghana has embraced a continuous and systemic process of knowledge capture, curation, and utilization of evidence in expanding geographic access by a massive expansion in the number of community health service points that has taken decades. A multisectoral approach has been pursued that has involved the creation of systematic partnerships that included all levels of the political system, local development officials, community groups and social networks, multiple university-based disciplines, external development partners, and donors. However, efforts to achieve high levels of financial access through the roll-out of the National Health Insurance Scheme have proceeded at a less consistent pace and been fraught with many challenges. As a result, financial access has been less comprehensive than geographical access despite sequential reforms having been made to both programs. The legacy of activities and current research on primary health care and national health insurance are reviewed together with unaddressed priorities that merit attention in the future. Factors that have facilitated or impeded progress with research utilization are reviewed and implications for health systems strengthening in Ghana and elsewhere in Africa and globally are discussed.

Strategies to promote evidence use for health programme improvement: learning from the experiences of embedded implementation research teams in Latin America and the Caribbean

Background

To achieve global health targets, innovative approaches are needed to strengthen the implementation of efficacious interventions. New approaches in implementation research that bring together health system decision-makers alongside researchers to collaboratively design, produce and apply research evidence are gaining traction. Embedded implementation research (EIR) approaches led by decision-maker principal investigators (DM PIs) appear promising in this regard. Our aim is to describe the strategies study teams employ in the post-research phase of EIR to promote evidence-informed programme or policy improvement.

Methods

We conducted a prospective, comparative case study of an EIR initiative in Bolivia, Colombia and Dominican Republic. Guided by a conceptual framework on EIR, we used semi-structured key informant interviews (n = 51) and document reviews (n = 20) to examine three decision-maker-led study teams (“cases”). Focusing on three processes (communication/dissemination, stakeholder engagement with evidence, integrating evidence in decision-making) and the main outcome (enacting improvements), we used thematic analysis to identify associated strategies and enabling or hindering factors.

Results

Across cases, we observed diverse strategies, shaped substantially by whether the DM PI was positioned to lead the response to study findings within their sphere of work. We found two primary change pathways: (1) DM PIs implement remedial measures directly, and (2) DM PIs seek to influence other stakeholders to respond to study findings. Throughout the post-research phase, EIR teams adapted research use strategies based on the evolving context.

Conclusions

EIR led by well-positioned DM PIs can facilitate impactful research translation efforts. We draw lessons around the importance of (1) understanding DM PI positionality, (2) ongoing assessment of the evolving context and stakeholders and (3) iterative adaptation to dynamic, uncertain circumstances. Findings may guide EIR practitioners in planning and conducting fit-for-purpose and context-sensitive strategies to advance the use of evidence for programme improvement.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12961-022-00834-1.

Developing organizational learning for scaling-up community-based primary health care in Ghana

INTRODUCTION

Achieving effective community-based primary health care requires evidence for guiding strategic decisions that must be made. However, research processes often limit data collection to particular organizational levels or disseminate results to specific audiences. Decision-making that emerges can fail to account for the contrasting perspectives and needs of managers at each organizational level. The Ghana Health Service (GHS) addressed this problem with a multilevel and sequential research and action approach that has provided two decades of implementation learning for guiding community-based primary health care development.

METHOD

The GHS implementation research initiatives progressed from (i) a participatory pilot investigation to (ii) an experimental trial of strategies that emerged to (iii) replication research for testing scale-up, culminating in (iv) evidence-based scale-up of a national community-based primary health care program. A reform process subsequently repeated this sequence in a manner that involved stakeholders at the community, sub-district, district, and regional levels of the system. The conduct, interpretation, and dissemination of results that emerged comprised a strategy for achieving systems learning by conducting investigations in phases in conjunction with bottom-up knowledge capture, lateral exchanges for fostering peer learning at each system level, and top-down processes for communicating results as policy. Continuous accumulation of qualitative data on stakeholder reactions to operations at each organizational level was conducted in conjunction with quantitative monitoring of field operations.

RESULTS

Implementation policies were enhanced by results associated with each phase. A quasi-experiment for testing the reform process showed that scale-up of community-based primary health care was accelerated, leading to improvements in childhood survival and reduced fertility.

CONCLUSION

Challenges to system learning were overcome despite severe resource constraints. The integration of knowledge generation with ongoing management processes institutionalized learning for achieving evidence-driven program action.

What informs oral health and chronic disease policy development in Australia: a citation analysis

Improvement of health services and patient outcomes depends on the translation of health research into health policy. Oral health research can inform policies to manage chronic diseases and improve quality of life of affected individuals. To determine if translation of this research into policy is occurring, we identify where policymakers obtain evidence to inform the development of Australian health policy. We conducted a citation analysis of oral health, cardiovascular disease, diabetes and cognitive impairment National policies to determine if current oral health research has informed oral health and chronic disease policy. We analysed five National policies with 268 individual references to policy or organizational documents (n = 179), peer-reviewed research (n = 74), grey literature (n = 12), or unidentifiable (n = 3). Although we found oral health references listed in the National policies (92), we did not find this information to have been translated into the oral health and chronic disease policies we analysed.

Closing the know-do gap for child health: UNICEF's experiences from embedding implementation research in child health and nutrition programming

UNICEF operates in 190 countries and territories, where it advocates for the protection of children’s rights and helps meet children’s basic needs to reach their full potential. Embedded implementation research (IR) is an approach to health systems strengthening in which (a) generation and use of research is led by decision-makers and implementers; (b) local context, priorities, and system complexity are taken into account; and (c) research is an integrated and systematic part of decision-making and implementation. By addressing research questions of direct relevance to programs, embedded IR increases the likelihood of evidence-informed policies and programs, with the ultimate goal of improving child health and nutrition.

This paper presents UNICEF’s embedded IR approach, describes its application to challenges and lessons learned, and considers implications for future work.

From 2015, UNICEF has collaborated with global development partners (e.g. WHO, USAID), governments and research institutions to conduct embedded IR studies in over 25 high burden countries. These studies focused on a variety of programs, including immunization, prevention of mother-to-child transmission of HIV, birth registration, nutrition, and newborn and child health services in emergency settings. The studies also used a variety of methods, including quantitative, qualitative and mixed-methods.

UNICEF has found that this systematically embedding research in programs to identify implementation barriers can address concerns of implementers in country programs and support action to improve implementation. In addition, it can be used to test innovations, in particular applicability of approaches for introduction and scaling of programs across different contexts (e.g., geographic, political, physical environment, social, economic, etc.). UNICEF aims to generate evidence as to what implementation strategies will lead to more effective programs and better outcomes for children, accounting for local context and complexity, and as prioritized by local service providers. The adaptation of implementation research theory and practice within a large, multi-sectoral program has shown positive results in UNICEF-supported programs for children and taking them to scale.

Cross-cutting lessons from the Decision-Maker Led Implementation Research initiative

BACKGROUND

Almost 20 million children under one year of age did not receive basic vaccines in 2019, and most of these children lived in low- and middle-income countries. Implementation research has been recognized as an emerging area that is critical to strengthen the implementation of interventions proven to be effective. As a component of strengthening implementation, WHO has called for greater embedding of research within decision-making processes. One strategy to facilitate the embedding of research is to engage decision-makers as Principal Investigators of the research. Since 2015, the Alliance for Health Policy and Systems Research within the WHO and the United Nations Children's Fund have supported decision-maker led research by partnering with Gavi, the Vaccine Alliance, in an initiative called "Decision-Maker Led Implementation Research". This synthesis paper describes the cross-cutting lessons from the initiative to further understand and develop future use of the decision-maker led strategy.

METHODS

This study used qualitative methods of data collection, including a document review and in-depth interviews with decision-makers and researchers engaged in the initiative. Document extraction and thematic content analysis were applied. The individual project was the unit of analysis and the results were summarized across projects.

RESULTS

Research teams from 11 of the 14 projects participated in this study, for an overall response rate of 78.6%. Most projects were carried out in countries in Africa and conducted at the sub-state or sub-district level. Seven enablers and five barriers to the process of conducting the studies or bringing about changes were identified. Key enablers were the relevance, acceptability, and integration of the research, while key barriers included unclear results, limited planning and support, and the limited role of a single study in informing changes to strengthen implementation.

CONCLUSIONS

Decision-maker led research is a promising strategy to facilitate the embedding of research into decision-making processes and contribute to greater use of research to strengthen implementation of proven-effective interventions, such as immunization. We identified several lessons for consideration in the future design and use of the decision-maker led strategy.

How does embedded implementation research work? Examining core features through qualitative case studies in Latin America and the Caribbean

Innovative strategies are needed to improve the delivery of evidence-informed health interventions. Embedded implementation research (EIR) seeks to enhance the generation and use of evidence for programme improvement through four core features: (1) central involvement of programme/policy decision-makers in the research cycle; (2) collaborative research partnerships; (3) positioning research within programme processes and (4) research focused on implementation. This paper examines how these features influence evidence-to-action processes and explores how they are operationalized, their effects and supporting conditions needed. We used a qualitative, comparative case study approach, drawing on document analysis and semi-structured interviews across multiple informant groups, to examine three EIR projects in Bolivia, Colombia and the Dominican Republic. Our findings are presented according to the four core EIR features. The central involvement of decision-makers in EIR was enhanced by decision-maker authority over the programme studied, professional networks and critical reflection. Strong research-practice partnerships were facilitated by commitment, a clear and shared purpose and representation of diverse perspectives. Evidence around positioning research within programme processes was less conclusive; however, as all three cases made significant advances in research use and programme improvement, this feature of EIR may be less critical than others, depending on specific circumstances. Finally, a research focus on implementation demanded proactive engagement by decision-makers in conceptualizing the research and identifying opportunities for direct action by decision-makers. As the EIR approach is a novel approach in these low-resource settings, key supports are needed to build capacity of health sector stakeholders and create an enabling environment through system-level strategies. Key implications for such supports include: promoting EIR and creating incentives for decision-makers to engage in it, establishing structures or mechanisms to facilitate decision-maker involvement, allocating funds for EIR, and developing guidance for EIR practitioners.

Bringing Policymakers to Science Through Communication: A Perspective From Latin America

Scientific knowledge should be shared beyond academic circles in order to promote science in policymaking. Science communication increases the understanding of how the natural world works and the capacity to make informed decisions. However, not every researcher has the ability to master the art of communicating, and even less in a clear, concise, and easy to understand language that society representatives appreciate. Within the huge and extraordinarily diverse Latin American region, science communication has been going on for at least 200 years, when the first science stories appeared in the newspapers, as well as the first science museums and botanical gardens were founded. Nevertheless, resources are limited, and notably time, which researchers spend mostly in mentoring, ensuring funding, publication of their results and laboratory work, while science journalists are an endangered species. This perspective article aims at providing some recommendations to build bridges between science and decision-making parties through communication, by exploring how Latin American diplomats and policymakers engage with scientific knowledge.

An embedded implementation research initiative to tackle service delivery bottlenecks in the expanded programme on immunisation in Pakistan: Overview and reflections

Background

Embedded implementation research (IR) can play a critical role in health systems strengthening by tackling systems and implementation bottlenecks of a program. To achieve this aim, with the financial support of GAVI, the Vaccine Alliance, in 2016, the Government of Pakistan, UNICEF and the Alliance for Health Policy and Systems Research (AHPSR) launched an Embedded IR for Immunisation Initiative (the Initiative) to explore health systems and implementation bottlenecks, and potential strategies to tackle such bottlenecks in the Expanded Programme on Immunisation (EPI) in Pakistan. In total, 10 research teams were involved in the Initiative, which was the first of its kind in the country. In this paper, we provided a brief overview of the Initiative's approach as well as the key learnings including challenges and successes of the research teams which could inform future embedded IR Initiatives.

Methods

Data were collected from members of the IR teams through an online survey. In addition, in-depth interviews were conducted via phone and in-person from IR team members to explore further the challenges they faced while conducting IR in Pakistan and recommendations for future IR initiatives. The qualitative information obtained from these sources was collated and categorized into themes reflecting some of the challenges, successes, and lessons learned, as well as teams' recommendations for future initiatives.

Results

The embedded IR Initiative in Pakistan followed several steps starting with a desk review to compile information on key implementation challenges of EPI and ended with a dissemination workshop where all the research teams shared their IR results with policymakers and implementers. Key factors that facilitated the successful and timely completion of the studies included appreciation by and leadership of implementers in generation and use of local knowledge, identification of research priorities jointly by EPI managers and researchers and provision of continuous and high-quality support from in-country research partners. Participants in the Initiative indicated that challenges included a lack of clarity on the role and responsibilities of each partner involved and need for further support to facilitate use and dissemination of research findings.

Conclusions

The Initiative established that an immunisation programme in a lower middle-income country can use small and time-bound embedded IR, based on partnerships between programme managers and local researchers, to generate information and evidence that can inform decision-making. Future embedded IR initiatives should strive to ensure effective coordination and active participation of all key stakeholders, a clear research utilisation plan from the outset, and efforts to strengthen research teams' capacity to foster utilisation of research findings.

Embedded implementation research determinants in Latin American health systems

OBJECTIVE:

To assess the determinants of embedded implementation research (EIR) conduct in seven Latin American and Caribbean countries.

METHODS:

This qualitative interpretative study conducted and analyzed 14 semi-structured interviews based on a grounded theory approach using Atlas-ti© 7.5.7. We grouped the conditions appointed by interviewees as determinants of EIR conduct into six domains.

RESULTS:

The participation of high-level engaged decision makers as research co-producers is an important EIR determinant that fosters research use. Nevertheless, EIR faces challenges such as dealing with key personnel changes and fluctuating political contexts.

CONCLUSIONS:

Despite its limitations, EIR is effective in creating a sense of ownership of research results among implementers, which helps bridge the gap between research and decision-making in health systems.

Collective reflections on the first cycle of a collaborative learning platform to strengthen rural primary healthcare in Mpumalanga, South Africa

BACKGROUND

Frontline managers and health service providers are constrained in many contexts from responding to community priorities due to organizational cultures focused on centrally defined outputs and targets. This paper presents an evaluation of the Verbal Autopsy with Participatory Action Research (VAPAR) programme-a collaborative learning platform embedded in the local health system in Mpumalanga, South Africa-for strengthening of rural primary healthcare (PHC) systems. The programme aims to address exclusion from access to health services by generating and acting on research evidence of practical, local relevance.

METHODS

Drawing on existing links in the provincial and national health systems and applying rapid, participatory evaluation techniques, we evaluated the first action-learning cycle of the VAPAR programme (2017-19). We collected data in three phases: (1) 10 individual interviews with programme stakeholders, including from government departments and parastatals, nongovernmental organizations and local communities; (2) an evaluative/exploratory workshop with provincial and district Department of Health managers; and (3) feedback and discussion of findings during an interactive workshop with national child health experts.

RESULTS

Individual programme stakeholders described early outcomes relating to effective research and stakeholder engagement, and organization and delivery of services, with potential further contributions to the establishment of an evidence base for local policy and planning, and improved health outcomes. These outcomes were verified with provincial managers. Provincial and national stakeholders identified the potential for VAPAR to support engagement between communities and health authorities for collective planning and implementation of services. Provincial stakeholders proposed that this could be achieved through a two-way integration, with VAPAR stakeholders participating in routine health planning and review activities and frontline health officials being involved in the VAPAR process. Findings were collated into a revised theory of change.

CONCLUSIONS

The VAPAR learning platform was regarded as a feasible, acceptable and relevant approach to facilitate cooperative learning and community participation in health systems. The evaluation provides support for a collaborative learning platform within routine health system processes and contributes to the limited evaluative evidence base on embedded health systems research.

Acceptability and adoption of clinical practice guidelines and treatment protocols on preeclampsia/eclampsia in the Dominican Republic

Objective

Estimate the acceptability and adoption by health care workers of clinical practice guidelines and treatment protocols for women with preeclampsia/eclampsia and identify the facilitating factors and barriers to their implementation.

Methods

A qualitative study was conducted, using semi-structured interviews and focus groups in five maternity hospitals. Interviews were compiled for analysis, and barriers and facilitators were characterized.

Results

Seventy health professionals (52 female and 18 male) participated, representing different levels of the health system. The majority of workers and managers were aware of the existence and content of clinical practice guidelines (CPGs) for preeclampsia/eclampsia, especially the participants with more time in the health service. With respect to facilitating factors, both medical and nursing staff were positive about continued development and implementation of high-quality CPGs. There was consensus that limitations exist, especially with respect to a lack of the necessary medicines, supplies, and equipment to meet and implement the established recommendations.

Discussion

The results of the study show the need to strengthen strategies that help close the gap between research and public policy. Studies suggest that research should focus on users, policymakers, and decisionmakers in the health system. The actors in the Dominican health system recognize the GRADE methodology as an appropriate instrument for the development and implementation of CPGs. Implementation barriers require systemic and comprehensive approaches.

Sustainability in chronic disease prevention: lessons from the Salud al Paso program in Ecuador

This study analyzes the conditions and possibilities of sustainability of the Salud al Paso program of the Metropolitan Health Secretariat of the Municipality of Quito, Ecuador, as an example for similar initiatives, in the context of the changes made by the new administration in May 2019. The analysis of the implementation of this initiative, focused on the prevention of noncommunicable diseases (NCDs), was based on the program’s user database, the information gathered on the perspectives of operational staff, knowledge of the program, and the opinion of local leaders and opinion leaders of the Quito Metropolitan District, as well as official information. Based on this data, the study identified factors that could have facilitated or hindered its sustainability and documented the rationale to suspend the on-demand activities included in the program and limit activities to the care of populations under municipal responsibility (day-care centers, schools and colleges, markets, elder care programs, and employees) and patients with identified cardiometabolic risk. The insufficient institutionalization of the program, conceived as a project with an insufficient vision of its sustainability in time, was mentioned as a possible obstacle by leaders and operational staff. The growing prevalence of NCDs requires initiatives for their prevention, which must be institutionalized to ensure their continuity and overcome eventual changes of government. In addition, future interventions similar to Salud al Paso should establish better sectoral coordination articulation, especially with the Ministry of Public Health and other service networks.

Implementation of national childbirth guidelines in Brazil: barriers and strategies

The present report describes the process and results obtained with a knowledge translation project developed in three stages to identify barriers to the Implementation of the National Guidelines for Normal Childbirth in Brazil, as well strategies for effective implementation. The Improving Programme Implementation through Embedded Research (iPIER) model and the Supporting Policy Relevant Reviews and Trials (SUPPORT) tools provided the methodological framework for the project. In the first stage, the quality of the Guidelines was evaluated and the barriers preventing implementation of the recommendations were identified through review of the global evidence and analysis of contributions obtained in a public consultation process. In the second stage, an evidence synthesis was used as the basis for a deliberative dialogue aimed at prioritizing the barriers identified. Finally, a second evidence synthesis was presented in a new deliberative dialogue to discuss six options to address the prioritized barriers: 1) promote the use of multifaceted interventions; 2) promote educational interventions for the adoption of guidelines; 3) perform audits and provide feedback to adjust professional practice; 4) use reminders to mediate the interaction between workers and service users; 5) enable patient-mediated interventions; and 6) engage opinion leaders to promote use of the Guidelines. The processes and results associated with each stage were documented and formulated to inform a review and update of the Guidelines and the development of an implementation plan for the recommendations. Effective implementation of the Guidelines is important for improving the care provided during labor and childbirth in Brazil.

Qualitative study of the implementation of the Continuity of Care and Rehabilitation Program for people with severe mental disorders in Peru

Objective.

Describe the implementation of the Continuity of Care and Rehabilitation Program (PCC-R) in community mental health centers (CSMCs, Spanish acronym) in Peru.

Methods.

Qualitative study of the implementation of the PCC-R in four CSMCs in Lima and La Libertad, Peru. Forty-two individual semi-structured interviews were conducted, as well as a focus group with five participants, for a total of 47 informants, including users, family members, and professionals involved in the design, implementation, and monitoring of the program.

Results.

The PCC-R is a key program for community mental health services in Peru and it enjoys broad acceptability. Providers and users report satisfaction with its results; however, the program lacks a policy document specifying its objectives, organization, and activities. This would explain the variability in its implementation. The PCC-R has limitations in terms of management of financial and human resources, and it is necessary to improve training and supervision. There is consensus on the need, usefulness, and viability of developing a system to monitor the PCC-R. Good practices and suggestions are presented with a view to addressing these challenges.

Conclusions.

The PCC-R is a flagship program for the CSMCs and for mental health reform in Peru. It has achieved broad acceptability among providers and users. Its implementation combines successes and difficulties, with pending tasks that include developing a policy document, improving resource management, strengthening training and supervision, and implementing a monitoring system for continuous improvement of the program.

[Acceptability and adoption of clinical practice guidelines and treatment protocols on preeclampsia/eclampsia in the Dominican RepublicAceitabilidade e adoção de diretrizes de prática clínica e protocolos de atenção para pré-eclâmpsia e eclâmpsia na República Dominicana]

Objetivo.

Estimar la aceptabilidad y adopción de las guías de prática clínica (GPC) y protocolos de atención a la mujer con preeclampsia-eclampsia por parte del personal prestador de los servicios de salud, e identificar los factores facilitadores y las barreras para su implementación.

Métodos.

Se desarrolló un estudio cualitativo por medio de entrevistas semiestructuradas y grupos focales en cinco maternidades. Se recopilaron las entrevistas para su análisis y se caracterizaron las barreras y facilitadores.

Resultados.

Participaron 70 profesionales de la salud (52 de sexo femenino y 18 de sexo masculino) que se desempeñan en distintos niveles del sistema de salud, participaron. La mayoría de los prestadores y gerentes conocen la existencia de las GPC de eclampsia-preeclampsia y su contenido, sobre todo los participantes con más tiempo en el servicio. Para los facilitadores, se estableció una valoración positiva entre el personal médico y de enfermería ante el proceso de continuar con la elaboración e implementación de GPC de alta calidad. Hubo consenso en cuanto a la existencia de limitaciones, sobre todo, por la falta de medicamentos, insumos y equipos requeridos, para cumplir y aplicar las recomendaciones formuladas.

Discusión.

Los resultados del estudio exponen la necesidad de fortalecer estrategias que ayuden a cerrar la brecha entre la investigación y la política pública. Estudios fundamentan la investigación en priorizar la atención a los usuarios, y los encargados de formular políticas y los tomadores de decisiones en el sistema de salud. Los actores del sistema de salud dominicano reconocen la metodología GRADE como un instrumento apropiado para la formulación e implementación de GPC. Las barreras de implementación requieren de abordajes sistémicos e integrales.

[Qualitative study of the implementation of the Continuity of Care and Rehabilitation Program for people with severe mental disorders in PeruEstudo qualitativo sobre a implementação do Programa de Continuidade de Cuidados e Rehabilitação para pessoas com transtornos mentais graves no Peru]

Objetivo.

Describir la implementación del Programa de continuidad de cuidados y rehabilitación (PCC-R) en centros de salud mental comunitaria (CSMC) del Perú.

Métodos.

Estudio cualitativo sobre la implementación del PCC-R en cuatro CSMC de Lima y La Libertad, Perú. Se realizaron 42 entrevistas semiestructuradas individuales y un grupo focal con cinco participantes, para un total de 47 informantes entre usuarios, familiares y profesionales vinculados al diseño, la implementación y el monitoreo del PCC-R.

Resultados.

El PCC-R es un programa central de los servicios de salud mental comunitaria en Perú, goza de amplia aceptación y los prestadores y usuarios refieren estar satisfechos con sus resultados. Sin embargo, el programa carece de un documento normativo que detalle sus objetivos, organización y actividades, lo que explicaría la variabilidad en su aplicación. Existen limitaciones en la gestión de recursos financieros y humanos del PCC-R y necesidades de capacitación y supervisión, que deben ser mejoradas. Existe consenso sobre la necesidad, la utilidad y la viabilidad de desarrollar un sistema de monitoreo del PCC-R. Se recogen buenas prácticas y sugerencias para enfrentar estos retos.

Conclusiones.

El PCC-R es un programa insignia de los CSMC y de la reforma de la salud mental en Perú, y ha logrado amplia aceptación entre los prestadores y usuarios. Su implementación combina aciertos y dificultades, y revela tareas pendientes como desarrollar un documento normativo, mejorar la gestión de recursos, fortalecer la capacitación y acompañamiento, y aplicar un sistema de monitoreo para favorecer la mejora continua del programa.

Sostenibilidad en la prevención de enfermedades crónicas: lecciones del programa Salud al Paso en Ecuador

El presente estudio analiza las condiciones y posibilidades de permanencia del programa “Salud al Paso” de la Secretaría Metropolitana de Salud del Municipio de Quito, Ecuador, como ejemplo para iniciativas similares, en el contexto de los cambios efectuados por la nueva administración en mayo del 2019. El análisis de esta implementación enfocada en la prevención de enfermedades no transmisibles se centró en la base de datos de usuarios del programa, la información recabada desde las perspectivas del personal operativo, el conocimiento del programa y el posicionamiento de líderes locales y de opinión del Distrito Metropolitano de Quito, así como información oficial. Con base en estos datos, el estudio identificó factores que podrían haber facilitado u obstaculizado su permanencia y documentó la fundamentación de las nuevas autoridades para suspender las actividades de libre demanda propias del programa y limitar la atención a las poblaciones bajo responsabilidad municipal (guarderías, escuelas y colegios, mercados, programas de atención a la tercera edad y empleados) y de pacientes con riesgo cardiometabólico identificado. La institucionalización insuficiente del programa, concebido más como proyecto y con una también insuficiente visión de permanencia en el tiempo, fue mencionada como un posible obstáculo por líderes y personal operativo. La prevalencia creciente de enfermedades no transmisibles demanda iniciativas para su prevención, que deben institucionalizarse para asegurar su continuidad y superar eventuales cambios de gobierno. Además, intervenciones futuras semejantes a Salud al Paso deberán establecer una mejor articulación sectorial, en especial con el Ministerio de Salud Pública y otras redes de servicios.

[Implementation of the National Childbirth Guidelines in Brazil: barriers and trategiesObstáculos y estrategias para la aplicación de las Directrices Nacionales para el Parto Normal en el Brasil]

The present report describes the process and results obtained with a knowledge translation project developed in three stages to identify barriers to the National Childbirth Guidelines in Brazil as well strategies for effective implementation. The Improving Programme Implementation through Embedded Research (iPIER) model and the Supporting Policy Relevant Reviews and Trials (SUPPORT) tools provided the methodological framework for the project. In the first stage, the quality of the Guidelines was evaluated and the barriers preventing implementation of the recommendations were identified through review of the global evidence and analysis of contributions obtained in a public consultation process. In the second stage, an evidence synthesis was used as basis for a deliberative dialogue aimed at prioritizing the barriers identified. Finally, a second evidence synthesis was presented in a new deliberative dialogue to discuss six options to address the prioritized barriers: 1) promote the use of multifaceted interventions; 2) promote educational interventions for the adoption of guidelines; 3) perform audits and provide feedback to adjust professional practice; 4) use reminders to mediate the interaction between workers and service users; 5) enable patient-mediated interventions; and 6) engage opinion leaders to promote the use of guidelines. The processes and results associated with each stage were documented and formulated to inform a review and update of the Guidelines and the development of an implementation plan for the recommendations. An effective implementation of the Guidelines is relevant to improve the care provided during labor and childbirth in Brazil.

Health system decision-makers at the helm of implementation research: development of a framework to evaluate the processes and effectiveness of embedded approaches

Background

Embedded approaches to implementation research (IR), whereby health system decision-makers participate actively in the research process, are gaining traction as effective approaches to optimise the delivery of health programmes and policies. However, the evidence base on the processes and effectiveness of such collaborative research remains inchoate. Standardised approaches to evaluate these initiatives are needed to identify core elements of ‘embeddedness’, unveil the underlying pathways of change, and assess contribution to evidence uptake in decision-making and overall outcomes of effect. The framework presented in this paper responds to this need, designed to guide the systematic evaluation of embedded IR.

Methods

This evaluation framework for embedded IR approaches is based on the experience of a joint initiative by the Pan American Health Organization/Alliance for Health Policy and Systems Research, which has supported 19 IR grants in 10 Latin American and Caribbean countries from 2014 to 2017. The conceptualisation of this framework drew on various sources of information, including empirical evidence and conceptual insights from the literature, interviews with content experts, and a prospective evaluation of the 2016 cohort that included semi-structured key informant interviews, document analysis, and a research team survey to examine key aspects of embedded research.

Results

We developed a widely applicable conceptual framework to guide the evaluation of embedded IR in various contexts. Focused on uncovering how this collaborative research approach influences programme improvement, it outlines expected processes and intermediate outcomes. It also highlights constructs with which to assess ‘embeddedness’ as well as critical contextual factors. The framework is intended to provide a structure by which to systematically examine such embedded research initiatives, proposing three key stages of evidence-informed decision-making – co-production of evidence, engagement with research, and enactment of programme changes.

Conclusion

Rigorous evaluation of embedded IR is needed to build the evidence on its processes and effectiveness in influencing decision-making. The evaluation framework presented here addresses this gap with consideration of the complexity of such efforts. Its applicability to similar initiatives is bolstered by virtue of being founded on real-world experience; its potential to contribute to a nuanced understanding of embedded IR is significant.

Action research and health system strengthening: the case of the health sector support programme in Mauritania, West Africa

Background

Access to qualitative and equitable healthcare is a major challenge in Mauritania. In order to support the country’s efforts, a health sector strengthening programme was set up with participatory action research at its core. Reinforcing a health system requires a customised and comprehensive approach to face the complexity inherent to health systems. Yet, limited knowledge is available on how policies could enhance the performance of the system and how multi-stakeholder efforts could give rise to changes in health policy. We aimed to analyse the ongoing participatory action research and, more specifically, see in how far action research as an embedded research approach could contribute to strengthening health systems.

Methods

We adopted a single-case study design, based on two subunits of analysis, i.e., two selected districts. Qualitative data were collected by analysing country and programme documents, conducting 12 semi-structured interviews and performing participatory observations. Interviewees were selected based on their current position and participation in the programme. The data analysis was designed to address the objectives of the study, but evolved according to emerging insights and through triangulation and identification of emergent and/or recurrent themes along the process.

Results

An evaluation of the progress made in the two districts indicates that continuous capacity-building and empowerment efforts through a participative approach have been key elements to enhance dialogue between, and ownership of, the actors at the local health system level. However, the strong hierarchical structure of the Mauritanian health system and its low level of decentralisation constituted substantial barriers to innovation. Other constraints were sociocultural and organisational in nature. Poor work ethics due to a weak environmental support system played an important role. While aiming for an alignment between the flexible iterative approach of action research and the prevailing national linear planning process is quite challenging, effects on policy formulation and implementation were not observed. An adequate time frame, the engagement of proactive leaders, maintenance of a sustained dialogue and a pragmatic, flexible approach could further facilitate the process of change.

Conclusion

Our study showcases that the action research approach used in Mauritania can usher local and national actors towards change within the health system strengthening programme when certain conditions are met. An inclusive, participatory approach generates dynamics of engagement that can facilitate ownership and strengthen capacity. Continuous evaluation is needed to measure how these processes can further develop and presume a possible effect at policy level.