Is Performance-Based Financing A Pathway to Strategic Purchasing in Sub-Saharan Africa? A Synthesis of the Evidence

Many countries in sub-Saharan Africa have implemented performance-based financing (PBF) to improve health system performance. Much of the debate and analysis relating to PBF has focused on whether PBF “works”—that is, whether it leads to improvements in indicators tied to incentive-based payments. Because PBF schemes embody key elements of strategic health purchasing, this study examines the question of whether and how PBF programs in sub-Saharan Africa influence strategic purchasing more broadly within country health financing arrangements. We searched PubMed, Scopus, EconLit, Cochrane Database of Systematic Reviews, Google Scholar, Google, and the World Health Organization and World Bank’s repositories for studies that focused on the implementation experience or effects of PBF in sub-Saharan African and published in English from 2000 to 2020. We identified 44 papers and used framework analysis to analyze the data and generate key findings. The evidence we reviewed shows that PBF has the potential to raise awareness about strategic purchasing, improve governance and institutional arrangements, and strengthen strategic purchasing functions. However, these effects are minimal in practice because PBF has been introduced as narrow, often pilot, projects that run parallel to and have little integration with the mainstream health financing system. We concluded that PBF has not systematically transformed health purchasing in countries in sub-Saharan Africa but that the experience with PBF can provide valuable lessons for how system-wide strategic purchasing can be implemented most effectively in that region—either in countries that currently have PBF schemes and aim to integrate them into broader purchasing systems, or in countries that are not currently implementing PBF. We also concluded that for countries to pursue more holistic approaches to strategic health purchasing and achieve better health outcomes, they need to implement health financing reforms within or aligned with existing financing systems.

Decentralized facility financing versus performance-based payments in primary health care: a large-scale randomized controlled trial in Nigeria

BACKGROUND

Health system financing presents a challenge in many developing countries. We assessed two reform packages, performance-based financing (PBF) and direct facility financing (DFF), against each other and business-as-usual for maternal and child healthcare (MCH) provision in Nigeria.

METHODS

We sampled 571 facilities (269 in PBF; 302 in DFF) in 52 districts randomly assigned to PBF or DFF, and 215 facilities in 25 observable-matched control districts. PBF facilities received $2 ($1 for operating grants plus $1 for bonuses) for every $1 received by DFF facilities (operating grants alone). Both received autonomy, supervision, and enhanced community engagement, isolating the impact of additional performance-linked facility and health worker payments. Facilities and households with recent pregnancies in facility catchments were surveyed at baseline (2014) and endline (2017). Outcomes were Penta3 immunization, institutional deliveries, modern contraceptive prevalence rate (mCPR), four-plus antenatal care (ANC) visits, insecticide-treated mosquito net (ITN) use by under-fives, and directly observed quality of care (QOC). We estimated difference-in-differences with state fixed effects and clustered standard errors.

RESULTS

PBF increased institutional deliveries by 10% points over DFF and 7% over business-as-usual (p<0.01). PBF and DFF were more effective than business-as-usual for Penta3 (p<0.05 and p<0.01, respectively); PBF also for mCPR (p<0.05). Twenty-one of 26 QOC indicators improved in both PBF and DFF relative to business-as-usual (p<0.05). However, except for deliveries, PBF was as or less effective than DFF: Penta3 immunization and ITN use were each 6% less than DFF (p<0.1 for both) and QOC gains were also comparable. Utilization gains come from the middle of the rural wealth distribution (p<0.05).

CONCLUSIONS

Our findings show that both PBF and DFF represent significant improvements over business-as-usual for service provision and quality of care. However, except for institutional delivery, PBF and DFF do not differ from each other despite PBF disbursing $2 for every dollar disbursed by DFF. These findings highlight the importance of direct facility financing and decentralization in improving PHC and suggest potential complementarities between the two approaches in strengthening MCH service delivery.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03890653 ; May 8, 2017. Retrospectively registered.

The effects of performance-based financing on neonatal health outcomes in Burundi, Lesotho, Senegal, Zambia and Zimbabwe

Maternal and newborn care has been a primary focus of performance-based financing (PBF) projects, which have been piloted or implemented in 21 countries in sub-Saharan Africa since 2007. Several evaluations of PBF have demonstrated improvements to facility delivery or quality of care. However, no studies have measured the impact of PBF programmes directly on neonatal health outcomes in Africa, nor compared PBF programmes against another. We assess the impact of PBF on early neonatal health outcomes and associated health care utilization and quality in Burundi, Lesotho, Senegal, Zambia and Zimbabwe. We pooled Demographic and Health Surveys and Multiple Indicator Cluster Surveys and apply difference-in-differences analysis to estimate the effect of PBF projects supported by the World Bank on early neonatal mortality and low birthweight. We also assessed the effect of PBF on intermediate outputs that are frequently explicitly incentivized in PBF projects, including facility delivery and antenatal care utilization and quality, and caesarean section. Finally, we examined the impact among births to poor or high-risk women. We found no statistically significant impact of PBF on neonatal health outcomes, health care utilization or quality in a pooled sample. PBF was also not associated with better health outcomes in each country individually, though in some countries and among poor women PBF improved facility delivery, antenatal care utilization or antenatal care quality. There was no improvement on the health outcomes among poor or high-risk women in the five countries. PBF had no impact on early neonatal health outcomes in the five African countries studied and had limited and variable effects on the utilization and quality of neonatal health care. These findings suggest that there is a need for both a deeper assessment of PBF and for other strategies to make meaningful improvements to neonatal health outcomes.

What happens when performance-based financing meets free healthcare? Evidence from an interrupted time-series analysis

In spite of the wide attention performance-based financing (PBF) has received over the past decade, no evidence is available on its impacts on quantity and mix of service provision nor on its interaction with parallel health financing interventions. Our study aimed to examine the PBF impact on quantity and mix of service provision in Burkina Faso, while accounting for the parallel introduction of a free healthcare policy. We used Health Management Information System data from 838 primary-level health facilities across 24 districts and relied on an interrupted time-series analysis with independent controls. We placed two interruptions, one to account for PBF and one to account for the free healthcare policy. In the period before the free healthcare policy, PBF produced significant but modest increases across a wide range of maternal and child services, but a significant decrease in child immunization coverage. In the period after the introduction of the free healthcare policy, PBF did not affect service provision in intervention compared with control facilities, possibly indicating a saturation effect. Our findings indicate that PBF can produce modest increases in service provision, without altering the overall service mix. Our findings, however, also indicate that the introduction of other health financing reforms can quickly crowd out the effects produced by PBF. Further qualitative research is required to understand what factors allow healthcare providers to increase the provision of some, but not all services and how they react to the joint implementation of PBF and free health care.

Towards an Explanation of the Social Value of Health Systems: An Interpretive Synthesis

BACKGROUND

Health systems are complex social systems, and values constitute a central dimension of their complexity. Values are commonly understood as key drivers of health system change, operating across all health systems components and functions. Moreover, health systems are understood to influence and generate social values, presenting an opportunity to harness health systems to build stronger, more cohesive societies. However, there is little investigation (theoretical, conceptual, or empirical) on social values in health policy and systems research (HPSR), particularly regarding the capacity of health systems to influence and generate social values. This study develops an explanatory theory for the 'social value of health systems.'

METHODS

We present the results of an interpretive synthesis of HPSR literature on social values, drawing on a qualitative systematic review, focusing on claims about the relationship between 'health systems' and 'social values.' We combined relational claims extracted from the literature under a common framework in order to generate new explanatory theory.

RESULTS

We identify four mechanisms by which health systems are considered to contribute social value to society: Health systems can: (1) offer a unifying national ideal and build social cohesion, (2) influence and legitimise popular attitudes about rights and entitlements with regard to healthcare and inform citizen's understanding of state responsibilities, (3) strengthen trust in the state and legitimise state authority, and (4) communicate the extent to which the state values various population groups.

CONCLUSION

We conclude that, using a systems-thinking and complex adaptive systems perspective, the above mechanisms can be explained as emergent properties of the dynamic network of values-based connections operating within health systems. We also demonstrate that this theory accounts for how HPSR authors write about the relationship between health systems and social values. Finally, we offer lessons for researchers and policy-makers seeking to bring about values-based change in health systems.

Adapting results-based financing to respond to endogenous and exogenous moderators in Zimbabwe

Purpose

This study examines key adaptations that occurred in the Zimbabwean Results-Based Financing (RBF) programme between 2010 and 2017, locating the endogenous and exogenous factors that required adaptive response and the processes from which changes were made.

Design/methodology/approach

The study is based on a desk review and thematic analysis of 64 policy and academic literatures supplemented with 28 multi-stakeholder interviews.

Findings

The programme experienced substantive adaption between 2010 and 2017, demonstrating a significant level of responsiveness towards increasing efficiency as well as to respond to unforeseen factors that undermined RBF mechanisms. The programme was adaptive due to its phased design, which allowed revision competencies and responsive adaptation, which provide useful insights for other low-and-middle income countries (LMICs) settings where graduated scale-up might better meet contextualised needs. However, exogenous factors were often not systematically examined or reported in RBF evaluations, demonstrating that adaptation could have been better anticipated, planned, reported and communicated, especially if RBF is to be a more effective health system reform tool.

Originality/value

RBF is an increasingly popular health system reform tool in LMICs. However, there are questions about how exogenous factors affect RBF performance and acknowledgement that unforeseen endogenous programme design and implementation factors also greatly affect the performance of RBF. As a result, a better understanding of how RBF operates and adapts to programme level (endogenous) and exogenous (external) factors in LMICs is necessary.

Coverage for the cost of outpatient nursing procedures by the Unified Health System: a percentage analysis

OBJECTIVE

To analyze the percentage of the coverage of transfers from the Brazilian Unified Health System regarding nursing procedures conducted in the Outpatient facility of a University Hospital.

METHOD

Quantitative, exploratory, descriptive case study. The sample for calculating the mean total direct costs was composed of non-participant observations of 656 procedures. The obtained costs were compared to transfers from the Unified Health System by multiplying the amount of procedures agreed upon by the unit cost in the Unified Table of Procedures in 2016 and 2017.

RESULTS

The Unified Health System transferred a percentage corresponding to 11.13% of the actual cost in 2016 and to 16.02% in 2017. In these two years, transfer values covered only a mean of 13.4%, resulting in a percentage difference in revenue significantly smaller than the actual cost.

CONCLUSION

The higher the productivity of the performed procedures, the higher was the hospital deficit and, consequently, the higher were the costs not covered by the Unified Health System.

Sustainability determinants of the Burkinabe performance-based financing project

PURPOSE

A performance-based financing (PBF) pilot project was implemented in 2011 in Burkina Faso. After more than five years of implementation (data collection in 2016), the project's sustainability was not guaranteed. This study's objective is to assess this project's sustainability in 2016 by identifying the presence/absence of different determinants of sustainability according to the conceptual framework of Seppey et al. (2017).

DESIGN/METHODOLOGY/APPROACH

It uses a case study approach using in-depth interviews with various actors at the local, district/regional and national levels. Participants (n = 37) included health practitioners, management team members, implementers and senior members of health directions. A thematic analysis based on the conceptual framework was conducted, as well as an inductive analysis.

FINDINGS

Results show the project's sustainability level was weak according to an unequal presence of sustainability's determinants; some activities are being maintained but not fully routinised. Discrepancies between the project and the context's values appeared to be important barriers towards sustainability. Project's ownership by key stakeholders also seemed superficial despite the implementers' leadership towards its success. The project's objective towards greater autonomy for health centres was also directly confronting the Burkinabe's hierarchical health system.

ORIGINALITY/VALUE

This study reveals many fits and misfits between a PBF project and its context affecting its ability to sustain activities through time. It also underlines the importance of using a conceptual framework in implementing and evaluating interventions. These results could be interesting for decision-makers and implementers in further assessing PBF projects elsewhere.

Does the gap between health workers' expectations and the realities of implementing a performance-based financing project in Mali create frustration?

Background

Performance-Based Financing (PBF), an innovative health financing initiative, was recently implemented in Mali. PBF aims to improve quality of care by motivating health workers. The purpose of this research was to identify and understand how health workers’ expectations related to their experiences of the first cycle of payment of PBF subsidies, and how this experience affected their motivation and sentiments towards the intervention. We pose the research question, “how does the process of PBF subsidies impact the motivation of health workers in Mali?”

Methods

We adopted a qualitative approach using multiple case studies. We chose three district hospitals (DH 1, 2 and 3) in three health districts (district 1, 2 and 3) among the ten in the Koulikoro region. Our cases correspond to the three DHs. We followed the principle of data source triangulation; we used 53 semi-directive interviews conducted with health workers (to follow the principle of saturuation), field notes, and documents relating to the distribution grids of subsidies for each DH. We analyzed data in a mixed deductive and inductive manner.

Results

The results show that the PBF subsidies led to health workers feeling more motivated to perform their tasks overall. Beyond financial motivation, this was primarily due to PBF allowing them to work more efficiently. However, respondents perceived a discrepancy between the efforts made and the subsidies received. The fact that their expectations were not met led to a sense of frustration and disappointment. Similarly, the way in which the subsidies were distributed and the lack of transparency in the distribution process led to feelings of unfairness among the vast majority of respondents. The results show that frustrations can build up in the early days of the intervention.

Conclusion

The PBF implementation in Mali left health workers frustrated. The short overall implementation period did not allow actors to adjust their initial expectations and motivational responses, neither positive nor negative. This underlines how short-term interventions might not just lack impact, but instil negative sentiments likely to carry on into the future.

What theories underpin performance-based financing? A scoping review

PURPOSE

The study aims to explore the theoretical bases justifying the use of performance-based financing (PBF) in the health sector in low- and middle-income countries (LMICs).

DESIGN/METHODOLOGY/APPROACH

The authors conducted a scoping review of the literature on PBF so as to identify the theories utilized to underpin it and analyzed its theoretical justifications.

FINDINGS

Sixty-four studies met the inclusion criteria. Economic theories were predominant, with the principal-agent theory being the most commonly-used theory, explicitly referred to by two-thirds of included studies. Psychological theories were also common, with a wide array of motivation theories. Other disciplines in the form of management or organizational science, political and social science and systems approaches also contributed. However, some of the theories referred to contradicted each other. Many of the studies included only casually alluded to one or more theories, and very few used these theories to justify or support PBF. No theory emerged as a dominant, consistent and credible justification of PBF, perhaps except for the principal-agent theory, which was often inappropriately applied in the included studies, and when it included additional assumptions reflecting the contexts of the health sector in LMICs, might actually warn against adopting PBF.

PRACTICAL IMPLICATIONS

Overall, this review has not been able to identify a comprehensive, credible, consistent, theoretical justification for using PBF rather than alternative approaches to health system reforms and healthcare providers' motivation in LMICs.

ORIGINALITY/VALUE

The theoretical justifications of PBF in the health sector in LMICs are under-documented. This review is the first of this kind and should encourage further debate and theoretical exploration of the justifications of PBF.

Divergent notions of "quality" in healthcare policy implementation: a framing perspective

PURPOSE

This paper examines how "quality" was framed in the design and implementation of a policy to reform hospital funding and associated care delivery. The aims of the study were: (1) To describe how government policy-makers who designed the policy and managers and clinicians who implemented the policy framed the concept of "quality" and (2) To explore how frames of quality and the framing process may have influenced policy implementation.

DESIGN/METHODOLOGY/APPROACH

The authors conducted a secondary analysis of data from a qualitative case study involving semi-structured interviews with 45 purposefully selected key informants involved in the design and implementation of the quality-based procedures policy in Ontario, Canada. The authors used framing theory to inform coding and analysis.

FINDINGS

The authors found that policy designers perpetuated a broader frame of quality than implementers who held more narrow frames of quality. Frame divergence was further characterized by how informants framed the relationship between clinical and financial domains of quality. Several environmental and organizational factors influenced how quality was framed by implementers.

ORIGINALITY/VALUE

As health systems around the world increasingly implement new models of governance and financing to strengthen quality of care, there is a need to consider how "quality" is framed in the context of these policies and with what effect. This is the first framing analysis of "quality" in health policy.

A realist review to assess for whom, under what conditions and how pay for performance programmes work in low- and middle-income countries

Pay for performance (P4P) programmes are popular health system-focused interventions aiming to improve health outcomes in low-and middle-income countries (LMICs). This realist review aims to understand how, why and under what circumstance P4P works in LMICs.We systematically searched peer-reviewed and grey literature databases, and examined the mechanisms underpinning P4P effects on: utilisation of services, patient satisfaction, provider productivity and broader health system, and contextual factors moderating these. This evidence was then used to construct a causal loop diagram.We included 112 records (19 grey literature; 93 peer-reviewed articles) assessing P4P schemes in 36 countries. Although we found mixed evidence of P4P's effects on identified outcomes, common pathways to improved outcomes include: community outreach; adherence to clinical guidelines, patient-provider interactions, patient trust, facility improvements, access to drugs and equipment, facility autonomy, and lower user fees. Contextual factors shaping the system response to P4P include: degree of facility autonomy, efficiency of banking, role of user charges in financing public services; staffing levels; staff training and motivation, quality of facility infrastructure and community social norms. Programme design features supporting or impeding health system effects of P4P included: scope of incentivised indicators, fairness and reach of incentives, timely payments and a supportive, robust verification system that does not overburden staff. Facility bonuses are a key element of P4P, but rely on provider autonomy for maximum effect. If health system inputs are vastly underperforming pre-P4P, they are unlikely to improve only due to P4P. This is the first realist review describing how and why P4P initiatives work (or fail) in different LMIC contexts by exploring the underlying mechanisms and contextual and programme design moderators. Future studies should systematically examine health system pathways to outcomes for P4P and other health system strengthening initiatives, and offer more understanding of how programme design shapes mechanisms and effects.

No effects of pilot performance-based intervention implementation and withdrawal on the coverage of maternal and child health services in the Koulikoro region, Mali: an interrupted time series analysis

Performance-based financing (PBF) has been promoted and increasingly implemented across low- and middle-income countries to increase the utilization and quality of primary health care. However, the evidence of the impact of PBF is mixed and varies substantially across settings. Thus, further rigorous investigation is needed to be able to draw broader conclusions about the effects of this health financing reform. We examined the effects of the implementation and subsequent withdrawal of the PBF pilot programme in the Koulikoro region of Mali on a range of relevant maternal and child health indicators targeted by the programme. We relied on a control interrupted time series design to examine the trend in maternal and child health service utilization rates prior to the PBF intervention, during its implementation and after its withdrawal in 26 intervention health centres. The results for these 26 intervention centres were compared with those for 95 control health centres, with an observation window that covered 27 quarters. Using a mixed-effects negative binomial model combined with a linear spline regression model and covariates adjustment, we found that neither the introduction nor the withdrawal of the pilot PBF programme bore a significant impact in the trend of maternal and child health service use indicators in the Koulikoro region of Mali. The absence of significant effects in the health facilities could be explained by the context, by the weaknesses in the intervention design and by the causal hypothesis and implementation. Further inquiry is required in order to provide policymakers and practitioners with vital information about the lack of effects detected by our quantitative analysis.

Implementing performance-based financing in peripheral health centres in Mali: what can we learn from it?

Introduction

Numerous sub-Saharan African countries have experimented with performance-based financing (PBF) with the goal of improving health system performance. To date, few articles have examined the implementation of this type of complex intervention in Francophone West Africa. This qualitative research aims to understand the process of implementing a PBF pilot project in Mali's Koulikoro region.

Method

We conducted a contrasted multiple case study of performance in 12 community health centres in three districts. We collected 161 semi-structured interviews, 69 informal interviews and 96 non-participant observation sessions. Data collection and analysis were guided by the Consolidated Framework for Implementation Research adapted to the research topic and local context.

Results

Our analysis revealed that the internal context of the PBF implementation played a key role in the process. High-performing centres exercised leadership and commitment more strongly than low-performing ones. These two characteristics were associated with taking initiatives to promote PBF implementation and strengthening team spirit. Information regarding the intervention was best appropriated by qualified health professionals. However, the limited duration of the implementation did not allow for the emergence of networks or champions. The enthusiasm initially generated by PBF quickly dissipated, mainly due to delays in the implementation schedule and the payment modalities.

Conclusion

PBF is a complex intervention in which many actors intervene in diverse contexts. The initial level of performance and the internal and external contexts of primary healthcare facilities influence the implementation of PBF. Future work in this area would benefit from an interdisciplinary approach combining public health and anthropology to better understand such an intervention. The deductive–inductive approach must be the stepping-stone of such a methodological approach.

Understanding efficiency and the effect of pay-for-performance across health facilities in Tanzania

BACKGROUND

Ensuring efficient use and allocation of limited resources is crucial to achieving the UHC goal. Performance-based financing that provides financial incentives for health providers reaching predefined targets would be expected to enhance technical efficiency across facilities by promoting an output-oriented payment system. However, there is no study which has systematically assessed efficiency scores across facilities before and after the introduction of pay-for-performance (P4P). This paper seeks to fill this knowledge gap.

METHODS

We used data of P4P evaluation related to healthcare inputs (staff, equipment, medicines) and outputs (outpatient consultations and institutional deliveries) from 75 health facilities implementing P4P in Pwani region, and 75 from comparison districts in Tanzania. We measured technical efficiency using Data Envelopment Analysis and obtained efficiency scores across facilities before and after P4P scheme. We analysed which factors influence technical efficiency by regressing the efficiency scores over a number of contextual factors. We also tested the impact of P4P on efficiency through a difference-in-differences regression analysis.

RESULTS

The overall technical efficiency scores ranged between 0.40 and 0.65 for hospitals and health centres, and around 0.20 for dispensaries. Only 21% of hospitals and health centres were efficient when outpatient consultations and deliveries were considered as output, and <3% out of all facilities were efficient when outpatient consultations only were considered as outputs. Higher efficiency scores were significantly associated with the level of care (hospital and health centre) and wealthier catchment populations. Despite no evidence of P4P effect on efficiency on average, P4P might have improved efficiency marginally among public facilities.

CONCLUSION

Most facilities were not operating at their full capacity indicating potential for improving resource usage. A better understanding of the production process at the facility level and of how different healthcare financing reforms affects efficiency is needed. Effective reforms should improve inputs, outputs but also efficiency.

Healthcare Digitalization and Pay-For-Performance Incentives in Smart Hospital Project Financing

This study aims to explore the impact of healthcare digitalization on smart hospital project financing (PF) fostered by pay-for-performance (P4P) incentives. Digital platforms are a technology-enabled business model that facilitates exchanges between interacting agents. They represent a bridging link among disconnected nodes, improving the scalable value of networks. Application to healthcare public-private partnerships (PPPs) is significant due to the consistency of digital platforms with health issues and the complexity of the stakeholder's interaction. In infrastructural PPPs, public and private players cooperate, usually following PF patterns. This relationship is complemented by digitized supply chains and is increasingly patient-centric. This paper reviews the literature, analyzes some supply chain bottlenecks, addresses solutions concerning the networking effects of platforms to improve PPP interactions, and investigates the cost-benefit analysis of digital health with an empirical case. Whereas diagnostic or infrastructural technology is an expensive investment with long-term payback, leapfrogging digital applications reduce contingent costs. "Digital" savings can be shared by key stakeholders with P4P schemes, incentivizing value co-creation patterns. Efficient sharing may apply network theory to a comprehensive PPP ecosystem where stakeholding nodes are digitally connected. This innovative approach improves stakeholder relationships, which are re-engineered around digital platforms that enhance patient-centered satisfaction and sustainability. Digital technologies are useful even for infectious disease surveillance, like that of the coronavirus pandemic, for supporting massive healthcare intervention, decongesting hospitals, and providing timely big data.

Effects in spite of tough constraints - A theory of change based investigation of contextual and implementation factors affecting the results of a performance based financing scheme extended to malnutrition in Burundi

BACKGROUND

From January 2015 to December 2016, the health authorities in Burundi piloted the inclusion of child nutrition services into the pre-existing performance-based financing free health care policy (PBF-FHC). An impact evaluation, focused on health centres, found positive effects both in terms of volume of services and quality of care. To some extent, this result is puzzling given the harshness of the contextual constraints related to the fragile setting.

METHODS

With a multi-methods approach, we explored how contextual and implementation constraints interacted with the pre-identified tracks of effect transmission embodied in the intervention. For our analysis, we used a hypothetical Theory of Change (ToC) that mapped a set of seven tracks through which the intervention might develop positive effects for children suffering from malnutrition. We built our analysis on (1) findings from the facility surveys and (2) extra qualitative data (logbooks, interviews and operational document reviews).

FINDINGS

Our results suggest that six constraints have weighted upon the intervention: (1) initial low skills of health workers; (2) unavailability of resources (including nutritional dietary inputs and equipment); (3) payment delays; (4) suboptimal information; (5) restrictions on autonomy; and (6) low intensity of supervision. Together, they have affected the intensity of the intervention, especially during its first year. From our analysis of the ToC, we noted that the positive effects largely occurred as a result of the incentive and information tracks. Qualitative data suggests that health centres have circumvented the many constraints by relying on a community-based recruitment strategy and a better management of inputs at the level of the facility and the patient himself.

CONCLUSION

Frontline actors have agency: when incentives are right, they take the initiative and find solutions. However, they cannot perform miracles: Burundi needs a holistic societal strategy to resolve the structural problem of child malnutrition.

TRIAL REGISTRATION

Clinical Trials.gov Identifier: NCT02721160; March 2016 (retrospectively registered).

The Importance of Leadership and Organizational Capacity in Shaping Health Workers' Motivational Reactions to Performance-Based Financing: A Multiple Case Study in Burkina Faso

BACKGROUND

Performance-based financing (PBF) is currently tested in many low- and middle-income countries as a health system strengthening strategy. One of the main mechanisms through which PBF is assumed to effect change is by motivating health workers to improve their service delivery performance. This article aims at a better understanding of such motivational effects of PBF. In particular, the study focused on organizational context factors and health workers' perceptions thereof as moderators of the motivational effects of PBF, which to date has been little explored.

METHODS

We conducted a multiple case study in 2 district hospitals and 16 primary health facilities across three districts. Health facilities were purposely sampled according to pre-PBF performance levels. Within sampled facilities, 82 clinical skilled healthcare workers were in-depth interviewed one year after the start of the PBF intervention. Data were analyzed using a blended deductive and inductive process, using self-determination theory (SDT) as an analytical framework.

RESULTS

Results show that the extent to which PBF contributed to positive, sustainable forms of motivation depended on the "ground upon which PBF fell," beyond health workers' individual personalities and disposition. In particular, health workers described three aspects of the organizational context in which PBF was implemented: the extent to which existing hierarchies fostered as opposed to hindered participation and transparency; managers' handling of the increased performance feedback inherent in PBF; and facility's pre-PBF levels in regards to infrastructure, equipment, and human resources.

CONCLUSION

Our results underline the importance of leadership styles and pre-implementation performance levels in shaping health workers' motivational reactions to PBF. Ancillary interventions aimed at fostering participatory as opposed to directional leadership or start-up support to low-performing health facilities will likely boost PBF effects in regards to the development of valuable motivational capacities.

Methods to improve quality performance at scale in lower- and middle-income countries

Universal Health Coverage is one of the Sustainable Development Goal targets. But coverage without quality health services limits benefits to populations. Performance-based financing programs (PBF) use strategic purchasing of services to expand coverage and promote quality by measuring quality and rewarding good performance. The widespread presence of PBF programs in lower and middle-income countries provide an opportunity to introduce and test new approaches for measuring and improving quality at scale. This article describes four approaches to improve quality of health services at scale in PBF programs. These approaches looked at structural and process measures of quality as well as outcome measures like patient satisfaction. Three types of tools were used in these approaches: clinical vignettes, competency tests and patient satisfaction surveys. Specific tools within each of the approaches are used in Kyrgyzstan, Cambodia, Democratic Republic of Congo and the Republic of Congo.

Performance-based financing kick-starts motivational "feedback loop": findings from a process evaluation in Mozambique

BACKGROUND

Performance-based financing (PBF) reforms aim to directly influence health worker behavior through changes to institutional arrangements, accountability structures, and financial incentives based on performance. While there is still some debate about whether PBF influences extrinsic or intrinsic motivators, recent research finds that PBF affects both. Against this backdrop, our study presents findings from a process evaluation of a PBF program in Mozambique, exploring the perceived changes to both internal and external drivers of health worker motivation associated with PBF.

METHODS

We used a qualitative research design with in-depth, semi-structured interviews with health workers, which included a rank order exercise and focus group discussions. Interviews were analyzed by two researchers using thematic analysis techniques. Rank order frequency was calculated using weighted average methodology.

RESULTS

Health workers reported that PBF, overall, positively influenced their motivation by introducing or reinforcing both internal and external motivational drivers. Internal drivers included enhanced self-efficacy driven by goal orientation, healthy competition among colleagues, and job satisfaction. External drivers included an organized work environment, enhanced access to equipment and supplies, financial incentives, teamwork, and regular consultations with verifiers (a type of supervision). PBF stimulates an interactive relationship between internal and external motivational drivers, creating a feedback loop involving responsibility, achievement, and recognition, which increased perceived motivation.

CONCLUSIONS

The PBF program helped workers feel that they had well-defined and achievable goals and that they received recognition from verification teams, management committees, and colleagues due to enhanced accountability and governance. Our paper shows that financial incentives could serve as the "driver" to kick-start the feedback loop, of responsibility, achievement, and recognition, in environments that lack other drivers. Understanding how PBF programs can be designed and refined to reinforce this feedback loop could be a powerful tool to further enhance and track positive motivational changes. For countries thinking about PBF, we recommend that policymakers assess the loop in their contexts, identify drivers, determine whether these drivers are sufficient, and consider PBF if they are not.

TRIAL REGISTRATION

We obtained ethical approval for the study protocol, data collection instruments, and informed consent forms from the Ethics Review Committee of the Centers for Disease Control and Prevention (CDC) [IRB 2015-190] and the Ethics Review Committee of the Mozambique Ministry of Health.

The unintended consequences of combining equity measures with performance-based financing in Burkina Faso

BACKGROUND

User fees and poor quality of care contribute to low use of healthcare services in Burkina Faso. The government implemented an innovative intervention that combines equity measures with performance-based financing (PBF). These health equity measures included a community-based selection of indigents to receive user fee exemptions and paying healthcare centres higher purchase prices for services provided to indigents. Research suggests complex interventions can trigger changes not targeted by program planners. To date, however, there is a knowledge gap regarding the unintended consequences that can emerge from combining PBF with health equity measures. Our objective is to document unintended consequences of the equity measures in this complex intervention.

METHODS

We developed a conceptual framework using the diffusion of innovations theory. For the design, we conducted a multiple case study. The cases were four healthcare facilities in one district. We collected data through 93 semi-structured interviews, informal discussions, observation, as well as intervention documents. We conducted thematic analysis using a hybrid deductive-inductive approach. We also used secondary data to describe the monthly evolution of services provided to indigent and non-indigent patients before and after indigent cards were distributed. Time series graphs were used to validate some results.

RESULTS

Local actors, including members of indigent selection committees and healthcare workers, re-invented elements of the PBF equity measures over which they had control to increase their relative advantage or to adapt to implementation challenges and context. Some individuals who did not meet the local conceptualization of indigents were selected to the detriment of others who did. Healthcare providers believed that distributing free medications led to financial difficulties and drug shortages, especially given the low purchase prices and long payment delays. Healthcare workers adopted measures to limit free services delivered to indigents, which led to conflicts between indigents and providers. Ultimately, selected indigents received uncertain and unequal coverage.

CONCLUSIONS

The severity of unintended consequences undermined the effectiveness and equity of the intervention. If the intervention is prolonged and expanded, decision-makers and implementers will have to address these unintended consequences to reduce inequities in accessing care.

Understanding for whom, why and in what circumstances payment for performance works in low and middle income countries: protocol for a realist review

Background

Many low and middle income countries (LMIC) are implementing payment for performance (P4P) schemes to strengthen health systems and make progress towards universal health coverage. A number of systematic reviews have considered P4P effectiveness but did not explore how P4P works in different settings to improve outcomes or shed light on pathways or mechanisms of programme effect. This research will undertake a realist review to investigate how, why and in what circumstances P4P leads to intended and unintended outcomes in LMIC.

Methods

Our search was guided by an initial programme theory of mechanisms and involved a systematic search of Medline, Embase, Popline, Business Source Premier, Emerald Insight and EconLit databases for studies on P4P and health in LMIC. Inclusion and exclusion criteria identify literature that is relevant to the initial programme theory and the research questions underpinning the review. Retained evidence will be used to test, revise or refine the programme theory and identify knowledge gaps. The evidence will be interrogated by examining the relationship between context, mechanisms and intended and unintended outcomes to establish what works for who, in which contexts and why.

Discussion

By synthesising current knowledge on how P4P affects health systems to produce outcomes in different contexts and to what extent the programme design affects this, we will inform more effective P4P programmes to strengthen health systems and achieve sustainable service delivery and health impacts.

Performance-based financing in three humanitarian settings: principles and pragmatism

BACKGROUND

Performance based financing (PBF) has been increasingly implemented across low and middle-income countries, including in fragile and humanitarian settings, which present specific features likely to require adaptation and to influence implementation of any health financing programme. However, the literature has been surprisingly thin in the discussion of how PBF has been adapted to different contexts, and in turn how different contexts may influence PBF. With case studies from three humanitarian settings (northern Nigeria, Central African Republic and South Kivu in the Democratic Republic of Congo), we examine why and how PBF has emerged and has been adapted to those unsettled and dynamic contexts, what the opportunities and challenges have been, and what lessons can be drawn.

METHODS

Our comparative case study is based on data collected from a document review, 35 key informant interviews and 16 focus group discussions with stakeholders at national and subnational level in the three settings. Data were analysed in order to describe and compare each setting in terms of underlying fragility features and their implications for the health system, and to look at how PBF has been adopted, implemented and iteratively adapted to respond to acute crisis, deal with other humanitarian actors and involve local communities.

RESULTS

Our analysis reveals that the challenging environments required a high degree of PBF adaptation and innovation, at times contravening the so-called 'PBF principles' that have become codified. We develop an analytical framework to highlight the key nodes where adaptations happen, the contextual drivers of adaptation, and the organisational elements that facilitate adaptation and may sustain PBF programmes.

CONCLUSIONS

Our study points to the importance of pragmatic adaptation in PBF design and implementation to reflect the contextual specificities, and identifies elements (such as, organisational flexibility, local staff and knowledge, and embedded long-term partners) that could facilitate adaptations and innovations. These findings and framework are useful to spark a reflection among PBF donors and implementers on the relevance of incorporating, reinforcing and building on those elements when designing and implementing PBF programmes.

How does performance-based financing affect health workers' intrinsic motivation? A Self-Determination Theory-based mixed-methods study in Malawi

"Intrinsic motivation crowding out", the erosion of high-quality, sustainable motivation through the introduction of financial incentives, is one of the most frequently discussed but yet little researched potential unfavorable consequence of Performance-based Financing (PBF). We used the opportunity of the introduction of PBF in Malawi to investigate whether and how PBF affected intrinsic motivation, using a mixed-methods research design theoretically grounded in Self-Determination Theory (SDT). The quantitative component served to estimate the impact of PBF on intrinsic motivation, relying on a controlled pre- and post-test design, with data collected from health workers in 23 intervention and 10 comparison facilities before (March/April 2013; n = 70) and approximately two years after (June/July 2015; n = 71) the start of the intervention. The qualitative component, relying on in-depth interviews with health workers in selected intervention facilities one (April 2014; n = 21) and two (September 2015; n = 20) years after the start of PBF, served to understand how PBF did or did not bring about change in intrinsic motivation. Specifically, it allowed us to examine how the various motivation-relevant elements and consequences of PBF impacted health workers' basic psychological needs for autonomy, competence, and relatedness, which SDT postulates as central to intrinsic motivation. Our results suggest that PBF did not affect health workers' overall intrinsic motivation levels, with the intervention having had both positive and negative effects on psychological needs satisfaction. To maximize positive PBF effects on intrinsic motivation, our results underline the potential value of explicit strategies to mitigate unintended negative impact of unavoidable design, implementation, and contextual challenges, for instance by building autonomy support activities into PBF designs.

Supply-side interventions to improve health: Findings from the Salud Mesoamérica Initiative

Background

Results-based aid (RBA) is increasingly used to incentivize action in health. In Mesoamerica, the region consisting of southern Mexico and Central America, the RBA project known as the Salud Mesoamérica Initiative (SMI) was designed to target disparities in maternal and child health, focusing on the poorest 20% of the population across the region.

Methods and findings

Data were first collected in 365 intervention health facilities to establish a baseline of indicators. For the first follow-up measure, 18 to 24 months later, 368 facilities were evaluated in these same areas. At both stages, we measured a near-identical set of supply-side performance indicators in line with country-specific priorities in maternal and child health. All countries showed progress in performance indicators, although with different levels. El Salvador, Honduras, Nicaragua, and Panama reached their 18-month targets, while the State of Chiapas in Mexico, Guatemala, and Belize did not. A second follow-up measurement in Chiapas and Guatemala showed continued progress, as they achieved previously missed targets nine to 12 months later, after implementing a performance improvement plan.

Conclusions

Our findings show an initial success in the supply-side indicators of SMI. Our data suggest that the RBA approach can be a motivator to improve availability of drugs and services in poor areas. Moreover, our innovative monitoring and evaluation framework will allow health officials with limited resources to identify and target areas of greatest need.

Context matters (but how and why?) A hypothesis-led literature review of performance based financing in fragile and conflict-affected health systems

Performance-based financing (PBF) schemes have been expanding rapidly across low and middle income countries in the past decade, with considerable external financing from multilateral, bilateral and global health initiatives. Many of these countries have been fragile and conflict-affected (FCAS), but while the influence of context is acknowledged to be important to the operation of PBF, there has been little examination of how it affects adoption and implementation of PBF. This article lays out initial hypotheses about how FCAS contexts may influence the adoption, adaption, implementation and health system effects of PBF. These are then interrogated through a review of available grey and published literature (140 documents in total, covering 23 PBF schemes). We find that PBF has been more common in FCAS contexts, which were also more commonly early adopters. Very little explanation of the rationale for its adoption, in particular in relation with the contextual features, is given in programme documents. However, there are a number of factors which could explain this, including the greater role of external actors and donors, a greater openness to institutional reform, and lower levels of trust within the public system and between government and donors, all of which favour more contractual approaches. These suggest that rather than emerging despite fragility, conditions of fragility may favour the rapid emergence of PBF. We also document few emerging adaptations of PBF to humanitarian settings and limited evidence of health system effects which may be contextually driven, but these require more in-depth analysis. Another area meriting more study is the political economy of PBF and its diffusion across contexts.

Characterizing performance improvement in primary care systems in Mesoamerica: A realist evaluation protocol

Background. Improving performance of primary care systems in low- and middle-income countries (LMICs) may be a necessary condition for achievement of universal health coverage in the age of Sustainable Development Goals. The Salud Mesoamerica Initiative (SMI), a large-scale, multi-country program that uses supply-side financial incentives directed at the central-level of governments, and continuous, external evaluation of public, health sector performance to induce improvements in primary care performance in eight LMICs. This study protocol seeks to explain whether and how these interventions generate program effects in El Salvador and Honduras. Methods. This study presents the protocol for a study that uses a realist evaluation approach to develop a preliminary program theory that hypothesizes the interactions between context, interventions and the mechanisms that trigger outcomes. The program theory was completed through a scoping review of relevant empirical, peer-reviewed and grey literature; a sense-making workshop with program stakeholders; and content analysis of key SMI documents. The study will use a multiple case-study design with embedded units with contrasting cases. We define as a case the two primary care systems of Honduras and El Salvador, each with different context characteristics. Data will be collected through in-depth interviews with program actors and stakeholders, documentary review, and non-participatory observation. Data analysis will use inductive and deductive approaches to identify causal patterns organized as 'context, mechanism, outcome' configurations. The findings will be triangulated with existing secondary, qualitative and quantitative data sources, and contrasted against relevant theoretical literature. The study will end with a refined program theory. Findings will be published following the guidelines generated by the Realist and Meta-narrative Evidence Syntheses study (RAMESES II). This study will be performed contemporaneously with SMI's mid-term stage of implementation. Of the methods described, the preliminary program theory has been completed. Data collection, analysis and synthesis remain to be completed.

Donor-funded project's sustainability assessment: a qualitative case study of a results-based financing pilot in Koulikoro region, Mali

BACKGROUND

Results-based financing (RBF) is emerging as a new alternative to finance health systems in many African countries. In Mali, a pilot project was conducted to improve demand and supply of health services through financing performance in targeted services. No study has explored the sustainability process of such a project in Africa. This study's objectives were to understand the project's sustainability process and to assess its level of sustainability.

METHODS

Sustainability was examined through its different determinants, phases, levels and contexts. These were explored using qualitative interviews to discern, via critical events, stakeholders' ideas regarding the project's sustainability. Data collection sites were chosen with the participation of different stakeholders, based on a variety of criteria (rural/urban settings, level of participation, RBF participants still present, etc.). Forty-nine stakeholders were then interviewed in six community health centres and two referral health centres (from 11/12/15 to 08/03/16), including health practitioners, administrators, and those involved in implementing and conceptualizing the program (government and NGOs). A theme analysis was done with the software © QDA Miner according to the study's conceptual framework.

RESULTS

The results of this project show a weak level of sustainability due to many factors. While some gains could be sustained (ex.: investments in long-term resources, high compatibility of values and codes, adapted design to the implementations contexts, etc.) other intended benefits could not (ex.: end of investments, lack of shared cultural artefacts around RBF, loss of different tasks and procedures, need of more ownership of the project by the local stakeholders). A lack of sustainability planning was observed, and few critical events were associated to phases of sustainability.

CONCLUSIONS

While this RBF project aimed at increasing health agents' motivation through different mechanisms (supervision, investments, incentives, etc.), these results raise questions on what types of motivation could be more stable and what could be the place of local stakeholders in the project; all this with the aim of more sustained and efficient results.

The unintended consequences of community verifications for performance-based financing in Burkina Faso

Performance-based financing (PBF) is being widely implemented to improve healthcare services in Africa. An essential component of PBF involves conducting community verifications, wherein investigators from local associations attempt to trace samples of patients. Community surveys are administered to patients to verify whether healthcare workers reported fictitious services to increase their revenue. At the same time, client satisfaction surveys are administered to assess whether patients are satisfied with the services received. Although some global health actors are concerned that PBF can trigger unintended consequences, this topic remains neglected. The objective of this study was to document the unintended consequences of community verification. Guided by the diffusion of innovations theory, we conducted a multiple case study. The cases were the catchment areas of seven healthcare facilities in Burkina Faso. Data were collected between January 2016 and May 2016 using non-participant observation, 92 semi-structured interviews, and informal discussions. Participants included a wide range of stakeholders, such as community verifiers, investigators, patients, and healthcare providers. Data were coded using QDA Miner, and thematic analysis was conducted. Healthcare workers did not significantly disturb or try to influence community verifiers during patient selection for community verifications. Unintended consequences included stakeholders' dissatisfaction regarding compensation modalities, work overload for community verifiers, and falsification of verification data by investigators. Community verifications led to loss of patient confidentiality as well as fears and apprehensions, although some patients were pleased to share their views regarding healthcare services. Community verifications also triggered marital issues, resulting in conflicts with, or interference from, husbands. The numerous challenges associated with locating patients in their communities led stakeholders to question the validity and utility of the results. These unintended consequences could jeopardize the overall effectiveness of community verifications. Attention should be paid to these unintended consequences to inform effective implementation and refine future interventions.

Combining Theory-Driven Evaluation and Causal Loop Diagramming for Opening the 'Black Box' of an Intervention in the Health Sector: A Case of Performance-Based Financing in Western Uganda

Increased attention on "complexity" in health systems evaluation has resulted in many different methodological responses. Theory-driven evaluations and systems thinking are two such responses that aim for better understanding of the mechanisms underlying given outcomes. Here, we studied the implementation of a performance-based financing intervention by the Belgian Technical Cooperation in Western Uganda to illustrate a methodological strategy of combining these two approaches. We utilized a systems dynamics tool called causal loop diagramming (CLD) to generate hypotheses feeding into a theory-driven evaluation. Semi-structured interviews were conducted with 30 health workers from two districts (Kasese and Kyenjojo) and with 16 key informants. After CLD, we identified three relevant hypotheses: "success to the successful", "growth and underinvestment", and "supervision conundrum". The first hypothesis leads to increasing improvements in performance, as better performance leads to more incentives, which in turn leads to better performance. The latter two hypotheses point to potential bottlenecks. Thus, the proposed methodological strategy was a useful tool for identifying hypotheses that can inform a theory-driven evaluation. The hypotheses are represented in a comprehensible way while highlighting the underlying assumptions, and are more easily falsifiable than hypotheses identified without using CLD.