Mind the costs, too: towards better cost-effectiveness analyses of PBF programmes

Adapting Economic Evaluation Methods to Shifting Global Health Priorities: Assessing the Value of Health System Inputs

OBJECTIVES

We highlight the importance of undertaking value assessments for health system inputs if allocative efficiency is to be achieve with health sector resources, with a focus on low- and middle-income countries. However, methodological challenges complicated the application of current economic evaluation techniques to health system input investments.

METHODS

We undertake a review of the literature to examine how assessments of investments in health system inputs have been considered to date, highlighting several studies that have suggested ways to address the methodological issues. Additionally, we surveyed how empirical economic evaluations of health system inputs have approached these issues. Finally, we highlight the steps required to move toward a comprehensive standardized framework for undertaking economic evaluations to make value assessments for investments in health systems.

RESULTS

Although the methodological challenges have been illustrated, a comprehensive framework for value assessments of health system inputs, guiding the evidence required, does not exist. The applied literature of economic evaluations of health system inputs has largely ignored the issues, likely resulting in inaccurate assessments of cost-effectiveness.

CONCLUSIONS

A majority of health sector budgets are spent on health system inputs, facilitating the provision of healthcare interventions. Although economic evaluation methods are a key component in priority setting for healthcare interventions, such methods are less commonly applied to decision making for investments in health system inputs. Given the growing agenda for investments in health systems, a framework will be increasingly required to guide governments and development partners in prioritizing investments in scarce health sector budgets.

How much does it cost to combine supply-side and demand-side RBF approaches in a single intervention? Full cost analysis of the Results Based Financing for Maternal and Newborn Health Initiative in Malawi

OBJECTIVE

To estimate the economic cost associated with implementing the Results Based Financing for Maternal and Newborn Health (RBF4MNH) Initiative in Malawi. No specific hypotheses were formulated ex-ante.

SETTING

Primary and secondary delivery facilities in rural Malawi.

PARTICIPANTS

Not applicable. The study relied almost exclusively on secondary financial data.

INTERVENTION

The RBF4MNH Initiative was a results-based financing (RBF) intervention including both a demand and a supply-side component.

PRIMARY AND SECONDARY OUTCOME MEASURES

Cost per potential and for actual beneficiaries.

RESULTS

The overall economic cost of the Initiative during 2011-2016 amounted to €12 786 924, equivalent to €24.17 per pregnant woman residing in the intervention districts. The supply side activity cluster absorbed over 40% of all resources, half of which were spent on infrastructure upgrading and equipment supply, and 10% on incentives. Costs for the demand side activity cluster and for verification were equivalent to 14% and 6%, respectively of the Initiative overall cost.

CONCLUSION

Carefully tracing resource consumption across all activities, our study suggests that the full economic cost of implementing RBF interventions may be higher than what was previously reported in published cost-effectiveness studies. More research is urgently needed to carefully trace the costs of implementing RBF and similar health financing innovations, in order to inform decision-making in low-income and middle-income countries around scaling up RBF approaches.

Is Performance-Based Financing A Pathway to Strategic Purchasing in Sub-Saharan Africa? A Synthesis of the Evidence

Many countries in sub-Saharan Africa have implemented performance-based financing (PBF) to improve health system performance. Much of the debate and analysis relating to PBF has focused on whether PBF “works”—that is, whether it leads to improvements in indicators tied to incentive-based payments. Because PBF schemes embody key elements of strategic health purchasing, this study examines the question of whether and how PBF programs in sub-Saharan Africa influence strategic purchasing more broadly within country health financing arrangements. We searched PubMed, Scopus, EconLit, Cochrane Database of Systematic Reviews, Google Scholar, Google, and the World Health Organization and World Bank’s repositories for studies that focused on the implementation experience or effects of PBF in sub-Saharan African and published in English from 2000 to 2020. We identified 44 papers and used framework analysis to analyze the data and generate key findings. The evidence we reviewed shows that PBF has the potential to raise awareness about strategic purchasing, improve governance and institutional arrangements, and strengthen strategic purchasing functions. However, these effects are minimal in practice because PBF has been introduced as narrow, often pilot, projects that run parallel to and have little integration with the mainstream health financing system. We concluded that PBF has not systematically transformed health purchasing in countries in sub-Saharan Africa but that the experience with PBF can provide valuable lessons for how system-wide strategic purchasing can be implemented most effectively in that region—either in countries that currently have PBF schemes and aim to integrate them into broader purchasing systems, or in countries that are not currently implementing PBF. We also concluded that for countries to pursue more holistic approaches to strategic health purchasing and achieve better health outcomes, they need to implement health financing reforms within or aligned with existing financing systems.

Economic Aspects of Delivering Primary Care Services: An Evidence Synthesis to Inform Policy and Research Priorities

Policy Points The 2018 Declaration of Astana reemphasized the importance of primary health care and its role in achieving universal health coverage. While there is a large amount of literature on the economic aspects of delivering primary care services, there is a need for more comprehensive overviews of this evidence. In this article, we offer such an overview. Evidence suggests that there are several strategies involving coverage, financing, service delivery, and governance arrangements which can, if implemented, have positive economic impacts on the delivery of primary care services. These include arrangements such as worker task-shifting and telemedicine. The implementation of any such arrangements, based on positive economic evidence, should carefully account for potential impacts on overall health care access and quality. There are many opportunities for further research, with notable gaps in evidence on the impacts of increasing primary care funding or the overall supply of primary care services.

CONTEXT

The 2018 Declaration of Astana reemphasized the importance of primary health care and its role in achieving universal health coverage. To strengthen primary health care, policymakers need guidance on how to allocate resources in a manner that maximizes its economic benefits.

METHODS

We collated and synthesized published systematic reviews of evidence on the economic aspects of different models of delivering primary care services. Building on previous efforts, we adapted existing taxonomies of primary care components to classify our results according to four categories: coverage, financing, service delivery, and governance.

FINDINGS

We identified and classified 109 reviews that met our inclusion criteria according to our taxonomy of primary care components: coverage, financing, service delivery, and governance arrangements. A significant body of evidence suggests that several specific primary care arrangements, such as health workers' task shifting and telemedicine, can have positive economic impacts (such as lower overall health care costs). Notably absent were reviews on the impact of increasing primary care funding or the overall supply of primary care services.

CONCLUSIONS

There is a great opportunity for further research to systematically examine the broader economic impacts of investing in primary care services. Despite progress over the last decade, significant evidence gaps on the economic implications of different models of primary care services remain, which could help inform the basis of future research efforts.

What happens when performance-based financing meets free healthcare? Evidence from an interrupted time-series analysis

In spite of the wide attention performance-based financing (PBF) has received over the past decade, no evidence is available on its impacts on quantity and mix of service provision nor on its interaction with parallel health financing interventions. Our study aimed to examine the PBF impact on quantity and mix of service provision in Burkina Faso, while accounting for the parallel introduction of a free healthcare policy. We used Health Management Information System data from 838 primary-level health facilities across 24 districts and relied on an interrupted time-series analysis with independent controls. We placed two interruptions, one to account for PBF and one to account for the free healthcare policy. In the period before the free healthcare policy, PBF produced significant but modest increases across a wide range of maternal and child services, but a significant decrease in child immunization coverage. In the period after the introduction of the free healthcare policy, PBF did not affect service provision in intervention compared with control facilities, possibly indicating a saturation effect. Our findings indicate that PBF can produce modest increases in service provision, without altering the overall service mix. Our findings, however, also indicate that the introduction of other health financing reforms can quickly crowd out the effects produced by PBF. Further qualitative research is required to understand what factors allow healthcare providers to increase the provision of some, but not all services and how they react to the joint implementation of PBF and free health care.

The cost-effectiveness of using results-based financing to reduce maternal and perinatal mortality in Malawi

INTRODUCTION

Results-based financing (RBF) is being promoted to increase coverage and quality of maternal and perinatal healthcare in sub-Saharan Africa (SSA) countries. Evidence on the cost-effectiveness of RBF is limited. We assessed the cost-effectiveness within the context of an RBF intervention, including performance-based financing and conditional cash transfers, in rural Malawi.

METHODS

We used a decision tree model to estimate expected costs and effects of RBF compared with status quo care during single pregnancy episodes. RBF effects on maternal case fatality rates were modelled based on data from a maternal and perinatal programme evaluation in Zambia and Uganda. We obtained complementary epidemiological information from the published literature. Service utilisation rates for normal and complicated deliveries and associated costs of care were based on the RBF intervention in Malawi. Costs were estimated from a societal perspective. We estimated incremental cost-effectiveness ratios per disability adjusted life year (DALY) averted, death averted and life-year gained (LYG) and conducted sensitivity analyses to how robust results were to variations in key model parameters.

RESULTS

Relative to status quo, RBF implied incremental costs of US$1122, US$26 220 and US$987 per additional DALY averted, death averted and LYG, respectively. The share of non-RBF facilities that provide quality care, life expectancy of mothers at time of delivery and the share of births in non-RBF facilities strongly influenced cost-effectiveness values. At a willingness to pay of US$1485 (3 times Malawi gross domestic product per capita) per DALY averted, RBF has a 77% probability of being cost-effective.

CONCLUSIONS

At high thresholds of wiliness-to-pay, RBF is a cost-effective intervention to improve quality of maternal and perinatal healthcare and outcomes, compared with the non-RBF based approach. More RBF cost-effectiveness analyses are needed in the SSA region to complement the few published studies and narrow the uncertainties surrounding cost-effectiveness estimates.

At what cost is performance-based financing implemented? Novel evidence from Malawi

Our study estimated the full economic cost of implementing performance-based financing [PBF, the Support for Service Delivery Integration Performance-Based Incentives (SSDI-PBI) programme], as a means of first introducing strategic purchasing in a low-income setting, Malawi. Our analysis distinguished design from implementation costs and traces costs across personnel and non-personnel cost categories over the 2012-15 period. The full cost of the SSDI-PBI programme amounted to USD 3 402 187, equivalent to USD 6.46 per targeted beneficiary. The design phase accounted for about one-third (USD 1 161 332) of the total costs, while the incentives (USD 1 140 436) represented about one-third of the total cost of the intervention and about half the cost of the implementation phase. With a cost of USD 1 605 178, personnel costs represented the dominant cost category. Our study indicated that the introduction of PBF entailed consumption of a substantial amount of resources, hence representing an important opportunity cost for the health system.