Assessing health system performance in developing countries: a review of the literature

Challenges and opportunities for policy decisions to address health equity in developing health systems: case study of the policy processes in the Indian state of Orissa

INTRODUCTION

Achieving health equity is a pertinent need of the developing health systems. Though policy process is crucial for planning and attaining health equity, the existing evidences on policy processes are scanty in this regard. This article explores the magnitude, determinants, challenges and prospects of 'health equity approach' in various health policy processes in the Indian State of Orissa - a setting comparable with many other developing health systems.

METHODS

A case-study involving 'Walt-Gilson Policy Triangle' employed key-informant interviews and documentary reviews. Key informants (n = 34) were selected from the departments of Health and Family Welfare, Rural Development, and Women and Child Welfare, and civil societies. The documentary reviews involved various published and unpublished reports, policy pronouncements and articles on health equity in Orissa and similar settings.

RESULTS

The 'health policy agenda' of Orissa was centered on 'health equity' envisaging affordable and equitable healthcare to all, integrated with public health interventions. However, the subsequent stages of policy process such as 'development, implementation and evaluation' experienced leakage in the equity approach. The impediment for a comprehensive approach towards health equity was the nexus among the national and state health priorities; role, agenda and capacity of actors involved; and existing constraints of the healthcare delivery system.

CONCLUSION

The health equity approach of policy processes was incomprehensive, often inadequately coordinated, and largely ignored the right blend of socio-medical determinants. A multi-sectoral, unified and integrated approach is required with technical, financial and managerial resources from different actors for a comprehensive 'health equity approach'. If carefully geared, the ongoing health sector reforms centered on sector-wide approaches, decentralization, communitization and involvement of non-state actors can substantially control existing inequalities through an optimally packaged equitable policy. The stakeholders involved in the policy processes need to be given orientation on the concept of health equity and its linkage with socio-economic development.

Understanding client satisfaction with a health insurance scheme in Nigeria: factors and enrollees experiences

BACKGROUND

Health insurance schemes have been widely introduced during this last decade in many African countries, which have strived for improvements in health service provision and the promotion of health care utilization. Client satisfaction with health service provision during the implementation of health insurance schemes has often been neglected since numerous activities take place concurrently. The satisfaction of enrollees and its influencing factors have been providing evidence which have assisted in policy and decision making. Our objective is to determine the enrollee's satisfaction with health service provision under a health insurance scheme and the factors which influence the satisfaction.

METHODS

This retrospective, cross-sectional survey took place between May and September 2008. Two hundred and eighty (280) enrollees insured for more than one year in Zaria-Nigeria were recruited using two stage sampling. Enrollee's satisfaction was categorized into more satisfied and less satisfied based on positive responses obtained. Satisfaction, general knowledge and awareness of contribution were each aggregated and assessed as composite measure. Logistic regression analysis was used to analyze factors that influenced the satisfaction of enrollees.

RESULTS

A high satisfaction rate with the health insurance scheme was observed (42.1%). Marital status (p < .05), general knowledge (p < .001) and awareness of contributions (p < .05) positively influenced clients' satisfaction. Length of employment, salary income, hospital visits and duration of enrolment slightly influenced satisfaction.

CONCLUSIONS

This study highlighted the potential effects of general health insurance knowledge and awareness of contributions by end-users (beneficiaries) of such new program on client satisfaction which have significant importance. The findings provided evidence which have assisted the amendment and re-prioritization of the medium term strategic plan of operations for the scheme. Future planning efforts could consider the client satisfaction and the factors which influenced it regularly.

Assessment of primary care in health surveys: a population perspective

BACKGROUND

The objective of this study was to evaluate the metric properties of a selection of items of the Primary Care Assessment Tool (PCAT) included into 2006 Catalonia Health Survey and adapted to evaluate experiences of primary care (PC) under population perspective.

METHODS

This was a cross-sectional study. The study population was composed of non-institutionalized residents of Catalonia over 15 years of age (n = 12,933). The instrument used was a 10-item selection of the adult user's version of the PCAT (PCAT10-AE). We assessed internal consistency, correlation between items and performed exploratory factor analysis and external validity analysis.

RESULTS

The instrument presented adequate internal consistency (0.72). All items showed acceptable correlation with other items that constitute the scale. The single extracted factor explained 64% of the common variance in the responses, allowing the construction of a global index for evaluation of PC. We observed an association between better evaluation of PC and more satisfaction with the health system.

CONCLUSIONS

Metric analysis supported the integrity and general adequacy of this very short tool included in a population health survey. The global index proposed could be a good measure for assessing and monitoring the adequacy of part of the PC experiences in first-contact care and person-focused care over time, under population perspective. On the other hand, the loss of content as a consequence of the selection of items, suggesting use of the expanded versions of the PCAT-AE whenever a global evaluation of PC is desired and it is possible.

Borrowing and selling to pay for health care in low- and middle-income countries

Many families around the world make sizable out-of-pocket payments for health care. We calculated the frequency of borrowing money or selling assets to buy health services in forty low- and middle-income countries and estimated how various factors are associated with these coping strategies. The data represented a combined population of 3.66 billion, or 58 percent of the world's population. On average, 25.9 percent of households borrowed money or sold items to pay for health care. The risk was higher among the poorest households and in countries with less health insurance. Health systems in developing countries are failing to protect families from the financial risks of seeking health care.

What does quality care mean to nurses in rural hospitals?

AIM

This paper is a report of a study conducted to answer the question: 'How do rural nurses and their chief nursing officers define quality care?'

BACKGROUND

Established indicators of quality care were developed primarily in urban hospitals. Rural hospitals and their environments differ from urban settings, suggesting that there might be differences in how quality care is defined. This has measurement implications.

METHODS

Focus groups with staff nurses and interviews with chief nursing officers were conducted in 2006 at four rural hospitals in the South-Eastern United States of America. Data were analysed using conventional content analysis.

FINDINGS

The staff nurse and chief nursing officer data were analysed separately and then compared, exposing two major themes: 'Patients are what matter most' and 'Community connectedness is both a help and a hindrance'. Along with conveying that patients were the utmost priority and all care was patient-focused, the first theme included established indicators of quality such as falls, pressure ulcers, infection rates, readmission rates, and lengths of stay. A new discovery in this theme was a need for an indicator relevant for rural settings: transfer time to larger hospitals. The second theme, Community Connectedness, is unique to rural settings, exemplifying the rural culture. The community and hospital converge into a family of sorts, creating expectations for quality care by both patients and staff that are not typically found in urban settings and larger hospitals.

CONCLUSION

Established quality indicators are appropriate for rural hospitals, but additional indicators need to be developed. These must include transfer times to larger facilities and the culture of the community.

Identification of performance indicators for emergency centres in South Africa: results of a Delphi study

Background

Emergency medicine is a rapidly developing field in South Africa (SA) and other developing nations. There is a need to develop performance indicators that are relevant and easy to measure. This will allow identification of areas for improvement, create standards of care and allow inter-institutional comparisons to be made. There is evidence from the international literature that performance measures do lead to performance improvements.

Aims

To develop a broad-based consensus document detailing quality measures for use in SA Emergency Centres (ECs).

Methods

A three-round modified Delphi study was conducted over e-mail. A panel of experts representing the emergency medicine field in SA was formed. Participants were asked to provide potential performance indicators for use in SA, under subheaders of the various disciplines that are seen in emergency patients. These statements were collated and sent out to the panel for scoring on a 9-point Lickert scale. Statements that did not reach a predefined consensus were sent back to the panellist for reconsideration.

Results

Consensus was reached on 99 out of 153 (65%) of the performance indicators proposed. These were further refined, and a synopsis of the statements is presented, classified as to whether the statements were thought to be feasible or not in the current circumstances.

Conclusions

A synopsis of the useful and feasible performance indicators is presented. The majority are structural and performance-based indicators appropriate to the development of the field in SA. Further refinement and research is needed to implement these indicators.

Electronic supplementary material

The online version of this article (doi:10.1007/s12245-010-0240-6) contains supplementary material, which is available to authorized users.

Framework and methodology for evaluating mental health policy and plans

The importance of monitoring and evaluation for mental health service planning and delivery is indubitable. Notwithstanding, monitoring and evaluation of mental health policy and plans has received only limited attention. This paper presents an approach developed by the World Health Organization for monitoring mental health policy and plans that can be adapted and utilized for evaluation and monitoring of policy and plans in most other health spheres as well. Four critical areas are outlined i.e., evaluation of the policy document and the plan derived from it; monitoring the implementation of the strategic plan; evaluation of the implementation of the plan; and evaluation of whether the objectives of the policy have been achieved. Overcoming difficulties in objective assessment of policy documents and plans is discussed and two WHO checklists for evaluating the process, content and operational aspects of policies and plans are introduced together with a five step guidance process for conducting policy and plan evaluations.

The role of quality improvement in strengthening health systems in developing countries

Quality of care was recognized as a key element for improved health outcomes and efficiency in the World Health Organization's (WHO) widely adopted framework for health system strengthening in resource-poor countries. Although modern approaches to improving quality are increasingly used globally, their adoption remains sporadic in developing countries. Healthcare leaders and improvement experts representing 15 countries met in October 2008 to catalyze the adoption of quality improvement (QI) methods to improve healthcare quality in resource-poor settings. This paper describes the evidence used to frame deliberations, the proceedings and a proposal for incorporating QI methods into plans for strengthening health systems. The conference participants presented case reports and reviewed a growing body of evidence from peer-reviewed journals demonstrating that QI methods can make significant contributions in resource poor settings. Deliberations focused on the barriers to adoption of QI methods and potential strategies for addressing those barriers. Attendees concluded that QI has the potential to optimize the use of limited resources available from governments and global initiatives targeted at achieving shared aims. Demonstrable improvements in quality may encourage greater investment in health systems in developing countries by increasing donor, population and governmental confidence that resources are being used well.

The contribution of primary care to health and health systems in low- and middle-income countries: a critical review of major primary care initiatives

It has been 30 years since the Declaration of Alma Ata. During that time, primary care has been the central strategy for expanding health services in many low- and middle-income countries. The recent global calls to redouble support for primary care highlighted it as a pathway to reaching the health Millennium Development Goals. In this systematic review we described and assessed the contributions of major primary care initiatives implemented in low- and middle-income countries in the past 30 years to a broad range of health system goals. The scope of the programs reviewed was substantial, with several interventions implemented on a national scale. We found that the majority of primary care programs had multiple components from health service delivery to financing reform to building community demand for health care. Although given this integration and the variable quality of the available research it was difficult to attribute effects to the primary care component alone, we found that primary care-focused health initiatives in low- and middle-income countries have improved access to health care, including among the poor, at reasonably low cost. There is also evidence that primary care programs have reduced child mortality and, in some cases, wealth-based disparities in mortality. Lastly, primary care has proven to be an effective platform for health system strengthening in several countries. Future research should focus on understanding how to optimize the delivery of primary care to improve health and achieve other health system objectives (e.g., responsiveness, efficiency) and to what extent models of care can be exported to different settings.

Qualitative assessment of the dental health services provided at a dental school in Kerman, Iran

Increasing the quality of the services provided in a Dental School can raise the satisfaction level of patients and consequently increase the level of their oral health. This study was conducted to evaluate the quality of dental care and services provided to patients referred to a Dental School in Kerman, Iran. In this qualitative study, face-to-face, in-depth interviews were conducted with 41 participants [25 patients (P), 5 nurses (N), 6 dental academic staff (AS), and 5 dental students (S)]. Then, the interviews were transcribed and analyzed, using content analysis of data. Data analysis in qualitative research involves breaking down the data and searching for codes and categories that are then reassembled to form themes. Both positive and negative themes emerged. Positive themes included: good infection control, service accessibility, patient appointments and visits were not assigned on merit, precise examinations, and comprehensive treatment plans. Negative themes included: long wait time, lack of options to pass waiting time, such as newspapers and television, an insufficient number of nurses, and not enough professors for supervision. In addition, the results of this study show that the patients and dental staff have high expectations in relation to dental services, and that implementation of these expectations would increase the overall satisfaction with and the quality of the level of services. Finally, some recommendations for improving services in the Kerman Dental School were given to the managing team of the Dental School.

Rebuilding health systems to improve health and promote statebuilding in post-conflict countries: a theoretical framework and research agenda

Violent conflicts claim lives, disrupt livelihoods, and halt delivery of essential services, such as health care and education. Health systems are often devastated in conflicts as health professionals flee, infrastructure is destroyed, and the supply of drugs and supplies is halted. We propose that early reconstruction of a functioning, equitable health system in countries recovering from conflict is an investment with a range of benefits for post-conflict countries. Building on the growing literature about health systems as social and political institutions, we elaborate a logic model that outlines how health systems may contribute not only to improved health status but also potentially to broader statebuilding and enhanced prospects for peace. Specifically, we propose that careful design of the core elements of the health system by national governments and their development partners can promote reliable provision of essential health services while demonstrating a commitment to equity, strengthening government accountability to citizens, and building the capacity of government to manage core social programs. We review the conceptual basis and extant empirical evidence for these mechanisms, identify knowledge gaps, and suggest a research agenda.