Effective coverage as a new approach to health system performance assessment: a scoping review

Validating the indicator "maternal death review coverage" to improve maternal mortality data: A retrospective analysis of district, facility, and individual medical record data

BACKGROUND

Understanding causes and contributors to maternal mortality is critical from a quality improvement perspective to inform decision making and monitor progress toward ending preventable maternal mortality. The indicator "maternal death review coverage" is defined as the percentage of maternal deaths occurring in a facility that are audited. Both the numerator and denominator of this indicator are subject to misclassification errors, underreporting, and bias. This study assessed the validity of the indicator by examining both its numerator-the number and quality of death reviews-and denominator-the number of facility-based maternal deaths and comparing estimates of the indicator obtained from facility- versus district-level data.

METHODS AND FINDINGS

We collected data on the number of maternal deaths and content of death reviews from all health facilities serving as birthing sites in 12 districts in three countries: Argentina, Ghana, and India. Additional data were extracted from health management information systems on the number and dates of maternal deaths and maternal death reviews reported from health facilities to the district-level. We tabulated the percentage of facility deaths with evidence of a review, the percentage of reviews that met the World Health Organization defined standard for maternal and perinatal death surveillance and response. Results were stratified by sociodemographic characteristics of women and facility location and type. We compared these estimates to that obtained using district-level data. and looked at evidence of the review at the district/provincial level. Study teams reviewed facility records at 34 facilities in Argentina, 51 facilities in Ghana, and 282 facilities in India. In total, we found 17 deaths in Argentina, 14 deaths in Ghana, and 58 deaths in India evidenced at facilities. Overall, >80% of deaths had evidence of a review at facilities. In India, a much lower percentage of deaths occurring at secondary-level facilities (61.1%) had evidence of a review compared to deaths in tertiary-level facilities (92.1%). In all three countries, only about half of deaths in each country had complete reviews: 58.8% (n = 10) in Argentina, 57.2% (n = 8) in Ghana, and 41.1% (n = 24) in India. Dramatic reductions in indicator value were seen in several subnational geographic areas, including Gonda and Meerut in India and Sunyani in Ghana. For example, in Gonda only three of the 18 reviews conducted at facilities met the definitional standard (16.7%), which caused the value of the indicator to decrease from 81.8% to 13.6%. Stratification by women's sociodemographic factors suggested systematic differences in completeness of reviews by women's age, place of residence, and timing of death.

CONCLUSIONS

Our study assessed the validity of an important indicator for ending preventable deaths: the coverage of reviews of maternal deaths occurring in facilities in three study settings. We found discrepancies in deaths recorded at facilities and those reported to districts from facilities. Further, few maternal death reviews met global quality standards for completeness. The value of the calculated indicator masked inaccuracies in counts of both deaths and reviews and gave no indication of completeness, thus undermining the ultimate utility of the measure in achieving an accurate measure of coverage.

Effective coverage of antenatal care services in Ethiopia: a population-based cross-sectional study

BACKGROUND

Antenatal care (ANC) is a principal component of safe motherhood and reproductive health strategies across the continuum of care. Although the coverage of antenatal care visits has increased in Ethiopia, there needs to be more evidence of effective coverage of antenatal care. The 'effective coverage' concept can pinpoint where action is required to improve high-quality coverage in Ethiopia. Effective coverage indicates a health system's performance by incorporating need, utilization, and quality into a single measurement. The concept includes the number of contacts, facility readiness, interventions received, and components of services received. This study aimed to measure effective antenatal care coverage in Ethiopia.

METHODS

A two-stage cluster sampling method was used and included 2714 women aged 15-49 years and 462 health facilities from six Ethiopian regions from October 2019 to January 2020. The effective coverage cascade was analyzed among the targeted women by computing the proportion who received four or more antenatal care visits where the necessary inputs were available, received iron-folate supplementation and two doses of tetanus vaccination according to process quality components of antenatal care services.

RESULTS

Of all women, 40% (95%CI; 38, 43) had four or more visits, ranging from 3% in Afar to 74% in Addis Ababa. The overall mean health facility readiness score of the facilities serving these women was 70%, the vaccination and iron-folate supplementation coverage was 26%, and the ANC process quality was 64%. As reported by women, the least score was given to the quality component of discussing birth preparedness and complication readiness with providers. In the effective coverage cascade, the input-adjusted, intervention-adjusted, and quality-adjusted antenatal coverage estimates were 28%, 18%, and 12%, respectively.

CONCLUSION

The overall effective ANC coverage was low, primarily due to a considerable drop in the proportion of women who completed four or more ANC visits. Improving quality of services is crucial to increase ANC up take and completion of the recommended visits along with interventions increasing women's awareness.

Validating midwifery professionals' scope of practice and competency: A multi-country study comparing national data to international standards

BACKGROUND

There is a global shortage of midwives, whose services are essential to meet the healthcare needs of pregnant women and newborns. Evidence suggests that if enough midwives, trained and regulated to global standards, were deployed worldwide, maternal, and perinatal mortality would decline significantly. Health workforce planning estimates the number of midwives needed to achieve population coverage of midwifery interventions. However, to provide a valid measure of midwifery care coverage, an indicator must consider not only the raw number of midwives, but also their scope and competency. The tasks midwives are authorized to deliver and their competency to perform essential skills and behaviors provide crucial information for understanding the availability of safe, high-quality midwifery services. Without reliable estimates for an adequate midwifery workforce, progress toward ending preventable maternal and perinatal mortality will continue to be uneven. The International Labor Organization (ILO) and the International Confederation of Midwives (ICM) suggest standards for midwifery scope of practice and competencies. This paper compares national midwifery regulations, scope, and competencies in three countries to the ILO and ICM standards to validate measures of midwife density. We also assess midwives' self-reported skills/behaviors from the ICM competencies and their acquisition.

METHODS AND FINDINGS

We compared midwives' scope of practice in Argentina, Ghana, and India to the ILO Tasks and ICM Essential Competencies for Midwifery Practice. We compared midwives self-reported skills/behaviors with the ICM Competencies. Univariate and bivariate analysis was conducted to describe the association between midwives' skills and selected characteristics. National scopes of practice matched two ILO tasks in Argentina, four in India, and all in Ghana. National standards partially reflected ICM skills in Categories 2, 3, and 4 (pre-pregnancy and antenatal care; care during labor and birth; and ongoing care of women and newborns, respectively) in Argentina (range 11% to 67%), mostly in India (range 74% to 100%) and completely in Ghana (100% match). 1,266 midwives surveyed reported considerable variation in competency for skills and behaviors across ICM Category 2, 3, and 4. Most midwives reported matching skills and behaviors around labor and childbirth (Category 2). Higher proportions of midwives reported gaining basic skills through in-service training and on-job-experience than in pre-service training.

CONCLUSION

Estimating the density of midwives needed for an adequate midwifery workforce capable of providing effective population coverage is predicated on a valid numerator. A reliable and valid count of midwives to meet population needs assumes that each midwife counted has the authority to exercise the same behaviors and reflects the ability to perform them with comparable competency. Our results demonstrate variation in midwifery scopes of practice and self-reported competencies in comparison to global standards that pose a threat to the reliability and validity of the numerator in measures of midwife density, and suggest the potential for expanded authorization and improved education and training to meet global reference standards for midwifery practice has not been fully realized. Although the universally recognized standard, this study demonstrates that the complex, composite descriptions of skills and behaviors in the ICM competencies make them difficult to use as benchmark measures with any precision, as they are not defined or structured to serve as valid measures for assessing workforce competency. A simplified, content-validated measurement system is needed to facilitate evaluation of the competency of the midwifery workforce.

Evaluation of effective coverage for type 2 diabetes in Mexican primary care health information systems: a retrospective registry analysis

BACKGROUND

As the leading cause of disability and the fourth leading cause of premature death in Mexico, type 2 diabetes (T2D) represents a serious public health concern. The incidence of diabetes has increased dramatically in recent years, and data from the Mexican National Health and Nutrition Survey (ENSANUT) indicate that many people remain undiagnosed. Persistent socioeconomic health care barriers exacerbate this situation, as T2D morbidity and mortality are worsened in vulnerable populations, such as those without social security. We evaluated the performance of public primary health centers (PHCs) in T2D medical attention through the measure of effective coverage (EC, a combined measure of health care need, use, and quality) at national, state, health jurisdiction, and municipality levels.

METHODS

This retrospective analysis used blinded data recorded during 2017 in the Non-communicable Diseases National Information System (SIC) and T2D prevalence reported in 2018 ENSANUT to evaluate the EC achieved. We included individuals ≥ 20 years old without social security who did not declare the use of private health care services. Each EC component (need, use, and quality) was estimated based on the Shengelia adapted framework. The Kruskal-Wallis test was applied to evaluate the associations among EC quintiles and demographics.

RESULTS

In 2017, 26.5 million individuals, aged ≥ 20 years, without social security, and without the use of private health care services, were under the care of 12,086 PHCs. The national prevalence of T2D was 10.3%, equivalent to 2.6 million people living with T2D in need of primary health care. Large contrasts were seen among EC components between and within Mexican states. We found that only 37.1% of the above individuals received health services at PHCs and of them, 25.8% improved their metabolic condition. The national EC was 9.3%, and the range (by health jurisdiction) was 0.2%-38.6%, representing a large geographic disparity in EC. We found an evident disconnect among need, utilization, and quality rates across the country.

CONCLUSIONS

Expansion and improvement of EC are urgently needed to address the growing number of people living with T2D in Mexico, particularly in states with vulnerable populations.

Determinants of effective treatment coverage for posttraumatic stress disorder: findings from the World Mental Health Surveys

BACKGROUND

Posttraumatic stress disorder (PTSD) is associated with significant morbidity, but efficacious pharmacotherapy and psychotherapy are available. Data from the World Mental Health Surveys were used to investigate extent and predictors of treatment coverage for PTSD in high-income countries (HICs) as well as in low- and middle-income countries (LMICs).

METHODS

Seventeen surveys were conducted across 15 countries (9 HICs, 6 LMICs) by the World Health Organization (WHO) World Mental Health Surveys. Of 35,012 respondents, 914 met DSM-IV criteria for 12-month PTSD. Components of treatment coverage analyzed were: (a) any mental health service utilization; (b) adequate pharmacotherapy; (c) adequate psychotherapy; and (d) effective treatment coverage. Regression models investigated predictors of treatment coverage.

RESULTS

12-month PTSD prevalence in trauma exposed individuals was 1.49 (S.E., 0.08). A total of 43.0% (S.E., 2.2) received any mental health services, with fewer receiving adequate pharmacotherapy (13.5%), adequate psychotherapy (17.2%), or effective treatment coverage (14.4%), and with all components of treatment coverage lower in LMICs than HICs. In a multivariable model having insurance (OR = 2.31, 95 CI 1.17, 4.57) and severity of symptoms (OR = .35, 95% CI 0.18, 0.70) were predictive of effective treatment coverage.

CONCLUSION

There is a clear need to improve pharmacotherapy and psychotherapy coverage for PTSD, particularly in those with mild symptoms, and especially in LMICs. Universal health care insurance can be expected to increase effective treatment coverage and therefore improve outcomes.

Evaluations of effective coverage of maternal and child health services: A systematic review

Conventionally used coverage measures do not reflect the quality of care. Effective coverage (EC) assesses the extent to which health care services deliver potential health gains to the population by integrating concepts of utilization, need and quality. We aimed to conduct a systematic review of studies evaluating EC of maternal and child health services, quality measurement strategies and disparities across wealth quantiles. A systematic search was performed in six electronic databases [MEDLINE, EMBASE, Cumulative Index of Nursing and Allied Health (CINAHL), Scopus, Web of Science and Maternity and Infant Care] and grey literature. We also undertook a hand search of references. We developed search terms having no restrictions based on publication period, country or language. We included studies which reported EC estimates based on the World Health Organization framework of measuring EC. Twenty-seven studies, all from low- and middle-income settings (49 countries), met the criteria and were included in the narrative synthesis of the results. Maternal and child health intervention(s) and programme(s) were assessed either at an individual level or as an aggregated measure of health system performance or both. The EC ranged from 0% for post-partum care to 95% for breastfeeding. When crude coverage measures were adjusted to account for the quality of care, the EC values turned lower. The gap between crude coverage and EC was as high as 86%, and it signified a low quality of care. The assessment of the quality of care addressed structural, process and outcome domains individually or combined. The wealthiest 20% had higher EC of services than the poorest 20%, an inequitable distribution of coverage. More efforts are needed to improve the quality of maternal and child health services and to eliminate the disparities. Moreover, considering multiple dimensions of quality and the use of standard measurements are recommended to monitor coverage effectively.

High coverage but low quality of maternal and newborn health services in the coverage cascade: who is benefitted and left behind in accessing better quality health services in Nepal?

BACKGROUND

Antenatal care (ANC) visits, institutional delivery, and postnatal care (PNC) visits are vital to improve the health of mothers and newborns. Despite improved access to these routine maternal and newborn health (MNH) services in Nepal, little is known about the cascade of health service coverage, particularly contact coverage, intervention-specific coverage, and quality-adjusted coverage of MNH services. This study examined the cascade of MNH services coverage, as well as social determinants associated with uptake of quality MNH services in Nepal.

METHODS

We conducted a secondary analysis of data derived from the Nepal Demographic and Health Survey (NDHS) 2016, taking 1978 women aged 15-49 years who had a live birth in the 2 years preceding the survey. Three outcome variables were (i) four or more (4⁺) ANC visits, (ii) institutional delivery, and (iii) first PNC visit for mothers and newborns within 48 h of childbirth. We applied a cascade of health services coverage, including contact coverage, intervention-specific and quality-adjusted coverage, using a list of specific intervention components for each outcome variable. Several social determinants of health were included as independent variables to identify determinants of uptake of quality MNH services. We generated a quality score for each outcome variable and dichotomised the scores into two categories of "poor" and "optimal" quality, considering > 0.8 as a cut-off point. Binomial logistic regression was conducted and odds ratios (OR) were reported with 95% confidence intervals (CIs) at the significance level of p < 0.05 (two-tailed).

RESULTS

Contact coverage was higher than intervention-specific coverage and quality-adjusted coverage across all MNH services. Women with advantaged ethnicities or who had access to bank accounts had higher odds of receiving optimal quality MNH services, while women who speak the Maithili language and who had high birth order (≥ 4) had lower odds of receiving optimal quality ANC services. Women who received better quality ANC services had higher odds of receiving optimal quality institutional delivery. Women received poor quality PNC services if they were from remote provinces, had higher birth order and perceived problems when not having access to female providers.

CONCLUSIONS

Women experiencing ethnic and social disadvantages, and from remote provinces received poor quality MNH services. The quality-adjusted coverage can be estimated using household survey data, such as demographic and health surveys, especially in countries with limited routine data. Policies and programs should focus on increasing quality of MNH services and targeting disadvantaged populations and those living in remote areas. Ensuring access to female health providers and improving the quality of earlier maternity visits could improve the quality of health care during the pregnancy-delivery-postnatal period.

Evidence for an expanded hypertension care cascade in low- and middle-income countries: a scoping review

Background

With nearly 90% of annual hypertension-related deaths occurring in low- and middle-income countries (LMICs), there is an urgent need to measure the coverage of health services that effectively manage hypertension. However, there is little agreement on how to define effective coverage and the existing hypertension care cascade (hypertension prevalence, percent aware, percent treated, and percent controlled) does not account for the quality of care received by patients. This study reviews definitions of effective coverage and service quality for hypertension management services and proposes an expanded hypertension care cascade to improve measurement of health systems performance.

Methods

A systematic scoping review of literature published in six electronic databases between January 2000 and October 2020 identified studies that defined effective coverage of hypertension management services or integrated dimensions of service quality into population-based estimates of hypertension management in LMICs. Findings informed an expanded hypertension care cascade from which quality-adjusted service coverage can be calculated to approximate effective coverage.

Results

The review identified 18 relevant studies, including 6 that defined effective coverage for hypertension management services and 12 that reported a measure of service quality in a population-based study. Based on commonly reported barriers to hypertension management, new steps on the proposed expanded care cascade include (i) population screened, (ii) population linked to quality care, and (iii) population adhering to prescribed treatment.

Conclusion

There is little consensus on the definition of effective coverage of hypertension management services, and most studies do not describe the quality of hypertension management services provided to populations. Incorporating aspects of service quality to the hypertension care cascade allows for the calculation of quality-adjusted coverage of relevant services, enabling an appropriate measurement of health systems performance through effective coverage.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08190-0.

A rapid systematic review and evidence synthesis of effective coverage measures and cascades for childbirth, newborn and child health in low- and middle-income countries

BACKGROUND

Effective coverage measures aim to estimate the proportion of a population in need of a service that received a positive health outcome. In 2020, the Effective Coverage Think Tank Group recommended using a 'coverage cascade' for maternal, newborn, child and adolescent health and nutrition (MNCAHN), which organises components of effective coverage in a stepwise fashion, with each step accounting for different aspects of quality of care (QoC), applied at the population level. The cascade outlines six steps that increase the likelihood that the population in need experience the intended health benefit: 1) the population in need (target population) who contact a health service; 2) that has the inputs available to deliver the service; 3) who receive the health service; 4) according to quality standards; 5) and adhere to prescribed medication(s) or health workers instructions; and 6) experience the expected health outcome. We examined how effective coverage of life-saving interventions from childbirth to children aged nine has been defined and assessed which steps of the cascade are captured by existing measures.

METHODS

We undertook a rapid systematic review. Seven scientific literature databases were searched covering the period from May 1, 2017 to July, 8 2021. Reference lists from reviews published in 2018 and 2019 were examined to identify studies published prior to May 2017. Eligible studies reported population-level contact coverage measures adjusted for at least one dimension of QoC.

RESULTS

Based on these two search approaches this review includes literature published from 2010 to 2021. From 16 662 records reviewed, 33 studies were included, reporting 64 effective coverage measures. The most frequently examined measures were for childbirth and immediate newborn care (n = 24). No studies examined measures among children aged five to nine years. Definitions of effective coverage varied across studies. Key sources of variability included (i) whether a single effective coverage measure was reported for a package of interventions or separate measures were calculated for each intervention; (ii) the number and type of coverage cascade steps applied to adjust for QoC; and (iii) the individual items included in the effective coverage definition and the methods used to generate a composite quality measure.

CONCLUSION

In the MNCAHN literature there is substantial heterogeneity in both definitions and construction of effective coverage, limiting the comparability of measures over time and place. Current measurement approaches are not closely aligned with the proposed cascade. For widespread adoption, there is a need for greater standardisation of indicator definitions and transparency in reporting, so governments can use these measures to improve investments in MNACHN and implement life-saving health policies and programs.

From contact coverage to effective coverage of community care for patients with severe mental disorders: A real-world investigation from Italy

OBJECTIVES

To measure the gap between contact and effective coverage of mental healthcare (MHC).

MATERIALS AND METHODS

45,761 newly referred cases of depression, schizophrenia, bipolar disorder, and personality disorder from four Italian regions were included. A variant of the self-controlled case series method was adopted to estimate the incidence rate ratio (IRR) for the relationship between exposure (i.e., use of different types of MHC such as pharmacotherapy, generic contact with the outpatient services, psychosocial intervention, and psychotherapy) and relapse (emergency hospital admissions for mental illness).

RESULTS

11,500 relapses occurred. Relapse risk was reduced during periods covered by (i) psychotherapy for patients with depression (IRR 0.67; 95% CI: 0.49 to 0.91) and bipolar disorder (0.64; 0.29 to 0.99); (ii) psychosocial interventions for those with depression (0.74; 0.56 to 0.98), schizophrenia (0.83; 0.68 to 0.99), and bipolar disorder (0.55; 0.36 to 0.84), (iii) pharmacotherapy for patients with schizophrenia (0.58; 0.49 to 0.69), and bipolar disorder (0.59; 0.44 to 0.78). Coverage with generic care, in absence of psychosocial/psychotherapeutic interventions, did not affect risk of relapse.

CONCLUSION

This study ascertained the gap between contact and effective coverage of MHC and showed that administrative data can usefully contribute to assess the effectiveness of a mental health system.

Changes in Eye Health and Service Coverage in Nampula, Mozambique between 2011 and 2018

Purpose: Globally, there are few examples of repeated eye health surveys to assess changes in prevalence and causes of visual impairment, and service coverage over time. Two separate, unlinked rapid assessments of avoidable blindness (RAAB) were conducted in Nampula province, Mozambique in 2011 and 2018. This paper reports the observed changes and examines how the trends differ for males and females.Methods: Standard RAAB methodology was used in both studies. Two-stage cluster sampling was used to generate random samples of adults aged over 50 years. Participants underwent a simplified visual acuity (VA) exam, a lens exam and posterior segment exam using a direct ophthalmoscope for all subjects with presenting VA<6/18. Data were analysed using Stata and logistic regression models were developed to assess changes.Results: The 2011 study enrolled 3,050 people and examined 96.9% (2,954 people). The 2018 survey enrolled 4,191 people and examined 95.8% (4,015 people). Age- and sex-adjusted estimates of blindness decreased from 6.2% in 2011 to 4.5% in 2018 (z = -2.21, p = .028). Cataract surgical coverage was higher among males in both surveys (13.4% among males vs 7.7% among females in 2011, and 40.0% among males vs 19.4% among females in 2018) and the gender disparity grew between surveys.Conclusion: Significant changes were observed in the eye health and service coverage between 2011 and 2018. Further improvements to services are required to improve access for women and people with moderate visual impairment.

Cost and cost drivers associated with setting-up a prime vendor system to complement the national medicines supply chain in Tanzania

Introduction

Economic analysis of supply chain management interventions to improve the availability of healthcare commodities at healthcare facilities is important in generating evidence for decision-makers. The current study assesses the cost and cost drivers for setting-up a public-private partnership programme in Tanzania in which all public healthcare facility orders for complementary medicines are pooled at the district level, and then purchased from one contracted supplier, the prime vendor (referred to as ‘Jazia Prime Vendor System’ (Jazia PVS)).

Methods

Financial and economic costs of Jazia PVS were collected retrospectively and using the ingredients approach. The financial costs were spread over the implementation period of January 2014–July 2019. In addition, we estimated the financial rollout costs of Jazia PVS to the other 23 regions in the country over 2 years (2018–2019). A multivariate sensitivity analysis was conducted on the estimates.

Results

Jazia PVS start-up and recurrent financial costs amounted to US$2 170 989.74 and US$709 302.32, respectively. The main cost drivers were costs for short-term experts, training of staff and healthcare workers and the Jazia PVS technical and board management activities. The start-up financial cost per facility was US$2819.47 and cost per capita was US$0.37.

Conclusion

In conclusion, the study provides useful information on the cost and cost drivers for setting-up a complementary pharmaceutical supply system to complement an existing system in low-income settings. Despite the substantial costs incurred in the initial investment and operations of the Jazia PVS, the new framework is effective in achieving the desired purpose of improving availability of healthcare commodities.

Effective coverage measurement in maternal, newborn, child, and adolescent health and nutrition: progress, future prospects, and implications for quality health systems

Intervention coverage-the proportion of the population with a health-care need who receive care-does not account for intervention quality and potentially overestimates health benefits of services provided to populations. Effective coverage introduces the dimension of quality of care to the measurement of intervention coverage. Many definitions and methodological approaches to measuring effective coverage have been developed, resulting in confusion over definition, calculation, interpretation, and monitoring of these measures. To develop a consensus on the definition and measurement of effective coverage for maternal, newborn, child, and adolescent health and nutrition (MNCAHN), WHO and UNICEF convened a group of experts, the Effective Coverage Think Tank Group, to make recommendations for standardising the definition of effective coverage, measurement approaches for effective coverage, indicators of effective coverage in MNCAHN, and to develop future effective coverage research priorities. Via a series of consultations, the group recommended that effective coverage be defined as the proportion of a population in need of a service that resulted in a positive health outcome from the service. The proposed effective coverage measures and care cascade steps can be applied to further develop effective coverage measures across a broad range of MNCAHN services. Furthermore, advances in measurement of effective coverage could improve monitoring efforts towards the achievement of universal health coverage.

A Meta-summarization of Qualitative Findings About Health Systems Performance Evaluation Models: Conceptual Problems and Comparability Limitations

Due to the replacement of the issue of performance measurement in health policies worldwide this study identifies and analyzes the models for evaluating health systems performance. For this purpose, a systematic review of the literature on the topic "health systems performance evaluation" is done, making it compatible with a qualitative meta-synthesis of the type "meta-summarization." It works with all databases related to the theme (PubMed, Scopus, EMBASE, PubAdm and Lilacs/Scielo). Portuguese, English, and Spanish are elected as language limit. Of the total number of articles (n = 32), 23 articles (71.8%) do not have a definition on "performance." In those who have a definition, "performance" could be summed up in 6 central ideas. Among the most frequent subsidiary concepts that makes up the performance idea are the concepts of "efficiency" (11.9%), "quality" (9.5%) and "effectiveness" (7.1%). Six models were found in this review: "dashboard," "balanced scorecard," "open system model," "PCATool," "analyze dimension and performance indicators" and "standardized checklist and interview." The "dashboard" was the most frequent performance evaluation model, found in 35.7% of studies. Only 25% of the reviewed studies presented the performance evaluation model applied specifically to health systems. Far from being configured as management tools useful to comprehension of health systems, these performance evaluation models have shortcomings that compromise their systemic evaluative power. This reinforces the inversion of reality in the relationship between quality and performance. Also, the performance evaluation models used try to adapt to the object, however in most them with relevant analytical problems compromising the specificities in depth of the health system under analysis. This generates inaccuracies and replaces the question about its use and their limitations to compare health systems.

Quality of TB care among people living with HIV: Gaps and solutions

Tuberculosis (TB) is the leading infectious cause of death among people living with HIV, causing one third of AIDS-related deaths globally. The concerning number of missing TB cases, ongoing high TB mortality, slow reduction in TB incidence, and limited uptake of TB preventive treatment among people living with HIV, all indicate the urgent need to improve quality of TB services within HIV programs. In this mini-review we discuss major gaps in quality of TB care that impede achieving prevention and treatment targets within the TB-HIV care cascades, show approaches of assessing gaps in TB service provision, and describe outcomes from innovative quality improvement projects among HIV and TB programs. We also offer recommendations for measuring quality of TB care.

Psychometric properties of primary health care trust questionnaire

Background

Trust has been introduced as the cornerstone of the public and health providers’ relation. Public trust in primary health care (PHC) is crucial and must be measured. The aim of this study was to develop and validate PHC trust measurement tool.

Methods

This was a psychometric study to develop PHC trust measuring tool done in Tabriz, East-Azerbaijan with participation of 600 households in 2016. Item generation was done through literature review and experts opinions. The content validity, reliability and construct validity of the PHC trust tool were assessed using several statistical methods including modified Kappa, Kendall’s Tau and intra-class correlation coefficient (ICC) as well as exploratory factor analysis (EFA). Data were analyzed using STATA 14 statistical software package.

Results

A 30-item questionnaire was developed. The Modified Kappa coefficient as an indicator of content validity assessment was 0.94. With respect to reliability assessment, a high internal consistency was observed with 0.98 Cronbach-Alpha score and the test–retest reliability for overall scale (assessed by ICC) was 0.94 (CI: 0.87–0.97). Exploratory factor analysis emerged 2 factors. Factor 1 consisted of 25 items accounting for 74.1% of the variance (eigenvalue = 22.47) followed by Factor 2 consisting of 5 items accounting for 19.2% of the variance (eigenvalue = 1.6).

Conclusion

PHC trust measuring tool could be used as a valid and reliable tool by health systems in Iran and similar contexts to investigate how they are trustful from the public viewpoint.

Electronic supplementary material

The online version of this article (10.1186/s12913-019-4340-6) contains supplementary material, which is available to authorized users.

Developing Iranian primary health care quality framework: a national study

BACKGROUND

Providing comprehensive and high-quality services is one of the most important goals of the health systems and a basic principle for Universal Health Coverage (UHC). Fulfilling this important task would be feasible through continuous evaluation and improvement of the health services quality. The aim of this study was to develop a framework for quality assessment of Primary Health Care (PHC) in Iran's health system.

METHODS

This study is a literature review which continued by a qualitative research. The extracted quality dimensions and indicators for initial screening were reviewed and discussed in two panel meetings attended by the experts with regard to the current package of health system in Iran. Using Delphi method, the dimensions and Quality Indicators(QIs) were evaluated and approved by 39 national health professionals in two rounds. Finally, after 4 panel sessions at ministerial level, the selected QIs were categorized in form of the final dimensions of the quality of care.

RESULTS

The literature review emerged 13 Primary Health Care Quality Assessment Frameworks (PHCQAF) including 20 and 698 QIs. Delphi study resulted in developing Iranian PHCQAF comprising 7 dimensions and 40 QIs. Among these, 8 QIs of the dimension of access and equity, 5 QIs of safety dimension, 2 QIs of efficiency dimension, 13 QIs of effectiveness dimension, 2 QIs of patient-centeredness dimension, 3 QIs of governance dimension and 7 QIs of appropriateness dimension were presented.

CONCLUSIONS

The presented PHCQAF can be used as a comprehensive and practical tool for continuous improvement of the quality of PHC services at local, national and regional levels. Moreover, it can give some useful information to the health managers and policy makers on how the services are provided.

Monitoring Frameworks for Universal Health Coverage: What About High-Income Countries?

Implementing universal health coverage (UHC) is widely perceived to be central to achieving the Sustainable Development Goals (SDGs), and is a work program priority of the World Health Organization (WHO). Much has already been written about how low- and middle-income countries (LMICs) can monitor progress towards UHC, with various UHC monitoring frameworks available in the literature. However, we suggest that these frameworks are largely irrelevant in high-income contexts and that the international community still needs to develop UHC monitoring framework meaningful for high-income countries (HICs). As a first step, this short communication presents preliminary findings from a literature review and document analysis on how various countries monitor their own progress towards achieving UHC. It furthermore offers considerations to guide meaningful UHC monitoring and reflects on pertinent challenges and tensions to inform future research on UHC implementation in HIC settings.

Effective coverage of facility delivery in Bangladesh, Haiti, Malawi, Nepal, Senegal, and Tanzania

Background

The persistence of preventable maternal and newborn deaths highlights the importance of quality of care as an essential element in coverage interventions. Moving beyond the conventional measurement of crude coverage, we estimated effective coverage of facility delivery by adjusting for facility preparedness to provide delivery services in Bangladesh, Haiti, Malawi, Nepal, Senegal, and Tanzania.

Methods

The study uses data from Demographic and Health Surveys (DHS) and Service Provision Assessments (SPA) in Bangladesh (2014 DHS and 2014 SPA), Haiti (2012 DHS and 2013 SPA), Malawi (2015–16 DHS and 2013–14 SPA), Nepal (2016 DHS and 2015 SPA), Senegal (2016 DHS and 2015 SPA), and Tanzania (2015–16 DHS and 2014–15 SPA). We defined effective coverage as the mathematical product of crude coverage and quality of care. The coverage of facility delivery was measured with DHS data and quality of care was measured with facility data from SPA. We estimated effective coverage at both the regional and the national level and accounted for type of facility where delivery care was sought.

Findings

The findings from the six countries indicate the effective coverage ranges from 24% in Haiti to 66% in Malawi, representing substantial reductions (20% to 39%) from crude coverage rates. Although Malawi has achieved almost universal coverage of facility delivery (93%), effective coverage was only 66%.vSuch gaps between the crude coverage and the effective coverage suggest that women delivered in health facility but did not necessarily receive an adequate quality of care. In all countries except Malawi, effective coverage differed substantially among the country’s regions of the country, primarily due to regional variability in coverage.

Interpretation

Our findings reinforce the importance of quality of obstetric and newborn care to achieve further reduction of maternal and newborn mortality. Continued efforts are needed to increase the use of facility delivery service in countries or regions where coverage remains low.