Evaluating the use of locally-based health facility assessments in Afghanistan: a pilot study of a novel research method

Development of a multidimensional culturally and socially inclusive measure of factors that support resilience: Child Resilience Questionnaire-Child report (CRQ-C)-a community-based participatory research and psychometric testing study in Australia

OBJECTIVE

Development and testing of a comprehensive and social and culturally inclusive child-report measure of resilience factors supporting positive outcomes in the face of adversity.

DESIGN

The measure is based on a socioecological model of resilience and was developed and revised using community-based participatory research methods with Aboriginal and refugee background communities. Pilot testing and validation of the child-report version (Child Resilience Questionnaire-Child report (CRQ- C)) is described in this paper.

SETTING

Australia.

PARTICIPANTS

Children aged 7-12 years from culturally and socially diverse backgrounds completed the CRQ- C in the pilot (n=387) and validation study (n=775). Families recruited via hospital clinics, Aboriginal and refugee background communities and nested follow-up of participants in an existing cohort study.

ANALYSIS

The factor structure and construct validity of CRQ-C scales were assessed using exploratory and confirmatory factor analyses. Preliminary assessment of criterion validity was conducted usinghe Strengths and Difficulties Questionnaire (SDQ). Internal consistency of final scales was assessed using Cronbach's alpha.

RESULTS

Conceptually developed CRQ-C was over inclusive of resilience factors and items. Exploratory factor analyses and confirmatory factor analyses supported 10 subscales reflecting personal resilience factors (positive self/future, managing emotions) and connectedness to family, school and culture. Excellent scale reliability (α=0.7-0.9) for all but one scale (Friends, α=0.6). Significant negative correlation between CRQ-C and SDQ total difficulty score supporting criterion validity (r_s=-0.317, p<0.001).

CONCLUSION

The CRQ-C is a new culturally and socially inclusive self-report measure of resilience factors in childhood, with demonstrated content, construct and scale reliability. Further testing of criterion validity required. Availability of child and parent report CRQ supports broad applications in clinical, research and intervention work. Socially inclusive and culturally appropriate tools are fundamental to create the evidence needed to assess and guide intervention efforts.

How to Engage Health Care Workers in the Evaluation of Hospitals: Development and Validation of BSC-HCW1-A Cross-Sectional Study

Organizations worldwide utilize the balanced scorecard (BSC) for their performance evaluation (PE). This research aims to provide a tool that engages health care workers (HCWs) in BSC implementation (BSC-HCW1). Additionally, it seeks to translate and validate it at Palestinian hospitals. In a cross-sectional study, 454 questionnaires were retrieved from 14 hospitals. The composite reliability (CR), interitem correlation (IIC), and corrected item total correlation (CITC) were evaluated. Exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) were used. In both EFA and CFA, the scale demonstrated a good level of model fit. All the items had loadings greater than 0.50. All factors passed the discriminant validity. Although certain factors' convergent validity was less than 0.50, their CR, IIC, and CITC were adequate. The final best fit model had nine factors and 28 items in CFA. The BSC-HCW1 is the first self-administered questionnaire to engage HCWs in assessing the BSC dimensions following all applicable rules and regulations. The findings revealed that this instrument's psychometric characteristics were adequate. Therefore, the BSC-HCW1 can be utilized to evaluate BSC perspectives and dimensions. It will help managers highlight which BSC dimension predicts HCW satisfaction and loyalty and examine differences depending on HCWs' and hospital characteristics.

Assessing Patient Experience and Attitude: BSC-PATIENT Development, Translation, and Psychometric Evaluation-A Cross-Sectional Study

Health care organizations (HCO) did not consider engaging patients in balanced scorecard (BSC) implementations to evaluate their performance. This paper aims to develop an instrument to engage patients in assessing BSC perspectives (BSC-PATIENT) and customize it for Palestinian hospitals. Two panels of experts participated in the item generation of BSC-PATIENT. Translation was performed based on guidelines. Pretesting was performed for 30 patients at one hospital. Then, 1000 patients were recruited at 14 hospitals between January and October 2021. Construct validity was tested through exploratory factor analysis (EFA) and confirmatory factor analysis (CFA). Additionally, the composite reliability (CR), interitem correlation (IIC), and corrected item total correlation (CITC) were assessed to find redundant and low correlated items. As a result, the scales had a highly adequate model fit in the EFA and CFA. The final best fit model in CFA comprised ten constructs with 36 items. In conclusion, BSC-PATIENT is the first self-administered questionnaire specifically developed to engage patients in BSC and will allow future researchers to evaluate the impact of patient experience on attitudes toward BSC perspectives, as well as to compare the differences based on patient and hospital characteristics.

The process of developing health workforce strategic plans in Africa: a document analysis

BACKGROUND

Many countries are faced with a multitude of health workforce-related challenges partly attributed to defective health workforce planning. Earlier efforts to guide the process and harmonise approaches to national health workforce policies and planning in the Africa Region included, among others, the development of the WHO Africa Regional Office (WHO/AFRO) Policies and Plans for Human Resources for Health Guidelines for Countries in the WHO African Region in 2006. Although this guideline has led to uniformity and rigour in developing human resources for health (HRH) policies and strategies in Africa, it has become imperative to synthesise the emerging evidence and best practices in the development of health workforce strategies.

METHODS

A document analysis was conducted using the READ ( R eadying materials; E xtracting data; A nalysing data and D istilling) approach.

RESULTS

Fourteen HRH policy/strategic plans were included in the study. The scope of the HRH strategic plans was described in three dimensions: the term of the strategy, sectors covered by the strategy and the health workforce considered in the projections. We found that HRH strategic plan development can be conceptualised as a cyclical, sequential multimethod project, with one phase feeding the subsequent phase with data or instructions. The process is very complex, with different interest groups and sectors that need to be satisfied. The HRH strategic plan development process comprises five main phases linked with external forces and national politics.

CONCLUSION

There is a need for accurate and comprehensive HRH data collection, astute HRH leadership, and broad base and multisectoral stakeholder consultation with technical support and guidance from experts and major external partners for effective HRH strategic plan development.

A systematic review: the dimensions to evaluate health care performance and an implication during the pandemic

BACKGROUND

The balanced scorecard (BSC) has been implemented to evaluate the performance of health care organizations (HCOs). BSC proved to be effective in improving financial performance and patient satisfaction.

AIM

This systematic review aims to identify all the perspectives, dimensions, and KPIs that are vital and most frequently used by health care managers in BSC implementations.

METHODS

This systematic review adheres to PRISMA guidelines. The PubMed, Embase, Cochrane, and Google Scholar databases and Google search engine were inspected to find all implementations of BSC at HCO. The risk of bias was assessed using the nonrandomized intervention studies (ROBINS-I) tool to evaluate the quality of observational and quasi-experimental studies and the Cochrane (RoB 2) tool for randomized controlled trials (RCTs).

RESULTS

There were 33 eligible studies, of which we identified 36 BSC implementations. The categorization and regrouping of the 797 KPIs resulted in 45 subdimensions. The reassembly of these subdimensions resulted in 13 major dimensions: financial, efficiency and effectiveness, availability and quality of supplies and services, managerial tasks, health care workers' (HCWs) scientific development error-free and safety, time, HCW-centeredness, patient-centeredness, technology, and information systems, community care and reputation, HCO building, and communication. On the other hand, this review detected that BSC design modification to include external and managerial perspectives was necessary for many BSC implementations.

CONCLUSION

This review solves the KPI categorization dilemma. It also guides researchers and health care managers in choosing dimensions for future BSC implementations and performance evaluations in general. Consequently, dimension uniformity will improve the data sharing and comparability among studies. Additionally, despite the pandemic negatively influencing many dimensions, the researchers observed a lack of comprehensive HCO performance evaluations. In the same vein, although some resulting dimensions were assessed separately during the pandemic, other dimensions still lack investigation. Last, BSC dimensions may play an essential role in tackling the COVID-19 pandemic. However, further research is required to investigate the BSC implementation effect in mitigating the pandemic consequences on HCO.

Eliminating malaria in conflict zones: public health strategies developed in the Sri Lanka Civil War

Despite the 26-year long civil war, Sri Lanka was declared malaria-free by WHO in 2016. This achievement was the result of nearly 30 years of elimination efforts following the last significant resurgence of malaria cases in Sri Lanka. The resurgence occurred in 1986–1987, when about 600 000 cases of malaria were detected. Obstacles to these efforts included a lack of healthcare workers in conflict zones, a disruption of vector control efforts, gaps in the medication supply chain, and rising malaria cases among the displaced population.

This article seeks to describe the four strategies deployed in Sri Lanka to mitigate the aforementioned obstacles to ultimately achieve malaria elimination. The first approach was the support for disease elimination by the government of Sri Lanka and the Liberation Tamil Tigers of Elam. The second strategy was the balance of centralised leadership of the federal government and the decentralised programme operation at the regional level. The third strategy was the engagement of non-governmental stakeholders to fill in gaps left by the conflict to continue the elimination efforts. The last strategy is the ongoing efforts by the government, military and non-profit organisations to prevent the reintroduction of malaria.

The lessons learnt from Sri Lanka have important implications for malaria-endemic nations that are in conflict such as Ethiopia, Afghanistan, Yemen and Somalia. To accomplish the World Health Assembly goal of reducing the global incidence and mortality of malaria by 90% by 2030, significant efforts are required to lessen the disease burden in conflict zones. In addition to the direct impacts of conflict on population health, conflicts may lead to increased risk of spread of malaria, both within a country and consequently, abroad.

Opportunities to catalyse improved healthcare access in pluralistic systems: a cross-sectional study in Haiti

OBJECTIVE

To identify determinants of intended versus actual care-seeking behaviours in a pluralistic healthcare system that is reliant on both conventional and non-conventional providers and discover opportunities to catalyse improved healthcare access.

DESIGN

Cross-sectional study.

SETTING AND PARTICIPANTS

In Haiti 568 households (incorporating 2900 members) with children less than 5 years of age were randomly sampled geographically with stratifications for population density. These households identified the healthcare providers they frequented. Among 140 providers, 65 were located and enrolled.

OUTCOME MEASURES

Household questionnaires with standardised cases (intentions) were compared with self-recall of health events (behaviours). The connectedness of households and their providers was determined by network analysis.

RESULTS

Households reported 636 health events in the prior month. Households sought care for 35% (n=220) and treated with home remedies for 44% (n=277). The odds of seeking care increased 217% for severe events (adjusted OR (aOR)=3.17; 95% CI 1.99 to 5.05; p<0.001). The odds of seeking care from a conventional provider increased by 37% with increasing distance (aOR=1.37; 95% CI 1.06 to 1.79; p=0.016). Despite stating an intention to seek care from conventional providers, there was a lack of congruence in practice that favoured non-conventional providers (McNemar's χ² test p<0.001). Care was sought from primary providers for 68% (n=150) of cases within a three-tiered network; 25% (n=38/150) were non-conventional.

CONCLUSION

Addressing geographic barriers, possibly with technology solutions, should be prioritised to meet healthcare seeking intentions while developing approaches to connect non-conventional providers into healthcare networks when geographic barriers cannot be overcome.

Overview of attacks against civilian infrastructure during the Syrian civil war, 2012-2018

BACKGROUND

Hundreds of thousands of people have been killed during the Syrian civil war and millions more displaced along with an unconscionable amount of destroyed civilian infrastructure.

METHODS

We aggregate attack data from Airwars, Physicians for Human Rights and the Safeguarding Health in Conflict Coalition/Insecurity Insight to provide a summary of attacks against civilian infrastructure during the years 2012-2018. Specifically, we explore relationships between date of attack, governorate, perpetrator and weapon for 2689 attacks against five civilian infrastructure classes: healthcare, private, public, school and unknown. Multiple correspondence analysis (MCA) via squared cosine distance, k-means clustering of the MCA row coordinates, binomial lasso classification and Cramer's V coefficients are used to produce and investigate these correlations.

RESULTS

Frequencies and proportions of attacks against the civilian infrastructure classes by year, governorate, perpetrator and weapon are presented. MCA results identify variation along the first two dimensions for the variables year, governorate, perpetrator and healthcare infrastructure in four topics of interest: (1) Syrian government attacks against healthcare infrastructure, (2) US-led Coalition offensives in Raqqa in 2017, (3) Russian violence in Aleppo in 2016 and (4) airstrikes on non-healthcare infrastructure. These topics of interest are supported by results of the k-means clustering, binomial lasso classification and Cramer's V coefficients.

DISCUSSION

Findings suggest that violence against healthcare infrastructure correlates strongly with specific perpetrators. We hope that the results of this study provide researchers with valuable data and insights that can be used in future analyses to better understand the Syrian conflict.

Factors influencing performance by contracted non-state providers implementing a basic package of health services in Afghanistan

BACKGROUND

In 2002 Afghanistan's Ministry of Public Health (MoPH) and its development partners initiated a new paradigm for the health sector by electing to Contract-Out (CO) the Basic Package of Health Services (BPHS) to non-state providers (NSPs). This model is generally regarded as successful, but literature is scarce that examines the motivations underlying implementation and factors influencing program success. This paper uses relevant theories and qualitative data to describe how and why contracting out delivery of primary health care services to NSPs has been effective. The main aim of this study was to assess the contextual, institutional, and contractual factors that influenced the performance of NSPs delivering the BPHS in Afghanistan.

METHODS

The qualitative study design involved individual in-depth interviews and focus group discussions conducted in six provinces of Afghanistan, as well as a desk review. The framework for assessing key factors of the contracting mechanism proposed by Liu et al. was utilized in the design, data collection and data analysis.

RESULTS

While some contextual factors facilitated the CO (e.g. MoPH leadership, NSP innovation and community participation), harsh geography, political interference and insecurity in some provinces had negative effects. Contractual factors, such as effective input and output management, guided health service delivery. Institutional factors were important; management capacity of contracted NSPs affects their ability to deliver outcomes. Effective human resources and pharmaceutical management were notable elements that contributed to the successful delivery of the BPHS. The contextual, contractual and institutional factors interacted with each other.

CONCLUSION

Three sets of factors influenced the implementation of the BPHS: contextual, contractual and institutional. The MoPH should consider all of these factors when contracting out the BPHS and other functions to NSPs. Other fragile states and countries emerging from a period of conflict could learn from Afghanistan's example in contracting out primary health care services, keeping in mind that generic or universal contracting policies might not work in all geographical areas within a country or between countries.

Conflict, displacement and sexual and reproductive health services in Mali: analysis of 2013 health resources availability mapping system (HeRAMS) survey

OBJECTIVE

Little is known specifically about the effects of conflict and displacement on provision of sexual and reproductive health (SRH) services. We aimed to understand the association between levels of conflict and displacement and the availability of SRH services in post-conflict Mali.

METHODS

A national assessment was conducted between April and May 2013 employing Health Systems Availability Mapping System (HeRAMS). Data from 1581 primary care facilities were analysed, focusing on SRH services. Descriptive analyses and multivariable logistic regression models were used to examine the availability of SRH services by different levels of conflict and displacement.

FINDINGS

Of 1581 facilities, 1551 had data available to identify the details of service provision. The majority of the facilities were part of the public sector (79.1 %), identified as basic community primary care facilities (71.9 %). Overall 15.7 % of the facilities were in the zones under occupation, 40.3 % in the areas with high concentration of displaced population and 44 % in areas with low concentration of displaced populations. Between zones of low concentration of displaced populations and under occupation the likelihood of service availability varied between OR: 2.9 (95 % CI 2.0-4.4) for basic emergency obstetric care and OR: 41.7 (95 % CI 20.4-85.3) for family planning. All of the services within the three domains of SRH were more likely to be available in the low and high concentration displaced population areas compared to the facilities in the under occupation zones, after adjusting for other facility-related variables.

CONCLUSION

Areas with high concentration of displaced population had less service availability, and areas formerly under occupation had the least service availability. This suggests that those living in conflict areas, and many of those who are internally displaced, have poor access to essential SRH interventions. The systematic measurement of the availability of health services, including SRH, is feasible and can contribute to recovery planning in post-conflict and humanitarian settings.

Assessments of health services availability in humanitarian emergencies: a review of assessments in Haiti and Sudan using a health systems approach

Background

Assessing the availability of health services during humanitarian emergencies is essential for understanding the capacities and weaknesses of disrupted health systems. To improve the consistency of health facilities assessments, the World Health Organization has proposed the use of the Health Resources Availability Mapping System (HeRAMS) developed in Darfur, Sudan as a standardized assessment tool for use in future acute and protracted crises. This study provides an evaluation of HeRAMS’ comprehensiveness, and investigates the methods, quality and comprehensiveness of health facilities data and tools in Haiti, where HeRAMS was not used.

Methods and findings

Tools and databases containing health facilities data in Haiti were collected using a snowball sampling technique, while HeRAMS was purposefully evaluated in Sudan. All collected tools were assessed for quality and comprehensiveness using a coding scheme based on the World Health Organization’s health systems building blocks, the Global Health Cluster Suggested Set of Core Indicators and Benchmarks by Category, and the Sphere Humanitarian Charter and Minimum Standards in Humanitarian Response.

Eight assessments and databases were located in Haiti, and covered a median of 3.5 of the 6 health system building blocks, 4.5 of the 14 Sphere standards, and 2 of the 9 Health Cluster indicators. None of the assessments covered all of the indicators in any of the assessment criteria and many lacked basic data, limiting the detail of analysis possible for calculating standardized benchmarks and indicators.

In Sudan, HeRAMS collected data on 5 of the 6 health system building blocks, 13 of the 14 Sphere Standards, and collected data to allow the calculation of 7 of the 9 Health Cluster Core Indicators and Benchmarks.

Conclusions

There is a need to agree upon essential health facilities data in disrupted health systems during humanitarian emergencies. Although the quality of the assessments in Haiti was generally poor, the large number of platforms and assessment tools deployed suggests that health facilities data can be collected even during acute emergencies. Further consensus is needed to establish essential criteria for data collection and to establish a core group of health systems assessment experts to be deployed during future emergencies.