Outreach training and supportive supervision for malaria case management in Zambia: the effects of focused capacity building on indicators of diagnostic and clinical performance

Can Outreach Training and Supportive Supervision Improve Competency in Malaria Service Delivery? An Evaluation in Cameroon, Ghana, Niger, and Zambia

Outreach Training and Supportive Supervision (OTSS) of malaria services at health facilities has been adopted by numerous malaria-endemic countries. The OTSS model is characterized by a hands-on method to enhance national guidelines and supervision tools, train supervisors, and perform supervision visits. An independent evaluation was conducted to evaluate the effectiveness of OTSS on health worker competence in the clinical management of malaria, parasitological diagnosis, and prevention of malaria in pregnancy. From 2018 to 2021, health facilities in Cameroon, Ghana, Niger, and Zambia received OTSS visits during which health workers were observed directly during patient consultations, and supervisors completed standardized checklists to assess their performance. Mixed-effects logistic regression models were developed to assess the impact of increasing OTSS visit number on a set of eight program-generated outcome indicators, including overall competency and requesting a confirmatory malaria test appropriately. Seven of eight outcome indicators showed evidence of beneficial effects of increased OTSS visits. Odds of health workers reaching competency thresholds for the malaria-in-pregnancy checklist increased by more than four times for each additional OTSS visit (odds ratio [OR], 4.62; 95% CI, 3.62-5.88). Each additional OTSS visit was associated with almost four times the odds of the health worker foregoing antimalarial prescriptions for patients who tested negative for malaria (OR, 3.80; 95% CI, 2.35-6.16). This evaluation provides evidence that successive OTSS visits result in meaningful improvements in indicators linked to quality case management of patients attending facilities for malaria diagnosis and treatment, as well as quality malaria prevention services received by women attending antenatal services.

Use of Supervision Data to Improve Quality of Care for Malaria in Pregnancy: Experience in Six African Countries

Malaria in pregnancy (MiP) intervention coverage, especially intermittent preventive treatment in pregnancy (IPTp), lags behind other global malaria indicators. In 2020, across Africa, only 32% of eligible pregnant women received at least three IPTp doses, despite high antenatal care attendance. We conducted a secondary analysis of data collected during Outreach Training and Supportive Supervision visits from 2019 to 2020 to assess quality of care and explore factors contributing to providers' competence in providing IPTp, insecticide-treated nets, malaria case management, and respectful maternity care. Data were collected during observations of provider-patient interactions in six countries (Cameroon, Cote d'Ivoire, Ghana, Kenya, Mali, and Niger). Competency scores (i.e., composite scores of supervisory checklist observations) were calculated across three domains: MiP prevention, MiP treatment, and respectful maternity care. Scores are used to understand drivers of competency, rather than to assess individual health worker performance. Country-specific multilinear regressions were used to assess how competency score was influenced by commodity availability, training, provider gender and cadre, job aid availability, and facility type. Average competency scores varied across countries: prevention (44-90%), treatment (78-90%), and respectful maternity care (53-93%). The relative association of each factor with competency score varied. Commodity availability, training, and access to job aids correlated positively with competency in multiple countries. To improve MiP service quality, equitable access to training opportunities for different cadres, targeted training, and access to job aids and guidelines should be available for providers. Collection and analysis of routine supervision data can support tailored actions to improve quality MiP services.

Outreach Training and Supportive Supervision for Quality Malaria Service Delivery: A Qualitative Evaluation in 11 Sub-Saharan African Countries

Quality improvement of malaria services aims to ensure that more patients receive accurate diagnosis, appropriate treatment, and referral. The Outreach Training and Supportive Supervision Plus (OTSS+) approach seeks to improve health facility readiness and provider competency through onsite supportive supervision, troubleshooting, and on-the-job training. As part of a multicomponent evaluation, qualitative research was conducted to understand the value of the OTSS+ approach for malaria quality improvement. Semistructured key informant interviews, focus group discussions, and structured health facility-based interviews were used to gather stakeholder perspectives at subnational, national, and global levels. Data were collected globally and in 11 countries implementing OTSS+; in-depth data collection was done in four: Cameroon, Ghana, Niger, and Zambia. Study sites and participants were selected purposively. Verbatim transcripts were analyzed thematically, following the Framework approach. A total of 262 participants were included in the analysis; 98 (37.4%) were supervisees, 99 (37.8%) were supervisors, and 65 (24.8%) were other stakeholders. The OTSS+ approach was perceived to improve provider knowledge and skills in malaria service delivery and to improve data and supply management indirectly. Improvements were attributed to a combination of factors. Participants valued the relevance, adaptation, and digitization of supervision checklists; the quality and amount of contact with problem-solving supervisors; and the joint identification of problems and solutions, and development of action plans. Opportunities for improvement were digitized checklist refinement, assurance of a sufficient pool of supervisors, prioritization of health facilities, action plan dissemination and follow-up, and data review and use. The OTSS+ approach was perceived to be a useful quality improvement approach for malaria services.

The U.S. President's Malaria Initiative's Support for Improving the Quality of Malaria Case Management Services: Fifteen Years of Progress and Learning

Since its launch in 2005, the U.S. President's Malaria Initiative's (PMI) investment in malaria case management has evolved based on lessons learned from its support to countries. An initial focus on updating malaria treatment policies to adopt artemisinin-based combination therapies achieved limited success, in part because of the poor quality of diagnostic and treatment services in targeted countries. In response, the PMI supported the development, refinement, and expansion of Outreach Training and Supportive Supervision (OTSS), a quality improvement approach that combines structured, competency-based supervision with corrective measures, including on-the-job training, coaching, troubleshooting, action planning, and timely follow-up. With 15 years of experience, the OTSS approach has been adopted by more than a dozen countries, and its effectiveness in improving the quality of malaria case management services has been documented. Through the PMI Impact Malaria Project, launched in 2018, the OTSS approach was expanded beyond case management of uncomplicated malaria to support quality improvement of inpatient management of severe malaria and malaria in pregnancy services delivered through antenatal care clinics. The OTSS platform also enabled targeted countries to respond rapidly to the COVID-19 pandemic by adding modules related to clinical management and laboratory diagnosis of suspected cases. The OTSS approach has been established as an effective approach to improve the quality of clinical malaria services and can be expanded to cover other health priorities. Further innovations to improve the quality of inpatient and community-based services, and further integration and institutionalization of OTSS into country health systems are needed.

Clinical Outreach Training and Supportive Supervision Quality-of-Care Analysis: Impact of Readiness Factors on Health Worker Competencies in Malaria Case Management in Cameroon, Mali, and Niger

Improving the quality of malaria clinical case management in health facilities is key to improving health outcomes in patients. The U.S. President's Malaria Initiative Impact Malaria Project has supported implementation of the Outreach Training and Supportive Supervision (OTSS) approach in 11 African countries to improve the quality of malaria care in health facilities through the collection and analysis of observation-based data on health facility readiness and health provider competency in malaria case management. We conducted a secondary analysis of longitudinal data collected during routine supervision in Cameroon (April 2021-March 2022), Mali (October 2020-December 2021), and Niger (November 2020-September 2021) using digitized checklists to assess how service readiness affects health worker competencies in managing patients with fever correctly and providing those with confirmed uncomplicated malaria cases with appropriate treatment and referral. Linear or logistic regression analyses were conducted to assess the effect of facility readiness and its components on observed health worker competencies. All countries demonstrated significant associations between health facility readiness and malaria case management competencies. Data from three rounds of OTSS visits in Cameroon, Mali, and Niger showed a statistically significant positive association between greater facility readiness scores (including the availability of commodities, materials, and trained staff) and health worker competency in case management. These findings provide evidence that health worker performance is likely affected by the tools and training available to them. These results reinforce the need for necessary tools and properly trained staff if high-quality malaria case management services are to be delivered at health facilities.

Improving Malaria Case Management and Referral Relationships at the Primary Care Level in Ghana: Evaluation of a Quality Assurance Internship

In Ghana, Community-based Health Planning and Services (CHPS) compounds managed by trained nurses and midwives called community health officers (CHOs) play a major role in malaria service delivery. With heavy administrative burdens and minimal training in providing patient care, particularly for febrile illnesses, including malaria, CHOs struggle to comply with the World Health Organization's test, treat, and track initiative guidelines and appropriate referral practices. A clinical training and mentorship program was implemented for CHOs to prevent and manage uncomplicated malaria and offer appropriate pre-referral treatment and referrals to district hospitals. Medical officers, pharmacists, midwives, health information officers, and medical laboratory scientists at 52 district referral hospitals were trained as mentors; CHOs from 520 poorly performing CHPS compounds underwent a 5-day internship at their assigned district referral hospital to improve knowledge and clinical skills for malaria case management. Three months later, mentors conducted post-training mentoring visits to assess knowledge and skill retention and provide ongoing on-the-job guidance. Significant percentage-point increases were observed immediately post-internship for history taking (+12.0, 95% confidence interval [CI]=8.3, 15.1; P<.001); fever assessment (+24.9, 95% CI=20.9, 29.3; P<.001); severe malaria assessment and referral (+32.0, 95% CI=28.2, 35.8; P<.001); and knowledge assessment (+15.8, 95% CI=10.0, 21.3; P<.001). Three months later, a third assessment revealed these gains were largely maintained. Analysis of national health management information system data showed statistically significant improvements in testing, treatment, and referral indicators at intervention CHPS compounds after the intervention that were not observed in comparison CHPS compounds. This training and mentorship approach offers a replicable model to build primary care provider competencies in malaria prevention and management and demonstrates how developing relationships between primary care and first-level referral facilities benefits both providers and clients. More methodologically rigorous studies are needed to measure the impact of this approach.

Real-time, spatial decision support to optimize malaria vector control: The case of indoor residual spraying on Bioko Island, Equatorial Guinea

Public health interventions require evidence-based decision-making to maximize impact. Spatial decision support systems (SDSS) are designed to collect, store, process and analyze data to generate knowledge and inform decisions. This paper discusses how the use of a SDSS, the Campaign Information Management System (CIMS), to support malaria control operations on Bioko Island has impacted key process indicators of indoor residual spraying (IRS): coverage, operational efficiency and productivity. We used data from the last five annual IRS rounds (2017 to 2021) to estimate these indicators. IRS coverage was calculated as the percentage of houses sprayed per unit area, represented by 100x100 m map-sectors. Optimal coverage was defined as between 80% and 85%, and under and overspraying as coverage below 80% and above 85%, respectively. Operational efficiency was defined as the fraction of map-sectors that achieved optimal coverage. Daily productivity was expressed as the number of houses sprayed per sprayer per day (h/s/d). These indicators were compared across the five rounds. Overall IRS coverage (i.e. percent of total houses sprayed against the overall denominator by round) was highest in 2017 (80.2%), yet this round showed the largest proportion of oversprayed map-sectors (36.0%). Conversely, despite producing a lower overall coverage (77.5%), the 2021 round showed the highest operational efficiency (37.7%) and the lowest proportion of oversprayed map-sectors (18.7%). In 2021, higher operational efficiency was also accompanied by marginally higher productivity. Productivity ranged from 3.3 h/s/d in 2020 to 3.9 h/s/d in 2021 (median 3.6 h/s/d). Our findings showed that the novel approach to data collection and processing proposed by the CIMS has significantly improved the operational efficiency of IRS on Bioko. High spatial granularity during planning and deployment together with closer follow-up of field teams using real-time data supported more homogeneous delivery of optimal coverage while sustaining high productivity.

Factors influencing health workers' compliance with outpatient malaria 'test and treat' guidelines during the plateauing performance phase in Kenya, 2014-2016

Background

Health workers’ compliance with outpatient malaria ‘test and treat’ guidelines has improved since 2010 but plateaued from 2014 at suboptimal levels in Kenya. This study examined the factors associated with high but suboptimal compliance levels at facilities with available malaria tests and drugs.

Methods

Data from four national, cross-sectional health facility surveys undertaken between 2014 and 2016 in Kenya were analysed. Association between 31 factors and compliance with malaria testing (survey range (SR): 65–69%) and no anti-malarial treatment for test negative patients (SR: 90–92%) were examined using multilevel logistic regression models.

Results

A total of 2,752 febrile patients seen by 594 health workers at 486 health facilities were analysed. Higher odds of malaria testing were associated with lake endemic (aOR = 12.12; 95% CI: 5.3–27.6), highland epidemic (aOR = 5.06; 95% CI: 2.7–9.5) and semi-arid seasonal (aOR = 2.07; 95% CI: 1.2–3.6) compared to low risk areas; faith-based (FBO)/ non-governmental organization (NGO)-owned compared to government-owned facilities (aOR = 5.80; 95% CI: 3.2–10.6); health workers’ perception of malaria endemicity as high-risk (aOR = 3.05; 95% CI: 1.8–5.2); supervision with feedback (aOR = 1.84; 95% CI: 1.2–2.9); access to guidelines (aOR = 1.96; 95% CI: 1.1–3.4); older patients compared to infants, higher temperature measurements and main complaints of fever, diarrhoea, headache, vomiting and chills. Lower odds of testing were associated with febrile patients having main complaints of a cough (aOR = 0.65; 95% CI: 0.5–0.9), a rash (aOR = 0.32; 95% CI: 0.2–0.7) or a running nose (aOR = 0.59; 95% CI: 0.4–0.9). Other factors associated with compliance with test negative results included the type of diagnostic test available at the facility, in-service training, health workers’ age, and correct knowledge of the targeted treatment policy.

Conclusions

To optimize outpatient malaria case-management, reduce testing compliance gaps and eliminate overtreatment of test negative patients, there is a need to focus on compliance within low malaria risk areas in addition to ensuring the universal and continuous availability of ‘test and treat’ commodities. Targeting of older and government health workers; dissemination of updated guidelines; and continuing with in-service training and supportive supervision with feedback is essential. Lastly, there is a need to improve health workers’ knowledge about malaria testing criteria considering their perceptions of endemicity.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12936-022-04093-x.

Adherence to malaria management guidelines by health care workers in the Busoga sub-region, eastern Uganda

BACKGROUND

Appropriate malaria management is a key malaria control strategy. The objective of this study was to determine health care worker adherence levels to malaria case management guidelines in the Busoga sub-region, Uganda.

METHODS

Health facility assessments, health care worker (HCW), and patient exit interview (PEI) surveys were conducted at government and private health facilities in the sub-region. All health centres (HC) IVs, IIIs, and a sample of HC IIs, representative of the tiered structure of outpatient service delivery at the district level were targeted. HCWs at these facilities were eligible for participation in the study. For PEIs, 210 patients of all ages presenting with a history of fever for outpatient care at selected facilities in each district were targeted. Patient outcome measures included testing rates, adherence to treatment, dispensing and counselling services as per national guidelines. The primary outcome was appropriate malaria case management, defined as the proportion of patients tested and only prescribed artemether-lumefantrine (AL) if positive. HCW readiness (e.g., training, supervision) and health facility capacity (e.g. availability of diagnostics and anti-malarials) to provide malaria case management were also assessed. Data were weighted to cater for the disproportionate representation of HC IIs in the study sample.

RESULTS

A total of 3936 patients and 1718 HCW from 392 facilities were considered in the analysis. The median age of patients was 14 years; majority (63.4%) females. Most (70.1%) facilities were HCIIs and 72.7% were owned by the government. Malaria testing services were available at > 85% of facilities. AL was in stock at 300 (76.5%) facilities. Of those with a positive result, nearly all were prescribed an anti-malarial, with AL (95.1%) accounting for most prescriptions. Among those prescribed AL, 81.0% were given AL at the facility, lowest at HC IV (60.0%) and government owned (80.1%) facilities, corresponding to AL stock levels. Overall, 86.9% (95%CI 79.7, 90.7) of all enrolled patients received appropriate malaria case management. However, only 50.7% (21.2, 79.7) of patients seen at PFPs received appropriate malaria management.

CONCLUSION

Adherence levels to malaria case management guidelines were good, but with gaps noted mainly in the private sector. The supply chain for AL needs to be strengthened. Interventions to improve practise at PFP facilities should be intensified.

Implementation of external quality assessment of microscopy for improved parasite detection and confirmatory diagnosis of malaria in Tanzanian Military health facilities

Objective

Good quality microscopy is critical for accurate detection and confirmation of malaria parasite infections. Microscopy relies on the skills of technicians to prepare and read slides, high quality reagents, and a good program of internal and external quality control (EQA), which are lacking in most malaria endemic settings. This study was undertaken between January 2016 and December 2018 to pilot an EQA of microscopy for improved diagnosis of malaria and patient care in Tanzanian Military health facilities.

Results

Of all blood smears crosschecked (n = 4000) at baseline, only 38.5% were incorrectly diagnosed by laboratory staff with false positive and negative rates of 46.7% and 16.4%, respectively. During the implementation of EQA, false positive and negative results decreased due to increased quality index of slide preparation and reading through supportive supervision, and retraining of laboratory personnel. There was a gradual increase of quarterly and annual total quality index for all laboratories, from 60% in 2016 to 78% in 2017 and 90% in 2018. The mean proficiency testing performance scores also increased from 75% in 2016 to 82% in 2017 and to 90% in 2018. Poor blood smear preparation and staining contributed to high false positive and negative rates while EQA helped in improvement of diagnostics.

The supervisory relationships of community health workers in primary health care: social network analysis of ward-based outreach teams in Ngaka Modiri Molema District, South Africa

Introduction

Supportive supervision remains a key challenge to the sustainability of community health worker (CHW) programmes globally. The aim of the study was to identify critical actors and patterns of relationships in the supervision of ward-based outreach teams (WBOT) in a rural South African district.

Methods

A cross-sectional study of social and professional relationships of WBOTs with other primary health care (PHC) system actors was conducted using a social network analysis (SNA) approach. A structured questionnaire was distributed to CHWs (37), WBOT team leaders (3), PHC facility managers (5) and PHC local area managers (2) (total n=47) assessing interaction patterns of supportive supervision, namely management, development and support.

Results

The supportive supervision system pivoted around team leaders, who were nurse cadres and who ensured internal cohesion and support among WBOT members. The network patterns also showed the extent of peer support between CHWs in WBOTs. PHC facility staff and middle managers in the subdistrict did not appear to play active roles in the supervision of CHWs and their team leaders. However, there were exceptions, with WBOTs drawing on sympathetic cadres identified among the PHC facility staff for support.

Conclusion

Supportive supervision of CHWs can be thought of as a system of horizontal and vertical relationships that go beyond just one supervisor–supervisee interaction. In this study, supervisory relationships within teams functioned better than those between teams and the rest of the PHC system. Understanding these relationships is key to designing effective supportive supervision in CHW programmes. SNA can be a valuable approach in identifying the relationships to be strengthened.

Evaluation of malaria microscopy diagnostic performance at private health facilities in Tanzania

Background

The World Health Organization (WHO) recommends use of parasitological diagnosis of malaria for all age groups in all malaria transmission settings. Many private health facilities rely on malaria microscopy for malaria diagnosis. However, quality of malaria microscopy is affected by number of factors including availability of skilled laboratory microscopists and lack of quality assurance systems in many malaria endemic countries. This study was carried out to assess quality of malaria microscopy in selected private health facilities in Tanzania.

Methods

A cross sectional study was conducted from August to September, 2017. A total of 40 private health laboratories in five regions were invited to participate in the study. Data were collected by distributing standardized pre-validated malaria slide-panels to each health facility. Sensitivity, specificity, and strength of agreement (with kappa score) were calculated to assess performance in detecting and quantification of Plasmodium species.

Results

Among the 40 health facilities, 31 (77.5%) returned their results to the reference centre (Muhimbili University of Health and Allied Sciences). Overall, the measures of malaria diagnostic accuracy were high, i.e. the sensitivity and specificity of malaria parasite detection by microscopy in the health facilities were 84.3% (95% CI 77–90) and 90.8% (95% CI 83.3–95.7), respectively. There was substantial agreement in parasite detection with (Kappa value: 0.74 (95% 0.65–0.83). However, only 17.8% (24 of 134) of blood slides were interpreted correctly at the health facilities in terms of parasite density counts.

Conclusion

Although there was substantial agreement between the private health microscopists and experienced microscopists in malaria parasite detection, there was poor performance in parasite counts. This calls for regular in-service training and external quality assessments at private health facilities to enhance the skills of private health facility microscopists in malaria microscopy.

Malaria case management in Zambia: A cross-sectional health facility survey

Misdiagnosis of malaria could lead to the overuse of antimalarials resulting in the progression of underlying illness as well as increased risk of mortality. Misdiagnosis is an important consideration as a significant proportion of febrile illnesses in sub-Saharan Africa are attributable to conditions other than malaria. A health facility survey was carried out for a simple random sample of health facilities across 4 provinces of central Zambia in 2014. Twenty-nine facilities with at least 10 outpatients per day were included in the final sample. A modified service provision assessment questionnaire was used for data collection along with several other instruments. Primary outcomes included the quality and accuracy of diagnostic testing for malaria as well as health worker diagnostic and treatment practices. Laboratory technicians displayed 65.5% sensitivity and 86.0% specificity in performing malaria microscopy. Rapid diagnostic test results as reported by health workers were cross-checked by survey staff revealing 99.8% (95% CI: 98.0%-100.0%) concordance. Overall, 69.5% (177/286) (95% CI [58.8%-78.4%]) of patients were reported as febrile of which 37.0% (68/177) (95% CI [21.0%-56.6%]) had a malaria test requested or conducted by their health worker. Appropriate health worker adherence to recommended malaria case management practices (i.e. requesting/conducting malaria tests for febrile patients and providing appropriate antimalarial treatment for test positive cases or forgoing antimalarial treatment for test negative cases) was 30.5% (57/177) (95% CI [17.1%-48.4%]). Presence of fever (aOR = 10.6; 95% CI [3.6-31.2]) and self-reported headache (aOR = 2.2; 95% CI [1.0-4.9]) were significant factors in explaining health worker practices of requesting or performing malaria tests. Routine practice of IQA activities (aOR = 4.8; 95% CI [1.5-15.1]) and self-reported headache (aOR = 3.3; 95% CI [1.1-10.1])) were both significant predictors of antimalarial drug treatment or prescription among malaria untested patients. Prescriber adherence to malaria diagnostic test results in central Zambia is good, but the overall testing rate of febrile patients was low. Additionally, a number of patients observed during this survey were found to have received a clinical diagnosis of malaria without parasitological confirmation and many patients without test results received antimalarial treatment.