Independent Evaluation of the integrated Community Case Management of Childhood Illness Strategy in Malawi Using a National Evaluation Platform Design

Effects of proactive vs fixed community health care delivery on child health and access to care: a cluster randomised trial secondary endpoint analysis

Background

Professional community health workers (CHWs) can help achieve universal health coverage, although evidence gaps remain on how to optimise CHW service delivery. We conducted an unblinded, parallel, cluster randomised trial in rural Mali to determine whether proactive CHW delivery reduced mortality and improved access to health care among children under five years, compared to passive delivery. Here we report the secondary access endpoints.

Methods

Beginning from 26-28 February 2017, 137 village-clusters were offered care by CHWs embedded in communities who were trained, paid, supervised, and integrated into a reinforced public-sector health system that did not charge user fees. Clusters were randomised (stratified on primary health centre catchment and distance) to care during CHWs during door-to-door home visits (intervention) or based at a fixed village site (control). We measured outcomes at baseline, 12-, 24-, and 36-month time points with surveys administered to all resident women aged 15-49 years. We used logistic regression with cluster-level random effects to estimate intention-to-treat and per-protocol effects over time on prompt (24-hour) treatment within the health sector.

Results

Follow-up surveys between February 2018 and April 2020 generated 20 105 child-year observations. Across arms, prompt health sector treatment more than doubled compared to baseline. At 12 months, children in intervention clusters had 22% higher odds of receiving prompt health sector treatment than those in control (cluster-specific adjusted odds ratio (aOR) = 1.22; 95% confidence interval (CI) = 1.06, 1.41, P = 0.005), or 4.7 percentage points higher (adjusted risk difference (aRD) = 0.047; 95% CI = 0.014, 0.080). We found no evidence of an effect at 24 or 36 months.

Conclusions

CHW-led health system redesign likely drove the 2-fold increase in rapid child access to care. In this context, proactive home visits further improved early access during the first year but waned afterwards.

Registration

ClinicalTrials.gov NCT02694055.

From raw data to a score: comparing quantitative methods that construct multi-level composite implementation strength scores of family planning programs in Malawi

BACKGROUND

Data that capture implementation strength can be combined in multiple ways across content and health system levels to create a summary measure that can help us to explore and compare program implementation across facility catchment areas. Summary indices can make it easier for national policymakers to understand and address variation in strength of program implementation across jurisdictions. In this paper, we describe the development of an index that we used to describe the district-level strength of implementation of Malawi's national family planning program.

METHODS

To develop the index, we used data collected during a 2017 national, health facility and community health worker Implementation Strength Assessment survey in Malawi to test different methods to combine indicators within and then across domains (4 methods-simple additive, weighted additive, principal components analysis, exploratory factor analysis) and combine scores across health facility and community health worker levels (2 methods-simple average and mixed effects model) to create a catchment area-level summary score for each health facility in Malawi. We explored how well each model captures variation and predicts couple-years protection and how feasible it is to conduct each type of analysis and the resulting interpretability.

RESULTS

We found little difference in how the four methods combined indicator data at the individual and combined levels of the health system. However, there were major differences when combining scores across health system levels to obtain a score at the health facility catchment area level. The scores resulting from the mixed effects model were able to better discriminate differences between catchment area scores compared to the simple average method. The scores using the mixed effects combination method also demonstrated more of a dose-response relationship with couple-years protection.

CONCLUSIONS

The summary measure that was calculated from the mixed effects combination method captured the variation of strength of implementation of Malawi's national family planning program at the health facility catchment area level. However, the best method for creating an index should be based on the pros and cons listed, not least, analyst capacity and ease of interpretability of findings. Ultimately, the resulting summary measure can aid decision-makers in understanding the combined effect of multiple aspects of programs being implemented in their health system and comparing the strengths of programs across geographies.

Strengthening effectiveness evaluations to improve programs for women, children and adolescents

A full understanding of the pathways from efficacious interventions to population impact requires rigorous effectiveness evaluations conducted under realistic scale-up conditions at country level. In this paper, we introduce a deductive framework that underpins effectiveness evaluations. This framework forms the theoretical and conceptual basis for the 'Real Accountability: Data Analysis for Results' (RADAR) project, intended to address gaps in guidance and tools for the evaluation of projects being implemented at scale to reduce mortality among women and children. These gaps include needs for a framework to guide decisions about evaluations and practical measurement tools, as well as increased capacity in evaluation practice among donors and program planners at global, national and project levels. RADAR aimed to improve the evidence base for program and policy decisions in reproductive, maternal, newborn and child health and nutrition (RMNCH&N). We focus on five linked methodological steps - presented as core evaluation questions - for designing and implementing effectiveness evaluation of large-scale programs that support both the needs of program managers to improve their programs and the needs of donors to meet their accountability responsibilities. RADAR has operationalized each step with a tool to facilitate its application. We also describe cross-cutting methodological issues and broader contextual factors that affect the planning and implementation of such evaluations. We conclude with proposals for how the global RMNCH&N community can support rigorous program evaluations and make better use of the resulting evidence.

Improving health and social systems for all children in LMICs: structural innovations to deliver high-quality services

Despite health gains over the past 30 years, children and adolescents are not reaching their health potential in many low-income and middle-income countries (LMICs). In addition to health systems, social systems, such as schools, communities, families, and digital platforms, can be used to promote health. We did a targeted literature review of how well health and social systems are meeting the needs of children in LMICs using the framework of The Lancet Global Health Commission on high-quality health systems and we reviewed evidence for structural reforms in health and social sectors. We found that quality of services for children is substandard across both health and social systems. Health systems have deficits in care competence (eg, diagnosis and management), system competence (eg, timeliness, continuity, and referral), user experience (eg, respect and usability), service provision for common and serious conditions (eg, cancer, trauma, and mental health), and service offerings for adolescents. Education and social services for child health are limited by low funding and poor coordination with other sectors. Structural reforms are more likely to improve service quality substantially and at scale than are micro-level efforts. Promising approaches include governing for quality (eg, leadership, expert management, and learning systems), redesigning service delivery to maximise outcomes, and empowering families to better care for children and to demand quality care from health and social systems. Additional research is needed on health needs across the life course, health system performance for children and families, and large-scale evaluation of promising health and social programmes.

The role of governance in implementing sustainable global health interventions: review of health system integration for integrated community case management (iCCM) of childhood illnesses

Improving health outcomes in countries with the greatest burden of under-5 child mortality requires implementing innovative approaches like integrated community case management (iCCM) to improve coverage and access for hard-to-reach populations. ICCM improves access for hard-to-reach populations by deploying community health workers to manage malaria, diarrhoea and pneumonia. Despite documented impact, challenges remain in programme implementation and sustainability. An analytical review was conducted using evidence from published and grey literature from 2010 to 2019. The goal was to understand the link between governance, policy development and programme sustainability for iCCM. A Governance Analytical Framework revealed thematic challenges and successes for iCCM adaptation to national health systems. Governance in iCCM included the collective problems, actors in coordination and policy-setting, contextual norms and programmatic interactions. Key challenges were country leadership, contextual evidence and information-sharing, dependence on external funding, and disease-specific stovepipes that impede funding and coordination. Countries that tailor and adapt programmes to suit their governance processes and meet their specific needs and capacities are better able to achieve sustainability and impact in iCCM.

Factors associated with the referral of children with severe illnesses at primary care level in Ethiopia: a cross-sectional study

CONTEXT AND OBJECTIVE

Ethiopia's primary care has a weak referral system for sick children. We aimed to identify health post and child factors associated with referrals of sick children 0-59 months of age and evaluate the healthcare providers' adherence to referral guidelines.

DESIGN

A cross-sectional facility-based survey.

SETTING

This study included data from 165 health posts in 52 districts in four Ethiopian regions collected from December 2018 to February 2019. The data included interviews with health extension workers, assessment of health post preparedness, recording of global positioning system (GPS)-coordinates of the health post and the referral health centre, and reviewing registers of sick children treated during the last 3 months at the health posts. We analysed the association between the sick child's characteristics, health post preparedness and distance to the health centre with referral of sick children by multivariable logistic regressions.

OUTCOME MEASURE

Referral to the nearest health centre of sick young infants aged 0-59 days and sick children 2-59 months.

RESULTS

The health extension workers referred 39/229 (17%) of the sick young infants and 78/1123 (7%) of the older children to the next level of care. Only 18 (37%) sick young infants and 22 (50%) 2-59 months children that deserved urgent referral according to guidelines were referred. The leading causes of referral were possible serious bacterial infection and pneumonia. Those being classified as a severe disease were referred more frequently. The availability of basic amenities (adjusted OR, AOR=0.38, 95% CI 0.15 to 0.96), amoxicillin (AOR=0.41, 95% CI 0.19 to 0.88) and rapid diagnostic test (AOR=0.18, 95% CI 0.07 to 0.46) were associated with less referral in the older age group.

CONCLUSION

Few children with severe illness were referred from health posts to health centres. Improving the health posts' medicine and diagnostic supplies may enhance adherence to referral guidelines and ultimately reduce child mortality.

The Community Health Systems Reform Cycle: Strengthening the Integration of Community Health Worker Programs Through an Institutional Reform Perspective

To develop guidance for governments and partners seeking to scale community health worker programs, we developed a conceptual framework, collected observations from the scale-up efforts of 7 countries, workshopped the framework with technical groups and with country stakeholders, and reviewed literature in the areas of health and policy reform, change management, institutional development, health systems, and advocacy. We observed that successful scale-up is a complex process of institutional reform. Successful scale-up: (1) depends on a carefully choreographed, problem-driven political process; (2) requires that scaled program models are drawn from solutions that are available in a given health system context and aligned with the resources, capabilities, and commitments of key health sector stakeholders; and (3) emerges from iterative cycles of learning and improvement, rather than a single, linear scale-up effort. We identify stages of the reform process associated with each of these 3 findings: problem prioritization, coalition building, solution gathering, design, program readiness, launch, governance, and management and learning. The resulting Community Health Systems Reform Cycle can be used by government, donors, and nongovernmental partners to prioritize and design community health worker scale-up efforts, diagnose challenges or gaps in successful scale-up and integration, and coordinate the contributions of diverse stakeholders.

Does a complex intervention targeting communities, health facilities and district health managers increase the utilisation of community-based child health services? A before and after study in intervention and comparison areas of Ethiopia

INTRODUCTION

Ethiopia successfully reduced mortality in children below 5 years of age during the past few decades, but the utilisation of child health services was still low. Optimising the Health Extension Programme was a 2-year intervention in 26 districts, focusing on community engagement, capacity strengthening of primary care workers and reinforcement of district accountability of child health services. We report the intervention's effectiveness on care utilisation for common childhood illnesses.

METHODS

We included a representative sample of 5773 households with 2874 under-five children at baseline (December 2016 to February 2017) and 10 788 households and 5639 under-five children at endline surveys (December 2018 to February 2019) in intervention and comparison areas. Health facilities were also included. We assessed the effect of the intervention using difference-in-differences analyses.

RESULTS

There were 31 intervention activities; many were one-off and implemented late. In eight districts, activities were interrupted for 4 months. Care-seeking for any illness in the 2 weeks before the survey for children aged 2-59 months at baseline was 58% (95% CI 47 to 68) in intervention and 49% (95% CI 39 to 60) in comparison areas. At end-line it was 39% (95% CI 32 to 45) in intervention and 34% (95% CI 27 to 41) in comparison areas (difference-in-differences -4 percentage points, adjusted OR 0.49, 95% CI 0.12 to 1.95). The intervention neither had an effect on care-seeking among sick neonates, nor on household participation in community engagement forums, supportive supervision of primary care workers, nor on indicators of district accountability for child health services.

CONCLUSION

We found no evidence to suggest that the intervention increased the utilisation of care for sick children. The lack of effect could partly be attributed to the short implementation period of a complex intervention and implementation interruption. Future funding schemes should take into consideration that complex interventions that include behaviour change may need an extended implementation period.

TRIAL REGISTRATION NUMBER

ISRCTN12040912.

District Health Teams' Readiness to Institutionalize Integrated Community Case Management in the Uganda Local Health Systems: A Repeated Qualitative Study

District health teams failed to transition from partner-supported integrated community case management (iCCM) programs to locally-run and fully-institutionalized programs. Successful iCCM institutionalization requires local ownership with increased coordination among governmental and nongovernmental actors at the national and district levels.

Introduction:

Several countries have adopted integrated community case management (iCCM) as a strategy for improved health service delivery in areas with poor health facility coverage. Early implementation of iCCM is often run by nongovernmental organizations financed by donors through projects. Such projects risk failure to transition into programs run by the local health system upon project closure. Engagement of subnational health authorities such as district health teams (DHTs) is essential for a smooth transition.

Methods:

We used a repeated qualitative study design to assess the readiness of and progress made by DHTs in institutionalizing iCCM into the functions of locally decentralized health systems in 9 western Uganda districts. Readiness data were derived from structured group interviews with DHTs before iCCM policy adoption in 2010 and again in 2015. Progressive institutionalization achievements were assessed through key informant interviews with targeted DHT members and local government district planners in the same areas.

Findings:

In the readiness study, DHTs expressed commitment to institutionalize iCCM into the local health system through the development of district-specific iCCM activity work plans and budgets. The DHTs further suggested that they would implement district-led training, motivation, and supervision of community health workers; procurement of iCCM medicines and supplies; and advocacy activities for inclusion of iCCM indicators into the national health information systems. After iCCM policy adoption, follow-up study data findings showed that iCCM was largely not institutionalized into the local district health system functions. The poor institutionalization was attributed to lack of stewardship on how to transition from externally supported implementation to district-led programming, conflicting guidelines on community distribution of medicines, poor community-level accountability systems, and limited decision-making autonomy at the district level.

Conclusion:

Successful institutionalization of iCCM requires local ownership with increased coordination and cooperation among governmental and nongovernmental actors at both the national and district levels.

Closing the inequality gaps in reproductive, maternal, newborn and child health coverage: slow and fast progressors

Introduction

Universal Health Coverage (UHC) is a critical goal under the Sustainable Development Goals (SDGs) for health. Achieving this goal for reproductive, maternal, newborn and child health (RMNCH) service coverage will require an understanding of national progress and how socioeconomic and demographic subgroups of women and children are being reached by health interventions.

Methods

We accessed coverage databases produced by the International Centre for Equity in Health, which were based on reanalysis of Demographic and Health Surveys, Multiple Indicator Cluster Surveys and Reproductive and Health Surveys. We limited the data to 58 countries with at least two surveys since 2008. We fitted multilevel linear regressions of coverage of RMNCH, divided into four main components-reproductive health, maternal health, child immunisation and child illness treatment-to estimate the average annual percentage point change (AAPPC) in coverage for the period 2008-2017 across these countries and for subgroups defined by maternal age, education, place of residence and wealth quintiles. We also assessed change in the pace of coverage progress between the periods 2000-2008 and 2008-2017.

Results

Progress in RMNCH coverage has been modest over the past decade, with statistically significant AAPPC observed only for maternal health (1.25, 95% CI 0.90 to 1.61) and reproductive health (0.83, 95% CI 0.47 to 1.19). AAPPC was not statistically significant for child immunisation and illness treatment. Progress, however, varied largely across countries, with fast or slow progressors spread throughout the low-income and middle-income groups. For reproductive and maternal health, low-income and lower middle-income countries appear to have progressed faster than upper middle-income countries. For these two components, faster progress was also observed in older women and in traditionally less well-off groups such as non-educated women, those living in rural areas or belonging to the poorest or middle wealth quintiles than among groups that are well off. The latter groups however continue to maintain substantially higher coverage levels over the former. No acceleration in RMNCH coverage was observed when the periods 2000-2008 and 2008-2017 were compared.

Conclusion

At the dawn of the SDGs, progress in coverage in RMNCH remains insufficient at the national level and across equity dimensions to accelerate towards UHC by 2030. Greater attention must be paid to child immunisation to sustain the past gains and to child illness treatment to substantially raise its coverage across all groups.

Determinants of healthcare seeking for childhood illnesses among caregivers of under-five children in urban slums in Malawi: a population-based cross-sectional study

BACKGROUND

There is considerable evidence that health systems, in so far as they ensure access to healthcare, promote population health even independent of other determinants. Access to child health services remains integral to improving child health outcomes. Cognisant that improvements in child health have been unevenly distributed, it is imperative that health services and research focus on the disadvantaged groups. Children residing in urban slums are known to face a health disadvantage that is masked by the common view of an urban health advantage. Granted increasing urbanisation rates and proliferation of urban slums resulting from urban poverty, the health of under-five children in slums remains a public health imperative in Malawi. We explored determinants of healthcare-seeking from a biomedical health provider for childhood symptoms of fever, cough with fast breathing and diarrhoea in three urban slums of Lilongwe, Malawi.

METHODS

This was a population-based cross-sectional study involving 543 caregivers of under-five children. Data on childhood morbidity and healthcare seeking in three months period were collected using face-to-face interviews guided by a validated questionnaire. Data were entered in CS-Pro 5.0 and analysed in SPSS version 20 using descriptive statistics and logistic regression analyses.

RESULTS

61% of caregivers sought healthcare albeit 53% of them sought healthcare late. Public health facilities constituted the most frequently used health providers. Healthcare was more likely to be sought: for younger than older under-five children (AOR = 0.54; 95% CI: 0.30-0.99); when illness was perceived to be severe (AOR = 2.40; 95% CI: 1.34-4.30); when the presenting symptom was fever (AOR = 1.77; 95% CI: 1.10-2.86). Home management of childhood illness was negatively associated with care-seeking (AOR = 0.54; 95% CI: 0.36-0.81) and timely care-seeking (AOR = 0.44; 95% CI: 0.2-0.74). Caregivers with good knowledge of child danger signs were less likely to seek care timely (AOR = 0.57; 95% CI: 0.33-0.99).

CONCLUSIONS

Even in the context of geographical proximity to healthcare services, caregivers in urban slums may not seek healthcare or when they do so the majority may not undertake timely healthcare care seeking. Factors related to the child, the type of illness, and the caregiver are central to the healthcare decision making dynamics. Improving access to under-five child health services therefore requires considering multiple factors.

Proactive case detection of common childhood illnesses by community health workers: a systematic review

INTRODUCTION

Identifying design features and implementation strategies to optimise community health worker (CHW) programmes is important in the context of mixed results at scale. We systematically reviewed evidence of the effects of proactive case detection by CHWs in low-income and middle-income countries (LMICs) on mortality, morbidity and access to care for common childhood illnesses.

METHODS

Published studies were identified via electronic databases from 1978 to 2017. We included randomised and non-randomised controlled trials, controlled before-after studies and interrupted time series studies, and assessed their quality for risk of bias. We reported measures of effect as study investigators reported them, and synthesised by outcomes of mortality, disease prevalence, hospitalisation and access to treatment. We calculated risk ratios (RRs) as a principal summary measure, with CIs adjusted for cluster design effect.

RESULTS

We identified 14 studies of 11 interventions from nine LMICs that met inclusion criteria. They showed considerable diversity in intervention design and implementation, comparison, outcomes and study quality, which precluded meta-analysis. Proactive case detection may reduce infant mortality (RR: 0.52-0.94) and increase access to effective treatment (RR: 1.59-4.64) compared with conventional community-based healthcare delivery (low certainty evidence). It is uncertain whether proactive case detection reduces mortality among children under 5 years (RR: 0.04-0.80), prevalence of infectious diseases (RR: 0.06-1.02), hospitalisation (RR: 0.38-1.26) or increases access to prompt treatment (RR: 1.00-2.39) because the certainty of this evidence is very low.

CONCLUSION

Proactive case detection may provide promising benefits for child health, but evidence is insufficient to draw conclusions. More research is needed on proactive case detection with rigorous study designs that use standardised outcomes and measurement methods, and report more detail on complex intervention design and implementation.

PROSPERO REGISTRATION NUMBER

CRD42017074621.

Proactive community case management and child survival: protocol for a cluster randomised controlled trial

INTRODUCTION

Community health workers (CHWs)-shown to improve access to care and reduce maternal, newborn, and child morbidity and mortality-are re-emerging as a key strategy to achieve health-related Sustainable Development Goals (SDGs). However, recent evaluations of national programmes for CHW-led integrated community case management (iCCM) of common childhood illnesses have not found benefits on access to care and child mortality. Developing innovative ways to maximise the potential benefits of iCCM is critical to achieving the SDGs.

METHODS AND ANALYSIS

An unblinded, cluster randomised controlled trial in rural Mali aims to test the efficacy of the addition of door-to-door proactive case detection by CHWs compared with a conventional approach to iCCM service delivery in reducing under-five mortality. In the intervention arm, 69 village clusters will have CHWs who conduct daily proactive case-finding home visits and deliver doorstep counsel, care, referral and follow-up. In the control arm, 68 village clusters will have CHWs who provide the same services exclusively out of a fixed community health site. A baseline population census will be conducted of all people living in the study area. All women of reproductive age will be enrolled in the study and surveyed at baseline, 12, 24 and 36 months. The survey includes a life table tracking all live births and deaths occurring prior to enrolment through the 36 months of follow-up in order to measure the primary endpoint: under-five mortality, measured as deaths among children under 5 years of age per 1000 person-years at risk of mortality.

ETHICS AND DISSEMINATION

The trial has received ethical approval from the Ethics Committee of the Faculty of Medicine, Pharmacy and Dentistry, University of Bamako. The results will be disseminated through peer-reviewed publications, national and international conferences and workshops, and media outlets.

TRIAL REGISTRATION NUMBER

NCT02694055; Pre-results.

Evidence of Impact: iCCM as a strategy to save lives of children under five

Background

In 2013, the World Health Organization (WHO) launched the Rapid Access Expansion (RAcE) programme in the Democratic Republic of Congo, Malawi, Mozambique, Niger, and Nigeria to increase coverage of diagnostic, treatment, and referral services for malaria, pneumonia, and diarrhea among children ages 2-59 months. In 2017, a final evaluation of the six RAcE sites was conducted to determine whether the programme goal was reached. A key evaluation objective was to estimate the reduction in childhood mortality and the number of under-five lives saved over the project period in the RAcE project areas.

Methods

The Lives Saved Tool (LiST) was used to estimate reductions in all-cause child mortality due to changes in coverage of treatment for the integrated community case management (iCCM) illnesses – malaria, pneumonia, and diarrhea – while accounting for other changes in maternal and child health interventions in each RAcE project area. Data from RAcE baseline and endline household surveys, Demographic and Health Surveys, and routine health service data were used in each LiST model. The models yielded estimated change in under-five mortality rates, and estimated number of lives saved per year by malaria, pneumonia and diarrhea treatment. We adjusted the results to estimate the number of lives saved by community health worker (CHW)-provided treatment.

Results

The LiST model accounts for coverage changes in iCCM intervention coverage and other health trends in each project area to estimate mortality reduction and child lives saved. Under five mortality declined in all six RAcE sites, with an average decline of 10 percent. An estimated 6200 under-five lives were saved by malaria, pneumonia, and diarrhea treatment in the DRC, Malawi, Niger, and Nigeria, of which approximately 4940 (75 percent) were saved by treatment provided by CHWs. This total excludes Mozambique, where there were no estimated under-five lives saved likely due to widespread stockouts of key medications. In all other project areas, lives saved by CHW-provided treatment contributed substantially to the estimated decline in under-five mortality.

Conclusions

Our results suggest that iCCM is a strategy that can save lives and measurably decrease child mortality in settings where access to health facility services is low and adequate resources for iCCM implementation are provided for CHW services.

Achievements and challenges of implementation in a mature iCCM programme: Malawi case study

Background

Malawi has a mature integrated community case management (iCCM) programme that is led by the Ministry of Health (MOH) but that still relies on donor support. From 2013 until 2017, under the Rapid Access Expansion (RAcE) programme, the World Health Organization supported the MOH to expand and strengthen iCCM services in four districts. This paper examines Malawi’s iCCM programme performance and implementation strength in RAcE districts to further strengthen the broader programme.

Methods

Baseline and endline household surveys were conducted in iCCM-eligible areas of RAcE districts. Primary caregivers of recently-sick children under five were interviewed to assess changes in care-seeking and treatment over the project period. Health surveillance assistants (HSAs) were surveyed at endline to assess iCCM implementation strength.

Results

Care-seeking from HSAs and treatment of fever improved over the project period. At endline, however, less than half of sick children were brought to an HSA, many caregivers reported a preference for providers other than HSAs, and perceptions of HSAs as trusted providers of high-quality, convenient care had decreased. HSA supervision and mentorship were below MOH targets. Stockouts of malaria medicines were associated with decreased care-seeking from HSAs. Thirty percent of clusters had limited or no access to iCCM (no HSA or an HSA providing iCCM services less than 2 days per week); 50% had moderate access (an HSA providing iCCM services 2 to 4 days per week; and 20% had high access (a resident HSA providing iCCM services 5 or more days per week). Moderate access to iCCM was associated with increased care-seeking from HSAs, increased treatment by HSAs, and more positive perceptions of HSAs compared to areas with limited or no access. Areas with high access to iCCM did not show further improvements above areas with moderate access.

Conclusions

Availability of well-equipped and supported HSAs is critical to the provision of iCCM services. Additional qualitative research is needed to examine challenges and to inform potential solutions. Malawi’s mature iCCM programme has a strong foundation but can be improved to strengthen the continuity of care from communities to facilities and to ultimately improve child health outcomes.

Home visits by community health workers for pregnant mothers and newborns: coverage plateau in Malawi

BACKGROUND

Home visits by community health workers (CHWs) during pregnancy and soon after delivery are recommended to improve newborn survival. However, as the roles of CHWs expand, there are concerns regarding the capacity of community health systems to deliver high effective coverage of home visits. The WHO's Rapid Access Expansion (RAcE) program supported the Malawi Ministry of Health to align their Community-Based Maternal and Newborn Care (CBMNC) package with the latest WHO guidelines and to implement and evaluate the feasibility and coverage of home visits in Ntcheu district.

METHODS

A population-based survey of 150 households in Ntcheu district was conducted in July-August 2016 after approximately 10 months of CBMNC implementation. Thirty clusters were selected proportional-to-size using the most recent census. In selected clusters, five households with mothers of children under six months of age were randomly selected for interview. The Health Surveillance Assistants (HSAs) providing community-based services to the same clusters were purposively selected for a structured interview and register review.

RESULTS

Less than one third of pregnant women (30.7%; 95% confidence interval CI = 21.7%-41.5%) received a home visit during pregnancy and only 20.7% (95% CI = 13.0%-29.4%) received the recommended two visits. Coverage of postnatal visits was even lower: 11.4% (95%CI = 6.8%-18.5%) of mothers and newborns received a visit within three days of delivery and 20.7% (95%CI = 12.7%-32.0%) received a visit within the first eight days. Reaching newborns soon after delivery requires timely participation of the family and/or health facility staff to notify the HSA - yet only 42.9% (95% CI = 33.4%-52.9%) of mothers reported that the HSA was informed of the delivery. Coverage of postnatal home visits among those who informed the HSA was significantly higher than among those in which the HSA was not informed (46.7% compared to 1.3%; P = 0.00). Most HSAs had the necessary equipment and supplies and were active in CBMNC: 83.9% (95% CI = 70.2%-97.6%) of HSAs had pregnancy home visits and 77.4% (95% CI = 61.8%-93.0%) had postnatal home visits documented in their registers for the previous three months.

CONCLUSIONS

We found low coverage of home visits during pregnancy and soon after delivery in a well-supported program delivery environment. Most HSAs were conducting home visits, but not at the level needed to reach high coverage. These findings were similar to previous studies, calling into question the feasibility of the current visitation schedule. It is time to re-align the CBMNC package with what the existing platform can deliver and identify strategies to better support HSAs to implement home visits to those who would benefit most.

Improving Community Health Worker performance by using a personalised feedback dashboard for supervision: a randomised controlled trial

BACKGROUND

Countries across sub-Saharan Africa are scaling up Community Health Worker (CHW) programmes, yet there remains little high-quality research assessing strategies for CHW supervision and performance improvement. This randomised controlled trial aimed to determine the effect of a personalised performance dashboard used as a supervision tool on the quantity, speed, and quality of CHW care.

METHODS

We conducted a randomised controlled trial in a large health catchment area in peri-urban Mali. One hundred forty-eight CHWs conducting proactive case-finding home visits were randomly allocated to receive individual monthly supervision with or without the CHW Performance Dashboard from January to June 2016. Randomisation was stratified by CHW supervisor, level of CHW experience, and CHW baseline performance for monthly quantity of care (number of household visits). With regression analysis, we used a difference-in-difference model to estimate the effect of the intervention on monthly quantity, timeliness (percentage of children under five treated within 24 hours of symptom onset), and quality (percentage of children under five treated without protocol error) of care over a six-month post-intervention period relative to a three-month pre-intervention period.

RESULTS

Use of the Dashboard during monthly supervision significantly increased the mean number of home visits by 39.94 visits per month (95% CI = 3.56-76.3; P = 0.031). Estimated effects on secondary outcomes of timeliness and quality were positive but not statistically significant. Across both study arms, CHW quantity, timeliness, and quality of care significantly improved over the study period, during which time all CHWs received dedicated monthly supervision, although effects plateaued over time.

CONCLUSIONS

Our findings suggest that dedicated monthly supervision and personalised feedback using performance dashboards can increase CHW productivity. Further operational research is needed to understand how to sustain the performance improvements over time.

TRIAL REGISTRATION

ClinicalTrials.gov (NCT03684551).

Intervention heroes of Mozambique from 1997 to 2015: estimates of maternal and child lives saved using the Lives Saved Tool

Background

As one of several countries that pledged to achieve the Millennium Development Goals (MDGs), Mozambique sought to reduce child, neonatal, and maternal mortality by two thirds by 2015. This study examines the impact of Mozambique’s efforts between 1997 and 2015, highlighting the increases in intervention coverage that contributed to saving the most lives.

Methods

A retrospective analysis of available household survey data was conducted using the Lives Saved Tool (LiST). Baseline mortality rates, cause-of-death distributions, and coverage of child, neonatal, and maternal interventions were entered as inputs. Changes in mortality rates, causes of death, and additional lives saved were calculated as results. Due to limited coverage data for the year 2015, we reported most results for the period 1997-2011. For 2011-2015 we reported additional lives saved for a subset of interventions. All analyses were performed at national and provincial level.

Results

Our modelled estimates show that increases in intervention coverage from 1997 to 2011 saved an additional 422 282 child lives (0-59 months), 85 450 neonatal lives (0-1 month), and 6528 maternal lives beyond those already being saved at baseline coverage levels in 1997. Malaria remained the leading cause of child mortality from 1997 to 2011; prematurity, asphyxia, and sepsis remained the leading causes of neonatal mortality; and hemorrhage remained the leading cause of maternal mortality. Interventions to reduce acute malnutrition and promote artemisinin-based combination therapy (ACT) for malaria were responsible for the largest number of additional child lives saved in the 1997-2011 period. Increases in coverage of delivery management were responsible for most additional newborn and maternal lives saved in both periods in Mozambique.

Conclusion

Mozambique has made impressive gains in reducing child mortality since 1997. Additional effort is needed to further reduce maternal and neonatal mortality in all provinces. More lives can be saved by continuing to increase coverage of existing health interventions and exploring new ways to reach underserved populations.

The Case for Community Health Innovation Networks

This commentary1 outlines the rationale for building community health innovation networks in settings of poverty and high burdens of disease. These networks integrate deep research expertise and sustained implementation infrastructure, with the aim of streamlining the design, building and scale up of evidence-based technical innovations for community health. Drawing on our experiences establishing such networks in Mali and Kenya, we discuss the importance of: 1) sustaining operational capacity to strengthen health systems; 2) being strategic about how we embed design research within ongoing implementation efforts; and 3) institutional partnerships that invest in infrastructure to support a series of studies and innovation efforts over time. Without claiming to offer any ‘quick and easy’ solutions, we argue that this approach has real potential to address the gap between research and practice in technical innovation for global health and sustainable development.

Integrated community case management in a peri-urban setting: a qualitative evaluation in Wakiso District, Uganda

BACKGROUND

Integrated community case management (iCCM) strategies aim to reach poor communities by providing timely access to treatment for malaria, pneumonia and diarrhoea for children under 5 years of age. Community health workers, known as Village Health Teams (VHTs) in Uganda, have been shown to be effective in hard-to-reach, underserved areas, but there is little evidence to support iCCM as an appropriate strategy in non-rural contexts. This study aimed to inform future iCCM implementation by exploring caregiver and VHT member perceptions of the value and effectiveness of iCCM in peri-urban settings in Uganda.

METHODS

A qualitative evaluation was conducted in seven villages in Wakiso district, a rapidly urbanising area in central Uganda. Villages were purposively selected, spanning a range of peri-urban settlements experiencing rapid population change. In each village, rapid appraisal activities were undertaken separately with purposively selected caregivers (n = 85) and all iCCM-trained VHT members (n = 14), providing platforms for group discussions. Fifteen key informant interviews were also conducted with community leaders and VHT members. Thematic analysis was based on the 'Health Access Livelihoods Framework'.

RESULTS

iCCM was perceived to facilitate timely treatment access and improve child health in peri-urban settings, often supplanting private clinics and traditional healers as first point of care. Relative to other health service providers, caregivers valued VHTs' free, proximal services, caring attitudes, perceived treatment quality, perceived competency and protocol use, and follow-up and referral services. VHT effectiveness was perceived to be restricted by inadequate diagnostics, limited newborn care, drug stockouts and VHT member absence - factors which drove utilisation of alternative providers. Low community engagement in VHT selection, lack of referral transport and poor availability of referral services also diminished perceived effectiveness. The iCCM strategy was widely perceived to result in economic savings and other livelihood benefits.

CONCLUSIONS

In peri-urban areas, iCCM was perceived as an effective, well-utilised strategy, reflecting both VHT attributes and gaps in existing health services. Depending on health system resources and organisation, iCCM may be a useful transitional service delivery approach. Implementation in peri-urban areas should consider tailored community engagement strategies, adapted selection criteria, and assessment of population density to ensure sufficient coverage.

Systematic review of interventions for improving the performance of community health workers in low-income and middle-income countries

OBJECTIVE

To systematically review and critically appraise the evidence for the effects of interventions to improve the performance of community health workers (CHWs) for community-based primary healthcare in low- and middle-income countries.

DESIGN

Systematic review following Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines.

METHODS

19 electronic databases were searched with a highly sensitive prespecified strategy and the grey literature examined, completed July 2016. Randomised controlled trials evaluating interventions to improve CHW performance in low- and middle-income countries were included and appraised for risk of bias. Outcomes were biological and behavioural patient outcomes (primary), use of health services, quality of care provided by CHWs and CHW retention (secondary).

RESULTS

Two reviewers screened 8082 records; 14 evaluations were included. Due to heterogeneity and lack of clear outcome data, no meta-analysis was conducted. Results were presented in a narrative summary. The review found one study showing no effect on the biological outcomes of interest, though these moderate quality data may not be indicative of all biological outcomes. It also found moderate quality evidence of the efficacy of performance improvement interventions for (1) improving behavioural outcomes for patients, (2) improving use of services by increasing the absolute number of patients who access services and, perhaps, better identifying those who would benefit from such services and (3) improving CHW quality of care in terms of upstream measures like completion of prescribed activities and downstream measures like adherence to treatment protocols. Nearly half of studies were compound interventions, making it difficult to isolate the effects of individual performance improvement intervention components, though four specific strategies pertaining to recruitment, supervision, incentivisation and equipment were identified.

CONCLUSIONS

Variations in recruitment, supervision, incentivisation and equipment may improve CHW performance. Practitioners should, however, assess the relevance and feasibility of these strategies in their health setting prior to implementation. Component selection experiments on a greater range of interventions to improve performance ought to be conducted.

The Effects of an Integrated Community Case Management Strategy on the Appropriate Treatment of Children and Child Mortality in Kono District, Sierra Leone: A Program Evaluation

Integrated community case management (iCCM) aims to reduce child mortality in areas with poor access to health care. iCCM was implemented in 2009 in Kono district, Sierra Leone, a postconflict area with high under-five mortality rates (U5MRs). We evaluated iCCM's impact and effects on child health using cluster surveys in 2010 (midterm) and 2013 (endline) to compare indicators on child mortality, coverage of appropriate treatment, timely access to care, quality of care, and recognition of community health workers (CHWs). The sample size was powered to detect a 28% decline in U5MR. Clusters were selected proportional to population size. All households were sampled to measure mortality and systematic random sampling was used to measure coverage in a subset of households. We used program data to evaluate utilization and access; 5,257 (2010) and 3,649 (2013) households were surveyed. U5MR did not change significantly (4.54 [95% confidence interval [CI]: 3.47-5.60] to 3.95 [95% CI: 3.06-4.83] deaths per 1,000 per month (P = 0.4)) though a relative change smaller than 28% could not be detected. CHWs were the first source of care for 52% (2010) and 50.9% (2013) of children. Coverage of appropriate treatment of fever by CHWs or peripheral health units increased from 45.5% [95% CI: 39.2-52.0] to 58.2% [95% CI: 50.5-65.5] (P = 0.01); changes for diarrhea and pneumonia were not significant. The continued reliance on the CHW as the first source of care and improved coverage for the appropriate treatment of fever support iCCM's role in Kono district.

Hierarchical Statistical Models to Represent and Visualize Survey Evidence for Program Evaluation: iCCM in Malawi

Policy and Program evaluation for maternal, newborn and child health is becoming increasingly complex due to changing contexts. Monitoring and evaluation efforts in this area can take advantage of large nationally representative household surveys such as DHS or MICS that are increasing in size and frequency, however, this analysis presents challenges on several fronts. We propose an approach with hierarchical models for cross-sectional survey data to describe evidence relating to program evaluation, and apply this approach to the recent scale up of iCCM in Malawi. We describe careseeking for children sick with diarrhea, pneumonia, or malaria with empirical Bayes estimates for each district of Malawi at two time points, both for careseeking from any source, and for careseeking only from health surveillance assistants (HSA). We do not find evidence that children in areas with more HSA trained in iCCM are more likely to seek care for pneumonia, diarrhea, or malaria, despite evidence that many indeed are seeking care from HSA. Children in areas with more HSA trained in iCCM are more likely to seek care from a HSA, with 100 additional trained health workers in a district corresponding to a 2% average increase in careseeking from HSA. The hierarchical models presented here provide a flexible set of methods that describe the primary evidence for evaluating iCCM in Malawi and which could be extended to formal causal analyses, and to analysis for other similar evaluations with national survey data.