Community-based intervention packages facilitated by NGOs demonstrate plausible evidence for child mortality impact

The involvement of non-governmental organisations in achieving health system goals based on the WHO six building blocks: A scoping review on global evidence

BACKGROUND

Non-governmental organisations (NGOs) have the potential to make a significant contribution to improving health system goals through the provision of resources, health services and community participation. Therefore, this paper examines the role of NGOs in achieving health system goals, based on the six building blocks of a health system framework, and identifies strategies to enhance NGO involvement in achieving health system goals.

METHODS

A scoping systematic review methodology was used to map and synthesise the existing literature on the topic, following the latest JBI six-stage framework. Four databases and one search engine including PubMed, Web of Science (ISI), EMBASE, Scopus and Google Scholar were searched from January 2000 to January 2024. The results were synthesised using a directed content analysis approach, and the findings were categorised according to the dimensions of the six building blocks.

RESULTS

NGO involvement in health system goals can effectively address gaps in service delivery, strengthen the health workforce, improve health information systems, increase access to essential medicines, mobilise resources and promote good governance. In addition, six key strategies were identified, including joint planning, policy development, capacity building, resource allocation, developing collaboration, and improving the quality of health care, to enhance NGO participation in achieving health system goals.

CONCLUSION

NGOs can play a critical role in achieving health system goals, alongside government and other key health stakeholders. Governments need to use evidence-based policies and interventions to support NGOs to realise their potential in achieving health system goals.

Community engagement for birth preparedness and complication readiness in the Community Level Interventions for Pre-eclampsia (CLIP) Trial in India: a mixed-method evaluation

OBJECTIVE

To describe the process of community engagement (CE) in northern Karnataka, India and its impact on pre-eclampsia knowledge, birth preparedness and complication readiness, pregnancy-related care seeking and maternal morbidity.

DESIGN

This study was a secondary analysis of a cluster randomised trial of Community Level Interventions for Pre-eclampsia (CLIP). A total of 12 clusters based on primary health centre catchment areas were randomised to intervention or control. CE was conducted in intervention clusters. CE attendance was summarised according to participant group using both quantitative and qualitative assessment. Pre-eclampsia knowledge, birth preparedness, health services engagement and perinatal outcomes was evaluated within trial surveillance. Outcomes were compared between trial arms using a mixed effects logistic regression model on RStudio (RStudio, Boston, USA). Community feedback notes were thematically analysed on NVivo V.12 (QSR International, Melbourne, Australia).

SETTING

Belagavi and Bagalkote districts in rural Karnataka, India.

PARTICIPANTS

Pregnant women and women of reproductive age, mothers and mothers-in-law, community stakeholders and male household decision-makers and health workers.

RESULTS

A total of 1379 CE meetings were conducted with 39 362 participants between November 2014 and October 2016. CE activities may have had an effect on modifying community attitudes towards hypertension in pregnancy and its complications. However, rates of pre-eclampsia knowledge, birth preparedness, health services engagement and maternal morbidities among individual pregnant women were not significantly impacted by CE activities in their area.

CONCLUSION

Evaluation of our CE programme in India demonstrates the feasibility of reaching pregnant women alongside household decision-makers, community stakeholders and health workers. More research is needed to explore the pathways of impact between broad community mobilisation to strengthen support for maternal care seeking and clinical outcomes of individual pregnant women.

TRIAL REGISTRATION NUMBER

NCT01911494.

What improves access to primary healthcare services in rural communities? A systematic review

BACKGROUND

To compile key strategies from the international experiences to improve access to primary healthcare (PHC) services in rural communities. Different innovative approaches have been practiced in different parts of the world to improve access to essential healthcare services in rural communities. Systematically collecting and combining best experiences all over the world is important to suggest effective strategies to improve access to healthcare in developing countries. Accordingly, this systematic review of literature was undertaken to identify key approaches from international experiences to enhance access to PHC services in rural communities.

METHODS

All published and unpublished qualitative and/or mixed method studies conducted to improvement access to PHC services were searched from MEDLINE, Scopus, Web of Science, WHO Global Health Library, and Google Scholar. Articles published other than English language, citations with no abstracts and/or full texts, and duplicate studies were excluded. We included all articles available in different electronic databases regardless of their publication years. We assessed the methodological quality of the included studies using mixed methods appraisal tool (MMAT) version 2018 to minimize the risk of bias. Data were extracted using JBI mixed methods data extraction form. Data were qualitatively analyzed using emergent thematic analysis approach to identify key concepts and coded them into related non-mutually exclusive themes.

RESULTS

Our analysis of 110 full-text articles resulted in ten key strategies to improve access to PHC services. Community health programs or community-directed interventions, school-based healthcare services, student-led healthcare services, outreach services or mobile clinics, family health program, empanelment, community health funding schemes, telemedicine, working with traditional healers, working with non-profit private sectors and non-governmental organizations including faith-based organizations are the key strategies identified from international experiences.

CONCLUSION

This review identified key strategies from international experiences to improve access to PHC services in rural communities. These strategies can play roles in achieving universal health coverage and reducing disparities in health outcomes among rural communities and enabling them to get healthcare when and where they want.

Interventions to increase participation of NGOs in preventive care: A scoping review

Background and Aims

Nongovernmental organizations (NGOs) have enormous potential to effectively prevent and manage diseases; however, little research is available on interventions used to improve NGOs' participation in this area. A scoping review was conducted to identify options proposed or implemented to improve the participation of the NGOs in preventive care.

Methods

Pubmed, Web of Science, and ProQuest were extensively searched. Google Scholar was also searched to find potential studies related to the subject. Relevant keywords were used in the English language. The reference list of relevant studies was also scanned. Studies were screened with defined inclusion and exclusion criteria. Relevant data were then extracted. Two individuals independently screened and extracted studies. The interventions implemented or proposed to promote the participation of the NGOs in the implementation of preventive interventions were deductively identified and classified.

Results

Eighteen articles were included in our review. We identified 31 interventions and categorized them into 11 strategies, including (1) building strong collaboration among NGOs and with governments; (2) expanding networks and sustained relations among NGOs; (3) evaluating the NGOs' performance; (4) increasing intersectoral collaboration; (5) advocating for the role of NGOs; (6) supporting NGOs from the side of government; (7) empowering the abilities and capabilities of NGOs; (8) defining the precise roles and responsibilities of the parties; (9) strengthening the health system governance; (10) increasing the health literacy of the community; and (11) developing required regulations, rules, and policies. None of the interventions identified had evidence of its effectiveness.

Conclusion

The current evidence on effective interventions to strengthen NGOs' participation in implementing health care is scanty. It means there is an information gap in the effect of interventions to improve NGOs' participation in health.

On Learning About Efforts to Strengthen (and Reduce Harm to) Systems for Health

We comment on two embedded case studies of systems effects of successive mid-size projects looking back over 7-10 years, published in Health Policy and Planning. The papers examine humanitarian projects in Sudan and Pakistan and development projects (integrated Community Case Management) in Ethiopia, Malawi, and Mozambique. In this commentary, we summarize the two papers and discuss the overarching substantive and methodological lessons learned. In both development and humanitarian/emergency practice, projects navigate a dynamic space between gap-filling, systems support, and systems strengthening. In this, their contribution to systems strengthening depends heavily on the eco-system of government, development partners, and donors. Systems strengthening presents great challenges in definition, implementation, and measurement. Nonetheless, project implementers can and should renew their commitment to strengthening systems for health. This comes with a fundamental requirement for learning and evaluation.

Engagement of non-governmental organisations in moving towards universal health coverage: a scoping review

BACKGROUND

Developing essential health services through non-governmental organisations (NGOs) is an important strategy for progressing towards Universal Health Coverage (UHC), especially in low- and middle-income countries. It is crucial to understand NGOs' role in reaching UHC and the best way to engage them.

OBJECTIVE

This study reviewed the role of NGOs and their engagement strategies in progress toward UHC.

METHOD

We systematically reviewed studies from five databases (PubMed, Web of Science (ISI), ProQuest, EMBASE and Scopus) that investigated NGOs interventions in public health-related activities. The quality of the selected studies was assessed using the mixed methods appraisal tool. PRISMA reporting guidelines were followed.

FINDINGS

Seventy-eight studies met the eligibility criteria. NGOs main activities related to service and population coverage and used different strategies to progress towards UHC. To ensure services coverage, NGOs provided adequate and competent human resources, necessary health equipment and facilities, and provided public health and health care services strategies. To achieve population coverage, they provided services to vulnerable groups through community participation. Most studies were conducted in middle-income countries. Overall, the quality of the reported evidence was good. The main funding sources of NGOs were self-financing and grants from the government, international organisations, and donors.

CONCLUSION

NGOs can play a significant role in the country's progress towards UHC along with the government and other key health players. The government should use strategies and interventions in supporting NGOs, accelerating their movement toward UHC.

The role of evaluation in iterative learning and implementation of quality of care interventions

Background: The Lancet Global Health Commission (LGHC) has argued that quality of care (QoC) is an emergent property that requires an iterative process to learn and implement. Such iterations are required given that health systems are complex adaptive systems.Objective: This paper explores the multiple roles that evaluations need to play in order to help with iterative learning and implementation. We argue evaluation needs to shift from a summative focus toward an approach that promotes learning in complex systems. A framework is presented to help guide the iterative learning, and includes the dimensions of clinical care, person-centered care, continuum of care, and 'more than medicine. Multiple roles of evaluation corresponding to each of the dimensions are discussed.Methods: This paper is informed by reviews of the literature on QoC and the roles of evaluation in complex systems. The proposed framework synthesizes the multiple views of QoC. The recommendations of the roles of evaluation are informed both by review and experience in evaluating multiple QoC initiatives.Results: The specific roles of different evaluation approaches, including summative, realist, developmental, and participatory, are identified in relationship to the dimensions in our proposed framework. In order to achieve the potential of LGHC, there is a need to discuss how different evaluation approaches can be combined in a coherent way to promote iterative learning and implementation of QoC initiatives.Conclusion: One of the implications of the QoC framework discussed in the paper is that time needs to be spent upfront in recognizing areas in which knowledge of a specific intervention is not complete at the outset. This, of course, implies taking stock of areas of incompleteness in knowledge of context, theory of change, support structures needed in order for the program to succeed in specific settings. The role of evaluation should not be limited to only providing an external assessment, but an important goal in building evaluation capacity should be to promote adaptive management among planners and practitioners. Such iterative learning and adaptive management are needed to achieve the goals of sustainable development goals.

Evidence of Impact: iCCM as a strategy to save lives of children under five

Background

In 2013, the World Health Organization (WHO) launched the Rapid Access Expansion (RAcE) programme in the Democratic Republic of Congo, Malawi, Mozambique, Niger, and Nigeria to increase coverage of diagnostic, treatment, and referral services for malaria, pneumonia, and diarrhea among children ages 2-59 months. In 2017, a final evaluation of the six RAcE sites was conducted to determine whether the programme goal was reached. A key evaluation objective was to estimate the reduction in childhood mortality and the number of under-five lives saved over the project period in the RAcE project areas.

Methods

The Lives Saved Tool (LiST) was used to estimate reductions in all-cause child mortality due to changes in coverage of treatment for the integrated community case management (iCCM) illnesses – malaria, pneumonia, and diarrhea – while accounting for other changes in maternal and child health interventions in each RAcE project area. Data from RAcE baseline and endline household surveys, Demographic and Health Surveys, and routine health service data were used in each LiST model. The models yielded estimated change in under-five mortality rates, and estimated number of lives saved per year by malaria, pneumonia and diarrhea treatment. We adjusted the results to estimate the number of lives saved by community health worker (CHW)-provided treatment.

Results

The LiST model accounts for coverage changes in iCCM intervention coverage and other health trends in each project area to estimate mortality reduction and child lives saved. Under five mortality declined in all six RAcE sites, with an average decline of 10 percent. An estimated 6200 under-five lives were saved by malaria, pneumonia, and diarrhea treatment in the DRC, Malawi, Niger, and Nigeria, of which approximately 4940 (75 percent) were saved by treatment provided by CHWs. This total excludes Mozambique, where there were no estimated under-five lives saved likely due to widespread stockouts of key medications. In all other project areas, lives saved by CHW-provided treatment contributed substantially to the estimated decline in under-five mortality.

Conclusions

Our results suggest that iCCM is a strategy that can save lives and measurably decrease child mortality in settings where access to health facility services is low and adequate resources for iCCM implementation are provided for CHW services.

A simple metric for a complex outcome: proposing a sustainment index for health indicators

Background

Sustainability is, at least in principle, an important criterion for evaluating global health and development programs. The absence of shared metrics for success or achievements in sustainability is however critically lacking. We propose a simple metric, free of causal inference, which can be used to test different empirical models for the sustainment of health outcomes.

Methods

We follow the suggestion of Chambers and use “sustainment” to refer to the verifiable and measured extent to which a health indicator has evolved over time. The sustainment index of a health indicator (Y) advanced by a program is based on a simple-to-calculate approximation of the derivative of Y over time (T0: baseline, T1: endline, and T2: post-project), based on the ratio of the slope of Y_T1-T2 over Y_T0-T1. SI(Y) = 1+ (Y_T1-T2 / Y_T0-T1).

Results

This construct provides three clear benchmarks: SI = 0, when the health indicator returns to baseline value post-project (Y_T2 = Y_T0); SI = 1, when the endline-post-project trend is a plateau; and SI = 2, when the progress slope during program is uninterrupted post-program. We find strong correlation (r² = 0.922) between the SI and independent practitioners’ rating of indicator trends. The SI shows different levels of achieved sustainment for a range of indicators in a published ex-post sustainability study. And we find that the SI can be computed for large national datasets for two types of indicators.

Conclusions

The Sustainment Index has limitations and conditions of applicability, but it can be applied to different datasets and studies to provide a reliable dependent measure of the level of sustainment of health outcomes from one period of time to the next. The Index will need additional testing, and future evaluation-research work will need to consider index performance under different situations. The Sustainment Index has the potential to provide a standard metric to build evidence through more systematic research on sustainment and sustainability.

Evaluating a community-based cervical cancer screening strategy in Western Kenya: a descriptive study

Background

The incidence of cervical cancer in Kenya is among the highest in the world. Few Kenyan women are able to access screening, thus fueling the high cervical cancer burden. Self-collected human papilloma Virus (HPV) tests, administered during community-health campaigns in rural areas may be a way to expand access to screening.

Methods

In December 2015, we carried out a four-day community health campaign (CHC) to educate participants about cervical cancer prevention and offer self-administered HPV screening. Community enumeration, outreach and mobilization preceded the CHC. Samples were sent to Migori County Hospital for HPV DNA testing using careHPV Test Kits. Women were notified of results through their choice of short message service (SMS), phone call, home visit or clinic visit. HPV positive women were referred for cryotherapy following a screen-and-treat strategy.

Results

Door-to-door enumeration identified approximately 870 eligible women in Ngodhe Community in Migori County. Among the 267 women attending the campaign, 255 women enrolled and collected samples: 243 tests were successfully resulted and 12 were indeterminate. Of the 243 resulted tests, 47 (19%) were positive for HPV, with young age being the only significant predictor of positivity. In multivariate analysis, each additional year of age conferred about a 4% decrease in the odds of testing positive (95% CI 0.1 to 7%, p = 0.046). Just over three-quarters of all women (195/255), were notified of their results. Those who were unable to be reached were more likely to prefer receiving results from clinic (54/60, 90%) and were less likely to have mobile phones (24/60, 73%). Although 76% of HPV positive women were notified of their results, just half (51%) of those testing positive presented for treatment. HPV positive women who successfully accessed the treatment facility did not differ from their non-presenting counterparts by demographics, health history, desired route of notification or access to a mobile phone.

Conclusion

Nearly a third of eligible women in Ngodhe Community attended the CHC and were screened for cervical cancer. Nearly all women who attended the CHC underwent cervical cancer screening by self-collected HPV tests. Three-quarters of all participants received results, but just half of HPV positive participants presented for treatment in a timely fashion, suggesting that linkage to treatment remains a major challenge.

Trial registration

NCT02124252, Registered 25 April 2014.

Cost of HPV screening at community health campaigns (CHCs) and health clinics in rural Kenya

Background

Cervical cancer is the most frequent neoplasm among Kenyan women, with 4800 diagnoses and 2400 deaths per year. One reason is an extremely low rate of screening through pap smears, at 13.8% in 2014. Knowing the costs of screening will help planners and policymakers design, implement, and scale programs.

Methods

We conducted HPV-based cervical cancer screening via self-collection in 12 communities in rural Migori County, Kenya. Six communities were randomized to community health campaigns (CHCs), and six to screening at government clinics. All HPV-positive women were referred for cryotherapy at Migori County Hospital. We prospectively estimated direct costs from the health system perspective, using micro-costing methods. Cost data were extracted from expenditure records, staff interviews, and time and motion logs. Total costs per woman screening included three activities: outreach, HPV-based screening, and notification. Types of inputs include personnel, recurrent goods, capital goods, and services. We costed potential changes to implementation for scaling.

Results

From January to September 2016, 2899 women were screened in CHCs and 2042 in clinics. Each CHC lasted for 30 working days, 10 days each for outreach, screening, and notification. The mean cost per woman screened was $25.00 for CHCs [median: $25.09; Range: $22.06-30.21] and $29.56 for clinics [$28.90; $25.27-37.08]. Clinics had higher costs than CHCs for personnel ($14.27 vs. $11.26) and capital ($5.55 vs. $2.80). Screening costs were higher for clinics at $21.84, compared to $17.48 for CHCs. In contrast, CHCs had higher outreach costs ($3.34 vs. $0.17). After modeling a reduction in staffing, clinic per-screening costs ($25.69) were approximately equivalent to CHCs.

Conclusions

HPV-based cervical cancer screening through community health campaigns achieved lower costs per woman screened, compared to screening at clinics. Periodic high-volume CHCs appear to be a viable low-cost strategy for implementing cervical cancer screening.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-3195-6) contains supplementary material, which is available to authorized users.

Comprehensive review of the evidence regarding the effectiveness of community-based primary health care in improving maternal, neonatal and child health: 4. child health findings

Background

This paper assesses the effectiveness of community–based primary health care (CBPHC) in improving child health beyond the neonatal period. Although there has been an accelerated decline in global under–5 mortality since 2000, mortality rates remain high in much of sub–Saharan Africa and in some south Asian countries where under–5 mortality is also decreasing more slowly. Essential interventions for child health at the community level have been identified. Our review aims to contribute further to this knowledge by examining how strong the evidence is and exploring in greater detail what specific interventions and implementation strategies appear to be effective.

Methods

We reviewed relevant documents from 1950 onwards using a detailed protocol. Peer reviewed documents, reports and books assessing the impact of one or more CBPHC interventions on child health (defined as changes in population coverage of one or more key child survival interventions, nutritional status, serious morbidity or mortality) among children in a geographically defined population was examined for inclusion. Two separate reviews took place of each document followed by an independent consolidated summative review. Data from the latter review were transferred to electronic database for analysis.

Results

The findings provide strong evidence that the major causes of child mortality in resource–constrained settings can be addressed at the community level largely by engaging communities and supporting community–level workers. For all major categories of interventions (nutritional interventions; control of pneumonia, diarrheal disease and malaria; HIV prevention and treatment; immunizations; integrated management of childhood diseases; and comprehensive primary health care) we have presented randomized controlled trials that have consistently produced statistically significant and operationally important effects.

Conclusions

This review shows that there is strong evidence of effectiveness for CBPHC implementation of an extensive range of interventions to improve child health and that four major strategies for delivering these interventions are effective.

Comprehensive review of the evidence regarding the effectiveness of community-based primary health care in improving maternal, neonatal and child health: 6. strategies used by effective projects

BACKGROUND

As part of our review of the evidence of the effectiveness of community-based primary health care (CBPHC) in improving maternal, neonatal and child health (MNCH), we summarize here the common delivery strategies of projects, programs and field research studies (collectively referred to as projects) that have demonstrated effectiveness in improving child mortality. Other articles in this series address specifically the effects of CBPHC on improving MNCH, while this paper explores the specific strategies used.

METHODS

We screened 12 166 published reports in PubMed of community-based approaches to improving maternal, neonatal and child health in high-mortality, resource-constrained settings from 1950-2015. A total of 700 assessments, including 148 reports from other publicly available sources (mostly unpublished evaluation reports and books) met the criteria for inclusion and were reviewed using a data extraction form. Here we identify and categorize key strategies used in project implementation.

RESULTS

Six categories of strategies for program implementation were identified, all of which required working in partnership with communities and health systems: (a) program design and evaluation, (b) community collaboration, (c) education for community-level staff, volunteers, beneficiaries and community members, (d) health systems strengthening, (e) use of community-level workers, and (f) intervention delivery. Four specific strategies for intervention delivery were identified: (a) recognition, referral, and (when possible) treatment of serious childhood illness by mothers and/or trained community agents, (b) routine systematic visitation of all homes, (c) facilitator-led participatory women's groups, and (d) health service provision at outreach sites by mobile health teams.

CONCLUSIONS

The strategies identified here provide useful starting points for program design in strengthening the effectiveness of CBPHC for improving MNCH.

LiST modelling with monitoring data to estimate impact on child mortality of an ORS and zinc programme with public sector providers in Bihar, India

Background

Many interventions have attempted to increase vulnerable and remote populations’ access to ORS and zinc to reduce child mortality from diarrhoea. However, the impact of these interventions is difficult to measure. From 2010 to 15, Micronutrient Initiative (MI), worked with the public sector in Bihar, India to enable community health workers to treat and report uncomplicated child diarrhoea with ORS and zinc. We describe how we estimated programme’s impact on child mortality with Lives Saved Tool (LiST) modelling and data from MI’s management information system (MIS). This study demonstrates that using LiST modelling and MIS data are viable options for evaluating programmes to reduce child mortality.

Methods

We used MI’s programme monitoring data to estimate coverage rates and LiST modelling software to estimate programme impact on child mortality. Four scenarios estimated the effects of different rates of programme scale-up and programme coverage on estimated child mortality by measuring children’s lives saved.

Results

The programme saved an estimated 806–975 children under-5 who had diarrhoea during five-year project phase. Increasing ORS and zinc coverage rates to 19.8% & 18.3% respectively under public sector coverage with effective treatment would have increased the programme’s impact on child mortality and could have achieved the project goal of saving 4200 children’s lives during the five-year programme.

Conclusions

Programme monitoring data can be used with LiST modelling software to estimate coverage rates and programme impact on child mortality. This modelling approach may cost less and yield estimates sooner than directly measuring programme impact with population-based surveys. However, users must be cautious about relying on modelled estimates of impact and ensure that the programme monitoring data used is complete and precise about the programme aspects that are modelled. Otherwise, LiST may mis-estimate impact on child mortality. Further, LiST software may require modifications to its built-in assumptions to capture programmatic inputs. LiST assumes that mortality rates and cause of death structure change only in response to changes in programme coverage. In Bihar, overall child mortality has decreased and diarrhoea seems to be less lethal than previously, but at present LiST does not adjust its estimates for these sorts of changes.

Evaluation of continuing education of family health strategy teams for the early identification of suspected cases of cancer in children

BACKGROUND

This study evaluated the influence of continuing education of family health strategy teams by the Ronald McDonald Institute program on the early diagnosis of cancer in children and adolescents.

METHODS

The study applied Habicht's model to evaluate the adequacy and plausibility of continuing education by using as outcome the number of children with suspected cancer who were referred to the hospital of references in the 1 year before and 1 year after intervention and the number of patients referred by intervention group and control group family health strategy teams. Medical records from each hospital of reference were used to collect information of suspect cases of cancer. Descriptive analyses were performed using frequencies and mean values. Chi-square tests were used to assess statistically significant differences between the groups and periods by using p-values < 0.05.

RESULTS

The results showed a 30.6% increase in the number of children referred to the hospital of reference for suspected cancer in the post-intervention period; in addition, the family health strategy teams that underwent the intervention referred 3.6 times more number of children to hospital of references than did the control group. Only the intervention group showed an increase in the number of confirmed cases.

CONCLUSIONS

This evaluation of a continuing education program for early identification of pediatric cancer showed that the program was adequate in achieving the established goals and that the results could be attributed to the program.

Institutionalizing community-focused maternal, newborn, and child health strategies to strengthen health systems: A new framework for the Sustainable Development Goal era

Background

Stronger health systems, with an emphasis on community-based primary health care, are required to help accelerate the pace of ending preventable maternal and child deaths as well as contribute to the achievement of the Sustainable Development Goals (SDGs). The success of the SDGs will require unprecedented coordination across sectors, including partnerships between public, private, and non-governmental organizations (NGOs). To date, little attention has been paid to the distinct ways in which NGOs (both international and local) can partner with existing national government health systems to institutionalize community health strategies.

Discussion

In this paper, we propose a new conceptual framework that depicts three primary pathways through which NGOs can contribute to the institutionalization of community-focused maternal, newborn, and child health (MNCH) strategies to strengthen health systems at the district, national or global level. To illustrate the practical application of these three pathways, we present six illustrative cases from multiple NGOs and discuss the primary drivers of institutional change. In the first pathway, “learning for leverage,” NGOs demonstrate the effectiveness of new innovations that can stimulate changes in the health system through adaptation of research into policy and practice. In the second pathway, “thought leadership,” NGOs disseminate lessons learned to public and private partners through training, information sharing and collaborative learning. In the third pathway, “joint venturing,” NGOs work in partnership with the government health system to demonstrate the efficacy of a project and use their collective voice to help guide decision-makers. In addition to these pathways, we present six key drivers that are critical for successful institutionalization: strategic responsiveness to national health priorities, partnership with policymakers and other stakeholders, community ownership and involvement, monitoring and use of data, diversification of financial resources, and longevity of efforts.

Conclusion

With additional research, we propose that this framework can contribute to program planning and policy making of donors, governments, and the NGO community in the institutionalization of community health strategies.

Care Groups II: A Summary of the Child Survival Outcomes Achieved Using Volunteer Community Health Workers in Resource-Constrained Settings

Care Group projects resulted in high levels of healthy behavior, including use of oral rehydration therapy, bed nets, and health care services. Accordingly, under-5 mortality in Care Group areas declined by an estimated 32% compared with 11% in areas with child survival projects not using Care Groups.

The Care Group approach, described in detail in a companion paper in this journal, uses volunteers to convey health promotion messages to their neighbors. This article summarizes the available evidence on the effectiveness of the Care Group approach, drawing on articles published in the peer-reviewed literature as well as data from unpublished but publicly available project evaluations and summary analyses of these evaluations. When implemented by strong international NGOs with adequate funding, Care Groups have been remarkably effective in increasing population coverage of key child survival interventions. There is strong evidence that Care Groups can reduce childhood undernutrition and reduce the prevalence of diarrhea. Finally, evidence from multiple sources, comprising independent assessments of mortality impact, vital events collected by Care Group Volunteers themselves, and analyses using the Lives Saved Tool (LiST), that Care Groups are effective in reducing under-5 mortality. For example, the average decline in under-5 mortality, estimated using LiST, among 8 Care Group projects was 32%. In comparison, among 12 non-Care Group child survival projects, the under-5 mortality declined, on average, by an estimated 11%. Care Group projects cost in the range of US$3–$8 per beneficiary per year. The cost per life saved is in the range of $441–$3,773, and the cost per disability-adjusted life year (DALY) averted is in the range of $15–$126. The Care Group approach, when implemented as described, appears to be highly cost-effective based on internationally accepted criteria. Care Groups represent an important and promising innovative, low-cost approach to increasing the coverage of key child survival interventions in high-mortality, resource-constrained settings. Next steps include further specifying the adjustments needed in government health systems to successfully incorporate the Care Group approach, testing the feasibility of these adjustments and of the effectiveness of Care Groups in pilot programs in government health systems, and finally assessing effectiveness at scale under routine field conditions in government health programs.

Evaluation of the effectiveness of care groups in expanding population coverage of Key child survival interventions and reducing under-5 mortality: a comparative analysis using the lives saved tool (LiST)

Background

Globally, less than half of Countdown Countries will achieve the Millennium Development Goal of reducing the under-5 mortality rate (U5MR) by two-thirds by 2015. There is growing interest in community-based delivery mechanisms to help accelerate progress. One promising approach is the use of a form of participatory mothers’ groups, called Care Groups, for expanding coverage of key child survival interventions, an essential feature for achieving mortality impact.

Methods

In this study we evaluate the effectiveness of Care Group projects conducted in 5 countries in Africa and Asia in comparison to other United States Agency for International Development-funded child survival projects in terms of increasing coverage of key child survival interventions and reducing U5MR (estimated using the Lives Saved Tool, or LiST). Ten Care Group and nine non-Care Group projects were matched by country and year of program implementation.

Results

In Care Group project areas, coverage increases were more than double those in non-Care Group project areas for key child survival interventions (p = 0.0007). The mean annual percent change in U5MR modelled in LiST for the Care Group and non-Care Group projects was −4.80 % and −3.14 %, respectively (p = 0.09).

Conclusions

Our findings suggest that Care Groups may provide a promising approach to significantly increase key child survival interventions and increase reductions in U5MR. Evaluations of child survival programs should be a top priority in global health to build a greater evidence base for effective approaches for program delivery.

Toward universal coverage in Afghanistan: A multi-stakeholder assessment of capacity investments in the community health worker system

Global efforts to scale-up the community health workforce have accelerated as a result of the growing evidence of their effectiveness to enhance coverage and health outcomes. Reconstruction efforts in Afghanistan integrated capacity investments for community based service delivery, including the deployment of over 28,000 community health workers (CHWs) to ensure access to basic preventive and curative services. The study aimed to conduct capacity assessments of the CHW system and determine stakeholder perspectives of CHW performance. Structured interviews were conducted on a national sample from 33 provinces and included supervisors, facility providers, patients, and CHWs. Formative assessments were also conducted with national policymakers, community members and health councils in two provinces. Results indicate that more than 70% of the NGO's provide comprehensive training for CHWs, 95% CHWs reported regular supervision, and more than 60% of the health posts had adequate infrastructure and essential commodities. Innovative strategies of paired male and female CHWs, institution of a special cadre of community health supervisors, and community health councils were introduced as systems strengthening mechanisms. Reported barriers included unrealistic and expanding task expectations (14%), unsatisfactory compensation mechanisms (75%), inadequate transport (69%), and lack of commodities (40%). Formative assessments evidenced that CHWs were highly valued as they provided equitable, accessible and affordable 24-h care. Their loyalty, dedication and the ability for women to access care without male family escorts was appreciated by communities. With rising concerns of workforce deficits, insecurity and budget constraints, the health system must enhance the capacity of these frontline workers to improve the continuum of care. The study provides critical insight into the strengths and constraints of Afghanistan's CHW system, warranting further efforts to contextualize service delivery and mechanisms for their support and motivation.

Shifting management of a community volunteer system for improved child health outcomes: results from an operations research study in Burundi

Background

Community-based strategies that foster frequent contact between caregivers of children under five and provide credible sources of health information are essential to improve child survival. Care Groups are a community-based implementation strategy for the delivery of social and behavior change interventions. This study assessed if supervision of Care Group activities by Ministry of Health (MOH) personnel could achieve the same child health outcomes as supervision provided by specialized non-governmental organization (NGO) staff.

Methods

The study was a pretest-posttest quasi-experimental design implemented in Burundi. A total of 45 MOH-led Care Groups with 478 Care Group Volunteers (CGVs) were established in the intervention area; and 50 NGO-led Care Groups with 509 CGVs were formed in the comparison area. Data were collected from 593 and 700 mothers of children 0-23 months at baseline and endline, respectively. Pearson’s chi-squared test and difference-in-difference analysis assessed changes in 40 child health and nutrition outcomes. A qualitative process evaluation was also conducted midway through the study.

Results

The MOH-led Care Group model performed at least as well as the NGO-led model in achieving specific child health and nutrition outcomes. Mothers of children 0-23 months in the intervention and comparison sites reported similar levels of knowledge and practices for 38 of 40 dependent variables measured in the study, and these results remained unchanged after accounting for differences in the indicator values at baseline. Process monitoring data confirmed that the MOH-led Care Group model and the NGO-led Care Group model were implemented with similar intervention strength.

Conclusions

The study demonstrated that behavior change interventions traditionally led by NGOs can be implemented through the existing MOH systems and achieve similar results, thereby increasing the potential for sustainable child health outcomes. Future research on the MOH-led Care Group model is required to systematically document all inputs and monetary costs borne by the MOH to implement the model.

Plausible role for CHW peer support groups in increasing care-seeking in an integrated community case management project in Rwanda: a mixed methods evaluation

During national scale up of iCCM in Rwanda, greater improvements in care-seeking were found in the districts where Kabeho Mwana implemented its model than in the rest of the country. Success was attributed to an emphasis on routine data review, intensive monitoring, collaborative supervision, community mobilization, and, in particular, CHW peer support groups.

Background:

The Kabeho Mwana project (2006–2011) supported the Rwanda Ministry of Health (MOH) in scaling up integrated community case management (iCCM) of childhood illness in 6 of Rwanda's 30 districts. The project trained and equipped community health workers (CHWs) according to national guidelines. In project districts, Kabeho Mwana staff also trained CHWs to conduct household-level health promotion and established supervision and reporting mechanisms through CHW peer support groups (PSGs) and quality improvement systems.

Methods:

The 2005 and 2010 Demographic and Health Surveys were re-analyzed to evaluate how project and non-project districts differed in terms of care-seeking for fever, diarrhea, and acute respiratory infection symptoms and related indicators. We developed a logit regression model, controlling for the timing of the first CHW training, with the district included as a fixed categorical effect. We also analyzed qualitative data from the final evaluation to examine factors that may have contributed to improved outcomes.

Results:

While there was notable improvement in care-seeking across all districts, care-seeking from any provider for each of the 3 conditions, and for all 3 combined, increased significantly more in the project districts. CHWs contributed a larger percentage of consultations in project districts (27%) than in non-project districts (12%). Qualitative data suggested that the PSG model was a valuable sub-level of CHW organization associated with improved CHW performance, supervision, and social capital.

Conclusions:

The iCCM model implemented by Kabeho Mwana resulted in greater improvements in care-seeking than those seen in the rest of the country. Intensive monitoring, collaborative supervision, community mobilization, and CHW PSGs contributed to this success. The PSGs were a unique contribution of the project, playing a critical role in improving care-seeking in project districts. Effective implementation of iCCM should therefore include CHW management and social support mechanisms. Finally, re-analysis of national survey data improved evaluation findings by providing impact estimates.

Evidence-based public health: not only whether it works, but how it can be made to work practicably at scale

Because public health must operate at scale in widely diverse, complex situations, randomized controlled trials (RCTs) have limited utility for public health. Other methodologies are needed. A key conceptual backbone is a detailed “theory of change” to apply appropriate evidence for each operational component. Synthesizing patterns of findings across multiple methodologies provides key insights. Programs operating successfully across a variety of settings can provide some of the best evidence. Challenges include judging the quality of such evidence and assisting programs to apply it. WHO and others should shift emphasis from RCTs to more relevant evidence when assessing public health issues.

The Lives Saved Tool (LiST) as a model for diarrhea mortality reduction

BACKGROUND

Diarrhea is a leading cause of morbidity and mortality among children under five years of age. The Lives Saved Tool (LiST) is a model used to calculate deaths averted or lives saved by past interventions and for the purposes of program planning when costly and time consuming impact studies are not possible.

DISCUSSION

LiST models the relationship between coverage of interventions and outputs, such as stunting, diarrhea incidence and diarrhea mortality. Each intervention directly prevents a proportion of diarrhea deaths such that the effect size of the intervention is multiplied by coverage to calculate lives saved. That is, the maximum effect size could be achieved at 100% coverage, but at 50% coverage only 50% of possible deaths are prevented. Diarrhea mortality is one of the most complex causes of death to be modeled. The complexity is driven by the combination of direct prevention and treatment interventions as well as interventions that operate indirectly via the reduction in risk factors, such as stunting and wasting. Published evidence is used to quantify the effect sizes for each direct and indirect relationship. Several studies have compared measured changes in mortality to LiST estimates of mortality change looking at different sets of interventions in different countries. While comparison work has generally found good agreement between the LiST estimates and measured mortality reduction, where data availability is weak, the model is less likely to produce accurate results. LiST can be used as a component of program evaluation, but should be coupled with more complete information on inputs, processes and outputs, not just outcomes and impact.

SUMMARY

LiST is an effective tool for modeling diarrhea mortality and can be a useful alternative to large and expensive mortality impact studies. Predicting the impact of interventions or comparing the impact of more than one intervention without having to wait for the results of large and expensive mortality studies is critical to keep programs focused and results oriented for continued reductions in diarrhea and all-cause mortality among children under five years of age.

Overview of the Lives Saved Tool (LiST)

This paper provides an overview of the historical development and current status of the Lives Saved Tool (LiST). The paper provides a general explanation of the modeling approach used in the model with links to web sites and other articles with more details. It also details the development process in developing both the model structure as well as the assumptions used in the model. The paper provides information about how LiST has been and is currently being used by various organizations and within national health programs. We also provide a review of the work that has been done to try to validate the outputs of the model.