Combining cluster surveys to estimate vaccination coverage: Experiences from Nigeria's multiple indicator cluster survey / national immunization coverage survey (MICS/NICS), 2016-17

Antenatal care coverage and early childhood mortality in Zimbabwe: new interpretations from nationally representative household surveys

Zimbabwe has implemented universal antenatal care (ANC) policies since 1980 that have significantly contributed to improvements in ANC access and early childhood mortality rates. However, Demographic and Health Surveys (DHS) and Multiple Indicator Cluster Surveys (MICS), two of Zimbabwe's main sources of health data and evidence, often provide seemingly different estimates of ANC coverage and under-five mortality rates. This creates confusion that can result in disparate policies and practices, with potential negative impacts on mother and child health in Zimbabwe. We conducted a comparability analysis of multiple DHS and MICS datasets to enhance the understanding of point estimates, temporal changes, rural-urban differences and reliability of estimates of ANC coverage and neonatal, infant and under-five mortality rates (NMR, IMR and U5MR, separately) from 2009 to 2019 in Zimbabwe. Our two samples z-tests revealed that both DHS and MICS indicated significant increases in ANC coverage and declines in IMR and U5MR but only from 2009 to 2015. NMR neither increased nor declined from 2009 to 2019. Rural-urban differences were significant for ANC coverage (2009-15 only) but not for NMR, IMR and U5MR. We found that there is a need for more precise DHS and MICS estimates of urban ANC coverage and all estimates of NMR, IMR and U5MR, and that shorter recall periods provide more reliable estimates of ANC coverage in Zimbabwe. Our findings represent new interpretations and clearer insights into progress and gaps around ANC coverage and under-five mortality rates that can inform the development, implementation, monitoring and evaluation of policy and practice responses and further research in Zimbabwe.

A Practical Guide to Pilot Testing Community-Based Vaccination Coverage Surveys

Pilot testing is crucial when preparing any community-based vaccination coverage survey. In this paper, we use the term pilot test to mean informative work conducted before a survey protocol has been finalized for the purpose of guiding decisions about how the work will be conducted. We summarize findings from seven pilot tests and provide practical guidance for piloting similar studies. We selected these particular pilots because they are excellent models of preliminary efforts that informed the refinement of data collection protocols and instruments. We recommend survey coordinators devote time and budget to identify aspects of the protocol where testing could mitigate project risk and ensure timely assessment yields, credible estimates of vaccination coverage and related indicators. We list specific items that may benefit from pilot work and provide guidance on how to prioritize what to pilot test when resources are limited.

Routine Immunization Coverage and Immunization Card Retention in Pakistan: Results From a Cross-sectional National Survey

BACKGROUND

Immunization is one of the most successful public health interventions available, saving millions of lives from death and disability each year. Therefore, improving immunization coverage is a high priority for the Government of Pakistan and essential to progress toward universal health coverage. This survey reports the national and provincial/regional coverage and determinants of fully, partially, and not-vaccinated children 12-23 months of age, antigen-wise coverage, percentage of home-based vaccination records (HBR) retention, and reasons for nonretention; dropout, timeliness, and prevalence of missed opportunities for simultaneous vaccination (MOSV).

METHODS

The survey was a descriptive cross-sectional national household survey carried out across Pakistan. The survey included 110,790 children 12-23 months old and their caregivers. A World Health Organization (WHO)-Expanded Program on Immunization (EPI) Survey questionnaire was adapted to collect information. Data were analyzed using the WHO Vaccination Coverage Quality Indicators (VCQI) software and Stata version 17.

RESULTS

Nationally excluding Azad Jammu and Kashmir (AJK) and Gilgit Baltistan (GB), the coverage of fully vaccinated children was 76.5%. The likelihood of being fully vaccinated was higher among children of educated parents who belonged to higher wealth quintiles and resided in any province/region other than Balochistan. The main reasons for unimmunization were no faith in immunization, rumors about vaccines, and distance to the facility. About two-thirds (66.2%) of the children had their HBR available, and the main reasons for not having a card were never visiting a health facility and having no awareness about the importance of a card. Dropout was discernible for later doses of vaccines compared with earlier ones. Higher proportions of children received the last doses late by more than two months. Of the 218,002 vaccination visits documented on HBR in the provinces, MOSVs occurred in 17.6% of the visits.

CONCLUSION

The immunization coverage rates provide a direction to strategize the progress to improve the vaccination rates in Pakistan. The country needs to outline the immediate and long-term actions to combat vaccine-preventable diseases, such as escalating integrated immunization campaigns and outreach activities, provision of mobility support, and deploying behavioral interventions as a cross-cutting strategy to improve awareness and reduce misconceptions.

Pairs of independent nationally representative vaccination coverage surveys conducted within one year of each other: A global overview covering 2000-2019

Background

Population-based surveys play an important role in measuring vaccination coverage. Surveys measuring vaccination coverage may be commissioned by the Expanded Programme on Immunization (EPI surveys) or part of multi-domain non-EPI surveys such as Demographic and Health Surveys (DHS) or Multiple Indicator Cluster Surveys (MICS). Surveys conducted too close in time to each other may not only be an inefficient use of resources but may also create problems for programme staff when results suggest inconsistent patterns of programme performance for similar time periods.

Objective

To summarize the occurrence of vaccination coverage surveys conducted close in time during 2000–2019 and compare results of EPI and non-EPI coverage surveys when the surveys were conducted within one year of each other.

Methods

Using a database of published national-level vaccination coverage survey results compiled by the World Health Organization (WHO) and the United Nations Children’s Fund (UNICEF), the authors abstracted information on survey field work dates, sample size, percentage of children with documented history of vaccination and the percent coverage, as well as published uncertainty intervals from DHS and MICS, for the first and third doses of diphtheria-tetanus toxoid-pertussis containing vaccine (DTP1, DTP3) and first dose of measles containing vaccine (MCV1). Survey results of EPI and non-EPI surveys were compared.

Results

The authors identified 646 surveys with final reports and estimates of national-level vaccination coverage for DTP1, DTP3, or MCV1 from a total of 687 surveys with data collection start date from 2000 to 2019. Of the 140 countries with at least one vaccination coverage survey, a median of four surveys was observed. Most countries were Gavi-eligible and located in the WHO Africa Region. Sixty-six survey dyads were identified where an EPI survey occurred within one year of a non-EPI survey. For the 66 dyads, in 49 of 59 with information available, EPI surveys reported higher proportion of documented evidence of vaccination and EPI survey results tended to suggest higher levels of vaccination coverage compared to the non-EPI surveys; quite often, differences were substantial. Surveys that found higher proportions of children with documented vaccination evidence tended to also find higher proportions of children who had been vaccinated.

Summary

Opportunities exist to improve overall planning of vaccination coverage measurement in population-based household surveys so that both EPI and non-EPI surveys are more comparable and survey coverage estimates are more appropriately spaced in time. When surveys occur too close in time, careful attention is warranted to ensure comparability and assess sources of documented evidence of vaccination and related coverage differences.

Implementing WHO guidance on conducting and analysing vaccination coverage cluster surveys: Two examples from Nigeria

In 2015, the World Health Organization substantially revised its guidance for vaccination coverage cluster surveys (revisions were finalized in 2018) and has since developed a set of accompanying resources, including definitions for standardized coverage indicators and software (named the Vaccination Coverage Quality Indicators—VCQI) to calculate them.–The current WHO vaccination coverage survey manual was used to design and conduct two nationally representative vaccination coverage surveys in Nigeria–one to assess routine immunization and one to measure post-measles campaign coverage. The primary analysis for both surveys was conducted using VCQI. In this paper, we describe those surveys and highlight some of the analyses that are facilitated by the new resources. In addition to calculating coverage of each vaccine-dose by age group, VCQI analyses provide insight into several indicators of program quality such as crude coverage versus valid doses, vaccination timeliness, missed opportunities for simultaneous vaccination, and, where relevant, vaccination campaign coverage stratified by several parameters, including the number of previous doses received. The VCQI software furnishes several helpful ways to visualize survey results. We show that routine coverage of all vaccines is far below targets in Nigeria and especially low in northeast and northwest zones, which also have highest rates of dropout and missed opportunities for vaccination. Coverage in the 2017 measles campaign was higher and showed less geospatial variation than routine coverage. Nonetheless, substantial improvement in both routine program performance and campaign implementation will be needed to achieve disease control goals.

Impact of state weights on national vaccination coverage estimates from household surveys in Nigeria

National vaccination coverage estimates from household surveys are widely used in monitoring and planning of immunization programs. In Nigeria, survey-reported national coverage estimates have shown large fluctuations in the past few years. In this paper, we examine the impact of state-level survey weighting on Nigeria's national vaccination coverage estimation. In particular, we focus three vaccination-related outcomes among children aged 12-23 months: the coverage of the third dose of diphtheria, pertussis, and tetanus vaccine (DPT3); the coverage of the first dose of measles-containing vaccine (MCV1); and the availability rate of home-based vaccination record (HBR). We compare the sample selection and weight assignment of three major survey programs in Nigeria, and show that considerable portions of the changes in survey-reported national coverage estimates can be explained by shifts in state-level weights. Our analysis demonstrates the importance of state weighting method in estimating aggregated national coverage figures and provides important context for interpreting changes in coverage estimates between surveys in the future.