Survey of women's report for 33 maternal and newborn indicators: EN-BIRTH multi-country validation study

Introducing a standardised register for strengthening the inpatient management of newborns and sick children: Implementation research in selected health facilities of Bangladesh

Background

It is imperative to maintain accurate documentation of clinical interventions aimed at enhancing the quality of care for newborns and sick children. The National Newborn Health and IMCI programme of Bangladesh led the development of a standardised register for managing newborns and sick children under five years of age during inpatient care through stakeholder engagement. We aimed to assess the implementation outcomes of the standardised register in the inpatient department.

Methods

We conducted implementation research in two district hospitals and two sub-district hospitals of Kushtia and Dinajpur districts from November 2022 to January 2023 to assess the implementation outcomes of the standardised register. We assessed the following World Health Organization implementation outcome variables: usability, acceptability, adoption (actual use), fidelity (completeness and accuracy), and utility (quality of care) of the register against preset benchmarks. We collected data through structured interviews with health care providers; participant enrolment; and data extraction from inpatient registers and case record forms.

Results

The average usability and acceptability scores among health care providers were 73 (standard deviation (SD) = 14) and 82 (SD = 14) out of 100, respectively. The inpatient register recorded 96% (95% confidence interval (CI) = 95-97) of under-five children who were admitted to the inpatient department (adoption - actual use). The proportions of completed data elements in the inpatient register were above the preset benchmark of 70% for all the assessed data elements except 'investigation done' (24%; 95% CI = 23-26) (fidelity - completeness). The percentage agreements between government-appointed nurses posted and study-appointed nurses were above the preset benchmark of 70% for all the reported variables (fidelity - accuracy). The kappa coefficient for the overall level of agreement between these two groups regarding reported variables indicated moderate to substantial agreement. The proportion of newborns with sepsis receiving injectable antibiotics was 62% (95% CI = 47-75) (utility - quality of care). We observed some variability in the completeness and accuracy of the inpatient register by district and facility type.

Conclusions

The inpatient register was positively received by health care providers, with evaluations of implementation outcome variables showing encouraging results. Our findings could inform evidence-based decision-making on the implementation and scale-up of the inpatient register in Bangladesh, as well as other low- and middle-income countries.

Effect of the Mamás del Río programme on essential newborn care: a three-year before-and-after outcome evaluation of a community-based, maternal and neonatal health intervention in the Peruvian Amazon

Background

Despite remarkable progress in maternal and neonatal health, regional inequalities persist in Peru. In rural areas of Amazonian Loreto, access to quality care is difficult, home births are frequent, and neonatal mortality is high. We conducted a prospective before-and-after study to assess the effect after implementation and over time of a community-based intervention on essential newborn care (ENC).

Methods

Mamás del Río consists of tablet-enhanced educational home visits by Community health workers (CHW) to pregnant women and mothers of newborns, with supportive training on ENC of traditional birth attendants and facility staff. The study area comprised 79 rural communities of three districts in Loreto. Primary outcomes were ENC practices in home births, secondary outcomes were ENC in facility births as well as healthcare seeking, measured at baseline before and at year 2 and year 3 after intervention implementation. Community censuses included questionnaires to women aged 15-49 years with a live birth. We calculated prevalence of outcomes at each time point and estimated adjusted prevalence differences (PD) between time points using post-estimation based on logistic regression.

Findings

Following implementation early 2019, 97% of communities had a trained CHW. At year 2 follow-up, 63% (322/530) of women received a CHW visit during pregnancy. Seven out of nine ENC indicators among home births improved, with largest adjusted prevalence differences in immediate skin-to-skin contact (50% [95% CI: 42-58], p < 0.0001), colostrum feeding (45% [35-54], p < 0.0001), and cord care (19% [10-28], p = 0.0001). Improvements were maintained at year 3, except for cord care. At year 2, among facility births only three ENC indicators improved, while more women gave birth in a facility. Sensitivity analyses showed ENC prevalence was similar before compared to after onset of Covid-19 lockdown.

Interpretation

ENC practices in home births improved consistently and changes were sustained over time, despite the onset of the Covid-19 pandemic. A community-based approach for behaviour-change in home-based newborn care appears effective. Process evaluation of mechanisms will help to explain observed effects and understand transferability of findings.

Funding

Grand Challenges Canada and Peruvian National Council of Science and Technology.

Prevalence of essential newborn care in home and facility births in the Peruvian Amazon: analysis of census data from programme evaluation in three remote districts of the Loreto region

Background

Essential newborn care (ENC) covers optimal breastfeeding, thermal care, and hygienic cord care. These practices are fundamental to save newborn lives. Despite neonatal mortality remaining high in some parts of Peru, no comprehensive data on ENC is available. We sought to estimate the prevalence of ENC and assess differences between facility and home births in the remote Peruvian Amazon.

Methods

We used baseline data from a household census of rural communities of three districts in Loreto region, collected as part of the evaluation of a maternal-neonatal health (MNH) programme. Women between 15 and 49 years with a live birth in the last 12 months were invited to complete a questionnaire about MNH-related care and ENC. Prevalence of ENC was calculated for all births and disaggregated by place of birth. Adjusted prevalence differences (PD) were post-estimated from logistic regression models on the effect of place of birth on ENC.

Findings

All 79 rural communities with a population of 14,474 were censused. Among 324 (>99%) women interviewed, 70% gave birth at home, most (93%) without skilled birth assistance. Among all births, prevalence was lowest for immediate skin-to-skin contact (24%), colostrum feeding (47%), and early breastfeeding (64%). ENC was consistently lower in home compared to facility births. After adjusting for confounders, largest PD were found for immediate skin-to-skin contact (50% [95% CI: 38-62]), colostrum feeding (26% [16-36]), and clean cord care (23% [14-32]). ENC prevalence in facilities ranged between 58 and 93%; delayed bathing was lower compared to home births (-19% [-31 to -7]).

Interpretation

Low prevalence of ENC practices among home births in a setting with high neonatal mortality and difficult access to quality care in facilities suggests potential for a community-based intervention to promote ENC practices at home, along with promotion of healthcare seeking and simultaneous strengthening of routine facility care.

Funding

Grand Challenges Canada and Peruvian National Council of Science, Technology, and Technology Innovation.

How valid are women's reports of the antenatal health services they receive from Community Health Workers in Gombe State north-eastern Nigeria?

BACKGROUND

Community health workers (CHWs) in low- and middle-income countries are key to increasing coverage of maternal and newborn interventions through home visits to counsel families about healthy behaviours. Household surveys enable tracking the progress of CHW programmes but recent evidence questions the accuracy of maternal reports. We measured the validity of women's responses about the content of care they received during CHW home visits and examined whether the accuracy of women's responses was affected by CHW counselling skills.

METHODS

We conducted a criterion validity study in 2019, in Gombe State-Nigeria, and collected data from 362 pregnant women. During accompanied CHW home visits the content of CHW care and the presence or absence of 18 positive counselling skills were observed and documented by a researcher. In a follow-up interview three months later, the same women were asked about the care received during the CHW home visit. Women's reports were compared with observation data and the sensitivity, specificity, and area under receiver curve (AUC) calculated. We performed a covariate validity analysis that adjusted for a counselling skill score to assess the variation in accuracy of women's reports with CHW counselling skills.

RESULTS

Ten indicators were included in the validity analysis. Women consistently overestimated the content of care CHWs provided and no indicator met the condition for individual-level accuracy set at AUC ≥ 0.6. The CHW counselling skill score ranged from 9-18 points from a possible 18, with a mean of 14.3; checking on client history or concerns were the most frequently missed item. There was evidence that unmarried women and the relatively most poor women received less skilled counselling than other women (mean counselling scores of 13.2 and 13.7 respectively). There was no consistent evidence of an association between higher counselling skill scores and better accuracy of women's reports.

CONCLUSIONS

The validity of women's responses about CHW care content was poor and consistently overestimated coverage. We discuss several challenges in applying criterion validity study methods to examine measures of community-based care and make only cautious interpretation of the findings that may be relevant to other researchers interested in developing similar studies.

Introducing pulse oximetry in routine IMCI services in Bangladesh: A context-driven approach to influence policy and programme through stakeholder engagement

Background

An estimated 7 million episodes of severe newborn infections occur annually worldwide, with half a million newborn deaths, most occurring in low- and middle-income countries. Whilst injectable antibiotics are necessary to treat the infection, supportive care is also crucial in ending preventable mortality and morbidity. This study uses multi-country data to assess gaps in coverage, quality, and documentation of supportive care, considering implications for measurement.

Methods

The EN-BIRTH study was conducted in five hospitals in Bangladesh, Nepal, and Tanzania (July 2017-July 2018). Newborns with an admission diagnosis of clinically-defined infection (sepsis, meningitis, and/or pneumonia) were included. Researchers extracted data from inpatient case notes and interviews with women (usually the mothers) as the primary family caretakers after discharge. The interviews were conducted using a structured survey questionnaire. We used descriptive statistics to report coverage of newborn supportive care components such as oxygen use, phototherapy, and appropriate feeding, and we assessed the validity of measurement through survey-reports using a random-effects model to generate pooled estimates. In this study, key supportive care components were assessment and correction of hypoxaemia, hyperbilirubinemia, and hypoglycaemia.

Results

Among 1015 neonates who met the inclusion criteria, 89% had an admission clinical diagnosis of sepsis. Major gaps in documentation and care practices related to supportive care varied substantially across the participating hospitals. The pooled sensitivity was low for the survey-reported oxygen use (47%; 95% confidence interval (CI) = 30%-64%) and moderate for phototherapy (60%; 95% CI = 44%-75%). The pooled specificity was high for both the survey-reported oxygen use (85%; 95% CI = 80%-89%) and phototherapy (91%; 95% CI = 82%-97%).

Conclusions

The women's reports during the exit survey consistently underestimated the coverage of supportive care components for managing infection. We have observed high variability in the inpatient documents across facilities. A standardised ward register for inpatient small and sick newborn care may capture selected supportive care data. However, tracking the detailed care will require standardised individual-level data sets linked to newborn case notes. We recommend investments in assessing the implementation aspects of a standardised inpatient register in resource-poor settings.

Household Survey Measurement of Newborn Postnatal Care: Coverage, Quality Gaps, and Internal Inconsistencies in Responses

Reliable measurement of postnatal content of care is currently lacking despite the critical importance of care in this vulnerable period. We found that there is a large quality-coverage gap with missed opportunities for quality care as well as internal inconsistencies in responses to newborn questions.

Background:

Reliable measurement of newborn postnatal care is essential to understand gaps in coverage and quality and thereby improve outcomes. This study examined gaps in coverage and measurement of newborn postnatal care in the first 2 days of life.

Methods:

We analyzed Demographic and Health Survey data from 15 countries for 71,366 births to measure the gap between postnatal contact coverage and content coverage within 2 days of birth. Coverage was a contact with the health system in the first 2 days (postnatal check or newborn care intervention), and quality was defined as reported receipt of 5 health worker-provided interventions. We examined internal consistency between interrelated questions regarding examination of the umbilical cord.

Results:

Reported coverage of postnatal check ranged from 13% in Ethiopia to 78% in Senegal. Report of specific newborn care interventions varied widely by intervention within and between countries. Quality-coverage gaps were high, ranging from 26% in Malawi to 89% in Burundi. We found some internally inconsistent reporting of newborn care. The percentage of women who reported that a health care provider checked their newborn's umbilical cord but responded “no” to the postnatal check question was as high as 16% in Malawi.

Conclusion:

Reliable measurement of coverage and content of early postnatal newborn care is essential to track progress in improving quality of care. Postnatal contact coverage is challenging to measure because it may be difficult for women to distinguish postnatal care from intrapartum care and it is a less recognizable concept than antenatal care. Co-coverage measures may provide a useful summary of contact and content, reflecting both coverage and an aspect of quality.

Comparability of family planning quality of care measurement tools in low-and-middle income country settings: a systematic review

BACKGROUND

In low-and-middle income countries (LMICs), accurate measures of the elements of quality care provided by a health worker through family planning services (also known as process quality) are required to ensure family's contraceptives needs are being met. There are many tools used to assess family planning process quality of care (QoC) but no one standardized method. Those measuring QoC in LMICs should select an appropriate tool based the program context and financial/logistical parameters, but they require data on how well each tool measures routine clinical care. We aim to synthesize the literature on validity/comparability of family planning process QoC measurement tools through a quantitative systematic review with no meta-analysis.

METHODS

We searched six literature databases for studies that compared quality measurements from different tools using quantitative statistics such as sensitivity/specificity, kappa statistic or absolute difference. We extracted the comparative measure along with other relevant study information, organized by quality indicator domain (e.g. counseling and privacy), and then classified the measure by low, medium, and high agreement.

RESULTS

We screened 8172 articles and identified eight for analysis. Studies comparing quality measurements from simulated clients, direct observation, client exit interview, provider knowledge quizzes, and medical record review were included. These eight studies were heterogenous in their methods and the measurements compared. There was insufficient data to estimate overall summary measures of validity for the tools. Client exit interviews compared to direct observation or simulated client protocols had the most data and they were a poor proxy of the actual quality care received for many measurements.

CONCLUSION

To measure QoC consistently and accurately in LMICs, standardized tools and measures are needed along with an established method of combining them for a comprehensive picture of quality care. Data on how different tools proxy quality client care will inform these guidelines. Despite the small number of studies found during the review, we described important differences on how tools measure quality of care.

Equity in newborn care, evidence from national surveys in low- and middle-income countries

BACKGROUND

High coverage of care is essential to improving newborn survival; however, gaps exist in access to timely and appropriate newborn care between and within countries. In high mortality burden settings, health inequities due to social and economic factors may also impact on newborn outcomes. This study aimed to examine equity in co-coverage of newborn care interventions in low- and low middle-income countries in sub-Saharan Africa and South Asia.

METHODS

We analysed secondary data from recent Demographic and Health Surveys in 16 countries. We created a co-coverage index of five newborn care interventions. We examined differences in coverage and co-coverage of newborn care interventions by country, place of birth, and wealth quintile. Using multilevel logistic regression, we examined the association between high co-coverage of newborn care (4 or 5 interventions) and social determinants of health.

RESULTS

Coverage and co-coverage of newborn care showed large between- and within-country gaps for home and facility births, with important inequities based on individual, family, contextual, and structural factors. Wealth-based inequities were smaller amongst facility births compared to non-facility births.

CONCLUSION

This analysis underlines the importance of facility birth for improved and more equitable newborn care. Shifting births to facilities, improving facility-based care, and community-based or pro-poor interventions are important to mitigate wealth-based inequities in newborn care, particularly in countries with large differences between the poorest and richest families and in countries with very low coverage of care.

Immediate newborn care and breastfeeding: EN-BIRTH multi-country validation study

BACKGROUND

Immediate newborn care (INC) practices, notably early initiation of breastfeeding (EIBF), are fundamental for newborn health. However, coverage tracking currently relies on household survey data in many settings. "Every Newborn Birth Indicators Research Tracking in Hospitals" (EN-BIRTH) was an observational study validating selected maternal and newborn health indicators. This paper reports results for EIBF.

METHODS

The EN-BIRTH study was conducted in five public hospitals in Bangladesh, Nepal, and Tanzania, from July 2017 to July 2018. Clinical observers collected tablet-based, time-stamped data on EIBF and INC practices (skin-to-skin within 1 h of birth, drying, and delayed cord clamping). To assess validity of EIBF measurement, we compared observation as gold standard to register records and women's exit-interview survey reports. Percent agreement was used to assess agreement between EIBF and INC practices. Kaplan Meier survival curves showed timing. Qualitative interviews were conducted to explore barriers/enablers to register recording.

RESULTS

Coverage of EIBF among 7802 newborns observed for ≥1 h was low (10.9, 95% CI 3.8-21.0). Survey-reported (53.2, 95% CI 39.4-66.8) and register-recorded results (85.9, 95% CI 58.1-99.6) overestimated coverage compared to observed levels across all hospitals. Registers did not capture other INC practices apart from breastfeeding. Agreement of EIBF with other INC practices was high for skin-to-skin (69.5-93.9%) at four sites, but fair/poor for delayed cord-clamping (47.3-73.5%) and drying (7.3-29.0%). EIBF and skin-to-skin were the most delayed and EIBF rarely happened after caesarean section (0.5-3.6%). Qualitative findings suggested that focusing on accuracy, as well as completeness, contributes to higher quality with register reporting.

CONCLUSIONS

Our study highlights the importance of tracking EIBF despite measurement challenges and found low coverage levels, particularly after caesarean births. Both survey-reported and register-recorded data over-estimated coverage. EIBF had a strong agreement with skin-to-skin but is not a simple tracer for other INC indicators. Other INC practices are challenging to measure in surveys, not included in registers, and are likely to require special studies or audits. Continued focus on EIBF is crucial to inform efforts to improve provider practices and increase coverage. Investment and innovation are required to improve measurement.

Neonatal resuscitation: EN-BIRTH multi-country validation study

BACKGROUND

Annually, 14 million newborns require stimulation to initiate breathing at birth and 6 million require bag-mask-ventilation (BMV). Many countries have invested in facility-based neonatal resuscitation equipment and training. However, there is no consistent tracking for neonatal resuscitation coverage.

METHODS

The EN-BIRTH study, in five hospitals in Bangladesh, Nepal, and Tanzania (2017-2018), collected time-stamped data for care around birth, including neonatal resuscitation. Researchers surveyed women and extracted data from routine labour ward registers. To assess accuracy, we compared gold standard observed coverage to survey-reported and register-recorded coverage, using absolute difference, validity ratios, and individual-level validation metrics (sensitivity, specificity, percent agreement). We analysed two resuscitation numerators (stimulation, BMV) and three denominators (live births and fresh stillbirths, non-crying, non-breathing). We also examined timeliness of BMV. Qualitative data were collected from health workers and data collectors regarding barriers and enablers to routine recording of resuscitation.

RESULTS

Among 22,752 observed births, 5330 (23.4%) babies did not cry and 3860 (17.0%) did not breathe in the first minute after birth. 16.2% (n = 3688) of babies were stimulated and 4.4% (n = 998) received BMV. Survey-report underestimated coverage of stimulation and BMV. Four of five labour ward registers captured resuscitation numerators. Stimulation had variable accuracy (sensitivity 7.5-40.8%, specificity 66.8-99.5%), BMV accuracy was higher (sensitivity 12.4-48.4%, specificity > 93%), with small absolute differences between observed and recorded BMV. Accuracy did not vary by denominator option. < 1% of BMV was initiated within 1 min of birth. Enablers to register recording included training and data use while barriers included register design, documentation burden, and time pressure.

CONCLUSIONS

Population-based surveys are unlikely to be useful for measuring resuscitation coverage given low validity of exit-survey report. Routine labour ward registers have potential to accurately capture BMV as the numerator. Measuring the true denominator for clinical need is complex; newborns may require BMV if breathing ineffectively or experiencing apnoea after initial drying/stimulation or subsequently at any time. Further denominator research is required to evaluate non-crying as a potential alternative in the context of respectful care. Measuring quality gaps, notably timely provision of resuscitation, is crucial for programme improvement and impact, but unlikely to be feasible in routine systems, requiring audits and special studies.