Designing and evaluating a novel mobile application for Helping Babies Breathe skills retention in Uganda: comparative study protocol

Utilization of a novel mobile application, "HBB Prompt", to reduce Helping Babies Breathe skills decay

BACKGROUND

Helping Babies Breathe (HBB) is a newborn resuscitation training program designed to reduce neonatal mortality in low- and middle-income countries. However, skills decay after initial training is a significant barrier to sustained impact.

OBJECTIVE

To test whether a mobile app, HBB Prompt, developed with user-centred design, helps improve skills and knowledge retention after HBB training.

METHODS

HBB Prompt was created during Phase 1 of this study with input from HBB facilitators and providers from Southwestern Uganda recruited from a national HBB provider registry. During Phase 2, healthcare workers (HCWs) in two community hospitals received HBB training. One hospital was randomly assigned as the intervention hospital, where trained HCWs had access to HBB Prompt, and the other served as control without HBB Prompt (NCT03577054). Participants were evaluated using the HBB 2.0 knowledge check and Objective Structured Clinical Exam, version B (OSCE B) immediately before and after training, and 6 months post-training. The primary outcome was difference in OSCE B scores immediately after training and 6 months post-training.

RESULTS

Twenty-nine HCWs were trained in HBB (17 in intervention, 12 in control). At 6 months, 10 HCW were evaluated in intervention and 7 in control. In intervention and control respectively, the median OSCE B scores were: 7 vs. 9 immediately before training, 17 vs. 21 immediately after training, and 12 vs. 13 at 6 months after training. Six months after training, the median difference in OSCE B scores was -3 (IQR -5 to -1) in intervention and -8 (IQR -11 to -6) in control (p = 0.02).

CONCLUSION

HBB Prompt, a mobile app created by user-centred design, improved retention of HBB skills at 6 months. However, skills decay remained high 6 months after training. Continued adaptation of HBB Prompt may further improve maintenance of HBB skills.

Time to improve documentation of neonatal resuscitation: a narrative review

A complete, objective and systematic documentation of delivery room resuscitation is important for research, for quality improvement, for teaching and as a reference for postresuscitation care. However, documentation during neonatal resuscitation is usually paper-based, retrospective, inaccurate and unreliable. In this narrative review, we discuss the strengths and pitfalls of current documentation methods in neonatal resuscitation, as well as the challenges of introducing new or emerging technologies in this field. In particular, we discuss innovations in electronic and automated medical records, video recording and Smartphones and Tablet Apps. Given the lack of a consensus standard, we finally propose a list of items that should be part of any neonatal resuscitation documentation method.

eHBB: a randomised controlled trial of virtual reality or video for neonatal resuscitation refresher training in healthcare workers in resource-scarce settings

OBJECTIVE

To assess the impact of mobile virtual reality (VR) simulations using electronic Helping Babies Breathe (eHBB) or video for the maintenance of neonatal resuscitation skills in healthcare workers in resource-scarce settings.

DESIGN

Randomised controlled trial with 6-month follow-up (2018-2020).

SETTING

Secondary and tertiary healthcare facilities.

PARTICIPANTS

274 nurses and midwives assigned to labour and delivery, operating room and newborn care units were recruited from 20 healthcare facilities in Nigeria and Kenya and randomised to one of three groups: VR (eHBB+digital guide), video (video+digital guide) or control (digital guide only) groups before an in-person HBB course.

INTERVENTIONS

eHBB VR simulation or neonatal resuscitation video.

MAIN OUTCOMES

Healthcare worker neonatal resuscitation skills using standardised checklists in a simulated setting at 1 month, 3 months and 6 months.

RESULTS

Neonatal resuscitation skills pass rates were similar among the groups at 6-month follow-up for bag-and-mask ventilation (BMV) skills check (VR 28%, video 25%, control 22%, p=0.71), objective structured clinical examination (OSCE) A (VR 76%, video 76%, control 72%, p=0.78) and OSCE B (VR 62%, video 60%, control 49%, p=0.18). Relative to the immediate postcourse assessments, there was greater retention of BMV skills at 6 months in the VR group (-15% VR, p=0.10; -21% video, p<0.01, -27% control, p=0.001). OSCE B pass rates in the VR group were numerically higher at 3 months (+4%, p=0.64) and 6 months (+3%, p=0.74) and lower in the video (-21% at 3 months, p<0.001; -14% at 6 months, p=0.066) and control groups (-7% at 3 months, p=0.43; -14% at 6 months, p=0.10). On follow-up survey, 95% (n=65) of respondents in the VR group and 98% (n=82) in the video group would use their assigned intervention again.

CONCLUSION

eHBB VR training was highly acceptable to healthcare workers in low-income to middle-income countries and may provide additional support for neonatal resuscitation skills retention compared with other digital interventions.

Development of a novel mobile application, HBB Prompt, with human factors and user-centred design for Helping Babies Breathe skills retention in Uganda

BACKGROUND

Helping Babies Breathe (HBB) is a life-saving program that has helped reduce neonatal morbidity and mortality, but knowledge and skills retention after training remains a significant challenge for sustainability of impact. User-centred design (UCD) can be used to develop solutions to target knowledge and skills maintenance.

METHODS

We applied a process of UCD beginning with understanding the facilitators of, and barriers to, learning and retaining HBB knowledge and skills. HBB Master Trainers and frontline HBB providers participated in a series of focus group discussions (FGDs) to uncover the processes of skills acquisition and maintenance to develop a mobile application called "HBB Prompt". Themes derived from each FGD were identified and implications for development of the HBB Prompt app were explored, including feasibility of incorporating strategies into the format of an app. Data analysis took place after each iteration in Phase 1 to incorporate feedback and improve subsequent versions of HBB Prompt.

RESULTS

Six HBB trainers and seven frontline HBB providers participated in a series of FGDs in Phase 1 of this study. Common themes included lack of motivation to practise, improving confidence in ventilation skills, ability to achieve the Golden Minute, fear of forgetting knowledge or skills, importance of feedback, and peer-to-peer learning. Themes identified that were not feasible to address pertained to health system challenges. Feedback about HBB Prompt was generally positive. Based on initial and iterative feedback, HBB Prompt was created with four primary functions: Training Mode, Simulation Mode, Quizzes, and Dashboard/Scoreboard.

CONCLUSIONS

Developing HBB Prompt with UCD to help improve knowledge and skills retention was feasible and revealed key concepts, including drivers for successes and challenges faced for learning and maintaining HBB skills. HBB Prompt will be piloted in Phase 2 of this study, where knowledge and skills retention after HBB training will be compared between an intervention group with HBB Prompt and a control group without the app. Trial registration Clinicaltrials.gov (NCT03577054). Retrospectively registered July 5, 2018, https://clinicaltrials.gov/ct2/show/study/NCT03577054 .

Innovations in Cardiorespiratory Monitoring to Improve Resuscitation With Helping Babies Breathe

Ninety percent of intrapartum-related neonatal deaths are attributable to respiratory depression, with the vast majority of these deaths occurring in low- and lower-middle-income countries. Neonatal resuscitation training with Helping Babies Breathe (HBB) decreases mortality from respiratory depression. Cardiorespiratory monitoring in conjunction with HBB can provide valuable resuscitation feedback for both training and bedside purposes. In this article, we discuss 3 innovations that couple cardiorespiratory monitoring with HBB: NeoNatalie Live, the Augmented Infant Resuscitator, and NeoBeat. NeoNatalie Live is a high-fidelity manikin that facilitates bag mask ventilation training through case scenarios of varying difficulty. The Augmented Infant Resuscitator is added in-line between a face mask and ventilation bag during bag mask ventilation training to provide users with real-time feedback on ventilation quality. NeoBeat is a battery-operated heart rate meter that digitally displays the newborn heart rate during bedside resuscitations. For each innovation, we review details of the device, implementation in the field, and areas for further research. Using early experience implementing these devices, we suggest building blocks for effective translation of training into improved care. We also highlight general challenges in implementation of devices in facilities in low- and lower-middle-income countries including considerations for training, adaptations to existing workflow, and integration into the ecosystem. Although the devices highlighted in this article hold promise, more data are needed to understand their impact on newborn outcomes.

Digital Health Innovations, Tools, and Resources to Support Helping Babies Survive Programs

The Helping Babies Survive (HBS) initiative features a suite of evidence-based curricula and simulation-based training programs designed to provide health workers in low- and middle-income countries (LMICs) with the knowledge, skills, and competencies to prevent, recognize, and manage leading causes of newborn morbidity and mortality. Global scale-up of HBS initiatives has been rapid. As HBS initiatives rolled out across LMIC settings, numerous bottlenecks, gaps, and barriers to the effective, consistent dissemination and implementation of the programs, across both the pre- and in-service continuums, emerged. Within the first decade of expansive scale-up of HBS programs, mobile phone ownership and access to cellular networks have also concomitantly surged in LMICs. In this article, we describe a number of HBS digital health innovations and resources that have been developed from 2010 to 2020 to support education and training, data collection for monitoring and evaluation, clinical decision support, and quality improvement. Helping Babies Survive partners and stakeholders can potentially integrate the described digital tools with HBS dissemination and implementation efforts in a myriad of ways to support low-dose high-frequency skills practice, in-person refresher courses, continuing medical and nursing education, on-the-job training, or peer-to-peer learning, and strengthen data collection for key newborn care and quality improvement indicators and outcomes. Thoughtful integration of purpose-built digital health tools, innovations, and resources may assist HBS practitioners to more effectively disseminate and implement newborn care programs in LMICs, and facilitate progress toward the achievement of Sustainable Development Goal health goals, targets, and objectives.

Achieving Country-Wide Scale for Helping Babies Breathe and Helping Babies Survive

Helping Babies Breathe (HBB) was piloted in 2009 as a program targeted to reduce neonatal mortality (NM). The program has morphed into a suite of programs termed Helping Babies Survive that includes Essential Care for Every Baby. Since 2010, the HBB and Helping Babies Survive training programs have been taught to >850 000 providers in 80 countries. Initial HBB training is associated with a significant improvement in knowledge and skills. However, at refresher training, there is a knowledge-skill gap evident, with a falloff in skills. Accumulating evidence supports the role for frequent refresher resuscitation training in facilitating skills retention. Beyond skill acquisition, HBB has been associated with a significant reduction in early NM (<24 hours) and fresh stillbirth rates. To evaluate the large-scale impact of the growth of skilled birth attendants, we analyzed NM rates in sub-Saharan Africa (n = 11) and Nepal (as areas of growing HBB implementation). All have revealed a consistent reduction in NM at 28 days between 2009 and 2018; a mean reduction of 5.34%. The number of skilled birth attendants, an indirect measure of HBB sustained rollout, reveals significant correlation with NM, fresh stillbirth, and perinatal mortality rates, highlighting HBB's success and the need for continued efforts to train frontline providers. A novel live newborn resuscitation trainer as well as a novel app (HBB Prompt) have been developed, increasing knowledge and skills while providing simulation-based repeated practice. Ongoing challenges in sustaining resources (financial and other) for newborn programming emphasize the need for innovative implementation strategies and training tools.

Implementation of the Helping Babies Breathe Training Program: A Systematic Review

CONTEXT

Helping Babies Breathe (HBB) is a well-established neonatal resuscitation program designed to reduce newborn mortality in low-resource settings.

OBJECTIVES

In this literature review, we aim to identify challenges, knowledge gaps, and successes associated with each stage of HBB programming.

DATA SOURCES

Databases used in the systematic search included Medline, POPLINE, Cumulative Index to Nursing and Allied Health Literature, Latin American and Caribbean Health Sciences Literature, African Index Medicus, Cochrane, and Index Medicus.

STUDY SELECTION

All articles related to HBB, in any language, were included. Article quality was assessed by using the Grading of Recommendations Assessment, Development, and Evaluation framework.

DATA EXTRACTION

Data were extracted if related to HBB, including its implementation, acquisition and retention of HBB knowledge and skills, changes in provider behavior and clinical care, or the impact on newborn outcomes.

RESULTS

Ninety-four articles met inclusion criteria. Barriers to HBB implementation include staff turnover and limited time or focus on training and practice. Researchers of several studies found HBB cost-effective. Posttraining decline in knowledge and skills can be prevented with low-dose high-frequency refresher trainings, on-the-job practice, or similar interventions. Impact of HBB training on provider clinical practices varies. Although not universal, researchers in multiple studies have shown a significant association of decreased perinatal mortality with HBB implementation.

LIMITATIONS

In addition to not conducting a gray literature search, articles relating only to Essential Care for Every Baby or Essential Care for Small Babies were not included in this review.

CONCLUSIONS

Key challenges and requirements for success associated with each stage of HBB programming were identified. Despite challenges in obtaining neonatal mortality data, the program is widely believed to improve neonatal outcomes in resource-limited settings.

First-step validation of a text message-based application for newborn clinical management among pediatricians

BACKGROUND

Neonatal mortality is high in developing countries. Lack of adequate training and insufficient management skills for sick newborn care contribute to these deaths. We developed a phone application dubbed Protecting Infants Remotely by Short Message Service (PRISMS). The PRISMS application uses routine clinical assessments with algorithms to provide newborn clinical management suggestions. We measured the feasibility, acceptability and efficacy of PRISMS by comparing its clinical case management suggestions with those of experienced pediatricians as the gold standard.

METHODS

Twelve different newborn case scenarios developed by pediatrics residents, based on real cases they had seen, were managed by pediatricians and PRISMS®. Each pediatrician was randomly assigned six of twelve cases. Pediatricians developed clinical case management plans for all assigned cases and then obtained PRISMS suggested clinical case managements. We calculated percent agreement and kappa (k) statistics to test the null hypothesis that pediatrician and PRISMS management plans were independent.

RESULTS

We found high level of agreement between pediatricians and PRISMS for components of newborn care including: 10% dextrose (Agreement = 73.8%), normal saline (Agreement = 73.8%), anticonvulsants (Agreement = 100%), blood transfusion (Agreement =81%), phototherapy (Agreement = 90.5%), and supplemental oxygen (agreement = 69.1%). However, we found poor agreement with potential investigations such as complete blood count, blood culture and lumbar puncture. PRISMS had a user satisfaction score of 3.8 out of 5 (range 1 = strongly disagree, 5 = strongly agree) and an average PRISMS user experience score of 4.1 out of 5 (range 1 = very bad, 5 = very good).

CONCLUSION

Management plans for newborn care from PRISMS showed good agreement with management plans from experienced Pediatricians. We acknowledge that the level of agreement was low in some aspects of newborn care.