Utility and feasibility of integrating pulse oximetry into the routine assessment of young infants at primary care clinics in Karachi, Pakistan: a cross-sectional study

Aspects of triage for infants: a narrative review

Infants under 1 year old frequently visit the general practitioner with acute illnesses. Assessing the severity of illness in this group can be challenging as signs and symptoms may be observed in both sick and healthy infants. Current triage systems are primarily designed for older children and adults and have been validated mainly in high-prevalence settings, such as emergency departments. As a result, these systems often result in undertriage, which can lead to delayed treatment and adverse outcomes.

CONCLUSION

This review reports the existing triage and scoring systems, currently used in infants. We discuss the strengths and limitations of this systems. Furthermore, we explore how the integration of clinical features with vital signs, such as heart rate and oxygen saturation, can improve the accuracy of triage for infants. The BabyCheck, validated for use in primary care for infants under 6 months of age, and the use of pulse oximetry offer promising improvements. Further research is essential to develop and validate an optimal triage system for infants under one year of age in the general practitioner setting.

WHAT IS KNOWN

• Current triage systems are widely used in emergency departments but show limitations, especially when applied to infants. • These existing triage systems often result in undertriage or overtriage, which can lead to either unnecessary healthcare utilization or delayed treatment for serious conditions.

WHAT IS NEW

• Combining vital signs such as heart rate and oxygen saturation with clinical features, may improve the accuracy of triage systems for infants.

The Tools for Integrated Management of Childhood Illness (TIMCI) study protocol: a multi-country mixed-method evaluation of pulse oximetry and clinical decision support algorithms

Effective and sustainable strategies are needed to address the burden of preventable deaths among children under-five in resource-constrained settings. The Tools for Integrated Management of Childhood Illness (TIMCI) project aims to support healthcare providers to identify and manage severe illness, whilst promoting resource stewardship, by introducing pulse oximetry and clinical decision support algorithms (CDSAs) to primary care facilities in India, Kenya, Senegal and Tanzania. Health impact is assessed through: a pragmatic parallel group, superiority cluster randomised controlled trial (RCT), with primary care facilities randomly allocated (1:1) in India to pulse oximetry or control, and (1:1:1) in Tanzania to pulse oximetry plus CDSA, pulse oximetry, or control; and through a quasi-experimental pre-post study in Kenya and Senegal. Devices are implemented with guidance and training, mentorship, and community engagement. Sociodemographic and clinical data are collected from caregivers and records of enrolled sick children aged 0-59 months at study facilities, with phone follow-up on Day 7 (and Day 28 in the RCT). The primary outcomes assessed for the RCT are severe complications (mortality and secondary hospitalisations) by Day 7 and primary hospitalisations (within 24 hours and with referral); and, for the pre-post study, referrals and antibiotic. Secondary outcomes on other aspects of health status, hypoxaemia, referral, follow-up and antimicrobial prescription are also evaluated. In all countries, embedded mixed-method studies further evaluate the effects of the intervention on care and care processes, implementation, cost and cost-effectiveness. Pilot and baseline studies started mid-2021, RCT and post-intervention mid-2022, with anticipated completion mid-2023 and first results late-2023. Study approval has been granted by all relevant institutional review boards, national and WHO ethical review committees. Findings will be shared with communities, healthcare providers, Ministries of Health and other local, national and international stakeholders to facilitate evidence-based decision-making on scale-up.Study registration: NCT04910750 and NCT05065320.

Can machine learning methods be used for identification of at-risk neonates in low-resource settings? A prospective cohort study

INTRODUCTION

Timely identification of at-risk neonates (ARNs) in the community is essential to reduce mortality in low-resource settings. Tools such as American Academy of Pediatrics pulse oximetry (POx) and WHO Young Infants Clinical Signs (WHOS) have high specificity but low sensitivity to identify ARNs. Our aim was assessing the value of POx and WHOS independently, in combination and with machine learning (ML) from clinical features, to detect ARNs in a low/middle-income country.

METHODS

This prospective cohort study was conducted in a periurban community in Pakistan. Eligible live births were screened using WHOS and POx along with clinical information regarding pregnancy and delivery. The enrolled neonates were followed for 4 weeks of life to assess the vital status. The predictive value to identify ARNs, of POx, WHOS and an ML model using maternal and neonatal clinical features, was assessed.

RESULTS

Of 1336 neonates, 68 (5%) had adverse outcomes, that is, sepsis (n=40, 59%), critical congenital heart disease (n=2, 3%), severe persistent pulmonary hypertension (n=1), hospitalisation (n=8, 12%) and death (n=17, 25%) assessed at 4 weeks of life. Specificity of POx and WHOS to independently identify ARNs was 99%, with sensitivity of 19% and 63%,respectively. Combining both improved sensitivity to 70%, keeping specificity at 98%. An ML model using clinical variables had 44% specificity and 76% sensitivity. A staged assessment, where WHOS, POx and ML are sequentially used for triage, increased sensitivity to 85%, keeping specificity 75%. Using ML (when WHOS and POx negative) for community follow-up detected the majority of ARNs.

CONCLUSION

Classic screening, combined with ML, can help maximise identifying ARNs and could be embedded in low-resource clinical settings, thereby improving outcome. Sequential use of classic assessment and clinical ML identifies the most ARNs in the community, still optimising follow-up clinical care.

Feasibility and acceptability of the paediatric pulse oximeter in integrated management of neonatal and childhood illnesses (IMNCI) services by public health facilities: A qualitative study in rural Western India

Background

Pneumonia contributes to about 15% of child deaths globally, with 20% of the overall deaths occurring in India. Although WHO recommends the use of pulse oximeters (PO) in first-level facilities for early detection of child pneumonia in low- and middle-income countries (LMICs), this has not yet been implemented in India. We aimed to assess the feasibility and acceptability of introducing PO in integrated management of neonatal and childhood illnesses (IMNCI) services at primary health centres (PHC) in the rural Pune district.

Methods

We identified medical officers (MO) and auxiliary nurse midwives (ANM) from six PHCs as study participants due to their involvement in the treatment of children. We developed in-depth interview (IDI) guides for both groups to explore their IMNCI knowledge and attitude towards the program through a qualitative study. We conducted interviews with MOs (n = 6) and ANMs (n = 6) from each PHC. The PO module was added to explore perceptions about its usefulness in diagnosing pneumonia. After baseline assessment, we conducted training sessions on adapted IMNCI services (including PO use) for MOs and ANMs. PO devices were provided at the study PHCs.

Results

At baseline, no PO devices were being used at study PHCs; PHC staff demonstrated satisfactory knowledge about paediatric pneumonia management and demanded refresher IMNCI training. They also felt the need to reiterate the PO use for early diagnosis of pneumonia in children and highlighted the challenges encountered in managing pneumonia at PHCs, such as health system-related challenges and parents' attitudes towards care seeking. There was positive acceptance of training and PO started to be used immediately in PHCs. There was increased confidence in using PO at endline. PO use in examining symptomatic children increased from 26 to 85%.

Conclusions

Paediatric PO implementation could be integrated successfully at PHC levels; we found pre-implementation training and provision of PO to PHCs to be helpful in achieving this goal. This intervention demonstrated that an algorithm to diagnose pneumonia in children that included PO could improve case management.

Usability of pulse oximeters used by community health and primary care workers as screening tools for severe illness in children under five in low resource settings: A cross-sectional study in Cambodia, Ethiopia, South Sudan, and Uganda

Timely recognition and referral of severely ill children is especially critical in low-resource health systems. Pulse-oximeters can improve health outcomes of children by detecting hypoxaemia, a severity indicator of the most common causes of death in children. Cost-effectiveness of pulse-oximeters has been proven in low-income settings. However, evidence on their usability in community health settings is scarce.This study explores the usability of pulse-oximeters for community health and primary care workers in Cambodia, Ethiopia, South Sudan, and Uganda. We collected observational data, through a nine-task checklist, and survey data, using a five-point Likert scale questionnaire, capturing three usability aspects (effectiveness, efficiency, and satisfaction) of single-probe fingertip and multi-probe handheld devices. Effectiveness was determined by checklist completion rates and task completion rates per checklist item. Efficiency was reported as proportion of successful assessments within three attempts. Standardized summated questionnaire scores (min = 0, max = 100) determined health worker's satisfaction. Influencing factors on effectiveness and satisfaction were explored through hypothesis tests between independent groups (device type, cadre of health worker, country). Checklist completion rate was 78.3% [CI 72.6-83.0]. Choosing probes according to child age showed the lowest task completion rate of 68.7% [CI 60.3%-76.0%]. In 95.6% [CI 92.7%-97.4%] of assessments a reading was obtained within three attempts. The median satisfaction score was 95.6 [IQR = 92.2-99.0]. Significantly higher checklist completion rates were observed with single-probe fingertip devices (p<0.001) and children 12-59 months (p<0.001). We found higher satisfaction scores in South Sudan (p<0.001) and satisfaction varied slightly between devices. From a usability perspective single-probe devices for all age groups should be prioritized for scaled implementation. Further research on easy to use and accurate devices for infants is much needed.

Screening methods for congenital anomalies in low and lower-middle income countries: A systematic review

INTRODUCTION

Surgically correctable congenital anomalies are responsible for a significant burden of morbidity and mortality in children from low-and lower-middle-income countries (LMICs). Early identification through fetal and neonatal screening is critical to reducing death and disability. This study aims to identify feasible screening methods for surgically correctable congenital anomalies in LMICs.

METHODS

A systematic search looking at screening for congenital anomalies in LMIC was conducted in seven databases from 2000 until May 25, 2020, with no language restriction. All articles discussing screening methods for surgically correctable congenital anomalies in LMICs were included. Articles were screened by two independent contributors using Rayyan software, with a third contributor resolving conflicts. Feasibility of the screening method and its risk of bias were assessed using the MINORS scale.

RESULTS

Of 3473 articles, 24 were included in the full-text review. Nine screening methods (three prenatal and six postnatal) were identified - the most frequently utilized being physician clinical examination (45.8%), pulse oximetry (33.3%) and fetal ultrasound (20.8%). The use of a birth defect picture toolkit was the most feasible screening method. The risk of bias scale yielded an average of 11.9 points, which corresponds to a moderate level of bias.

CONCLUSION

Despite clear benefits, prenatal and neonatal screening methods are infrequently used in LMICs to identify surgically correctable congenital anomalies in neonates, likely due to financial, material, and human resource constraints. Further research into the development of low-cost feasible methods is needed within these settings.

PROSPERO REGISTRATION NUMBER

CRD42020192051.

TYPE OF STUDY

Systematic review.

LEVEL OF EVIDENCE

IV.

Evaluation of the routine implementation of pulse oximeters into integrated management of childhood illness (IMCI) guidelines at primary health care level in West Africa: the AIRE mixed-methods research protocol

BACKGROUND

The AIRE operational project will evaluate the implementation of the routine Pulse Oximeter (PO) use in the integrated management of childhood illness (IMCI) strategy for children under-5 in primary health care centers (PHC) in West Africa. The introduction of PO should promote the accurate identification of hypoxemia (pulse blood oxygen saturation Sp02 < 90%) among all severe IMCI cases (respiratory and non-respiratory) to prompt their effective case management (oxygen, antibiotics and other required treatments) at hospital. We seek to understand how the routine use of PO integrated in IMCI outpatients works (or not), for whom, in what contexts and with what outcomes.

METHODS

The AIRE project is being implemented from 03/2020 to 12/2022 in 202 PHCs in four West African countries (Burkina Faso, Guinea, Mali, Niger) including 16 research PHCs (four per country). The research protocol will assess three complementary components using mixed quantitative and qualitative methods: a) context based on repeated cross-sectional surveys: baseline and aggregated monthly data from all PHCs on infrastructure, staffing, accessibility, equipment, PO use, severe cases and care; b) the process across PHCs by assessing acceptability, fidelity, implementation challenges and realistic evaluation, and c) individual outcomes in the research PHCs: all children under-5 attending IMCI clinics, eligible for PO use will be included with parental consent in a cross-sectional study. Among them, severe IMCI cases will be followed in a prospective cohort to assess their health status at 14 days. We will analyze pathways, patterns of care, and costs of care.

DISCUSSION

This research will identify challenges to the systematic implementation of PO in IMCI consultations, such as health workers practices, frequent turnover, quality of care, etc. Further research will be needed to fully address key questions such as the best time to introduce PO into the IMCI process, the best SpO2 threshold for deciding on hospital referral, and assessing the cost-effectiveness of PO use. The AIRE research will provide health policy makers in West Africa with sufficient evidence on the context, process and outcomes of using PO integrated into IMCI to promote scale-up in all PHCs.

TRIAL REGISTRATION

Trial registration number: PACTR202206525204526 retrospectively registered on 06/15/2022.

Shah Alam H, Saberin A, Ahmed S, Banik G, Kabir ANME, Ahmed A, Chisti MJ, Cunningham S, Dockrell DH, Nair H, Arifeen SE, Campbell H. Introducing pulse oximetry for outpatient management of childhood pneumonia: An implementation research adopting a district implementation model in selected rural facilities in Bangladesh

BACKGROUND

Pulse oximetry has potential for identifying hypoxaemic pneumonia and substantially reducing under-five deaths in low- and middle-income countries (LMICs) setting. However, there are few examples of introducing pulse oximetry in resource-constrained paediatric outpatient settings, such as Integrated Management of Childhood Illness (IMCI) services.

METHODS

The National IMCI-programme of Bangladesh designed and developed a district implementation model for introducing pulse oximetry in routine IMCI services through stakeholder engagement and demonstrated the model in Kushtia district adopting a health system strengthening approach. Between December 2020 and June 2021, two rounds of assessment were conducted based on WHO's implementation research framework and outcome variables, involving 22 IMCI service-providers and 1680 children presenting with cough/difficulty-in-breathing in 12 health facilities. The data collection procedures included structured-observations, re-assessments, interviews, and data-extraction by trained study personnel.

FINDINGS

We observed that IMCI service-providers conducted pulse oximetry assessments on all eligible children in routine outpatient settings, of which 99% of assessments were successful; 85% (95% CI 83,87) in one attempt, and 69% (95% CI 67,71) within one minute. The adherence to standard operating procedure related to pulse oximetry was 92% (95% CI 91,93), and agreement regarding identifying hypoxaemia was 97% (95% CI 96,98). The median performance-time was 36 seconds (IQR 20,75), which was longer among younger children (2-11 months: 44s, IQR 22,78; 12-59 months: 30s, IQR 18,53, p < 0.01) and among those classified as pneumonia/severe-pneumonia than as no-pneumonia (41s, IQR 22,70; 32s, IQR 20,62, p < 0.01). We observed improvements in almost all indicators in round-2. IMCI service-providers and caregivers showed positive attitudes towards using this novel technology for assessing their children.

INTERPRETATION

This implementation research study suggested the adoption, feasibility, fidelity, appropriateness, acceptability, and sustainability of pulse oximetry introduction in routine IMCI services in resource-poor settings. The learning may inform the evidence-based scale-up of pulse oximetry linked with an oxygen delivery system in Bangladesh and other LMICs.

FUNDING

This research was funded by the UK National Institute for Health Research (NIHR) (Global Health Research Unit on Respiratory Health (RESPIRE); 16/136/109) using UK aid from the UK Government to support global health research.

Cost-effectiveness of pulse oximetry and integrated management of childhood illness for diagnosing severe pneumonia

Pneumonia is a major killer of children younger than five years old. In resource constrained health facilities, the capacity to diagnose severe pneumonia is low. Therefore, it is important to identify technologies that improve the diagnosis of severe pneumonia at the lowest incremental cost. The objective of this study was to conduct a health economic evaluation of standard integrated management of childhood illnesses (IMCI) guideline alone and combined use of standard IMCI guideline and pulse oximetry in diagnosing childhood pneumonia. This is a cluster-randomized controlled trial conducted in health centres in southern Ethiopia. Two methods of diagnosing pneumonia in children younger than five years old at 24 health centres are analysed. In the intervention arm, combined use of the pulse oximetry and standard IMCI guideline was used. In the control arm, the standard IMCI guideline alone was used. The primary outcome was cases of diagnosed severe pneumonia. Provider and patient costs were collected. A probabilistic decision tree was used in analysis of primary trial data to get incremental cost per case of diagnosed severe pneumonia. The proportion of children diagnosed with severe pneumonia was 148/928 (16.0%) in the intervention arm and 34/876 (4.0%) in the control arm. The average cost per diagnosed severe pneumonia case was USD 25.74 for combined use of pulse oximetry and standard IMCI guideline and USD 17.98 for standard IMCI guideline alone. The incremental cost of combined use of IMCI and pulse oximetry was USD 29 per extra diagnosed severe pneumonia case compared to standard IMCI guideline alone. Adding pulse oximetry to the diagnostic toolkit in the standard IMCI guideline could detect and treat one more child with severe pneumonia for an additional investment of USD 29. Better diagnostic tools for lower respiratory infections are important in resource-constrained settings, especially now during the COVID-19 pandemic.

Success and time implications of SpO2 measurement through pulse oximetry among hospitalised children in rural Bangladesh: Variability by various device-, provider- and patient-related factors

Background

Hypoxaemia is one of the strongest predictors of mortality among children with pneumonia. It can be identified through pulse oximetry instantaneously, which is a non-invasive procedure but can be influenced by factors related to the specific measuring device, health provider and patient. Following WHO's global recommendation in 2014, Bangladesh decided to introduce pulse oximetry in paediatric outpatient services, ie, the Integrated Management of Childhood Illness (IMCI) services in 2019. A national committee updated the existing IMCI implementation package and decided to test it by assessing the pulse oximetry performance of different types of assessors in real-life inpatient settings.

Methods

We adopted an observational design and conducted a technology assessment among children admitted to a rural district hospital. Eleven nurses and seven paramedics received one-day training on pulse oximetry as assessors. Each assessor performed at least 30 pulse oximetry measurements on children with two types of handheld devices. The primary outcome of interest was obtaining a successful measurement of SpO2, defined as observing a stable (±1%) reading for at least 10 seconds. Performance time, ie, time taken to obtain a successful measurement of SpO2 was considered the secondary outcome of interest. In addition, we used Generalized Estimating Equation to assess the effect of different factors on the pulse oximetry performance.

Results

The assessors obtained successful measurements of SpO2 in all attempts (n = 1478) except one. The median time taken was 30 (interquartile range (IQR) = 22-42) seconds, and within 60 seconds, 92% of attempts were successful. The odds of obtaining a successful measurement within 60 seconds were 7.3 (95% confidence interval (CI) = 3.7-14.2) times higher with a Masimo device than a Lifebox device. Similarly, assessors aged >25 years were 4.8 (95% CI = 1.2, 18.6) times more likely to obtain a successful measurement within 60 seconds. The odds of obtaining a successful measurement was 2.6 (95% CI = 1.6, 4.2) times higher among children aged 12-59 months compared to 2-11 months.

Conclusions

Our study indicated that assessors could achieve the necessary skills to perform pulse oximetry successfully in real-life inpatient settings through a short training module, with some effect of device-, provider- and patient-related factors. The National IMCI Programme of Bangladesh can use these findings for finalising the national IMCI training modules and implementation package incorporating the recommendation of using pulse oximetry for childhood pneumonia assessment.

The impact of pulse oximetry on diagnosis, management and outcomes of acute febrile illness in low-income and middle-income countries: a systematic review

BACKGROUND

Acute fever is a common presenting symptom in low/middle-income countries (LMICs) and is strongly associated with sepsis. Hypoxaemia predicts disease severity in such patients but is poorly detected by clinical examination. Therefore, including pulse oximetry in the assessment of acutely febrile patients may improve clinical outcomes in LMIC settings.

METHODS

We systematically reviewed studies of any design comparing one group where pulse oximetry was used and at least one group where it was not. The target population was patients of any age presenting with acute febrile illness or associated syndromes in LMICs. Studies were obtained from searching PubMed, EMBASE, CABI Global Health, Global Index Medicus, CINAHL, Cochrane CENTRAL, Web of Science and DARE. Further studies were identified through searches of non-governmental organisation websites, snowballing and input from a Technical Advisory Panel. Outcomes of interest were diagnosis, management and patient outcomes. Study quality was assessed using the Cochrane Risk of Bias 2 tool for Cluster Randomised Trials and Risk of Bias in Non-randomized Studies of Interventions tools, as appropriate.

RESULTS

Ten of 4898 studies were eligible for inclusion. Their small number and heterogeneity prevented formal meta-analysis. All studies were in children, eight only recruited patients with pneumonia, and nine were conducted in Africa or Australasia. Six were at serious risk of bias. There was moderately strong evidence for the utility of pulse oximetry in diagnosing pneumonia and identifying severe disease requiring hospital referral. Pulse oximetry used as part of a quality-assured facility-wide package of interventions may reduce pneumonia mortality, but studies assessing this endpoint were at serious risk of bias.

CONCLUSIONS

Very few studies addressed this important question. In LMICs, pulse oximetry may assist clinicians in diagnosing and managing paediatric pneumonia, but for the greatest impact on patient outcomes should be implemented as part of a health systems approach. The evidence for these conclusions is not widely generalisable and is of poor quality.

Experiences From an Implementation Model of ARI Diagnostic Device in Pneumonia Case Management Among Under-5 Children in Peripheral Healthcare Centers in India

OBJECTIVES

To address pneumonia, a major killer of under-5 children in India, a multimodal pulse oximeter was implemented in Health and Wellness Centers. Given the evidence of pulse oximetry in effective pneumonia management and taking into account the inadequate skills of front-line healthcare workers in case management, the device was introduced to help them readily diagnose and treat a child and to examine usability of the device.

DESIGN

The implementation was integrated with the routine OPD of primary health centers for 15 months after healthcare workers were provided with an abridged IMNCI training. Monthly facility data was collected to examine case management with the diagnostic device. Feedback on usefulness of the device was obtained.

SETTING

Health and Wellness Centers (19) of 7 states were selected in consultation with state National Health Mission based on patient footfall.

PARTICIPANTS

Under-5 children presenting with ARI symptoms at the OPD.

RESULTS

Of 4846 children, 0.1% were diagnosed with severe pneumonia and 23% were diagnosed with pneumonia. As per device readings, correct referrals were made of 77.6% of cases of severe pneumonia, and 81% of pneumonia cases were correctly given antibiotics. The Pulse oximeter was highly acceptable among health workers as it helped in timely classification and treatment of pneumonia. It had no maintenance issue and battery was long-lasting.

CONCLUSION

Pulse oximeter implementation was doable and acceptable among health workers. Together with IMNCI training, PO in primary care settings is a feasible approach to provide equitable care to under-5 children.

Impact of pulse oximetry on hospital referral acceptance in children under 5 with severe pneumonia in rural Pakistan (district Jamshoro): protocol for a cluster randomised trial

BACKGROUND

Pneumonia is a leading cause of death among children under 5 specifically in South Asia and sub-Saharan Africa. Hypoxaemia is a life-threatening complication among children under 5 with pneumonia. Hypoxaemia increases risk of mortality by 4.3 times in children with pneumonia than those without hypoxaemia. Prevalence of hypoxaemia varies with geography, altitude and severity (9%-39% Asia, 3%-10% African countries). In this protocol paper, we describe research methods for assessing impact of Lady Health Workers (LHWs) identifying hypoxaemia in children with signs of pneumonia during household visits on acceptance of hospital referral in district Jamshoro, Sindh.

METHODS AND ANALYSIS

A cluster randomised controlled trial using pulse oximetry as intervention for children with severe pneumonia will be conducted in community settings. Children aged 0-59 months with signs of severe pneumonia will be recruited by LHWs during routine visits in both intervention and control arms after consent. Severe pneumonia will be defined as fast breathing and/or chest in-drawing, and, one or more danger sign and/or hypoxaemia (Sa02 <92%) in PO (intervention) group and fast breathing and/or chest in-drawing and one or more danger sign in clinical signs (control) group. Recruits in both groups will receive a stat dose of oral amoxicillin and referral to designated tertiary health facility. Analysis of variance will be used to compare baseline referral acceptance in both groups with that at end of study.

ETHICS AND DISSEMINATION

Ethical approval was granted by the Ethics Review Committee of the Aga Khan University (4722-Ped-ERC-17), Karachi. Study results will be shared with relevant government and non-governmental organisations, presented at national and international research conferences and published in international peer-reviewed scientific journals.

TRIAL REGISTRATION NUMBER

NCT03588377.

Performance of five pulse oximeters to detect hypoxaemia as an indicator of severe illness in children under five by frontline health workers in low resource settings - A prospective, multicentre, single-blinded, trial in Cambodia, Ethiopia, South Sudan, and Uganda

BACKGROUND

Low blood oxygen saturation (SpO₂), or hypoxaemia, is an indicator of severe illness in children. Pulse oximetry is a globally accepted, non-invasive method to identify hypoxaemia, but rarely available outside higher-level facilities in resource-constrained countries. This study aims to evaluate the performance of different types of pulse oximeters amongst frontline health workers in Cambodia, Ethiopia, South Sudan, and Uganda.

METHODS

Five pulse oximeters (POx) which passed laboratory testing, out of an initial 32 potential pulse oximeters, were evaluated by frontline health workers for performance, defined as agreement between the SpO₂ measurements of the test device and the reference standard. The study protocol is registered with the Australia New Zealand Clinical Trials Registry (Ref: ACTRrn12615000348550).

FINDINGS

Two finger-tip pulse oximeters (Contec and Devon), two handheld pulse oximeters (Lifebox and Utech), and one phone pulse oximeter (Masimo) passed the laboratory testing. They were evaluated for performance on 1,313 children under five years old by 207 frontline health workers between February and May 2015. Phone and handheld pulse oximeters had greater overall agreement with the reference standard (56%; 95% CI 0.52 - 0.60 to 68%; 95% CI 0.65 - 0.71) than the finger-tip POx (31%; 95% CI 0.26 to 0.36 and 47%; 95% CI 0.42 to 0.52). Fingertip POx performance was substantially lower in the 0-2 month olds; having just 17% and 25% agreement. The finger-tip devices more often underreported SpO₂ readings (mean difference -7.9%; 95%CI -8.6,-7.2 and -3.9%; 95%CI -4.4,-3.4), and therefore over diagnosed hypoxaemia in the children assessed.

INTERPRETATION

While the Masimo phone pulse oximeter performed best, all handheld POx with age-specific probes performed well in the hands of frontline health workers, further highlighting their suitability as a screening tool of severe illness. The poor performance of the fingertip POx suggests they should not be used in children under five by frontline health workers. It is essential that POx are performance tested on children in routine settings (in vivo), not only in laboratories or controlled settings (in vitro), before being introduced at scale.

FUNDING

Bill & Melinda Gates Foundation [OPP1054367].

Usability and acceptability of a multimodal respiratory rate and pulse oximeter device in case management of children with symptoms of pneumonia: A cross-sectional study in Ethiopia

Aim

Pneumonia is the leading infectious cause of death among children under five globally. Many pneumonia deaths result from inappropriate treatment due to misdiagnosis of signs and symptoms. This study aims to identify whether health extension workers (HEWs) in Ethiopia, using an automated multimodal device (Masimo Rad‐G), adhere to required guidelines while assessing and classifying under five children with cough or difficulty breathing and to understand device acceptability.

Methods

A cross‐sectional study was conducted in three districts of Southern Nations, Nationalities, and Peoples' Region, Ethiopia. Between September and December 2018, 133 HEWs were directly observed using Rad‐G while conducting 599 sick child consultations. Usability was measured as adherence to the World Health Organization requirements to assess fast breathing and device manufacturer instructions for use. Acceptability was assessed using semi‐structured interviews with HEWs, first‐level health facility workers and caregivers.

Results

Adherence using the Rad‐G routinely for 2 months was 85.3% (95% CI 80.2, 89.3). Health workers and caregivers stated a preference for Rad‐G. Users highlighted a number of device design issues.

Conclusion

While demonstrating high levels of acceptability and usability, the device modifications to consider include better probe fit, improved user interface with exclusive age categories and simplified classification outcomes.

Experiences with use of a pulse oximeter multimodal device in outpatient management of children with Acute Respiratory Infection during Covid pandemic

Background:

While Covid-19 infection rate in children is low, respiratory symptoms are a common mode of presentation which calls for better management of such symptoms. However, ARI case managemnet in primary health settings settings has challenges as health workers lack skills to count respiratory rate and check chest indrawing. To address this multimodal pulse oximeters have been introduced in health and wellness centres of seven states to ease the work of front line health workers. A study was undertaken to understand the usability of the multimodal pulse oximeter during Covid times.

Methods:

A qualitative study was conducted with the aid of indepth interviews among a convenience sample of eleven health care workers from ten health and wellness centres. Interviews were conducted and recorded over phone, after obtaining consent. Transcribed interviews were coded and analysed on a qualitative analysis software. Content analysis was conducted.

Results:

Total children screened during covid lockdown period (April 1-May 31) is 571, those diagnosed with pneumonia and severe pneumonia is 68 and 2. Health care workers were satisfied with pulse oximeter as it helped in timely diagnosis and treatment, and offered protection from possible infection as it mitigated the need for physical contact.

Conclusion:

The multimodal pulse oximeter is well accepted among providers as it is easy to use aiding in timely management of ARI in children. It has an added protection as it's use reduces the need for physical contact. It can be adopted in other HWC and primary health facilities.

Usability Testing of a Reusable Pulse Oximeter Probe Developed for Health-Care Workers Caring for Children < 5 Years Old in Low-Resource Settings

Hypoxemia measured by pulse oximetry predicts child pneumonia mortality in low-resource settings (LRS). Existing pediatric oximeter probes are prohibitively expensive and/or difficult to use, limiting LRS implementation. Using a human-centered design, we developed a low-cost, reusable pediatric oximeter probe for LRS health-care workers (HCWs). Here, we report probe usability testing. Fifty-one HCWs from Malawi, Bangladesh, and the United Kingdom participated, and seven experts provided reference measurements. Health-care workers and experts measured the peripheral arterial oxyhemoglobin saturation (SpO₂) independently in < 5 year olds. Health-care worker measurements were classed as successful if recorded in 5 minutes (or shorter) and physiologically appropriate for the child, using expert measurements as the reference. All expert measurements were considered successful if obtained in < 5 minutes. We analyzed the proportion of successful SpO₂ measurements obtained in < 1, < 2, and < 5 minutes and used multivariable logistic regression to predict < 1 minute successful measurements. We conducted four testing rounds with probe modifications between rounds, and obtained 1,307 SpO₂ readings. Overall, 67% (876) of measurements were successful and achieved in < 1 minute, 81% (1,059) < 2 minutes, and 90% (1,181) < 5 minutes. Compared with neonates, increasing age (infant adjusted odds ratio [aOR]; 1.87, 95% confidence interval [CI]: 1.16, 3.02; toddler aOR: 4.33, 95% CI: 2.36, 7.97; child aOR; 3.90, 95% CI: 1.73, 8.81) and being asleep versus being calm (aOR; 3.53, 95% CI: 1.89, 6.58), were associated with < 1 minute successful measurements. In conclusion, we designed a novel, reusable pediatric oximetry probe that was effectively used by LRS HCWs on children. This probe may be suitable for LRS implementation.

Performance, Acceptability, and Usability of Respiratory Rate Timers and Pulse Oximeters When Used by Frontline Health Workers to Detect Symptoms of Pneumonia in Sub-Saharan Africa and Southeast Asia: Protocol for a Two-Phase, Multisite, Mixed-Methods Trial

Background

Pneumonia is one of the leading causes of death in children aged under 5 years in both sub-Saharan Africa and Southeast Asia. The current diagnostic criterion for pneumonia is based on the increased respiratory rate (RR) in children with cough or difficulty breathing. Low oxygen saturation, measured using pulse oximeters, is indicative of severe pneumonia. Health workers often find it difficult to accurately count the number of breaths, and the current RR counting devices are often difficult to use or unavailable. Nonetheless, improved counting devices and low-cost pulse oximeters are now available on the market.

Objective

The objective of our study was to identify the most accurate, usable, and acceptable devices for the diagnosis of pneumonia symptoms by community health workers and first-level health facility workers or frontline health workers in resource-poor settings.

Methods

This was a multicenter, prospective, two-stage, observational study to assess the performance and usability or acceptability of 9 potential diagnostic devices when used to detect symptoms of pneumonia in the hands of frontline health workers. Notably, 188 possible devices were ranked and scored, tested for suitability in a laboratory, and 5 pulse oximeters and 4 RR timers were evaluated for usability and performance by frontline health workers in hospital, health facility, and community settings. The performance was evaluated against 2 references over 3 months in Cambodia, Ethiopia, South Sudan, and Uganda. Furthermore, acceptability and usability was subsequently evaluated using both qualitative and quantitative methodologies in routine practice, over 3 months, in the 4 countries.

Results

This project was funded in 2014, and data collection has been completed. Data analysis is currently under way, and the first results are expected to be submitted for publication in 2018.

Conclusions

This is the first large-scale evaluation of tools to detect symptoms of pneumonia at the community level. In addition, selecting an appropriate reference standard against which the devices were measured was challenging given the lack of existing standards and differences of opinions among experts. The findings from this study will help create a standardized and validated protocol for future studies and support further comparative testing of diagnostic devices in these settings.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12615000348550; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=367306&isReview=true (Archived by Website at http://www.webcitation.org/72OcvgBcf)

International Registered Report Identifier (IRRID)

RR1-10.2196/10191

Adoption of paediatric and neonatal pulse oximetry by 12 hospitals in Nigeria: a mixed-methods realist evaluation

Introduction

Pulse oximetry is a life-saving tool for identifying children with hypoxaemia and guiding oxygen therapy. This study aimed to evaluate the adoption of oximetry practices in 12 Nigerian hospitals and identify strategies to improve adoption.

Methods

We conducted a mixed-methods realist evaluation to understand how oximetry was adopted in 12 Nigerian hospitals and why it varied in different contexts. We collected quantitative data on oximetry use (from case notes) and user knowledge (pretraining/post-training tests). We collected qualitative data via focus groups with project nurses (n=12) and interviews with hospital staff (n=11). We used the quantitative data to describe the uptake of oximetry practices. We used mixed methods to explain how hospitals adopted oximetry and why it varied between contexts.

Results

Between January 2014 and April 2017, 38 525 children (38% aged ≤28 days) were admitted to participating hospitals (23 401 pretraining; 15 124 post-training). Prior to our intervention, 3.3% of children and 2.5% of neonates had oximetry documented on admission. In the 18 months of intervention period, all hospitals improved oximetry practices, typically achieving oximetry coverage on >50% of admitted children after 2-3 months and >90% after 6-12 months. However, oximetry adoption varied in different contexts. We identified key mechanisms that influenced oximetry adoption in particular contexts.

Conclusion

Pulse oximetry is a simple, life-saving clinical practice, but introducing it into routine clinical practice is challenging. By exploring how oximetry was adopted in different contexts, we identified strategies to enhance institutional adoption of oximetry, which will be relevant for scale-up of oximetry in hospitals globally.

Trial registration number

ACTRN12617000341325.

Distribution and determinants of pneumonia diagnosis using Integrated Management of Childhood Illness guidelines: a nationally representative study in Malawi

Background

Pneumonia remains the leading cause of child mortality in sub-Saharan Africa. The Integrated Management of Childhood Illness (IMCI) strategy was developed to standardise care in low-income and middle-income countries for major childhood illnesses and can effectively improve healthcare worker performance. Suboptimal clinical evaluation can result in missed diagnoses and excess morbidity and mortality. We estimate the sensitivity of pneumonia diagnosis and investigate its determinants among children in Malawi.

Methods

Data were obtained from the 2013-2014 Service Provision Assessment survey, a census of health facilities in Malawi that included direct observation of care and re-examination of children by trained observers. We calculated sensitivity of pneumonia diagnosis and used multilevel log-binomial regression to assess factors associated with diagnostic sensitivity.

Results

3136 clinical visits for children 2-59 months old were observed at 742 health facilities. Healthcare workers completed an average of 30% (SD 13%) of IMCI guidelines in each encounter. 573 children met the IMCI criteria for pneumonia; 118 (21%) were correctly diagnosed. Advanced practice clinicians were more likely than other providers to diagnose pneumonia correctly (adjusted relative risk 2.00, 95% CI 1.21 to 3.29). Clinical quality was strongly associated with correct diagnosis: sensitivity was 23% in providers at the 75th percentile for guideline adherence compared with 14% for those at the 25th percentile. Contextual factors, facility structural readiness, and training or supervision were not associated with sensitivity.

Conclusions

Care quality for Malawian children is poor, with low guideline adherence and missed diagnosis for four of five children with pneumonia. Better sensitivity is associated with provider type and higher adherence to IMCI. Existing interventions such as training and supportive supervision are associated with higher guideline adherence, but are insufficient to meaningfully improve sensitivity. Innovative and scalable quality improvement interventions are needed to strengthen health systems and reduce avoidable child mortality.

Opportunities and barriers in paediatric pulse oximetry for pneumonia in low-resource clinical settings: a qualitative evaluation from Malawi and Bangladesh

OBJECTIVE

To gain an understanding of what challenges pulse oximetry for paediatric pneumonia management poses, how it has changed service provision and what would improve this device for use across paediatric clinical settings in low-income countries.

DESIGN

Focus group discussions (FGDs), with purposive sampling and thematic analysis using a framework approach.

SETTING

Community, front-line outpatient, and hospital outpatient and inpatient settings in Malawi and Bangladesh, which provide paediatric pneumonia care.

PARTICIPANTS

Healthcare providers (HCPs) from Malawi and Bangladesh who had received training in pulse oximetry and had been using oximeters in routine paediatric care, including community healthcare workers, non-physician clinicians or medical assistants, and hospital-based nurses and doctors.

RESULTS

We conducted six FGDs, with 23 participants from Bangladesh and 26 from Malawi. We identified five emergent themes: trust, value, user-related experience, sustainability and design. HCPs discussed the confidence gained through the use of oximeters, resulting in improved trust from caregivers and valuing the device, although there were conflicts between the weight given to clinical judgement versus oximeter results. HCPs reported the ease of using oximeters, but identified movement and physically smaller children as measurement challenges. Challenges in sustainability related to battery durability and replacement parts, however many HCPs had used the same device longer than 4 years, demonstrating robustness within these settings. Desirable features included back-up power banks and integrated respiratory rate and thermometer capability.

CONCLUSIONS

Pulse oximetry was generally deemed valuable by HCPs for use as a spot-check device in a range of paediatric low-income clinical settings. Areas highlighted as challenges by HCPs, and therefore opportunities for redesign, included battery charging and durability, probe fit and sensitivity in paediatric populations.

TRIAL REGISTRATION NUMBER

NCT02941237.

Exhaustive mathematical analysis of simple clinical measurements for childhood pneumonia diagnosis

BACKGROUND

Pneumonia is the leading cause of mortality for children below 5 years of age. The majority of these occur in poor countries with limited access to diagnosis. The World Health Organization (WHO) criterion for pneumonia is the de facto method for diagnosis. It is designed targeting a high sensitivity and uses easy to measure parameters. The WHO criterion has poor specificity.

METHODS

We propose a method using common measurements (including the WHO parameters) to diagnose pneumonia at high sensitivity and specificity. Seventeen clinical features obtained from 134 subjects were used to create a series of logistic regression models. We started with one feature at a time, and continued building models with increasing number of features until we exhausted all possible combinations. We used a k-fold cross validation method to measure the performance of the models.

RESULTS

The sensitivity of our method was comparable to that of the WHO criterion but the specificity was 84%-655% higher. In the 2-11 month age group, the WHO criteria had a sensitivity and specificity of 92.0%±11.6% and 38.1%±18.5%, respectively. Our best model (using the existence of a runny nose, the number of days with runny nose, breathing rate and temperature) performed at a sensitivity of 91.3%±13.0% and specificity of 70.2%±22.80%. In the 12-60 month age group, the WHO algorithm gave a sensitivity of 95.7%±7.6% at a specificity of 9.8%±13.1%, while our corresponding sensitivity and specificity were 94.0%±12.1% and 74.0%±23.3%, respectively (using fever, number of days with cough, heart rate and chest in-drawing).

CONCLUSIONS

The WHO algorithm can be improved through mathematical analysis of clinical observations and measurements routinely made in the field. The method is simple and easy to implement on a mobile phone. Our method allows the freedom to pick the best model in any arbitrary field scenario (e.g., when an oximeter is not available).