Usability and acceptability of a multimodal respiratory rate and pulse oximeter device in case management of children with symptoms of pneumonia: A cross-sectional study in Ethiopia

Health System Considerations for Community-Based Implementation of Automated Respiratory Counters to Identify Childhood Pneumonia in 5 Regions of Ethiopia: A Qualitative Study

BACKGROUND

In Ethiopia, childhood pneumonia is diagnosed in primary healthcare settings by measuring respiratory rate (RR) along with the presence of cough, chest indrawing, difficulty breathing, and fast breathing. Our aim was to identify health system-level lessons from implementing two automated RR counters, Children's Automated Respiration Monitor (ChARM) by Phillips® and Rad-G by Masimo®, to provide considerations for integrating such devices into child health programmes and health systems. This study was part of an initiative called the Acute Respiratory Infection Diagnostic Aids (ARIDA).

METHODS

Key informant interviews (KIIs) were conducted with 57 participants (health workers in communities and facilities, trainers of health workers, district management, and key decision-makers) in five regions of Ethiopia. Data were analyzed in ATLAS.ti using thematic content analysis and themes were categorized using the Tanahashi bottleneck analysis.

RESULTS

All participants recommended scaling up the ARIDA initiative nationally as part of Integrated Management of Newborn and Childhood Illness (IMNCI) in primary healthcare. Health workers perceived the devices as: time saving, acceptable by parents and children, and facilitating diagnosis and referrals. Health workers perceived an increased demand for services and reduced numbers of sick children not seeking care. Participants recommended increasing the number of devices distributed and health workers trained. Strengthening drug supply chains, improving oxygen gas availability, and strengthening referral networks would maximize perceived benefits. While training improved knowledge, more supportive supervision, integration with current guidelines and more guidance related to community engagement was recommended.

CONCLUSION

Automatic RR counters for the decentralized diagnosis of childhood pneumonia could have positive impact on improving the quality of diagnosis and management of pneumonia in children. However, the study has shown that a health system approach is required to ensure all steps along the pneumonia pathway are adequate, including drug and oxygen supply, community engagement, health worker training and support, and referral pathways.

Pulse oximetry training landscape for healthcare workers in low- and middle-income countries: A scoping review

Background

Pulse oximetry has been used in medical care for decades. Its use quickly became standard of care in high resource settings, with delayed widespread availability and use in lower resource settings. Pulse oximetry training initiatives have been ongoing for years, but a map of the literature describing such initiatives among health care workers in low- and middle-income countries (LMICs) has not previously been conducted. Additionally, the coronavirus disease 2019 (COVID-19) pandemic further highlighted the inequitable distribution of pulse oximetry use and training. We aimed to characterise the landscape of pulse oximetry training for health care workers in LMICs prior to the COVID-19 pandemic as described in the literature.

Methods

We systematically searched six databases to identify studies reporting pulse oximetry training among health care workers, broadly defined, in LMICs prior to the COVID-19 pandemic. Two reviewers independently assessed titles and abstracts and relevant full texts for eligibility. Data were charted by one author and reviewed for accuracy by a second. We synthesised the results using a narrative synthesis.

Results

A total of 7423 studies were identified and 182 screened in full. A total of 55 training initiatives in 42 countries met inclusion criteria, as described in 66 studies since some included studies reported on different aspects of the same training initiative. Five overarching reasons for conducting pulse oximetry training were identified: 1) anaesthesia and perioperative care, 2) respiratory support programme expansion, 3) perinatal assessment and monitoring, 4) assessment and monitoring of children and 5) assessment and monitoring of adults. Educational programmes varied in their purpose with respect to the types of patients being targeted, the health care workers being instructed, and the depth of pulse oximetry specific training.

Conclusions

Pulse oximetry training initiatives have been ongoing for decades for a variety of purposes, utilising a multitude of approaches to equip health care workers with tools to improve patient care. It is important that these initiatives continue as pulse oximetry availability and knowledge gaps remain. Neither pulse oximetry provision nor training alone is enough to bolster patient care, but sustainable solutions for both must be considered to meet the needs of both health care workers and patients.

Shah Alam H, Saberin A, Ahmed S, Banik G, Kabir ANME, Ahmed A, Chisti MJ, Cunningham S, Dockrell DH, Nair H, Arifeen SE, Campbell H. Introducing pulse oximetry for outpatient management of childhood pneumonia: An implementation research adopting a district implementation model in selected rural facilities in Bangladesh

BACKGROUND

Pulse oximetry has potential for identifying hypoxaemic pneumonia and substantially reducing under-five deaths in low- and middle-income countries (LMICs) setting. However, there are few examples of introducing pulse oximetry in resource-constrained paediatric outpatient settings, such as Integrated Management of Childhood Illness (IMCI) services.

METHODS

The National IMCI-programme of Bangladesh designed and developed a district implementation model for introducing pulse oximetry in routine IMCI services through stakeholder engagement and demonstrated the model in Kushtia district adopting a health system strengthening approach. Between December 2020 and June 2021, two rounds of assessment were conducted based on WHO's implementation research framework and outcome variables, involving 22 IMCI service-providers and 1680 children presenting with cough/difficulty-in-breathing in 12 health facilities. The data collection procedures included structured-observations, re-assessments, interviews, and data-extraction by trained study personnel.

FINDINGS

We observed that IMCI service-providers conducted pulse oximetry assessments on all eligible children in routine outpatient settings, of which 99% of assessments were successful; 85% (95% CI 83,87) in one attempt, and 69% (95% CI 67,71) within one minute. The adherence to standard operating procedure related to pulse oximetry was 92% (95% CI 91,93), and agreement regarding identifying hypoxaemia was 97% (95% CI 96,98). The median performance-time was 36 seconds (IQR 20,75), which was longer among younger children (2-11 months: 44s, IQR 22,78; 12-59 months: 30s, IQR 18,53, p < 0.01) and among those classified as pneumonia/severe-pneumonia than as no-pneumonia (41s, IQR 22,70; 32s, IQR 20,62, p < 0.01). We observed improvements in almost all indicators in round-2. IMCI service-providers and caregivers showed positive attitudes towards using this novel technology for assessing their children.

INTERPRETATION

This implementation research study suggested the adoption, feasibility, fidelity, appropriateness, acceptability, and sustainability of pulse oximetry introduction in routine IMCI services in resource-poor settings. The learning may inform the evidence-based scale-up of pulse oximetry linked with an oxygen delivery system in Bangladesh and other LMICs.

FUNDING

This research was funded by the UK National Institute for Health Research (NIHR) (Global Health Research Unit on Respiratory Health (RESPIRE); 16/136/109) using UK aid from the UK Government to support global health research.

Field Experiences with Handheld Diagnostic Devices to Triage Children under Five Presenting with Severe Febrile Illness in a District Hospital in DR Congo

As part of a field study (NCT04473768) in children presenting with severe febrile illness to Kisantu hospital (DR Congo), we retrospectively compiled user experiences (not performance) with handheld diagnostic devices assisting triage: tympanic thermometer, pulse oximeter (measuring heart rate, respiratory rate and oxygen saturation), hemoglobinometer and glucometer. Guidance documents for product selection were generic and scattered. Stock rupture, market withdrawal and unaffordable prices interfered with procurement. Challenges at implementation included environmental temperature, capillary blood sampling (antisepsis, order of multiple tests, filling microcuvettes and glucose strips), calibration (environmental temperature, cold chain) and liability-oriented communication with a manufacturer. Instructions for use were readable and contained symbol keys; two devices had printed French-language instructions. Shortcomings were poor integration of figures with text and distinct procedures for the oximeter and its sensor. Usability interview revealed appreciations for quick results, visibility of the display and memory function (three devices) but also problems of capillary blood sample transfer, cleaning, too long of a time-to-results (respiratory rate) and size, fitting and disposal of thermometer probes. Pictorial error messages were preferred over alphanumeric error codes but interpretation of symbols was poor. Alarm sounds of the oximeter caused unrest in children and caretakers perceived the device as associated with poor prognosis.

Patient and clinician use characteristics and perceptions of pulse oximeter use: A scoping review

BACKGROUND AND OBJECTIVES

The need to monitor patients outside of a formal clinical setting, such as a hospital or ambulatory care facility, has become increasingly important since COVID-19. It introduces significant challenges to ensure accurate and timely measurements, maintain strong patient engagement, and operationalise data for clinical decision-making. Remote Patient Monitoring (RPM) devices like the pulse oximeter help mitigate these difficulties, however, practical approaches to successfully integrate this technology into existing patient-clinician interactions that ensure the delivery of safe and effective care are vital. The objective of this scoping review was to synthesise existing literature to provide an overview of the variety of user perceptions associated with pulse oximeter devices, which may impact patients' and clinicians' acceptance of the devices in a RPM context.

METHODS

A search over three databases was conducted between April 2021 - June 2021 using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses for Scoping Review (PRISMA-ScR) guidelines. A total of 16 articles were included in this scoping review.

RESULTS

Results indicate there has been an increase in use of pulse oximeters across hospital and community settings for continuous vital signs monitoring and remote monitoring of patients over time. Research in this area is shifting towards increasing accessibility of care through the development and implementation of telehealth systems and phone oximeters. Aspects of pulse oximeter UX most frequently investigated are usability and acceptability, however, these terms are often undefined, or definitions vary across studies. Perceived effectiveness, opportunity costs, and attitude towards use remain unexplored areas of UX. Overall, patients and clinicians view the pulse oximeter positively and find it user-friendly. A high level of learnability was found for the device and additional benefits included increasing patient self-efficacy and clinician motivation to work. However, issues getting an accurate reading due to device usability are still experienced by some patients and clinicians.

CONCLUSION

This scoping review is the first to summarise user perceptions of the pulse oximeter in a healthcare context. It showed that both patients and clinicians hold positive perceptions of the pulse oximeter and important factors to consider in designing user-focused services include ease-of-use and wearability of devices; context of use including user's prior health and IT knowledge; attitude towards use and perceived effectiveness; impact on user motivation and self-efficacy; and finally, potential user costs like inconvenience or increased anxiety. With the rapid increase in research studies examining pulse oximeter use for RPM since COVID-19, a systematic review is warranted as the next step to consolidate evidence and investigate the impact of these factors on pulse oximeter acceptance and effectiveness.

Prevalence of hypoxaemia in children with pneumonia in low-income and middle-income countries: a systematic review and meta-analysis

Background

Pneumonia accounts for around 15% of all deaths of children younger than 5 years globally. Most happen in resource-constrained settings and are potentially preventable. Hypoxaemia is one of the strongest predictors of these deaths. We present an updated estimate of hypoxaemia prevalence among children with pneumonia in low-income and middle-income countries.

Methods

We conducted a systematic review using the following key concepts “children under five years of age” AND “pneumonia” AND “hypoxaemia” AND “low- and middle-income countries” by searching in 11 bibliographic databases and citation indices. We included all articles published between Nov 1, 2008, and Oct 8, 2021, based on observational studies and control arms of randomised and non-randomised controlled trials. We excluded protocol papers, articles reporting hypoxaemia prevalence based on less than 100 pneumonia cases, and articles published before 2008 from the review. Quality appraisal was done with the Joanna Briggs Institute tools. We reported pooled prevalence of hypoxaemia (SpO₂ <90%) by classification of clinical severity and by clinical settings by use of the random-effects meta-analysis models. We combined our estimate of the pooled prevalence of pneumonia with a previously published estimate of the number of children admitted to hospital due to pneumonia annually to calculate the total annual number of children admitted to hospital with hypoxaemic pneumonia.

Findings

We identified 2825 unique records from the databases, of which 57 studies met the eligibility criteria: 26 from Africa, 23 from Asia, five from South America, and four from multiple continents. The prevalence of hypoxaemia was 31% (95% CI 26–36; 101 775 children) among all children with WHO-classified pneumonia, 41% (33–49; 30 483 children) among those with very severe or severe pneumonia, and 8% (3–16; 2395 children) among those with non-severe pneumonia. The prevalence was much higher in studies conducted in emergency and inpatient settings than in studies conducted in outpatient settings. In 2019, we estimated that over 7 million children (95% CI 5–8 million) were admitted to hospital with hypoxaemic pneumonia. The studies included in this systematic review had high τ² (ie, 0·17), indicating a high level of heterogeneity between studies, and a high I² value (ie, 99·6%), indicating that the heterogeneity was not due to chance. This study is registered with PROSPERO, CRD42019126207.

Interpretation

The high prevalence of hypoxaemia among children with severe pneumonia, particularly among children who have been admitted to hospital, emphasises the importance of overall oxygen security within the health systems of low-income and middle-income countries, particularly in the context of the COVID-19 pandemic. Even among children with non-severe pneumonia that is managed in outpatient and community settings, the high prevalence emphasises the importance of rapid identification of hypoxaemia at the first point of contact and referral for appropriate oxygen therapy.

Funding

UK National Institute for Health Research (Global Health Research Unit on Respiratory Health [RESPIRE]; 16/136/109).

Hypoxemia, hypoglycemia and IMCI danger signs in pediatric outpatients in Malawi

Hypoxemia and hypoglycemia are known risks for mortality in children in low-income settings. Routine screening with pulse oximetry and blood glucose assessments for outpatients could assist in early identification of high-risk children. We assessed the prevalence of hypoglycemia and hypoxemia, and the overlap with Integrated Management of Childhood Illness (IMCI) general danger signs, among children seeking outpatient care in Malawi. A cross-sectional study was conducted at 14 government primary care facilities, four rural hospitals and one district referral hospital in Mchinji district, Malawi from August 2019-April 2020. All children aged 0-12 years seeking care with an acute illness were assessed on one day per month in each facility. Study research assistants measured oxygen saturation using Lifebox LB-01 pulse oximeter and blood glucose was assessed with AccuCheck Aviva glucometers. World Health Organization definitions were used for severe hypoglycemia (<2.5mmol/l) and hypoxemia (SpO2 <90%). Moderate hypoglycemia (2.5-4.0mmol/l) and hypoxemia (SpO2 90-93%) were also calculated and prevalence levels compared between those with and without IMCI danger signs using chi2 tests. In total 2,943 children were enrolled, with a median age of 41 (range: 0-144) months. The prevalence of severe hypoxemia was 0.6% and moderate hypoxemia 5.4%. Severe hypoglycemia was present in 0.1% of children and moderate hypoglycemia in 11.1%. IMCI general danger signs were present in 29.3% of children. All severely hypoglycemic children presented with an IMCI danger sign (p <0.001), but only 23.5% of the severely hypoxemic and 31.7% of the moderately hypoxemic children. We conclude that while the prevalence of severe hypoxemia and hypoglycemia were low, moderate levels were not uncommon and could potentially be useful as an objective tool to determine referral needs. IMCI danger signs identified hypoglycemic children, but results highlight the challenge to detect hypoxemia. Future studies should explore case management strategies for moderate hypoxemia and hypoglycemia.

Performance of Automated Point-of-Care Respiratory Rate Counting versus Manual Counting in Children under Five Admitted with Severe Febrile Illness to Kisantu Hospital, DR Congo

To improve the early recognition of danger signs in children with severe febrile illness in low resource settings, WHO promotes automated respiratory rate (RR) counting, but its performance is unknown in this population. Therefore, we prospectively evaluated the field performance of automated point-of-care plethysmography-based RR counting in hospitalized children with severe febrile illness (<5 years) in DR Congo. A trained research nurse simultaneously counted the RR manually (comparative method) and automatically with the Masimo Rad G pulse oximeter. Valid paired RR measurements were obtained in 202 (83.1%) children, among whom 43.1% (87/202) had fast breathing according to WHO criteria based on manual counting. Automated counting frequently underestimated the RR (median difference of -1 breath/minute; p2.5-p97.5 limits of agreement: -34-6), particularly at higher RR. This resulted in a failure to detect fast breathing in 24.1% (21/87) of fast breathing children (positive percent agreement: 75.9%), which was not explained by clinical characteristics (p > 0.05). Children without fast breathing were mostly correctly classified (negative percent agreement: 98.3%). In conclusion, in the present setting the automated RR counter performed insufficiently to facilitate the early recognition of danger signs in children with severe febrile illness, given wide limits of agreement and a too low positive percent agreement.

Usability and acceptability of a multimodal respiratory rate and pulse oximeter device in case management of children with symptoms of pneumonia: A cross-sectional study in Ethiopia

Aim

Pneumonia is the leading infectious cause of death among children under five globally. Many pneumonia deaths result from inappropriate treatment due to misdiagnosis of signs and symptoms. This study aims to identify whether health extension workers (HEWs) in Ethiopia, using an automated multimodal device (Masimo Rad‐G), adhere to required guidelines while assessing and classifying under five children with cough or difficulty breathing and to understand device acceptability.

Methods

A cross‐sectional study was conducted in three districts of Southern Nations, Nationalities, and Peoples' Region, Ethiopia. Between September and December 2018, 133 HEWs were directly observed using Rad‐G while conducting 599 sick child consultations. Usability was measured as adherence to the World Health Organization requirements to assess fast breathing and device manufacturer instructions for use. Acceptability was assessed using semi‐structured interviews with HEWs, first‐level health facility workers and caregivers.

Results

Adherence using the Rad‐G routinely for 2 months was 85.3% (95% CI 80.2, 89.3). Health workers and caregivers stated a preference for Rad‐G. Users highlighted a number of device design issues.

Conclusion

While demonstrating high levels of acceptability and usability, the device modifications to consider include better probe fit, improved user interface with exclusive age categories and simplified classification outcomes.