Developing and introducing evidence based clinical practice guidelines for serious illness in Kenya

Diagnostic Accuracy of the World Health Organization Pediatric Emergency Triage, Assessment and Treatment Tool Plus Among Patients Seeking Care in Nairobi, Kenya: A Cross-sectional Study

INTRODUCTION

The World Health Organization developed Emergency Triage Assessment and Treatment Plus (ETAT+) guidelines to facilitate pediatric care in resource-limited settings. ETAT+ triages patients as nonurgent, priority, or emergency cases, but there is limited research on the performance of ETAT+ regarding patient-oriented outcomes. This study assessed the diagnostic accuracy of ETAT+ in predicting the need for hospital admission in a pediatric emergency unit at Kenyatta National Hospital in Nairobi, Kenya.

METHODS

This was a secondary analysis of a cross-sectional study of pediatric emergency unit patients enrolled over a 4-week period using fixed random sampling. Diagnostic accuracy of ETAT+ was evaluated using receiver operating curves (ROCs) and respective 95% confidence intervals (CIs) with associated sensitivity and specificity (reference category: nonurgent). The ROC analysis was performed for the overall population and stratified by age group.

RESULTS

A total of 323 patients were studied. The most common reasons for presentation were upper respiratory tract disease (32.8%), gastrointestinal disease (15.5%), and lower respiratory tract disease (12.4%). Two hundred twelve participants were triaged as nonurgent (65.6%), 60 as priority (18.6%), and 51 as emergency (15.8%). In the overall study population, the area under the ROC curve was 0.97 (95% CI, 0.95-0.99). The ETAT+ sensitivity was 93.8% (95% CI, 87.0%-99.0%), and the specificity was 82.0% (95% CI, 77.0%-87.0%) for admission of priority group patients. The sensitivity and specificity for the emergency patients were 66.0% (95% CI, 55.0%-77.0%) and 98.0% (95% CI, 97.0%-100.0%), respectively.

CONCLUSIONS

ETAT+ demonstrated diagnostic accuracy for predicting patient need for hospital admission. This finding supports the utility of ETAT+ to inform emergency care practice. Further research on ETAT+ performance in larger populations and additional patient-oriented outcomes would enhance its generalizability and application in resource-limited settings.

Developing and testing a clinical care bundle incorporating caffeine citrate to manage apnoea of prematurity in a resource-constrained setting: a mixed methods clinical feasibility study protocol

BACKGROUND

Apnoea of prematurity (AOP) is a common condition among preterm infants. Methylxanthines, such as caffeine and aminophylline/theophylline, can help prevent and treat AOP. Due to its physiological benefits and fewer side effects, caffeine citrate is recommended for the prevention and treatment of AOP. However, caffeine citrate is not available in most resource-constrained settings (RCS) due to its high cost. Challenges in RCS using caffeine citrate to prevent AOP include identifying eligible preterm infants where gestational age is not always known and the capability for continuous monitoring of vital signs to readily identify apnoea. We aim to develop an evidence-based care bundle that includes caffeine citrate to prevent and manage AOP in tertiary healthcare facilities in Kenya.

METHODS

This protocol details a prospective mixed-methods clinical feasibility study on using caffeine citrate to manage apnoea of prematurity in a single facility tertiary-care newborn unit (NBU) in Nairobi, Kenya. This study will include a 4-month formative research phase followed by the development of an AOP clinical-care-bundle prototype over 2 months. In the subsequent 4 months, implementation and improvement of the clinical-care-bundle prototype will be undertaken. The baseline data will provide contextualised insights on care practices within the NBU that will inform the development of a context-sensitive AOP clinical-care-bundle prototype. The clinical care bundle will be tested and refined further during an implementation phase of the quality improvement initiative using a PDSA framework underpinned by quantitative and qualitative clinical audits and stakeholders' engagement. The quantitative component will include all neonates born at gestation age < 34 weeks and any neonate prescribed aminophylline or caffeine citrate admitted to the NBU during the study period.

DISCUSSION

There is a need to develop evidence-based and context-sensitive clinical practice guidelines to standardise and improve the management of AOP in RCS. Concerns requiring resolution in implementing such guidelines include diagnosis of apnoea, optimal timing, dosing and administration of caffeine citrate, standardisation of monitoring devices and alarm limits, and discharge protocols. We aim to provide a feasible standardised clinical care bundle for managing AOP in low and middle-income settings.

Policies and resources for strengthening of emergency and critical care services in the context of the global COVID-19 pandemic in Kenya

Critical illnesses cause several million deaths annually, with many of these occurring in low-resource settings like Kenya. Great efforts have been made worldwide to scale up critical care to reduce deaths from COVID-19. Lower income countries with fragile health systems may not have had sufficient resources to upscale their critical care. We aimed to review how efforts to strengthen emergency and critical care were operationalised during the pandemic in Kenya to point towards how future emergencies should be approached. This was an exploratory study that involved document reviews, and discussions with key stakeholders (donors, international agencies, professional associations, government actors), during the first year of the pandemic in Kenya. Our findings suggest that pre-pandemic health services for the critically ill in Kenya were sparse and unable to meet rising demand, with major limitations noted in human resources and infrastructure. The pandemic response saw galvanised action by the Government of Kenya and other agencies to mobilise resources (approximately USD 218 million). Earlier efforts were largely directed towards advanced critical care but since the human resource gap could not be reduced immediately, a lot of equipment remained unused. We also note that despite strong policies on what resources should be available, the reality on the ground was that there were often critical shortages. While emergency response mechanisms are not conducive to addressing long-term health system issues, the pandemic increased global recognition of the need to fund care for the critically ill. Limited resources may be best prioritised towards a public health approach with focus on provision of relatively basic, lower cost essential emergency and critical care (EECC) that can potentially save the most lives amongst critically ill patients.

Quality of inpatient paediatric and newborn care in district hospitals: WHO indicators, measurement, and improvement

Poor-quality paediatric and neonatal care in district hospitals in low-income and middle-income countries (LMICs) was first highlighted more than 20 years ago. WHO recently developed more than 1000 paediatric and neonatal quality indicators for hospitals. Prioritising these indicators should account for the challenges in producing reliable process and outcome data in these settings, and their measurement should not unduly narrow the focus of global and national actors to reports of measured indicators. A three-tier, long-term strategy for the improvement of paedicatric and neonatal care in LMIC district hospitals is needed, comprising quality measurement, governance, and front-line support. Measurement should be better supported by integrating data from routine information systems to reduce the future cost of surveys. Governance and quality management processes need to address system-wide issues and develop supportive institutional norms and organisational culture. This strategy requires governments, regulators, professions, training institutions, and others to engage beyond the initial consultation on indicator selection, and to tackle the pervasive constraints that undermine the quality of district hospital care. Institutional development must be combined with direct support to hospitals. Too often the focus of indicator measurement as an improvement strategy is on reporting up to regional or national managers, but not on providing support down to hospitals to attain quality care.

Development of pediatric acute care education (PACE): An adaptive electronic learning (e-learning) environment for healthcare providers in Tanzania

Globally, inadequate healthcare provider (HCP) proficiency with evidence-based guidelines contributes to millions of newborn, infant, and child deaths each year. HCP guideline proficiency would improve patient outcomes. Conventional (in person) HCP in-service education is limited in 4 ways: reach, scalability, adaptability, and the ability to contextualize. Adaptive e-learning environments (AEE), a subdomain of e-learning, incorporate artificial intelligence technology to create a unique cognitive model of each HCP to improve education effectiveness. AEEs that use existing internet access and personal mobile devices may overcome limits of conventional education. This paper provides an overview of the development of our AEE HCP in-service education, Pediatric Acute Care Education (PACE). PACE uses an innovative approach to address HCPs' proficiency in evidence-based guidelines for care of newborns, infants, and children. PACE is novel in 2 ways: 1) its patient-centric approach using clinical audit data or frontline provider input to determine content and 2) its ability to incorporate refresher learning over time to solidify knowledge gains. We describe PACE's integration into the Pediatric Association of Tanzania's (PAT) Clinical Learning Network (CLN), a multifaceted intervention to improve facility-based care along a single referral chain. Using principles of co-design, stakeholder meetings modified PACE's characteristics and optimized integration with CLN. We plan to use three-phase, mixed-methods, implementation process. Phase I will examine the feasibility of PACE and refine its components and protocol. Lessons gained from this initial phase will guide the design of Phase II proof of concept studies which will generate insights into the appropriate empirical framework for (Phase III) implementation at scale to examine effectiveness.

Assessment of neonatal resuscitation skills among healthcare workers in Uasin Gishu County, Kenya

Objective

Neonatal resuscitation is key in preventing neonatal mortality. The objective of this study was to assess the competence of healthcare workers in basic neonatal resuscitation at six hospitals in Uasin Gishu County in Kenya.

Methods

This was a cross-sectional study of healthcare workers based on the labor and delivery wards.

Results

Of the 46 healthcare workers who were assessed with a written examination and skills assessment, 85% were nurses. While 46% were able to pass the written examination, none demonstrated all required steps of newborn resuscitation during the skills assessment by simulation. No significant associations were present between the pass rate of the written examination and years of experience, role, or prior in-service training. All of the hospitals had the basic equipment required for neonatal resuscitation.

Conclusion

There is a need to further develop the neonatal resuscitation skills among healthcare workers in the labor and delivery wards in Uasin Gishu County, Kenya.

Lessons from the design, development and implementation of a three-dimensional (3D) neonatal resuscitation training smartphone application: Life-saving Instruction for Emergencies (LIFE app)

Neonatal mortality remains disproportionately high in sub-Saharan Africa partly due to insufficient numbers of adequately trained and skilled front-line health workers. Opportunities for improving neonatal care may result from upskilling frontline health workers using innovative technological approaches. This practice paper describes the key steps involved in the design, development and implementation of an innovative smartphone-based training application using an agile, human-centred design approach. The Life-saving Instruction for Emergencies (LIFE) app is a three-dimension (3D) scenario-based mobile app for smartphones and is free to download. Two clinical modules are currently included with further scenarios planned. Whilst the focus of the practice paper is on the lessons learned during the design and development process, we also share key learning related to project management and sustainability plans, which we hope will help researchers working on similar projects.

Improving in-patient neonatal data quality as a pre-requisite for monitoring and improving quality of care at scale: A multisite retrospective cohort study in Kenya

The objectives of this study were to (1)explore the quality of clinical data generated from hospitals providing in-patient neonatal care participating in a clinical information network (CIN) and whether data improved over time, and if data are adequate, (2)characterise accuracy of prescribing for basic treatments provided to neonatal in-patients over time. This was a retrospective cohort study involving neonates ≤28 days admitted between January 2018 and December 2021 in 20 government hospitals with an interquartile range of annual neonatal inpatient admissions between 550 and 1640 in Kenya. These hospitals participated in routine audit and feedback processes on quality of documentation and care over the study period. The study's outcomes were the number of patients as a proportion of all eligible patients over time with (1)complete domain-specific documentation scores, and (2)accurate domain-specific treatment prescription scores at admission, reported as incidence rate ratios. 80,060 neonatal admissions were eligible for inclusion. Upon joining CIN, documentation scores in the monitoring, other physical examination and bedside testing, discharge information, and maternal history domains demonstrated a statistically significant month-to-month relative improvement in number of patients with complete documentation of 7.6%, 2.9%, 2.4%, and 2.0% respectively. There was also statistically significant month-to-month improvement in prescribing accuracy after joining the CIN of 2.8% and 1.4% for feeds and fluids but not for Antibiotic prescriptions. Findings suggest that much of the variation observed is due to hospital-level factors. It is possible to introduce tools that capture important clinical data at least 80% of the time in routine African hospital settings but analyses of such data will need to account for missingness using appropriate statistical techniques. These data allow exploration of trends in performance and could support better impact evaluation, exploration of links between health system inputs and outcomes and scrutiny of variation in quality and outcomes of hospital care.

White Paper on Early Critical Care Services in Low Resource Settings

This White Paper has been formally accepted for support by the International Federation for Emergency Medicine (IFEM) and by the World Federation of Intensive and Critical Care (WFICC), put forth by a multi-specialty group of intensivists and emergency medicine providers from low- and low-middle-income countries (LMICs) and high-income countries (HiCs) with the aim of 1) defining the current state of caring for the critically ill in low-resource settings (LRS) within LMICs and 2) highlighting policy options and recommendations for improving the system-level delivery of early critical care services in LRS.

LMICs have a high burden of critical illness and worse patient outcomes than HICs, hence, the focus of this White Paper is on the care of critically ill patients in the early stages of presentation in LMIC settings. In such settings, the provision of early critical care is challenged by a fragmented health system, costs, a health care workforce with limited training, and competing healthcare priorities.

Early critical care services are defined as the early interventions that support vital organ function during the initial care provided to the critically ill patient—these interventions can be performed at any point of patient contact and can be delivered across diverse settings in the healthcare system and do not necessitate specialty personnel.

Currently, a single “best” care delivery model likely does not exist in LMICs given the heterogeneity in local context; therefore, objective comparisons of quality, efficiency, and cost-effectiveness between varying models are difficult to establish. While limited, there is data to suggest that caring for the critically ill may be cost effective in LMICs, contrary to a widely held belief. Drawing from locally available resources and context, strengthening early critical care services in LRS will require a multi-faceted approach, including three core pillars: education, research, and policy.

Education initiatives for physicians, nurses, and allied health staff that focus on protocolized emergency response training can bridge the workforce gap in the short-term; however, each country’s current human resources must be evaluated to decide on the duration of training, who should be trained, and using what curriculum.

Understanding the burden of critical Illness, best practices for resuscitation, and appropriate quality metrics for different early critical care services implementation models in LMICs are reliant upon strengthening the regional research capacity, therefore, standard documentation systems should be implemented to allow for registry use and quality improvement.

Policy efforts at a local, national and international level to strengthen early critical care services should focus on funding the building blocks of early critical care services systems and promoting the right to access early critical care regardless of the patient’s geographic or financial barriers. Additionally, national and local policies describing ethical dilemmas involving the withdrawal of life-sustaining care should be developed with broad stakeholder representation based on local cultural beliefs as well as the optimization of limited resources.

Impact of a Multifaceted Intervention to Improve Emergency Care on Newborn and Child Health Outcomes in Rwanda

Implementing context-appropriate neonatal and pediatric advanced life support management interventions has increasingly been recommended as one of the approaches to reduce under-five mortality in resource-constrained settings like Rwanda. One such intervention is ETAT+, which stands for Emergency Triage, Assessment and Treatment plus Admission care for severely ill newborns and children. In 2013, ETAT+ was implemented in Rwandan district hospitals. We evaluated the impact of the ETAT+ intervention on newborn and child health outcomes. We used monthly time series data from the DHIS2-enabled Rwanda Health Management Information System from 2012 to 2016 to examine neonatal and pediatric hospital mortality rate. Each hospital contributed data for 12 and 36 months before and after ETAT+ implementation, respectively. Using controlled interrupted time series analysis and segmented regression model, we estimated longitudinal changes in neonatal and pediatric hospital mortality rate in intervention hospitals relative to matched concurrent control hospitals. We also studied changes in case fatality rate specifically for ETAT+ targeted conditions. Our study cohort consisted of seven intervention hospitals and fourteen matched control hospitals contributing 142,424 neonatal and pediatric hospital admissions. After controlling for secular trends and autocorrelation, we found that the ETAT+ implementation had no statistically significant impact on the rate of all-cause neonatal and pediatric hospital mortality in intervention hospitals relative to control hospitals. However, the case fatality rate for ETAT+ targeted neonatal conditions decreased immediately following implementation by 5% (95% CI: -9.25, -0.77) and over time by 0.8% monthly (95% CI: -1.36, -0.25), in intervention hospitals compared with control hospitals. Case fatality rate for ETAT+ targeted pediatric conditions did not decrease following the ETAT+ implementation. While ETAT+ focuses on improving quality of hospital care for both newborns and children, we only found an impact on neonatal hospital mortality for ETAT+ targeted conditions that should be interpreted with caution given the relatively short pre-intervention period and potential regression to the mean.

Value of stakeholder engagement in improving newborn care in Kenya: a qualitative description of perspectives and lessons learned

OBJECTIVE

Embedding researchers within health systems results in more socially relevant research and more effective uptake of evidence into policy and practice. However, the practice of embedded health service research remains poorly understood. We explored and assessed the development of embedded participatory approaches to health service research by a health research team in Kenya highlighting the different ways multiple stakeholders were engaged in a neonatal research study.

METHODS

We conducted semistructured qualitative interviews with key stakeholders. Data were analysed thematically using both inductive and deductive approaches.

SETTING

Over recent years, the Health Services Unit within the Kenya Medical Research Institute (KEMRI)-Wellcome Trust Research Programme in Nairobi Kenya, has been working closely with organisations and technical stakeholders including, but not limited to, medical and nursing schools, frontline health workers, senior paediatricians, policymakers and county officials, in developing and conducting embedded health research. This involves researchers embedding themselves in the contexts in which they carry out their research (mainly in county hospitals, local universities and other training institutions), creating and sustaining social networks. Researchers collaboratively worked with stakeholders to identify clinical, operational and behavioural issues related to routine service delivery, formulating and exploring research questions to bring change in practice PARTICIPANTS: We purposively selected 14 relevant stakeholders spanning policy, training institutions, healthcare workers, regulatory councils and professional associations.

RESULTS

The value of embeddedness is highlighted through the description of a recently completed project, Health Services that Deliver for Newborns (HSD-N). We describe how the HSD-N research process contributed to and further strengthened a collaborative research platform and illustrating this project's role in identifying and generating ideas about how to tackle health service delivery problems CONCLUSIONS: We conclude with a discussion about the experiences, challenges and lessons learned regarding engaging stakeholders in the coproduction of research.

Employing learning health system principles to advance research on severe neonatal and paediatric illness in Kenya

We have worked to develop a Clinical Information Network (CIN) in Kenya as an early form of learning health systems (LHS) focused on paediatric and neonatal care that now spans 22 hospitals. CIN's aim was to examine important outcomes of hospitalisation at scale, identify and ultimately solve practical problems of service delivery, drive improvements in quality and test interventions. By including multiple routine settings in research, we aimed to promote generalisability of findings and demonstrate potential efficiencies derived from LHS. We illustrate the nature and range of research CIN has supported over the past 7 years as a form of LHS. Clinically, this has largely focused on common, serious paediatric illnesses such as pneumonia, malaria and diarrhoea with dehydration with recent extensions to neonatal illnesses. CIN also enables examination of the quality of care, for example that provided to children with severe malnutrition and the challenges encountered in routine settings in adopting simple technologies (pulse oximetry) and more advanced diagnostics (eg, Xpert MTB/RIF). Although regular feedback to hospitals has been associated with some improvements in quality data continue to highlight system challenges that undermine provision of basic, quality care (eg, poor access to blood glucose testing and routine microbiology). These challenges include those associated with increased mortality risk (eg, delays in blood transfusion). Using the same data the CIN platform has enabled conduct of randomised trials and supports malaria vaccine and most recently COVID-19 surveillance. Employing LHS principles has meant engaging front-line workers, clinical managers and national stakeholders throughout. Our experience suggests LHS can be developed in low and middle-income countries that efficiently enable contextually appropriate research and contribute to strengthening of health services and research systems.

Paediatric Emergency Triage, Assessment and Treatment (ETAT) - preparedness for implementation at primary care facilities in Malawi

Background

The majority of deaths amongst children under 5 years are still due to preventable infectious causes. Emergency care has been identified as a key health system weakness, and referrals are often challenging.

Objective

We aimed to establish how prepared frontline facilities in Malawi are to implement WHO Emergency Triage Assessment and Treatment (ETAT) guidelines, to support policy and planning decisions.

Methods

We conducted a concurrent mixed-methods study, including facility audit; healthcare provider survey; focus group discussions (FGD) and semi-structured interviews with facility staff. The study was conducted in two districts in Malawi, Zomba and Mchinji, between January and May 2019. We included all frontline facilities, including dispensaries, primary health centres, rural and community hospitals. Quantitative data were described using proportions, means and linear regression. Qualitative data was analysed using a framework approach. Data were analysed separately and then triangulated into common themes.

Results

Forty-seven facilities and 531 healthcare providers were included in the audit and survey; 6 FGDs and 5 interviews were completed. Four common themes emerged: (1) current emergency case management; (2) referral practices; (3) trained staff capacity; (4) opportunities and barriers for ETAT. Triage was conducted in most facilities with various methods described, and 53% reporting all staff are responsible. Referrals were common, but challenging due to issues in transportation. Twelve percent of survey respondents had ETAT training, with clinical officers (41%) reporting this more frequently than other cadres. Training was associated with increased knowledge, independent of cadre. The main barriers to ETAT implementation were the lack of resources, but opportunities to improve quality of care were reported.

Conclusions

Malawian frontline facilities are already providing a level of emergency paediatric care, but issues in training, drug supplies and equipment were present. To effectively scale-up ETAT, policies need to include supply chain management, maintenance and strengthening referral communication.

The Use of in situ Simulation in Healthcare Education: Current Perspectives

In situ simulation is the practice of using simulated scenarios in a clinical environment itself rather than in training facilities to promote learning and improved clinical care. The use of in situ simulation has been increasingly used to train healthcare staff in dealing with emergencies, resuscitation and clinical skills. The aim of this study is to provide an overview of the themes, perspectives and approaches to in situ simulation for educational purposes with healthcare staff. The literature search included studies describing and evaluating in situ simulations with an educational component. We carried out a narrative synthesis and extracted data on the clinical setting, the simulation purpose, design, evaluation method and impact. In situ simulation has proved useful in a range of different specialties for skills improvement and team development. Simulation design ranges in terms of fidelity, duration and topic. No specific design has shown to be the most efficient. However, adopting a design that fits into the specific centers resources, educational needs and clinical demands is the most important consideration.

Antibiotic use in Kenyan public hospitals: Prevalence, appropriateness and link to guideline availability

•

We report findings from a point prevalence survey across 14 Kenyan public hospitals.

•

About half of the hospitalised patients received appropriate antibiotic therapy.

•

Laboratory investigations supported less than 1% of the antibiotic prescriptions.

•

Physical availability of treatment guidelines influenced treatment appropriateness.

•

There is need for context-specific, up-to-date, and accessible treatment guidelines.

Objective

To examine prescription patterns and explore to what extent guidelines are available and how they might influence treatment appropriateness among hospitalised patients in Kenyan hospitals.

Methods

Data on antimicrobial usage were collected from hospitalised patients across 14 Kenyan public hospitals. For each prescription, appropriateness of treatment was defined using available local and international treatment guidelines and through consensus with local medical specialists. Association between appropriate treatment, guideline availability and other possible explanatory factors was explored using univariate and multiple regression analysis.

Results

There were 1675 (46.7%) of the 3590 hospitalised patients on antimicrobials with 3145(94%) of the 3363 antimicrobial prescriptions being antibiotics. Two patients (0.1%), had treatment based on available antibiotic susceptibility tests. Appropriate treatment was assessed in 1502 patients who had a single diagnosis. Of these, 805 (53.6%) received appropriate treatment. Physical availability of treatment guidelines increased the odds of receiving appropriate treatment Odds Ratio 6.44[95% CI 4.81–8.64].

Conclusion

Appropriate antibiotic prescription remains a challenge in Kenyan public hospitals. This may be improved by the availability of context-specific, up-to-date, and readily accessible treatment guidelines across all the departments, and by providing better diagnostic support.

Evaluation of Adaptive Feedback in a Smartphone-Based Game on Health Care Providers' Learning Gain: Randomized Controlled Trial

BACKGROUND

Although smartphone-based emergency care training is more affordable than traditional avenues of training, it is still in its infancy, remains poorly implemented, and its current implementation modes tend to be invariant to the evolving learning needs of the intended users. In resource-limited settings, the use of such platforms coupled with gamified approaches remains largely unexplored, despite the lack of traditional training opportunities, and high mortality rates in these settings.

OBJECTIVE

The primary aim of this randomized experiment is to determine the effectiveness of offering adaptive versus standard feedback, on the learning gains of clinicians, through the use of a smartphone-based game that assessed their management of a simulated medical emergency. A secondary aim is to examine the effects of learner characteristics and learning spacing with repeated use of the game on the secondary outcome of individualized normalized learning gain.

METHODS

The experiment is aimed at clinicians who provide bedside neonatal care in low-income settings. Data were captured through an Android app installed on the study participants' personal phones. The intervention, which was based on successful attempts at a learning task, included adaptive feedback provided within the app to the experimental arm, whereas the control arm received standardized feedback. The primary end point was completion of the second learning session. Of the 572 participants enrolled between February 2019 and July 2019, 247 (43.2%) reached the primary end point. The primary outcome was standardized relative change in learning gains between the study arms as measured by the Morris G effect size. The secondary outcomes were the participants individualized normalized learning gains.

RESULTS

The effect of adaptive feedback on care providers' learning gain was found to be g=0.09 (95% CI -0.31 to 0.46; P=.47). In exploratory analysis, using normalized learning gains, when subject-treatment interaction and differential time effect was controlled for, this effect increased significantly to 0.644 (95% CI 0.35 to 0.94; P<.001) with immediate repetition, which is a moderate learning effect, but reduced significantly by 0.28 after a week. The overall learning change from the app use in both arms was large and may have obscured a direct effect of feedback.

CONCLUSIONS

There is a considerable learning gain between the first two rounds of learning with both forms of feedback and a small added benefit of adaptive feedback after controlling for learner differences. We suggest that linking the adaptive feedback provided to care providers to how they space their repeat learning session(s) may yield higher learning gains. Future work might explore in more depth the feedback content, in particular whether or not explanatory feedback (why answers were wrong) enhances learning more than reflective feedback (information about what the right answers are).

TRIAL REGISTRATION

Pan African Clinical Trial Registry (PACTR) 201901783811130; https://pactr.samrc.ac.za/TrialDisplay.aspx?TrialID=5836.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.2196/13034.

Triage conducted by lay-staff and emergency training reduces paediatric mortality in the emergency department of a rural hospital in Northern Mozambique

INTRODUCTION

The majority of emergency paediatric death in African countries occur within the first 24 h of admission. A coloured triage system is widely implemented in high-income countries and the emergency triage and assessment treatment (ETAT) is recommended by the World Health Organization, but not put into practice in Mozambique. We implemented a three-colour triage system in a rural district hospital with lay-staff workers conducting the first triage.

METHODS

A retrospective, before and after, mortality analysis was performed using routine patient files from the district hospital between 2014 and 2017. The triage system was implemented in August 2016. Inclusion criteria were children under 15 years of age that entered the emergency centre. Primary outcome was child mortality rate. Secondary outcomes included the percentage agreement between the clinical and non-clinical staff and the duration from triage to first treatment. We used a negative binomial model in STATA 15 to compare mortality rates, and Kappa statistics to estimate the agreement between clinical and non-clinical staff.

RESULTS

4176 admissions were included. The mortality rate ratio (MMR) was 45% lower after the start of the intervention (2016; MRR = 0.55; 0.38, 0.81; p = 0.002), compared to before. To estimate the agreement between non-clinical and clinical staff, 548 (of the 671) patient files were included. The agreement was estimated at 88.7% (Kappa = 0.644; p < 0.001). The median waiting time decreased with urgency of the triage: 2 h33 for 'green'/least serious (IQR 1 h58-3 h30), 21 min for yellow/serious (IQR 0 h10-0 h58) and nine minutes for 'red'/urgent (IQR 2-40 min).

CONCLUSION

In a rural setting with nurse-led clinical care and non-clinician staff working at the triage reception, implementation of a three-coloured triage system was feasible. Triage and ETAT training was associated with a decrease of 45% of paediatric deaths. The impact on mortality, low cost, and ease of the implementation supports scaling this intervention in similar settings.

Evaluation of Adaptive Feedback in a Smartphone-Based Serious Game on Health Care Providers' Knowledge Gain in Neonatal Emergency Care: Protocol for a Randomized Controlled Trial

BACKGROUND

Although smartphone-based clinical training to support emergency care training is more affordable than traditional avenues of training, it is still in its infancy and remains poorly implemented. In addition, its current implementations tend to be invariant to the evolving learning needs of the intended users. In resource-limited settings, the use of such platforms coupled with serious-gaming approaches remain largely unexplored and underdeveloped, even though they offer promise in terms of addressing the health workforce skill imbalance and lack of training opportunities associated with the high neonatal mortality rates in these settings.

OBJECTIVE

This randomized controlled study aims to assess the effectiveness of offering adaptive versus standard feedback through a smartphone-based serious game on health care providers' knowledge gain on the management of a neonatal medical emergency.

METHODS

The study is aimed at health care workers (physicians, nurses, and clinical officers) who provide bedside neonatal care in low-income settings. We will use data captured through an Android smartphone-based serious-game app that will be downloaded to personal phones belonging to the study participants. The intervention will be adaptive feedback provided within the app. The data captured will include the level of feedback provided to participants as they learn to use the mobile app, and performance data from attempts made during the assessment questions on interactive tasks participants perform as they progress through the app on emergency neonatal care delivery. The primary endpoint will be the first two complete rounds of learning within the app, from which the individuals' "learning gains" and Morris G intervention effect size will be computed. To minimize bias, participants will be assigned to an experimental or a control group by a within-app random generator, and this process will be concealed to both the study participants and the investigators until the primary endpoint is reached.

RESULTS

This project was funded in November 2016. It has been approved by the Central University Research Ethics Committee of the University of Oxford and the Scientific and Ethics Review Unit of the Kenya Medical Research Institute. Recruitment and data collection began from February 2019 and will continue up to July 31, 2019. As of July 18, 2019, we enrolled 541 participants, of whom 238 reached the primary endpoint, with a further 19 qualitative interviews conducted to support evaluation. Full analysis will be conducted once we reach the end of the study recruitment period.

CONCLUSIONS

This study will be used to explore the effectiveness of adaptive feedback in a smartphone-based serious game on health care providers in a low-income setting. This aspect of medical education is a largely unexplored topic in this context. In this randomized experiment, the risk of performance bias across arms is moderate, given that the active ingredient of the intervention (ie, knowledge) is a latent trait that is difficult to comprehensively control for in a real-world setting. However, the influence of any resulting bias that has the ability to alter the results will be assessed using alternative methods such as qualitative interviews.

TRIAL REGISTRATION

Pan African Clinical Trials Registry PACTR201901783811130; https://pactr.samrc.ac.za/TrialDisplay. aspx?TrialID=5836.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

PRR1-10.2196/13034.

Adherence to clinical guidelines is associated with reduced inpatient mortality among children with severe anemia in Ugandan hospitals

BACKGROUND

In resource limited settings, there is variability in the level of adherence to clinical guidelines in the inpatient management of children with common conditions like severe anemia. However, there is limited data on the effect of adherence to clinical guidelines on inpatient mortality in children managed for severe anemia.

METHODS

We analyzed data from an uncontrolled before and after in-service training intervention to improve quality of care in Lira and Jinja regional referral hospitals in Uganda. Inpatient records of children aged 0 to 5 years managed as cases of 'severe anemia (SA)' were reviewed to ascertain adherence to clinical guidelines and compare inpatient deaths in SA children managed versus those not managed according to clinical guidelines. Logistic regression analysis was conducted to evaluate the relationship between clinical care factors and inpatient deaths amongst patients managed for SA.

RESULTS

A total of 1,131 children were assigned a clinical diagnosis of 'severe anemia' in the two hospitals. There was improvement in the level of care after the in-service training intervention with more children being managed according to clinical guidelines compared to the period before, 218/510 (42.7%) vs 158/621 (25.4%) (p < 0.001). Overall, children managed according to clinical guidelines had reduced risk of inpatient mortality compared to those not managed according to clinical guidelines, [OR 0.28, (95%, CI 0.14, 0.55), p = 0.001]. Clinical care factors associated with decreased risk of inpatient death included, having pre-transfusion hemoglobin done to confirm diagnosis [OR 0.5; 95% CI 0.29, 0.87], a co-morbid diagnosis of severe malaria [OR 0.4; 95% CI 0.25, 0.76], and being reviewed after admission by a clinician [OR 0.3; 95% CI 0.18, 0.59], while a co-morbid diagnosis of severe acute malnutrition was associated with increased risk of inpatient death [OR 4.2; 95% CI 2.15, 8.22].

CONCLUSION

Children with suspected SA who are managed according to clinical guidelines have lower in-hospital mortality than those not managed according to the guidelines. Efforts to reduce inpatient mortality in SA children in resource-limited settings should focus on training and supporting health workers to adhere to clinical guidelines.

Continuing Professional Development in Maternal Health Care: Barriers to Applying New Knowledge and Skills in the Hospitals of Rwanda

Objectives Training healthcare professionals in emergency maternal healthcare is a critical component of improving overall maternal health in developing countries like Rwanda. This paper explored the challenges that healthcare professionals who participated in a Continuing Professional Development (CPD) program on Advanced Life Support in Obstetrics® (ALSO) face in putting the learned knowledge and skills into practice in hospitals of Rwanda. Methods This study used a mixed methods approach to understand the challenges/barriers to applying new knowledge and skills in the hospitals of Rwanda. We conducted thirteen purposive in-depth interviews with ALSO® trainees (nurses, midwives and physicians) complemented with a cross-sectional survey on staff turnover in eight of the nine hospitals in the Eastern province of Rwanda. Results Our study found that trainees do not get enough opportunity to apply the new knowledge and skills in their hospitals and expand to health centers. In part because they are frequently rotating to different departments of the hospital and are not getting the opportunity to train their colleagues to share the learned knowledge and skills. The lack of refresher trainings/mentorship and the high personnel turnover were also reported as a barrier to applying new knowledge and skills. Reasons for staff turnover included pursuing further studies, a better opportunity (job/remuneration), low morale, and family related motives including joining a spouse or better schools for children. Conclusions for Practice Expanding and formalizing CPD training to all the healthcare professionals involved in providing maternal care services would improve the provision of emergency maternal healthcare in Rwanda.

Using a common data platform to facilitate audit and feedback on the quality of hospital care provided to sick newborns in Kenya

Essential interventions to reduce neonatal deaths that can be effectively delivered in hospitals have been identified. Improving information systems may support routine monitoring of the delivery of these interventions and outcomes at scale. We used cycles of audit and feedback (A&F) coupled with the use of a standardised newborn admission record (NAR) form to explore the potential for creating a common inpatient neonatal data platform and illustrate its potential for monitoring prescribing accuracy. Revised NARs were introduced in a high volume, neonatal unit in Kenya together with 13 A&F meetings over a period of 3  years from January 2014 to November 2016. Data were abstracted from medical records for 15 months before introduction of the revised NAR and A&F and during the 3 years of A&F. We calculated, for each patient, the percentage of documented items from among the total recommended for documentation and trends calculated over time. Gentamicin prescribing accuracy was also tracked over time. Records were examined for 827 and 7336 patients in the pre-A&F and post-A&F periods, respectively. Documentation scores improved overall. Documentation of gestational age improved from <15% in 2014 to >75% in 2016. For five recommended items, including temperature, documentation remained <50%. 16.7% (n=1367; 95%  CI 15.9 to 17.6) of the admitted babies had a diagnosis of neonatal sepsis needing antibiotic treatment. In this group, dosing accuracy of gentamicin improved over time for those under 2  kg from 60% (95%36.1 to 80.1) in 2013 to 83% (95% CI 69.2 to 92.3) in 2016. We report that it is possible to improve routine data collection in neonatal units using a standardised neonatal record linked to relatively basic electronic data collection tools and cycles of A&F. This can be useful in identifying potential gaps in care and tracking outcomes with an aim of improving the quality of care.

Knowledge Accrual Following Participation in Pediatric Fundamental Critical Care Support Course in Gaborone, Botswana

OBJECTIVES

To describe provider characteristics, knowledge acquisition, perceived relevance, and instruction quality of the Society of Critical Care Medicine's Pediatric Fundamentals of Critical Care Support course pilot implementation in Botswana.

DESIGN

Observational, single center.

SETTING

Academic, upper middle-income country.

SUBJECTS

Healthcare providers in Botswana.

INTERVENTIONS

A cohort of healthcare providers completed the standard 2-day Pediatric Fundamentals of Critical Care Support course and qualitative survey during the course. Cognitive knowledge was assessed prior to and immediately following training using standard Pediatric Fundamentals of Critical Care Support multiple choice questionnaires. Data analysis used Fisher exact, chi-square, paired t test, and Wilcoxon rank-sum where appropriate.

MAIN RESULTS

There was a significant increase in overall multiple choice questionnaires scores after training (mean 67% vs 77%; p < 0.001). Early career providers had significantly lower mean baseline scores (56% vs 71%; p < 0.01), greater knowledge acquisition (17% vs 7%; p < 0.02), but no difference in posttraining scores (73% vs 78%; p = 0.13) compared with more senior providers. Recent pediatric resuscitation or emergency training did not significantly impact baseline scores, posttraining scores, or decrease knowledge acquisition. Eighty-eight percent of providers perceived the course was highly relevant to their clinical practice, but only 71% reported the course equipment was similar to their current workplace.

CONCLUSIONS

Pediatric Fundamentals of Critical Care Support training significantly increased provider knowledge to care for hospitalized seriously ill or injured children in Botswana. Knowledge accrual is most significant among early career providers and is not limited by previous pediatric resuscitation or emergency training. Further contextualization of the course to use equipment relevant to providers work environment may increase the value of training.

Association of the Paediatric Admission Quality of Care score with mortality in Kenyan hospitals: a validation study

Background

Measuring the quality of hospital admission care is essential to ensure that standards of practice are met and continuously improved to reduce morbidity and mortality associated with the illnesses most responsible for inpatient deaths. The Paediatric Admission Quality of Care (PAQC) score is a tool for measuring adherence to guidelines for children admitted with acute illnesses in a low-income setting. We aimed to explore the external and criterion-related validity of the PAQC score by investigating its association with mortality using data drawn from a diverse sample of Kenyan hospitals.

Methods

We identified children admitted to Kenyan hospitals for treatment of malaria, pneumonia, diarrhoea, or dehydration from datasets from three sources: an observational study, a clinical trial, and a national cross-sectional survey. We extracted variables describing the process of care provided to patients at admission and their eventual outcomes from these data. We applied the PAQC scoring algorithm to the data to obtain a quality-of-care score for each child. We assessed external validity of the PAQC score by its systematic replication in datasets that had not been previously used to investigate properties of the PAQC score. We assessed criterion-related validity by using hierarchical logistic regression to estimate the association between PAQC score and the outcome of mortality, adjusting for other factors thought to be predictive of the outcome or responsible for heterogeneity in quality of care.

Findings

We found 19 065 eligible admissions in the three validation datasets that covered 27 hospitals, of which 12 969 (68%) were complete cases. Greater guideline adherence, corresponding to higher PAQC scores, was associated with a reduction in odds of death across the three datasets, ranging between 9% (odds ratio 0·91, 95% CI 0·84–0·99; p=0·031) and 30% (0·70, 0·63–0·78; p<0·0001) adjusted reduction per unit increase in the PAQC score, with a pooled estimate of 17% (0·83, 0·78–0·89; p<0·0001). These findings were consistent with a multiple imputation analysis that used information from all observations in the combined dataset.

Interpretation

The PAQC score, designed as an index of the technical quality of care for the three commonest causes of admission in children, is also associated with mortality. This finding suggests that it could be a meaningful summary measure of the quality of care for common inpatient conditions and supports a link between process quality and outcome. It might have potential for application in low-income countries with similar disease profiles and in which paediatric practice recommendations are based on WHO guidelines.

Funding

The Wellcome Trust.

Prevalence, outcome and quality of care among children hospitalized with severe acute malnutrition in Kenyan hospitals: A multi-site observational study

Background

Severe acute malnutrition (SAM) remains a major cause of admission and inpatient mortality worldwide in children aged less than 5 years. In this study, we explored SAM prevalence and outcomes in children admitted in 13 Kenyan hospitals participating in a Clinical Information Network (CIN). We also describe their immediate in-patient management.

Methods

We analyzed data for children aged 1–59 months collected retrospectively from medical records after discharge. Mean, median and ranges were used to summarize pooled and age-specific prevalence and mortality associated with SAM. Documentation of key signs and symptoms (S/S) and performance of indicators of quality of care for selected aspects of the WHO management steps were assessed. Logistic regression models were used to evaluate associations between documented S/S and mortality among SAM patients aged 6–59 months. Loess curves were used to explore performance change over time for indicators of selected SAM management steps.

Results

5306/54140 (9.8%) children aged 1–59 months admitted with medical conditions in CIN hospitals between December 2013 and November 2016 had SAM. SAM prevalence identified by clinicians and case fatality varied widely across hospitals with median proportion (range) of 10.1% (4.6–18.2%) and 14.8% (6.0–28.6%) respectively. Seventeen variables were associated with increased mortality. Performance change over time of management steps varied across hospitals and across selected indicators but suggests some effect of regular audit and feedback.

Conclusion

Identification of SAM patients, their mortality and adherence to in-patient management recommendations varied across hospitals. An important group of SAM patients are aged less than 6 months. Continued efforts are required to improve management of SAM in routine settings as part of efforts to reduce inpatient mortality.

Assessing process of paediatric care in a resource-limited setting: a cross-sectional audit of district hospitals in Rwanda

BACKGROUND

Routine assessment of quality of care helps identify deficiencies which need to be improved. While gaps in the emergency care of children have been documented across sub-Saharan Africa, data from Rwanda are lacking.

OBJECTIVE

To assess the care of sick infants and children admitted to Rwandan district hospitals and the extent to which it follows currently recommended clinical practice guidelines in Rwanda.

METHODS

Data were gathered during a retrospective cross-sectional audit of eight district hospitals across Rwanda in 2012/2013. Medical records were randomly selected from each hospital and were reviewed to assess the process of care, focusing on the leading causes of under-5 mortality, including neonatal conditions, pneumonia, malaria and dehydration/diarrhoea.

RESULTS

Altogether, 522 medical records were reviewed. Overall completion of a structured neonatal admission record was above 85% (range 78.6-90.0%) and its use was associated with better documentation of key neonatal signs (median score 6/8 and 2/8 when used and not used, respectively). Deficiencies in the processes of care were identified across hospitals and there were rural/urban disparities for some indicators. For example, neonates admitted to urban district hospitals were more likely to receive treatment consistent with currently recommended guidelines [e.g. gentamicin (OR 2.52, 95% CI 1.03-6.43) and fluids (OR 2.69, 95% CI 1.2-6.2)] than those in rural hospitals. Likewise, children with pneumonia admitted to urban hospitals were more likely to receive the correct dosage of gentamicin (OR 4.47, 95% CI 1.21-25.1) and to have their treatment monitored (OR 3.75, 95% CI 1.57-8.3) than in rural hospitals. Furthermore, children diagnosed with malaria and admitted to urban hospitals were more likely to have their treatment (OR 2.7, 95% CI 1.15-6.41) monitored than those in rural hospitals.

CONCLUSIONS

Substantial gaps were identified in the process of neonatal and paediatric care across district hospitals in Rwanda. There is a need to (i) train health care professionals in providing neonatal and paediatric care according to nationally adopted clinical practice guidelines (e.g. ETAT+); (ii) establish a supervision and mentoring programme to ensure that the guidelines are available and used appropriately in district hospitals; and (iii) use admission checklists (e.g. neonatal and paediatric admission records) in district hospitals.

Developing and Implementing a Pediatric Emergency Care Curriculum for Providers at District Level Hospitals in Sub-Saharan Africa: A Case Study in Kenya

Introduction

Emergency medicine is a relatively new field in sub-Saharan Africa and dedicated training in pediatric emergency care is limited. While guidelines from the African Federation of Emergency Medicine (AFEM) regarding emergency training exist, a core curriculum in pediatric emergency care has not yet been established for providers at the district hospital level.

Methods

The objective of the project was to develop a curriculum for providers with limited training in pediatric emergencies, and contain didactic and simulation components with emphasis on treatment and resuscitation using available resources. A core curriculum for pediatric emergency care was developed using a validated model of medical education curriculum development and through review of existing guidelines and literature. Based on literature review, as well as a review of existent guidelines in pediatric and emergency care, 10 core topics were chosen and agreed upon by experts in the field, including pediatric and emergency care providers in Kenya and the United States. These topics were confirmed to be consistent with the principles of emergency care endorsed by AFEM as well as complimentary to existing Kenyan medical school syllabi. A curriculum based on these 10 core topics was created and subsequently piloted with a group of medical residents and clinical officers at a community hospital in western Kenya.

Results

The 10 core pediatric topics prioritized were airway management, respiratory distress, thoracic and abdominal trauma, head trauma and cervical spine management, sepsis and shock, endocrine emergencies, altered mental status/toxicology, orthopedic emergencies, burn and wound management, and pediatric advanced life support. The topics were incorporated into a curriculum comprised of ten 1.5-h combined didactic plus low-fidelity simulation modules. Feedback from trainers and participating providers gave high ratings to the ease of information delivery, relevance, and appropriateness of the curriculum.

Conclusion

We present here a core curriculum in pediatric emergency care for district hospital level providers in Kenya which can be used as a framework for further development and implementation of training programs throughout sub-Saharan Africa.

Developing guidelines in low-income and middle-income countries: lessons from Kenya

There are few examples of sustained nationally organised, evidence-informed clinical guidelines development processes in Sub-Saharan Africa. We describe the evolution of efforts from 2005 to 2015 to support evidence-informed decision making to guide admission hospital care practices in Kenya. The approach to conduct reviews, present evidence, and structure and promote transparency of consensus-based procedures for making recommendations improved over four distinct rounds of policy making. Efforts to engage important voices extended from government and academia initially to include multiple professional associations, regulators and practitioners. More than 100 people have been engaged in the decision-making process; an increasing number outside the research team has contributed to the conduct of systematic reviews, and 31 clinical policy recommendations has been developed. Recommendations were incorporated into clinical guideline booklets that have been widely disseminated with a popular knowledge and skills training course. Both helped translate evidence into practice. We contend that these efforts have helped improve the use of evidence to inform policy. The systematic reviews, Grading of Recommendations, Assessment, Development and Evaluation (GRADE) approaches and evidence to decision-making process are well understood by clinicians, and the process has helped create a broad community engaged in evidence translation together with a social or professional norm to use evidence in paediatric care in Kenya. Specific sustained efforts should be made to support capacity and evidence-based decision making in other African settings and clinical disciplines.

Implementing the Emergency Triage, Assessment and Treatment plus admission care (ETAT+) clinical practice guidelines to improve quality of hospital care in Rwandan district hospitals: healthcare workers' perspectives on relevance and challenges

Background

An emergency triage, assessment and treatment plus admission care (ETAT+) intervention was implemented in Rwandan district hospitals to improve hospital care for severely ill infants and children. Many interventions are rarely implemented with perfect fidelity under real-world conditions. Thus, evaluations of the real-world experiences of implementing ETAT+ are important in terms of identifying potential barriers to successful implementation. This study explored the perspectives of Rwandan healthcare workers (HCWs) on the relevance of ETAT+ and documented potential barriers to its successful implementation.

Methods

HCWs enrolled in the ETAT+ training were asked, immediately after the training, their perspective regarding (i) relevance of the ETAT+ training to Rwandan district hospitals; (ii) if attending the training would bring about change in their work; and (iii) challenges that they encountered during the training, as well as those they anticipated to hamper their ability to translate the knowledge and skills learned in the ETAT+ training into practice in order to improve care for severely ill infants and children in their hospitals. They wrote their perspectives in French, Kinyarwanda, or English and sometimes a mixture of all these languages that are official in the post-genocide Rwanda. Their notes were translated to (if not already in) English and transcribed, and transcripts were analyzed using thematic content analysis.

Results

One hundred seventy-one HCWs were included in our analysis. Nearly all these HCWs stated that the training was highly relevant to the district hospitals and that it aligned with their work expectation. However, some midwives believed that the “neonatal resuscitation and feeding” components of the training were more relevant to them than other components. Many HCWs anticipated to change practice by initiating a triage system in their hospital and by using job aids including guidelines for prescription and feeding. Most of the challenges stemmed from the mode of the ETAT+ training delivery (e.g., language barriers, intense training schedule); while others were more related to uptake of guidelines in the district hospitals (e.g., staff turnover, reluctance to change, limited resources, conflicting protocols).

Conclusion

This study highlights potential challenges to successful implementation of the ETAT+ clinical practice guidelines in order to improve quality of hospital care in Rwandan district hospitals. Understanding these challenges, especially from HCWs perspective, can guide efforts to improve uptake of clinical practice guidelines including ETAT+ in Rwanda.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2193-4) contains supplementary material, which is available to authorized users.

Enhancing emergency care in low-income countries using mobile technology-based training tools

In this paper, we discuss the role of mobile technology in developing training tools for health workers, with particular reference to low-income countries (LICs). The global and technological context is outlined, followed by a summary of approaches to using and evaluating mobile technology for learning in healthcare. Finally, recommendations are made for those developing and using such tools, based on current literature and the authors' involvement in the field.

Prevalence, aetiology, treatment and outcomes of shock in children admitted to Kenyan hospitals

BACKGROUND

Shock may complicate several acute childhood illnesses in hospitals within low-income countries and has a high case fatality. Hypovolemic shock secondary to diarrhoea/dehydration and septic shock are thought to be common, but there are few reliable data on prevalence or treatment that differ for the two major forms of shock. Examining prevalence and treatment practices has become important since reports suggest high risks from liberal use of fluid boluses in African children. The present study aims to estimate the prevalence, fluid management practices and outcomes of shock among hospitalised children.

METHODS

We analysed paediatric in-patient data collected using discharge case record review between October 2013 and February 2016 from 14 hospitals in Kenya which are part of a network (referred to as the Clinical Information Network) using similar tools for standardised clinical records with care directed by the local clinical team leaders. Data are from a period after dissemination of national guidance seeking to limit use of bolus fluids.

RESULTS

A total of 74,402 children were admitted between October 2013 and February 2016. Children aged < 30 days or > 5 years, with severe acute malnutrition, surgical/burns, or cases with pre-defined minimum data sets were excluded from analysis. This resulted in 42,937 patients meeting the inclusion criteria. Prevalence of clinically diagnosed shock was 1.5 % (n = 622) and overall bolus use was 0.9 % (n = 366); 41 % (256/622) of children with clinically diagnosed shock did not receive a fluid bolus (but had a fluid plan for management of dehydration). Identified cases appeared mostly to be hypovolaemic shock secondary to dehydration/diarrhoea (94 %, 582/622), with a high case fatality (34 %, 211/622). Overall mortality for all admitted children was 5 % (2115/42,937) and was 7.9 % (798/10,096) in children with dehydration/diarrhoea. The diagnosis of hypovolaemic shock was nearly always accompanied by additional clinical diagnosis (99 %), most often pneumonia or malaria. Where bolus fluids were used, they were prescribed in accordance with guidelines (isotonic fluid at correct volume) in 92 % of cases. Inappropriate use of bolus fluids to treat milder forms of impaired circulation appeared very rarely.

CONCLUSION

A diagnosis of shock is uncommon at admission and use of fluid bolus is rare in admissions to Kenyan hospitals. A fluid bolus, when prescribed, is mostly used in children with hypovolemic shock secondary to dehydration and case fatality in these cases is high. We found little evidence of liberal use of fluid bolus that might cause harm in a period following dissemination of national guidelines suggesting very strict criteria for fluid bolus use.

Correlates of Performance of Healthcare Workers in Emergency, Triage, Assessment and Treatment plus Admission Care (ETAT+) Course in Rwanda: Context Matters

BACKGROUND

The Emergency, Triage, Assessment and Treatment plus Admission care (ETAT+) course, a comprehensive advanced pediatric life support course, was introduced in Rwanda in 2010 to facilitate the achievement of the fourth Millennium Development Goal. The impact of the course on improving healthcare workers (HCWs) knowledge and practical skills related to providing emergency care to severely ill newborns and children in Rwanda has not been studied.

OBJECTIVE

To evaluate the impact of the ETAT+ course on HCWs knowledge and practical skills, and to identify factors associated with greater improvement in knowledge and skills.

METHODS

We used a one group, pre-post test study using data collected during ETAT+ course implementation from 2010 to 2013. The paired t-test was used to assess the effect of ETAT+ course on knowledge improvement in participating HCWs. Mixed effects linear and logistic regression models were fitted to explore factors associated with HCWs performance in ETAT+ course knowledge and practical skills assessments, while accounting for clustering of HCWs in hospitals.

RESULTS

374 HCWs were included in the analysis. On average, knowledge scores improved by 22.8/100 (95% confidence interval (CI) 20.5, 25.1). In adjusted models, bilingual (French & English) participants had a greater improvement in knowledge 7.3 (95% CI 4.3, 10.2) and higher odds of passing the practical skills assessment (adjusted odds ratio (aOR) = 2.60; 95% CI 1.25, 5.40) than those who were solely proficient in French. Participants who attended a course outside of their health facility had higher odds of passing the skills assessment (aOR = 2.11; 95% CI 1.01, 4.44) than those who attended one within their health facility.

CONCLUSIONS

The current study shows a positive impact of ETAT+ course on improving participants' knowledge and skills related to managing emergency pediatric and neonatal care conditions. The findings regarding key factors influencing ETAT+ course outcomes demonstrate the importance of considering key contextual factors (e.g., language barriers) that might affect HCWs performance in this type of continuous medical education.

A Review of Pediatric Critical Care in Resource-Limited Settings: A Look at Past, Present, and Future Directions

Fifteen years ago, United Nations world leaders defined millenium development goal 4 (MDG 4): to reduce under-5-year mortality rates by two-thirds by the year 2015. Unfortunately, only 27 of 138 developing countries are expected to achieve MDG 4. The majority of childhood deaths in these settings result from reversible causes, and developing effective pediatric emergency and critical care services could substantially reduce this mortality. The Ebola outbreak highlighted the fragility of health care systems in resource-limited settings and emphasized the urgent need for a paradigm shift in the global approach to healthcare delivery related to critical illness. This review provides an overview of pediatric critical care in resource-limited settings and outlines strategies to address challenges specific to these areas. Implementation of these tools has the potential to move us toward delivery of an adequate standard of critical care for all children globally, and ultimately decrease global child mortality in resource-limited settings.

Admission Risk Score to Predict Inpatient Pediatric Mortality at Four Public Hospitals in Uganda

Mortality rates among hospitalized children in many government hospitals in sub-Saharan Africa are high. Pediatric emergency services in these hospitals are often sub-optimal. Timely recognition of critically ill children on arrival is key to improving service delivery. We present a simple risk score to predict inpatient mortality among hospitalized children. Between April 2010 and June 2011, the Uganda Malaria Surveillance Project (UMSP), in collaboration with the National Malaria Control Program (NMCP), set up an enhanced sentinel site malaria surveillance program for children hospitalized at four public hospitals in different districts: Tororo, Apac, Jinja and Mubende. Clinical data collected through March 2013, representing 50249 admissions were used to develop a mortality risk score (derivation data set). One year of data collected subsequently from the same hospitals, representing 20406 admissions, were used to prospectively validate the performance of the risk score (validation data set). Using a backward selection approach, 13 out of 25 clinical parameters recognizable on initial presentation, were selected for inclusion in a final logistic regression prediction model. The presence of individual parameters was awarded a score of either 1 or 2 based on regression coefficients. For each individual patient, a composite risk score was generated. The risk score was further categorized into three categories; low, medium, and high. Patient characteristics were comparable in both data sets. Measures of performance for the risk score included the receiver operating characteristics curves and the area under the curve (AUC), both demonstrating good and comparable ability to predict deathusing both the derivation (AUC =0.76) and validation dataset (AUC =0.74). Using the derivation and validation datasets, the mortality rates in each risk category were as follows: low risk (0.8% vs. 0.7%), moderate risk (3.5% vs. 3.2%), and high risk (16.5% vs. 12.6%), respectively. Our analysis resulted in development of a risk score that ably predicted mortality risk among hospitalized children. While validation studies are needed, this approach could be used to improve existing triage systems.

Access to and value of information to support good practice for staff in Kenyan hospitals

Background

Studies have sought to define information needs of health workers within very specific settings or projects. Lacking in the literature is how hospitals in low-income settings are able to meet the information needs of their staff and the use of information communication technologies (ICT) in day-to-day information searching.

Objective

The study aimed to explore where professionals in Kenyan hospitals turn to for work-related information in their day-to-day work. Additionally, it examined what existing solutions are provided by hospitals with regard to provision of best practice care. Lastly, the study explored the use of ICT in information searching.

Design

Data for this study were collected in July 2012. Self-administered questionnaires (SAQs) were distributed across 22 study hospitals with an aim to get a response from 34 health workers per hospital.

Results

SAQs were collected from 657 health workers. The most popular sources of information to guide work were fellow health workers and printed guidelines while the least popular were scientific journals. Of value to health workers were: national treatment policies, new research findings, regular reports from surveillance data, information on costs of services and information on their performance of routine clinical tasks; however, hospitals only partially met these needs. Barriers to accessing information sources included: ‘not available/difficult to get’ and ‘difficult to understand’. ICT use for information seeking was reported and with demographic specific differences noted from the multivariate logistic regression model; nurses compared to medical doctors and older workers were less likely to use ICT for health information searching. Barriers to accessing Internet were identified as: high costs and the lack of the service at home or at work.

Conclusions

Hospitals need to provide appropriate information by improving information dissemination efforts and providing an enabling environment that allows health workers find the information they need for best practice.

In-service training for health professionals to improve care of seriously ill newborns and children in low-income countries

BACKGROUND

A variety of in-service emergency care training courses are currently being promoted as a strategy to improve the quality of care provided to seriously ill newborns and children in low-income countries. Most courses have been developed in high-income countries. However, whether these courses improve the ability of health professionals to provide appropriate care in low-income countries remains unclear. This is the first update of the original review.

OBJECTIVES

To assess the effects of in-service emergency care training on health professionals' treatment of seriously ill newborns and children in low-income countries.

SEARCH METHODS

For this update, we searched the Cochrane Database of Systematic Reviews, part of The Cochrane Library (www.cochranelibrary.com); MEDLINE, Ovid SP; EMBASE, Ovid SP; the Cochrane Central Register of Controlled Trials (CENTRAL), part of The Cochrane Library (www.cochranelibrary.com) (including the Cochrane Effective Practice and Organisation of Care (EPOC) Group Specialised Register); Science Citation Index and Social Sciences Citation Index, Institute for Scientific Information (ISI) Web of Knowledge/Science and eight other databases. We performed database searches in February 2015. We also searched clinical trial registries, websites of relevant organisations and reference lists of related reviews. We applied no date, language or publication status restrictions when conducting the searches.

SELECTION CRITERIA

Randomised trials, non-randomised trials, controlled before and after studies and interrupted-time-series studies that compared the effects of in-service emergency care training versus usual care were eligible for inclusion. We included only hospital-based studies and excluded community-based studies. Two review authors independently screened and selected studies for inclusion.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data and assessed study risk of bias and confidence in effect estimates (certainty of evidence) for each outcome using GRADE (Grades of Recommendation, Assessment, Development and Evaluation). We described results and presented them in GRADE tables.

MAIN RESULTS

We identified no new studies in this update. Two randomised trials (which were included in the original review) met the review eligibility criteria. In the first trial, newborn resuscitation training compared with usual care improved provider performance of appropriate resuscitation (trained 66% vs usual care 27%, risk ratio 2.45, 95% confidence interval (CI) 1.75 to 3.42; moderate certainty evidence) and reduced inappropriate resuscitation (trained mean 0.53 vs usual care 0.92, mean difference 0.40, 95% CI 0.13 to 0.66; moderate certainty evidence). Effect on neonatal mortality was inconclusive (trained 28% vs usual care 25%, risk ratio 0.77, 95% CI 0.40 to 1.48; N = 27 deaths; low certainty evidence). Findings from the second trial suggest that essential newborn care training compared with usual care probably slightly improves delivery room newborn care practices (assessment of breathing, preparedness for resuscitation) (moderate certainty evidence).

AUTHORS' CONCLUSIONS

In-service neonatal emergency care courses probably improve health professionals' treatment of seriously ill babies in the short term. Further multi-centre randomised trials evaluating the effects of in-service emergency care training on long-term outcomes (health professional practice and patient outcomes) are needed.

Moving towards routine evaluation of quality of inpatient pediatric care in Kenya

Background

Regular assessment of quality of care allows monitoring of progress towards system goals and identifies gaps that need to be addressed to promote better outcomes. We report efforts to initiate routine assessments in a low-income country in partnership with government.

Methods

A cross-sectional survey undertaken in 22 ‘internship training’ hospitals across Kenya that examined availability of essential resources and process of care based on review of 60 case-records per site focusing on the common childhood illnesses (pneumonia, malaria, diarrhea/dehydration, malnutrition and meningitis).

Results

Availability of essential resources was 75% (45/61 items) or more in 8/22 hospitals. A total of 1298 (range 54–61) case records were reviewed. HIV testing remained suboptimal at 12% (95% CI 7–19). A routinely introduced structured pediatric admission record form improved documentation of core admission symptoms and signs (median score for signs 22/22 and 8/22 when form used and not used respectively). Correctness of penicillin and gentamicin dosing was above 85% but correctness of prescribed intravenous fluid or oral feed volumes for severe dehydration and malnutrition were 54% and 25% respectively. Introduction of Zinc for diarrhea has been relatively successful (66% cases) but use of artesunate for malaria remained rare. Exploratory analysis suggests considerable variability of the quality of care across hospitals.

Conclusion

Quality of pediatric care in Kenya has improved but can improve further. The approach to monitoring described in this survey seems feasible and provides an opportunity for routine assessments across a large number of hospitals as part of national efforts to sustain improvement. Understanding variability across hospitals may help target improvement efforts.

Knowledge and skills retention following Emergency Triage, Assessment and Treatment plus Admission course for final year medical students in Rwanda: a longitudinal cohort study

AIM

To determine whether, after the Emergency Triage, Assessment and Treatment plus Admission (ETAT+) course, a comprehensive paediatric life support course, final year medical undergraduates in Rwanda would achieve a high level of knowledge and practical skills and if these were retained. To guide further course development, student feedback was obtained.

METHODS

Longitudinal cohort study of knowledge and skills of all final year medical undergraduates at the University of Rwanda in academic year 2011-2012 who attended a 5-day ETAT+ course. Students completed a precourse knowledge test. Knowledge and clinical skills assessments, using standardised marking, were performed immediately postcourse and 3-9 months later. Feedback was obtained using printed questionnaires.

RESULTS

84 students attended the course and re-evaluation. Knowledge test showed a significant improvement, from median 47% to 71% correct answers (p<0.001). For two clinical skills scenarios, 98% passed both scenarios, 37% after a retake, 2% failed both scenarios. Three to nine months later, students were re-evaluated, median score for knowledge test 67%, not significantly different from postcourse (p>0.1). For clinical skills, 74% passed, with 32% requiring a retake, 8% failed after retake, 18% failed both scenarios, a significant deterioration (p<0.0001).

CONCLUSIONS

Students performed well on knowledge and skills immediately after a comprehensive ETAT+ course. Knowledge was maintained 3-9 months later. Clinical skills, which require detailed sequential steps, declined, but most were able to perform them satisfactorily after feedback. The course was highly valued, but several short courses and more practical teaching were advocated.

Prevalence and correlates of treatment failure among Kenyan children hospitalised with severe community-acquired pneumonia: a prospective study of the clinical effectiveness of WHO pneumonia case management guidelines

Objective

To determine the extent and pattern of treatment failure (TF) among children hospitalised with community-acquired pneumonia at a large tertiary hospital in Kenya.

Methods

We followed up children aged 2–59 months with WHO-defined severe pneumonia (SP) and very severe pneumonia (VSP) for up to 5 days for TF using two definitions: (i) documentation of pre-defined clinical signs resulting in change of treatment (ii) primary clinician's decision to change treatment with or without documentation of the same pre-defined clinical signs.

Results

We enrolled 385 children. The risk of TF varied between 1.8% (95% CI 0.4–5.1) and 12.4% (95% CI 7.9–18.4) for SP and 21.4% (95% CI 15.9–27) and 39.3% (95% CI 32.5–46.4) for VSP depending on the definition applied. Higher rates were associated with early changes in therapy by clinician in the absence of an obvious clinical rationale. Non-adherence to treatment guidelines was observed for 70/169 (41.4%) and 67/201 (33.3%) of children with SP and VSP, respectively. Among children with SP, adherence to treatment guidelines was associated with the presence of wheeze on initial assessment (P = 0.02), while clinician non-adherence to guideline-recommended treatments for VSP tended to occur in children with altered consciousness (P < 0.001). Using propensity score matching to account for imbalance in the distribution of baseline clinical characteristics among children with VSP revealed no difference in TF between those treated with the guideline-recommended regimen vs. more costly broad-spectrum alternatives [risk difference 0.37 (95% CI −0.84 to 0.51)].

Conclusion

Before revising current pneumonia case management guidelines, standardised definitions of TF and appropriate studies of treatment effectiveness of alternative regimens are required.

Objectif

Déterminer l'ampleur et les caractéristiques de l’échec du traitement (ET) chez les enfants hospitalisés avec une pneumonie acquise dans la communauté dans un grand hôpital tertiaire du Kenya.

Méthodes

Nous avons suivi des enfants âgés de 2 à 59 mois avec une pneumonie sévère (PS) et une pneumonie très sévère (PTS) telles que définies par l’OMS, sur un maximum de cinq jours pour l’ET, en utilisant deux définitions: (a) documentation des signes cliniques prédéfinis ayant entraîné un changement du traitement, (b) décision primaire du clinicien de changer de traitement avec ou sans documentation des mêmes signes cliniques prédéfinis.

Résultats

Nous avons recruté 385 enfants. Le risque d’ET variait de 1,8% (IC95%: 0,4 à 5,1) à 12,4% (IC95%: 7,9 à 18,4) pour la PS et de 21,4% (IC95%: 15,9 à 27) à 39,3% (IC95%: 32,5 à 46,4) pour la PTS selon la définition appliquée. Des taux plus élevés étaient associés à des changements précoces du traitement par le clinicien en l'absence d'une justification clinique évidente. Le non-respect des directives de traitement a été observé pour 70/169 (41,4%) et 67/201 (33,3%) enfants avec une PS et une PTS respectivement. Chez les enfants avec une PS, le respect des directives de traitement était associé avec la présence d'une respiration sifflante au cours l’évaluation initiale (P = 0,02) tandis que le non respect par les cliniciens des traitements recommandés pour la PTS tendait à se produire chez les enfants avec une altération de la conscience (P <0,001). L'utilisation du score de propension correspondant pour tenir compte du déséquilibre dans la répartition des caractéristiques cliniques de base chez les enfants avec une PTS n'a révélé aucune différence dans l’ET entre ceux traités avec le régime recommandé par les directives et ceux traités par des alternatives plus coûteuses à large spectre (différence de risque: 0,37 (IC95%: -0,84 à 0,51).

Conclusion

Avant la révision des directives actuelles de prise en charge des cas de pneumonie, des définitions standard d’ET et des études appropriées de l'efficacité des traitements alternatifs sont nécessaires.

Objetivo

Determinar la extensión y el patrón del fallo en el tratamiento (FT) en niños hospitalizados con una neumonía adquirida en la comunidad, ingresados en un gran hospital terciario de Kenia.

Métodos

Hemos seguido a niños con edades entre los 2-59 meses con una neumonía severa (NS) y neumonía muy severa (NMS) según definición de la OMS de hasta cinco días para FT utilizando dos definiciones: (a) documentación de signos clínicos pre-definidos que resultaron en un cambio de tratamiento (b) decisión del clínico principal de cambiar el tratamiento con o sin documentación de los mismos signos clínicos pre-definidos.

Resultados

Incluimos a 385 niños. El riesgo de FT varió entre un 1.8% (IC 95% 0.4 a 5.1) y 12.4% (IC 95% 7.9 a 18.4) para NS y 21.4% (IC 95% 15.9 a 27) y 39.3% (IC 95% 32.5 a 46.4) para NMS dependiendo de la definición que se aplicase. Unas mayores tasas estaban asociadas con cambios tempranos en la terapia por el clínico y en ausencia de un razonamiento clínico obvio. Se observaba una no adherencia a las guías de tratamiento en 70/169 (41.4%) y 67/201 (33.3%) de los niños con NS y NMS respectivamente. Entre los niños con SP, la adherencia a las guías de tratamiento estaba asociada con la presencia de sibilancias en la evaluación inicial (P=0.02) mientras que la no adherencia del clínico a los tratamientos recomendados por las guías para NMS tendían a ocurrir en niños con un estado alterado de consciencia (P<0.001). Utilizando el pareamiento por puntaje de propensión para equilibrar los grupos en la distribución de las características clínicas de base de los niños con NMS, se observó que no existían diferencias en FT entre aquellos tratados con el régimen recomendado por las guías versus alternativas más costosas de amplio espectro (diferencias de riesgo 0.37 (IC 95% -0.84 a 0.51).

Conclusión

Antes de revisar las actuales guías de manejo de casos de neumonía, se requieren definiciones estandarizadas de FT y estudios apropiados de la efectividad del tratamiento de regímenes alternativos.

Assessment of paediatric inpatient care during a multifaceted quality improvement intervention in Kenyan district hospitals--use of prospectively collected case record data

Background

In assessing quality of care in developing countries, retrospectively collected data are usually used given their availability. Retrospective data however suffer from such biases as recall bias and non-response bias. Comparing results obtained using prospectively and retrospectively collected data will help validate the use of the easily available retrospective data in assessing quality of care in past and future studies.

Methods

Prospective and retrospective datasets were obtained from a cluster randomized trial of a multifaceted intervention aimed at improving paediatric inpatient care conducted in eight rural Kenyan district hospitals by improving management of children admitted with pneumonia, malaria and diarrhea and/or dehydration. Four hospitals received a full intervention and four a partial intervention. Data were collected through 3 two weeks surveys conducted at baseline, after 6 and 18 months. Retrospective data was sampled from paediatric medical records of patients discharged in the preceding six months of the survey while prospective data was collected from patients discharged during the two week period of each survey. Risk Differences during post-intervention period of16 quality of care indicators were analyzed separately for prospective and retrospective datasets and later plotted side by side for comparison.

Results

For the prospective data there was strong evidence of an intervention effect for 8 of the indicators and weaker evidence of an effect for one indicator, with magnitude of effect sizes varying from 23% to 60% difference. For the retrospective data, 10 process (these include the 8 indicators found to be statistically significant in prospective data analysis) indicators had statistically significant differences with magnitude of effects varying from 10% to 42%. The bar-graph comparing results from the prospective and retrospective datasets showed similarity in terms of magnitude of effects and statistical significance for all except two indicators.

Conclusion

Multifaceted interventions can help improve adoption of clinical guidelines and hence improve the quality of care. The similar inference reached after analyses based on prospective assessment of case management is a useful finding as it supports the utility of work based on examination of retrospectively assembled case records allowing longer time periods to be studied while constraining costs.

Trial registration

Current Controlled Trials ISRCTN42996612. Trial registration date: 20/11/2008

Using health worker opinions to assess changes in structural components of quality in a Cluster Randomized Trial

BACKGROUND

The 'resource readiness' of health facilities to provide effective services is captured in the structure component of the classical Donabedian paradigm often used for assessment of the quality of care in the health sector. Periodic inventories are commonly used to confirm the presence (or absence) of equipment or drugs by physical observation or by asking those in charge to indicate whether an item is present or not. It is then assumed that this point observation is representative of the everyday status. However the availability of an item (consumables) may vary. Arguably therefore a more useful assessment for resources would be one that captures this fluctuation in time. Here we report an approach that may circumvent these difficulties.

METHODS

We used self-administered questionnaires (SAQ) to seek health worker views of availability of key resources supporting paediatric care linked to a cluster randomized trial of a multifaceted intervention aimed at improving this care conducted in eight rural Kenyan district hospitals. Four hospitals received a full intervention and four a partial intervention. Data were collected pre-intervention and after 6 and 18 months from health workers in three clinical areas asked to score item availability using an 11-point scale. Mean scores for items common to all 3 areas and mean scores for items allocated to domains identified using exploratory factor analysis (EFA) were used to describe availability and explore changes over time.

RESULTS

SAQ were collected from 1,156 health workers. EFA identified 11 item domains across the three departments. Mean availability scores for these domains were often <5/10 at baseline reflecting lack of basic resources such as oxygen, nutrition and second line drugs. An improvement in mean scores occurred in 8 out of 11 domains in both control and intervention groups. A calculation of difference in difference of means for intervention vs. control suggested an intervention effect resulting in greater changes in 5 out of 11 domains.

CONCLUSION

Using SAQ data to assess resource availability experienced by health workers provides an alternative to direct observations that provide point prevalence estimates. Further the approach was able to demonstrate poor access to resources, change over time and variability across place.

Implementation in Indonesia of the WHO Pocket Book of Hospital Care for Children

BACKGROUND

Effective implementation of evidence-based practice guidelines has the potential to improve quality of hospital care for children. To achieve this in Indonesia, a locally adapted version of the WHO Pocket Book of Hospital Care for Children was published in 2009.

OBJECTIVES

To document implementation of the Pocket Book in Indonesia and to compare uptake in health facilities in which there has been a quality-improvement approach involving audit and feedback with uptake in settings in which there has been only passive dissemination.

METHODS

Indonesian district health offices, district hospitals, health centres with beds, and medical schools were surveyed by telephone, and an online and telephone survey of paediatricians was conducted. Health facilities in four provinces were visited, and key stakeholders were interviewed. Health facilities were assessed on availability of the guidelines, use by staff, and their incorporation into hospital procedures and activities.

RESULTS

There was evidence of use of the Pocket Book across Indonesia, despite limited funding for implementation. Its distribution had reached all provinces; 61% (33/54) of health facilities surveyed had a copy of the guidelines. Hospitals involved in a related quality audit were more likely to report use of the guidelines than hospitals exposed to passive dissemination, although this difference was not significant. Of 150 paediatricians sampled, 109 (73%) reported referring to the guidelines in their clinical practice. The guidelines have been incorporated into the postgraduate paediatric curriculum in four of 13 universities sampled.

CONCLUSION

There was encouraging evidence of uptake of the Pocket Book in Indonesia following local adaptation, nationwide mailing distribution and small-scale local implementation activities.

Explaining the uptake of paediatric guidelines in a Kenyan tertiary hospital--mixed methods research

Background

Evidence-based standards for management of the seriously sick child have existed for decades, yet their translation in clinical practice is a challenge. The context and organization of institutions are known determinants of successful translation, however, research using adequate methodologies to explain the dynamic nature of these determinants in the quality-of-care improvement process is rarely performed.

Methods

We conducted mixed methods research in a tertiary hospital in a low-income country to explore the uptake of locally adapted paediatric guidelines. The quantitative component was an uncontrolled before and after intervention study that included an exploration of the intervention dose-effect relationship. The qualitative component was an ethnographic research based on the theoretical perspective of participatory action research. Interpretive integration was employed to derive meta-inferences that provided a more complete picture of the overall study results that reflect the complexity and the multifaceted ontology of the phenomenon studied.

Results

The improvement in health workers’ performance in relation to the intensity of the intervention was not linear and was characterized by improved and occasionally declining performance. Possible root causes of this performance variability included challenges in keeping knowledge and clinical skills updated, inadequate commitment of the staff to continued improvement, limited exposure to positive professional role models, poor teamwork, failure to maintain professional integrity and mal-adaptation to institutional pressures.

Conclusion

Implementation of best-practices is a complex process that is largely unpredictable, attributed to the complexity of contextual factors operating predominantly at professional and organizational levels. There is no simple solution to implementation of best-practices. Tackling root causes of inadequate knowledge translation in this tertiary care setting will require long-term planning, with emphasis on promotion of professional ethics and values and establishing an organizational framework that enhances positive aspects of professionalism. This study has significant implications for the quality of training in medical institutions and the development of hospital leadership.

Factors influencing performance of health workers in the management of seriously sick children at a Kenyan tertiary hospital--participatory action research

BACKGROUND

Implementation of World Health Organization case management guidelines for serious childhood illnesses remains a challenge in hospitals in low-income countries. Facilitators of and barriers to implementation of locally adapted clinical practice guidelines (CPGs) have not been explored.

METHODS

This ethnographic study based on the theory of participatory action research (PAR) was conducted in Kenyatta National Hospital, Kenya's largest teaching hospital. The primary intervention consisted of dissemination of locally adapted CPGs. The PRECEDE-PROCEED health education model was used as the conceptual framework to guide and examine further reinforcement activities to improve the uptake of the CPGs. Activities focussed on introduction of routine clinical audits and tailored educational sessions. Data were collected by a participant observer who also facilitated the PAR over an eighteen-month period. Naturalistic inquiry was utilized to obtain information from all hospital staff encountered while theoretical sampling allowed in-depth exploration of emerging issues. Data were analysed using interpretive description.

RESULTS

Relevance of the CPGs to routine work and emergence of a champion of change facilitated uptake of best-practices. Mobilization of basic resources was relatively easily undertaken while activities that required real intellectual and professional engagement of the senior staff were a challenge. Accomplishments of the PAR were largely with the passive rather than active involvement of the hospital management. Barriers to implementation of best-practices included i) mismatch between the hospital's vision and reality, ii) poor communication, iii) lack of objective mechanisms for monitoring and evaluating quality of clinical care, iv) limited capacity for planning strategic change, v) limited management skills to introduce and manage change, vi) hierarchical relationships, and vii) inadequate adaptation of the interventions to the local context.

CONCLUSIONS

Educational interventions, often regarded as 'quick-fixes' to improve care in low-income countries, may be necessary but are unlikely to be sufficient to deliver improved services. We propose that an understanding of organizational issues that influence the behaviour of individual health professionals should guide and inform the implementation of best-practices.