Identification of performance indicators for emergency centres in South Africa: results of a Delphi study

Clinical emergency care quality indicators in Africa: a scoping review and data summary

OBJECTIVES

Emergency care services are rapidly expanding in Africa; however, development must focus on quality. The African Federation of Emergency Medicine consensus conference (AFEM-CC)-based quality indicators were published in 2018. This study sought to increase knowledge of quality through identifying all publications from Africa containing data relevant to the AFEM-CC process clinical and outcome quality indicators.

DESIGN

We conducted searches for general quality of emergency care in Africa and for each of 28 AFEM-CC process clinical and five outcome clinical quality indicators individually in the medical and grey literature.

DATA SOURCES

PubMed (1964-2 January 2022), Embase (1947-2 January 2022) and CINAHL (1982-3 January 2022) and various forms of grey literature were queried.

ELIGIBILITY CRITERIA

Studies published in English, addressing the African emergency care population as a whole or large subsegment of this population (eg, trauma, paediatrics), and matching AFEM-CC process quality indicator parameters exactly were included. Studies with similar, but not exact match, data were collected separately as 'AFEM-CC quality indicators near match'.

DATA EXTRACTION AND SYNTHESIS

Document screening was done in duplicate by two authors, using Covidence, and conflicts were adjudicated by a third. Simple descriptive statistics were calculated.

RESULTS

One thousand three hundred and fourteen documents were reviewed, 314 in full text. 41 studies met a priori criteria and were included, yielding 59 unique quality indicator data points. Documentation and assessment quality indicators accounted for 64% of data points identified, clinical care for 25% and outcomes for 10%. An additional 53 'AFEM-CC quality indicators near match' publications were identified (38 new publications and 15 previously identified studies that contained additional 'near match' data), yielding 87 data points.

CONCLUSIONS

Data relevant to African emergency care facility-based quality indicators are highly limited. Future publications on emergency care in Africa should be aware of, and conform with, AFEM-CC quality indicators to strengthen understanding of quality.

Assessment of documented adherence to critical actions in paediatric emergency care at a district-level public hospital in South Africa

Introduction

The provision of high-quality care is vital to improve child health and survival rates. A simple, practice-based tool was recently developed to evaluate the quality of paediatric emergency care in resource-limited settings in Africa. This study used the practice-based tool to describe the documented adherence to critical actions in paediatric emergency care at an urban district-level hospital in South Africa and assess its relation to clinical outcomes.

Methods

This study is a retrospective observational study covering a 19-month period (September 2017 to March 2019). Patients <13 years old, presenting to the emergency centre with one of six sentinel presentations (seizure, altered mental status, diarrhoea, fever, respiratory distress and polytrauma) were eligible for inclusion. In the patients' files, critical actions specific for each presentation were checked for completion. Post-hoc, a seventh group ‘multiple diagnoses’ was created for patients with more than one sentinel disease. The action completion rate was tested for association with clinical outcomes.

Results

In total, 388 patients were included (median age 1.1 years, IQR 0.3–3.6). The action completion rate varied from 63% (polytrauma) to 90% (respiratory distress). Participants with ≥75% action completion rate were younger (p < 0.001), presented with high acuity (p < 0.001), were more likely to be admitted (adjusted OR 2.2, 95%CI: 1.2–4.1), and had a hospital stay ≥4 days (adjusted OR 3.4, 95%CI: 1.5–7.9).

Conclusion

A high completion rate was associated with young age, a high patient acuity, hospital admission, length of hospital stay ≥4 days, and the specific sentinel presentation. Future research should determine whether or not documented care corresponds with the quality of delivered care and the predictive value regarding clinical outcome.

Availability of Emergency Drugs and Essential Equipment in Intensive Care Units in Hospitals of Ethiopia: A Multicenter Cross-Sectional Study

Purpose

Emergency drugs and essential equipment are important to successfully manage patients in the intensive care unit (ICUs). The absence of these emergency drugs and essential equipment might result in mortality and morbidity which is more compounded in resource-limited settings. This study aims to assess the availability of emergency drugs and essential equipment in ICUs in hospitals in Ethiopia.

Materials and Methods

A cross-sectional descriptive study design was employed in the intensive care unit of nine Amhara regional state hospitals in Ethiopia. This study was done from August 01, 2020, to September 01, 2020. The data were collected using a structured questionnaire, which were adopted from the Emergency Medicine Society of South Africa (EMSSA) guidelines. Tables and narration were used to describe results.

Results

There were deficiencies of essential emergency items particularly in the pediatrics domain, devices to confirm tracheal intubation and equipment for managing difficult intubation. Emergency drugs like adrenaline, salbutamol puff, atropine, aspirin, furosemide, hydrocortisone, insulin, lidocaine, and medical oxygen were available in all ICUs, whereas amiodarone, sodium bicarbonate, glucagon, ipratropium nebulization, thiamine were not available in all ICUs.

Conclusions and Recommendations

There were considerable deficiencies in emergency drugs and essential equipment. Based on our findings, we recommend to develop standardized checklists, regular audits, and healthcare personnel awareness program to improve checking, maintaining, restocking, and repairing the equipment in the emergency trolley.

Pre-hospital intercostal chest drains in South Africa: A modified Delphi study

INTRODUCTION

Trauma is one of the most common causes of death in low- and middle-income countries, with thoracic injury accounting for 20-25% of these deaths worldwide. The current management of a life-threatening pre-hospital pneumothorax is with a needle chest decompression, however, definitive care for a pneumothorax and/or haemothorax is still the insertion of an intercostal chest drain. The aim of this study was to seek expert opinion and consensus on the placement of ICDs in the pre-hospital emergency care setting in South Africa.

METHODS

A three-round modified Delphi study was undertaken with an expert panel drawn from local emergency care experts consisting of physicians and emergency medical service practitioners. Participants supplied opinion statements in round 1 under headings derived from common emerging themes found in the literature. During round 2 participants used a 9-point Likert scale to rate their consensus on each statement and in round 3 they were able to change their position based on the earlier panel distributions. A consensus percentage of 60% was set within a narrow margin of 'strongly agree' or 'strongly disagree'.

RESULTS

A total of 22 experts took part as panel members. There were 123 opinion statements produced from round 1, of which 21 (17%) reached consensus in round 2. At the end of round 3 another four statements reached consensus, bringing the total up to 25 (20%).

CONCLUSION

Definitive care of a life-threating pneumothorax and/or haemothorax must be sought emergently. The insertion of an ICD, under select conditions, may be required in the pre-hospital setting in South Africa.

Development of a simple, practice-based tool to assess quality of paediatric emergency care delivery in resource-limited settings: identifying critical actions via a Delphi study

OBJECTIVE

Provision of timely, high-quality care for the initial management of critically ill children in African hospitals remains a challenge. Monitoring the completion of critical actions during resuscitations can inform efforts to reduce variability and improve outcomes. We sought to develop a practice-based tool based on contextually relevant actions identified via a Delphi process. Our goal was to develop a tool that could identify gaps in care, facilitate identification of training and standardised assessment to support quality improvement efforts.

DESIGN

Six sentinel conditions were selected based on disease epidemiology and mortality at rural and urban African emergency departments. Potential critical actions were identified through focused literature review. These actions were evaluated within a three-round modified Delphi process. A set of logistical filters was applied to the candidate list to derive a practice-based tool.

SETTING AND PARTICIPANTS

Attendees at an international emergency medicine conference comprised an expert panel of 25 participants, with 84% working primarily in African settings. Consensus rounds allowing novel responses were conducted via online and in-person surveys.

RESULTS

The expert panel generated 199 actions that apply to six conditions in emergently ill children. Application of appropriateness criteria refined this to 92 candidate actions across the following seven categories: core skills, active seizure, altered mental status, diarrhoeal illness, febrile illness, respiratory distress and polytrauma. From these, we identified 28 actions for inclusion in a practice-based tool contextually relevant to the initial management of critically ill children in Africa.

CONCLUSIONS

A group consensus process identified critical actions for severely ill children with select sentinel conditions in emergency paediatric care in an African setting. Absence of these actions during resuscitation might reflect modifiable gaps in quality of care. The resulting practice-based tool is context relevant and can serve as a foundation for training and quality improvement efforts in African hospitals and emergency departments.

Protocol for development and validation of a context-appropriate tool for assessing organisational readiness for change in primary health clinics in South Africa

INTRODUCTION

A large treatment gap for common mental disorders (such as depression) exists in South Africa. Comorbidity with other chronic diseases, including HIV and diseases of lifestyle, is an increasing public health concern globally. Currently, primary health facilities as points of care for those with chronic disease provide limited services for common mental disorders. Assessing organisational readiness for change (ORC) towards adopting health innovations (such as mental health services) using contextually appropriate measures is needed to facilitate implementation of these services. This study aims to investigate the validity of the Texas Christian University Organisational Readiness for Change (TCU-ORC) scale in the South African context. Subsequently, we will develop a shortened version of this scale. This study is nested within Project MIND, a multiyear randomised controlled trial that is testing two different approaches for integrating counselling for common mental disorders into chronic disease care. Although the modified, contextually appropriate ORC measure resulting from the proposed study will be developed in the context of integrating mental health into primary healthcare services, the potential for the tool to be generalised to further understanding barriers to any change being implemented in primary care settings is high.

METHODS AND ANALYSIS

We will establish internal consistency (Cronbach's alpha coefficients), test-retest reliability (intraclass correlation coefficient) and construct validity of the long-form TCU-ORC questionnaire. Survey data will be collected from 288 clinical, management and operational staff from 24 primary health facilities where the Project MIND trial is implemented. A modified Delphi approach will assess the content validity of the TCU-ORC items and identify areas for potential adaptation and item reduction.

ETHICS AND DISSEMINATION

Ethical approval has been granted by the South African Medical Research Council (Protocol ID EC004-2-2015, amendment of 20 August 2017). Results will be submitted to peer-reviewed journals relevant to implementation and health systems strengthening.

Defining quality indicators for emergency care delivery: findings of an expert consensus process by emergency care practitioners in Africa

Facility-based emergency care delivery in low-income and middle- income countries is expanding rapidly, particularly in Africa. Unfortunately, these efforts rarely include measurement of the quality or the impact of care provided, which is essential for improvement of care provision. Our aim was to determine context-appropriate quality indicators that will allow uniform and objective data collection to enhance emergency care delivery throughout Africa. We undertook a multiphase expert consensus process to identify, rank and refine quality indicators. A comprehensive review of the literature identified existing indicators; those associated with a substantial burden of disease in Africa were categorised and presented to consensus conference delegates. Participants selected indicators based on inclusion criteria and priority clinical conditions. The indicators were then presented to a group of expert clinicians via on-line survey; all meeting agreements were refined in-person by a separate panel and ranked according to validity, feasibility and value. The consensus working group selected seven conditions addressing nearly 75% of mortality in the African region to prioritise during indicator development, and the final product at the end of the multiphase study was a list of 76 indicators. This comprehensive process produced a robust set of quality indicators for emergency care that are appropriate for use in the African setting. The adaptation of a standardised set of indicators will enhance the quality of care provided and allow for comparison of system strengthening efforts and resource distribution.

Selection of quality indicators for hospital-based emergency care in Denmark, informed by a modified-Delphi process

Background

In 2013, Danish policy-makers on a nationwide level decided to set up a national quality of care database for hospital-based emergency care in Denmark including the selection of quality indicators. The aim of the study was to describe the Delphi process that contributed to the selection of quality indicators for a new national database of hospital-based emergency care in Denmark.

Methods

The process comprised a literature review followed by a modified-Delphi survey process, involving a panel of 54 experts (senior clinicians, researchers and administrators from the emergency area and collaborating specialties). Based on the literature review, we identified 43 potential indicators, of which eight were time-critical conditions. We then consulted the Expert panel in two consecutive rounds. The Expert panel was asked to what extent each indicator would be a good measure of hospital-based emergency care in Denmark. In each round, the Expert panel participants scored each indicator on a Likert scale ranging from one (=disagree completely) through to six (=agree completely). Consensus for a quality indicator was reached if the median was greater than or equal to five (=agree). The Delphi process was followed by final selection by the steering group for the new database.

Results

Following round two of the Expert panel, consensus was reached on 32 quality indicators, including three time-critical conditions. Subsequently, the database steering group chose a set of nine quality indicators for the initial version of the national database for hospital-based emergency care.

Conclusions

The two-round modified Delphi process contributed to the selection of an initial set of nine quality indicators for a new a national database for hospital-based emergency care in Denmark. Final selection was made by the database steering group informed by the Delphi process.

Electronic supplementary material

The online version of this article (doi:10.1186/s13049-016-0203-x) contains supplementary material, which is available to authorized users.

Emergency department quality and safety indicators in resource-limited settings: an environmental survey

Background

As global emergency care grows, practical and effective performance measures are needed to ensure high quality care. Our objective was to systematically catalog and classify metrics that have been used to measure the quality of emergency care in resource-limited settings.

Methods

We searched MEDLINE, Embase, CINAHL, and the gray literature using standardized terms. The references of included articles were also reviewed. Two researchers screened titles and abstracts for relevance; full text was then reviewed by three researchers. A structured data extraction tool was used to identify and classify metrics into one of six Institute of Medicine (IOM) quality domains (safe, timely, efficient, effective, equitable, patient-centered) and one of three of Donabedian’s structure/process/outcome categories. A fourth expert reviewer blinded to the initial classifications re-classified all indicators, with a weighted kappa of 0.89.

Results

A total of 1705 articles were screened, 95 received full text review, and 34 met inclusion criteria. One hundred eighty unique metrics were identified, predominantly process (57 %) and structure measures (27 %); 16 % of metrics were related to outcomes. Most metrics evaluated the effectiveness (52 %) and timeliness (28 %) of care, with few addressing the patient centeredness (11 %), safety (4 %), resource-efficiency (3 %), or equitability (1 %) of care.

Conclusions

The published quality metrics in emergency care in resource-limited settings primarily focus on the effectiveness and timeliness of care. As global emergency care is built and strengthened, outcome-based measures and those focused on the safety, efficiency, and equitability of care need to be developed and studied to improve quality of care and resource utilization.

Electronic supplementary material

The online version of this article (doi:10.1186/s12245-015-0088-x) contains supplementary material, which is available to authorized users.