Implementation study of a 5-component pediatric early warning system (PEWS) in an emergency department in British Columbia, Canada, to inform provincial scale up

Implementation of Prediction Models in the Emergency Department from an Implementation Science Perspective-Determinants, Outcomes, and Real-World Impact: A Scoping Review

STUDY OBJECTIVE

Prediction models offer a promising form of clinical decision support in the complex and fast-paced environment of the emergency department (ED). Despite significant advancements in model development and validation, implementation of such models in routine clinical practice remains elusive. This scoping review aims to survey the current state of prediction model implementation in the ED and to provide insights on contributing factors and outcomes from an implementation science perspective.

METHODS

We searched 4 databases from their inception to May 20, 2022: MEDLINE (through PubMed), Embase, Scopus, and CINAHL. Articles that reported implementation outcomes and/or contextual determinants under the Reach, Effectiveness, Adoption, Implementation Maintenance (RE-AIM)/Practical, Robust, Implementation, and Sustainability Model (PRISM) framework were included. Characteristics of studies, models, and results of the RE-AIM/PRISM domains were summarized narratively.

RESULTS

Thirty-six reports on 31 implementations were included. The most common prediction models implemented were early warning scores. The most common implementation strategies used were training stakeholders, infrastructural changes, and using evaluative or iterative strategies. Only one report examined ED patients' perspectives, whereas the rest were focused on the experience of health care workers or organizational stakeholders. Key determinants of successful implementation include strong stakeholder engagement, codevelopment of workflows and implementation strategies, education, and usability.

CONCLUSION

Examining ED prediction models from an implementation science perspective can provide valuable insights and help guide future implementations.

Clinical utility and acceptability of a whole-hospital, pro-active electronic paediatric early warning system (the DETECT study): A prospective e-survey of parents and health professionals

Background

Paediatric early warning systems (PEWS) are a means of tracking physiological state and alerting healthcare professionals about signs of deterioration, triggering a clinical review and/or escalation of care of children. A proactive end-to-end deterioration solution (the DETECT surveillance system) with an embedded e-PEWS that included sepsis screening was introduced across a tertiary children’s hospital. One component of the implementation programme was a sub-study to determine an understanding of the DETECT e-PEWS in terms of its clinical utility and its acceptability.

Aim

This study aimed to examine how parents and health professionals view and engage with the DETECT e-PEWS apps, with a particular focus on its clinical utility and its acceptability.

Method

A prospective, closed (tick box or sliding scale) and open (text based) question, e-survey of parents (n = 137) and health professionals (n = 151) with experience of DETECT e-PEWS. Data were collected between February 2020 and February 2021.

Results

Quantitative data were analysed using descriptive and inferential statistics and qualitative data with generic thematic analysis. Overall, both clinical utility and acceptability (across seven constructs) were high across both stakeholder groups although some challenges to utility (e.g., sensitivity of triggers within specific patient populations) and acceptability (e.g., burden related to having to carry extra technology) were identified.

Conclusion

Despite the multifaceted nature of the intervention and the complexity of implementation across a hospital, the system demonstrated clinical utility and acceptability across two key groups of stakeholders: parents and health professionals.

Using the Delphi method to establish pediatric emergency triage criteria in a grade A tertiary women's and children's hospital in China

BACKGROUND

We aimed to establish simplified and quantifiable triage criteria in pediatric emergency care, improving the efficiency of pediatric emergency triage and ensuring patient safety.

METHODS

We preliminarily determined the pediatric emergency triage criteria with references to pediatric emergency department characteristics and internationally recognized triage tools after literature review and discussion. The final determination of the triage criteria was reached after two rounds of Delphi surveys completed by18 experts from 3 hospitals in China.

RESULTS

Both round 1 and round 2 surveys had a 100% response rate. The overall expert authority coefficient in the two rounds of surveys was 0.872. The experts had 100% enthusiasm for participating in the surveys. Kendall's coefficients of concordance for conditions/symptoms in patients triaged to level 1, 2, 3, and 4 were 0.149, 0.193, 0.102, and 0.266, respectively. All p-values were less than 0.05. The coefficients of variation in conditions/symptoms, vital signs, and the Pediatric Early Warning Score (PEWS) ranged between 0.00 and 0.205, meeting the inclusion criteria. The pediatric emergency triage criteria containing conditions/symptoms, vital signs, PEWS scores, and other 4 level 1 indicators, 51 level 2 indicators and 23 level 3 indicators were built. The maximum waiting time to treatment for the patients triaged to level 1, 2, 3, and 4 was immediate, within 10 min, within 30 min, and within 240 min, respectively.

CONCLUSION

The pediatric emergency triage criteria established in this study was scientific and reliable. It can be used to quickly identify the patients requiring urgent and immediate care, thereby ensuring the priorities for the care of critically ill patients.

Do paediatric early warning systems reduce mortality and critical deterioration events among children? A systematic review and meta-analysis

Aim

We conducted a systematic review and meta-analysis to answer the question: Does the implementation of Paediatric Early Warning Systems (PEWS) in the hospital setting reduce mortality, cardiopulmonary arrests, unplanned codes and critical deterioration events among children, as compared to usual care without PEWS?

Methods

We conducted a comprehensive search using Medline, EMBASE, Cochrane Central Register of Controlled Trials, Cumulative Index to Nursing and Allied Health Literature and Web of Science. We included studies published between January 2006 and April 2022 on children <18 years old performed in inpatient units and emergency departments, and compared patient populations with PEWS to those without PEWS. We excluded studies without a comparator, case control studies, systematic reviews, and studies published in non-English languages. We employed a random effects meta-analysis and synthesised the risk and rate ratios from individual studies. We used the Scottish Intercollegiate Guidelines Network (SIGN) to appraise the risk of bias.

Results

Among 911 articles screened, 15 were included for descriptive analysis. Fourteen of the 15 studies were pre- versus post-implementation studies and one was a multi-centre cluster randomised controlled trial (RCT). Among 10 studies (580,604 hospital admissions) analysed for mortality, we found an increased risk (pooled RR 1.18, 95% CI 1.01–1.38, p = 0.036) in the group without PEWS compared to the group with PEWS. The sensitivity analysis performed without the RCT (436,065 hospital admissions) showed a non-significant relationship (pooled RR 1.17, 95% CI 0.98–1.40, p = 0.087). Among four studies (168,544 hospital admissions) analysed for unplanned code events, there was an increased risk in the group without PEWS (pooled RR 1.73, 95%CI 1.01–2.96, p = 0.046) There were no differences in the rate of cardiopulmonary arrests or critical deterioration events between groups. Our findings were limited by potential confounders and imprecision among included studies.

Conclusions

Healthcare systems that implemented PEWS were associated with reduced mortality and code rates. We recognise that these gains vary depending on resource availability and efferent response systems.

PROSPERO registration: CRD42021269579.

Health professionals' initial experiences and perceptions of the acceptability of a whole-hospital, pro-active electronic paediatric early warning system (the DETECT study): a qualitative interview study

Background

Paediatric early warning systems (PEWS) alert health professionals to signs of a child’s deterioration with the intention of triggering an urgent review and escalating care. They can reduce unplanned critical care transfer, cardiac arrest, and death. Electronic systems may be superior to paper-based systems. The objective of the study was to critically explore the initial experiences and perceptions of health professionals about the acceptability of DETECT e-PEWS, and what factors influence its acceptability.

Methods

A descriptive qualitative study (part of The DETECT study) was undertaken February 2020–2021. Single, semi-structured telephone interviews were used. The setting was a tertiary children’s hospital, UK. The participants were health professionals working in study setting and using DETECT e-PEWS. Sampling was undertaken using a mix of convenience and snowballing techniques. Participants represented two user-groups: ‘documenting vital signs’ (D-VS) and ‘responding to vital signs’ (R-VS). Perceptions of clinical utility and acceptability of DETECT e-PEWS were derived from thematic analysis of transcripts.

Results

Fourteen HPs (12 nurses, 2 doctors) participated; seven in D-VS and seven in the R-VS group. Three main themes were identified: complying with DETECT e-PEWS, circumventing DETECT e-PEWS, and disregarding DETECT e-PEWS. Overall clinical utility and acceptability were deemed good for HPs in the D-VS group but there was diversity in perception in the R-VS group (nurses found it more acceptable than doctors). Compliance was better in the D-VS group where use of DETECT e-PEWS was mandated and used more consistently. Some health professionals circumvented DETECT e-PEWS and fell back into old habits. Doctors (R-VS) did not consistently engage with DETECT e-PEWS, which reduced the acceptability of the system, even in those who thought the system brought benefits.

Conclusions

Speed and accuracy of real-time data, automation of triggering alerts and improved situational awareness were key factors that contributed to the acceptability of DETECT e-PEWS. Mandating use of both recording and responding aspects of DETECT e-PEWS is needed to ensure full implementation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12887-022-03411-1.

Situation awareness and the mitigation of risk associated with patient deterioration: A meta-narrative review of theories and models and their relevance to nursing practice

BACKGROUND

Accurate situation awareness has been identified as a critical component of effective deteriorating patient response systems and an essential patient safety skill for nursing practice. However, situation awareness has been defined and theorised from multiple perspectives to explain how individuals, teams and systems maintain awareness in dynamic task environments.

AIM

Our aim was to critically analyse the different approaches taken to the study of situation awareness in healthcare and explore the implications for nursing practice and research as it relates to clinical deterioration in ward contexts.

METHODS

We undertook a meta-narrative review of the healthcare literature to capture how situation awareness has been defined, theorised and studied in healthcare. Following an initial scoping review, we conducted an extensive search of ten electronic databases and included any theoretical, empirical or critical papers with a primary focus on situation awareness in an inpatient hospital setting. Included papers were collaboratively categorised in accordance with their theoretical framing, research tradition and paradigm with a narrative review presented.

RESULTS

A total of 120 papers were included in this review. Three overarching narratives reflecting philosophical, patient safety and solution focussed framings of situation awareness and seven meta-narratives were identified as follows: individual, team and systems perspectives of situation awareness (meta-narratives 1-3), situation awareness and patient safety (meta-narrative 4), communication tools, technologies and education to support situation awareness (meta-narratives 5-7). We identified a concentration of literature from anaesthesia and operating rooms and a body of research largely located within a cognitive engineering tradition and a positivist research paradigm. Endsley's situation awareness model was applied in over 80% of the papers reviewed. A minority of papers drew on alternative situation awareness theories including constructivist, collaborative and distributed perspectives.

CONCLUSIONS

Nurses have a critical role in identifying and escalating the care of deteriorating patients. There is a need to build on prior studies and reflect on the reality of nurse's work and the constraints imposed on situation awareness by the demands of busy inpatient wards. We suggest that this will require an analysis that complements but goes beyond the dominant cognitive engineering tradition to reflect the complex socio-cultural reality of ward-based teams and to explore how situation awareness emerges in increasingly complex, technologically enabled distributed healthcare systems.

Development of the Tiers of Service framework to support system and operational planning for children's healthcare services

Background

Providing access to pediatric healthcare services in British Columbia, Canada, presents unique challenges given low population densities spread across large geographic distances combined with a lack of availability of specialist providers in remote areas, leading to quality of care shortcomings and inequalities in care delivery. The study objective was to develop a framework that provides a common language and methodology for defining and planning child and youth healthcare services across the province.

Methods

The framework was developed in two phases. In Phase 1, a literature and jurisdictional review was completed using the following inclusion criteria: (i) description of a framework focusing on organizing service delivery systems (ii) that supports health service planning, (iii) includes specialty or subspecialty services and (iv) has been published since 2008. In Phase 2, a series of meetings with key provincial stakeholders were held to receive feedback on the developed Tiers of Service framework versions that were based on the literature and jurisdictional review and adjusted to the British Columbian health care context. The final version was endorsed by the Child Health BC Steering Committee.

Results

Ten medical articles and thirteen jurisdictional papers met the established selection criteria and were included in this study. Most frameworks were developed by the Australian national or state jurisdictions and published in jurisdictional papers (n = 8). Frameworks identified in the medical literature were mainly developed in Canada (n = 3) and the US (n = 3) and focused on maternity, neonatal, critical care and oncology services. Based on feedback received from the expert group, the framework was expanded to include community-based services, prevention and health determinants. The final version of the Tiers of Service framework describes the specific services to be delivered at each tier, which are categorized as Tier 1 (community services) through Tier 6 (sub-specialized services). Two consecutive steps were identified to effectively use the framework for operational and system planning: (i) development of a ‘module’ outlining the responsibilities and requirements to be delivered at each tier; and (ii) assessment of services provided at the health care facility against those described in the module, alignment to a specific tier, identification of gaps at the local, regional and provincial level, and implementation of quality improvement initiatives to effectively address the gaps.

Conclusions

The benefits of the Tiers of Service framework and accompanying modules for health service planning are being increasingly recognized. Planning and coordinating pediatric health services across the province will help to optimize flow and improve access to high-quality services for children living in British Columbia.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06616-9.

Vaccine-associated enhanced disease: Case definition and guidelines for data collection, analysis, and presentation of immunization safety data

This is a Brighton Collaboration Case Definition of the term “Vaccine Associated Enhanced Disease” to be utilized in the evaluation of adverse events following immunization. The Case Definition was developed by a group of experts convened by the Coalition for Epidemic Preparedness Innovations (CEPI) in the context of active development of vaccines for SARS-CoV-2 vaccines and other emerging pathogens. The case definition format of the Brighton Collaboration was followed to develop a consensus definition and defined levels of certainty, after an exhaustive review of the literature and expert consultation. The document underwent peer review by the Brighton Collaboration Network and by selected Expert Reviewers prior to submission.