Using technology to reduce critical deterioration (the DETECT study): a cost analysis of care costs at a tertiary children's hospital in the United Kingdom

BACKGROUND

Electronic early warning systems have been used in adults for many years to prevent critical deterioration events (CDEs). However, implementation of similar technologies for monitoring children across the entire hospital poses additional challenges. While the concept of such technologies is promising, their cost-effectiveness is not established for use in children. In this study we investigate the potential for direct cost savings arising from the implementation of the DETECT surveillance system.

METHODS

Data were collected at a tertiary children's hospital in the United Kingdom. We rely on the comparison between patients in the baseline period (March 2018 to February 2019) and patients in the post-intervention period (March 2020 to July 2021). These provided a matched cohort of 19,562 hospital admissions for each group. From these admissions, 324 and 286 CDEs were observed in the baseline and post-intervention period, respectively. Hospital reported costs and Health Related Group (HRG) National Costs were used to estimate overall expenditure associated with CDEs for both groups of patients.

RESULTS

Comparing post-intervention with baseline data we found a reduction in the total number of critical care days, driven by an overall reduction in the number of CDEs, however without statistical significance. Using hospital reported costs adjusted for the Covid-19 impact, we estimate a non-significant reduction of total expenditure from £16.0 million to £14.3 million (corresponding to £1.7 million of savings - 11%). Additionally, using HRG average costs, we estimated a non-significant reduction of total expenditure from £8.2 million to £ 7.2 million (corresponding to £1.1 million of savings - 13%).

DISCUSSION AND CONCLUSION

Unplanned critical care admissions for children not only impose a substantial burden on patients and families but are also costly for hospitals. Interventions aimed at reducing emergency critical care admissions can be crucial to contribute to the reduction of these episodes' costs. Even though cost reductions were identified in our sample, our results do not support the hypothesis that reducing CDEs using technology leads to a significant reduction on hospital costs.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN61279068, date of registration 07/06/2019, retrospectively registered.

Clinical utility and acceptability of a whole-hospital, pro-active electronic paediatric early warning system (the DETECT study): A prospective e-survey of parents and health professionals

Background

Paediatric early warning systems (PEWS) are a means of tracking physiological state and alerting healthcare professionals about signs of deterioration, triggering a clinical review and/or escalation of care of children. A proactive end-to-end deterioration solution (the DETECT surveillance system) with an embedded e-PEWS that included sepsis screening was introduced across a tertiary children’s hospital. One component of the implementation programme was a sub-study to determine an understanding of the DETECT e-PEWS in terms of its clinical utility and its acceptability.

Aim

This study aimed to examine how parents and health professionals view and engage with the DETECT e-PEWS apps, with a particular focus on its clinical utility and its acceptability.

Method

A prospective, closed (tick box or sliding scale) and open (text based) question, e-survey of parents (n = 137) and health professionals (n = 151) with experience of DETECT e-PEWS. Data were collected between February 2020 and February 2021.

Results

Quantitative data were analysed using descriptive and inferential statistics and qualitative data with generic thematic analysis. Overall, both clinical utility and acceptability (across seven constructs) were high across both stakeholder groups although some challenges to utility (e.g., sensitivity of triggers within specific patient populations) and acceptability (e.g., burden related to having to carry extra technology) were identified.

Conclusion

Despite the multifaceted nature of the intervention and the complexity of implementation across a hospital, the system demonstrated clinical utility and acceptability across two key groups of stakeholders: parents and health professionals.

Health professionals' initial experiences and perceptions of the acceptability of a whole-hospital, pro-active electronic paediatric early warning system (the DETECT study): a qualitative interview study

Background

Paediatric early warning systems (PEWS) alert health professionals to signs of a child’s deterioration with the intention of triggering an urgent review and escalating care. They can reduce unplanned critical care transfer, cardiac arrest, and death. Electronic systems may be superior to paper-based systems. The objective of the study was to critically explore the initial experiences and perceptions of health professionals about the acceptability of DETECT e-PEWS, and what factors influence its acceptability.

Methods

A descriptive qualitative study (part of The DETECT study) was undertaken February 2020–2021. Single, semi-structured telephone interviews were used. The setting was a tertiary children’s hospital, UK. The participants were health professionals working in study setting and using DETECT e-PEWS. Sampling was undertaken using a mix of convenience and snowballing techniques. Participants represented two user-groups: ‘documenting vital signs’ (D-VS) and ‘responding to vital signs’ (R-VS). Perceptions of clinical utility and acceptability of DETECT e-PEWS were derived from thematic analysis of transcripts.

Results

Fourteen HPs (12 nurses, 2 doctors) participated; seven in D-VS and seven in the R-VS group. Three main themes were identified: complying with DETECT e-PEWS, circumventing DETECT e-PEWS, and disregarding DETECT e-PEWS. Overall clinical utility and acceptability were deemed good for HPs in the D-VS group but there was diversity in perception in the R-VS group (nurses found it more acceptable than doctors). Compliance was better in the D-VS group where use of DETECT e-PEWS was mandated and used more consistently. Some health professionals circumvented DETECT e-PEWS and fell back into old habits. Doctors (R-VS) did not consistently engage with DETECT e-PEWS, which reduced the acceptability of the system, even in those who thought the system brought benefits.

Conclusions

Speed and accuracy of real-time data, automation of triggering alerts and improved situational awareness were key factors that contributed to the acceptability of DETECT e-PEWS. Mandating use of both recording and responding aspects of DETECT e-PEWS is needed to ensure full implementation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12887-022-03411-1.

Parents' experiences and perceptions of the acceptability of a whole-hospital, pro-active electronic pediatric early warning system (the DETECT study): A qualitative interview study

BACKGROUND

Failure to recognize and respond to clinical deterioration in a timely and effective manner is an urgent safety concern, driving the need for early identification systems to be embedded in the care of children in hospital. Pediatric early warning systems (PEWS) or PEW scores alert health professionals (HPs) to signs of deterioration, trigger a review and escalate care as needed. PEW scoring allows HPs to record a child's vital signs and other key data including parent concern.

AIM

This study aimed to explore the experiences and perceptions of parents about the acceptability of a newly implemented electronic surveillance system (the DETECT surveillance system), and factors that influenced acceptability and their awareness around signs of clinical deterioration and raising concern.

METHODS

Descriptive, qualitative semi-structured telephone interviews were undertaken with parents of children who had experienced a critical deterioration event (CDE) (n = 19) and parents of those who had not experienced a CDE (non-CDE parents) (n = 17). Data were collected between February 2020 and February 2021.

RESULTS

Qualitative data were analyzed using generic thematic analysis. Analysis revealed an overarching theme of trust as a key factor that underpinned all aspects of children's vital signs being recorded and monitored. The main themes reflect three domains of parents' trust: trust in themselves, trust in the HPs, and trust in the technology.

CONCLUSION

Parents' experiences and perceptions of the acceptability of a whole-hospital, pro-active electronic pediatric early warning system (The DETECT system) were positive; they found it acceptable and welcomed the use of new technology to support the care of their child.