Evaluating processes of care and outcomes of children in hospital (EPOCH): study protocol for a randomized controlled trial

Escalation of care in children at high risk of clinical deterioration in a tertiary care children's hospital using the Bedside Pediatric Early Warning System

BACKGROUND

Escalation and de-escalation are a routine part of high-quality care that should be matched with clinical needs. The aim of this study was to describe escalation of care in relation to the occurrence and timing of Pediatric Intensive Care Unit (PICU) admission in a cohort of pediatric inpatients with acute worsening of their clinical condition.

METHODS

A monocentric, observational cohort study was performed from January to December 2018. Eligible patients were children: 1) admitted to one of the inpatient wards other than ICU; 2) under the age of 18 years at the time of admission; 3) with two or more Bedside-Paediatric-Early-Warning-System (BedsidePEWS) scores ≥ 7 recorded at a distance of at least one hour and for a period of 4 h during admission. The main outcome -the 24-h disposition - was defined as admission to PICU within 24-h of enrolment or staying in the inpatient ward. Escalation of care was measured using an eight-point scale-the Escalation Index (EI), developed by the authors. The EI was calculated every 6 h, starting from the moment the patient was considered eligible. Analyses used multivariate quantile and logistic regression models.

RESULTS

The 228 episodes included 574 EI calculated scores. The 24-h disposition was the ward in 129 (57%) and the PICU in 99 (43%) episodes. Patients who were admitted to PICU within 24-h had higher top EI scores [median (IQR) 6 (5-7) vs 4 (3-5), p < 0.001]; higher initial BedsidePEWS scores [median (IQR) 10(8-13) vs. 9 (8-11), p = 0.02], were less likely to have a chronic disease [n = 62 (63%) vs. n = 127 (98%), p < 0.0001], and were rated by physicians as being at a higher risk of having a cardiac arrest (p = 0.01) than patients remaining on the ward. The EI increased over 24 h before urgent admission to PICU or cardiac arrest by 0.53 every 6-h interval (CI 0.37-0.70, p < 0.001), while it decreased by 0.25 every 6-h interval (CI -0.36-0.15, p < 0.001) in patients who stayed on the wards.

CONCLUSION

Escalation of care was related to temporal changes in severity of illness, patient background and environmental factors. The EI index can improve responses to evolving critical illness.

Risk factors for unplanned paediatric intensive care unit admission after anaesthesia—an international multicentre study

Objectives

Unplanned intensive care unit (ICU) admissions are associated with near-miss events, morbidity, and mortality. We describe the rate, resource utilization, and outcomes of paediatric patients urgently admitted directly to ICU post-anaesthesia compared to other sources of unplanned ICU admissions.

Methods

We performed a secondary analysis of data from specialist paediatric hospitals in 7 countries. Patients urgently admitted to the ICU post-anaesthesia were combined and matched with 1 to 3 unique controls from unplanned ICU admissions from other locations by age and hospital. Demographic, clinical, and outcome variables were compared using the Wilcoxon rank-sum test for continuous variables and chi-square or Fisher’s exact test for categorical variables. The effect of admission sources on binary outcomes was estimated using univariable conditional logistic regression models with stratification by matched set of anaesthesia and non-anaesthesia admission sources.

Results

Most admissions were &lt;1 year of age and for respiratory reasons. Admissions post-anaesthesia were shorter, occurred later in the day, and were more likely to be mechanically ventilated. Admissions post-anaesthesia were less likely to have had a previous ICU admission (4.8% compared to 11%, P=0.032) or PIM ‘high-risk diagnosis’ (9.5% versus 17.2%, P=0.035) but there was no difference in the number of subsequent ICU admissions. There was no difference in the PIM severity of illness score and no mortality difference between the groups.

Conclusions

Young children and respiratory indications dominated unplanned ICU admissions post-anaesthesia, which was more likely later in the day and with mechanical ventilation.

Death and Dying in Hospitalized Pediatric Patients: A Prospective Multicenter, Multinational Study

Background: For hospitalized children admitted outside of a critical care unit, the location, mode of death, "do-not-resuscitate" order (DNR) use, and involvement of palliative care teams have not been described across high-income countries. Objective: To describe location of death, patient and terminal care plan characteristics of pediatric inpatient deaths inside and outside the pediatric intensive care unit (PICU). Design: Secondary analysis of inpatient deaths in the Evaluating Processes of Care and Outcomes of Children in Hospital (EPOCH) randomized controlled trial. Setting/Subjects: Twenty-one centers from Canada, Belgium, the United Kingdom, Ireland, Italy, the Netherlands, and New Zealand. Measurement: Descriptive statistics were used to compare patient and terminal care plan characteristics. A multivariable generalized estimating equation examined if palliative care consult during hospital admission was associated with location of death. Results: A total of 365 of 144,539 patients enrolled in EPOCH died; 219 (60%) died in PICU and 143 (40%) died on another inpatient unit. Compared with other inpatient wards, patients who died in PICU were less likely to be expected to die, have a DNR or palliative care consult. Hospital palliative care consultation was more common in older children and independently associated with a lower adjusted odds (95% confidence interval) of dying in PICU [0.59 (0.52-0.68)]. Conclusion: Most pediatric inpatient deaths occur in PICU where patients were less likely to have a DNR or palliative care consult. Palliative care consultation could be better integrated into end-of-life care for younger children and those dying in PICU.

Vaccine-associated enhanced disease: Case definition and guidelines for data collection, analysis, and presentation of immunization safety data

This is a Brighton Collaboration Case Definition of the term "Vaccine Associated Enhanced Disease" to be utilized in the evaluation of adverse events following immunization. The Case Definition was developed by a group of experts convened by the Coalition for Epidemic Preparedness Innovations (CEPI) in the context of active development of vaccines for SARS-CoV-2 vaccines and other emerging pathogens. The case definition format of the Brighton Collaboration was followed to develop a consensus definition and defined levels of certainty, after an exhaustive review of the literature and expert consultation. The document underwent peer review by the Brighton Collaboration Network and by selected Expert Reviewers prior to submission.

High-impact RCTs without prospective informed consent: a systematic review

The prevalence of randomized controlled trials (RCTs) performed without fully informed prospective consent from subjects is unknown. We performed this study to estimate the prevalence of high-impact RCTs performed without informed consent from all subjects and examine whether such trials are becoming more prevalent. We performed a systematic review of English-language RCTs published from 2014 through 2018 identified in Scopus and sorted to identify the top 100 most highly cited RCTs each year. Text search of title and abstract included terms randomized controlled or clinical trial and spelling variants thereof, and excluded metaanalyses and systematic reviews. We independently identified the most highly cited RCTs based on predefined criteria and negotiated to agreement, then independently performed keyword searches, read, abstracted and coded information regarding informed consent from each paper and again negotiated to agreement. No quality indicators were assessed. We planned descriptive qualitative analysis and appropriate quantitative analysis to examine the prevalence and characteristics of trials enrolling subjects with other than fully informed prospective consent. We find that 44 (8.8%, binomial exact 95% CI 6.5% to 11.6%) of 500 high-impact RCTs did not secure informed consent from at least some subjects. The prevalence of such trials did not change over the 5 years (OR=1.09, z=0.78, p=0.44). A majority (66%) of the trials involved emergency situations, and 40 of 44 (90.9%) of the trials involved emergency interventions, pragmatic designs, were cluster randomized, or a combination of these factors. A qualitative analysis explores the methods of and justifications for waiving informed consent in our sample of RCTs.

Provisional Validation of a Pediatric Early Warning Score for Resource-Limited Settings

BACKGROUND AND OBJECTIVES

The use of Pediatric Early Warning Scores is becoming widespread to identify and rapidly respond to patients with deteriorating conditions. The ability of Pediatric Early Warning Scores to identify children at high risk of deterioration or death has not, however, been established in resource-limited settings.

METHODS

We developed the Pediatric Early Warning Score for Resource-Limited Settings (PEWS-RL) on the basis of expert opinion and existing scores. The PEWS-RL was derived from 6 equally weighted variables, producing a cumulative score of 0 to 6. We then conducted a case-control study of admissions to the pediatrics department of the main public referral hospital in Kigali, Rwanda between November 2016 and March 2017. We defined case patients as children fulfilling the criteria for clinical deterioration, who were then matched with controls of the same age and hospital ward.

RESULTS

During the study period, 627 children were admitted, from whom we selected 79 case patients and 79 controls. For a PEWS-RL of ≥3, sensitivity was 96.2%, and specificity was 87.3% for identifying patients at risk for clinical deterioration. A total PEWS-RL of ≥3 was associated with a substantially increased risk of clinical deterioration (odds ratio 129.3; 95% confidence interval 38.8-431.6; P <.005).

CONCLUSIONS

This study reveals that the PEWS-RL, a simple score based on vital signs, mental status, and presence of respiratory distress, was feasible to implement in a resource-limited setting and was able to identify children at risk for clinical deterioration.

The Association Between Fever and Subsequent Deterioration Among Hospitalized Children With Elevated PEWS

OBJECTIVES

To evaluate the association between fever and subsequent deterioration among patients with Pediatric Early Warning Score (PEWS) elevations to ≥4 to inform improvements to care escalation processes at our institution.

METHODS

We performed a cohort study of hospitalized children at a single quaternary children's hospital with PEWS elevations to ≥4 between January 1, 2014 and March 31, 2014. Bivariable analysis was used to compare characteristics between patients with and without unplanned ICU transfers and critical deterioration events (CDEs) (ie, unplanned ICU transfers with life-sustaining interventions initiated in the first 12 ICU hours). A multivariable Poisson regression was used to assess the relative risk of unplanned ICU transfers and CDEs.

RESULTS

The study population included 220 PEWS elevations from 176 unique patients. Of those, 33% had fever (n = 73), 40% experienced an unplanned ICU transfer (n = 88), and 19% experienced CDEs (n = 42). Bivariable analysis revealed that febrile patients were less likely to experience an unplanned ICU transfer than those without fever. The same association was found in multivariable analysis with only marginal significance (adjusted relative risk 0.68; 95% confidence interval 0.45-1.01; P = .058). There was no difference in the CDE risk for febrile versus afebrile patients (adjusted relative risk 0.79; 95% confidence interval 0.43-1.44; P = .44).

CONCLUSIONS

At our institution, patients with an elevated PEWS appeared less likely to experience an unplanned ICU transfer if they were febrile. We were underpowered to evaluate the effect on CDEs. These findings contributed to our recognition that (1) PEWS may not include all relevant clinical factors used for clinical decision-making regarding care escalation and (2) further study is needed in this area.

Quality Improvement and Safety in Pediatric Emergency Medicine

Pediatric emergency medicine quality work continues to focus on the National Academies of Sciences, Engineering, and Medicine's 6 domains of quality, with a need for specific emphasis on equity and patient centeredness. Adopting the principles of high-reliability organizations, pediatric emergency departments should become increasing transparent with benchmarking and collaboration across institutions in order to develop an infrastructure for quality and safety to improve the care of pediatric patients in the emergency department.

From skepticism to assurance and control; Implementation of a patient safety system at a pediatric hospital in Sweden

BACKGROUND

The use of evidence-based practice among healthcare professionals directly correlates to better outcomes for patients and higher professional satisfaction. Translating knowledge in practice and mobilizing evidence-based clinical care remains a continuing challenge in healthcare systems across the world.

PURPOSE

To describe experiences from the implementation of an Early Detection and Treatment Program for Children (EDT-C) among health care professionals at a pediatric hospital in Sweden.

DESIGN AND METHODS

Sixteen individual interviews were conducted with physicians, nurses and nurse assistants, which of five were instructors. Data were analyzed with qualitative content analysis.

RESULTS

An overarching theme was created: From uncertainty and skepticism towards assurance and control. The theme was based on the content of eight categories: An innovation suitable for clinical practice, Differing conditions for change, Lack of organizational slack, Complex situations, A pragmatic implementation strategy, Delegated responsibility, Experiences of control and Successful implementation.

CONCLUSIONS

Successful implementation was achieved when initial skepticism among staff was changed into acceptance and using EDT-C had become routine in their daily work. Inter-professional education including material from authentic patient cases promotes knowledge about different professions and can strengthen teamwork. EDT-C with evidenced-based material adapted to the context can give healthcare professionals a structured and objective tool with which to assess and treat patients, giving them a sense of control and assurance.

Newly qualified Saudi nurses' ability to recognize the deteriorating child in hospital

BACKGROUND

It is recognized that nurses' failure to recognize and respond promptly to deterioration in children's physiological status can result in increased morbidity and mortality.

AIM

The aim of this study was to explore the ability of Saudi-educated, newly qualified nurses, working in paediatric wards, to recognize children's deterioration.

METHODS

A pilot study was carried out to assess nurses' responses to three clinical vignettes (deteriorating child, improving child and ambiguous scenarios). The nurses' ability to make a correct identification was captured using a 'Think Aloud' approach and quantified using a visual analogue scale.

RESULTS

Twenty-seven nurses in two geographical regions in Saudi Arabia participated. Only half the nurses (51·8%) correctly identified the deteriorating child vignette. Of those who could not, 37% were unsure and 11% responded incorrectly. No nurses correctly identified all three vignettes, and four nurses (15%) responded incorrectly to all vignettes.

CONCLUSIONS

The recognition of the deteriorating child is complex, and even in non-stressful simulated scenarios using vignettes, many newly qualified nurses working with children failed to recognize clear signs of deterioration. A focused (culturally specific) educational intervention is being developed to target this, taking into account Saudi nurses' perceived education and training needs.

RELEVANCE TO CLINICAL PRACTICE

Newly qualified nurses working in paediatric wards frequently find it difficult to identify the deteriorating child.

Effect of a Pediatric Early Warning System on All-Cause Mortality in Hospitalized Pediatric Patients: The EPOCH Randomized Clinical Trial

IMPORTANCE

There is limited evidence that the use of severity of illness scores in pediatric patients can facilitate timely admission to the intensive care unit or improve patient outcomes.

OBJECTIVE

To determine the effect of the Bedside Paediatric Early Warning System (BedsidePEWS) on all-cause hospital mortality and late admission to the intensive care unit (ICU), cardiac arrest, and ICU resource use.

DESIGN, SETTING, AND PARTICIPANTS

A multicenter cluster randomized trial of 21 hospitals located in 7 countries (Belgium, Canada, England, Ireland, Italy, New Zealand, and the Netherlands) that provided inpatient pediatric care for infants (gestational age ≥37 weeks) to teenagers (aged ≤18 years). Participating hospitals had continuous physician staffing and subspecialized pediatric services. Patient enrollment began on February 28, 2011, and ended on June 21, 2015. Follow-up ended on July 19, 2015.

INTERVENTIONS

The BedsidePEWS intervention (10 hospitals) was compared with usual care (no severity of illness score; 11 hospitals).

MAIN OUTCOMES AND MEASURES

The primary outcome was all-cause hospital mortality. The secondary outcome was a significant clinical deterioration event, which was defined as a composite outcome reflecting late ICU admission. Regression analyses accounted for hospital-level clustering and baseline rates.

RESULTS

Among 144 539 patient discharges at 21 randomized hospitals, there were 559 443 patient-days and 144 539 patients (100%) completed the trial. All-cause hospital mortality was 1.93 per 1000 patient discharges at hospitals with BedsidePEWS and 1.56 per 1000 patient discharges at hospitals with usual care (adjusted between-group rate difference, 0.01 [95% CI, -0.80 to 0.81 per 1000 patient discharges]; adjusted odds ratio, 1.01 [95% CI, 0.61 to 1.69]; P = .96). Significant clinical deterioration events occurred during 0.50 per 1000 patient-days at hospitals with BedsidePEWS vs 0.84 per 1000 patient-days at hospitals with usual care (adjusted between-group rate difference, -0.34 [95% CI, -0.73 to 0.05 per 1000 patient-days]; adjusted rate ratio, 0.77 [95% CI, 0.61 to 0.97]; P = .03).

CONCLUSIONS AND RELEVANCE

Implementation of the Bedside Paediatric Early Warning System compared with usual care did not significantly decrease all-cause mortality among hospitalized pediatric patients. These findings do not support the use of this system to reduce mortality.

TRIAL REGISTRATION

clinicaltrials.gov Identifier: NCT01260831.

Qualitative study exploring factors influencing escalation of care of deteriorating children in a children's hospital

BACKGROUND

System-level interventions including rapid response teams and paediatric early warning scores have been designed to support escalation of care and prevent severe adverse events in hospital wards. Barriers and facilitators to escalation of care have been rarely explored in paediatric settings.

AIM

This study explores the experiences of parents and healthcare professionals of in-hospital paediatric clinical deterioration events to identify factors associated with escalation of care.

METHODS

Across 2 hospital sites, 6 focus groups with 32 participants were conducted with parents (n=9) and healthcare professionals (n=23) who had cared for or witnessed a clinical deterioration event of a child. Transcripts of audio recording were analysed for emergent themes using a constant comparative approach.

FINDINGS

Four themes and 19 subthemes were identified: (1) impact of staff competencies and skills, including personal judgement of clinical efficacy (self-efficacy), differences in staff training and their impact on perceived nursing credibility; (2) impact of relationships in care focusing on communication and teamwork; (3) processes identifying and responding to clinical deterioration, such as patient assessment practices, tools to support the identification of patients at risk and the role of the rapid response team; and (4) influences of organisational factors on escalation of care, such as staffing, patient pathways and continuity of care.

CONCLUSIONS

Findings emphasise the considerable influence of social processes such as teamwork, communication, models of staff organisation and staff education. Further studies are needed to better understand how modification of these factors can be used to improve patient safety.

Effect of a children's at-home nursing team on reducing emergency admissions

This article explores the effect of a children's at-home nursing team, Hospital at Home (H@H), which aimed to reduce demand on acute hospital beds, support families to improve patient experience, and empower parents to care safely for their unwell children and help prevent emergency department (ED) reattendance. Data on demographics and clinical presentation of H@H and ED attendances were collected and compared. A survey measuring parents' confidence in managing their unwell children was also conducted. Of 72 patients treated by the H@H service between May and July 2016, 32 (44%) would have been admitted to hospital from the ED if the H@H service had not existed. This is equivalent to a saving of 64 bed days. Patients treated by the H@H service had similar demographics to those discharged from the ED to usual care. The H@H service took on patients with higher Bedside Paediatric Early Warning System scores before discharge. Parents reported that they would be more confident caring for their children after discharge from the H@H service. The H@H service decreased the number of unnecessary ED admissions. The service promotes a positive patient experience and increases parents' confidence when caring for unwell children at home.

'The Score Matters': wide variations in predictive performance of 18 paediatric track and trigger systems

OBJECTIVE

To compare the predictive performance of 18 paediatric early warning systems (PEWS) in predicting critical deterioration.

DESIGN

Retrospective case-controlled study. PEWS values were calculated from existing clinical data, and the area under the receiver operator characteristic curve (AUROC) compared.

SETTING

UK tertiary referral children's hospital.

PATIENTS

Patients without a 'do not attempt resuscitation' order admitted between 1 January 2011 and 31 December 2012. All patients on paediatric wards who suffered a critical deterioration event were designated 'cases' and matched with a control closest in age who was present on the same ward at the same time.

MAIN OUTCOME MEASURES

Respiratory and/or cardiac arrest, unplanned transfer to paediatric intensive care and/or unexpected death.

RESULTS

12 'scoring' and 6 'trigger' systems were suitable for comparative analysis. 297 case events in 224 patients were available for analysis. 244 control patients were identified for the 311 events. Three PEWS demonstrated better overall predictive performance with an AUROC of 0.87 or greater. Comparing each system with the highest performing PEWS with Bonferroni's correction for multiple comparisons resulted in statistically significant differences for 13 systems. Trigger systems performed worse than scoring systems, occupying the six lowest places in the AUROC rankings.

CONCLUSIONS

There is considerable variation in the performance of published PEWS, and as such the choice of PEWS has the potential to be clinically important. Trigger-based systems performed poorly overall, but it remains unclear what factors determine optimum performance. More complex systems did not necessarily demonstrate improved performance.

Paediatric early warning systems for detecting and responding to clinical deterioration in children: a systematic review

OBJECTIVE

To systematically review the available evidence on paediatric early warning systems (PEWS) for use in acute paediatric healthcare settings for the detection of, and timely response to, clinical deterioration in children.

METHOD

The electronic databases PubMed, MEDLINE, CINAHL, EMBASE and Cochrane were searched systematically from inception up to August 2016. Eligible studies had to refer to PEWS, inclusive of rapid response systems and teams. Outcomes had to be specific to the identification of and/or response to clinical deterioration in children (including neonates) in paediatric hospital settings (including emergency departments). 2 review authors independently completed the screening and selection process, the quality appraisal of the retrieved evidence and data extraction; with a third reviewer resolving any discrepancies, as required. Results were narratively synthesised.

RESULTS

From a total screening of 2742 papers, 90 papers, of varied designs, were identified as eligible for inclusion in the review. Findings revealed that PEWS are extensively used internationally in paediatric inpatient hospital settings. However, robust empirical evidence on which PEWS is most effective was limited. The studies examined did however highlight some evidence of positive directional trends in improving clinical and process-based outcomes for clinically deteriorating children. Favourable outcomes were also identified for enhanced multidisciplinary team work, communication and confidence in recognising, reporting and making decisions about child clinical deterioration.

CONCLUSIONS

Despite many studies reporting on the complexity and multifaceted nature of PEWS, no evidence was sourced which examined PEWS as a complex healthcare intervention. Future research needs to investigate PEWS as a complex multifaceted sociotechnical system that is embedded in a wider safety culture influenced by many organisational and human factors. PEWS should be embraced as a part of a larger multifaceted safety framework that will develop and grow over time with strong governance and leadership, targeted training, ongoing support and continuous improvement.

Parents' and young people's involvement in designing a trial of ventilator weaning

Consulting with users is considered best practice and is highly recommended in designing new trials. As part of our feasibility work, we undertook a consultation exercise with parents, ex-patients and young people prior to designing a trial of protocol-based ventilator weaning. Our aims were to (1) ascertain views on the relevance and importance of the trial; (2) determine the important parent/patient outcome measures; and (3) ascertain views on informed consent in a cluster randomized controlled trial. We conducted audio-recorded face-to-face, telephone and focus group interviews with parents and young people. Data were content analysed to generate information to address our specific consultation objectives. The setting was the north-western region of England. A total of 16 participants were interviewed: 2 parents of paediatric intensive care unit (PICU) survivors; 1 PICU survivor; and 13 young people from the former Medicines for Children Research Network. The trial objectives were deemed important and relevant, and participants considered the most important outcome measure to be the length of time on ventilation. Parents and young people did not consider written informed consent to be a necessary requirement in the context of this trial, rather awareness of unit participation in the trial was important with the opportunity of opting out of data collection. This consultation provided useful, pragmatic insights to inform trial design. We encountered significant challenges in recruiting parents and young people for this consultation exercise, and novel recruitment methods need to be considered for future work in this field. Patient and public involvement is essential to ensure that future trials answer parent-relevant questions and have meaningful outcome measures, as well as involving parents and young people in the general development of health care services.