Metric Development for the Multicenter Improving Pediatric Sepsis Outcomes (IPSO) Collaborative

Impact of a Coordinated Sepsis Response on Time to Treatment in a Pediatric Emergency Department

BACKGROUND

Sepsis is responsible for 75 000 pediatric hospitalizations annually, with an associated mortality rate estimated between 11% and 19%. Evidence supports the use of timely fluid resuscitation and antibiotics to decrease morbidity and mortality. Our emergency department did not meet the timeliness goals for fluid and antibiotic administration suggested by the 2012 Surviving Sepsis Campaign.

METHODS

In November 2018, we implemented a sepsis response team utilizing a scripted communication tool and a dedicated sepsis supply cart to address timeliness barriers. Performance was evaluated using statistical process control charts. We conducted observations to evaluate adherence to the new process. Our aim was to meet the Surviving Sepsis Campaign's timeliness goals for first fluid and antibiotic administration (20 and 60 minutes, respectively) within 8 months of our intervention.

RESULTS

We observed sustained decreases in mean time to fluids. We also observed a shift in the proportion of patients receiving fluids within 20 minutes. No shifts were observed for timely antibiotic administration.

CONCLUSIONS

The implementation of a dedicated emergency department sepsis response team with designated roles and responsibilities, directed communication, and easily accessible supplies can lead to improvements in the timeliness of fluid administration in the pediatric population.

Sociodemographic Factors are Associated with Care Delivery and Outcomes in Pediatric Severe Sepsis

IMPORTANCE

Sepsis is a leading cause of morbidity and mortality in the United States and disparate outcomes exist between racial/ethnic groups despite improvements in sepsis management. These observed differences are often related to social determinants of health (SDoH). Little is known about the role of SDoH on outcomes in pediatric sepsis.

OBJECTIVE

This study examined the differences in care delivery and outcomes in children with severe sepsis based on race/ethnicity and neighborhood context (as measured by the social vulnerability index).

DESIGN SETTING AND PARTICIPANTS

This retrospective, cross-sectional study was completed in a quaternary care children's hospital. Patients 18 years old or younger who were admitted between May 1, 2018, and February 28, 2022, met the improving pediatric sepsis outcomes (IPSO) collaborative definition for severe sepsis. Composite measures of social vulnerability, care delivery, and clinical outcomes were stratified by race/ethnicity.

MAIN OUTCOMES AND MEASURES

The primary outcome of interest was admission to the PICU. Secondary outcomes were sepsis recognition and early goal-directed therapy (EGDT).

RESULTS

A total of 967 children met the criteria for IPSO-defined severe sepsis, of whom 53.4% were White/non-Hispanic. Nearly half of the cohort (48.7%) required PICU admission. There was no difference in illness severity at PICU admission by race (1.01 vs. 1.1, p = 0.18). Non-White race/Hispanic ethnicity was independently associated with PICU admission (odds ratio [OR] 1.35 [1.01-1.8], p = 0.04). Although social vulnerability was not independently associated with PICU admission (OR 0.95 [0.59-1.53], p = 0.83), non-White children were significantly more likely to reside in vulnerable neighborhoods (0.66 vs. 0.38, p < 0.001). Non-White race was associated with lower sepsis recognition (87.8% vs. 93.6%, p = 0.002) and less EGDT compliance (35.7% vs. 42.8%, p = 0.024).

CONCLUSIONS AND RELEVANCE

Non-White race/ethnicity was independently associated with PICU admission. Differences in care delivery were also identified. Prospective studies are needed to further investigate these findings.

Association between positive blood culture and clinical outcomes among children treated for sepsis in the emergency department

OBJECTIVE

Among children treated for sepsis in a pediatric emergency department (ED), compare clinical features and outcomes between those with blood cultures positive versus negative for a bacterial pathogen.

DESIGN

Single-center retrospective cohort study.

SETTING

Pediatric emergency department (ED) at a quaternary pediatric care center.

PATIENTS

Children aged 0-18 years treated for sepsis defined by the Children's Hospital Association's Improving Pediatric Sepsis Outcomes (IPSO) definition.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

We analyzed 1307 patients treated for sepsis during the study period, of which 117 (9.0%) had blood cultures positive for a bacterial pathogen. Of children with blood culture positive sepsis, 62 (53.0%) had organ dysfunction compared to 514 (43.2%) with culture negative sepsis (adjusted odds ratio 1.56, 95% confidence interval (CI) 1.04-2.34, adjusting for age, high risk medical conditions, and time to antibiotics). Children with blood culture positive sepsis had a larger base deficit, -4 vs -1 (p < 0.01), and higher procalcitonin, 3.84 vs 0.56 ng/mL (p < 0.01).

CONCLUSIONS

Children meeting the IPSO Sepsis definition with blood culture positive for a bacterial pathogen have higher rates of organ dysfunction than those who are culture negative, although our 9% rate of blood culture positivity is lower than previously cited literature from the pediatric intensive care unit.

Sepsis Prediction in Hospitalized Children: Clinical Decision Support Design and Deployment

BACKGROUND

Following development and validation of a sepsis prediction model described in a companion article, we aimed to use quality improvement and safety methodology to guide the design and deployment of clinical decision support (CDS) tools and clinician workflows to improve pediatric sepsis recognition in the inpatient setting.

METHODS

CDS tools and sepsis huddle workflows were created to implement an electronic health record-based sepsis prediction model. These were proactively analyzed and refined using simulation and safety science principles before implementation and were introduced across inpatient units during 2020-2021. Huddle compliance, alerts per non-ICU patient days, and days between sepsis-attributable emergent transfers were monitored. Rapid Plan-Do-Study-Act (PDSA) cycles based on user feedback and weekly metric data informed improvement throughout implementation.

RESULTS

There were 264 sepsis alerts on 173 patients with an 89% bedside huddle completion rate and 10 alerts per 1000 non-ICU patient days per month. There was no special cause variation in the metric days between sepsis-attributable emergent transfers.

CONCLUSIONS

An automated electronic health record-based sepsis prediction model, CDS tools, and sepsis huddle workflows were implemented on inpatient units with a relatively low rate of interruptive alerts and high compliance with bedside huddles. Use of CDS best practices, simulation, safety tools, and quality improvement principles led to high utilization of the sepsis screening process.

Sepsis Prediction in Hospitalized Children: Model Development and Validation

BACKGROUND AND OBJECTIVES

Early recognition and treatment of pediatric sepsis remain mainstay approaches to improve outcomes. Although most children with sepsis are diagnosed in the emergency department, some are admitted with unrecognized sepsis or develop sepsis while hospitalized. Our objective was to develop and validate a prediction model of pediatric sepsis to improve recognition in the inpatient setting.

METHODS

Patients with sepsis were identified using intention-to-treat criteria. Encounters from 2012 to 2018 were used as a derivation to train a prediction model using variables from an existing model. A 2-tier threshold was determined using a precision-recall curve: an "Alert" tier with high positive predictive value to prompt bedside evaluation and an "Aware" tier with high sensitivity to increase situational awareness. The model was prospectively validated in the electronic health record in silent mode during 2019.

RESULTS

A total of 55 980 encounters and 793 (1.4%) episodes of sepsis were used for derivation and prospective validation. The final model consisted of 13 variables with an area under the curve of 0.96 (95% confidence interval 0.95-0.97) in the validation set. The Aware tier had 100% sensitivity and the Alert tier had a positive predictive value of 14% (number needed to alert of 7) in the validation set.

CONCLUSIONS

We derived and prospectively validated a 2-tiered prediction model of inpatient pediatric sepsis designed to have a high sensitivity Aware threshold to enable situational awareness and a low number needed to Alert threshold to minimize false alerts. Our model was embedded in our electronic health record and implemented as clinical decision support, which is presented in a companion article.

Bundled Care to Reduce Sepsis Mortality: The Improving Pediatric Sepsis Outcomes (IPSO) Collaborative

OBJECTIVES

We sought to improve utilization of a sepsis care bundle and decrease 3- and 30- day sepsis-attributable mortality, as well as determine which care elements of a sepsis bundle are associated with improved outcomes.

METHODS

Children's Hospital Association formed a QI collaborative to Improve Pediatric Sepsis Outcomes (IPSO) (January 2017-March 2020 analyzed here). IPSO Suspected Sepsis (ISS) patients were those without organ dysfunction where the provider "intended to treat" sepsis. IPSO Critical Sepsis (ICS) patients approximated those with septic shock. Process (bundle adherence), outcome (mortality), and balancing measures were quantified over time using statistical process control. An original bundle (recognition method, fluid bolus < 20 min, antibiotics < 60 min) was retrospectively compared with varying bundle time-points, including a modified evidence-based care bundle, (recognition method, fluid bolus < 60 min, antibiotics < 180 min). We compared outcomes using Pearson χ-square and Kruskal Wallis tests and adjusted analysis.

RESULTS

Reported are 24 518 ISS and 12 821 ICS cases from 40 children's hospitals (January 2017-March 2020). Modified bundle compliance demonstrated special cause variation (40.1% to 45.8% in ISS; 52.3% to 57.4% in ICS). The ISS cohort's 30-day, sepsis-attributable mortality dropped from 1.4% to 0.9%, a 35.7% relative reduction over time (P < .001). In the ICS cohort, compliance with the original bundle was not associated with a decrease in 30-day sepsis-attributable mortality, whereas compliance with the modified bundle decreased mortality from 4.75% to 2.4% (P < .01).

CONCLUSIONS

Timely treatment of pediatric sepsis is associated with reduced mortality. A time-liberalized care bundle was associated with greater mortality reductions.

A sepsis trigger tool reduces time to antibiotic administration in the NICU

OBJECTIVE

Prolonged time to antibiotic administration is associated with increased morbidity and mortality. Interventions to decrease the time to antibiotic administration may improve mortality and morbidity.

STUDY DESIGN

We identified possible change concepts for reducing time to antibiotic usage in the NICU. For the initial intervention, we developed a sepsis screening tool based on NICU-specific parameters. The main goal of the project was to reduce time to antibiotic administration by 10%.

RESULTS

The project was conducted from April 2017 until April 2019. There were no missed cases of sepsis in the project period. Time to antibiotic administration for patients who were started on antibiotics decreased during the project, with the mean shifting from 126 to 102 min, a reduction of 19%.

CONCLUSIONS

We successfully reduced time to antibiotic delivery in our NICU using a trigger tool to identifying potential cases of sepsis in the NICU environment. The trigger tool requires broader validation.

Validation of a paediatric sepsis screening tool to identify children with sepsis in the emergency department: a statewide prospective cohort study in Queensland, Australia

OBJECTIVE

The Surviving Sepsis Campaign guidelines recommend the implementation of systematic screening for sepsis. We aimed to validate a paediatric sepsis screening tool and derive a simplified screening tool.

DESIGN

Prospective multicentre study conducted between August 2018 and December 2019. We assessed the performance of the paediatric sepsis screening tool using stepwise multiple logistic regression analyses with 10-fold cross-validation and evaluated the final model at defined risk thresholds.

SETTING

Twelve emergency departments (EDs) in Queensland, Australia.

PARTICIPANTS

3473 children screened for sepsis, of which 523 (15.1%) were diagnosed with sepsis.

INTERVENTIONS

A 32-item paediatric sepsis screening tool including rapidly available information from triage, risk factors and targeted physical examination.

PRIMARY OUTCOME MEASURE

Senior medical officer-diagnosed sepsis combined with the administration of intravenous antibiotics in the ED.

RESULTS

The 32-item paediatric sepsis screening tool had good predictive performance (area under the receiver operating characteristic curve (AUC) 0.80, 95% CI 0.78 to 0.82). A simplified tool containing 16 of 32 criteria had comparable performance and retained an AUC of 0.80 (95% CI 0.78 to 0.82). To reach a sensitivity of 90% (95% CI 87% to 92%), the final model achieved a specificity of 51% (95% CI 49% to 53%). Sensitivity analyses using the outcomes of sepsis-associated organ dysfunction (AUC 0.84, 95% CI 0.81 to 0.87) and septic shock (AUC 0.84, 95% CI 0.81 to 0.88) confirmed the main results.

CONCLUSIONS

A simplified paediatric sepsis screening tool performed well to identify children with sepsis in the ED. Implementation of sepsis screening tools may improve the timely recognition and treatment of sepsis.

Characteristics and Outcomes of Sepsis Presenting in Inpatient Pediatric Settings

OBJECTIVE

The pediatric sepsis literature lacks studies examining the inpatient setting, yet sepsis remains a leading cause of death in children's hospitals. More information is needed about sepsis arising in patients already hospitalized to improve morbidity and mortality outcomes. This study describes the clinical characteristics, process measures, and outcomes of inpatient sepsis cases compared with emergency department (ED) sepsis cases within the Improving Pediatric Sepsis Outcomes data registry from 46 hospitals that care for children.

METHODS

This retrospective cohort study included Improving Pediatric Sepsis Outcomes sepsis cases from January 2017 to December 2019 with onset in inpatient or ED. We used descriptive statistics to compare inpatient and ED sepsis metrics and describe inpatient sepsis outcomes.

RESULTS

The cohort included 26 855 cases; 8.4% were inpatient and 91.6% were ED. Inpatient cases had higher sepsis-attributable mortality (2.0% vs 1.4%, P = .025), longer length of stay after sepsis recognition (9 vs 5 days, P <.001), more intensive care admissions (57.6% vs 54.1%, P = .002), and greater average vasopressor use (18.0% vs 13.6%, P <.001) compared with ED. In the inpatient cohort, >40% of cases had a time from arrival to recognition within 12 hours. In 21% of cases, this time was >96 hours. Improved adherence to sepsis treatment bundles over time was associated with improved 30-day sepsis-attributable mortality for inpatients with sepsis.

CONCLUSIONS

Inpatient sepsis cases had longer lengths of stay, more need for intensive care, and higher vasopressor use. Sepsis-attributable mortality was significantly higher in inpatient cases compared with ED cases and improved with improved sepsis bundle adherence.

"These Are Our Kids": Qualitative Interviews With Clinical Leaders in General Emergency Departments on Motivations, Processes, and Guidelines in Pediatric Sepsis Care

STUDY OBJECTIVE

Sepsis is a leading cause of pediatric death requiring emergency resuscitation. Most children with sepsis are treated in general emergency departments (EDs); however, research has focused on pediatric EDs. We sought to identify barriers and facilitators to pediatric sepsis care in general EDs, including care processes, the role of guidelines, and incentivized metrics.

METHODS

In this qualitative study, we conducted semistructured interviews with key informant physician and nurse leaders overseeing pediatric sepsis in general EDs in 2021, including medical directors, nurse managers, and quality coordinators. Interviews were audio-recorded, transcribed, and coded using deductive domains based on steps of sepsis care, pediatric readiness, and structural dynamics. Domains were analyzed across interviews in matrices, using thematic analysis within domains.

RESULTS

Twenty-one clinical leaders representing 26 hospitals, including trauma levels I to IV, were interviewed. The themes included the following: (1) motivation to improve pediatric sepsis care based on moral imperative and location; (2) need for actionable pediatric sepsis guidelines; (3) children's hospitals' role in education, protocols, transfer, and consultation; and (4) mixed feelings about reportable metrics, particularly in EDs with low pediatric volume. Sepsis care process challenges included diagnosis, intravenous access, and antibiotic delivery but varied among hospitals.

CONCLUSION

Leaders in general EDs were motivated to provide high-quality pediatric sepsis care but disagreed on whether reportable metrics would drive improvements. They universally sought direct support from their nearest children's hospitals and actionable guidelines. Efforts to address pediatric sepsis quality in general EDs should prioritize guideline design, responsive pediatric transfer and consultation systems, and locally specific process improvement.

The Current and Future State of Pediatric Sepsis Definitions: An International Survey

BACKGROUND AND OBJECTIVES

Definitions for pediatric sepsis were established in 2005 without data-driven criteria. It is unknown whether the more recent adult Sepsis-3 definitions meet the needs of providers caring for children. We aimed to explore the use and applicability of criteria to diagnose sepsis and septic shock in children across the world.

METHODS

This is an international electronic survey of clinicians distributed across international and national societies representing pediatric intensive care, emergency medicine, pediatrics, and pediatric infectious diseases. Respondents stated their preferences on a 5-point Likert scale.

RESULTS

There were 2835 survey responses analyzed, of which 48% originated from upper-middle income countries, followed by high income countries (38%) and low or lower-middle income countries (14%). Abnormal vital signs, laboratory evidence of inflammation, and microbiologic diagnoses were the criteria most used for the diagnosis of "sepsis." The 2005 consensus definitions were perceived to be the most useful for sepsis recognition, while Sepsis-3 definitions were stated as more useful for benchmarking, disease classification, enrollment into trials, and prognostication. The World Health Organization definitions were perceived as least useful across all domains. Seventy one percent of respondents agreed that the term sepsis should be restricted to children with infection-associated organ dysfunction.

CONCLUSIONS

Clinicians around the world apply a myriad of signs, symptoms, laboratory studies, and treatment factors when diagnosing sepsis. The concept of sepsis as infection with associated organ dysfunction is broadly supported. Currently available sepsis definitions fall short of the perceived needs. Future diagnostic algorithms should be pragmatic and sensitive to the clinical settings.

Queensland Pediatric Sepsis Breakthrough Collaborative: Multicenter Observational Study to Evaluate the Implementation of a Pediatric Sepsis Pathway Within the Emergency Department

Supplemental Digital Content is available in the text.

To evaluate the implementation of a pediatric sepsis pathway in the emergency department as part of a statewide quality improvement initiative in Queensland, Australia.

Application of the Improving Pediatric Sepsis Outcomes Definition for Pediatric Sepsis to Nationally Representative Emergency Department Data

Supplemental Digital Content is available in the text.

To compare encounter estimates and demographics of pediatric patients (<18 years) meeting modified Improving Pediatric Sepsis Outcomes (IPSO) criteria for sepsis to cohorts obtained using other criteria for pediatric sepsis from administrative datasets.