Comparison of Administrative versus Electronic Health Record-based Methods for Identifying Sepsis Hospitalizations

Understanding the biases to sepsis surveillance and quality assurance caused by inaccurate coding in administrative health data

PURPOSE

Timely and accurate data on the epidemiology of sepsis are essential to inform policy decisions and research priorities. We aimed to investigate the validity of inpatient administrative health data (IAHD) for surveillance and quality assurance of sepsis care.

METHODS

We conducted a retrospective validation study in a disproportional stratified random sample of 10,334 inpatient cases of age ≥ 15 years treated in 2015-2017 in ten German hospitals. The accuracy of coding of sepsis and risk factors for mortality in IAHD was assessed compared to reference standard diagnoses obtained by a chart review. Hospital-level risk-adjusted mortality of sepsis as calculated from IAHD information was compared to mortality calculated from chart review information.

RESULTS

ICD-coding of sepsis in IAHD showed high positive predictive value (76.9-85.7% depending on sepsis definition), but low sensitivity (26.8-38%), which led to an underestimation of sepsis incidence (1.4% vs. 3.3% for severe sepsis-1). Not naming sepsis in the chart was strongly associated with under-coding of sepsis. The frequency of correctly naming sepsis and ICD-coding of sepsis varied strongly between hospitals (range of sensitivity of naming: 29-71.7%, of ICD-diagnosis: 10.7-58.5%). Risk-adjusted mortality of sepsis per hospital calculated from coding in IAHD showed no substantial correlation to reference standard risk-adjusted mortality (r = 0.09).

CONCLUSION

Due to the under-coding of sepsis in IAHD, previous epidemiological studies underestimated the burden of sepsis in Germany. There is a large variability between hospitals in accuracy of diagnosing and coding of sepsis. Therefore, IAHD alone is not suited to assess quality of sepsis care.

Heterogeneity of Benefit from Earlier Time-to-Antibiotics for Sepsis

Rationale: Shorter time-to-antibiotics improves survival from sepsis, particularly among patients in shock. There may be other subgroups for whom faster antibiotics are particularly beneficial.Objectives: Identify patient characteristics associated with greater benefit from shorter time-to-antibiotics.Methods: Observational cohort study of patients hospitalized with community-onset sepsis at 173 hospitals and treated with antimicrobials within 12 hours. We used three approaches to evaluate heterogeneity of benefit from shorter time-to-antibiotics: 1) conditional average treatment effects of shorter (⩽3 h) versus longer (>3-12 h) time-to-antibiotics on 30-day mortality using multivariable Poisson regression; 2) causal forest to identify characteristics associated with greatest benefit from shorter time-to-antibiotics; and 3) logistic regression with time-to-antibiotics modeled as a spline.Measurements and Main Results: Among 273,255 patients with community-onset sepsis, 131,094 (48.0%) received antibiotics within 3 hours. In Poisson models, shorter time-to-antibiotics was associated with greater absolute mortality reduction among patients with metastatic cancer (5.0% [95% confidence interval; CI: 4.3-5.7] vs. 0.4% [95% CI: 0.2-0.6] for patients without cancer, P < 0.001); patients with shock (7.0% [95% CI: 5.8-8.2%] vs. 2.8% [95% CI: 2.7-3.5%] for patients without shock, P = 0.005); and patients with more acute organ dysfunctions (4.8% [95% CI: 3.9-5.6%] for three or more dysfunctions vs. 0.5% [95% CI: 0.3-0.8] for one dysfunction, P < 0.001). In causal forest, metastatic cancer and shock were associated with greatest benefit from shorter time-to-antibiotics. Spline analysis confirmed differential nonlinear associations of time-to-antibiotics with mortality in patients with metastatic cancer and shock.Conclusions: In patients with community-onset sepsis, the mortality benefit of shorter time-to-antibiotics varied by patient characteristics. These findings suggest that shorter time-to-antibiotics for sepsis is particularly important among patients with cancer and/or shock.

Real-World Implications of Updated Surviving Sepsis Campaign Antibiotic Timing Recommendations

OBJECTIVE

To evaluate real-world implications of updated Surviving Sepsis Campaign (SSC) recommendations for antibiotic timing.

DESIGN

Retrospective cohort study.

SETTING

Twelve hospitals in the Southeastern United States between 2017 and 2021.

PATIENTS

One hundred sixty-six thousand five hundred fifty-nine adult hospitalized patients treated in the emergency department for suspected serious infection.

INTERVENTIONS

None.

MEASUREMENTS AND MAIN RESULTS

We determined the number and characteristics of patients affected by updated SSC recommendations for initiation of antibiotics that incorporate a risk- and probability-stratified approach. Using an infection prediction model with a cutoff of 0.5 to classify possible vs. probable infection, we found that 30% of the suspected infection cohort would be classified as shock absent, possible infection and thus eligible for the new 3-hour antibiotic recommendation. In real-world practice, this group had a conservative time to antibiotics (median, 5.5 hr; interquartile range [IQR], 3.2-9.8 hr) and low mortality (2%). Patients categorized as shock absent, probable infection had a median time to antibiotics of 3.2 hours (IQR, 2.1-5.1 hr) and mortality of 3%. Patients categorized as shock present, the probable infection had a median time to antibiotics 2.7 hours (IQR, 1.7-4.6 hr) and mortality of 17%, and patients categorized as shock present, the possible infection had a median time to antibiotics 6.9 hours (IQR, 3.5-16.3 hr) and mortality of 12%.

CONCLUSIONS

These data support recently updated SSC recommendations to align antibiotic timing targets with risk and probability stratifications. Our results provide empirical support that clinicians and hospitals should not be held to 1-hour targets for patients without shock and with only possible sepsis.

Impact of Reducing Time-to-Antibiotics on Sepsis Mortality, Antibiotic Use, and Adverse Events

Rationale: Shorter time-to-antibiotics is lifesaving in sepsis, but programs to hasten antibiotic delivery may increase unnecessary antibiotic use and adverse events. Objectives: We sought to estimate both the benefits and harms of shortening time-to-antibiotics for sepsis. Methods: We conducted a simulation study using a cohort of 1,559,523 hospitalized patients admitted through the emergency department with meeting two or more systemic inflammatory response syndrome criteria (2013-2018). Reasons for hospitalization were classified as septic shock, sepsis, infection, antibiotics stopped early, and never treated (no antibiotics within 48 h). We simulated the impact of a 50% reduction in time-to-antibiotics for sepsis across 12 hospital scenarios defined by sepsis prevalence (low, medium, or high) and magnitude of "spillover" antibiotic prescribing to patients without infection (low, medium, high, or very high). Outcomes included mortality and adverse events potentially attributable to antibiotics (e.g., allergy, organ dysfunction, Clostridiodes difficile infection, and culture with multidrug-resistant organism). Results: A total of 933,458 (59.9%) hospitalized patients received antimicrobial therapy within 48 hours of presentation, including 38,572 (2.5%) with septic shock, 276,082 (17.7%) with sepsis, 370,705 (23.8%) with infection, and 248,099 (15.9%) with antibiotics stopped early. A total of 199,937 (12.8%) hospitalized patients experienced an adverse event; most commonly, acute liver injury (5.6%), new MDRO (3.5%), and Clostridiodes difficile infection (1.7%). Across the scenarios, a 50% reduction in time-to-antibiotics for sepsis was associated with a median of 1 to 180 additional antibiotic-treated patients and zero to seven additional adverse events per death averted from sepsis. Conclusions: The impacts of faster time-to-antibiotics for sepsis vary markedly across simulated hospital types. However, even in the worst-case scenario, new antibiotic-associated adverse events were rare.