28 NICUs participating in a quality improvement collaborative targeting early-onset sepsis antibiotic use

OBJECTIVE

There is widespread overuse of antibiotics in neonatal intensive care units (NICUs). The objective of this study was to safely reduce antibiotic use in participating NICUs by targeting early-onset sepsis (EOS) management.

STUDY DESIGN

Twenty-eight NICUs participated in this statewide multicenter antibiotic stewardship quality improvement collaborative. The primary aim was to reduce the total monthly mean antibiotic utilization rate (AUR) by 25% in participant NICUs.

RESULT

Aggregate AUR was reduced by 15.3% (p < 0.001). There was a wide range in improvement among participant NICUs. There were no increases in EOS rates or nosocomial infection rates related to the intervention.

CONCLUSION

Participation in this multicenter NICU antibiotic stewardship collaborative targeting EOS was associated with an aggregate reduction in antibiotic use. This study informs efforts aimed at sustaining improvements in NICU AURs.

Association between Electronic Health Record Implementations and Hospital-Acquired Conditions in Pediatric Hospitals

BACKGROUND

Implementing an electronic health record (EHR) is one of the most disruptive operational tasks a health system can undergo. Despite anecdotal reports of adverse events around the time of EHR implementations, there is limited corroborating research, particularly in pediatrics. We utilized data from Solutions for Patient Safety (SPS), a network of 145+ children's hospitals that share data and protocols to reduce harm in pediatric care delivery, to study the impact of EHR implementations on patient safety.

OBJECTIVE

Determine if there is an association between the time immediately surrounding an EHR implementation and hospital-acquired conditions (HACs) rates in pediatrics.

METHODS

A survey of information technology leaders at pediatric institutions identified EHR implementations occurring between 2012 and 2022. This list was cross-referenced with the SPS database to create an anonymized dataset of 27 sites comprising monthly HAC and care bundle compliance rates in the 7 months preceding and succeeding the transition. Six HACs were analyzed: central-line associated bloodstream infection (CLABSI), catheter-associated urinary tract infection (CAUTI), adverse drug events, surgical site infections (SSIs), pressure injuries (PIs), and falls, in addition to four associated care bundle compliance rates: CLABSI and CAUTI maintenance bundles, SSI bundle, and PI bundle. To determine if there was a statistically significant association with EHR implementation, the observation period was divided into three eras: "before" (months -7 to -3), "during" (months -2 to +2), and "after" go-live (months +3 to +7). Average monthly HAC and bundle compliance rates were calculated across eras. Paired t-tests were performed to compare rates between the eras.

RESULTS

No statistically significant increase in HAC rates or decrease in bundle compliance rates was observed across the EHR implementation eras.

CONCLUSION

This multisite study detected no significant increase in HACs and no decrease in preventive care bundle compliance in the months surrounding an EHR implementation.

Association Between Hospital-Acquired Harm Outcomes and Membership in a National Patient Safety Collaborative

IMPORTANCE

Hospital engagement networks supported by the US Centers for Medicare & Medicaid Services Partnership for Patients program have reported significant reductions in hospital-acquired harm, but methodological limitations and lack of peer review have led to persistent questions about the effectiveness of this approach.

OBJECTIVE

To evaluate associations between membership in Children's Hospitals' Solutions for Patient Safety (SPS), a federally funded hospital engagement network, and hospital-acquired harm using standardized definitions and secular trend adjustment.

DESIGN, SETTING, AND PARTICIPANTS

This prospective hospital cohort study included 99 children's hospitals. Using interrupted time series analyses with staggered intervention introduction, immediate and postimplementation changes in hospital-acquired harm rates were analyzed, with adjustment for preexisting secular trends. Outcomes were further evaluated by early-adopting (n = 73) and late-adopting (n = 26) cohorts.

EXPOSURES

Hospitals implemented harm prevention bundles, reported outcomes and bundle compliance using standard definitions to the network monthly, participated in learning events, and implemented a broad safety culture program. Hospitals received regular reports on their comparative performance.

MAIN OUTCOMES AND MEASURES

Outcomes for 8 hospital-acquired conditions were evaluated over 1 year before and 3 years after intervention.

RESULTS

In total, 99 hospitals met the inclusion criteria and were included in the analysis. A total of 73 were considered part of the early-adopting cohort (joined between 2012-2013) and 26 were considered part of the late-adopting cohort (joined between 2014-2016). A total of 42 hospitals were freestanding children's hospitals, and 57 were children's hospitals within hospital or health systems. The implementation of SPS was associated with an improvement in hospital-acquired condition rates in 3 of the 8 conditions after accounting for secular trends. Membership in the SPS was associated with an immediate reduction in central catheter-associated bloodstream infections (coefficient = -0.152; 95% CI, -0.213 to -0.019) and falls of moderate or greater severity (coefficient = -0.331; 95% CI, -0.594 to -0.069). The implementation of the SPS was associated with a reduction in the monthly rate of adverse drug events (coefficient = -0.021; 95% CI, -0.034 to -0.008) in the post-SPS period. The study team observed larger decreases for the early-adopting cohort compared with the late-adopting cohort.

CONCLUSIONS AND RELEVANCE

Through the application of rigorous methods (standard definitions and longitudinal time series analysis with adjustment for secular trends), this study provides a more thorough analysis of the association between the Partnership for Patients hospital engagement network model and reductions in hospital-acquired conditions. These findings strengthen previous claims of an association between this model and improvement. However, inconsistent observations across hospital-acquired conditions when adjusted for secular trends suggests that some caution regarding attributing all effects observed to this model is warranted.

Vignettes Identify Variation in Antibiotic Use for Suspected Early Onset Sepsis

BACKGROUND AND OBJECTIVES

There is widespread unwarranted antibiotic use and large individual provider variation in antibiotic use in NICUs. Vignette-based research methodology offers a unique method of studying variation in individual provider decisions. The objective with this study was to use a vignette-based survey to identify specific areas of provider antibiotic use variation in newborns being evaluated for early onset sepsis.

METHODS

This study was undertaken as part of a statewide multicenter neonatal antibiotic stewardship quality improvement project led by a perinatal quality improvement collaborative. A web-based vignette survey was administered to identify variation in decisions to start and discontinue antibiotics in cases of early onset sepsis.

RESULTS

The largest variation was noted in 3 of the 6 vignette cases. These cases highlighted variation in (1) decisions to start antibiotics in a case describing a well-appearing newborn with risk factors and an elevated C-reactive protein, (2) decisions to start antibiotics in the case of a newborn with risk factors plus mild respiratory signs at birth, and (3) decisions to stop antibiotics in the case of the newborn with a history of sepsis risk factors and mild clinical respiratory signs that resolved after 72 hours.

CONCLUSIONS

Clinical vignette assessment identified specific areas of variation in individual provider antibiotic use decisions in cases of suspected early onset sepsis. Vignettes are a valuable method of describing individual provider variation and highlighting antibiotic stewardship improvement opportunities in NICUs.

Target-Based Care: An Intervention to Reduce Variation in Postoperative Length of Stay

OBJECTIVES

To derive care targets and evaluate the impact of displaying them at the point of care on postoperative length of stay (LOS).

STUDY DESIGN

A prospective cohort study using 2 years of historical controls within a freestanding, academic children's hospital. Patients undergoing benchmark cardiac surgery between May 4, 2014, and August 15, 2016 (preintervention) and September 6, 2016, to September 30, 2018 (postintervention) were included. The intervention consisted of displaying at the point of care targets for the timing of extubation, transfer from the intensive care unit (ICU), and hospital discharge. Family satisfaction, reintubation, and readmission rates were tracked.

RESULTS

The postintervention cohort consisted of 219 consecutive patients. There was a reduction in variation for ICU (difference in SD -2.56, P < .01) and total LOS (difference in SD -2.84, P < .001). Patients stayed on average 0.97 fewer days (P < .001) in the ICU (median -1.01 [IQR -2.15, -0.39]), 0.7 fewer days (P < .001) on mechanical ventilation (median -0.54 [IQR -0.77, -0.50]), and 1.18 fewer days (P < .001) for the total LOS (median -2.25 [IQR -3.69, -0.15]). Log-transformed multivariable linear regression demonstrated the intervention to be associated with shorter ICU LOS (β coefficient -0.19, SE 0.059, P < .001), total postoperative LOS (β coefficient -0.12, SE 0.052, P = .02), and ventilator duration (β coefficient -0.21, SE 0.048, P < .001). Balancing metrics did not differ after the intervention.

CONCLUSIONS

Target-based care is a simple, novel intervention associated with reduced variation in LOS and absolute LOS across a diverse spectrum of complex cardiac surgeries.

Safety climate, safety climate strength, and length of stay in the NICU

Background

Safety climate is an important marker of patient safety attitudes within health care units, but the significance of intra-unit variation of safety climate perceptions (safety climate strength) is poorly understood. This study sought to examine the standard safety climate measure (percent positive response (PPR)) and safety climate strength in relation to length of stay (LOS) of very low birth weight (VLBW) infants within California neonatal intensive care units (NICUs).

Methods

Observational study of safety climate from 2073 health care providers in 44 NICUs. Consistent perceptions among a NICU’s respondents, i.e., safety climate strength, was determined via intra-unit standard deviation of safety climate scores. The relation between safety climate PPR, safety climate strength, and LOS among VLBW (< 1500 g) infants was evaluated using log-linear regression. Secondary outcomes were infections, chronic lung disease, and mortality.

Results

NICUs had safety climate PPRs of 66 ± 12%, intra-unit standard deviations 11 (strongest) to 23 (weakest), and median LOS 60 days. NICUs with stronger climates had LOS 4 days shorter than those with weaker climates. In interaction modeling, NICUs with weak climates and low PPR had the longest LOS, NICUs with strong climates and low PPR had the shortest LOS, and NICUs with high PPR (both strong and weak) had intermediate LOS. Stronger climates were associated with lower odds of infections, but not with other secondary outcomes.

Conclusions

Safety climate strength is independently associated with LOS and moderates the association between PPR and LOS among VLBW infants. Strength and PPR together provided better prediction than PPR alone, capturing variance in outcomes missed by PPR. Evaluations of NICU safety climate consider both positivity (PPR) and consistency of responses (strength) across individuals.

A multifaceted quality improvement project improves intraoperative redosing of surgical antimicrobial prophylaxis during pediatric surgery

BACKGROUND

Accurate intraoperative antibiotic redosing contributes to prevention of surgical site infections in pediatric patients. Ensuring compliance with evolving national guidelines of weight-based, intraoperative redosing of antibiotics is challenging to pediatric anesthesiologists.

AIMS

Our primary aim was to increase compliance of antibiotic redoses at the appropriate time and appropriate weight-based dose to 70%. Secondary aims included a subset analysis of time compliance and dose compliance individually, and compliance based on order entry method of the first dose (verbal or electronic).

METHODS

At a freestanding, academic pediatric hospital, we reviewed surgical cases between May 1, 2014, and October 31, 2017 requiring antibiotic redoses. After an institutional change in cefazolin dosing in May 2015, phased interventions to improve compliance included electronic countermeasures to display previous and next dose timing, an alert 5 minutes prior to next dose, and weight-based dose recommendation (September 2015). Physical countermeasures include badge cards, posting of guidelines, and updates to housestaff manual (September 2015). Statistical process control charts were used to assess overall antibiotic redose compliance, time compliance, and dose compliance. The chi-square test was used to analyze group differences.

RESULTS

A total of 3015 antibiotic redoses were administered during 2341 operative cases between May 1, 2014, and October 31, 2017. Mean monthly compliance with redosing was 4.3% (May 2014-April 2015) and 73% (November 2015-October 2017) (P < 0.001). Dose-only compliance increased from 76% to 89% (P < 0.001), and time-only compliance increased from 4.9% to 82% (P < 0.001). After implementation of countermeasures, electronic order entry compared with verbal order was associated with higher dose compliance, 90% vs 86% (P = 0.015).

CONCLUSION

This quality improvement project, utilizing electronic and physical interventions, was effective in improving overall prophylactic antibiotic redosing compliance in accordance with institutional redosing guidelines.

Self-Reported Adherence to High Reliability Practices Among Participants in the Children's Hospitals' Solutions for Patient Safety Collaborative

BACKGROUND

Application of high reliability principles has the potential to transform the health care industry to perform with a higher level of safety than is present today. The purpose of this study was to quantitatively assess and describe the extent and variability of integration of high reliability practices among a collaborative of children's hospitals using the High Reliability Health Care Maturity (HRHCM) model.

METHODS

A survey instrument based on the HRHCM model was developed to determine the extent of integration of high reliability practices across hospitals participating in the Children's Hospitals' Solutions for Patient Safety (CHSPS) network. The survey was distributed with instructions for completion to obtain a single organizational response, which was then used to quantify the extent to which high reliability attributes were implemented at each organization.

RESULTS

Of the 95 institutions in the CHSPS at the time of the study, 46 provided a complete response to the survey (48.4% response rate). The overall mean score for high reliability was 42.3 (range: 28-53), which places the cohort in the stage of approaching high reliability. Of the responding organizations, none fell into the beginning stage, while 15.2% landed in the developing, 4.3% in the advancing, and 80.4% in the approaching high reliability stages.

CONCLUSION

Understanding high reliability attributes and assessing the location of individual and collaborative-wide sites along the high reliability continuum using this maturity model identify opportunities for organizations as they progress on their high reliability journey. Our results suggest opportunity in all domains of the high reliability maturity model for the majority of participating children's hospitals.

Safety Stop: A Valuable Addition to the Pediatric Universal Protocol

PROBLEM DEFINITION

The World Health Organization (WHO) guidelines and Joint Commission requirements state that the time-out component of the Universal Protocol for Preventing Wrong Site, Wrong Procedure, and Wrong Person Surgery™ must be performed just prior to incision. A mock Joint Commission survey at one institution revealed that the time-out was performed prior to preparation and draping (P&D) of the patient, not afterward, representing both a patient and regulatory risk.

APPROACH

The multidisciplinary perioperative quality improvement team at a freestanding, quaternary care, academic pediatric hospital led the development of a new time-out process. An enhanced pediatric Universal Protocol, which included a new component, the safety stop, was created. The safety stop occurred just prior to P&D of the patient, and the time-out was performed just prior to incision, aligning with WHO recommendations. After electronic correspondence and several perioperative leadership meetings, the enhanced pediatric Universal Protocol was initiated. Compliance audits were performed to demonstrate comprehensive adoption.

OUTCOMES

In seven operating room locations, 60 audits were completed in four weeks, with 96.7% (58/60) demonstrating compliance with the new policy. During a subsequent Joint Commission accreditation survey, the enhanced pediatric Universal Protocol with inclusion of the safety stop was highlighted as a leading practice.

KEY INSIGHTS

Although initially it was believed that moving the time-out from prior to P&D to just prior to incision would be a simple solution, flow mapping the complete time-out process identified significant risk of wrong-site or wrong-patient surgery with this solution. This risk was exacerbated by the small body size of pediatric patients being obscured by draping on a typical operating room table.

Adverse Events in Hospitalized Pediatric Patients

: media-1vid110.1542/5789657761001PEDS-VA_2017-3360Video Abstract BACKGROUND: Patient safety concerns over the past 2 decades have prompted widespread efforts to reduce adverse events (AEs). It is unclear whether these efforts have resulted in reductions in hospital-wide AE rates. We used a validated safety surveillance tool, the Global Assessment of Pediatric Patient Safety, to measure temporal trends (2007-2012) in AE rates among hospitalized children.

METHODS

We conducted a retrospective surveillance study of randomly selected pediatric inpatient records from 16 teaching and nonteaching hospitals. We constructed Poisson regression models with hospital random intercepts, controlling for patient age, sex, insurance, and chronic conditions, to estimate changes in AE rates over time.

RESULTS

Examining 3790 records, reviewers identified 414 AEs (19.1 AEs per 1000 patient days; 95% confidence interval [CI] 17.2-20.9) and 210 preventable AEs (9.5 AEs per 1000 patient days; 95% CI 8.2-10.8). On average, teaching hospitals had higher AE rates than nonteaching hospitals (26.2 [95% CI 23.7-29.0] vs 5.1 [95% CI 3.7-7.1] AEs per 1000 patient days, P < .001). Chronically ill children had higher AE rates than patients without chronic conditions (33.9 [95% CI 24.5-47.0] vs 14.0 [95% CI 11.8-16.5] AEs per 1000 patient days, P < .001). Multivariate analyses revealed no significant changes in AE rates over time. When stratified by hospital type, neither teaching nor nonteaching hospitals experienced significant temporal AE rate variations.

CONCLUSIONS

AE rates in pediatric inpatients are high and did not improve from 2007 to 2012. Pediatric AE rates were substantially higher in teaching hospitals as well as in patients with more chronic conditions.

Comparison of Collaborative Versus Single-Site Quality Improvement to Reduce NICU Length of Stay

BACKGROUND

There is unexplained variation in length of stay (LOS) across NICUs, suggesting that there may be practices that can optimize LOS.

METHODS

Three groups of NICUs in the California Perinatal Quality Care Collaborative were followed: (1) collaborative centers participating in an 18-month collaborative quality improvement project to optimize LOS for preterm infants; (2) individual centers aiming to optimize LOS; and (3) nonparticipants. Our aim in the collaborative project was to decrease postmenstrual age (PMA) at discharge for infants born between 27 + 0 and <32 weeks' gestational age by 3 days. A secondary outcome was "early discharge," the proportion of infants discharged from the hospital before 36 + 5 weeks' PMA. The balancing measure of readmissions within 72 hours was tracked for the collaborative group.

RESULTS

From 2013 to 2015, 8917 infants were cared for in 20 collaborative NICUs, 19 individual project NICUs, and 71 nonparticipants. In the collaborative group, the PMA at discharge decreased from 37.8 to 37.5 weeks (P = .02), and early discharge increased from 31.6% to 41.9% (P = .006). The individual project group had no significant change. Nonparticipants had a decrease in PMA from 37.5 to 37.3 weeks (P = .01) but no significant change in early discharge (39.8% to 43.6%; P = .24). There was no significant change in readmissions over time in the collaborative group.

CONCLUSIONS

A structured collaborative project that was focused on optimizing LOS led to a 3-day decrease in LOS and was more effective than individualized quality improvement efforts.

Children's Hospitals' Solutions for Patient Safety Collaborative Impact on Hospital-Acquired Harm

OBJECTIVES

To determine if an improvement collaborative of 33 children's hospitals focused on reliable best practice implementation and culture of safety improvements can reduce hospital-acquired conditions (HACs) and serious safety events (SSEs).

METHODS

A 3-year prospective cohort study design with a 12-month historical control population was completed by the Children's Hospitals' Solutions for Patient Safety collaborative. Identification and dissemination of best practices related to 9 HACs and SSE reduction focused on key process and culture of safety improvements. Individual hospital improvement teams leveraged the resources of a large, structured children's hospital collaborative using electronic, virtual, and in-person interactions.

RESULTS

Thirty-three children's hospitals from across the United States volunteered to be part of the Children's Hospitals' Solutions for Patient Safety collaborative. Thirty-two met all the data submission eligibility requirements for the HAC improvement objective of this study, and 21 participated in the high-reliability culture work aimed at reducing SSEs. Significant harm reduction occurred in 8 of 9 common HACs (range 9%-71%; P < .005 for all). The mean monthly SSE rate decreased 32% (from 0.77 to 0.52; P < .001). The 12-month rolling average SSE rate decreased 50% (from 0.82 to 0.41; P < .001).

CONCLUSIONS

Participation in a structured collaborative dedicated to implementing HAC-related best-practice prevention bundles and culture of safety interventions designed to increase the use of high-reliability organization practices resulted in significant HAC and SSE reductions. Structured collaboration and rapid sharing of evidence-based practices and tools are effective approaches to decreasing hospital-acquired harm.

Inpatient-Derived Vital Sign Parameters Implementation: An Initiative to Decrease Alarm Burden

OBJECTIVES

To implement data-driven vital sign parameters to reduce bedside monitor alarm burden.

METHODS

Single-center, quality-improvement initiative with historical controls assessing the impact of age-based, inpatient-derived heart rate (HR) and respiratory rate (RR) parameters on a 20-bed acute care ward that serves primarily pediatric cardiology patients. The primary outcome was the number of alarms per monitored bed day (MBD) with the aim to decrease the alarms per MBD. Balancing measures included the frequency of missed rapid response team activations, acute respiratory code events, and cardiorespiratory arrest events in the unit with the new vital sign parameters.

RESULTS

The median number of all cardiorespiratory monitor alarms per MBD decreased by 21% from 52 (baseline period) to 41 (postintervention period) (P < .001). This included a 17% decrease in the median HR alarms (9-7.5 per MBD) and a 53% drop in RR alarms (16.8-8.0 per MBD). There were 57 rapid response team activations, 8 acute respiratory code events, and no cardiorespiratory arrest events after the implementation of the new parameters. An evaluation of HRs and RRs recorded at the time of the event revealed that all patients with HRs and/or RRs out of range per former default parameters would also be out of range with the new parameters.

CONCLUSIONS

Implementation of data-driven HR and iteratively derived RR parameters safely decreased the total alarm frequency by 21% in a pediatric acute care unit.

A quality improvement initiative to optimize dosing of surgical antimicrobial prophylaxis

BACKGROUND

The risk of surgical site infections is reduced with appropriate timing and dosing of preoperative antimicrobials. Based on evolving national guidelines, we increased the preoperative dose of cefazolin from 25 to 30 mg·kg^-1 . This quality improvement project describes an improvement initiative to develop standard work processes to ensure appropriate dosing.

AIMS

The primary aim was to deliver cefazolin 30 mg·kg^-1 to at least 90% of indicated patients. The secondary aim was to determine differences between accuracy of cefazolin doses when given as an electronic order compared to a verbal order.

METHODS

Data were collected from January 1, 2012 to May 31, 2016. A quality improvement team of perioperative physicians, nurses, and pharmacists implemented a series of interventions including new electronic medical record order sets, personal provider antibiotic dose badges, and utilization of pharmacists to prepare antibiotics to increase compliance with the recommended dose. Process compliance was measured using a statistical process control chart, and dose compliance was measured through electronic analysis of the electronic medical record. Secondary aim data were displayed as percentage of dose compliance. An unpaired t-test was used to determine differences between groups.

RESULTS

Between January 1, 2012 and May 31, 2016, cefazolin was administered to 9086 patients. The mean compliance of cefazolin at 30 mg·kg^-1 from May 2013 to March 2014 was 40%, which prompted initiation of this project. From April 2014 to May 2016, a series of interventions were deployed. The mean compliance from September 2015 to May 2016 was 93% with significantly reduced variation and no special cause variation, indicating that the process was in control at the target primary aim. There were 649 cefazolin administrations given verbally and 1929 given with an electronic order between October 1, 2014 and May 31, 2016. During this time period, the rate of compliance of administering cefazolin at 30 mg·kg^-1 was significantly higher when given after an electronic order than when given verbally, 94% vs 76%.

CONCLUSION

This comprehensive quality improvement project improved practitioner compliance with evidence-based preoperative antimicrobial dosing recommendations to reduce the risk of surgical site infections.

Standardized ICU to OR handoff increases communication without delaying surgery

Purpose

No studies have examined preoperative handoffs from the intensive care unit (ICU) to OR. Given the risk of patient harm, the authors developed a standardized ICU to OR handoff using a previously published handoff model. The purpose of this paper is to determine whether a standardized ICU to OR handoff process would increase the number of team handoffs and improve patient transport readiness.

Design/methodology/approach

The intervention consisted of designing a multidisciplinary, face-to-face handoff between sending ICU providers and receiving anesthesiologist and OR nurse, verbally presented in the I-PASS format. Anticipatory calls from the OR nurse to the ICU nurse were made to prepare the patient for transport. Data collected included frequency of handoff, patient transport readiness, turnover time between OR cases, and anesthesia provider satisfaction.

Findings

In total, 57 audits were completed. The frequency of handoffs increased from 25 to 86 percent (p<0.0001) and the frequency of patient readiness increased from 61 to 97 percent (p=0.001). There were no changes in timeliness of first start cases and no significant change in turnover times between cases. Anesthesia provider satisfaction scores increased significantly.

Practical implications

A standardized, team based ICU to OR handoff increased the frequency of face-to-face handoffs, patient readiness and anesthesia provider satisfaction within increasing turnover between cases.

Originality/value

Although studies have identified the transition of patients from the ICU to the OR as a period of increased harm, the development of a preoperative ICU to OR handoff had not been described. This intervention may be used in other institutions to design ICU to OR transitions of care.

Factors Associated With Provider Burnout in the NICU

BACKGROUND

NICUs vary greatly in patient acuity and volume and represent a wide array of organizational structures, but the effect of these differences on NICU providers is unknown. This study sought to test the relation between provider burnout prevalence and organizational factors in California NICUs.

METHODS

Provider perceptions of burnout were obtained from 1934 nurse practitioners, physicians, registered nurses, and respiratory therapists in 41 California NICUs via a validated 4-item questionnaire based on the Maslach Burnout Inventory. The relations between burnout and organizational factors of each NICU were evaluated via t-test comparison of quartiles, univariable regression, and multivariable regression.

RESULTS

Overall burnout prevalence was 26.7% ± 9.8%. Highest burnout prevalence was found among NICUs with higher average daily admissions (32.1% ± 6.4% vs 17.2% ± 6.7%, P < .001), higher average occupancy (28.1% ± 8.1% vs 19.9% ± 8.4%, P = .02), and those with electronic health records (28% ± 11% vs 18% ± 7%, P = .03). In sensitivity analysis, nursing burnout was more sensitive to organizational differences than physician burnout in multivariable modeling, significantly associated with average daily admissions, late transfer proportion, nursing hours per patient day, and mortality per 1000 infants. Burnout prevalence showed no association with proportion of high-risk patients, teaching hospital distinction, or in-house attending presence.

CONCLUSIONS

Burnout is most prevalent in NICUs with high patient volume and electronic health records and may affect nurses disproportionately. Interventions to reduce burnout prevalence may be of greater importance in NICUs with ≥10 weekly admissions.

Effects of delivery room quality improvement on premature infant outcomes

OBJECTIVE

Delivery room management interventions have been successfully implemented via collaborative quality improvement (QI) projects. However, it is unknown whether these successes translate to reductions in neonatal morbidity and mortality.

STUDY DESIGN

This was a prospective pre-post intervention study of three nonrandomized hospital groups within the California Perinatal Quality Care Collaborative. A collaborative QI model (Collaborative QI) was compared with a single-site QI model (NICU QI) and a non-participant population when implementing evidence-based delivery room practices. The intervention period was between June 2011 and May 2012. Infants born with gestational age between 22 weeks 0 days and 29 weeks 6 days and birth weight ⩽1500 g were included. Outcomes were mortality and select morbidities (bronchopulmonary dysplasia (BPD), intraventricular hemorrhage (IVH), retinopathy of prematurity (ROP) and necrotizing enterocolitis (NEC)). Outcomes were compared between the baseline (January 2010 to May 2011) and post-intervention period (June 2012 to May 2013) within each comparison group.

RESULTS

Ninety-five hospitals were included with 4222 infants in the baseline period and 4186 infants in the post-intervention period. The Collaborative QI group had significantly reduced odds of developing BPD post-intervention (odds ratio (OR) 0.8, 95% confidence interval (CI) 0.65 to 0.99) or composite BPD-death (OR 0.83, 95% CI 0.69 to 1.00). In both the Collaborative QI and non-participants there were also reductions in IVH, severe IVH, composite severe IVH-death, severe ROP and composite severe ROP-death.

CONCLUSION

Hospitals dedicated to improving delivery room practices can impact neonatal outcomes.

Pediatric Postoperative Pulse Oximetry Monitoring During Transport to the Postanesthesia Care Unit Reduces Frequency of Hypoxemia

BACKGROUND

The standard use of pulse oximetry during the transport of postoperative patients from the operating room (OR) to the postanesthesia care unit (PACU) is not routinely practiced. A study was conducted to determine if the frequency of hypoxemia on admission to the PACU decreased after implementation of routine use of transport pulse oximeters for postoperative patients being transferred to the PACU.

METHODS

In this prospective cohort study, which was conducted at an academic pediatric hospital, the primary outcome measure was the frequency of hypoxemic events on arrival to the PACU.

RESULTS

A total of 506 patients in the preintervention phase and 597 in the postintervention phase met the inclusion criteria. Six hypoxemic events on arrival to the PACU were identified in preintervention phase versus zero in the postintervention period, p = 0.009. Use of oxygen monitors during transport from the OR to the PACU increased from 0% to 100%, p < 0.0001, in the postintervention phase. The median duration of unmonitored time during transport decreased from 272 seconds to 13 seconds, p < 0.0001. Of the 605 patients who met the inclusion criteria for sustainment audits-conducted 18 months after the postimplementation evaluation-99.8% were transported to the PACU with a pulse oximeter, and there were zero reported hypoxemic patients on PACU admission.

CONCLUSION

The routine use of portable oxygen monitoring when transferring patients from the OR to the PACU is a low-cost, noninvasive safety measure that should be considered at any institution performing pediatric general anesthesia.

Implementing Delivery Room Checklists and Communication Standards in a Multi-Neonatal ICU Quality Improvement Collaborative

BACKGROUND

The 2015 American Academy of Pediatrics Neonatal Resuscitation Program (NRP) and International Liaison Committee on Resuscitation (ILCOR) resuscitation guidelines state, "It is still suggested that briefing and debriefing techniques be used whenever possible for neonatal resuscitation." Effective communication and reliable delivery of evidence-based best practices are critical aspects of the 2015 NRP guidelines. To promote optimal communication and best practice-focused checklists use during active neonatal resuscitation, the Readiness Bundle (RB) was integrated within the larger change package deployed in the California Perinatal Quality Care Collaborative's (CPQCC) 12-month Delivery Room Management Quality Improvement Collaborative.

METHODS

The RB consisted of (1) a checklist for high-risk neonatal resuscitations and (2) briefings and debriefings to improve teamwork and communication in the delivery room (DR). Implementation of the RB was encouraged, compliance with the RB was tracked monthly up through 6 months after the completion of the collaborative, and satisfaction with the RB was evaluated.

RESULTS

Twenty-four neonatal intensive care units (NICUs) participated in the CPQCCDR collaborative. Before the initiation of the collaborative, the elements of the RB were complied with in 0 of 740 reported deliveries (0%). During the 12-month collaborative, compliance with the RB improved to a median of 71%, which was surpassed in the 6-month period after the collaborative ended (80%). One-hundred percent of responding NICUs would recommend the RB to other NICUs working on improving DR management.

CONCLUSIONS

The RB was rapidly adopted, with compliance sustained for 6 months after completion of the collaborative. Inclusion of the RB in the next generation of the NRP guidelines is encouraged.

Safety analysis of proposed data-driven physiologic alarm parameters for hospitalized children

INTRODUCTION

Modification of alarm limits is one approach to mitigating alarm fatigue. We aimed to create and validate heart rate (HR) and respiratory rate (RR) percentiles for hospitalized children, and analyze the safety of replacing current vital sign reference ranges with proposed data-driven, age-stratified 5th and 95th percentile values.

METHODS

In this retrospective cross-sectional study, nurse-charted HR and RR data from a training set of 7202 hospitalized children were used to develop percentile tables. We compared 5th and 95th percentile values with currently accepted reference ranges in a validation set of 2287 patients. We analyzed 148 rapid response team (RRT) and cardiorespiratory arrest (CRA) events over a 12-month period, using HR and RR values in the 12 hours prior to the event, to determine the proportion of patients with out-of-range vitals based upon reference versus data-driven limits.

RESULTS

There were 24,045 (55.6%) fewer out-of-range measurements using data-driven vital sign limits. Overall, 144/148 RRT and CRA patients had out-of-range HR or RR values preceding the event using current limits, and 138/148 were abnormal using data-driven limits. Chart review of RRT and CRA patients with abnormal HR and RR per current limits considered normal by data-driven limits revealed that clinical status change was identified by other vital sign abnormalities or clinical context.

CONCLUSIONS

A large proportion of vital signs in hospitalized children are outside presently used norms. Safety evaluation of data-driven limits suggests they are as safe as those currently used. Implementation of these parameters in physiologic monitors may mitigate alarm fatigue. Journal of Hospital Medicine 2015;11:817-823. © 2015 Society of Hospital Medicine.

Performance of the Global Assessment of Pediatric Patient Safety (GAPPS) Tool

BACKGROUND AND OBJECTIVE

Efforts to advance patient safety have been hampered by the lack of high quality measures of adverse events (AEs). This study's objective was to develop and test the Global Assessment of Pediatric Patient Safety (GAPPS) trigger tool, which measures hospital-wide rates of AEs and preventable AEs.

METHODS

Through a literature review and expert panel process, we developed a draft trigger tool. Tool performance was tested in 16 academic and community hospitals across the United States. At each site, a primary reviewer (nurse) reviewed ∼240 randomly selected medical records; 10% of records underwent an additional primary review. Suspected AEs were subsequently evaluated by 2 secondary reviewers (physicians). Ten percent of records were also reviewed by external expert reviewers. Each trigger's incidence and positivity rates were assessed to refine GAPPS.

RESULTS

In total, 3814 medical records were reviewed. Primary reviewers agreed 92% of the time on presence or absence of a suspected AE (κ = 0.69). Secondary reviewers verifying AE presence or absence agreed 92% of the time (κ = 0.81). Using expert reviews as a standard for comparison, hospital-based primary reviewers had a sensitivity and specificity of 40% and 91%, respectively. As primary reviewers gained experience, their agreement with expert reviewers improved significantly. After removing low-yield triggers, 27 and 30 (of 54) triggers met inclusion criteria to form final manual and automated trigger lists, respectively.

CONCLUSIONS

GAPPS reliably identifies AEs and can be used to guide and monitor quality improvement efforts. Ongoing refinement may facilitate future interhospital comparisons.

Changes in Efficiency and Safety Culture After Integration of an I-PASS-Supported Handoff Process

BACKGROUND AND OBJECTIVES

Recent publications have shown improved outcomes associated with resident-to-resident handoff processes. However, the implementation of similar handoff processes for patients moving between units and teams with expansive responsibilities presents unique challenges. We sought to determine the impact of a multidisciplinary standardized handoff process on efficiency, safety culture, and satisfaction.

METHODS

A prospective improvement initiative to standardize handoffs during patient transitions from the cardiovascular ICU to the acute care unit was implemented in a university-affiliated children's hospital.

RESULTS

Time between verbal handoff and patient transfer decreased from baseline (397 ± 167 minutes) to the postintervention period (24 ± 21 minutes) (P < .01). Percentage positive scores for the handoff/transitions domain of a national culture of safety survey improved (39.8% vs 15.2% and 38.8% vs 19.6%; P = .005 and 0.03, respectively). Provider satisfaction improved related to the information conveyed (34% to 41%; P = .03), time to transfer (5% to 34%; P < .01), and overall experience (3% to 24%; P < .01). Family satisfaction improved for several questions, including: "satisfaction with the information conveyed" (42% to 70%; P = .02), "opportunities to ask questions" (46% to 74%; P < .01), and "Acute Care team's knowledgeabout my child's issues" (50% to 73%; P = .04). No differences in rates of readmission, rapid response team calls, or mortality were observed.

CONCLUSIONS

Implementation of a multidisciplinary I-PASS-supported handoff process for patients transferring from the cardiovascular ICU to the acute care unit resulted in improved transfer efficiency, safety culture scores, and satisfaction of providers and families.

Use of a Checklist and Clinical Decision Support Tool Reduces Laboratory Use and Improves Cost

OBJECTIVE

We hypothesized that a daily rounding checklist and a computerized order entry (CPOE) rule that limited the scheduling of complete blood cell counts and chemistry and coagulation panels to a 24-hour interval would reduce laboratory utilization and associated costs.

METHODS

We performed a retrospective analysis of these initiatives in a pediatric cardiovascular ICU (CVICU) that included all patients with congenital or acquired heart disease admitted to the cardiovascular ICU from September 1, 2008, until April 1, 2011. Our primary outcomes were the number of laboratory orders and cost of laboratory orders. Our secondary outcomes were mortality and CVICU and hospital length of stay.

RESULTS

We found a reduction in laboratory utilization frequency in the checklist intervention period and additional reduction in the CPOE intervention period [complete blood count: 31% and 44% (P < .0001); comprehensive chemistry panel: 48% and 72% (P < .0001); coagulation panel: 26% and 55% (P < .0001); point of care blood gas: 43% and 44% (P < .0001)] compared with the preintervention period. Projected yearly cost reduction was $717,538.8. There was no change in adjusted mortality rate (odds ratio 1.1, 95% confidence interval 0.7-1.9, P = .65). CVICU and total length of stay (days) was similar in the pre- and postintervention periods.

CONCLUSIONS

Use of a daily checklist and CPOE rule reduced laboratory resource utilization and cost without adversely affecting adjusted mortality or length of stay. CPOE has the potential to hardwire resource management interventions to augment and sustain the daily checklist.

Comparing NICU teamwork and safety climate across two commonly used survey instruments

Background and objectives

Measurement and our understanding of safety culture are still evolving. The objectives of this study were to assess variation in safety and teamwork climate and in the neonatal intensive care unit (NICU) setting, and compare measurement of safety culture scales using two different instruments (Safety Attitudes Questionnaire (SAQ) and Hospital Survey on Patient Safety Culture (HSOPSC)).

Methods

Cross-sectional survey study of a voluntary sample of 2073 (response rate 62.9%) health professionals in 44 NICUs. To compare survey instruments, we used Spearman's rank correlation coefficients. We also compared similar scales and items across the instruments using t tests and changes in quartile-level performance.

Results

We found significant variation across NICUs in safety and teamwork climate scales of SAQ and HSOPSC (p<0.001). Safety scales (safety climate and overall perception of safety) and teamwork scales (teamwork climate and teamwork within units) of the two instruments correlated strongly (safety r=0.72, p<0.001; teamwork r=0.67, p<0.001). However, the means and per cent agreements for all scale scores and even seemingly similar item scores were significantly different. In addition, comparisons of scale score quartiles between the two instruments revealed that half of the NICUs fell into different quartiles when translating between the instruments.

Conclusions

Large variation and opportunities for improvement in patient safety culture exist across NICUs. Important systematic differences exist between SAQ and HSOPSC such that these instruments should not be used interchangeably.

Exploring Value in Congenital Heart Disease: An Evaluation of Inpatient Admissions

OBJECTIVES

Understanding value provides an important context for improvement. However, most health care models fail to measure value. Our objective was to categorize inpatient encounters within an academic congenital heart program based on clinical outcome and the cost to achieve the outcome (value). We aimed to describe clinical and nonclinical features associated with value.

DESIGN

We defined hospital encounters based on outcome per resource utilized. We performed principal component and cluster analysis to classify encounters based on mortality, length of stay, hospital cost and revenue into six classes. We used nearest shrunken centroid to identify discriminant features associated with the cluster-derived classes. These features underwent hierarchical clustering and multivariate analysis to identify features associated with each class.

STUDY SETTING/PATIENTS

We analyzed all patients admitted to an academic congenital heart program between September 1, 2009, and December 31, 2012.

OUTCOME MEASURES/RESULTS

A total of 2658 encounters occurred during the study period. Six classes were categorized by value. Low-performing value classes were associated with greater institutional reward; however, encounters with higher-performing value were associated with a loss in profitability. Encounters that included insertion of a pediatric ventricular assist device (log OR 2.5 [95% CI, 1.78 to 3.43]) and acquisition of a hospital-acquired infection (log OR 1.42 [95% CI, 0.99 to 1.87]) were risk factors for inferior health care value.

CONCLUSIONS

Among the patients in our study, institutional reward was not associated with value. We describe a framework to target quality improvement and resource management efforts that can benefit patients, institutions, and payers alike.

A trigger tool to detect harm in pediatric inpatient settings

OBJECTIVES

An efficient and reliable process for measuring harm due to medical care is needed to advance pediatric patient safety. Several pediatric studies have assessed the use of trigger tools in varying inpatient environments. Using the Institute for Healthcare Improvement's adult-focused Global Trigger Tool as a model, we developed and pilot tested a trigger tool that would identify the most common causes of harm in pediatric inpatient environments.

METHODS

After formal training, 6 academic children's hospitals used this novel pediatric trigger tool to review 100 randomly selected inpatient records per site from patients discharged during the month of February 2012.

RESULTS

From the 600 patient charts evaluated, 240 harmful events ("harms") were identified, resulting in a rate of 40 harms per 100 patients admitted and 54.9 harms per 1000 patient days across the 6 hospitals. At least 1 harm was identified in 146 patients (24.3% of patients). Of the 240 total events, 108 (45.0%) were assessed to have been potentially or definitely preventable. The most common patient harms were intravenous catheter infiltrations/burns, respiratory distress, constipation, pain, and surgical complications.

CONCLUSIONS

Consistent with earlier rates of all-cause harm in adult hospitals, harm occurs at high rates in hospitalized children. Availability and use of an all-cause harm identification tool will establish the epidemiology of harm and will provide a consistent approach to assessing the effect of interventions on harms in hospitalized children.

Implementation methods for delivery room management: a quality improvement comparison study

BACKGROUND

There is little evidence to compare the effectiveness of large collaborative quality improvement versus individual local projects.

METHODS

This was a prospective pre-post intervention study of neonatal resuscitation practice, comparing 3 groups of nonrandomized hospitals in the California Perinatal Quality Care Collaborative: (1) collaborative, hospitals working together through face-to-face meetings, webcasts, electronic mailing list, and data sharing; (2) individual, hospitals working independently; and (3) nonparticipant hospitals. The collaborative and individual arms participated in improvement activities, focusing on reducing hypothermia and invasive ventilatory support.

RESULTS

There were 20 collaborative, 31 individual, and 44 nonparticipant hospitals caring for 12,528 eligible infants. Each group had reduced hypothermia from baseline to postintervention. The collaborative group had the most significant decrease in hypothermia, from 39% to 21%, compared with individual hospital efforts of 38% to 33%, and nonparticipants of 42% to 34%. After risk adjustment, the collaborative group had twice the magnitude of decrease in rates of newborns with hypothermia compared with the other groups. Collaborative improvement also led to greater decreases in delivery room intubation (53% to 40%) and surfactant administration (37% to 20%).

CONCLUSIONS

Collaborative efforts resulted in larger improvements in delivery room outcomes and processes than individual efforts or nonparticipation. These findings have implications for planning quality improvement projects for implementation of evidence-based practices.

Decreasing handoff-related care failures in children's hospitals

BACKGROUND AND OBJECTIVE

Patient handoffs in health care require transfer of information, responsibility, and authority between providers. Suboptimal patient handoffs pose a serious safety risk. Studies demonstrating the impact of improved patient handoffs on care failures are lacking. The primary objective of this study was to evaluate the effect of a multihospital collaborative designed to decrease handoff-related care failures.

METHODS

Twenty-three children's hospitals participated in a quality improvement collaborative aimed at reducing handoff-related care failures. The improvement was guided by evidence-based recommendations regarding handoff intent and content, standardized handoff tools/methods, and clear transition of responsibility. Hospitals tailored handoff elements to locally important handoff types. Handoff-related care failures were compared between baseline and 3 intervention periods. Secondary outcomes measured compliance to specific change package elements and balancing measure of staff satisfaction.

RESULTS

Twenty-three children's hospitals evaluated 7864 handoffs over the 12-month study period. Handoff-related care failures decreased from baseline (25.8%) to the final intervention period (7.9%) (P < .05). Significant improvement was observed in every handoff type studied. Compliance to change package elements improved (achieving a common understanding about the patient from 86% to 96% [P < .05]; clear transition of responsibility from 92% to 96% [P < .05]; and minimized interruptions and distractions from 84% to 90% [P < .05]) as did overall satisfaction with the handoff (from 55% to 70% [P < .05]).

CONCLUSIONS

Implementation of a standardized evidence-based handoff process across 23 children's hospitals resulted in a significant decrease in handoff-related care failures, observed over all handoff types. Compliance to critical components of the handoff process improved, as did provider satisfaction.

Exposure to Leadership WalkRounds in neonatal intensive care units is associated with a better patient safety culture and less caregiver burnout

BACKGROUND

Leadership WalkRounds (WR) are widely used in healthcare organisations to improve patient safety. The relationship between WR and caregiver assessments of patient safety culture, and healthcare worker burnout is unknown.

METHODS

This cross-sectional survey study evaluated the association between receiving feedback about actions taken as a result of WR and healthcare worker assessments of patient safety culture and burnout across 44 neonatal intensive care units (NICUs) actively participating in a structured delivery room management quality improvement initiative.

RESULTS

Of 3294 administered surveys, 2073 were returned for an overall response rate of 62.9%. More WR feedback was associated with better safety culture results and lower burnout rates in the NICUs. Participation in WR and receiving feedback about WR were less common in NICUs than in a benchmarking comparison of adult clinical areas.

CONCLUSIONS

WR are linked to patient safety and burnout. In NICUs, where they occurred more often, the workplace appears to be a better place to deliver and to receive care.

Burnout in the NICU setting and its relation to safety culture

BACKGROUND

Burnout is widespread among healthcare providers and is associated with adverse safety behaviours, operational and clinical outcomes. Little is known with regard to the explanatory links between burnout and these adverse outcomes.

OBJECTIVES

(1) Test the psychometric properties of a brief four-item burnout scale, (2) Provide neonatal intensive care unit (NICU) burnout and resilience benchmarking data across different units and caregiver types, (3) Examine the relationships between caregiver burnout and patient safety culture.

RESEARCH DESIGN

Cross-sectional survey study.

SUBJECTS

Nurses, nurse practitioners, respiratory care providers and physicians in 44 NICUs.

MEASURES

Caregiver assessments of burnout and safety culture.

RESULTS

Of 3294 administered surveys, 2073 were returned for an overall response rate of 62.9%. The percentage of respondents in each NICU reporting burnout ranged from 7.5% to 54.4% (mean=25.9%, SD=10.8). The four-item burnout scale was reliable (α=0.85) and appropriate for aggregation (intra-class correlation coefficient-2=0.95). Burnout varied significantly between NICUs, p<0.0001, but was less prevalent in physicians (mean=15.1%, SD=19.6) compared with non-physicians (mean=26.9%, SD=11.4, p=0.0004). NICUs with more burnout had lower teamwork climate (r=-0.48, p=0.001), safety climate (r=-0.40, p=0.01), job satisfaction (r=-0.64, p<0.0001), perceptions of management (r=-0.50, p=0.0006) and working conditions (r=-0.45, p=0.002).

CONCLUSIONS

NICU caregiver burnout appears to have 'climate-like' features, is prevalent, and associated with lower perceptions of patient safety culture.

Use of electronic medical record-enhanced checklist and electronic dashboard to decrease CLABSIs

OBJECTIVES

We hypothesized that a checklist enhanced by the electronic medical record and a unit-wide dashboard would improve compliance with an evidence-based, pediatric-specific catheter care bundle and decrease central line-associated bloodstream infections (CLABSI).

METHODS

We performed a cohort study with historical controls that included all patients with a central venous catheter in a 24-bed PICU in an academic children's hospital. Postintervention CLABSI rates, compliance with bundle elements, and staff perceptions of communication were evaluated and compared with preintervention data.

RESULTS

CLABSI rates decreased from 2.6 CLABSIs per 1000 line-days before intervention to 0.7 CLABSIs per 1000 line-days after intervention. Analysis of specific bundle elements demonstrated increased daily documentation of line necessity from 30% to 73% (P < .001), increased compliance with dressing changes from 87% to 90% (P = .003), increased compliance with cap changes from 87% to 93% (P < .001), increased compliance with port needle changes from 69% to 95% (P < .001), but decreased compliance with insertion bundle documentation from 67% to 62% (P = .001). Changes in the care plan were made during review of the electronic medical record checklist on 39% of patient rounds episodes.

CONCLUSIONS

Use of an electronic medical record-enhanced CLABSI prevention checklist coupled with a unit-wide real-time display of adherence was associated with increased compliance with evidence-based catheter care and sustained decrease in CLABSI rates. These data underscore the potential for computerized interventions to promote compliance with proven best practices and prevent patient harm.

Exemplar pediatric collaborative improvement networks: achieving results

A number of pediatric collaborative improvement networks have demonstrated improved care and outcomes for children. Regionally, Cincinnati Children's Hospital Medical Center Physician Hospital Organization has sustained key asthma processes, substantially increased the percentage of their asthma population receiving "perfect care," and implemented an innovative pay-for-performance program with a large commercial payor based on asthma performance measures. The California Perinatal Quality Care Collaborative uses its outcomes database to improve care for infants in California NICUs. It has achieved reductions in central line-associated blood stream infections (CLABSI), increased breast-milk feeding rates at hospital discharge, and is now working to improve delivery room management. Solutions for Patient Safety (SPS) has achieved significant improvements in adverse drug events and surgical site infections across all 8 Ohio children's hospitals, with 7700 fewer children harmed and >$11.8 million in avoided costs. SPS is now expanding nationally, aiming to eliminate all events of serious harm at children's hospitals. National collaborative networks include ImproveCareNow, which aims to improve care and outcomes for children with inflammatory bowel disease. Reliable adherence to Model Care Guidelines has produced improved remission rates without using new medications and a significant increase in the proportion of Crohn disease patients not taking prednisone. Data-driven collaboratives of the Children's Hospital Association Quality Transformation Network initially focused on CLABSI in PICUs. By September 2011, they had prevented an estimated 2964 CLABSI, saving 355 lives and $103,722,423. Subsequent improvement efforts include CLABSI reductions in additional settings and populations.

A clinical case of electronic health record drug alert fatigue: consequences for patient outcome

Despite advances in electronic medication order entry systems, it has been well established that clinicians override many drug allergy alerts generated by the electronic health record. The direct clinical consequences of overalerting clinicians in a pediatric setting have not been well demonstrated in the literature. We observed a patient in the PICU who experienced complications as a result of an extended series of non-evidence-based alerts in the electronic health record. Subsequently, evidence-based allergy alerting changes were made to the hospital's system. Incorporating clinical evidence in electronic drug allergy alerting systems remains challenging, especially in pediatric settings.

Using an Evidence-Based Approach to EMR Implementation to Optimize Outcomes and Avoid Unintended Consequences

Implementation of an electronic medical record (EMR) with computerized physician order entry (CPOE) can provide an important foundation for preventing harm and improving outcomes. Incentivized by the recent economic stimulus initiative, healthcare systems are implementing vendor-based EMR systems at an unprecedented rate. Accumulating evidence suggests that local implementation decisions, rather than the specific EMR product or technology selected, are the primary drivers of the quality improvement performance of these systems. However, limited attention has been paid to effective approaches to EMR implementation. In this case report, we outline the evidence-based approach we used to make EMR implementation decisions in a pragmatic structure intended for replication at other sites.

A quality improvement project to increase breast milk use in very low birth weight infants

OBJECTIVE

To evaluate a multihospital collaborative designed to increase breast milk feeding in premature infants.

METHODS

Eleven NICUs in the California Perinatal Quality of Care Collaborative participated in an Institute for Healthcare Improvement-style collaborative to increase NICU breast milk feeding rates. Multiple interventions were recommended with participating sites implementing a self-selected combination of these interventions. Breast milk feeding rates were compared between baseline (October 2008-September 2009), implementation (October 2009-September 2010), and sustainability periods (October 2010-March 2011). Secondary outcome measures included necrotizing enterocolitis (NEC) rates and lengths of stay. California Perinatal Quality of Care Collaborative hospitals not participating in the project served as a control population.

RESULTS

The breast milk feeding rate in the intervention sites improved from baseline (54.6%) to intervention period (61.7%; P = .005) with sustained improvement over 6 months postintervention (64.0%; P = .003). NEC rates decreased from baseline (7.0%) to intervention period (4.3%; P = .022) to sustainability period (2.4%; P < .0001). Length of stay increased during the intervention but returned to baseline levels in the sustainability period. Control hospitals had higher rates of breast milk feeding at baseline (64.2% control vs 54.6% participants, P < .0001), but over the course of the implementation (65.7% vs 61.7%, P = .049) and sustainability periods (67.7% vs 64.0%, P = .199), participants improved to similar rates as the control group.

CONCLUSIONS

Implementation of a breast milk/nutrition change package by an 11-site collaborative resulted in an increase in breast milk feeding and decrease in NEC that was sustained over an 18-month period.

Reducing mortality related to adverse events in children

Since the launch of the 100,000 Lives Campaign by the Institute for Healthcare Improvement (IHI), preventing medical adverse events to reduce avoidable mortality has emerged as a central focus for health care providers, institutions, regulators, insurance companies, and patients. Evidence-based interventions targeting the 6 interventions in the campaign have been associated with a reduction in preventable hospital deaths in the United States. The generalizability of the IHI's campaign to the pediatric population is only partly applicable. Pediatric experiences with rapid response teams and preventing central-line infections parallel the published experience of adults, with promise to significantly reduce preventable pediatric mortality.

Integrating the home management plan of care for children with asthma into an electronic medical record

BACKGROUND

Asthma exacerbation is one of the most common causes for pediatric hospitalization. One of the three Joint Commission quality measures--which has proven the most challenging--addresses the provision of a home management plan of care (HMPC) for discharge of pediatric inpatients with a primary diagnosis of asthma. A user-friendly electronic medical record (EMR)-generated HMPC was developed and implemented at Lucile Packard Children's Hospital (LPCH) Palo Alto, California, an HPMC needed to be completed before entry of an inpatient discharge order.

METHODS

A cohort study using historical controls was conducted in 2010-2011. Patients were eligible to receive an HMPC if they were between the ages of 2 and 17 years old at discharge, had a length of stay < 120 days, were not enrolled in clinical trials, and had the primary discharge diagnosis of asthma. These patients were identified by the EMR if this diagnosis was listed in the diagnosis list or problem list or if the asthma admit/discharge order set was initiated.

RESULTS

Compliance with the HMPC increased from 65.3% for the 39 months (April 1, 2007-June 30, 2010) before integration of the HMPC into EMR to 93.7% for the 18 months after integration (July 1, 2010, through December 31, 2011); p < .0001. Users of the EMR-integrated HMPC found it to be significantly easier to complete, less time-consuming, and less prone to potential errors or omission.

CONCLUSION

Lessons learned at LPCH included the need for a continuous surveillance and improvement model, which resulted in several iterations of the HMPC; the importance of soliciting user input, which resulted in improvements in work flow; and consistent support from the quality management and information technology departments, which are crucial to eliminating barriers and facilitating improvement.

Performance characteristics of a methodology to quantify adverse events over time in hospitalized patients

OBJECTIVE

To assess the performance characteristics of the Institute for Healthcare Improvement Global Trigger Tool (GTT) to determine its reliability for tracking local and national adverse event rates.

DATA SOURCES

Primary data from 2008 chart reviews.

STUDY DESIGN

A retrospective study in a stratified random sample of 10 North Carolina hospitals. Hospital-based (internal) and contract research organization-hired (external) reviewers used the GTT to identify adverse events in the same 10 randomly selected medical records per hospital in each quarter from January 2002 through December 2007.

DATA COLLECTION/EXTRACTION

Interrater and intrarater reliability was assessed using κ statistics on 10 percent and 5 percent, respectively, of selected medical records. Additionally, experienced GTT users reviewed 10 percent of records to calculate internal and external teams' sensitivity and specificity.

PRINCIPAL FINDINGS

Eighty-eight to 98 percent of the targeted 2,400 medical records were reviewed. The reliability of the GTT to detect the presence, number, and severity of adverse events varied from κ=0.40 to 0.60. When compared with a team of experienced reviewers, the internal teams' sensitivity (49 percent) and specificity (94 percent) exceeded the external teams' (34 and 93 percent), as did their performance on all other metrics.

CONCLUSIONS

The high specificity, moderate sensitivity, and favorable interrater and intrarater reliability of the GTT make it appropriate for tracking local and national adverse event rates. The strong performance of hospital-based reviewers supports their use in future studies.

Neonatal Informatics: Computerized Physician Order Entry

Computerized physician order entry (CPOE) is the feature of electronic medical record (EMR) implementation that arguably offers the greatest quality and patient safety benefits. The gains are potentially greater for critically ill neonates, but the effect of CPOE on quality and safety is dependent upon local implementation decisions. OBJECTIVES: After completing this article, readers should be able to: Define the basic aspects of CPOE and clinical decision support (CDS) systems.Describe the potential benefits of implementing CPOE associated with CDS in a neonatal intensive care unit (NICU).

Temporal trends in rates of patient harm resulting from medical care

BACKGROUND

In the 10 years since publication of the Institute of Medicine's report To Err Is Human, extensive efforts have been undertaken to improve patient safety. The success of these efforts remains unclear.

METHODS

We conducted a retrospective study of a stratified random sample of 10 hospitals in North Carolina. A total of 100 admissions per quarter from January 2002 through December 2007 were reviewed in random order by teams of nurse reviewers both within the hospitals (internal reviewers) and outside the hospitals (external reviewers) with the use of the Institute for Healthcare Improvement's Global Trigger Tool for Measuring Adverse Events. Suspected harms that were identified on initial review were evaluated by two independent physician reviewers. We evaluated changes in the rates of harm, using a random-effects Poisson regression model with adjustment for hospital-level clustering, demographic characteristics of patients, hospital service, and high-risk conditions.

RESULTS

Among 2341 admissions, internal reviewers identified 588 harms (25.1 harms per 100 admissions; 95% confidence interval [CI], 23.1 to 27.2) [corrected]. Multivariate analyses of harms identified by internal reviewers showed no significant changes in the overall rate of harms per 1000 patient-days (reduction factor, 0.99 per year; 95% CI, 0.94 to 1.04; P=0.61) or the rate of preventable harms. There was a reduction in preventable harms identified by external reviewers that did not reach statistical significance (reduction factor, 0.92; 95% CI, 0.85 to 1.00; P=0.06), with no significant change in the overall rate of harms (reduction factor, 0.98; 95% CI, 0.93 to 1.04; P=0.47).

CONCLUSIONS

In a study of 10 North Carolina hospitals, we found that harms remain common, with little evidence of widespread improvement. Further efforts are needed to translate effective safety interventions into routine practice and to monitor health care safety over time. (Funded by the Rx Foundation.).

Decrease in hospital-wide mortality rate after implementation of a commercially sold computerized physician order entry system

BACKGROUND

Implementations of computerized physician order entry (CPOE) systems have previously been associated with either an increase or no change in hospital-wide mortality rates of inpatients. Despite widespread enthusiasm for CPOE as a tool to help transform quality and patient safety, no published studies to date have associated CPOE implementation with significant reductions in hospital-wide mortality rates.

OBJECTIVE

The objective of this study was to determine the effect on the hospital-wide mortality rate after implementation of CPOE at an academic children's hospital.

PATIENTS AND METHODS

We performed a cohort study with historical controls at a 303-bed, freestanding, quaternary care academic children's hospital. All nonobstetric inpatients admitted between January 1, 2001, and April 30, 2009, were included. A total of 80,063 patient discharges were evaluated before the intervention (before November 1, 2007), and 17,432 patient discharges were evaluated after the intervention (on or after November 1, 2007). On November 4, 2007, the hospital implemented locally modified functionality within a commercially sold electronic medical record to support CPOE and electronic nursing documentation.

RESULTS

After CPOE implementation, the mean monthly adjusted mortality rate decreased by 20% (1.008-0.716 deaths per 100 discharges per month unadjusted [95% confidence interval: 0.8%-40%]; P = .03). With observed versus expected mortality-rate estimates, these data suggest that our CPOE implementation could have resulted in 36 fewer deaths over the 18-month postimplementation time frame.

CONCLUSION

Implementation of a locally modified, commercially sold CPOE system was associated with a statistically significant reduction in the hospital-wide mortality rate at a quaternary care academic children's hospital.

NICU practices and outcomes associated with 9 years of quality improvement collaboratives

OBJECTIVE

Quality improvement collaboratives (QICs) can improve short-term outcomes, but few have examined their long-term results. This study evaluated the changes in treatment practices and outcomes associated with participation in multiple sequential QICs.

DESIGN AND METHODS

This retrospective, 9-year, pre-post study of very low birth weight infants, we assessed treatment and outcomes from the 8 NICUs of the Reduce Lung Injury (ReLI) group of a QIC sponsored by the Vermont Oxford Network (VON). We analyzed data from 1998 (pre-ReLI), 2001 (last ReLI year), and 2006 (5 years after ReLI) by using univariate and multiple regression.

RESULTS

A total of 4065 very low birth weight infants were treated in ReLI NICUs in 1998, 2001, and 2006. From 1998 to 2006, the ReLI group decreased delivery room intubation (70% vs 52%; adjusted odds ratio [aOR]: 0.2 [95% confidence interval (CI): 0.2-0.3]; P < .001), conventional ventilation (75% vs 62%; aOR: 0.3 [95% CI: 0.2-0.4]; P < .001), and postnatal steroids for BPD (35% vs 10%; aOR: 0.09 [95% CI: 0.07-0.1]; P < .001). They increased the use of nasal continuous positive airway pressure (57% vs 78%; aOR: 3.3 [95% CI: 2.7-3.9]; P < .001). BPD-free survival remained unchanged (68% vs 66%; aOR: 0.9 [95% CI: 0.7-1.1]; P = .16), the BPD rate increased (25% vs 29%; aOR: 1.3 [95% CI: 1.1-1.6]; P = .017), survival to discharge increased (90% vs 93%; aOR: 1.5 [95% CI: 1.1-2.2]; P < .001), and nosocomial infections decreased (18% vs 15%; aOR: 0.8 [95% CI: 0.6-0.99]; P = .045).

CONCLUSIONS

Participation in VON-sponsored QICs was associated with sustained implementation of potentially better respiratory practices, increased survival, and reduced nosocomial infections. The BPD-free survival rate did not change, and the BPD rate increased. Implemented changes endured for at least 5 years after the QIC.