Statistical process control as a tool for research and healthcare improvement

Screening for Quality of Life in a Neurology Tic Clinic Using Quality Improvement Methodology

BACKGROUND

Tic disorders in children often co-occur with other disorders that can significantly impact functioning. Screening for quality of life (QoL) can help identify optimal treatment paths. This quality improvement (QI) study describes implementation of a QoL measure in a busy neurology clinic to help guide psychological intervention for patients with tics.

METHODS

Using QI methodology outlined by the Institute for Healthcare Improvement, this study implemented the PedsQL Generic Core (4.0) in an outpatient medical clinic specializing in the diagnosis and treatment of tic disorders. Assembling a research team to design process maps and key driver diagrams helped identify gaps in the screening process. Conducting several plan-do-study-act cycles refined identification of patients appropriate to receive the measure. Over the three-year study, electronic health record notification tools and data collection were increasingly utilized to capture patients' information during their visit.

RESULTS

Over 350 unique patients were screened during the assessment period. Electronic means replaced paper measures as time progressed. The percentage of patients completing the measure increased from 0% to 51.9% after the initial implementation of process improvement, advancing to 91.6% after the introduction of electronic measures. This average completion rate was sustained for 15 months.

CONCLUSIONS

Using QI methodology helped identify the pragmatics of implementing a QoL assessment to enhance screening practices in a busy medical clinic. Assessment review at the time of appointment helped inform treatment and referral decisions.

A Dedicated Outpatient Pharmacy Improves Access to Discharge Medications in a Pediatric Emergency Department: A Quality Improvement Study

STUDY OBJECTIVE

Following discharge from a pediatric emergency department (ED) or urgent care, many families do not pick up their prescribed medications. The aim of this quality improvement study was to increase the percentage of patients discharged home with medications in-hand from 6% to 30% within 6 months.

METHODS

Due to the planned construction of a new ED, urgent care, and dedicated pharmacy, a multidisciplinary team was formed to increase access to discharge medications. We performed a pilot study in the urgent care to improve the discharge prescription process and expanded its scope to the ED. We evaluated the effect of our interventions on the percentage of patients discharged with medications in-hand through statistical process control charts. Process measures included the percentage of prescriptions electronically prescribed and directed to an on-site pharmacy.

RESULTS

Between June 21, 2021 and March 27, 2022, 7,678 patients were discharged with at least 1 medication in-hand. The percentage of patients discharged with medications in-hand increased from 6.2% to 60.6%. The percentage of prescriptions e-prescribed and directed to an on-site pharmacy increased to 94.6% and 65.6% respectively.

CONCLUSIONS

In this study, the availability of a 24-hour on-site pharmacy appears to be the most impactful intervention increasing access to discharge medications for families. Other interventions, such as a pilot study in the urgent care and implementing default electronic prescribing, may have potentiated the effect of the new pharmacy.

A time-adjusted control chart for monitoring surgical outcome variations

BACKGROUND

Statistical Process Control (SPC) tools providing feedback to surgical teams can improve patient outcomes over time. However, the quality of routinely available hospital data used to build these tools does not permit full capture of the influence of patient case-mix. We aimed to demonstrate the value of considering time-related variables in addition to patient case-mix for detection of special cause variations when monitoring surgical outcomes with control charts.

METHODS

A retrospective analysis from the French nationwide hospital database of 151,588 patients aged 18 and older admitted for colorectal surgery between January 1st, 2014, and December 31st, 2018. GEE multilevel logistic regression models were fitted from the training dataset to predict surgical outcomes (in-patient mortality, intensive care stay and reoperation within 30-day of procedure) and applied on the testing dataset to build control charts. Surgical outcomes were adjusted on patient case-mix only for the classical chart, and additionally on secular (yearly) and seasonal (quarterly) trends for the enhanced control chart. The detection of special cause variations was compared between those charts using the Cohen's Kappa agreement statistic, as well as sensitivity and positive predictive value with the enhanced chart as the reference.

RESULTS

Within the 5-years monitoring period, 18.9% (28/148) of hospitals detected at least one special cause variation using the classical chart and 19.6% (29/148) using the enhanced chart. 59 special cause variations were detected overall, among which 19 (32.2%) discordances were observed between classical and enhanced charts. The observed Kappa agreement between those charts was 0.89 (95% Confidence Interval [95% CI], 0.78 to 1.00) for detecting mortality variations, 0.83 (95% CI, 0.70 to 0.96) for intensive care stay and 0.67 (95% CI, 0.46 to 0.87) for reoperation. Depending on surgical outcomes, the sensitivity of classical versus enhanced charts in detecting special causes variations ranged from 0.75 to 0.89 and the positive predictive value from 0.60 to 0.89.

CONCLUSION

Seasonal and secular trends can be controlled as potential confounders to improve signal detection in surgical outcomes monitoring over time.

Increasing Use of Rapid Magnetic Resonance Imaging for Children with Blunt Head Injury

OBJECTIVE

To increase the percentage of patients who undergo rapid magnetic resonance imaging (rMRI) rather than computed tomography (CT) for evaluation of mild traumatic brain injury (TBI) from 45% in 2020 to 80% by December 2021.

STUDY DESIGN

This was a quality improvement initiative targeted to patients presenting to the pediatric emergency department (ED) presenting with mild traumatic brain injury (TBI), with baseline data collected from January 2020 to December 2020. From January 2021 to August 2021 we implemented a series of improvement interventions and tracked the percentage of patients undergoing neuroimaging who received rMRI as their initial study. Balancing measures included proportion of all patients with mild TBI who underwent neuroimaging of any kind, proportion of patients requiring sedation, emergency department (ED) length of stay (LOS), and percentage with clinically important TBI.

RESULTS

The utilization of rMRI increased from a baseline of 45% to a mean of 92% in the intervention period. Overall neuroimaging rates did not change significantly after the intervention (19.8 vs 23.2%, p=0.24). There was no difference in need for anxiolysis (12 vs 7%, p=0.30) though ED LOS was marginally increased (1.4 vs 1.7 hours, p=<0.01).

CONCLUSION

In this quality improvement initiative, transition to rMRI as the primary imaging modality for the evaluation of minor TBI was achieved at a level 1 pediatric trauma center with no significant increase in overall use of neuroimaging.

Reducing IV Antibiotic Duration for Neonatal UTI Using a Clinical Standard Pathway

OBJECTIVES

Urinary tract infections (UTIs) are the most common bacterial infections in young infants and are traditionally treated with longer intravenous (IV) antibiotic courses. A growing body of evidence supports shorter IV antibiotic courses for young infants. Our primary aim was to decrease the IV antibiotic treatment to 3 days over 2 years for neonates aged 0 to 28 days who have been hospitalized with UTIs.

METHODS

Using quality improvement methods, our primary intervention was to implement a revised clinical pathway recommending 3 (previously 7) days of IV antibiotics. Our primary outcome measure was IV antibiotic duration, and the secondary outcomes were length of stay (LOS) and costs. The balancing measure was readmission within 30 days of discharge. Neonates were identified by using International Classification of Diseases diagnosis codes and excluded if they were admitted to the ICU or had a LOS >30 days. We used statistical process control to analyze outcome measures for 4 years before (baseline) and 2 years after the pathway revision (intervention) in February 2020.

RESULTS

A total of 93 neonates were hospitalized with UTIs in the baseline period and 41 were hospitalized in the intervention period. We found special cause variation, with a significant decrease in mean IV antibiotic duration from 4.7 (baseline) to 3.1 days (intervention) and a decrease in mean LOS from 5.4 to 3.6 days. Costs did not differ between the baseline and intervention periods. There were 7 readmissions during the baseline period, and 0 during the intervention period.

CONCLUSIONS

The implementation of a revised clinical pathway significantly reduced IV antibiotic treatment duration and hospital LOS for neonatal UTIs without an increase in hospital readmissions.

Postcardiac Arrest Care Delivery in Pediatric Intensive Care Units: A Plan and Call to Action

Background

Despite national pediatric postcardiac arrest care (PCAC) guidelines to improve neurological outcomes and survival, there are limited studies describing PCAC delivery in pediatric institutions. This study aimed to describe PCAC delivery in centers belonging to a resuscitation quality collaborative.

Methods

An institutional review board-approved REDCap survey was distributed electronically to the lead resuscitation investigator at each institution in the international Pediatric Resuscitation Quality Improvement Collaborative. Data were summarized using descriptive statistics. A chi-square test was used to compare categorical data.

Results

Twenty-four of 47 centers (51%) completed the survey. Most respondents (58%) belonged to large centers (>1,000 annual pediatric intensive care unit admissions). Sixty-seven percent of centers reported no specific process to initiate PCAC with the other third employing order sets, paper forms, or institutional guidelines. Common PCAC targets included temperature (96%), age-based blood pressure (88%), and glucose (75%). Most PCAC included electroencephalogram (75%), but neuroimaging was only included at 46% of centers. Duration of PCAC was either tailored to clinical improvement and neurological examination (54%) or time-based (45%). Only 25% of centers reported having a mechanism for evaluating PCAC adherence. Common barriers to effective PCAC implementation included lack of time and limited training opportunities.

Conclusions

There is wide variation in PCAC delivery among surveyed pediatric institutions despite national guidelines to standardize and implement PCAC.

General Surgery Resuscitation Preference Documentation: A Quality Improvement Initiative

BACKGROUND/PURPOSE

Documentation of resuscitation preferences is crucial for patients undergoing surgery. Unfortunately, this remains an area for improvement at many institutions. We conducted a quality improvement initiative to enhance documentation percentages by integrating perioperative resuscitation checks into the surgical workflow. Specifically, we aimed to increase the percentage of general surgery patients with documented resuscitation statuses from 82% to 90% within a 1-year period.

METHODS

Three key change ideas were developed. First, surgical consent forms were modified to include the patient's resuscitation status. Second, the resuscitation status was added to the routinely used perioperative surgical checklist. Finally, patient resources on resuscitation processes and options were updated with support from patient partners. An audit survey was distributed mid-way through the interventions to evaluate process measures.

RESULTS

The initiatives were successful in reaching our study aim of 90% documentation rate for all general surgery patients. The audit revealed a high uptake of the new consent forms, moderate use of the surgical checklist, and only a few patients for whom additional resuscitation details were added to their clinical note.

CONCLUSIONS

We successfully increased the documentation percentage of resuscitation statuses within our large tertiary care center by incorporating checks into routine forms to prompt the conversation with patients early.

Improving Guideline-Concordant Care for Febrile Infants Through a Quality Improvement Initiative

OBJECTIVES

We aimed to examine the impact of a quality improvement (QI) collaborative on adherence to specific recommendations within the American Academy of Pediatrics' Clinical Practice Guideline (CPG) for well-appearing febrile infants aged 8 to 60 days.

METHODS

Concurrent with CPG release in August 2021, we initiated a QI collaborative involving 103 general and children's hospitals across the United States and Canada. We developed a multifaceted intervention bundle to improve adherence to CPG recommendations for 4 primary measures and 4 secondary measures, while tracking 5 balancing measures. Primary measures focused on guideline recommendations where deimplementation strategies were indicated. We analyzed data using statistical process control (SPC) with baseline and project enrollment from November 2020 to October 2021 and the intervention from November 2021 to October 2022.

RESULTS

Within the final analysis, there were 17 708 infants included. SPC demonstrated improvement across primary and secondary measures. Specifically, the primary measures of appropriately not obtaining cerebrospinal fluid in qualifying infants and appropriately not administering antibiotics had the highest adherence at the end of the collaborative (92.4% and 90.0% respectively). Secondary measures on parent engagement for emergency department discharge of infants 22 to 28 days and oral antibiotics for infants 29 to 60 days with positive urinalyses demonstrated the greatest changes with collaborative-wide improvements of 16.0% and 20.4% respectively. Balancing measures showed no change in missed invasive bacterial infections.

CONCLUSIONS

A QI collaborative with a multifaceted intervention bundle was associated with improvements in adherence to several recommendations from the AAP CPG for febrile infants.

Improving Identification of Firearm Access in Children With Mental Health Complaints

OBJECTIVE

To determine if electronic medical record (EMR) changes and implementation of a study on firearm storage practices changed identification of firearm exposure in children presenting to a pediatric emergency department (PED) with mental health complaints. We also sought to determine the accuracy of information collected on firearm storage practices.

METHODS

Retrospective study of EMR documentation of firearm exposure in PED patients with mental health complaints from January 20, 2015 until November 20, 2017. EMR changes occurred on January 20, 2016 and the firearms study began on February 13, 2016. The primary outcome was documentation of firearm exposure. Secondary outcomes were documentation of unsafe firearm storage practices. We also examined differences between clinical and research documentation of unsafe firearm storage practices post-intervention. We compared groups using descriptive statistics and chi-squared tests. We used statistical process control to examine the relationship between interventions and changes in outcomes.

RESULTS

5582 encounters were examined. Identification of firearm exposure increased from 11 to 17% postintervention. Identification of unsafe storage practices increased from 1.9% to 4.4% across all encounters. Special cause variation in both metrics occurred concurrently with the interventions. Postintervention, unsafe firearms storage practices in firearm owning families were under-identified (39% identified as not triple-safe in clinical data vs 75% in research data).

CONCLUSIONS

EMR changes and implementation of a firearms study improved identification of firearm exposure and unsafe storage practices in families of PED patients being evaluated for mental health complaints. However, unsafe storage practices continued to be under-identified in firearm-owning families.

An Improvement Project in Reducing After-Visit Phone Calls in a Community Pediatric Neurology Clinic: Too Much Communication?

Background and Objective

Physicians strive to provide high-quality clinical care, yet after-visit patient telephone calls create extra demands on a clinician's time. Pediatric neurologists are particularly affected by this challenge given the number of patients with chronic illnesses they serve and the volume of worried parents they support. Added workload coupled with a busy office practice increases the likelihood of early physician burnout, which can have downstream effects on the quality of patient care and patient satisfaction. Using the IHI model for quality improvement (abbreviated QI moving forward), QI methodology was used to determine volume and key drivers of patient/family communications after a visit to a pediatric neurology clinic. Interventions aimed at reducing telephone messages by 15% over a 6-month period were put into place.

Methods

A baseline audit of clinic phone calls was completed in 2019 to develop an overview of after-visit communications. After-visit telephone calls and web-based portal messages were then tracked for 3-week periods in 2019, 2020, and 2021 to understand key trends. A key driver diagram of patient/family communications after a clinic visit was created, and interventions aimed at reducing telephone messages were discussed. These interventions included optimizing MD-RN workflows, synchronous and asynchronous educational initiatives, and changes to our clinic's voicemail phone tree. Our primary outcome measure was the average monthly telephone call volume, and this measure was tracked monthly from November 2020 through December 2022. Similarly, electronic portal message volume was tracked and served as our balancing measure.

Results

Physicians, nurses, and patients were primary drivers of phone call volume. After interventions were in place, the average monthly call volume decreased by 30% from a baseline of 293 calls to 203 calls. This change was sustained for at least 1 year. The average monthly portal message volume remained consistent throughout the study period at 359 messages.

Discussion

Both physicians and nurses agree that after-visit patient communication affects their workload. This study illustrates that QI methodology can be used to plan and implement interventions aimed at decreasing after-visit telephone calls.

Reducing intravenous antibiotics in neonates born ≥35 weeks' gestation: A quality improvement study

AIM

To assess the impact of the Early Onset Sepsis (EOS) calculator, implemented as a quality improvement study, to reduce the rate of unnecessary antibiotics in neonates born ≥35 weeks' gestation.

METHODS

An audit of routinely collected hospital data from January 2008 to March 2014 (retrospective) and from January 2018 to September 2019 (prospective) determined baseline incidence of EOS intravenous antibiotic use in neonates born ≥35 weeks' gestation in a tertiary level perinatal centre. Plan-do-study-act (PDSA) cycles were applied to implement the EOS calculator. Statistical process control methodology and time series analysis assessments were used to assess the potential impact of the PDSA cycles on the rate of intravenous antibiotics, blood culture collection, EOS, length of stay and health care costs (not adjusted for potential confounders).

RESULTS

In the study population, from January 2008 to March 2014, the baseline incidence of intravenous antibiotic use was 10.49% (2970/28290), whilst only 0.067% (19/28290) neonates had culture proven EOS. From January 2018 to October 2019, prior to implementation of the EOS calculator, 13.3% (1119/8411) neonates were treated with intravenous antibiotic and the use decreased to 8.3% (61/734) post-implementation. The rate of blood culture collection decreased from 14.4% (1211/8411) to 11.9% (87/734). There were no cases of missed EOS. Length of stay decreased from 2.68 to 2.39 days, with an estimated cost saving of $366 per patient per admission.

CONCLUSION

Implementing the EOS calculator in a tertiary hospital setting reduced invasive investigations for EOS and intravenous antibiotic use among neonates ≥35 weeks' gestation. This can result in reduced length of neonatal hospital stays, and associated health care cost savings and may reduce separation of mother and baby.

Use of urine neutrophil gelatinase-associated lipocalin for nephrotoxic medication acute kidney injury screening in neonates

BACKGROUND

Daily serum creatinine monitoring protocols for acute kidney injury (AKI) are invasive and may lead to surveillance resistance. We aimed to understand if use of urine neutrophil gelatinase-associated lipocalin (uNGAL) could increase high-risk nephrotoxic medication (NTMx) associated AKI screening adherence in neonates.

METHODS

Statistical process control methods prior to and post implementation were trended. The primary outcome, screening adherence, was defined as either daily serum creatinine or uNGAL assessment through 2 days post high-risk NTMx exposure.

RESULTS

1291 monitoring days from the pre-implementation era (4/2020-6/2021) were compared to1377 monitoring days from the post-era (6/2021-10/2022). AKI screening adherence increased (81 to 92%) following implementation of optional uNGAL screening. Urine NGAL accounted for 35% of screening obtained. Use of uNGAL resulted in a 40% reduction in blood sampling for serum creatinine.

CONCLUSIONS

Incorporation of uNGAL as a complementary screening tool to serum creatinine demonstrated sustained increased AKI surveillance in our Baby NINJA monitoring program.

Impact of a relocation to a new critical care building on pediatric safety events

BACKGROUND

Cincinnati Children's Hospital Medical Center (CCHMC) relocated the pediatric, cardiac, and neonatal intensive care units (PICU, CICU and NICU) to a newly constructed critical care building (CCB) in November 2021. Simulation and onboarding sessions were implemented before the relocation, aimed at mitigating latent safety threats.

OBJECTIVE

To evaluate the impact of ICU relocation to the CCHMC CCB on patient safety as measured by the quantity, rate, severity score, and category of safety reports.

METHODS

This retrospective, cross-sectional, observational study compared safety reports filed in a 90-day period before and following the CCB relocation. The primary outcome was pre- and postrelocation safety report rates per 100 patient-days. Secondary outcomes included safety report severity, category, and rate of hospital acquired conditions (HACs).

RESULTS

Total safety report incidence increased by 16% across all ICUs postrelocation with no difference in post- versus prerelocation odds ratio between ICUs. Three isolated instances of special cause variation were found, one in NICU and two in CICU. No special cause variation was found in the PICU. There were no statistical differences in assigned safety report severity pre- to postrelocation for all ICUs, and only lab specimen/test related safety reports showed a statistically significant increase postrelocation. Overall rates of HACs were low, with six occurring prerelocation and eight postrelocation.

CONCLUSIONS

All three ICUs were relocated to the new CCB with minimal changes in the incidence, severity, or category of safety reports filed, suggesting staff training and preparations ahead of the relocation mitigated latent safety threats.

Human Papillomavirus Vaccine Completion by 13: A Quality Improvement Initiative in a Large Primary Care Network

OBJECTIVE

Fewer than 40% of U.S. children complete the human papillomavirus (HPV) vaccine series before their 13th birthday. In our large pediatric primary care network, HPV vaccine completion rate by age 13 was 30%. We hypothesized that a phased quality improvement (QI) initiative would increase rates of HPV vaccine completion by age 13 across our network.

METHODS

This QI initiative was conducted in a network of 30 practices located across two states, in urban and suburban settings, consisting of teaching and non-teaching clinics, and ranging in size from three to 50 providers per office. We used a phased approach incorporating multicomponent network-wide and iterative practice-specific interventions. Key interventions included: updating clinical decision support to default order HPV vaccine due at preventive visits starting at age nine instead of 11, data audit and feedback to providers and practices, encouraging use of a strong provider recommendation, and standing orders.

RESULTS

From April 2019 to October 2022, HPV vaccine completion by age 13 across our network increased from 30% to 55% and met criteria for special cause variation on statistical process control charts. A gap in median HPV vaccine completion by age 13 between patients with public insurance and patients with private or commercial insurance decreased from 9% to 1%.

CONCLUSION

A QI initiative was associated with a sustained increase in HPV vaccine series completion by age 13 and reduced variation in care across a large network of 30 primary care practices.

Implementation of a comprehensive clinical risk management system in a university hospital

BACKGROUND

Adverse events during hospital treatment are common and can lead to serious harm. This study reports the implementation of a comprehensive clinical risk management system in a university hospital and assesses the impact of clinical risk management on patient harms.

METHODS

The clinical risk management system was rolled out over a period of eight years and consisted of a training of interdisciplinary risk management teams, external and internal risk audits, and the implementation of a critical incident reporting system (CIRS). The risks identified during the audits were analyzed according to the type, severity, and implementation of preventive measures. Other key figures of the risk management system were obtained from the annual risk reports. The number of liability cases was used as primary outcome measurement.

RESULTS

Of the 1,104 risks identified during the risk audits, 56.2% were related to organization, 21.3% to documentation, 15.3% to treatment, and 7.2% to patient information and consent. The highest proportion of serious risks was found in the category organization (22.7%), the lowest in the category documentation (13.6%). Critical incident reporting identified between 241 and 370 critical incidents per year, for which in 79.5% to 83% preventive measures were implemented within twelve months. The frequency of incident reports per department correlated with the number of active risk managers and risk team meetings. Compared with the years prior to the introduction of the clinical risk management system, an average annual reduction of harms by 60.1% (95% CI: 57.1; 63.1) was observed two years after the implementation was completed. On average, the rate of harms dropped by 5% per year for each 10% increase in roll-out of the clinical risk management system (incidence rate ratio: 0.95; 95% CI: 0.93; 0.97) .

CONCLUSION

The results of this project demonstrate the effectiveness of clinical risk management in detecting treatment-related risks and in reducing harm to patients.

Prospective Evaluation of the Clinical Benefits of a Novel Tattoo-less Workflow for Nonspine Bone Stereotactic Body Radiation Therapy: Integrating Surface-Guidance With Triggered Imaging Reduces Treatment Time and Eliminates the Need for Tattoos

PURPOSE

Oligometastatic disease has expanded the indications for nonspine bone stereotactic body radiation therapy (NSB SBRT). We investigated whether optical surface monitoring systems (OSMS) could enable tattoo-less setup and substitute for 2-dimensional/3-dimensional or cone beam computed tomography (CBCT)-based mid-imaging in NSB SBRT.

METHODS AND MATERIALS

OSMS was incorporated in parallel with an existing workflow using pretreatment CBCT and 2-dimensional/3-dimensional kV/kV mid-imaging beginning November 2019. The ability of OSMS to detect out-of-tolerance (>2 mm/>2°) and commanded couch shifts was analyzed. A workflow incorporating OSMS reference captures, CBCT for pretreatment verification, and OSMS/triggered imaging (TI) for intrafraction monitoring was developed for rib/sternum SBRT beginning November 2021 and all NSB SBRT beginning February 2022. Treatment time and CBCT-related radiation dose between the OSMS and the non-OSMS intrafraction monitoring group was analyzed pre- and post-OSMS/TI workflow adoption. All fractions were analyzed through statistical process control with use of an XmR chart of treatment time per quarter from February 2019 to February 2023. Special cause rules were based on Institute for Healthcare Improvement criteria.

RESULTS

From February 2019 to February 2023, 1993 NSB SBRT fractions were delivered, including 234 rib, 109 sternum, 214 ilium, and 682 multisite. Over 20 commanded shifts, OSMS could detect 2-mm shifts to within 0.4 mm 67% of the time and 0.8 mm 95% of the time. All NSB SBRT sites showed significant reductions in treatment time, including the greatest improvement in rib total treatment (21.6-13.4 minutes; P = 1.16 × 10-17) and beam time (7.9-3.2 minutes; P = 7.32 × 10-27). Significant reductions in CBCT-related radiation were also observed for several NSB sites. These process improvements were associated with OSMS adoption.

CONCLUSIONS

Adoption of a novel NSB SBRT workflow incorporating OSMS/TI for bone intrafraction motion monitoring reduced treatment time and CBCT-related radiation exposure while also allowing for more continuous intrafraction motion monitoring for NSB SBRT. OSMS/TI enabled the transition to a tattoo-less workflow.

Reducing Osteopenia of Prematurity-related Fractures in a Level IV NICU: A Quality Improvement Initiative

Background

Osteopenia of prematurity (OOP) is often a silent disease in the neonatal intensive care unit (NICU). Despite its association with increased neonatal morbidity, such as fractures, wide variation exists in screening, diagnostic, and management practices. We sought to decrease the rate of OOP-related fractures in our level IV NICU by 20% within 1 year.

Methods

A multidisciplinary quality improvement team identified inconsistent screening, diagnosis, and management of OOP, as well as handling of at-risk patients, as primary drivers for OOP-related fractures. Using the model for improvement, we implemented sequential interventions, including screening, diagnosis, and a management algorithm as a "handle-with-care" bundle in infants at risk for fractures.

Results

194 at-risk infants were included, 59 of whom had OOP. There was special cause variation in OOP-related fractures, with a reduction from 0.43 per 1000 patient days to 0.06 per 1000 patient days with our interventions. There was also an improvement in days between fractures from 62 to 337 days. We achieved these improvements despite a similar prevalence of OOP throughout the initiative. We showed special cause variation with increased patients between missed OOP documentation and improved collection of OOP screening laboratories at 4 weeks of life without increased blood testing.

Conclusion

A multidisciplinary team approach with standardized OOP screening, diagnosis, and management guidelines, including a handle-with-care bundle, reduces OOP-related fractures in a level IV NICU.

Successful de-implementation of an ineffective practice: The fall of docusate

BACKGROUND

Reducing wasteful practices optimizes value in medicine. Docusate lacks treatment efficacy yet is widely prescribed. This quality improvement project aimed to de-implement docusate in place of a new evidence-based order set.

METHODS

This is an ambidirectional study of inpatient laxative orders from 2018 to 2022 ​at one institution. We stratified docusate data by service/unit to target prospective deimplementation initiatives. A new evidence-based constipation order set was embedded in Cerner.

RESULTS

There were 701,732 docusate orders across 75 services on 68 units. Top docusate ordering services were Trauma, Obstetrics and Hospitalist. Docusate administration rates were higher than for other laxatives. Our efforts reduced docusate orders by 44% over 4 months. PEG and senna orders increased by 58% and 35%.

CONCLUSION

Docusate has no efficacy yet is widely prescribed. A structured de-implementation strategy can drive systematic change by leveraging technology and applying multidisciplinary improvement efforts. Our work removed docusate from the inpatient formulary.

A Quality Improvement Initiative to Increase Documentation of Preferences for Life-Sustaining Treatment in Hospitalized Adults

BACKGROUND

Portable Orders for Life-Sustaining Treatment (POLST) forms allow patients to codify their preferences for life-sustaining treatments across inpatient and outpatient settings. In 2019 only 29.5% of our hospitalized internal medicine patients with an inpatient do-not-resuscitate (DNR) order and no DNR POLST at admission discharged with a DNR POLST. This presented an opportunity to improve POLST completion and avoid undesired or inappropriate care after discharge.

METHODS

Using electronic health record (EHR) data, the authors identified hospitalized adults (age ≥ 50 years) admitted to an internal medicine service with a DNR order and discharged alive. Patient records were cross-referenced with the state's POLST registry for an active POLST form. Among patients with a missing or full-code POLST form at admission, the authors calculated the proportion with a DNR POLST form completed by discharge. These data were tracked over time with control charts to detect performance shifts following three Plan-Do-Study-Act (PDSA) cycles over 34 months, which included a single educational training on electronic POLST navigation, an EHR discharge navigator notification, and quarterly e-mailed individualized performance reports.

RESULTS

The study population (N = 387) was 55.0% male and predominately non-Hispanic white (80.9%). Patients discharging to a skilled nursing facility or hospice were three times more likely to discharge with a DNR POLST compared to patients discharging home. Overall, the proportion of DNR POLST forms completed by discharge increased from 0.36 to 0.60 after three PDSA cycles (p < 0.001).

CONCLUSION

This quality improvement initiative demonstrated improved POLST form completion rates in a target population of adults at elevated risk for readmission and death.

Implementing American Academy of Neurology Quality Measures in Antigua Using Quality Improvement Methodology

Background and Objectives

The American Academy of Neurology has developed quality measures related to various neurologic disorders. A gap exists in the implementation of these measures in the different health care systems. To date, there has been no electronic health care record nor implementation of quality measures in Antigua. Therefore, we aimed to increase the percent of patients who have epilepsy quality measures documented using standardized common data elements in the outpatient neurology clinic at Sir Lester Bird Medical Center from 0% to 80% per week by June 1, 2022 and sustain for 6 months.

Methods

We used the Institute for Health care Improvement Model for Improvement methodology. A data use agreement was implemented. Data were displayed using statistical process control charts and the American Society for Quality criteria to determine statistical significance and centerline shifts.

Results

Current and future state process maps were developed to determine areas of opportunity for interventions. Interventions were developed following a "Plan-Do-Study-Act cycle." One intervention was the creation of a RedCap survey and database to be used by health care providers during clinical patient encounters. Because of multiple interventions, we achieved a 100% utilization of the survey for clinical care.

Discussion

Quality improvement (QI) methodology can be used for implementation of quality measures in various settings to improve patient care outcomes without use of significant resources. Implementation of quality measures can increase efficiency in clinical delivery. Similar QI methodology could be implemented in other resource-limited countries of the Caribbean and globally.

Healthcare-associated respiratory viral infections after discontinuing universal masking

In November 2022, our pediatric hospital replaced the requirement for universal masking of all healthcare personnel and visitors in all clinical buildings with a requirement for masking only during patient encounters. Following this change, we observed an immediate, substantial, and sustained increase in healthcare-associated respiratory viral infections.

Use of statistical process control in quality improvement projects in abdominal surgery: a PRISMA systematic review

BACKGROUND

The use of quality improvement methodology has increased in recent years due to a perceived benefit in effectively reducing morbidity, mortality and length of stay. Statistical process control (SPC) is an important tool to evaluate these actions, but its use has been limited in abdominal surgery. Previous systematic reviews have examined the use of SPC in healthcare, but relatively few surgery-related articles were found at that time.

OBJECTIVE

To perform a systematic review (SR) to evaluate the application of SPC on abdominal surgery specialties between 2004 and 2019.

METHODS

An SR following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses flow diagram was completed using Embase and Ovid Medline with terms related to abdominal surgery and SPC.

RESULTS

A total of 20 articles were selected after applying the exclusion criteria. Most of the articles came from North America, Europe and Australia, and half have been published in the last 5 years. The most common outcome studied was surgical complications. Urology, colorectal and paediatric surgery made up most of the articles. Articles show the application of SPC in various outcomes and the use of different types of graphs, demonstrating flexibility in using SPC. However, some studies did not use SPC in a robust way and these studies were of variable quality.

CONCLUSION

This study shows that SPCs are being applied increasingly for most surgical specialties; however, it is still less used than in other fields, such as anaesthesia. We identified conceptual errors in several studies, such as issues with the design or incorrect data analysis. SPCs can be used to increase the quality of surgical care; the use should increase, but critically, the analysis needs to improve to prevent erroneous conclusions being drawn.

Implementing a comprehensive STEMI protocol to improve care metrics and outcomes in patients with in-hospital STEMI: an observational cohort study

BACKGROUND

Patients who experience in-hospital ST-segment elevation myocardial infarction (iSTEMI) represent a uniquely high-risk cohort owing to delays in diagnosis, prolonged time to reperfusion and increased mortality. Quality initiatives aimed at improving the care of this vulnerable, yet understudied population are needed.

METHODS

This study included consecutive patients with iSTEMI treated with percutaneous coronary intervention (PCI) between 1 January 2011 and 15 July 2019 at a single, tertiary referral centre. A comprehensive iSTEMI protocol (CSP) was implemented on 15 July 2014, incorporating: (1) cardiology fellow activation of the catheterisation lab using standardised criteria, (2) nursing chest pain protocol, (3) improved electronic access to electrocardiographic studies, (4) checklist for initial triage and management, (5) 24/7/365 catheterisation lab readiness and (6) radial-first PCI approach. Key metrics and clinical outcomes were compared before and after CSP implementation.

RESULTS

Among 125 total subjects, the post-CSP cohort (n=81) was younger, had more males and were more likely to be hospitalised for cardiac-related reasons relative to the pre-CSP cohort (n=44) who were more likely hospitalised for operative-related aetiologies. After CSP adoption, median ECG-to-first-device-activation time decreased from 113 min to 64 min (p<0.001), goal ECG-to-first-device-activation time increased from 36% to 76% of patients (p<0.001), administration of guideline-directed medical therapy prior to PCI increased from 27.3% to 65.4% (p<0.001), trans-radial access increased from 16% to 70% (p<0.001) and rates of discharge home increased from 56.8% to 76.5% (p=0.04). Statistically insignificant numerical reductions were observed post-CSP in in-hospital mortality (18.2% vs 9.9%, p=0.30), 30-day mortality (15.9% vs 12.3%, p=0.78) and 1-year mortality (27.3% vs 21.0%, p=0.57).

CONCLUSIONS

The implementation of a CSP was associated with marked enhancements in key care metrics among patients with iSTEMI. Among a larger cohort, the use of a CSP yielded a significant reduction in ECG-to-first-device-activation time in a particularly vulnerable population at high risk of death.

Detecting atypical alert behavior through statistical process control: Clinical decision support alert frequency visualizations

Clinical decision support (CDS) alerts are designed to work according to a set of clearly defined criteria and have the potential to improve clinical care. To efficiently and proactively review abnormally functioning CDS alerts, we postulate that the introduction of a dashboard with statistical process control (SPC) charting will lead to effective detection of erratic alert behavior. We identified custom CDS alerts from an academic medical center that were recorded and monitored in a longitudinal fashion and the data warehouses where this information was stored. We created a dashboard of alert frequency using SPC charts, applied SPC rules for classification of variation, and validated dashboard data. From June-August 2022, the dashboard effectively pulled in data to visually depict alert behavior. SPC-defined parameters for standard deviation from the mean were applied to visualizations and allowed for rapid review of alerts with greatest variation. These alerts were subsequently investigated, and it was determined that they were functioning correctly. The most profound abnormalities detected during implementation reflected changes in practice and not system errors, though further investigation into thresholds for statistical significance will benefit this field. We conclude that SPC visualizations are a time-efficient and effective method of identifying CDS malfunctions.

Using Clinical Decision Support Systems to Decrease Intravenous Acetaminophen Use: Implementation and Lessons Learned

BACKGROUND

Clinical decision support systems (CDSS) can enhance medical decision-making by providing targeted information to providers. While they have the potential to improve quality of care and reduce costs, they are not universally effective and can lead to unintended harm.

OBJECTIVES

To describe the implementation of an unsuccessful interruptive CDSS that aimed to promote appropriate use of intravenous (IV) acetaminophen at an academic pediatric hospital, with an emphasis on lessons learned.

METHODS

Quality improvement methodology was used to study the effect of an interruptive CDSS, which set a mandatory expiry time of 24 hours for all IV acetaminophen orders. This CDSS was implemented on April 5, 2021. The primary outcome measure was number of IV acetaminophen administrations per 1,000 patient days, measured pre- and postimplementation. Process measures were the number of IV acetaminophen orders placed per 1,000 patient days. Balancing measures were collected via survey data and included provider and nursing acceptability and unintended consequences of the CDSS.

RESULTS

There was no special cause variation in hospital-wide IV acetaminophen administrations and orders after CDSS implementation, nor when the CDSS was removed. A total of 88 participants completed the survey. Nearly half (40/88) of respondents reported negative issues with the CDSS, with the majority stating that this affected patient care (39/40). Respondents cited delays in patient care and reduced efficiency as the most common negative effects.

CONCLUSION

This study underscores the significance of monitoring CDSS implementations and including end user acceptability as an outcome measure. Teams should be prepared to modify or remove CDSS that do not achieve their intended goal or are associated with low end user acceptability. CDSS holds promise for improving clinical practice, but careful implementation and ongoing evaluation are crucial for maximizing their benefits and minimizing potential harm.

Imaging Stewardship: Triage for Neuroradiology MR During Limited-Resource Hours

OBJECTIVES

To decrease call burden on pediatric neuroradiologists, we developed guidelines for appropriate use of MR overnight. These guidelines were implemented using triage by in-house generalist pediatric radiologists. Process measures and balancing measures were assessed during implementation.

METHODS

For this improvement project, interdepartmental consensus guidelines were developed using exploratory mixed-methods design. Implementation of triage used plan-do-study-act cycles. Process measures included reduction in the number of telephone calls, frequency of calls, triage decisions, and number and type of examinations ordered. Balancing measures included burden of time and effort to the generalist radiologists. Differences in examination orders between implementation intervals was assessed using Kruskal-Wallis, with significance at P < .05.

RESULTS

Consensus defined MR requests as "do," "defer," or "divert" (to CT). Guidelines decreased neuroradiologist calls 74% while adding minimal burden to the generalist radiologists. Most nights had zero or one triage request and the most common triage decision was "do," and the most common examination was routine brain MR. Number of MR ordered and completed overnight did not significantly change with triage.

DISCUSSION

Multidisciplinary consensus for use of pediatric neurological MR during limited resource hours overnight is an example of imaging stewardship that decreased the burden of calls and burnout for neuroradiologists while maintaining a comparable level of service to the ordering clinicians.

Initiative to increase family presence and participation in daily rounds on a paediatric acute care cardiology unit

INTRODUCTION

Family-centred rounds benefit families and clinicians and improve outcomes in general paediatrics, but are understudied in subspecialty settings. We sought to improve family presence and participation in rounds in a paediatric acute care cardiology unit.

METHODS

We created operational definitions for family presence, our process measure, and participation, our outcome measure, and gathered baseline data over 4 months of 2021. Our SMART aim was to increase mean family presence from 43 to 75% and mean family participation from 81 to 90% by 30 May, 2022. We tested interventions with iterative plan-do-study-act cycles between 6 January, 2022 and 20 May, 2022, including provider education, calling families not at bedside, and adjustment to rounding presentations. We visualised change over time relative to interventions with statistical control charts. We conducted a high census days subanalysis. Length of stay and time of transfer from the ICU served as balancing measures.

RESULTS

Mean presence increased from 43 to 83%, demonstrating special cause variation twice. Mean participation increased from 81 to 96%, demonstrating special cause variation once. Mean presence and participation were lower during high census (61 and 93% at project end) but improved with special cause variation. Length of stay and time of transfer remained stable.

CONCLUSIONS

Through our interventions, family presence and participation in rounds improved without apparent unintended consequences. Family presence and participation may improve family and staff experience and outcomes; future research is warranted to evaluate this. Development of high level of reliability interventions may further improve family presence and participation, particularly on high census days.

Improving On-Time Starts for Pediatric Cardiac MRI

PURPOSE

Delayed start times for cardiac MRI examinations have resulted in longer patient fasts, extended wait times, and poor synchronization of anesthesia induction and contrast administration. The aim of this work was to improve on-time start rates from an initial baseline of 10%.

METHODS

A multidisciplinary team comprising members of the cardiac and radiology services used the Realizing Improvement Through Team Empowerment methodology to target the root causes of the delays and enhance workflow. The main factors identified as contributing to examination delays were late patient arrival, variations in patient preparation time, unavailability of equipment, and inefficient scheduling processes.

RESULTS

The implementation of various interventions, such as the use of standardized appointment scripts, ensuring timely patient preparation, and ensuring the availability of equipment when required, resulted in an increase in on-time start rates for cardiac MRI examinations to 34%.

CONCLUSIONS

The study's systematic approach proved to be valuable in both understanding and resolving the identified problems. Through the continuous application of plan-do-study-act cycles, the authors effectively pinpointed obstacles and tested multiple potential measures to overcome them. This approach made it possible to comprehend the issue and to implement targeted interventions to address it.

Improving Diabetes Screening in the Primary Care Clinic

BACKGROUND

In our suburban primary care clinic, the average rate of screening for diabetes among eligible patients was only 51%, similar to national screening data. We conducted a quality improvement project to increase this rate.

METHODS

During the 6-month preintervention phase, we collected baseline data on the percentage of eligible patients screened per week (percentage of patients with hemoglobin A1c checked in the prior 3 years out of patients eligible for screening who completed a visit during the week). We then implemented a two-phase intervention. In phase 1 (approximately 8 months), we generated an electronic health record (EHR) report to identify eligible patients and pended laboratory orders for physicians to sign. In phase 2 (approximately 3 months), we replaced the phase 1 intervention with an EHR clinical decision support tool that automatically identifies eligible patients. We compared screening rates in the preintervention vs. intervention period. For phase 1, we also assessed laboratory completion rates and the laboratory results. We surveyed physicians regarding intervention acceptability and satisfaction at 3, 6, 9, and 12 months during the intervention period.

RESULTS

The weekly percentage of patients screened increased from an average of 51% in the preintervention phase to 65% in the intervention phase (p < 0.001). During phase 1, most patients underwent laboratory blood testing as recommended (83% within 3 months), and results were consistent with prediabetes in 23% and with diabetes in 4%. Overall, most physicians believed that the intervention appropriately identified patients due for screening and was helpful (100% of respondents agreed at 9 months vs. 71% at 3 months).

CONCLUSION

We successfully implemented a systematic screening intervention involving a manual workflow and EHR tool and improved diabetes screening rates in our clinic.

Performance assessment of surgical tracking systems based on statistical process control and longitudinal QA

A system for performance assessment and quality assurance (QA) of surgical trackers is reported based on principles of geometric accuracy and statistical process control (SPC) for routine longitudinal testing. A simple QA test phantom was designed, where the number and distribution of registration fiducials was determined drawing from analytical models for target registration error (TRE). A tracker testbed was configured with open-source software for measurement of a TRE-based accuracy metric ε and Jitter (J ). Six trackers were tested: 2 electromagnetic (EM - Aurora); and 4 infrared (IR - 1 Spectra, 1 Vega, and 2 Vicra) - all NDI (Waterloo, ON). Phase I SPC analysis of Shewhart mean (x ¯ ) and standard deviation (s ) determined system control limits. Phase II involved weekly QA of each system for up to 32 weeks and identified Pass, Note, Alert, and Failure action rules. The process permitted QA in <1 min. Phase I control limits were established for all trackers: EM trackers exhibited higher upper control limits than IR trackers in ε (EM: x ¯ ε   ∼ 2.8-3.3 mm, IR: x ¯ ε   ∼ 1.6-2.0 mm) and Jitter (EM: x ¯ jitter   ∼ 0.30-0.33 mm, IR: x ¯ jitter   ∼ 0.08-0.10 mm), and older trackers showed evidence of degradation - e.g. higher Jitter for the older Vicra (p-value < .05). Phase II longitudinal tests yielded 676 outcomes in which a total of 4 Failures were noted - 3 resolved by intervention (metal interference for EM trackers) - and 1 owing to restrictive control limits for a new system (Vega). Weekly tests also yielded 40 Notes and 16 Alerts - each spontaneously resolved in subsequent monitoring.

Patient Safety/Quality Improvement Primer, Part IV: How to Measure and Track Improvements

Patient safety and quality improvement (PS/QI) has become an integral part of the health care system, and the ability to effectively use data to track, understand, and communicate performance is essential to designing and implementing quality initiatives, as well as assessing their impact. Though many otolaryngologists are proficient in the methodologies of traditional research pursuits, educational gaps remain in the foundational principles of PS/QI measurement strategies. Part IV of this PS/QI primer discusses the fundamentals of measurement design and data analysis methods specific to PS/QI. Consideration is given to the selection of appropriate measures when designing a PS/QI project, as well as the method and frequency for collecting these measures. In addition, this primer reviews key aspects of tracking and analyzing data, providing an overview of statistical process control methods while highlighting the construction and utility of run and control charts. Lastly, this article discusses strategies to successfully develop and execute PS/QI initiatives in a way that facilitates the ability to appropriately measure their effectiveness and sustainability.

Closing the equity gap as we move to the elimination of seclusion: Early results from a national quality improvement project

OBJECTIVE

Use of seclusion within mental health inpatient facilities is harmful for consumers and staff, but it is still used in many Aotearoa New Zealand and Australian facilities, at higher, inequitable rates for the indigenous populations of both countries. We report early results from a national programme to eliminate seclusion in mental health services in Aotearoa New Zealand, using a bicultural approach to reduce inequity for Māori.

METHOD

The 'Zero Seclusion: Safety and dignity for all' programme, with programme teams nationwide, developed a co-designed bicultural change package combining Māori cultural and Western clinical interventions, incorporating quality improvement methodologies. Outcome measures included seclusion rates, duration, and average number of episodes per person admitted, by ethnicity, with a focus on equity.

RESULTS

Nationally, rates of seclusion for Māori reduced from the 12-month (to August 2019) baseline mean monthly rate of 7.5% to 6.8%, sustained from late 2020 to September 2022. The duration of seclusion for Māori reduced by 33% (4.5 h at baseline to 3.0).

CONCLUSION

A focus on inequity for Māori in use of seclusion, and a bicultural approach with cultural and clinical interventions, has been associated with a national reduction in rates and duration of seclusion for Māori.

Pediatric Rheumatology Care and Outcomes Improvement Network's Quality Measure Set to Improve Care of Children With Juvenile Idiopathic Arthritis

OBJECTIVE

To describe the selection, development, and implementation of quality measures (QMs) for juvenile idiopathic arthritis (JIA) by the Pediatric Rheumatology Care and Outcomes Improvement Network (PR-COIN), a multihospital learning health network using quality improvement methods and leveraging QMs to drive improved outcomes across a JIA population since 2011.

METHODS

An American College of Rheumatology-endorsed multistakeholder process previously selected initial process QMs. Clinicians in PR-COIN and parents of children with JIA collaboratively selected outcome QMs. A committee of rheumatologists and data analysts developed operational definitions. QMs were programmed and validated using patient data. Measures are populated by registry data, and performance is displayed on automated statistical process control charts. PR-COIN centers use rapid-cycle quality improvement approaches to improve performance metrics. The QMs are revised for usefulness, to reflect best practices, and to support network initiatives.

RESULTS

The initial QM set included 13 process measures concerning standardized measurement of disease activity, collection of patient-reported outcome assessments, and clinical performance measures. Initial outcome measures were clinical inactive disease, low pain score, and optimal physical functioning. The revised QM set has 20 measures and includes additional measures of disease activity, data quality, and a balancing measure.

CONCLUSION

PR-COIN has developed and tested JIA QMs to assess clinical performance and patient outcomes. The implementation of robust QMs is important to improve quality of care. PR-COIN's set of JIA QMs is the first comprehensive set of QMs used at the point-of-care for a large cohort of JIA patients in a variety of pediatric rheumatology practice settings.

Editorial: Continuous monitoring to improve outcome of treatment-the next step towards safe and effective faecal microbiota transplantation. Authors' reply

This article is linked to Baunwall et al papers. To view these articles, visit https://doi.org/10.1111/apt.17642 and https://doi.org/10.1111/apt.17694

Decreasing Blood Culture Collection in Hospitalized Patients with CAP, SSTI, and UTI

Background

Blood culture collection in pediatric patients with community-acquired pneumonia (CAP), skin and soft tissue infections (SSTI), and urinary tract infections (UTI) remains high despite evidence of its limited utility. We aimed to decrease the number of cultures collected in children hospitalized for CAP, SSTI, and UTI by 25% over 11 months.

Methods

Quality improvement initiative at a children's hospital among well-appearing patients aged 2 months or more to 18 years diagnosed with CAP, SSTI, or UTI. Our primary and secondary outcomes were blood culture collection rate and positivity rate, respectively. Interventions focused on three key drivers: academic detailing, physician awareness of personal performance, and data transparency.

Results

Over the 2-year study period, there were 105 blood cultures collected in 223 hospitalized patients. Blood culture collection rates demonstrated special cause variation, decreasing from 63.5% to 24.5%. For patients with UTI, 86% (18/21) of blood cultures were negative, whereas 100% were negative for CAP and SSTI. All three patients with bacteremic UTI had a concurrent urine culture growing the same pathogen. Balancing measures remained unchanged, including escalation to a higher level of care and return to the emergency department or hospital within 14 days for the same infection.

Conclusions

A multifaceted quality improvement approach can reduce blood culture collection for hospitalized patients with CAP, SSTI, and UTI without significant changes to balancing measures. Despite the reduction achieved, the near-universal negative culture results suggest continued overutilization and highlight the need for more targeted approaches to blood culture collection.

Increasing COVID-19 Immunization Rates through a Vaccination Program for Hospitalized Children

Introduction

Inpatient coronavirus disease 2019 (COVID-19) vaccination initiatives offer a novel strategy to eliminate barriers to care, provide access to interprofessional teams, and decrease COVID-19 morbidity and mortality. Our inpatient vaccination initiative aimed to triple the baseline rate of eligible hospitalized children vaccinated against COVID-19 from 0.95% to 2.85% from December 2021 to June 2022.

Methods

We implemented a COVID-19 vaccination program for pediatric inpatients eligible to receive a dose based on age, current guidelines, and prior doses received. Key drivers included immunization counseling training, identification of eligible patients, and a streamlined workflow. The outcome measure was the percentage of eligible patients who received a vaccine dose during hospitalization. The process measures included the percentage of age-eligible patients who were appropriately screened for prior doses on admission. We designed a clinical decision support system to enhance eligibility identification. The team performed a health equity analysis which stratified patients by social vulnerability index.

Results

During the study period, the average percentage of eligible hospitalized patients vaccinated increased from 0.9% to 3.5%, representing special cause variation and a centerline shift. The average percentage of age-eligible patients screened for prior vaccine doses on admission increased from 66.5% to 81.5%. Patients were more likely to be vaccinated if their clinician was exposed to the clinical decision support system (P < 0.01). The social vulnerability index analysis showed no significant differences.

Conclusions

This COVID-19 vaccination initiative highlights how an interprofessional approach can increase vaccination rates in hospitalized children; however, overall inpatient COVID-19 vaccination rates in this setting remained low.

Trigger tool-based description of adverse events in helicopter emergency medical services in Qatar

INTRODUCTION

Adverse events (AEs) in helicopter emergency medical services (HEMS) remain poorly reported, despite the potential for harm to occur. The trigger tool (TT) represents a novel approach to AE detection in healthcare. The aim of this study was to retrospectively describe the frequency of AEs and their proximal causes (PCs) in Qatar HEMS.

METHODS

Using the Pittsburgh Adverse Event Tool to identify AEs in HEMS, we retrospectively analysed 804 records within an existing AE TT database (21-month period). We calculated outcome measures for triggers, AEs and harm per 100 patient encounters, plotted measures on statistical process control charts, and conducted a multivariate analysis to report harm associations.

RESULTS

We identified 883 triggers in 536 patients, with a rate of 1.1 triggers per patient encounter, where 81.2% had documentation errors (n=436). An AE and harm rate of 27.7% and 3.5%, respectively, was realised. The leading PC was actions by HEMS Crew (81.6%; n=182). The majority of harm (57.1%) stemmed from the intervention and medication triggers (n=16), where deviation from standard of care was common (37.9%; n=11). Age and diagnosis-adjusted odds were significant in the patient condition (6.50; 95% CI 1.71 to 24.67; p=0.01) and interventional (11.85; 95% CI 1.36 to 102.92; p=0.03) trigger groupings, while age and diagnosis had no effect on harm.

CONCLUSION

The TT methodology is a robust, reliable and valid means of AE detection in the HEMS domain. While an AE rate of 27.7% is high, more research is required to understand prehospital clinical decision-making and reasons for guideline deviance. Furthermore, focused quality improvement initiatives to reduce AEs and documentation errors should also be addressed in future research.

Implementation of a Children's Hospital Acute Care Behavior Response Team

BACKGROUND

Pediatric patients with behavioral needs are frequently admitted to the hospital for medical care; when behavioral crises occur, patients and staff are at risk for injury. Our aim was to implement a behavior response team (BRT) to increase the days between employee injury due to aggressive patient interactions on the inpatient medical units from 99 to 150 over 1 year.

METHODS

A multidisciplinary team used quality improvement methods to design and implement the BRT system that includes 2 options: huddle to proactively plan for patients exhibiting early signs of escalation and STAT for immediate help for patients with imminent risk of harm to self or others. Using run and statistical process control charts, we tracked events per month, days between Occupational Safety & Health Administration-recordable events, and violent restraint use over time for 1 year after implementation. Staff pre and postimplementation surveys were compared to assess staff perception of safety and support provided by the BRT intervention.

RESULTS

The BRT was implemented across the inpatient system in July 2020, with an average number of 13 events per month. Days between Occupational Safety & Health Administration-recordable events remained stable with a maximum of 134 days. Restraint use remained stable at 0.74 per 1000 patient days. The perception of behavioral support available to staff increased significantly pre to postsurvey.

CONCLUSIONS

The implementation of a BRT can improve staff perception of support and confidence in safely caring for patients with behavior needs on the inpatient medical unit, although additional provider- and system-level improvements are needed to prevent employee injuries.

Learning in real world practice: Identifying implementation strategies to integrate health-related social needs screening within a large health system

Introduction

Health systems have many incentives to screen patients for health-related social needs (HRSNs) due to growing evidence that social determinants of health impact outcomes and a new regulatory context that requires health equity measures. This study describes the experience of one large urban health system in scaling HRSN screening by implementing improvement strategies over five years, from 2018 to 2023.

Methods

In 2018, the health system adapted a 10-item HRSN screening tool from a widely used, validated instrument. Implementation strategies aimed to foster screening were retrospectively reviewed and categorized according to the Expert Recommendations for Implementing Change (ERIC) study. Statistical process control methods were utilized to determine whether implementation strategies contributed to improvements in HRSN screening activities.

Results

There were 280,757 HRSN screens administered across 311 clinical teams in the health system between April 2018 and March 2023. Implementation strategies linked to increased screening included integrating screening within an online patient portal (ERIC strategy: involve patients/consumers and family members), expansion to discrete clinical teams (ERIC strategy: change service sites), providing data feedback loops (ERIC strategy: facilitate relay of clinical data to providers), and deploying Community Health Workers to address HRSNs (ERIC strategy: create new clinical teams).

Conclusion

Implementation strategies designed to promote efficiency, foster universal screening, link patients to resources, and provide clinical teams with an easy-to-integrate tool appear to have the greatest impact on HRSN screening uptake. Sustained increases in screening demonstrate the cumulative effects of implementation strategies and the health system's commitment toward universal screening.

A quality improvement initiative to improve folic acid supplementation counseling for adolescent females with epilepsy

OBJECTIVE

We designed a quality improvement (QI) project to improve rates of documented folic acid supplementation counseling for adolescent females with epilepsy, consistent with a quality measure from the American Academy of Neurology and American Epilepsy Society. Our SMART aim was to increase the percentage of visits at which folic acid counseling was addressed from our baseline rate of 23% to 50% by July 1, 2020.

METHODS

This initiative was conducted in female patients ≥12 years old with epilepsy who were prescribed daily antiseizure medication and were seen by the 13 providers in our Neurology QI Program. Using provider interviews, we undertook a root cause analysis of low counseling rates and identified the following main factors: insufficient time during clinic visit to counsel, lack of provider knowledge, and forgetting to counsel. Countermeasures were designed to address these main root causes and were implemented through iterative plan-do-study-act (PDSA) cycles. Interventions included provider education and features within the electronic health record, which were introduced sequentially, culminating in the creation of a best practice advisory (BPA). We performed biweekly chart reviews of visits for applicable patients to establish baseline performance rate and track progress over time. We used a statistical process control p-chart to analyze the outcome measure of documented counseling. As a balancing measure, clinicians were surveyed using the Technology Adoption Model survey to assess acceptance of the BPA.

RESULTS

From September 2019 to August 2022, the QI team improved rates of documented folic acid counseling from 23% to 73% through several PDSA cycles. This level of performance has been sustained over time. The most successful and sustainable intervention was the BPA. Provider acceptance of the BPA was overall positive.

SIGNIFICANCE

We successfully used QI methodology to improve and sustain our rates of documented folic acid supplementation counseling for adolescent females with epilepsy.

A quality improvement approach to integrating social determinants of health objectives into pediatric simulation

Background

Health disparities and the unequal distribution of social resources impact health outcomes. By considering social determinants of health (SDH), clinicians can provide holistic and equitable care. However, barriers such as lack of time or understanding of the relevance of SDH to patient care prevent providers from addressing SDH. Simulation curricula may improve learners' ability to address SDH in practice.

Objectives

The primary objective was to increase the percentage of pediatric emergency simulations that included SDH objectives from 5% to 50% in 12 months at one institution. As a balancing metric, we examined whether trainees approved the incorporation of SDH objectives.

Methods

Using the Model for Improvement approach, we conducted interviews of residents and simulation facilitators to identify challenges to integrating SDH objectives into the simulation curriculum. Review of interviews and visual representation of the system helped identify key drivers in the process. A team of simulation leaders, residents, and fellows met regularly to develop simulation cases with embedded SDH objectives. Using a plan, do, study, act approach, we tested, refined, and implemented interventions including engaging residency program and SDH leadership, piloting cases, providing facilitators concise resources, inviting SDH-specific experts to co-debrief, and eliciting and incorporating learner and facilitator feedback to improve cases. SDH topics include homelessness, undocumented status, and racism.

Results

Prior to the start of the quality improvement work, SDH were rarely incorporated into emergency simulations for pediatric residents. A p-chart was used to track the percentage of monthly cases that incorporated SDH topics. During the study period, the percentage of simulations including SDH topics increased to 57% per month. Most trainees (94%) welcomed incorporating SDH objectives.

Conclusions

Using the Model for Improvement, we incorporated SDH objectives into pediatric resident emergency simulations. Next steps include examining effectiveness of the curriculum, dissemination to additional learners, and examining sustainability in practice.

Outcomes of a respiratory therapist driven high flow nasal cannula management protocol for pediatric critical asthma patients

INTRODUCTION

This study aimed to determine if a respiratory therapist (RT)-driven high flow nasal cannula (HFNC) protocol could decrease duration of HFNC use, pediatric intensive care unit (PICU) and hospital length of stay (LOS), and duration of continuous albuterol use in pediatric patients with critical asthma.

METHODS

This was a quality improvement project performed at a quaternary academic PICU. Patients admitted to the PICU between 2 and 18 years of age with a diagnosis of asthma requiring continuous albuterol and HFNC were included. Implementation of an RT-driven HFNC protocol [Plan-Do-Study-Act (PDSA) 1] occurred in October 2017. Additional interventions included weaning continuous albuterol and HFNC simultaneously (PDSA 2; March 2019), adjusting HFNC wean rate (PDSA 3; July 2020), and a HFNC holiday (PDSA 4; October 2021). HFNC duration was the primary outcome. Secondary outcomes included LOS data and continuous albuterol duration. Noninvasive ventilation (NIV), invasive mechanical ventilation (IMV), and 7-day PICU and hospital readmission rates were used as balancing measures.

RESULTS

A total of 410 patients were included. Patient demographics and adjunct therapy use did not differ among the groups. After PDSA 2, mean HFNC duration decreased (26.8-18.1 h). Mean PICU LOS decreased (41-31.8 h). Mean hospital LOS also decreased (86.5-68 h). These outcomes remained stable during PDSA 3 and 4. Continuous albuterol duration and NIV use were unchanged, while IMV use decreased.

CONCLUSIONS

An RT-driven HFNC protocol led to decreased length of HFNC and PICU and hospital LOS for pediatric patients with critical asthma without an increase in adverse events.

Data drift in medical machine learning: implications and potential remedies

Data drift refers to differences between the data used in training a machine learning (ML) model and that applied to the model in real-world operation. Medical ML systems can be exposed to various forms of data drift, including differences between the data sampled for training and used in clinical operation, differences between medical practices or context of use between training and clinical use, and time-related changes in patient populations, disease patterns, and data acquisition, to name a few. In this article, we first review the terminology used in ML literature related to data drift, define distinct types of drift, and discuss in detail potential causes within the context of medical applications with an emphasis on medical imaging. We then review the recent literature regarding the effects of data drift on medical ML systems, which overwhelmingly show that data drift can be a major cause for performance deterioration. We then discuss methods for monitoring data drift and mitigating its effects with an emphasis on pre- and post-deployment techniques. Some of the potential methods for drift detection and issues around model retraining when drift is detected are included. Based on our review, we find that data drift is a major concern in medical ML deployment and that more research is needed so that ML models can identify drift early, incorporate effective mitigation strategies and resist performance decay.

Successful quality improvement project to increase hydroxyurea prescriptions for children with sickle cell anaemia

Hydroxyurea (HU) is an effective but underused disease-modifying therapy for patients with sickle cell anaemia (SCA). EMBRACE SCD, a sickle cell disease treatment demonstration project, aimed to improve access to HU by increasing prescription (Rx) rates by at least 10% from baseline in children with SCA.The Model for Improvement was used as the quality improvement framework. HU Rx was assessed from clinical databases in three paediatric haematology centres. Children aged 9 months-18 years with SCA not on chronic transfusions were eligible for HU treatment. The health belief model was the conceptual framework to discuss with patients and promote HU acceptance. A visual aid showing erythrocytes under the effect of HU and the American Society of Hematology HU brochure were used as educational tools. At least 6 months after offering HU, a Barrier Assessment Questionnaire was given to assess reasons for HU acceptance and refusals. If HU was declined, the providers discussed with family again. We conducted chart audits to find missed opportunities to prescribe HU as one plan-do-study-act cycle.At initial measurement, 50.2% of 524 eligible patients had HU prescribed. During the testing and initial implementation phase, the mean performance after 10 data points was 53%. After 2 years, the mean performance was 59%, achieving an 11% increase in mean performance and a 29% increase from initial to the last measurement (64.8% HU Rx). During a 15-month period, 32.1% (N=168) of the eligible patients who were offered HU completed the barrier questionnaire with 19% (N=32) refusing HU, mostly based on not perceiving enough severity of their children's SCA or fearing side effects.Reviewing patient charts for missed opportunity of offering HU with feedback and evaluating the reasons of declining HU via a questionnaire were key components in increasing HU Rx in our population.

Observation of a quality improvement initiative to contextually adapt and use Robson classification in real time to collect data around CS delivery and to develop strategies to reduce CS rate

The rising trend in caesarean section (CS) rate is a global concern and, in this hospital too, it rose from 21.5% in 2010 to 32.6% in 2018. The team followed the point of care quality improvement methodology and conducted a series of Plan-Do-Study-Act cycles to contextually modify and adapt Robson classification into the existing workflow to improve the process of documentation and data collection for CS in the first 6 months (January 2019-June 2019) and then to use these data to develop strategies to reduce CS rate below 30% in the next 18 months.To evaluate the impact of developed strategies, the team plotted the data on Statistical Process Control (XmR) chart. The baseline mean CS rate was 32.6%. The team observed a shift in the CS rate data twice, between April 2020 and December 2020 and between August 2021 and February 2021 with the mean 27.8% and 28.9%, respectively. October 2021 onwards, the team also observed a sustained reduction in the CS rate in women undergoing CS who had one previous CS. The mean CS rate reduced from 94% to 86%.The reductions in the CS rate were not sustained and followed by an increase again. The project highlighted the complexity of the factors related to CS delivery and the multidimensional barriers of sustaining the reduction in the CS rate. This is a well-sustained ongoing QI intervention and the team is further working on identifying the underlying factors to improve the efficacy of the interventions to sustain the reduction in the CS rate.This hospital represents the general population of North India seeking care in public healthcare facilities. Therefore, despite being a single-centre study, the population served and interpretations drawn from this study are generalisable to other hospitals with similar settings.

Monitoring the performance of a dedicated weaning unit using risk-adjusted control charts for the weaning rate in prolonged mechanical ventilation

BACKGROUND

Weaning rate is an important quality indicator of care for patients with prolonged mechanical ventilation (PMV). However, diverse clinical characteristics often affect the measured rate. A risk-adjusted control chart may be beneficial for assessing the quality of care.

METHODS

We analyzed patients with PMV who were discharged between 2018 and 2020 from a dedicated weaning unit at a medical center. We generated a formula to estimate monthly weaning rates using multivariate logistic regression for the clinical, laboratory, and physiologic characteristics upon weaning unit admission in the first two years (Phase I). We then applied both multiplicative and additive models for adjusted p-charts, displayed in both non-segmented and segmented formats, to assess whether special cause variation existed.

RESULTS

A total of 737 patients were analyzed, including 503 in Phase I and 234 in Phase II, with average weaning rates of 59.4% and 60.3%, respectively. The p-chart of crude weaning rates did not show special cause variation. Ten variables from the regression analysis were selected for the formula to predict individual weaning probability and generate estimated weaning rates in Phases I and II. For risk-adjusted p-charts, both multiplicative and additive models showed similar findings and no special cause variation.

CONCLUSION

Risk-adjusted control charts generated using a combination of multivariate logistic regression and control chart-adjustment models may provide a feasible method to assess the quality of care in the setting of PMV with standard care protocols.

Quality Improvement to Reduce High-Flow Nasal Cannula Overuse in Children With Bronchiolitis

BACKGROUND

High-flow nasal cannula oxygen therapy (HFNC) is increasingly used to treat bronchiolitis. However, HFNC has not reduced time on supplemental oxygen, length of stay (LOS), or ICU admission. Our objective was to reduce HFNC use in children admitted for bronchiolitis from 41% to 20% over 2 years.

METHODS

Using quality improvement methods, our multidisciplinary team formulated key drivers, including standardization of HFNC use, effective communication, knowledgeable staff, engaged providers and families, data transparency, and high-value care focus. Interventions included: (1) standardized HFNC initiation criteria, (2) staff education, (3) real-time feedback to providers, (4) a script for providers to use with families about expectations during admission, (5) team huddle for patients admitted on HFNC to discuss necessity, and (6) distribution of a bronchiolitis toolkit. We used statistical process control charts to track the percentage of children with bronchiolitis who received HFNC. Data were compared with a comparison institution not actively involved in quality improvement work around HFNC use to ensure improvements were not secondary to the COVID-19 pandemic alone.

RESULTS

Over 10 months of interventions, we saw a decrease in HFNC use for patients admitted with bronchiolitis from 41% to 22%, which was sustained for >12 months. There was no change in HFNC use at the comparison institution. The overall mean LOS for children with bronchiolitis decreased from 60 to 45 hours.

CONCLUSIONS

We successfully reduced HFNC use in children with bronchiolitis, improving delivery of high-value and evidence-based care. This reduction was associated with a 25% decrease in LOS.

Donor, patient age and exposure to antibiotics are associated with the outcome of faecal microbiota transplantation for recurrent Clostridioides difficile infection: A prospective cohort study

BACKGROUND

Faecal microbiota transplantation (FMT) is effective for recurrent Clostridioides difficile infection (rCDI), but its effect varies inexplicably.

AIMS

To optimise the effectiveness of FMT for rCDI and validate determinants for effect METHODS: We conducted a cohort study, including all patients treated with FMT for rCDI between October 2018 and June 2020. Statistical process control was used to evaluate the impact of prospective quality improvement on the effect of single FMT treatments per 10-11 patients. Targeting an 80% effect, optimisations included changes to processing procedures, preparation and clinical application of FMT. The primary outcome was the resolution of Clostridioides difficile-associated diarrhoea at week 8. If CDI recurred, FMT was repeated. All patients were followed for 8 weeks after their latest FMT.

RESULTS

183 patients with rCDI received 290 FMT treatments. A single FMT achieved resolution at week 8 in 127 (69%, 95% CI: 62%-76%), while repeated FMT cumulatively achieved resolution in 167/183 (91%, 95% CI: 86%-95%). The single FMT effect varied between 36% and 100% over time. In a mixed-effect model, patient age above 65 years, non-rCDI antibiotics at week 1 post-FMT, and donor were associated with effect. Neither increasing the dosages of faecal microbes nor standardising the processing improved outcomes.

CONCLUSION

FMT has a high cumulative effectiveness in patients with rCDI following multiple administrations, but the single FMT effect is variable and may be optimised using statistical process control. Optimising FMT by considering patient age, post-FMT antibiotics, donor and multiple administrations may improve the treatment outcomes.

CLINICALTRIALS

gov (Study identifier: NCT03712722).