Lessons Learned From a Systematic, Hospital-Wide Implementation of the ABCDEF Bundle: A Survey Evaluation

Objective

We recently reported the first part of a study testing the impact of data literacy training on "assessing pain, spontaneous awakening and breathing trials, choice of analgesia and sedation, delirium monitoring/management, early exercise/mobility, and family and patient empowerment" [ABCDEF [A-F]) compliance. The purpose of the current study, part 2, was to evaluate the effectiveness of the implementation approach by surveying clinical staff to examine staff knowledge, skill, motivation, and organizational resources.

DESIGN

The Clark and Estes Gap Analysis framework was used to study knowledge, motivation, and organization (KMO) influences. Assumed influences identified in the literature were used to design the A-F bundle implementation strategies. The influences were validated against a survey distributed to the ICU interprofessional team.

SETTING

Single-center study was conducted in eight adult ICUs in a quaternary academic medical center.

SUBJECTS

Interprofessional ICU clinical team.

INTERVENTIONS

A quantitative survey was sent to 386 participants to evaluate the implementation design postimplementation. An exploratory factor analysis was performed to understand the relationship between the KMO influences and the questions posed to validate the influence. Descriptive statistics were used to identify strengths needed to sustain performance and weaknesses that required improvement to increase A-F bundle adherence.

MEASUREMENT AND RESULTS

The survey received an 83% response rate. The exploratory factor analysis confirmed that 38 of 42 questions had a strong relationship to the KMO influences, validating the survey's utility in evaluating the effectiveness of implementation design. A total of 12 KMO influences were identified, 8 were categorized as a strength and 4 as a weakness of the implementation.

CONCLUSIONS

Our study used an evidence-based gap analysis framework to demonstrate key implementation approaches needed to increase A-F bundle compliance. The following drivers were recommended as essential methods required for successful protocol implementation: data literacy training and performance monitoring, organizational support, value proposition, multidisciplinary collaboration, and interprofessional teamwork activities. We believe the learning generated in this two-part study is applicable to implementation design beyond the A-F bundle.

Have the UK Pediatric Trauma Protocols resulted in a reduction in chest computed tomography imaging for children presenting with major blunt trauma?

Objectives

To observe variation in imaging requests after publication of the Royal College of Radiologists UK Paediatric Trauma Protocols in 2014, recommending limited use of thoracic computed tomography (CT) to appropriately clinically risk stratified children.

Method

A retrospective observational study using data from the Trauma Audit & Research Network in the United Kingdom, for children (0-16 years of age) for the years 2012-2021. Percentages were calculated to facilitate comparison between year groups (under 1 year of age, 1-10 years of age, 11-15 years of age), and CT imaging categories reviewed: (1) whole-body CT (WBCT); (2) abdominopelvic CT (CTAP) with chest radiograph (CXR); (3) chest, abdomen, and pelvic CT (CTCAP) with CXR; (4) CTCAP without CXR; and (5) other imaging.

Results

Increased use of the recommended protocol (CXR with CTAP) was observed after guidance publication but was not sustained: infants under 1 year old, 0.0% in 2012, 7% in 2017, 0.0% in 2021; 1-10-year-olds, 4% in 2012, 13.9% in 2017, 5.5% in 2021; 11-15-year-olds, 7.1% in 2012, 10.2% in 2017, 6.6% in 2021. Requests for WBCT increased from 2012-2021 (all age groups, 2.4%, 2012, to 5.3%, 2021) and requests for CTCAP were consistently at a higher level than that of the recommended protocol.

Conclusion

The increased use of CXR with CTAP after publication of the guidelines, was not sustained with a decreasing trend observed from ∼2017, raising concern for the ionizing radiation burden in this population.

Assessment of Emergency Medical Services Personnel Compliance with Escalating Airway Algorithm Protocol

Introduction

When emergency medical services (EMS) personnel respond to emergencies, the decisions they make often can mean life or death for the patient. This is especially true in the case of advanced airway management. Protocols are set in place to ensure that the least invasive airway management techniques are used initially before more invasive techniques. The purpose of this study was to determine how often EMS personnel followed this protocol, while adequately achieving the goals of appropriate oxygenation and ventilation.

Methods

This retrospective chart review was approved by the Institutional Review Board of the University of Kansas Medical Center. The authors reviewed the Wichita/Sedgewick County EMS system for cases during 2017 in which patients required airway support. We examined de-identified data to determine if invasive methods were applied in sequence. Cohen's kappa coefficient (κ) and immersion-crystallization approach were used to analyze the data.

Results

A total of 279 cases were identified in which EMS personnel used advanced airway management techniques. In 90% (n = 251) of cases, less invasive techniques were not used prior to more invasive techniques and in 80% (n = 222) of cases, the more invasive technique was used alone. A dirty airway was the most common reason for the EMS personnel's choice of using more invasive approaches in achieving the goals of appropriate oxygenation and ventilation.

Conclusions

Our data showed that EMS personnel in Sedgwick County/Wichita, Kansas often deviated from the advanced airway management protocols when caring for patients in need of respiratory intervention. Dirty airway was the main reason for using a more invasive approach in achieving the goals of appropriate oxygenation and ventilation. It is important to understand reasons why deviations in protocol were occurring to ensure that current protocols, documentation, and training practices are effective in producing the best possible patient outcomes.

Critical impact of radiotherapy protocol compliance and quality in the treatment of retroperitoneal sarcomas: Results from the EORTC 62092-22092 STRASS trial

BACKGROUND

The European Organization for Research and Treatment of Cancer 22092-62092 STRASS trial failed to demonstrate the superiority of neoadjuvant radiotherapy (RT) over surgery alone in patients with retroperitoneal sarcoma. Therefore, an RT quality-assurance program was added to the study protocol to detect and correct RT deviations. The authors report results from the trial RT quality-assurance program and its potential effect on patient outcomes.

METHODS

To evaluate the effect of RT compliance on survival outcomes, a composite end point was created. It combined the information related to planning target volume coverage, target delineation, total dose received, and overall treatment time into 2 groups: non-RT-compliant (NRC) for patients who had unacceptable deviation(s) in any of the previous categories and RT-compliant (RC) otherwise. Abdominal recurrence-free survival (ARFS) and overall survival were compared between the 2 groups using a Cox proportional hazard model adjusted for known prognostic factors.

RESULTS

Thirty-six of 125 patients (28.8%) were classified as NRC, and the remaining 89 patients (71.2%) were classified as RC. The 3-year ARFS rate was 66.8% (95% confidence interval [CI], 55.8%-75.7%) and 49.8% (95% CI, 32.7%-64.8%) for the RC and NRC groups, respectively (adjusted hazard ratio, 2.32; 95% CI, 1.25-4.32; P = .008). Local recurrence after macroscopic complete resection occurred in 13 of 89 patients (14.6%) versus 2 of 36 patients (5.6%) in the RC and NRC groups, respectively.

CONCLUSIONS

The current analysis suggests a significant benefit in terms of ARFS in favor of the RC group. This association did not translate into less local relapses after complete resection in the RC group. Multidisciplinary collaboration and review of cases are critical to avoid geographic misses, especially for rare tumors like retroperitoneal sarcoma.

Technical Note: A standardized automation framework for monitoring institutional radiotherapy protocol compliance

PURPOSE

To establish a framework for the standardization of monitoring radiotherapy protocol compliance.

METHODS

An automated protocol compliance tool was developed using best practice in software design and a flexible framework to easily adapt to changing institutional standards. The Eclipse scripting environment was used to develop the application with the scripting application programing interface (API) and direct data extraction from ARIA. For each institutional protocol, external validation was specified in a JavaScript Object Notation (JSON) file that stores protocol specific constraints and evaluates compliance of the data from Eclipse and Aria. This tool was applied prospectively to a cohort of prostate cancer patients undergoing radiotherapy with a prescription regimen of 60 Gy in 20 fractions.

RESULTS

The prospective evaluation was performed on 58 prostate cancer patients. For this cohort, the mean (standard deviation) pass rate is 92.3% (6.1%). The overall fail rate is 6.0% (5.8%); the percentage of these failures is in 2.6% in Patient Assessment, 0% in Simulation, and 97.4% in Treatment Planning.

CONCLUSIONS

A protocol compliance application is developed and implemented in a standard radiotherapy information system. The application functionality is demonstrated on a cohort of 58 patients undergoing prostate radiotherapy, which highlights the utility of assessing adherence to institutional protocols. A unified method must be available for the community to ensure consistency in compliance reporting.

Assessment of Non-Routine Events and Significant Physiological Disturbances during Emergency Department Evaluation after Pediatric Head Trauma

Outcomes following pediatric traumatic brain injury (TBI) are dependent on initial injury severity and prevention of secondary injury. Hypoxia, hypotension, and hyperventilation following TBI are associated with increased mortality. The purpose of this study was to determine the association of non-routine events (NREs) during the initial resuscitation phase with these physiological disturbances. We conducted a video review of pediatric trauma resuscitations of patients with suspected TBI and Glasgow Coma Scale (GCS) scores <13. NREs were rated as "momentary" if task progression was delayed by <1 min and "moderate" if delayed by >1 min. Vital sign monitor data were used to identify periods of significant physiological disturbances. We calculated the association between the rate of overall and moderate NREs per case and the proportion of cases with abnormal vital signs using multi-variate linear regression, controlling for GCS score and need for intubation. Among 26 resuscitations, 604 NREs were identified with a median of 23 (interquartile range [IQR] 17-27.8, range 5-44) per case. Moderate delay NREs occurred in 19 resuscitations (n = 32, median 1 NRE/resuscitation, IQR 0.3-1, range 0-5). Oxygen desaturation and respiratory depression were associated with a greater rate of moderate NREs (p = 0.008, p < 0.001, respectively). We observed no association between duration of hypotension, desaturation, and respiratory depression and overall NRE rate. NREs are common in the initial resuscitation of children with moderate to severe TBI. Episodes of hypoxia and respiratory depression are associated with NREs that cause a moderate delay in task progression. Conformance with resuscitation guidelines is needed to prevent physiological events associated with adverse outcomes following pediatric TBI.

Use of In-Game Rewards to Motivate Daily Self-Report Compliance: Randomized Controlled Trial

Background

Encouraging individuals to report daily information such as unpleasant disease symptoms, daily activities and behaviors, or aspects of their physical and emotional state is difficult but necessary for many studies and clinical trials that rely on patient-reported data as primary outcomes. Use of paper diaries is the traditional method of completing daily diaries, but digital surveys are becoming the new standard because of their increased compliance; however, they still fall short of desired compliance levels.

Objective

Mobile games using in-game rewards offer the opportunity to increase compliance above the rates of digital diaries and paper diaries. We conducted a 5-week randomized control trial to compare the completion rates of a daily diary across 3 conditions: a paper-based participant-reported outcome diary (Paper PRO), an electronic-based participant-reported outcome diary (ePRO), and a novel ePRO diary with in-game rewards (Game-Motivated ePRO).

Methods

We developed a novel mobile game that is a combination of the idle and pet collection genres to reward individuals who complete a daily diary with an in-game reward. Overall, 197 individuals aged 6 to 24 years (male: 100 and female: 97) were enrolled in a 5-week study after being randomized into 1 of the 3 methods of daily diary completion. Moreover, 157 participants (male: 84 and female: 69) completed at least one diary and were subsequently included in analysis of compliance rates.

Results

We observed a significant difference (F_2,124=6.341; P=.002) in compliance to filling out daily diaries, with the Game-Motivated ePRO group having the highest compliance (mean completion 86.4%, SD 19.6%), followed by the ePRO group (mean completion 77.7%, SD 24.1%), and finally, the Paper PRO group (mean completion 70.6%, SD 23.4%). The Game-Motivated ePRO (P=.002) significantly improved compliance rates above the Paper PRO. In addition, the Game-Motivated ePRO resulted in higher compliance rates than the rates of ePRO alone (P=.09). Equally important, even though we observed significant differences in completion of daily diaries between groups, we did not observe any statistically significant differences in association between the responses to a daily mood question and study group, the average diary completion time (P=.52), or the System Usability Scale score (P=.88).

Conclusions

The Game-Motivated ePRO system encouraged individuals to complete the daily diaries above the compliance rates of the Paper PRO and ePRO without altering the participants’ responses.

Trial Registration

ClinicalTrials.gov NCT03738254; http://clinicaltrials.gov/ct2/show/NCT03738254 (Archived by WebCite at http://www.webcitation.org/74T1p8u52)

Use of electronic medical record templates improves quality of care for patients with infantile spasms

BACKGROUND

Infantile spasms (IS) is a neurologic disorder of childhood where time to treatment may affect long-term outcomes. Due to the clinical complexity of IS, care can be delayed.

OBJECTIVE

To determine if the use of electronic medical record templates (EMRTs) improved care quality in patients treated for IS.

METHOD

Records of patients newly diagnosed with IS were retrospectively reviewed both before and after creation of an EMRT for the workup and treatment of IS. Quality of care measures reviewed included delays in treatment plan, medication administration, obtaining neurodiagnostic studies and discharge. The need for repeat neurodiagnostic studies was also assessed. Resident physicians were surveyed regarding template ease of use and functionality.

RESULTS

Of 17 patients with IS, 7 received template-based care and 10 did not. Patients in the non-template group had more delays in treatment (p = 0.010), delay in medication administration (p = 0.10), delay in diagnostic studies (p = 0.01) and delay in discharge (p = 0.39). Neurodiagnostic studies needed to be repeated in 5 out of 10 patients in the non-template group and none of the 7 patients in the template group (p = 0.04). Surveyed resident physicians reported improved coordination in care, avoidance of delays in discharge and improved ability to predict side effects of treatment with template use.

CONCLUSION

In a single centre, the use of protocolised EMRTs decreased treatment delays and the need for repeated invasive procedures in patients with newly diagnosed IS and was reported as easy to use by resident physicians.

IMPLICATIONS

The use of protocolised EMRTs may improve the quality of patient care in IS and other rare diseases.

Compliance with an empirical antimicrobial protocol improves the outcome of complicated intra-abdominal infections: a prospective observational study

BACKGROUND

Despite improvements in medical and surgical care, mortality attributed to complicated intra-abdominal infections (cIAI) remains high. Appropriate initial antimicrobial therapy (ABT) is key to successful management. The main causes of non-compliance with empirical protocols have not been clearly described.

METHODS

An empirical ABT protocol was designed according to guidelines, validated in the institution and widely disseminated. All patients with cIAI (2009-2011) were then prospectively studied to evaluate compliance with this protocol and its impact on outcome. Patients were classified into two groups according to whether or not they received ABT in compliance with the protocol.

RESULTS

310 patients were included: 223 (71.9%) with community-acquired and 87 (28.1%) with healthcare-associated cIAI [mean age 60(17-97) yr, mean SAPS II score 24(16)]. Empirical ABT complied with the protocol in 52.3% of patients. The appropriateness of empirical ABT to target the bacteria isolated was 80%. Independent factors associated with non-compliance with the protocol were the anaesthetist's age ≥36 yr [OR 2.1; 95%CI (1.3-3.4)] and the presence of risk factors for multidrug-resistant bacteria (MDRB) [OR 5.4; 95%CI (3.0-9.5)]. Non-compliance with the protocol was associated with higher mortality (14.9 vs 5.6%, P=0.011) and morbidity: relaparotomy (P=0.047), haemodynamic failure (P=0.001), postoperative pneumonia (P=0.025), longer duration of mechanical ventilation (P<0.001), longer ICU stay (P<0.001) and longer hospital stay (P=0.002). On multivariate logistic regression analysis, non-compliance with the ABT protocol was independently associated with mortality [OR 2.4; 95% CI (1.1-5.7), P=0.04].

CONCLUSIONS

Non-compliance with empirical ABT guidelines in cIAI is associated with increased morbidity and mortality. Information campaigns should target older anaesthetists and risk factors for MDRB.

Lessons and Challenges from a 6-Month Randomized Pilot Study of Daily Ethanol Consumption: Research Methodology and Study Design

Background: Observational studies and crossover feeding studies suggest that moderate alcohol use may benefit cardiovascular risk, but we know of no long-term randomized trials that have tested this hypothesis. Objective: We evaluated the feasibility of an efficacy study of daily ethanol use in a 6-mo randomized pilot study in adults at higher cardiovascular risk. Methods: In a double-blind, randomized, controlled parallel-design trial, we screened 67 adults aged ≥55 y and randomly assigned 45 participants to consume 150 mL of an artificially sweetened beverage with or without 10% grain alcohol daily for 6 mo. Participants were asked to consume no other alcohol and returned monthly to receive the beverage and undergo measurement of HDL cholesterol, liver function tests, and complete blood counts. Results: Of the 45 randomly assigned participants, 39 completed the trial; the primary reason cited for attrition was inconvenience. None of the participants reported problem drinking or developed any serious adverse events or abnormal biochemical findings. However, we observed no differences in concentrations of HDL cholesterol, HDL lipoprotein subclasses, aspartate aminotransferase, alanine aminotransferase, γ-glutamyltransferase, mean corpuscular volume, or adiponectin between the alcohol and control arms, suggesting that adherence was poor. Every participant accurately identified their assigned beverage, most with great certainty. Conclusions: In this parallel-design pilot study of daily alcohol use, we observed none of the expected changes in markers of alcohol intake, which suggests poor adherence to this pure alcohol intervention. Our results suggest that long-term trials of alcohol consumption, if they are conducted in light drinkers similar to these, must use pragmatic designs for maximal feasibility. This study was registered at clinicaltrials.gov as NCT01377727.

Safe and correct use of peripheral intravenous devices

BACKGROUND

A peripheral intravenous device (PIVD) provides venous access for the administration of medications, blood products and fluids. They can be associated with a risk of infection and other complications, which have prompted the development of evidence-based guidelines for their use at the Royal Adelaide Hospital (RAH). A previous audit performed at the RAH found unsatisfactory compliance with these guidelines across a group of wards. The Burns Unit performed poorly compared with other wards, but the reasons for this were not explored.

METHODS

A repeat audit was performed for all PIVDs in the Burns Unit over a 3-week period and compliance with the PIVD safety guidelines was assessed. Factors influencing compliance were investigated and the evidence behind the guidelines was reviewed.

RESULTS

Overall compliance with the seven safety criteria was 71%. Poorest compliance was for documentation of insertion date, which has implications for scheduling PIVD replacement.

CONCLUSION

The guidelines are largely evidence-based; however, not all of them are feasible for all patients within a hospital. The Burns Unit had an overall compliance rate of 71%. Auditing of individual wards is not effective in assessing those wards' compliance with the guidelines as many PIVDs are inserted in other locations in the hospital. For compliance to improve, other areas of the hospital where PIVDs are inserted need to be targeted.

The Environmental Determinants of Diabetes in the Young (TEDDY) study: predictors of early study withdrawal among participants with no family history of type 1 diabetes

OBJECTIVE

The Environmental Determinants of Diabetes in the Young (TEDDY) study seeks to identify environmental triggers of autoimmunity and type 1 diabetes mellitus (T1DM) in children at increased human-leukocyte-antigen conferred genetic risk for this disease. The objective of this study was to identify predictors of early withdrawal from TEDDY among families with no immediate family history of T1DM.

METHOD

Logistic multiple regression was used to discriminate 2994 (83%) families currently active in the TEDDY study for ≥1 yr from 763 (17%) families who withdrew in the first year. Data collected on the screening form at the time of the child's birth and from interview and questionnaire data obtained at the baby's first study visit (at ≤4.5 months of age) were used.

RESULTS

Significant and independent predictors of early withdrawal included country of residence, young maternal age, no father participation, and female gender of the study participant. Mothers of children who withdrew were more likely to report smoking during pregnancy, abstaining from alcohol, and reducing their work hours or not working at all during pregnancy. Mothers who withdrew were also more likely to underestimate their child's risk for T1DM and fail to respond to multiple items on the enrollment questionnaires or interview. Among mothers with accurate risk perceptions, those experiencing high anxiety about their child's risk were more likely to be early withdrawals.

CONCLUSIONS

Identifying families at high risk for study withdrawal at the time of enrollment allows for targeting these families with individually tailored plans to help maintain their participation in the study.

The Trial to Reduce IDDM in the Genetically at Risk (TRIGR) study: recruitment, intervention and follow-up

AIMS/HYPOTHESIS

The Trial to Reduce IDDM in the Genetically at Risk (TRIGR) study was designed to establish whether weaning to a highly hydrolysed formula in infancy subsequently reduces the risk of type 1 diabetes.

METHODS

The study population comprises newborn infants who have first-degree relatives with type 1 diabetes and meet the increased risk HLA inclusion, but not exclusion criteria. The study is being performed in 15 countries in three continents. First-degree relatives of patients with type 1 diabetes were identified from diabetes clinics, diabetes registries, and from other endocrinology or obstetrics offices and websites. HLA typing was performed at birth from cord or heel stick blood, and the results sent to the study's Data Management Unit within 2 weeks for communication of eligibility to the clinical study centre. All mothers recruited were encouraged to breastfeed. The intervention lasted for 6 to 8 months, and weaning formulas based on hydrolysed casein and standard cow's milk were compared.

RESULTS

TRIGR recruited 5,606 infants, of whom 2,160 were enrolled as eligible participants, 6% more than the target of 2,032. Of those enrolled, 80% were exposed to the study formula. The overall retention rate over the first 5 years is 87%, with protocol compliance at 94%. The randomisation code will be opened when the last recruited child turns 10 years of age, i.e. in 2017.

CONCLUSIONS/INTERPRETATION

The TRIGR experience demonstrates the feasibility and successful implementation of an international dietary intervention study. TRIGR is the first ever primary prevention trial for type 1 diabetes and, if completed successfully, will provide a definite answer to the research question.

TRIAL REGISTRATION

ClinicalTrials.gov NCT00179777

FUNDING

The study was funded by the National Institute of Child Health and Development (NICHD) and National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK), National Institutes of Health (NIH) (grant numbers HD040364, HD042444 and HD051997), Canadian Institutes of Health Research, the Juvenile Diabetes Research Foundation International and the Commission of the European Communities (specific RTD programme 'Quality of Life and Management of Living Resources', contract number QLK1-2002-00372 'Diabetes Prevention'. Other funding came from the EFSD/JDRF/Novo Nordisk Focused Research Grant, Academy of Finland, Dutch Diabetes Research Foundation and Finnish Diabetes Research Foundation).

Participant and parent experiences in the oral insulin study of the Diabetes Prevention Trial for Type 1 Diabetes

OBJECTIVE

To assess the experiences of participants and parents of children in the oral insulin study of the Diabetes Prevention Trial - Type 1.

METHOD

Before trial results were publicized, surveys were completed by 124 participants and 219 parents of children in the oral trial.

RESULTS

Although most of those surveyed were positive about the trial, survey results suggest that participant perspective (adult, child, parent, and gender), study procedures, and beliefs about placebo vs. active drug assignment have important implications for planning future clinical trials. Parents and children reported greater distress, worry, and difficulty making the decision to join the trial compared with adult participants. Mothers and female participants were particularly interested in additional psychosocial support during the study. Random assignment was viewed negatively by both parents and children, and close observation for diabetes onset was viewed as the most favorable aspect of the study. Adherence to study procedures declined over time and behaviors outside the study protocol to prevent/delay diabetes onset were common, particularly among those who believed the participant was taking a placebo. Children and respondents who believed that the participant was taking the active drug expressed confidence in oral insulin's ability to delay or prevent type 1 diabetes.

CONCLUSIONS

Although most participants were positive about the trial and many expressed optimism about the intervention's potential for success, future trials need to address negative reactions to random assignment, the unique concerns of children and their parents, declining adherence, and behaviors - external to the trial - designed to delay or prevent diabetes.