Quality improvement projects targeting health care-associated infections: comparing Virtual Collaborative and Toolkit approaches

Care bundles and peripheral arterial catheters

HIGHLIGHTS

What we know about the topic: Recommendations for the use of vascular access care bundles to reduce infection are followed for different devices. The risk of arterial catheter-related infection is comparable with short-term, non-cuffed central venous catheters. There are practice concerns for clinicians inserting and caring for peripheral arterial catheters. What this paper adds: The selected studies had a theme of decreased infection after using bundled strategies for all devices. Few studies addressed use of bundles for care of peripheral arterial catheters. High-quality research should be performed about using care bundles for insertion and care of arterial catheters.

INTRODUCTION

A scoping review of the literature was performed.

AIMS/OBJECTIVES

To find information on the use of care bundles for care of arterial, central, and peripherally inserted venous catheters.

METHODS

Data was extracted by 2 independent researchers using standardized methodology.

RESULTS

Results of 84 studies included 2 (2.4%) randomized controlled trials, 38 (45.2%) observational studies, 29 (34.5%) quality projects, and 15 (17.9%) reviews. Populations had more adults than pediatric patients. All studies had the most prominent theme of decreased infection in all devices after using bundle strategies.

DISCUSSION AND CONCLUSIONS

The mapping of available evidence strongly supports the use of care bundles to reduce infection in the care of all intravascular devices. However, deficiencies regarding practice concerns about insertion and care of arterial catheters highlight areas for future research with the aim to eliminate the gap in the evidence of studies of care bundles for peripheral arterial catheters.

Effectiveness of national and subnational interventions for prevention and control of health-care-associated infections in acute hospitals in high-income and upper-middle-income counties: a systematic review update

This systematic review, commissioned and funded by WHO, aimed to update a review of infection prevention and control (IPC) interventions at a national level to inform a review of their IPC Core Components guidelines (PROSPERO CRD42021297376). CENTRAL, CINAHL, Embase, MEDLINE, and WHO IRIS were searched for studies meeting Cochrane's Effective Practice and Organisation of Care (EPOC) design criteria, published from April 19, 2017, to Oct 14, 2021. Primary research studies examining national IPC interventions in acute hospitals in any country with outcomes related to rates of health-care-associated infections were included. Two independent reviewers extracted data and assessed quality using the EPOC risk of bias criteria. 36 studies were categorised per intervention type and synthesised narratively: care bundles (n=2), care bundles with implementation strategies (n=9), IPC programmes (n=16), and regulations (n=9). Designs included 21 interrupted time-series, nine controlled before-and-after studies, four cluster-randomised trials, and two non-randomised trials. Evidence supports the effectiveness of care bundles with implementation strategies. However, evidence for IPC programmes and regulations was inconclusive as studies were heterogeneous regarding populations, interventions, and outcomes. The overall risk of bias was high. Recommendations include the involvement of implementation strategies in care bundles and for further research on national IPC interventions with robust study designs and in low-income and middle-income settings.

Perspectives of acute, post-acute, physician and community support providers on community collaborative efforts to improve transitions of care

BACKGROUND

Transitional care (TC) involves multiple organizations as patients transition from hospitals. Collaboration to reduce readmissions has been encouraged by government initiatives. As part of Project ACHIEVE, a comparative TC study, we sought provider perspectives on TC improvement efforts.

METHODS

We aimed to identify perceived problems that drove improvement efforts, influences on interventions implemented, facilitators or barriers to desired outcomes, and sustainability. Investigators interviewed 63 representatives from collaborative improvement efforts across 13 states in 2015. Directed content analysis was performed, with inductive coding as insights emerged. Data was also analyzed for differences in participant perceptions, such as the organization represented, geographic characteristics, and source of funding for interventions.

RESULTS

Participants in semi-structured interviews included physicians, nurses, care navigators, and administrators from hospitals, nursing facilities, community-based organizations, and medical practices. Participants reported that changing reimbursement practices and readmissions penalties drove TC efforts, and common problems they sought to address included insufficient inter-provider communication, medication management, and challenges related to chronic condition management. Solutions implemented were often adapted according to community and setting characteristics and population factors. Findings also suggest differences in the types of interventions implemented according to funding sources, which also impacted the ability to sustain these interventions.

CONCLUSIONS

Cross-site collaboration, communication, and partnership among stakeholders is essential to effective transitional care. Collaboration led to shared understanding among stakeholders of health care and support services available in the community. Coalition-based work also facilitated trust among partners which led to expansion and sustainment of TC efforts. Unmet social needs of patients are a barrier.

IMPLICATIONS

Opportunities exist for increased and improved collaboration among clinical providers with community-based and social services organizations. Increased involvement of primary care providers in such collaborations would improve communication with both the patient and involved providers. Communities with external funding were more likely to implement evidence-based interventions, while those relying on institutional support addressed identified problems with more targeted interventions.

Learning Collaboratives: a Strategy for Quality Improvement and Implementation in Behavioral Health

Learning collaboratives are increasingly used in behavioral health. They generally involve bringing together teams from different organizations and using experts to educate and coach the teams in quality improvement, implementing evidence-based practices, and measuring the effects. Although learning collaboratives have demonstrated some effectiveness in general health care, the evidence is less clear in behavioral health and more rigorous studies are needed. Learning collaboratives may contain a range of elements, and which elements are included in any one learning collaborative varies widely; the unique contribution of each element has not been established. This commentary seeks to clarify the concept of a learning collaborative, highlight its common elements, review evidence of its effectiveness, identify its application in behavioral health, and highlight recommendations to guide technical assistance purveyors and behavioral health providers as they employ learning collaboratives to improve behavioral health access and quality.

Continuous quality improvement at the frontline: One interdisciplinary clinical team's four-year journey after completing a virtual learning program

Background

The Veterans Health Administration (VHA) is the largest integrated health system in the U.S. and has identified the learning health system as a strategic priority. Clinicians and staff engaging in active learning through continuous quality improvement (QI) is a key pillar for learning system maturity. An interdisciplinary frontline team at a VHA medical center participated in the Learn. Engage. Act. Process. (LEAP) virtual coaching program to learn how to conduct multidisciplinary team-based QI cycles of change. These clinicians lead and deliver the MOVE! weight management program, an evidence-based comprehensive lifestyle intervention. The team worked to continuously improve patient weight loss by engaging in incremental learning cycles of change. The aim of this study is to tell the story of this team's learning experience and the resulting positive reinforcing loop with patient outcomes.

Methods

This is a mixed methods case study description of one team that participated in the LEAP Program that provides hands-on QI learning for frontline teams with virtual coaching and a structured curriculum. Autoethnographic qualitative descriptions of team experiences over time illustrate this team's continued engagement in learning loops. Multilevel linear modeling was used to assess patient outcomes before vs after the team's participation in LEAP.

Results

The team's participation in LEAP provided a set of fundamental QI skills and established a commitment to continual learning. Incremental improvements led to significant weight loss for patients who participated in MOVE! after the team completed LEAP (mean = 9.80 pounds; SD 10.43) compared to the pre-LEAP time period (mean = -6.83 pounds; SD 9.63).

Conclusions

Despite competing priorities and time limitations, this team's experiences provide a positive vision of how team engagement in data-driven continuous learning is feasible at the frontline and can lead to higher job satisfaction and stronger teams. These types of team activities provide much-needed backbone to being a mature learning health system.

Implementing Evidence-Based Pressure Injury Prevention Interventions: Veterans Health Administration Quality Improvement Collaborative

BACKGROUND

Pressure injury prevention is a persistent concern in nursing. The Veterans Health Administration implemented a creative approach with successful outcomes across the United States.

PROBLEM

Pressure injury prevention is a measure of nursing quality of care and a high priority in the Veterans Health Administration.

METHODS

A 12-month Virtual Breakthrough Series Collaborative utilizing coaching and group calls was conducted to assist long-term and acute care teams with preventing pressure injuries.

INTERVENTIONS

Interventions from the Veterans Health Administration Skin Bundle were implemented, including pressure-relieving surfaces, novel turning techniques, specialized dressings, and emollients to prevent skin breakdown.

RESULTS

The aggregated pressure injury rate for all teams decreased from Prework to the Action phase from 1.0 to 0.8 per 1000 bed days of care (P = .01). The aggregated pressure injury rates for long-term care units decreased from Prework to Continuous Improvement from 0.8 to 0.4 per 1000 bed days of care (P = .021).

CONCLUSION

The Virtual Breakthrough Series helped reduce pressure injuries.

A cluster randomized controlled trial comparing Virtual Learning Collaborative and Technical Assistance strategies to implement an early palliative care program for patients with advanced cancer and their caregivers: a study protocol

BACKGROUND

Virtual Learning Collaboratives (VLC), learning communities focused on a common purpose, are used frequently in healthcare settings to implement best practices. Yet, there is limited research testing the effectiveness of this approach compared to other implementation strategies. This study evaluates the effectiveness of a VLC compared to Technical Assistance (TA) among community oncology practices implementing ENABLE (Educate, Nurture, Advise, Before Life Ends), an evidence-based, early palliative care telehealth, psycho-educational intervention for patients with newly diagnosed advanced cancer and their caregivers.

METHODS

Using Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) and Proctor's Implementation Outcomes Frameworks, this two-arm hybrid type-III cluster-randomized controlled trial (RCT) will compare two implementation strategies, VLC versus TA, among the 48 National Cancer Institute Community Oncology Research Program (NCORP) practice clusters that have not historically provided palliative care to all patients with advanced cancer. Three cohorts of practice clusters will be randomized to the study arms. Each practice cluster will recruit 15-27 patients and a family caregiver to participate in ENABLE. The primary study outcome is ENABLE uptake (patient level), i.e., the proportion of eligible patients who complete the ENABLE program (receive a palliative care assessment and complete the six ENABLE sessions over 12 weeks). The secondary outcome is overall program implementation (practice cluster level), as measured by the General Organizational Index at baseline, 6, and 12 months. Exploratory aims assess patient and caregiver mood and quality of life outcomes at baseline, 12, and 24 weeks. Practice cluster randomization will seek to keep the proportion of rural practices, practice sizes, and minority patients seen within each practice balanced across the two study arms.

DISCUSSION

This study will advance the field of implementation science by evaluating VLC effectiveness, a commonly used but understudied, implementation strategy. The study will advance the field of palliative care by building the capacity and infrastructure to implement an early palliative care program in community oncology practices.

TRIAL REGISTRATION

Clinicaltrials.gov . NCT04062552; Pre-results. Registered: August 20, 2019. https://clinicaltrials.gov/ct2/show/NCT04062552?term=NCT04062552&draw=2&rank=1.

Rationale, Methodological Quality, and Reporting of Cluster-Randomized Controlled Trials in Critical Care Medicine: A Systematic Review

OBJECTIVE

Compared with individual-patient randomized controlled trials, cluster randomized controlled trials have unique methodological and ethical considerations. We evaluated the rationale, methodological quality, and reporting of cluster randomized controlled trials in critical care studies.

DATA SOURCES

Systematic searches of Medline, Embase, and Cochrane Central Register were performed.

STUDY SELECTION

We included all cluster randomized controlled trials conducted in adult, pediatric, or neonatal critical care units from January 2005 to September 2019.

DATA EXTRACTION

Two reviewers independently screened citations, reviewed full texts, protocols, and supplements of potentially eligible studies, abstracted data, and assessed methodology of included studies.

DATA SYNTHESIS

From 1,902 citations, 59 cluster randomized controlled trials met criteria. Most focused on quality improvement (24, 41%), antimicrobial therapy (9, 15%), or infection control (9, 15%) interventions. Designs included parallel-group (25, 42%), crossover (21, 36%), and stepped-wedge (13, 22%). Concealment of allocation was reported in 21 studies (36%). Thirteen studies (22%) reported at least one method of blinding. The median total sample size was 1,660 patients (interquartile range, 813-4,295); the median number of clusters was 12 (interquartile range, 5-24); and the median patients per cluster was 141 (interquartile range, 54-452). Sample size calculations were reported in 90% of trials, but only 54% met Consolidated Standards of Reporting Trials guidance for sample size reporting. Twenty-seven of the studies (46%) identified a fixed number of available clusters prior to trial commencement, and only nine (15%) prespecified both the number of clusters and patients required to detect the expected effect size. Overall, 36 trials (68%) achieved the total prespecified sample size. When analyzing data, 44 studies (75%) appropriately adjusted for clustering when analyzing the primary outcome. Only 12 (20%) reported an intracluster coefficient (median 0.047 [interquartile range, 0.01-0.13]).

CONCLUSIONS

Cluster randomized controlled trials in critical care typically involve a small and fixed number of relatively large clusters. The reporting of key methodological aspects of these trials is often inadequate.

The LEAP Program: Quality Improvement Training to Address Team Readiness Gaps Identified by Implementation Science Findings

BACKGROUND

Integrating evidence-based innovations (EBIs) into sustained use is challenging; most implementations in health systems fail. Increasing frontline teams' quality improvement (QI) capability may increase the implementation readiness and success of EBI implementation.

OBJECTIVES

Develop a QI training program ("Learn. Engage. Act. Process." (LEAP)) and evaluate its impact on frontline obesity treatment teams to improve treatment delivered within the Veterans Health Administration (VHA).

DESIGN

This was a pre-post evaluation of the LEAP program. MOVE! coordinators (N = 68) were invited to participate in LEAP; 24 were randomly assigned to four starting times. MOVE! coordinators formed teams to work on improvement aims. Pre-post surveys assessed team organizational readiness for implementing change and self-rated QI skills. Program satisfaction, assignment completion, and aim achievement were also evaluated.

PARTICIPANTS

VHA facility-based MOVE! teams.

INTERVENTIONS

LEAP is a 21-week QI training program. Core components include audit and feedback reports, structured curriculum, coaching and learning community, and online platform.

MAIN MEASURES

Organizational readiness for implementing change (ORIC); self-rated QI skills before and after LEAP; assignment completion and aim achievement; program satisfaction.

KEY RESULTS

Seventeen of 24 randomized teams participated in LEAP. Participants' self-ratings across six categories of QI skills increased after completing LEAP (p< 0.0001). The ORIC measure showed no statistically significant change overall; the change efficacy subscale marginally improved (p < 0.08), and the change commitment subscale remained the same (p = 0.66). Depending on the assignment, 35 to 100% of teams completed the assignment. Nine teams achieved their aim. Most team members were satisfied or very satisfied (81-89%) with the LEAP components, 74% intended to continue using QI methods, and 81% planned to continue improvement work.

CONCLUSIONS

LEAP is scalable and does not require travel or time away from clinical responsibilities. While QI skills improved among participating teams and most completed the work, they struggled to do so amid competing clinical priorities.

Failure of central venous catheter insertion and care bundles in a high central line-associated bloodstream infection rate, high bed occupancy hospital

BACKGROUND

Our hospital has several characteristics different from the settings in which the central venous catheter (CVC) care bundle has been implemented so far, that is, care bundles or protocols are not systematically used, and the prevalence of central line-associated bloodstream infections (CLABSI) is high, as is bed occupancy rate. We examined the effectiveness of CVC care bundles.

METHODS

Modified CVC bundles were implemented across all settings of our hospital. During both phases of the study, we collected data on CLABSI, and we monitored CVC insertion and management practices with direct observation audits.

RESULTS

We have studied 913 CVC insertions (454 in PRE and 459 in POST) for 11,871 catheter-days. The incidence of CLABSI was 8.3 per 1,000 catheter-days PRE, and 7.6 per 1,000 catheter-days POST (incidence rate ratio, 0.92; 95% confidence interval, 0.60-1.40). Compliance with the CVC insertion bundle increased from 8.4%-74.3% (P < .0001). The CVC management bundle compliance also increased from 11.4%-57.7% (P < .0001).

CONCLUSIONS

Despite improved compliance after the intervention, implementation of a modified CVC bundle failed to decrease CLABSI incidence. Higher bundle compliance rates may be necessary for a significant decrease in the incidence of CLABSI, along with the appropriate organizational culture and levels of staffing.

Incidence of Central Venous Catheter-Related Bloodstream Infections: Evaluation of Bundle Prevention in Two Intensive Care Units in Central Brazil

Background

Central venous catheter-associated bloodstream infections (CVC-BSIs) have been associated with increased length of hospital stay, mortality, and healthcare costs, especially in intensive care units (ICUs). The aim of this study was to evaluate the incidence density of CVC-BSIs before and after implementation of the bundle in a hospital of infectious and dermatological diseases in Central Brazil.

Methods

A retrospective cohort study was conducted in two ICUs (adult and pediatric) between 2012 and 2015. Two periods were compared to assess the effect of the intervention in incidence density of CVC-BSIs: before and after intervention, related to the stages before and after the implementation of the bundle, respectively.

Results

No significant reduction was observed in the incidence density of CVC-BSIs in adult ICU (incidence rate ratio [IRR]: 0.754; 95.0% CI: 0.349 to 1.621; p-value = 0.469), despite the high bundle application rate in the postintervention period. Similarly, significant reduction in the incidence density in pediatric ICU has not been verified after implementation of the bundle (IRR: 1.148; 95.0% CI: 0.314 to 4.193; p-value = 0.834).

Conclusion

Not significant reduction in the incidence density of CVC-BSIs was observed after bundle implementation in ICUs, suggesting the need to review the use of process, as well as continuing education for staffs in compliance and correct application of the bundle. Further studies are needed to evaluate the effect of bundle in the reduction of incidence density of CVC-BSIs in Brazil.

Reducing the rare event: lessons from the implementation of a ventilator bundle

The ventilator-associated event (VAE) is a potentially avoidable complication of mechanical ventilation (MV) associated with poor outcomes. Although rare, VAEs and other nosocomial events are frequently targeted for quality improvement efforts consistent with the creed to ‘do no harm’. In October 2016, VA Greater Los Angeles (GLA) was in the lowest-performing decile of VA medical centres on a composite measure of quality, owing to GLA’s relatively high VAE rate. To decrease VAEs, we sought to reduce average MV duration of patients with acute respiratory failure to less than 3 days by 1 July 2017. In our first intervention (period 1), intensive care unit (ICU) attending physicians trained residents to use an existing ventilator bundle order set; in our second intervention (period 2), we updated the order set to streamline order entry and incorporate new nurse-driven and respiratory therapist (RT)-driven spontaneous awakening trial (SAT) and spontaneous breathing trial (SBT) protocols. In period 1, the proportion of eligible patients with SAT and SBT orders increased from 29.9% and 51.2% to 67.4% and 72.6%, respectively, with sustained improvements through December 2017. Mean MV duration decreased from 7.2 days at baseline to 5.5 days in period 1 and 4.7 days in period 2; statistical process control charts revealed no significant differences, but the difference between baseline and period 2 MV duration was statistically significant at p=0.049. Bedside audits showed RTs consistently performed indicated SBTs, but there were missed opportunities for SATs due to ICU staff concerns about the SAT protocol. The rarity of VAEs, small population of ventilated patients and infrequent use of sedative infusions at GLA may have decreased the opportunity to achieve staff acceptance and use of the SAT protocol. Quality improvement teams should consider frequency of targeted outcomes when planning interventions; rare events pose challenges in implementation and evaluation of change.

Review of Strategies to Reduce Central Line-Associated Bloodstream Infection (CLABSI) and Catheter-Associated Urinary Tract Infection (CAUTI) in Adult ICUs

Central line-associated bloodstream infection (CLABSI) and catheter-associated urinary tract infection (CAUTI) are costly and morbid. Despite evidence-based guidelines, Some intensive care units (ICUs) continue to have elevated infection rates. In October 2015, we performed a systematic search of the peer-reviewed literature within the PubMed and Cochrane databases for interventions to reduce CLABSI and/or CAUTI in adult ICUs and synthesized findings using a narrative review process. The interventions were categorized using a conceptual model, with stages applicable to both CAUTI and CLABSI prevention: (stage 0) avoid catheter if possible, (stage 1) ensure aseptic placement, (stage 2) maintain awareness and proper care of catheters in place, and (stage 3) promptly remove unnecessary catheters. We also looked for effective components that the 5 most successful (by reduction in infection rates) studies of each infection shared. Interventions that addressed multiple stages within the conceptual model were common in these successful studies. Assuring compliance with infection prevention efforts via auditing and timely feedback were also common. Hospitalists with patient safety interests may find this review informative for formulating quality improvement interventions to reduce these infections.

Prevention of central venous line associated bloodstream infections in adult intensive care units: A systematic review

BACKGROUND

In adult Intensive Care Units, the complexity of patient treatment requirements make the use of central venous lines essential. Despite the potential benefits central venous lines can have for patients, there is a high risk of bloodstream infection associated with these catheters.

AIM

Identify and critique the best available evidence regarding interventions to prevent central venous line associated bloodstream infections in adult intensive care unit patients other than anti-microbial catheters.

METHODS

A systematic review of studies published from January 2007 to February 2016 was undertaken. A systematic search of seven databases was carried out: MEDLINE; CINAHL Plus; EMBASE; PubMed; Cochrane Library; Scopus and Google Scholar. Studies were critically appraised by three independent reviewers prior to inclusion.

RESULTS

Nineteen studies were included. A range of interventions were found to be used for the prevention or reduction of central venous line associated bloodstream infections. These interventions included dressings, closed infusion systems, aseptic skin preparation, central venous line bundles, quality improvement initiatives, education, an extra staff in the Intensive Care Unit and the participation in the 'On the CUSP: Stop Blood Stream Infections' national programme.

CONCLUSIONS

Central venous line associated bloodstream infections can be reduced by a range of interventions including closed infusion systems, aseptic technique during insertion and management of the central venous line, early removal of central venous lines and appropriate site selection.

Adaptation of the Grasha Riechman Student Learning Style Survey and Teaching Style Inventory to assess individual teaching and learning styles in a quality improvement collaborative

BACKGROUND

NIATx200, a quality improvement collaborative, involved 201 substance abuse clinics. Each clinic was randomized to one of four implementation strategies: (a) interest circle calls, (b) learning sessions, (c) coach only or (d) a combination of all three. Each strategy was led by NIATx200 coaches who provided direct coaching or facilitated the interest circle and learning session interventions.

METHODS

Eligibility was limited to NIATx200 coaches (N = 18), and the executive sponsor/change leader of participating clinics (N = 389). Participants were invited to complete a modified Grasha Riechmann Student Learning Style Survey and Teaching Style Inventory. Principal components analysis determined participants' preferred learning and teaching styles.

RESULTS

Responses were received from 17 (94.4 %) of the coaches. Seventy-two individuals were excluded from the initial sample of change leaders and executive sponsors (N = 389). Responses were received from 80 persons (25.2 %) of the contactable individuals. Six learning profiles for the executive sponsors and change leaders were identified: Collaborative/Competitive (N = 28, 36.4 %); Collaborative/Participatory (N = 19, 24.7 %); Collaborative only (N = 17, 22.1 %); Collaborative/Dependent (N = 6, 7.8 %); Independent (N = 3, 5.2 %); and Avoidant/Dependent (N = 3, 3.9 %). NIATx200 coaches relied primarily on one of four coaching profiles: Facilitator (N = 7, 41.2 %), Facilitator/Delegator (N = 6, 35.3 %), Facilitator/Personal Model (N = 3, 17.6 %) and Delegator (N = 1, 5.9 %). Coaches also supported their primary coaching profiles with one of eight different secondary coaching profiles.

CONCLUSIONS

The study is one of the first to assess teaching and learning styles within a QIC. Results indicate that individual learners (change leaders and executive sponsors) and coaches utilize multiple approaches in the teaching and practice-based learning of quality improvement (QI) processes. Identification teaching profiles could be used to tailor the collaborative structure and content delivery. Efforts to accommodate learning styles would facilitate knowledge acquisition enhancing the effectiveness of a QI collaborative to improve organizational processes and outcomes.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT00934141 Registered July 6, 2009. Retrospectively registered.

Effectiveness of insertion and maintenance bundles to prevent central-line-associated bloodstream infections in critically ill patients of all ages: a systematic review and meta-analysis

BACKGROUND

Central-line-associated bloodstream infections (CLABSIs) are a major problem in intensive care units (ICUs) worldwide. We aimed to quantify the effectiveness of central-line bundles (insertion or maintenance or both) to prevent these infections.

METHODS

We searched Embase, MEDLINE OvidSP, Web-of-Science, and Cochrane Library to identify studies reporting the implementation of central-line bundles in adult ICU, paediatric ICU (PICU), or neonatal ICU (NICU) patients. We searched for studies published between Jan 1, 1990, and June 30, 2015. For the meta-analysis, crude estimates of infections were pooled by use of a DerSimonian and Laird random effect model. The primary outcome was the number of CLABSIs per 1000 catheter-days before and after implementation. Incidence risk ratios (IRRs) were obtained by use of random-effects models.

FINDINGS

We initially identified 4337 records, and after excluding duplicates and those ineligible, 96 studies met the eligibility criteria, 79 of which contained sufficient information for a meta-analysis. Median CLABSIs incidence were 5·7 per 1000 catheter-days (range 1·2-46·3; IQR 3·1-9·5) on adult ICUs; 5·9 per 1000 catheter-days (range 2·6-31·1; 4·8-9·4) on PICUs; and 8·4 per 1000 catheter-days (range 2·6-24·1; 3·7-16·0) on NICUs. After implementation of central-line bundles the CLABSI incidence ranged from 0 to 19·5 per 1000 catheter-days (median 2·6, IQR 1·2-4·4) in all types of ICUs. In our meta-analysis the incidence of infections decreased significantly from median 6·4 per 1000 catheter-days (IQR 3·8-10·9) to 2·5 per 1000 catheter-days (1·4-4·8) after implementation of bundles (IRR 0·44, 95% CI 0·39-0·50, p<0·0001; I(2)=89%).

INTERPRETATION

Implementation of central-line bundles has the potential to reduce the incidence of CLABSIs.

FUNDING

None.

The effectiveness of toolkits as knowledge translation strategies for integrating evidence into clinical care: a systematic review

OBJECTIVES

The aim of this systematic review was to evaluate the effectiveness of toolkits as a knowledge translation (KT) strategy for facilitating the implementation of evidence into clinical care. Toolkits include multiple resources for educating and/or facilitating behaviour change.

DESIGN

Systematic review of the literature on toolkits.

METHODS

A search was conducted on MEDLINE, EMBASE, PsycINFO and CINAHL. Studies were included if they evaluated the effectiveness of a toolkit to support the integration of evidence into clinical care, and if the KT goal(s) of the study were to inform, share knowledge, build awareness, change practice, change behaviour, and/or clinical outcomes in healthcare settings, inform policy, or to commercialise an innovation. Screening of studies, assessment of methodological quality and data extraction for the included studies were conducted by at least two reviewers.

RESULTS

39 relevant studies were included for full review; 8 were rated as moderate to strong methodologically with clinical outcomes that could be somewhat attributed to the toolkit. Three of the eight studies evaluated the toolkit as a single KT intervention, while five embedded the toolkit into a multistrategy intervention. Six of the eight toolkits were partially or mostly effective in changing clinical outcomes and six studies reported on implementation outcomes. The types of resources embedded within toolkits varied but included predominantly educational materials.

CONCLUSIONS

Future toolkits should be informed by high-quality evidence and theory, and should be evaluated using rigorous study designs to explain the factors underlying their effectiveness and successful implementation.

Implementing a user-driven online quality improvement toolkit for cancer care

PURPOSE

Peer-to-peer collaboration within integrated health systems requires a mechanism for sharing quality improvement lessons. The Veterans Health Administration (VA) developed online compendia of tools linked to specific cancer quality indicators. We evaluated awareness and use of the toolkits, variation across facilities, impact of social marketing, and factors influencing toolkit use.

METHODS

A diffusion of innovations conceptual framework guided the collection of user activity data from the Toolkit Series SharePoint site and an online survey of potential Lung Cancer Care Toolkit users.

RESULTS

The VA Toolkit Series site had 5,088 unique visitors in its first 22 months; 5% of users accounted for 40% of page views. Social marketing communications were correlated with site usage. Of survey respondents (n = 355), 54% had visited the site, of whom 24% downloaded at least one tool. Respondents' awareness of the lung cancer quality performance of their facility, and facility participation in quality improvement collaboratives, were positively associated with Toolkit Series site use. Facility-level lung cancer tool implementation varied widely across tool types.

CONCLUSION

The VA Toolkit Series achieved widespread use and a high degree of user engagement, although use varied widely across facilities. The most active users were aware of and active in cancer care quality improvement. Toolkit use seemed to be reinforced by other quality improvement activities. A combination of user-driven tool creation and centralized toolkit development seemed to be effective for leveraging health information technology to spread disease-specific quality improvement tools within an integrated health care system.

The physician mentored implementation model: a promising quality improvement framework for health care change

Quality improvement (QI) efforts hold great promise for improving care delivery. However, hospitals often struggle with QI implementation and fail to sustain improvement in either process changes or patient outcomes. Physician mentored implementation (PMI) is a novel approach that promotes the success and sustainability of QI initiatives at hospitals. It leverages the expertise of external physician mentors who coach QI teams to implement interventions at their local hospitals. The PMI model includes five core components: (1) a hospital self-assessment tool, (2) a face-to-face training session including direct interaction with a physician mentor, (3) a guided continuous quality improvement and systems approach, (4) yearlong individual physician mentoring, and (5) a learning community supported by a resource center, listserv, and webinars. Mentors provide content and process expertise, rather than offering "one-size-fits-all" technical assistance that might not be sustained after the mentoring year ends. Mentors support and motivate QI teams throughout the planning and implementation phases of their interventions, help to engage hospital leadership, garner local physician buy-in, and address institutional barriers. Mentors also guide hospitals to identify opportunities for the adaptation and customization of original evidence-based models of care while ensuring the fidelity of those models. More than 350 hospitals have used the PMI model to implement successful national and statewide QI initiatives. Academic medical centers are charged with improving the health of patients and reengineering care delivery; thus, they serve as the ideal source for physician mentors and can act as leaders in implementing QI projects using the PMI model.

Impact of the Development of a Regional Collaborative to Reduce 30-Day Heart Failure Readmissions

Thirty-day heart failure readmissions can be reduced if multiple interventions, such as 7-day postdischarge follow-up, are implemented, but this task is challenging for health systems. Ten hospitals participated in a multisystem collaborative implementing evidence-based strategies. The overall 30-day readmission rate was reduced more in the collaborating hospitals than in the noncollaborating hospitals (from 29.32% to 27.66% vs from 27.66% to 26.03%, P = .008). Regional collaboration between health care systems within a quality improvement project was associated with reduced 30-day readmission.

Multimethod evaluation of the VA's peer-to-peer Toolkit for patient-centered medical home implementation

BACKGROUND

Effective implementation of the patient-centered medical home (PCMH) in primary care practices requires training and other resources, such as online toolkits, to share strategies and materials. The Veterans Health Administration (VA) developed an online Toolkit of user-sourced tools to support teams implementing its Patient Aligned Care Team (PACT) medical home model.

OBJECTIVE

To present findings from an evaluation of the PACT Toolkit, including use, variation across facilities, effect of social marketing, and factors influencing use.

INNOVATION

The Toolkit is an online repository of ready-to-use tools created by VA clinic staff that physicians, nurses, and other team members may share, download, and adopt in order to more effectively implement PCMH principles and improve local performance on VA metrics.

DESIGN

Multimethod evaluation using: (1) website usage analytics, (2) an online survey of the PACT community of practice's use of the Toolkit, and (3) key informant interviews.

PARTICIPANTS

Survey respondents were PACT team members and coaches (n = 544) at 136 VA facilities. Interview respondents were Toolkit users and non-users (n = 32).

MEASURES

For survey data, multivariable logistic models were used to predict Toolkit awareness and use. Interviews and open-text survey comments were coded using a "common themes" framework. The Consolidated Framework for Implementation Research (CFIR) guided data collection and analyses.

KEY RESULTS

The Toolkit was used by 6,745 staff in the first 19 months of availability. Among members of the target audience, 80 % had heard of the Toolkit, and of those, 70 % had visited the website. Tools had been implemented at 65 % of facilities. Qualitative findings revealed a range of user perspectives from enthusiastic support to lack of sufficient time to browse the Toolkit.

CONCLUSIONS

An online Toolkit to support PCMH implementation was used at VA facilities nationwide. Other complex health care organizations may benefit from adopting similar online peer-to-peer resource libraries.

Project BOOST: effectiveness of a multihospital effort to reduce rehospitalization

BACKGROUND

Rehospitalization is a prominent target for healthcare quality improvement and performance-based reimbursement. The generalizability of existing evidence on best practices is unknown.

OBJECTIVE

To determine the effect of Project BOOST (Better Outcomes for Older adults through Safe Transitions) on rehospitalization rates and length of stay.

DESIGN

Semicontrolled pre-post study.

SETTING/PARTICIPANTS

Volunteer sample of 11 hospitals varying in geography, size, and academic affiliation.

INTERVENTION

Hospitals implemented Project BOOST-recommended tools supported by an external quality improvement physician mentor.

METHODS

Pre-post changes in readmission rates and length of stay within BOOST units, and between BOOST units and site-designated control units.

RESULTS

The average rate of 30-day rehospitalization in BOOST units was 14.7% prior to implementation and 12.7% 12 months later (P = 0.010), reflecting an absolute reduction of 2% and a relative reduction of 13.6%. Rehospitalization rates for matched control units were 14.0% in the preintervention period and 14.1% in the postintervention period (P = 0.831). The mean absolute reduction in readmission rates in BOOST units compared to control units was 2.0% (P = 0.054 for signed rank test comparing differences in readmission rate reduction in BOOST units compared to site-matched control units).

CONCLUSIONS

Participation in Project BOOST appeared to be associated with a decrease in readmission rates.

Interventions to improve professional adherence to guidelines for prevention of device-related infections

BACKGROUND

Healthcare-associated infections (HAIs) are a major threat to patient safety, and are associated with mortality rates varying from 5% to 35%. Important risk factors associated with HAIs are the use of invasive medical devices (e.g. central lines, urinary catheters and mechanical ventilators), and poor staff adherence to infection prevention practices during insertion and care for the devices when in place. There are specific risk profiles for each device, but in general, the breakdown of aseptic technique during insertion and care for the device, as well as the duration of device use, are important factors for the development of these serious and costly infections.

OBJECTIVES

To assess the effectiveness of different interventions, alone or in combination, which target healthcare professionals or healthcare organisations to improve professional adherence to infection control guidelines on device-related infection rates and measures of adherence.

SEARCH METHODS

We searched the following electronic databases for primary studies up to June 2012: the Cochrane Effective Paractice and Organisation of Care (EPOC) Group Specialised Register, the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, EMBASE, and CINAHL. We searched reference lists and contacted authors of included studies. We also searched the Cochrane Database of Systematic Reviews and Database of Abstracts of Reviews of Effectiveness (DARE) for related reviews.

SELECTION CRITERIA

We included randomised controlled trials (RCTs), non-randomised controlled trials (NRCTs), controlled before-after (CBA) studies and interrupted time series (ITS) studies that complied with the Cochrane EPOC Group methodological criteria, and that evaluated interventions to improve professional adherence to guidelines for the prevention of device-related infections.

DATA COLLECTION AND ANALYSIS

Two review authors independently extracted data and assessed the risk of bias of each included study using the Cochrane EPOC 'Risk of bias' tool. We contacted authors of original papers to obtain missing information.

MAIN RESULTS

We included 13 studies: one cluster randomised controlled trial (CRCT) and 12 ITS studies, involving 40 hospitals, 51 intensive care units (ICUs), 27 wards, and more than 3504 patients and 1406 healthcare professionals. Six of the included studies targeted adherence to guidelines to prevent central line-associated blood stream infections (CLABSIs); another six studies targeted adherence to guidelines to prevent ventilator-associated pneumonia (VAP), and one study focused on interventions to improve urinary catheter practices. We judged all included studies to be at moderate or high risk of bias.The largest median effect on rates of VAP was found at nine months follow-up with a decrease of 7.36 (-10.82 to 3.14) cases per 1000 ventilator days (five studies and 15 sites). The one included cluster randomised controlled trial (CRCT) observed, improved urinary catheter practices five weeks after the intervention (absolute difference 12.2 percentage points), however, the statistical significance of this is unknown given a unit of analysis error. It is worth noting that N = 6 interventions that did result in significantly decreased infection rates involved more than one active intervention, which in some cases, was repeatedly administered over time, and further, that one intervention involving specialised oral care personnel showed the largest step change (-22.9 cases per 1000 ventilator days (standard error (SE) 4.0), and also the largest slope change (-6.45 cases per 1000 ventilator days (SE 1.42, P = 0.002)) among the included studies. We attempted to combine the results for studies targeting the same indwelling medical device (central line catheters or mechanical ventilators) and reporting the same outcomes (CLABSI and VAP rate) in two separate meta-analyses, but due to very high statistical heterogeneity among included studies (I(2) up to 97%), we did not retain these analyses. Six of the included studies reported post-intervention adherence scores ranging from 14% to 98%. The effect on rates of infection were mixed and the effect sizes were small, with the largest median effect for the change in level (interquartile range (IQR)) for the six CLABSI studies being observed at three months follow-up was a decrease of 0.6 (-2.74 to 0.28) cases per 1000 central line days (six studies and 36 sites). This change was not sustained over longer follow-up times.

AUTHORS' CONCLUSIONS

The low to very low quality of the evidence of studies included in this review provides insufficient evidence to determine with certainty which interventions are most effective in changing professional behaviour and in what contexts. However, interventions that may be worth further study are educational interventions involving more than one active element and that are repeatedly administered over time, and interventions employing specialised personnel, who are focused on an aspect of care that is supported by evidence e.g. dentists/dental auxiliaries performing oral care for VAP prevention.

Decreasing unnecessary utilization in acute bronchiolitis care: results from the value in inpatient pediatrics network

BACKGROUND

Acute viral bronchiolitis is the most common diagnosis resulting in hospital admission in pediatrics. Utilization of non-evidence-based therapies and testing remains common despite a large volume of evidence to guide quality improvement efforts.

OBJECTIVE

Our objective was to reduce utilization of unnecessary therapies in the inpatient care of bronchiolitis across a diverse network of clinical sites.

METHODS

We formed a voluntary quality improvement collaborative of pediatric hospitalists for the purpose of benchmarking the use of bronchodilators, steroids, chest radiography, chest physiotherapy, and viral testing in bronchiolitis using hospital administrative data. We shared resources within the network, including protocols, scores, order sets, and key bibliographies, and established group norms for decreasing utilization.

RESULTS

Aggregate data on 11,568 hospitalizations for bronchiolitis from 17 centers was analyzed for this report. The network was organized in 2008. By 2010, we saw a 46% reduction in overall volume of bronchodilators used, a 3.4 dose per patient absolute decrease in utilization (95% confidence interval [CI] 1.4-5.8). Overall exposure to any dose of bronchodilator decreased by 12 percentage points as well (95% CI 5%-25%). There was also a statistically significant decline in chest physiotherapy usage, but not for steroids, chest radiography, or viral testing.

CONCLUSIONS

Benchmarking within a voluntary pediatric hospitalist collaborative facilitated decreased utilization of bronchodilators and chest physiotherapy in bronchiolitis.