Think twice: A cognitive perspective of an antibiotic timeout intervention to improve antibiotic use

Antimicrobial physician and pharmacist experience and perception of an antimicrobial Self-Stewardship Time-Out Program (SSTOP) intervention at eight Veterans' Affairs medical centers

We explored experiences and perceptions surrounding the Self-Stewardship Time-Out Program (SSTOP) intervention across implementation sites to improve antimicrobial use. Semistructured qualitative interviews were conducted with Antibiotic Stewardship physicians and pharmacists, from which 5 key themes emerged. SSTOP may serve to achieve sustainable promotion of antibiotic use improvements.

Systematic user-centered design of a prototype clinical decision support system for glaucoma

Purpose

To rigorously develop a prototype clinical decision support (CDS) system to help clinicians determine the appropriate timing for follow-up visual field testing for patients with glaucoma and to identify themes regarding the context of use for glaucoma CDS systems, design requirements, and design solutions to meet these requirements.

Design

Semistructured qualitative interviews and iterative design cycles.

Participants

Clinicians who care for patients with glaucoma, purposefully sampled to ensure a representation of a range of clinical specialties (glaucoma specialist, general ophthalmologist, optometrist) and years in clinical practice.

Methods

Using the established User-Centered Design Process framework, we conducted semistructured interviews with 5 clinicians that addressed the context of use and design requirements for a glaucoma CDS system. We analyzed the interviews using inductive thematic analysis and grounded theory to generate themes regarding the context of use and design requirements. We created design solutions to address these requirements and used iterative design cycles with the clinicians to refine the CDS prototype.

Main Outcome Measures

Themes regarding decision support for determining the timing of visual field testing for patients with glaucoma, CDS design requirements, and CDS design features.

Results

We identified 9 themes that addressed the context of use for the CDS system, 9 design requirements for the prototype CDS system, and 9 design features intended to address these design requirements. Key design requirements included the preservation of clinician autonomy, incorporation of currently used heuristics, compilation of data, and increasing and communicating the level of certainty regarding the decision. After completing 3 iterative design cycles using this preliminary CDS system design solution, the design was satisfactory to the clinicians and was accepted as our prototype glaucoma CDS system.

Conclusions

We used a systematic design process based on the established User-Centered Design Process to rigorously develop a prototype glaucoma CDS system, which will be used as a starting point for a future, large-scale iterative refinement and implementation process. Clinicians who care for patients with glaucoma need CDS systems that preserve clinician autonomy, compile and present data, incorporate currently used heuristics, and increase and communicate the level of certainty regarding the decision.

Financial Disclosures

Proprietary or commercial disclosure may be found after the references.

Digital interventions for antimicrobial prescribing and monitoring: a qualitative meta-synthesis of factors influencing user acceptance

OBJECTIVE

To understand and synthesize factors influencing user acceptance of digital interventions used for antimicrobial prescribing and monitoring in hospitals.

MATERIALS AND METHODS

A meta-synthesis was conducted to identify qualitative studies that explored user acceptance of digital interventions for antimicrobial prescribing and/or monitoring in hospitals. Databases were searched and qualitative data were extracted and systematically classified using the unified theory of acceptance and use of technology (UTAUT) model.

RESULTS

Fifteen qualitative studies met the inclusion criteria. Eleven papers used interviews and four used focus groups. Most digital interventions evaluated in studies were decision support for prescribing (n = 13). Majority of perceptions were classified in the UTAUT performance expectancy domain in perceived usefulness and relative advantage constructs. Key facilitators in this domain included systems being trusted and credible sources of information, improving performance of tasks and increasing efficiency. Reported barriers were that interventions were not considered useful for all settings or patient conditions. Facilitating conditions was the second largest domain, which highlights the importance of users having infrastructure to support system use. Digital interventions were viewed positively if they were compatible with values, needs, and experiences of users.

CONCLUSIONS

User perceptions that drive users to accept and utilize digital interventions for antimicrobial prescribing and monitoring were predominantly related to performance expectations and facilitating conditions. To ensure digital interventions for antimicrobial prescribing are accepted and used, we recommend organizations ensure systems are evaluated and benefits are conveyed to users, that utility meets expectations, and that appropriate infrastructure is in place to support use.

A Scoping Review of the Use of Social and Behavioral Change in Acute Care Antimicrobial Stewardship Initiatives

Purpose: Antimicrobial stewardship (AS) initiatives are implemented with a goal of reducing antimicrobial resistance. It is unknown exactly how many acute care AS initiatives have since been based on social and behavioral theory. The purpose of this scoping review is to provide an updated review of theory-informed acute care AS initiatives in the published literature, including how social and behavioral theories have been used in the described interventions. Methods: PubMed, EMBASE, CINAHL, PsycINFO, and ProQuest Dissertations were searched using a combination of AS, acute care, and social and behavioral theory search terms from April 2011 to November 2019. Using both an initial review of titles and abstracts and a second review of full text, a total of 4 articles were identified after a review of 2014 records. Each article was coded using a guide that abstracted details of study methods, the AS intervention, and use of theory based on a validated theory coding scheme. Results: The interventions included combinations of decision-making tools, provider education, and prospective audit and feedback. Two studies included an evaluation of the described initiative, with findings indicating improvement in antimicrobial use. All interventions utilized theory in developing AS interventions. However, gaps were evident in the use of theory in the evaluations, including inconsistent measurement of theory constructs and lack of testing of the theory. Conclusion: AS interventions are frequently published; however, theory-based acute care AS interventions are not commonly described. More consistent and comprehensive utilization of social and behavioral theories may enhance effectiveness of AS programs.

Social dynamics of a population-level dashboard for antimicrobial stewardship: A qualitative analysis

OBJECTIVE

To evaluate antimicrobial stewards' experiences of using a dashboard display integrating local and national antibiotic use data implemented in the U.S. Department of Veterans Affairs (VA). This paper reports early formative evaluation.

DESIGN

Qualitative interviewing.

SETTING

Eight VA hospitals participated with established antimicrobial stewardship (AS) programs participated in the pilot.

PARTICIPANTS

Six infectious disease physicians and eight clinical pharmacists agreed to be interviewed (n = 14).

METHODS

A 3-part qualitative interview script was used involving a description of local stewardship activities, a Critical Incident description of dashboard use, and general questions regarding attitudes towards the tool. An inductive open coding approach was used for analysis.

RESULTS

We found 4 themes showing the complexities of using stewardship tools: (1) Data validity is socially negotiated; (2) Performance feedback motivates and persuades social goals when situated in an empirical distribution; (3) Shared problem awareness is aided by authoritative data; and (4) The AS dashboard encourages connections with local quality improvement culture.

CONCLUSIONS

Social dimensions of AS tool use emerged as distinct from, and equally important as decision support provided by the dashboard. Successful stewardship tools should be designed to support both the social and cognitive needs of users.

Nudging clinicians: A systematic scoping review of the literature

BACKGROUND

While the quality of medical care delivered by physicians can be very good, it can also be inconsistent and feature behaviours that are entrenched despite updated information and evidence. The "nudge" paradigm for behaviour change is being used to bring clinical practice in line with desired standards. The premise is that behaviour can be voluntarily shifted by making particular choices instinctively appealing. We reviewed studies that are explicit about their use of nudge theory in influencing clinician behaviour.

METHODS

Databases were searched from April 2008 (the publication date of the book that introduced nudge theory to a wider audience) to November 2018, inclusive. The search strategy and narrative review of results addressed the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews.

RESULTS

22 studies were identified. Randomized trials or pre-post comparisons were generally used in community-based settings; single-site pre-post studies were favoured in hospitals. The studies employed eight intervention types: active choice; patient chart redesign; default and default alerts; partitioning of prescription menus; audit and feedback; commitment messages; peer comparisons; and redirection of workflow. Three core cognitive factors underpinned the eight interventions: bias towards prominent choices (salience); predisposition to social norms; and bias towards time or cost savings.

CONCLUSIONS

Published studies that are explicit about their use of nudge theory are few in number and diverse in their settings, targets, and results. Default and chart re-design interventions reported the most substantial improvements in adherence to evidence and guideline-based practice. Studies that are explicit in their use of nudge theory address the widespread failure of clinical practice studies to identify theoretical frameworks for interventions. However, few studies identified in our review engaged in research to understand the contextual and site-specific barriers to a desired behaviour before designing a nudge intervention.

Cognitive bias: how understanding its impact on antibiotic prescribing decisions can help advance antimicrobial stewardship

The way clinicians think about decision-making is evolving. Human decision-making shifts between two modes of thinking, either fast/intuitive (Type 1) or slow/deliberate (Type 2). In the healthcare setting where thousands of decisions are made daily, Type 1 thinking can reduce cognitive load and help ensure decision making is efficient and timely, but it can come at the expense of accuracy, leading to systematic errors, also called cognitive biases. This review provides an introduction to cognitive bias and provides explanation through patient vignettes of how cognitive biases contribute to suboptimal antibiotic prescribing. We describe common cognitive biases in antibiotic prescribing both from the clinician and the patient perspective, including hyperbolic discounting (the tendency to favour small immediate benefits over larger more distant benefits) and commission bias (the tendency towards action over inaction). Management of cognitive bias includes encouraging more mindful decision making (e.g., time-outs, checklists), improving awareness of one's own biases (i.e., meta-cognition), and designing an environment that facilitates safe and accurate decision making (e.g., decision support tools, nudges). A basic understanding of cognitive biases can help explain why certain stewardship interventions are more effective than others and may inspire more creative strategies to ensure antibiotics are used more safely and more effectively in our patients.

Post-Prescription Review with Threat of Infectious Disease Consultation and Sustained Reduction in Meropenem Use Over Four Years

BACKGROUND

Following a meropenem shortage, we implemented a post-prescription review with feedback (PPRF) in November 2015 with mandatory infectious disease (ID) consultation for all meropenem and imipenem courses > 72 hours. Providers were made aware of the policy via an electronic alert at the time of ordering.

METHODS

A retrospective study was conducted at the University of Washington Medical Center (UWMC) and Harborview Medical Center (HMC) to evaluate the impact of the policy on antimicrobial consumption and clinical outcomes pre- and post-intervention during a 6-year period. Antimicrobial use was tracked using days of therapy (DOT) per 1,000 patient-days, and data were analyzed by an interrupted time series.

RESULTS

There were 4,066 and 2,552 patients in the pre- and post-intervention periods, respectively. Meropenem and imipenem use remained steady until the intervention, when a marked reduction in DOT/1,000 patient-days occurred at both hospitals (UWMC: percentage change -72.1%, (95% CI -76.6, -66.9), P & 0.001; HMC: percentage change -43.6%, (95% CI -59.9, -20.7), P = 0.001). Notably, although the intervention did not address antibiotic use until 72 hours after initiation, there was a significant decline in meropenem and imipenem initiation ("first starts") in the post-intervention period, with a 64.9% reduction (95% CI 58.7, 70.2; P &0.001) at UWMC and 44.7% reduction (95% CI 28.1, 57.4; P & 0.001) at HMC.

CONCLUSIONS

Mandatory ID consultation and PPRF for meropenem and imipenem beyond 72 hours resulted in a significant and sustained reduction in the use of these antibiotics and notably impacted their up-front usage.

Diagnosing, fast and slow

Diagnostic error is increasingly recognised as a source of significant morbidity and mortality in medicine. In this article, we will attempt to address several questions relating to clinical decision making; How do we decide on a diagnosis? Why do we so often get it wrong? Can we improve our critical faculties?We begin by describing a clinical vignette in which a medical error occurred and resulted in an adverse outcome for a patient. This case leads us to the concepts of heuristic thinking and cognitive bias. We then discuss how this is relevant to our current clinical paradigm, examples of heuristic thinking and potential mechanisms to mitigate bias.The aim of this article is to increase awareness of the role that cognitive bias and heuristic thinking play in medical decision making. We hope to motivate clinicians to reflect on their own patterns of thinking with an overall aim of improving patient care.

Antimicrobial stewardship: The influence of behavioral nudging on renal-function-based appropriateness of dosing

Failure to adjust doses may contribute to adverse events. We evaluated the effectiveness of providing the estimated glomerular filtration rate on appropriateness of dosing for antimicrobials. The approach increased appropriateness of dosing from 33.9% to 41.4% (P < .001). Nudging prescription behavior can boost strategies for adequate antimicrobial prescription.

Teaching Clinical Reasoning and Critical Thinking: From Cognitive Theory to Practical Application

Teaching clinical reasoning is challenging, particularly in the time-pressured and complicated environment of the ICU. Clinical reasoning is a complex process in which one identifies and prioritizes pertinent clinical data to develop a hypothesis and a plan to confirm or refute that hypothesis. Clinical reasoning is related to and dependent on critical thinking skills, which are defined as one's capacity to engage in higher cognitive skills such as analysis, synthesis, and self-reflection. This article reviews how an understanding of the cognitive psychological principles that contribute to effective clinical reasoning has led to strategies for teaching clinical reasoning in the ICU. With familiarity with System 1 and System 2 thinking, which represent intuitive vs analytical cognitive processing pathways, respectively, the clinical teacher can use this framework to identify cognitive patterns in clinical reasoning. In addition, the article describes how internal and external factors in the clinical environment can affect students' and trainees' clinical reasoning abilities, as well as their capacity to understand and incorporate strategies for effective critical thinking into their practice. Utilizing applicable cognitive psychological theory, the relevant literature on teaching clinical reasoning is reviewed, and specific strategies to effectively teach clinical reasoning and critical thinking in the ICU and other clinical settings are provided. Definitions, operational descriptions, and justifications for a variety of teaching interventions are discussed, including the "one-minute preceptor" model, the use of concept or mechanism maps, and cognitive de-biasing strategies.

Forecasting Implementation, Adoption, and Evaluation Challenges for an Electronic Game-Based Antimicrobial Stewardship Intervention: Co-Design Workshop With Multidisciplinary Stakeholders

BACKGROUND

Serious games have been proposed to address the lack of engagement and sustainability traditionally affecting interventions aiming to improve optimal antibiotic use among hospital prescribers.

OBJECTIVE

The goal of the research was to forecast gaps in implementation, adoption and evaluation of game-based interventions, and co-design solutions with antimicrobial clinicians and digital and behavioral researchers.

METHODS

A co-development workshop with clinicians and academics in serious games, antimicrobials, and behavioral sciences was organized to open the International Summit on Serious Health Games in London, United Kingdom, in March 2018. The workshop was announced on social media and online platforms. Attendees were asked to work in small groups provided with a laptop/tablet and the latest version of the game On call: Antibiotics. A workshop leader guided open group discussions around implementation, adoption, and evaluation threats and potential solutions. Workshop summary notes were collated by an observer.

RESULTS

There were 29 participants attending the workshop. Anticipated challenges to resolve reflected implementation threats such as an inadequate organizational arrangement to scale and sustain the use of the game, requiring sufficient technical and educational support and a streamlined feedback mechanism that made best use of data arriving from the game. Adoption threats included collective perceptions that a game would be a ludic rather than professional tool and demanding efforts to integrate all available educational solutions so none are seen as inferior. Evaluation threats included the need to combine game metrics with organizational indicators such as antibiotic use, which may be difficult to enable.

CONCLUSIONS

As with other technology-based interventions, deploying game-based solutions requires careful planning on how to engage and support clinicians in their use and how best to integrate the game and game outputs onto existing workflows. The ludic characteristics of the game may foster perceptions of unprofessionalism among gamers, which would need buffering from the organization.

Evaluation of an electronic antimicrobial time-out on antimicrobial utilization at a large health system

We evaluated the impact of an electronic health record based 72-hour antimicrobial time-out (ATO) on antimicrobial utilization. We observed that 6 hours after the ATO, 21% of empiric antimicrobials were discontinued or de-escalated. There was a significant reduction in the duration of antimicrobial therapy but no impact on overall antimicrobial usage metrics.

A cognitive forcing tool to mitigate cognitive bias - a randomised control trial

BACKGROUND

Cognitive bias is an important source of diagnostic error yet is a challenging area to understand and teach. Our aim was to determine whether a cognitive forcing tool can reduce the rates of error in clinical decision making. A secondary objective was to understand the process by which this effect might occur.

METHODS

We hypothesised that using a cognitive forcing tool would reduce diagnostic error rates. To test this hypothesis, a novel online case-based approach was used to conduct a single blinded randomized clinical trial conducted from January 2017 to September 2018. In addition, a qualitative series of "think aloud" interviews were conducted with 20 doctors from a UK teaching hospital in 2018. The primary outcome was the diagnostic error rate when solving bias inducing clinical vignettes. A volunteer sample of medical professionals from across the UK, Republic of Ireland and North America. They ranged in seniority from medical student to Attending Physician.

RESULTS

Seventy six participants were included in the study. The data showed doctors of all grades routinely made errors related to cognitive bias. There was no difference in error rates between groups (mean 2.8 cases correct in intervention vs 3.1 in control group, 95% CI -0.94 - 0.45 P = 0.49). The qualitative protocol revealed that the cognitive forcing strategy was well received and a produced a subjectively positive impact on doctors' accuracy and thoughtfulness in clinical cases.

CONCLUSIONS

The quantitative data failed to show an improvement in accuracy despite a positive qualitative experience. There is insufficient evidence to recommend this tool in clinical practice, however the qualitative data suggests such an approach has some merit and face validity to users.

Impact of resuscitation fluid bag size availability on volume of fluid administration in the intensive care unit

BACKGROUND

Iatrogenic fluid overload is associated with increased mortality in the intensive care unit (ICU). Decisions on fluid therapy may, at times, be based on other factors than physiological endpoints. We hypothesized that because of psychological factors volume of available fluid bags would affect the amount of resuscitation fluid administered to ICU patients.

METHODS

We performed a prospective intervention cross-over study at 3 Swedish ICUs by replacing the standard resuscitation fluid bag of Ringer's Acetate 1000 mL with 500 mL bags (intervention group) for 5 separate months and then compared it with the standard bag size for 5 months (control group). Primary endpoint was the amount of Ringer's Acetate per patient during ICU stay. Secondary endpoints were differences between the groups in cumulative fluid balance and change in body weight, hemoglobin and creatinine levels, urine output, acute kidney failure (measured as the need for renal replacement therapy, RRT) and 90-day mortality.

RESULTS

Six hundred and thirty-five ICU patients were included (291 in the intervention group, 344 in the control group). There was no difference in the amount of resuscitation fluid per patient during the ICU stay (2200 mL [1000-4500 median IQR] vs 2245 mL [1000-5630 median IQR]), RRT rate (11 vs 9%), 90-day mortality (11 vs 10%) or total fluid balance between the groups. The daily amount of Ringer's acetate administered per day was lower in the intervention group (1040 (280-2000) vs 1520 (460-3000) mL; P = .03).

CONCLUSIONS

The amount of resuscitation fluid administered to ICU patients was not affected by the size of the available fluid bags. However, altering fluid bag size could have influenced fluid prescription behavior.

Antibiotic Use in the Intensive Care Unit: Optimization and De-Escalation

Appropriate antimicrobial therapy is essential to ensuring positive patient outcomes. Inappropriate or suboptimal utilization of antibiotics can lead to increased length of stay, multidrug-resistant infections, and mortality. Critically ill intensive care patients, particularly those with severe sepsis and septic shock, are at risk of antibiotic failure and secondary infections associated with incorrect antibiotic use. Through the initiation of active empiric antibiotic therapy based upon local susceptibilities, daily evaluation of signs and symptoms of infection and narrowing of antibiotic therapy when feasible, providers can streamline the treatment of common intensive care unit (ICU) infections. Optimizing antibiotic dosing through prolonged infusions can be beneficial in intensive care populations with altered pharmacokinetics. Antimicrobial stewardship teams can assist ICU providers in managing and implementing these tactics. This review will discuss the current literature on antibiotic use in the ICU applying antimicrobial stewardship strategies. Based upon the most recent evidence, ICUs would benefit from employing empiric guidelines for antibiotic use, collecting appropriate specimens and implementing molecular diagnostics, optimizing the dosing of antibiotics, and reducing the duration of total therapy. These strategies for antibiotic use have the potential to enhance patient care while preventing adverse outcomes.