Using 'nudge' principles for order set design: a before and after evaluation of an electronic prescribing template in critical care

Effectiveness of non-interruptive nudge interventions in electronic health records to improve the delivery of care in hospitals: a systematic review

OBJECTIVES

To describe the application of nudges within electronic health records (EHRs) and their effects on inpatient care delivery, and identify design features that support effective decision-making without the use of interruptive alerts.

MATERIALS AND METHODS

We searched Medline, Embase, and PsychInfo (in January 2022) for randomized controlled trials, interrupted time-series and before-after studies reporting effects of nudge interventions embedded in hospital EHRs to improve care. Nudge interventions were identified at full-text review, using a pre-existing classification. Interventions using interruptive alerts were excluded. Risk of bias was assessed using the ROBINS-I tool (Risk of Bias in Non-randomized Studies of Interventions) for non-randomized studies or the Cochrane Effective Practice and Organization of Care Group methodology for randomized trials. Study results were summarized narratively.

RESULTS

We included 18 studies evaluating 24 EHR nudges. An improvement in care delivery was reported for 79.2% (n = 19; 95% CI, 59.5-90.8) of nudges. Nudges applied were from 5 of 9 possible nudge categories: change choice defaults (n = 9), make information visible (n = 6), change range or composition of options (n = 5), provide reminders (n = 2), and change option-related effort (n = 2). Only one study had a low risk of bias. Nudges targeted ordering of medications, laboratory tests, imaging, and appropriateness of care. Few studies evaluated long-term effects.

DISCUSSION

Nudges in EHRs can improve care delivery. Future work could explore a wider range of nudges and evaluate long-term effects.

CONCLUSION

Nudges can be implemented in EHRs to improve care delivery within current system capabilities; however, as with all digital interventions, careful consideration of the sociotechnical system is crucial to enhance their effectiveness.

Impact of computerised provider order entry on the quality and quantity of clinical information included with investigation requests: an interrupted time series analysis

INTRODUCTION

Relevant clinical information is vital to inform the analytical and interpretative phases of most investigations. The aim of this study is to evaluate the impact of implementation of computerised provider order entry (CPOE), featuring order-specific electronic order entry forms (eOEFs), on the quality and quantity of clinical information included with investigation requests.

METHODS

The CPOE module of a commercially available electronic health record (Cerner Millennium) was implemented at a large, tertiary care centre. The laboratory information management system was interrogated to collect data on specimens sent for microbiological culture 1 year before implementation of CPOE (2018), immediately post implementation (2019) and 6 months post implementation (2020). An interrupted time series analysis was performed, using text mining, to evaluate the quality and quantity of free-text clinical information.

RESULTS

In total, 39 919 specimens were collected from 16 458 patients. eOEFs were used to place 10 071 out of 13 735 orders in 2019 (73.3%), and 9155 out of 12 229 orders in 2020 (74.9%). No clinical details were included with 653 out of 39 919 specimens (1.6%), of which 22 (3.4%) were ordered using eOEFs. The median character count increased from 14 in 2018, to 41 in 2019, and 38 in 2020. An anti-infective agent was specified in 581 out of 13 955 requests (4.2%) in 2018; 5545 out of 13 735 requests (40.4%) in 2019; and 5215 out of 12 229 requests (42.6%) in 2020. Ciprofloxacin or piperacillin-tazobactam (Tazocin) were mentioned in the clinical details included with 421 out of 15 335 urine culture requests (2.7%), of which 406 (96.3%) were ordered using eOEFs. Subsequent detection of in vitro non-susceptibility led to a change in anti-infective therapy for five patients.

CONCLUSIONS

Implementation of CPOE, featuring order-specific eOEFs, significantly and sustainably improves the quality and quantity of clinical information included with investigation requests, resulting in changes to patient management that would not otherwise have occurred.

The impact of pain management changes to an inpatient general admission electronic order-set

BACKGROUND

Opioids pose many risks, and standardized ordering processes need to be created. In May 2020, our institution implemented pain management changes to the inpatient general admission electronic order-set and increased provider education on pain management prescribing.

OBJECTIVES

This study aimed to investigate the impact of pain management changes to the inpatient general admission electronic order-set on opioid prescribing.

METHODS

Data were collected by retrospective chart review of 376 patients who were admitted using the inpatient general admission electronic order-set at 8 hospital locations within an integrated health system. Two cohorts were identified for comparison: patients admitted pre-electronic order-set change (n = 183; August 2019) and patients admitted post-electronic order-set change (n = 193; August 2020). The primary end points were the amount of intravenous (IV) opioids received measured in morphine milligram equivalents (MME), the quantification of opioids received for pain management, and the oral MME prescribed on discharge.

RESULTS

There was no statistically significant difference in the use of IV opioids. There was, however, a statistically significant difference between the IV MME 24 to 48 hours with median 0 (interquartile range [IQR] 0, 6) and 0 (IQR 0, 0) for pre- and post-electronic order-set implementation, respectively (P = 0.003). Oxycodone was more frequently prescribed in the postimplementation cohort-55 patients (29%) compared with the 31 (17%) in the preimplementation cohort (P = 0.008). Tramadol was prescribed less frequently in the postimplementation cohort (n = 12 [6%]) than in preimplementation cohort (n = 28 [15%]) (P = 0.004). There was no statistically significant difference in the oral MME prescribed on discharge (P = 0.833).

CONCLUSION

Changes to the inpatient general admission electronic order-set had relatively little impact on the prescribing of opioids. Further electronic order-set changes or other methodologies should be explored to affect inpatient opioid use.

A pragmatic parallel arm randomized-controlled trial of a multi-pronged electronic health record-based clinical decision support tool protocol to reduce low-value antipsychotic prescriptions among older adults with Alzheimer's and related dementias

Among patients with Alzheimer's disease and its related dementias (ADRD) with behavioral disturbances, antipsychotic prescriptions have limited efficacy and increase the risk of death. Yet, physicians continue to routinely prescribe low-value antipsychotic medications for behavioral disturbances among patients with ADRD. We designed a pragmatic randomized-controlled trial to measure the impact of a behavioral economic electronic health record (EHR) clinical decision support (CDS) intervention to reduce physician prescriptions of new antipsychotic medications among patients with ADRD. Utilizing a pragmatic parallel arm randomized-controlled trial design, the study will randomize eligible physicians from a large academic health system to either receive a EHR CDS intervention or not (control) when they prescribe a new antipsychotic medication during visits with patients with ADRD. The intervention will include three components: 1) alerts prescribers that antipsychotic prescriptions increase mortality risk (motivating physicians' intrinsic desire for non-malfeasance); 2) offers non-pharmacological behavioral resources for caregivers; 3) auto-defaults the prescription to contain the lowest dose and number of pill-days (n = 30) without refills if the prescriber does not cancel the order (appealing to default bias). Over 1 year, we will compare the cumulative total of new antipsychotic pill-days prescribed (primary outcome) by physicians in the intervention group versus in the control group. The study protocol meets international SPIRIT guidelines. Behavioral economics, or the study of human behavior as a function of more than rational incentives, considering a whole host of cognitive and social psychological preferences, tendencies, and biases, is increasingly recognized as an important conceptual framework to improve physician behavior. This pragmatic trial is among the first to combine two distinct behavioral economic principles, a desire for non-malfeasance and default bias, to improve physician prescribing patterns for patients with ADRD. We anticipate this trial will substantially advance understanding of how behavioral-economic informed EHR CDS tools can potentially reduce harmful, low-value care among patients with ADRD.

Applications of Behavioral Economics to Pharmaceutical Policymaking: A Scoping Review with Implications for Best-Value Biological Medicines

BACKGROUND AND OBJECTIVE

Pharmaceutical policies are generally based on the assumption that involved stakeholders make rational decisions. However, behavioral economics has taught us that this is not always the case as people deviate from rational behavior in rather predictable patterns. This scoping review examined to what extent behavioral concepts have already been applied in the pharmaceutical domain and what evidence exists about their effectiveness, with the aim of formulating future applications and research hypotheses on policymaking for best-value biologicals.

METHODS

A scoping literature review was conducted on the evidence of behavioral applications to pharmaceuticals. Scientific databases (Embase, MEDLINE, APA PsycArticles, and Scopus) were searched up to 20 October, 2021.

RESULTS

Forty-four full-text scientific articles were identified and narratively described in this article. Pharmaceutical domains where behavioral concepts have been investigated relate to influencing prescribing behavior, improving medication adherence, and increasing vaccination uptake. Multiple behavioral concepts were examined in the identified studies, such as social norms, defaults, framing, loss aversion, availability, and present bias. The effectiveness of the applied interventions was generally positive, but depended on the context. Some of the examined interventions can easily be translated into effective policy interventions for best-value biological medicines. However, some applications require further investigation in a research context.

CONCLUSIONS

Applications of behavioral economics to pharmaceutical policymaking are promising. However, further research is required to investigate the effect of behavioral applications on policy interventions for a more sustainable market environment for best-value biological medicines.

Using nudges to promote clinical decision making of healthcare professionals: A scoping review

Nudging has been discussed in the context of policy and public health, but not so much within healthcare. This scoping review aimed to assess the empirical evidence on how nudging techniques can be used to affect the behavior of healthcare professionals (HCPs) in clinical settings. A systematic database search was conducted for the period January 2010-December 2020 using the PRISMA extension for Scoping Review checklist. Two reviewers independently screened each article for inclusion. Included articles were reviewed to extract key information about each intervention, including purpose, target behavior, measured outcomes, key findings, nudging strategies, intervention objectives and their theoretical underpinnings. Two independent dimensions, building on Kahneman's System 1 and System 2, were used to describe nudging strategies according to user action and timing of their implementation. Of the included 51 articles, 40 reported statistically significant results, six were not significant and two reported mixed results. Thirteen different nudging strategies were identified aimed at modifying four types of HPCs' behavior: prescriptions and orders, procedure, hand hygiene, and vaccination. The most common nudging strategy employed were defaults or pre-orders, followed by alerts or reminders, and active choice. Many interventions did not require any deliberate action from users, here termed passive interventions, such as automatically changing prescriptions to their generic equivalent unless indicated by the user. Passive nudges may be successful in changing the target outcome but may go unnoticed by the user. Future work should consider the broader ethical implications of passive nudges.

A Systematic Review of Nudge Interventions to Optimize Medication Prescribing

Background: The benefits of medication optimization are largely uncontroversial but difficult to achieve. Behavior change interventions aiming to optimize prescriber medication-related decisions, which do not forbid any option and that do not significantly change financial incentives, offer a promising way forward. These interventions are often referred to as nudges.

Objective: The current systematic literature review characterizes published studies describing nudge interventions to optimize medication prescribing by the behavioral determinants they intend to influence and the techniques they apply.

Methods: Four databases were searched (MEDLINE, Embase, PsychINFO, and CINAHL) to identify studies with nudge-type interventions aiming to optimize prescribing decisions. To describe the behavioral determinants that interventionists aimed to influence, data were extracted according to the Theoretical Domains Framework (TDF). To describe intervention techniques applied, data were extracted according to the Behavior Change Techniques (BCT) Taxonomy version 1 and MINDSPACE. Next, the recommended TDF-BCT mappings were used to appraise whether each intervention applied a sufficient array of techniques to influence all identified behavioral determinants.

Results: The current review located 15 studies comprised of 20 interventions. Of the 20 interventions, 16 interventions (80%) were effective. The behavior change techniques most often applied involved prompts (n = 13). The MINDSPACE contextual influencer most often applied involved defaults (n = 10). According to the recommended TDF-BCT mappings, only two interventions applied a sufficient array of behavior change techniques to address the behavioral determinants the interventionists aimed to influence.

Conclusion: The fact that so many interventions successfully changed prescriber behavior encourages the development of future behavior change interventions to optimize prescribing without mandates or financial incentives. The current review encourages interventionists to understand the behavioral determinants they are trying to affect, before the selection and application of techniques to change prescribing behaviors.

Systematic Review Registration: [https://www.crd.york.ac.uk/prospero/], identifier [CRD42020168006].

Development and implementation of a clinical decision support-based initiative to drive intravenous fluid prescribing

OBJECTIVE

Studies suggest superior outcomes with use of intravenous (IV) balanced fluids compared to normal saline (NS). However, significant fluid prescribing variability persists, highlighting the knowledge-to-practice gap. We sought to identify contributors to prescribing variation and utilize a clinical decision support system (CDSS) to increase institutional balanced fluid prescribing.

MATERIALS AND METHODS

This single-center informatics-enabled quality improvement initiative for patients hospitalized or treated in the emergency department included stepwise interventions of 1) identification of design factors within the computerized provider order entry (CPOE) of our electronic health record (EHR) that contribute to preferential NS ordering, 2) clinician education, 3) fluid stocking modifications, 4) re-design and implementation of a CDSS-integrated IV fluid ordering panel, and 5) comparison of fluid prescribing before and after the intervention. EHR-derived prescribing data was analyzed via single interrupted time series.

RESULTS

Pre-intervention (3/2019-9/2019), balanced fluids comprised 33% of isotonic fluid orders, with gradual uptake (1.4%/month) of balanced fluid prescribing. Clinician education (10/2019-2/2020) yielded a modest (4.4%/month, 95% CI 1.6-7.2, p = 0.01) proportional increase in balanced fluid prescribing, while CPOE redesign (3/2020) yielded an immediate (20.7%, 95% CI 17.7-23.6, p < 0.0001) and sustained increase (72% of fluid orders in 12/2020). The intervention proved most effective among those with lower baseline balanced fluids utilization, including emergency medicine (57% increase, 95% CI 0.7-1.8, p < 0.0001) and internal medicine/subspecialties (18% increase, 95% CI 14.4-21.3, p < 0.0001) clinicians and substantially reduced institutional prescribing variation.

CONCLUSION

Integration of CDSS into an EHR yielded a robust and sustained increase in balanced fluid prescribing. This impact far exceeded that of clinician education highlighting the importance of CDSS.

Systematic review of clinician-directed nudges in healthcare contexts

OBJECTIVE

Nudges are interventions that alter the way options are presented, enabling individuals to more easily select the best option. Health systems and researchers have tested nudges to shape clinician decision-making with the aim of improving healthcare service delivery. We aimed to systematically study the use and effectiveness of nudges designed to improve clinicians' decisions in healthcare settings.

DESIGN

A systematic review was conducted to collect and consolidate results from studies testing nudges and to determine whether nudges directed at improving clinical decisions in healthcare settings across clinician types were effective. We systematically searched seven databases (EBSCO MegaFILE, EconLit, Embase, PsycINFO, PubMed, Scopus and Web of Science) and used a snowball sampling technique to identify peer-reviewed published studies available between 1 January 1984 and 22 April 2020. Eligible studies were critically appraised and narratively synthesised. We categorised nudges according to a taxonomy derived from the Nuffield Council on Bioethics. Included studies were appraised using the Cochrane Risk of Bias Assessment Tool.

RESULTS

We screened 3608 studies and 39 studies met our criteria. The majority of the studies (90%) were conducted in the USA and 36% were randomised controlled trials. The most commonly studied nudge intervention (46%) framed information for clinicians, often through peer comparison feedback. Nudges that guided clinical decisions through default options or by enabling choice were also frequently studied (31%). Information framing, default and enabling choice nudges showed promise, whereas the effectiveness of other nudge types was mixed. Given the inclusion of non-experimental designs, only a small portion of studies were at minimal risk of bias (33%) across all Cochrane criteria.

CONCLUSIONS

Nudges that frame information, change default options or enable choice are frequently studied and show promise in improving clinical decision-making. Future work should examine how nudges compare to non-nudge interventions (eg, policy interventions) in improving healthcare.

Nudging healthcare professionals in clinical settings: a scoping review of the literature

BACKGROUND

Healthcare organisations are in constant need of improvement and change. Nudging has been proposed as a strategy to affect people's choices and has been used to affect patients' behaviour in healthcare settings. However, little is known about how nudging is being interpreted and applied to change the behaviour of healthcare professionals (HCPs). The objective of this review is to identify interventions using nudge theory to affect the behaviour of HCPs in clinical settings.

METHODS

A scoping review. We searched PubMed and PsycINFO for articles published from 2010 to September 2019, including terms related to "nudging" in the title or abstract. Two reviewers screened articles for inclusion based on whether the articles described an intervention to change the behaviour of HCPs. Two reviewers extracted key information and categorized included articles. Descriptive analyses were performed on the data.

RESULTS

Search results yielded 997 unique articles, of which 25 articles satisfied the inclusion criteria. Five additional articles were selected from the reference lists of the included articles. We identified 11 nudging strategies: accountable justification, goal setting, suggested alternatives, feedback, information transparency, peer comparison, active choice, alerts and reminders, environmental cueing/priming, defaults/pre-orders, and education. These strategies were employed to affect the following 4 target behaviours: vaccination of staff, hand hygiene, clinical procedures, prescriptions and orders. To compare approaches across so many areas, we introduced two independent dimensions to describe nudging strategies: synchronous/asynchronous, and active/passive.

CONCLUSION

There are relatively few studies published referring to nudge theory aimed at changing HCP behaviour in clinical settings. These studies reflect a diverse set of objectives and implement nudging strategies in a variety of ways. We suggest distinguishing active from passive nudging strategies. Passive nudging strategies may achieve the desired outcome but go unnoticed by the clinician thereby not really changing a behaviour and raising ethical concerns. Our review indicates that there are successful active strategies that engage with clinicians in a more deliberate way. However, more research is needed on how different nudging strategies impact HCP behaviour in the short and long term to improve clinical decision making.

A cluster randomized stepped-wedge trial to de-implement unnecessary post-operative antibiotics in children: the optimizing perioperative antibiotic in children (OPerAtiC) trial

BACKGROUND

Antibiotic-resistant infections have become a public health crisis that is driven by the inappropriate use of antibiotics. In the USA, antibiotic stewardship programs (ASP) have been established and are required by regulatory agencies to help combat the problem of antibiotic resistance. Post-operative antibiotic use in surgical cases deemed low-risk for infection is an area with significant overuse of antibiotics in children. Consensus among leading public health organizations has led to guidelines eliminating post-operative antibiotics in low-risk surgeries. However, the best strategies to de-implement these inappropriate antibiotics in this setting are unknown.

METHODS/DESIGN

A 3-year stepped wedge cluster randomized trial will be conducted at nine US Children's Hospitals to assess the impact of two de-implementation strategies, order set change and facilitation training, on inappropriate post-operative antibiotic prescribing in low risk (i.e., clean and clean-contaminated) surgical cases. The facilitation training will amplify order set changes and will involve a 2-day workshop with antibiotic stewardship teams. This training will be led by an implementation scientist expert (VRM) and a pediatric infectious diseases physician with antibiotic stewardship expertise (JGN). The primary clinical outcome will be the percentage of surgical cases receiving unnecessary post-operative antibiotics. Secondary clinical outcomes will include the rate of surgical site infections and the rate of Clostridioides difficile infections, a common negative consequence of antibiotic use. Monthly semi-structured interviews at each hospital will assess the implementation process of the two strategies. The primary implementation outcome is penetration, which will be defined as the number of order sets changed or developed by each hospital during the study. Additional implementation outcomes will include the ASP team members' assessment of the acceptability, appropriateness, and feasibility of each strategy while they are being implemented.

DISCUSSION

This study will provide important information on the impact of two potential strategies to de-implement unnecessary post-operative antibiotic use in children while assessing important clinical outcomes. As more unnecessary medical practices are identified, de-implementation strategies, including facilitation, need to be rigorously evaluated. Along with this study, other rigorously designed studies evaluating additional strategies are needed to further advance the burgeoning field of de-implementation.

TRIAL REGISTRATION

NCT04366440. Registered April 28, 2020, https://clinicaltrials.gov/ct2/show/NCT04366440 .

Nudging clinicians: A systematic scoping review of the literature

BACKGROUND

While the quality of medical care delivered by physicians can be very good, it can also be inconsistent and feature behaviours that are entrenched despite updated information and evidence. The "nudge" paradigm for behaviour change is being used to bring clinical practice in line with desired standards. The premise is that behaviour can be voluntarily shifted by making particular choices instinctively appealing. We reviewed studies that are explicit about their use of nudge theory in influencing clinician behaviour.

METHODS

Databases were searched from April 2008 (the publication date of the book that introduced nudge theory to a wider audience) to November 2018, inclusive. The search strategy and narrative review of results addressed the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews.

RESULTS

22 studies were identified. Randomized trials or pre-post comparisons were generally used in community-based settings; single-site pre-post studies were favoured in hospitals. The studies employed eight intervention types: active choice; patient chart redesign; default and default alerts; partitioning of prescription menus; audit and feedback; commitment messages; peer comparisons; and redirection of workflow. Three core cognitive factors underpinned the eight interventions: bias towards prominent choices (salience); predisposition to social norms; and bias towards time or cost savings.

CONCLUSIONS

Published studies that are explicit about their use of nudge theory are few in number and diverse in their settings, targets, and results. Default and chart re-design interventions reported the most substantial improvements in adherence to evidence and guideline-based practice. Studies that are explicit in their use of nudge theory address the widespread failure of clinical practice studies to identify theoretical frameworks for interventions. However, few studies identified in our review engaged in research to understand the contextual and site-specific barriers to a desired behaviour before designing a nudge intervention.

Association of a multiple-step action with cervical lymph node yield of oral cancer patients in an Asian country

Background

High quality lymph node (LN) yield could increase survival, however strategies to improve LN yield have been seldom reported. This study aimed to assess the multiple-step action to promote quality of neck dissection in oral cancer.

Methods

A total of 400 patients with oral cancer who underwent primary tumor resection and neck dissection, including elective and radical neck dissection, were recruited after propensity score matching by clinical T and N categories between January 2009 and September 2018. Patients were treated by two independent departments in our institute. A multiple-step action was initiated in October 2015 in one department, and another department was as a control group. The impact of multiple-step action on LN yield and regional recurrence were analyzed using multivariate analysis and difference-in-differences (DID) linear regression analysis.

Results

The mean patient age was 55.2 + 11.1 years, and 92% were male. A total of 180 (45%) patients had T3-4 disease, and 129 (32%) patients had N2-3 disease. The multivariate linear regression and DID analyses revealed that multiple-step action had a positive effect on LN yield. A net improvement of LN yield with a coefficient of 13.78 (p < 0.001) after launching multiple-step action (since October 2015) was observed. A borderline protective effect of multiple-step action for cN0 patients with a reduced regional recurrence rate of 11.6% (p = 0.072) through DID analysis was noted.

Conclusions

Multiple-step action was associated with increased LN yield and decreased regional recurrence in patients with oral cancer. The observed activity may promote surgeons to improve the quality of neck dissections, is feasible, and could be applied to a widespread patient population.

Standardized Order Set Exhibits Surgeon Adherence to Pain Protocol in Pediatric Adenotonsillectomy

OBJECTIVES/HYPOTHESIS

To produce a sustained reduction in opioid prescriptions in patients <5 years of age undergoing T&A through utilization of standardized algorithms and electronic health record (EHR) automation tools.

STUDY DESIGN

Prospective quality improvement initiative.

METHODS

Plan-do-study-act (PDSA) methodology was used to design an age-based postoperative pain regimen in which children <5 years of age received a non-opioid pain regimen, and option to prescribe oxycodone for additional pain relief was given for children >5 years of age. Standardized discharge instructions and automated, age-specific order sets were created to facilitate adherence. Rate of discharge opioid prescription was monitored and balanced against post-discharge opioid prescriptions and returns to the emergency department (ED).

RESULTS

In children <5 years of age undergoing T&A, reduction in opioid prescription rates from 65.9% to 30.9% after initial implementation of the order set was noted. Ultimately, reduction of opioid prescribing rates to 3.7% of patients was noted after pain-regimen consensus and EHR order set implementation. Opioid prescriptions in patients >5 years of age decreased from 90.6% to 58.1% initially, and then down 35.9% by the last time point analyzed. Requests for outpatient opioid prescriptions did not increase. There was no significant change in returns to the emergency ED for pain management, or in the number opioids prescribed when patients returned to the ED.

CONCLUSIONS

Iterative cycles of improvement utilizing standardized pain management algorithms and EHR tools were effective means of producing a sustained reduction in opioid prescriptions in postoperative T&A patients. Such findings suggest a framework for similar interventions in other pediatric otolaryngology settings.

LEVEL OF EVIDENCE

4 Laryngoscope, 131:E2337-E2343, 2021.

A Scoping Review of Implementation Science in Adult Critical Care Settings

OBJECTIVES

The purpose of this scoping review is to provide a synthesis of the available literature on implementation science in critical care settings. Specifically, we aimed to identify the evidence-based practices selected for implementation, the frequency and type of implementation strategies used to foster change, and the process and clinical outcomes associated with implementation.

DATA SOURCES

A librarian-assisted search was performed using three electronic databases.

STUDY SELECTION

Articles that reported outcomes aimed at disseminating, implementing, or sustaining an evidence-based intervention or practice, used established implementation strategies, and were conducted in a critical care unit were included.

DATA EXTRACTION

Two reviewers independently screened titles, abstracts, and full text of articles to determine eligibility. Data extraction was performed using customized fields established a priori within a systematic review software system.

DATA SYNTHESIS

Of 1,707 citations, 82 met eligibility criteria. Studies included prospective research investigations, quality improvement projects, and implementation science trials. The most common practices investigated were use of a ventilator-associated pneumonia bundle, nutritional support protocols, and the Awakening and Breathing Coordination, Delirium Monitoring/Management, and Early Exercise/Mobility bundle. A variety of implementation strategies were used to facilitate evidence adoption, most commonly educational meetings, auditing and feedback, developing tools, and use of local opinion leaders. The majority of studies (76/82, 93%) reported using more than one implementation strategy. Few studies specifically used implementation science designs and frameworks to systematically evaluate both implementation and clinical outcomes.

CONCLUSIONS

The field of critical care has experienced slow but steady gains in the number of investigations specifically guided by implementation science. However, given the exponential growth of evidence-based practices and guidelines in this same period, much work remains to critically evaluate the most effective mechanisms to integrate and sustain these practices across diverse critical care settings and teams.

Improving Hospitalized Children's Sleep by Reducing Excessive Overnight Blood Pressure Monitoring

BACKGROUND

Although required for healing, sleep is often disrupted during hospitalization. Blood pressure (BP) monitoring can be especially disruptive for pediatric inpatients and has few clinical indications. Our aim in this pilot study was to reduce unnecessary overnight BP monitoring and improve sleep for pediatric inpatients.

METHODS

The intervention in June 2018 involved clinician education sessions and updated electronic health record (EHR) orders that enabled the forgoing of overnight BP checks. The postintervention period from July 2018 to May 2019 examined patient-caregiver surveys as outcome measures. These surveys measured inpatient sleep and overnight disruptions and were adopted from validated surveys: the Patient Sleep Questionnaire, expanded Brief Infant Sleep Questionnaire, and Potential Hospital Sleep Disruptions and Noises Questionnaire. Uptake of new sleep-friendly EHR orders was a process measure. Reported patient care escalations served as a balancing measure.

RESULTS

Interrupted time series analysis of EHR orders (n_pre = 493; n_post = 1472) showed an increase in intercept for the proportion of patients forgoing overnight BP postintervention (+50.7%; 95% confidence interval 41.2% to 60.3%; P < .001) and a subsequent decrease in slope each week (-0.16%; 95% confidence interval -0.32% to -0.01%; P = .037). Statistical process control of surveys (n_pre = 263; n_post = 131) showed a significant increase in sleep duration for patients older than 2, and nighttime disruptions by clinicians decreased by 19% (P < .001). Annual estimated cost savings were $15 842.01. No major adverse events in patients forgoing BP were reported.

CONCLUSIONS

A pilot study combining EHR changes and clinician education safely decreased overnight BP checks, increased pediatric inpatient sleep duration, and reduced nighttime disruptions by clinicians.

The effectiveness of behavioral economics-informed interventions on physician behavioral change: A systematic literature review

OBJECTIVE

Interventions informed by behavioral economics have the potential to change behaviors governed by underlying cognitive biases. This has been explored extensively for various use in healthcare including changing patient behavior and, more recently, physician behavior. We aimed to systematically review the literature on the use and effectiveness of behavioral economics-informed interventions in changing physician behavior.

METHOD

We searched Medline, Cochrane Library, EBM Reviews, PsychINFO, EconLit, Business Source Complete and Web of Science for peer-reviewed studies published in English that examined the effectiveness of behavioral economics-informed interventions on physician behavioral change. We included studies of physicians in all care settings and specialties and all types of objectively measured behavioral outcomes. The reporting quality of included studies was appraised using the Effective Public Health Practice Project tool.

RESULTS

We screened 6,439 studies and included 17 studies that met our criteria, involving at least 9,834 physicians. The majority of studies were conducted in the United States, published between 2014 and 2018, and were in the patient safety and quality domain. Reporting quality of included studies included strong (n = 7), moderate (n = 6) and weak (n = 4). Changing default settings and providing social reference points were the most widely studied interventions, with these studies consistently demonstrating their effectiveness in changing physician behavior despite differences in implementation methods among studies. Prescribing behavior was most frequently targeted in included studies, with consistent effectiveness of studied interventions.

CONCLUSION

Changing default settings and providing social reference points were the most frequently studied and consistently effective interventions in changing physician behavior towards guideline-concordant practices. Additional theory-informed research is needed to better understand the mechanisms underlying the effectiveness of these interventions to guide implementation.

The Impact of Changes to an Electronic Admission Order Set on Prescribing and Clinical Outcomes in the Intensive Care Unit

BACKGROUND

Implementation of disease-specific order sets has improved compliance with standards of care for a variety of diseases. Evidence of the impact admission order sets can have on care is limited.

OBJECTIVE

The main purpose of this article is to evaluate the impact of changes made to an electronic critical care admission order set on provider prescribing patterns and clinical outcomes.

METHODS

A retrospective, observational before-and-after exploratory study was performed on adult patients admitted to the medical intensive care unit using the Inpatient Critical Care Admission Order Set. The primary outcome measure was the percentage change in the number of orders for scheduled acetaminophen, a histamine-2 receptor antagonist (H2RA), and lactated ringers at admission before implementation of the revised order set compared with after implementation. Secondary outcomes assessed clinical impact of changes made to the order set.

RESULTS

The addition of a different dosing strategy for a medication already available on the order set (scheduled acetaminophen vs. as needed acetaminophen) had no impact on physician prescribing (0 vs. 0%, p = 1.000). The addition of a new medication class (an H2RA) to the order set significantly increased the number of patients prescribed an H2RA for stress ulcer prophylaxis (0 vs. 20%, p < 0.001). Rearranging the list of maintenance intravenous fluids to make lactated ringers the first fluid option in place of normal saline significantly decreased the number of orders for lactated ringers (17 vs. 4%, p = 0.005). The order set changes had no significant impact on clinical outcomes such as incidence of transaminitis, gastrointestinal bleed, and acute kidney injury.

CONCLUSION

Making changes to an admission order set can impact provider prescribing patterns. The type of change made to the order set, in addition to the specific medication changed, may have an effect on how influential the changes are on prescribing patterns.

Architecting Process of Care: A randomized controlled study evaluating the impact of providing nonadherence information and pharmacist assistance to physicians

OBJECTIVE

To test the impact of connecting physicians, pharmacists, and patients to address medication nonadherence, and to compare different physician choice architectures.

DATA SOURCES AND STUDY SETTING

The study was conducted with 90 physicians and 2602 of their patients on medications treating chronic illness.

STUDY DESIGN

In this cluster randomized controlled trial, physicians were randomly assigned to an arm where the physician receives notification of patient nonadherence derived from real-time claims data, an arm where they receive this information and a pharmacist may contact patients either by default or by physician choice, and a control group. The primary outcome was resolving nonadherence within 30 days. We also considered physician engagement outcomes including viewing information about nonadherence and utilizing a pharmacist.

DATA COLLECTION

Physician engagement was constructed from metadata from the study website; adherence outcomes were constructed from medication claims.

PRINCIPAL FINDINGS

We see no differences between the treatment arms and control for the primary adherence outcome. The pharmacist intervention was 42 percentage points (95% CI: 28 pp-56 pp) more likely when it was triggered by default.

CONCLUSIONS

Access to a pharmacist and real-time nonadherence information did not improve patient adherence. Physician process of care was sensitive to choice architecture.

Case Study: More Patient Safety by Design - System-based Approaches for Hospitals

Since the publication of the report "To Err Is Human: Building a Safer Health System" by the US Institute of Medicine in 2000, much has changed with regard to patient safety. Many of the more recent initiatives to improve patient safety target the behavior of health care staff (e.g., training, double-checking procedures, and standard operating procedures). System-based interventions have so far received less attention, even though they produce more substantial improvements, being less dependent on individuals' behavior. One type of system-based intervention that can benefit patient safety involves improvements to hospital design. Given that people's working environments affect their behavior, good design at a systemic level not only enables staff to work more efficiently; it can also prevent errors and mishaps, which can have serious consequences for patients. While an increasing number of studies have demonstrated the effect of hospital design on patient safety, this knowledge is not easily accessible to clinicians, practitioners, risk managers, and other decision-makers, such as designers and architects of health care facilities. This is why the Swiss Patient Safety Foundation launched its project, "More Patient Safety by Design: Systemic Approaches for Hospitals," which is presented in this chapter.

Patient Commitment to Health (PACT-Health) in the Heart Failure Population: A Focus Group Study of an Active Communication Framework for Patient-Centered Health Behavior Change

Background

Over 6 million Americans have heart failure, and 1 in 8 deaths included heart failure as a contributing cause in 2016. Lifestyle changes and adherence to diet and exercise regimens are important in limiting disease progression. Health coaching and public commitment are two interactive communication strategies that may improve self-management of heart failure.

Objective

This study aimed to conduct patient focus groups to gain insight into how best to implement health coaching and public commitment strategies within the heart failure population.

Methods

Focus groups were conducted in two locations. We studied 2 patients in Oakland, California, and 5 patients in Los Angeles, California. Patients were referred by local cardiologists and had to have a diagnosis of chronic heart failure. We used a semistructured interview tool to explore several patient-centered themes including medication adherence, exercise habits, dietary habits, goals, accountability, and rewards. We coded focus group data using the a priori coding criteria for these domains.

Results

Medication adherence barriers included regimen complexity, forgetfulness, and difficulty coping with side effects. Participants reported that they receive little instruction from care providers on appropriate exercise and dietary habits. They also reported personal and social obstacles to achieving these objectives. Participants were in favor of structured goal setting, use of online social networks, and financial rewards as a means of promoting health lifestyles. Peers were viewed as better motivating agents than family members.

Conclusions

An active communication framework involving dissemination of diet- and exercise-related health information, structured goal setting, peer accountability, and financial rewards appears promising in the management of heart failure.

Decreasing daily blood work in hospitals: What works and what doesn't

Recurrent, inappropriate laboratory testing is a costly and wasteful use of healthcare resources. Recognizing this problem, the American Board of Internal Medicine, Canadian Society of Internal Medicine, and the Canadian Association of Pathologist all supported the Choosing Wisely campaign to reduce laboratory investigations in patients who demonstrate clinical and laboratory stability. In this narrative, we review studies looking at a variety of approaches to reduce excessive testing including education, audit and feedback, computerized physician order entry system changes, and forcing functions. Each type of intervention has its own unique advantages and disadvantages, varying in complexity, disruptiveness, effectiveness, and sustainability. Before implementing any quality improvement project, it is important to analyze the local context to identify the root causes for the practice behavior and aim to use the minimal amount of intervention to achieve the desired result. Change is often incremental and will seldom occur with a single intervention or Plan-Do-Study-Act cycle. Garnering the support of opinion leaders and a quality improvement team will help make the process and intervention a success.

Evidence-based medicine: A cornerstone for clinical care but not for quality improvement

Quality improvement (QI) as a clinical improvement science has been criticized for failing to deliver broad patient outcome improvement and for being a top-down regulatory and compliance construct. These critics have argued that the focus of QI should be on increasing adherence to clinical practice guidelines (CPGs) and, as a result, should be consolidated into research structures with the science of evidence-based medicine (EBM) at the helm. We argue that EBM often overestimates the role of knowledge as the root cause of quality problems and focuses almost exclusively on the effectiveness of care while often neglecting the domains of safety, efficiency, patient-centredness, and equity. Successfully addressing quality problems requires a much broader, systems-based view of health-care delivery. Although essential to clinical decision-making and practice, EBM cannot act as the cornerstone of health system improvement.

Balancing quality improvement and unintended effects: The impact of implementing admission order sets for chronic obstructive pulmonary disease and heart failure at two teaching hospitals

RATIONALE, AIMS, AND OBJECTIVES

Local health administrators implemented chronic obstructive pulmonary disease and heart failure admission order sets to increase guideline adherence. We explored the impact of these order sets on workflows and guideline adherence in the internal medicine specialty in two Canadian teaching hospitals.

METHODS

A mixed methods study combined shadowing care providers (250 h), meeting observation and interviews (11 h), and patient medical chart audits for heart failure (n = 120) and chronic obstructive pulmonary disease (n = 120) patients. The chart audits analysed details of the admission process and 14 guideline elements associated with heart failure (nine) and chronic obstructive pulmonary disease (five).

RESULTS

A subset (10/14) of the evaluated guideline elements were included in the heart failure or chronic obstructive pulmonary disease order sets. Order set use significantly increased adherence to some (4/10) of these elements. However, our qualitative work uncovered a perception that use of these two order sets increased order duplication. Our chart audits supported this perception. Order set use increased order duplication for heart failure (92% vs 43%) and chronic obstructive pulmonary disease (75% vs 43%).

CONCLUSION

It is unclear whether, for these two hospitals, the gains brought by implementation of chronic obstructive pulmonary disease and heart failure admission order sets were worth their associated organisational shortcomings. Problems with order set implementation appeared to stem from poor integration with pre-existing complex organisational systems. Health administrators and clinicians interested in implementing order sets within their own hospitals need to remain cognizant of how these tools will fit into existing systems and practices.

Towards a decision support tool for intensive care discharge: machine learning algorithm development using electronic healthcare data from MIMIC-III and Bristol, UK

OBJECTIVE

The primary objective is to develop an automated method for detecting patients that are ready for discharge from intensive care.

DESIGN

We used two datasets of routinely collected patient data to test and improve on a set of previously proposed discharge criteria.

SETTING

Bristol Royal Infirmary general intensive care unit (GICU).

PATIENTS

Two cohorts derived from historical datasets: 1870 intensive care patients from GICU in Bristol, and 7592 from Medical Information Mart for Intensive Care (MIMIC)-III.

RESULTS

In both cohorts few successfully discharged patients met all of the discharge criteria. Both a random forest and a logistic classifier, trained using multiple-source cross-validation, demonstrated improved performance over the original criteria and generalised well between the cohorts. The classifiers showed good agreement on which features were most predictive of readiness-for-discharge, and these were generally consistent with clinical experience. By weighting the discharge criteria according to feature importance from the logistic model we showed improved performance over the original criteria, while retaining good interpretability.

CONCLUSIONS

Our findings indicate the feasibility of the proposed approach to ready-for-discharge classification, which could complement other risk models of specific adverse outcomes in a future decision support system. Avenues for improvement to produce a clinically useful tool are identified.

Variable effectiveness of stepwise implementation of nudge-type interventions to improve provider compliance with intraoperative low tidal volume ventilation

BACKGROUND

Identifying mechanisms to improve provider compliance with quality metrics is a common goal across medical disciplines. Nudge interventions are minimally invasive strategies that can influence behavioural changes and are increasingly used within healthcare settings. We hypothesised that nudge interventions may improve provider compliance with lung-protective ventilation (LPV) strategies during general anaesthesia.

METHODS

We developed an audit and feedback dashboard that included information on both provider-level and department-level compliance with LPV strategies in two academic hospitals, two non-academic hospitals and two academic surgery centres affiliated with a single healthcare system. Dashboards were emailed to providers four times over the course of the 9-month study. Additionally, the default setting on anaesthesia machines for tidal volume was decreased from 700 mL to 400 mL. Data on surgical cases performed between 1 September 2016 and 31 May 2017 were examined for compliance with LPV. The impact of the interventions was assessed via pairwise logistic regression analysis corrected for multiple comparisons.

RESULTS

A total of 14 793 anaesthesia records were analysed. Absolute compliance rates increased from 59.3% to 87.8%preintervention to postintervention. Introduction of attending physician dashboards resulted in a 41% increase in the odds of compliance (OR 1.41, 95% CI 1.17 to 1.69, p=0.002). Subsequently, the addition of advanced practice provider and resident dashboards lead to an additional 93% increase in the odds of compliance (OR 1.93, 95% CI 1.52 to 2.46, p<0.001). Lastly, modifying ventilator defaults led to a 376% increase in the odds of compliance (OR 3.76, 95% CI 3.1 to 4.57, p<0.001).

CONCLUSION

Audit and feedback tools in conjunction with default changes improve provider compliance.

The effectiveness of computerised decision support on antibiotic use in hospitals: A systematic review

Background

Inappropriate antimicrobial use has been shown to be an important determinant of the emergence of antimicrobial resistance (AMR). Health information technology (HIT) in the form of Computerised Decision Support (CDS) represents an option for improving antimicrobial prescribing and containing AMR.

Objectives

To evaluate the evidence for CDS in improving quantitative and qualitative measures of antibiotic prescribing in inpatient hospital settings.

Methods

A systematic literature search was conducted of articles published from inception to 20^th December 2014 using eight electronic databases: MEDLINE, EMBASE, PUBMED, Web of Science, CINAHL, Cochrane Library, HMIC and PsychINFo. An updated systematic literature search was conducted from January 1^st 2015 to October 1^st 2016 using PUBMED. The search strategy used combinations of the following terms: (electronic prescribing) OR (clinical decision support) AND (antibiotic or antibacterial or antimicrobial) AND (hospital or secondary care or inpatient). Studies were evaluated for quality using a 10-point rating scale.

Results

Eighty-one studies were identified matching the inclusion criteria. Seven outcome measures were evaluated: adequacy of antibiotic coverage, mortality, volume of antibiotic usage, length of stay, antibiotic cost, compliance with guidelines, antimicrobial resistance, and CDS implementation and uptake. Meta-analysis of pooled outcomes showed CDS significantly improved the adequacy of antibiotic coverage (n = 13; odds ratio [OR], 2.11 [95% CI, 1.67 to 2.66, p ≤ 0.00001]). Also, CDS was associated with marginally lowered mortality (n = 20; OR, 0.85 [CI, 0.75 to 0.96, p = 0.01]). CDS was associated with lower antibiotic utilisation, increased compliance with antibiotic guidelines and reductions in antimicrobial resistance. Conflicting effects of CDS on length of stay, antibiotic costs and system uptake were also noted.

Conclusions

CDS has the potential to improve the adequacy of antibiotic coverage and marginally decrease mortality in hospital-related settings.

Increasing compliance with low tidal volume ventilation in the ICU with two nudge-based interventions: evaluation through intervention time-series analyses

OBJECTIVES

Low tidal volume (TVe) ventilation improves outcomes for ventilated patients, and the majority of clinicians state they implement it. Unfortunately, most patients never receive low TVes. 'Nudges' influence decision-making with subtle cognitive mechanisms and are effective in many contexts. There have been few studies examining their impact on clinical decision-making. We investigated the impact of 2 interventions designed using principles from behavioural science on the deployment of low TVe ventilation in the intensive care unit (ICU).

SETTING

University Hospitals Bristol, a tertiary, mixed medical and surgical ICU with 20 beds, admitting over 1300 patients per year.

PARTICIPANTS

Data were collected from 2144 consecutive patients receiving controlled mechanical ventilation for more than 1 hour between October 2010 and September 2014. Patients on controlled mechanical ventilation for more than 20 hours were included in the final analysis.

INTERVENTIONS

(1) Default ventilator settings were adjusted to comply with low TVe targets from the initiation of ventilation unless actively changed by a clinician. (2) A large dashboard was deployed displaying TVes in the format mL/kg ideal body weight (IBW) with alerts when TVes were excessive.

PRIMARY OUTCOME MEASURE

TVe in mL/kg IBW.

FINDINGS

TVe was significantly lower in the defaults group. In the dashboard intervention, TVe fell more quickly and by a greater amount after a TVe of 8 mL/kg IBW was breached when compared with controls. This effect improved in each subsequent year for 3 years.

CONCLUSIONS

This study has demonstrated that adjustment of default ventilator settings and a dashboard with alerts for excessive TVe can significantly influence clinical decision-making. This offers a promising strategy to improve compliance with low TVe ventilation, and suggests that using insights from behavioural science has potential to improve the translation of evidence into practice.

Behaviourally designed treatments that increase willingness to treatment from families with children suffering from autism spectrum disorder

BACKGROUND

Autism spectrum disorder is a lifelong disability that is not well known by the general population and tends to be associated with social stigma; also, because it involves children, it may get highly emotionally charged. These stylised facts engender a number of possible heuristics and biases at the moment of deciding on following a treatment or looking for a diagnosis, which should be considered in the presentation of information. Using insights from Behavioural Economics, three treatments are designed to present the information regarding possible therapies.

METHODS

Between-subjects design with one level of variation. Interviews were performed with a convenience sample of 154 households from the metropolitan area of Bogotá (Colombia). The treatments include: use of default option, use of professional interviewer to illustrate the therapy and emotionally charged presentation.

RESULTS

Kruskal-Wallis test of the intention to be treated rejects the null hypothesis (χ(2)=22.14, p=0.00). The cognitive processing of the information is not a determinant, supporting the claim that genuine framing effects shape the choice. The strongest effect of the treatment with a professional suggests a key role for asymmetry of the information, which is confirmed indirectly through the postexperiment questionnaire.

CONCLUSIONS

Bad healthcare decisions are not necessarily driven by lack of information. Asymmetric information (eg, delegating the decision to a professional) improves choices, especially when social stigma is involved. Cognitive processing of information seems to be less relevant than the framing effect.

Default options in the ICU: widely used but insufficiently understood

PURPOSE OF REVIEW

Default options dramatically influence the behavior of decision makers and may serve as effective decision support tools in the ICU. Their use in medicine has increased in an effort to improve efficiency, reduce errors, and harness the potential of healthcare technology.

RECENT FINDINGS

Defaults often fall short of their predicted influence when employed in critical care settings as quality improvement interventions. Investigations reporting the use of defaults are often limited by variations in the relative effect across sites. Preimplementation experiments and long-term monitoring studies are lacking.

SUMMARY

Defaults in the ICU may help or harm patients and clinical efficiency depending on their format and use. When constructing and encountering defaults, providers should be aware of their powerful and complex influences on decision making. Additional evaluations of the appropriate creation of healthcare defaults and their resulting intended and unintended consequences are needed.