We Ask and Listen: A Group-Wide Retrospective Survey on Satisfaction with Digital Medication Software

Purpose

Computerized physician order entry (CPOE) and clinical decision support systems (CDSS) are used internationally since the 1980s. These systems reduce costs, enhance drug therapy safety, and improve quality of care. A few years ago, there was a growing effort to digitize the healthcare sector in Germany. Implementing such systems like CPOE-CDSS requires training for effective adoption and, more important, acceptance by the users. Potential improvements for the software and implementation process can be derived from the users' perspective. The implementation process is globally relevant and applicable across professions due to the constant advancement of digitalization. The study assessed the implementation of medication software and overall satisfaction.

Methods

In an anonymous voluntary online survey, physicians and nursing staff were asked about their satisfaction with the new CPOE-CDSS. The survey comprised single-choice queries on a Likert scale, categorizing into general information, digital medication administration, drug safety, and software introduction. In addition multiple-choice questions are mentioned. Data analysis was performed using Microsoft Office Excel 2016 and GraphPad PRISM 9.5.0.

Results

Nurses and physicians' satisfaction with the new software increased with usage hours. The software's performance and loading times have clearly had a negative impact, which leads to a low satisfaction of only 20% among physicians and 17% among nurses. 53% of nurses find the program's training period unsuitable for their daily use, while 57% of physicians approve the training's scope for their professional group. Both professions agree that drug-related problems are easier to detect using CPOE-CDSS, with 76% of nurses and 75% of physicians agreeing. The study provides unbiased feedback on software implementation.

Conclusion

In conclusion, digitizing healthcare requires managing change, effective training, and addressing software functionality concerns to ensure improved medication safety and streamlined processes. Interfaces, performance optimization, and training remain crucial for software acceptance and effectiveness.

A systematic review of data elements of computerized physician order entry (CPOE): mapping the data to FHIR

OBJECTIVE

Medication errors are the third leading cause of death. There are several methods to prevent prescription errors, one of which is to use a Computerized Physician Order Entry system (CPOE). In a CPOE system, necessary data needs to be collected so that making decisions about prescribing medications and treatment plans could be made. Although many CPOE systems have been developed worldwide, studies have yet to identify the necessary data and data elements of CPOE systems. This study aims to identify data elements of CPOE and standardize these data with Fast Healthcare Interoperability Resources (FHIR) to facilitate data sharing and integration with the electronic health record (EHR) system and reduce data diversity.

METHODS

PubMed, Web of Science, Embase, and Scopus databases for studies up to October 2019 were searched. Two reviewers independently assessed original articles to determine eligibility for inclusion in this review. All articles describing data elements of a COPE system were included. Data elements were obtained from the included articles' text, tables, and figures.Classification of the extracted data elements and mapping them to FHIR was done to facilitate data sharing and integration with the electronic health record (EHR) system and reduce data diversity. The final data elements of CPOE were categorized into five main categories of FHIR (foundation, base, clinical, financial, and specialized) and 146 resources, where possible. One of the researchers did mapping and checked and verified by the second researcher. If a data element could not be mapped to any FHIR resources, this data element was considered an extension to the most relevant resource.

RESULTS

We retrieved 5162 articles through database searches. After the full-text assessment, 21 articles were included. In total, 270 data elements were identified and mapped to the FHIR standard. These elements have been reported in 26 FHIR resources of 146 ones (18%). In total, 71 data elements were considered an extension.

CONCLUSIONS

The results of this study showed that the same data elements were not used in the CPOE systems, and the degree of homogeneity of these systems is limited. The mapping of extracted data with data elements used in the FHIR standard shows the extent to which these systems comply with existing standards. Considering the standards in these systems' design helps developers design more coherent systems that can share data with other systems.

Impact of a computerized physician order entry system on medication safety in pediatrics-The AVOID study

BACKGROUND

One of the most critical steps in the medication process on pediatric wards is the medical prescription. This study aims to investigate the impact of a computerized physician order entry (CPOE) system on Adverse Drug Events (ADEs) and potentially harmful ADEs (pot ADEs) in comparison with paper-based documentation in a general pediatric ward at a German University hospital.

METHODS

A prospective pre-post study was conducted. All patients aged 17 years or younger were observed during the study periods (5 months pre- and postimplementation). Issues Regarding Medication (IRM) were identified by intensive chart review. Events were assessed regarding causality (WHO), severity (WHO; Dean & Barber for MEs), and preventability (Shumock) and classified into (pot) ADEs, (pot) Medication errors (ME), Adverse drug Reactions (ADR), and Other incidents (OI) accordingly.

RESULTS

Total of 333 patients with medication were included in the paper-based prescribing cohort (phase I) and 320 patients with medication in the electronic prescribing cohort (phase II). In each cohort, patients received a median number of four different drugs (IQR 5 and IQR 4). A total of 3966 IRM was observed. During the hospitalization, 2.7% (n = 9) patients in phase I and 2.8% (n = 9) in phase II experienced an ADE. Potentially harmful MEs were less often observed in the cohort with electronic prescribing (n = 228 vs. n = 562). The mean number per patient significantly decreased from 1.69 to 0.71 (p < .01).

CONCLUSION

The implementation of a CPOE system resulted in a reduction of issues regarding medication, particularly MEs with the potential to harm patients decreased significantly.

Perspective: leveraging the electronic health record to improve sleep in the hospital

Inpatient sleep loss can worsen health outcomes, including delirium and falls. Sleep disruptions in the hospital often originate from provider-patient interactions ordered electronically through computerized provider order entry. These orders contain clinical decision support systems with default schedules. These defaults are often around-the-clock, may not align with patients' needs, and cause iatrogenic sleep loss. Optimizing clinical decision support in the electronic health record can decrease unnecessary sleep disruptions and influence sleep-friendly decision-making.

CITATION

Kadura S, Siala T, Arora VM. Perspective: Leveraging the electronic health record to improve sleep in the hospital. J Clin Sleep Med. 2023;19(2):421-423.

Implementation of Computerized Physician Order Entry in Primary Care: A Scoping Review

PURPOSE

This scoping review aimed to assess the implementation and outcomes of computerized physician order entry (CPOE) in primary care.

METHODS

A scoping review was carried out in accordance with the Joanna Briggs Institute's guidelines (JBI). The databases PubMed, CINAHL, Science Direct, and Google Scholar were all searched. The full text of each article was reviewed for eligibility after the title and abstract were evaluated. JBI data extraction were used to extract data. Donabedian's framework served as the foundation for the data discussion.

RESULTS

Based on the inclusion criteria, seven studies were included. The studies' main goal in common was to analyze the outcome or impact of implementing CPOE systems in ambulatory or primary care settings. Several studies described the framework, current state of implementation, and evaluation or recommendation following CPOE system implementation. Many positive effects were felt by physicians or prescribers, pharmacists, patients, and primary care providers, with patient safety being the primary goal.

CONCLUSION

Although this study discovered some issues and factors associated with CPOE implementation and adoption, such as infrastructure, workflow, level of engagement, and safety culture, CPOE has many positive outcomes for patients, physicians, and primary care. To improve CPOE adoption in healthcare, particularly primary care, more research into the structure, framework, and components of CPOE deployment is required.

Effect of Computerized Physician Order Entry and Clinical Decision Support System on Adverse Drug Events Prevention in the Emergency Department: A Systematic Review

Objective: An adverse drug event (ADE) is an injury resulting from a medical intervention related to a drug. The emergency department (ED) is a ward vulnerable to more ADEs because of overcrowding. Information technologies such as computerized physician order entry (CPOE) and clinical decision support system (CDSS) may decrease the occurrence of ADEs. This study aims to review research that reported the evaluation of the effectiveness of CPOE and CDSS on lowering the occurrence of ADEs in the ED. Data Sources: PubMed, EMBASE, and Web of Science databases were used to find studies published from 2003 to 2018. The search was conducted in November 2018. Study Selection and Data Extraction: The search resulted in 1700 retrieved articles. After applying inclusion and exclusion criteria, 11 articles were included. Data on the date, country, type of system, medication process stages, study design, participants, sample size, and outcomes were extracted. Data Synthesis: Results showed that CPOE and CDSS may prevent ADEs in the ED through significantly decreasing the rate of errors, ADEs, excessive dose, and inappropriate prescribing (in 54.5% of articles); furthermore, CPOE and CDSS may significantly increase the rate of appropriate prescribing and dosing in compliance with established guidelines (45.5% of articles). Conclusion: This study revealed that the use of CPOE and CDSS can lower the occurrence of ADEs in the ED; however, further randomized controlled trials are needed to address the effect of a CDSS, with basic or advanced features, on the occurrence of ADEs in the ED.

Design, Implementation, and Evaluation of Compliance With Pharmacy Workflow During a Pediatric Oncology Computerized Provider Order Entry (CPOE) Launch

OBJECTIVE

There is a lack of published literature detailing how computerized physician order entry (CPOE) pharmacy workflow is designed and implemented. The intent of this project was to design, implement, and assess compliance with the pharmacy workflow required for launching CPOE to improve the safety and efficiency of chemotherapy order entry for pediatric patients.

METHODS

This process implementation project took place in 2 phases, which included the design and implementation of pharmacy workflow education, and retrospective chart review of patients who received chemotherapy ordered through CPOE. An anonymous survey was also distributed to pharmacy staff, nurses, and physicians, and an assessment of any CPOE-related safety reports was completed.

RESULTS

Eighty-three patients received intravenous and/or intrathecal chemotherapy ordered via the CPOE software, Beacon, within the electronic medical record system, Epic, in the first 30 days post-launch across both the inpatient and outpatient settings. Overall compliance with the CPOE workflow for entering chemotherapy plans was 77% and >66% compliance with the order preparation process. Pharmacists provided an average of 1.6 interventions per review. The pharmacy was able to prepare chemotherapy within the allotted institutional time benchmarks in most cases. An overall combined multidisciplinary survey response rate of 30.6% was achieved. Twenty-eight Beacon-related patient safety reports were filed in the first 2 weeks post-launch.

CONCLUSIONS

The Beacon launch at this single pediatric institution was successful, and the pharmacy workflow was shown to greatly affect the overall success of the launch of CPOE. The careful prospective design, education, implementation, and retrospective review of the pharmacy workflow is key to process implementation related to chemotherapy CPOE.

The tradeoffs between safety and alert fatigue: Data from a national evaluation of hospital medication-related clinical decision support

OBJECTIVE

The study sought to evaluate the overall performance of hospitals that used the Computerized Physician Order Entry Evaluation Tool in both 2017 and 2018, along with their performance against fatal orders and nuisance orders.

MATERIALS AND METHODS

We evaluated 1599 hospitals that took the test in both 2017 and 2018 by using their overall percentage scores on the test, along with the percentage of fatal orders appropriately alerted on, and the percentage of nuisance orders incorrectly alerted on.

RESULTS

Hospitals showed overall improvement; the mean score in 2017 was 58.1%, and this increased to 66.2% in 2018. Fatal order performance improved slightly from 78.8% to 83.0% (P < .001), though there was almost no change in nuisance order performance (89.0% to 89.7%; P = .43). Hospitals alerting on one or more nuisance orders had a 3-percentage-point increase in their overall score.

DISCUSSION

Despite the improvement of overall scores in 2017 and 2018, there was little improvement in fatal order performance, suggesting that hospitals are not targeting the deadliest orders first. Nuisance order performance showed almost no improvement, and some hospitals may be achieving higher scores by overalerting, suggesting that the thresholds for which alerts are fired from are too low.

CONCLUSIONS

Although hospitals improved overall from 2017 to 2018, there is still important room for improvement for both fatal and nuisance orders. Hospitals that incorrectly alerted on one or more nuisance orders had slightly higher overall performance, suggesting that some hospitals may be achieving higher scores at the cost of overalerting, which has the potential to cause clinician burnout and even worsen safety.

Physicians' Use of the Computerized Physician Order Entry System for Medication Prescribing: Systematic Review

BACKGROUND

Computerized physician order entry (CPOE) systems in health care settings have many benefits for prescribing medication, such as improved quality of patient care and patient safety. However, to achieve their full potential, the factors influencing the usage of CPOE systems by physicians must be identified and understood.

OBJECTIVE

The aim of this study is to identify the factors influencing the usage of CPOE systems by physicians for medication prescribing in their clinical practice.

METHODS

We conducted a systematic search of the literature on this topic using four databases: PubMed, CINAHL, Ovid MEDLINE, and Embase. Searches were performed from September 2019 to December 2019. The retrieved papers were screened by examining the titles and abstracts of relevant studies; two reviewers screened the full text of potentially relevant papers for inclusion in the review. Qualitative, quantitative, and mixed methods studies with the aim of conducting assessments or investigations of factors influencing the use of CPOE for medication prescribing among physicians were included. The identified factors were grouped based on constructs from two models: the unified theory of acceptance and use of technology model and the Delone and McLean Information System Success Model. We used the Mixed Method Appraisal Tool to assess the quality of the included studies and narrative synthesis to report the results.

RESULTS

A total of 11 articles were included in the review, and 37 factors related to the usage of CPOE systems were identified as the factors influencing how physicians used CPOE for medication prescribing. These factors represented three main themes: individual, technological, and organizational.

CONCLUSIONS

This study identified the common factors that influenced the usage of CPOE systems by physicians for medication prescribing regardless of the type of setting or the duration of the use of a system by participants. Our findings can be used to inform implementation and support the usage of the CPOE system by physicians.

Towards The Automated, Empirical Filtering of Drug-Drug Interaction Alerts in Clinical Decision Support Systems: Historical Cohort Study of Vitamin K Antagonists

Background

Drug-drug interactions (DDIs) involving vitamin K antagonists (VKAs) constitute an important cause of in-hospital morbidity and mortality. However, the list of potential DDIs is long; the implementation of all these interactions in a clinical decision support system (CDSS) results in over-alerting and alert fatigue, limiting the benefits provided by the CDSS.

Objective

To estimate the probability of occurrence of international normalized ratio (INR) changes for each DDI rule, via the reuse of electronic health records.

Methods

An 8-year, exhaustive, population-based, historical cohort study including a French community hospital, a group of Danish community hospitals, and a Bulgarian hospital. The study database included 156,893 stays. After filtering against two criteria (at least one VKA administration and at least one INR laboratory result), the final analysis covered 4047 stays. Exposure to any of the 145 drugs known to interact with VKA was tracked and analyzed if at least 3 patients were concerned. The main outcomes are VKA potentiation (defined as an INR≥5) and VKA inhibition (defined as an INR≤1.5). Groups were compared using the Fisher exact test and logistic regression, and the results were expressed as an odds ratio (95% confidence limits).

Results

The drugs known to interact with VKAs either did not have a statistically significant association regarding the outcome (47 drug administrations and 14 discontinuations) or were associated with significant reduction in risk of its occurrence (odds ratio<1 for 18 administrations and 21 discontinuations).

Conclusions

The probabilities of outcomes obtained were not those expected on the basis of our current body of pharmacological knowledge. The results do not cast doubt on our current pharmacological knowledge per se but do challenge the commonly accepted idea whereby this knowledge alone should be used to define when a DDI alert should be displayed. Real-life probabilities should also be considered during the filtration of DDI alerts by CDSSs, as proposed in SPC-CDSS (statistically prioritized and contextualized CDSS). However, these probabilities may differ from one hospital to another and so should probably be calculated locally.

Can emergency department provider notes help to achieve more dynamic clinical decision support?

OBJECTIVE

Assess whether clinical data were present in emergency department (ED) provider notes at time of order entry for cervical spine (c-spine) imaging that could be used to augment or pre-populate clinical decision support (CDS) attributes.

METHODS

This Institutional Review Board-approved retrospective study, performed in a quaternary hospital, included all encounters for adult ED patients seen April 1, 2013-September 30, 2014 for a chief complaint of trauma who received c-spine computed tomography (CT) or x-ray. We assessed proportion of ED encounters with at least 1 c-spine-specific CDS rule attribute in clinical notes available at the time of imaging order and agreement between attributes in clinical notes and data entered into CDS.

RESULTS

A portion of the clinical note was submitted before imaging order in 42% (184/438) of encounters reviewed; 59.2% (109/184) of encounters with note portions submitted before imaging order had at least 1 positive CDS attribute identified supporting imaging study appropriateness; 34.8% (64/184) identified exclusion criteria where CDS appropriateness recommendations would not be applicable. 65.8% (121/184) of encounters had either a positive CDS attribute or an exclusion criterion. Concordance of c-spine CDS attributes when present in both notes and CDS was 68.4% (κ = 0.35 95% CI: 0.15-0.56; McNemar P = 0.23).

CONCLUSIONS

Clinical notes are an underutilized source of clinical attributes needed for CDS, available in a substantial percentage of encounters at the time of imaging order. Automated pre-population of imaging order requisitions with relevant clinical information extracted from electronic health record provider notes may: (1) improve ordering efficiency by reducing redundant data entry, (2) help improve clinical relevance of CDS alerts, and (3) potentially reduce provider burnout from extraneous alerts.

Computerized provider order entry-related medication errors among hospitalized patients: An integrative review

The Institute of Medicine estimates that 7,000 lives are lost yearly as a result of medication errors. Computerized physician and/or provider order entry was one of the proposed solutions to overcome this tragic issue. Despite some promising data about its effectiveness, it has been found that computerized provider order entry may facilitate medication errors.The purpose of this review is to summarize current evidence of computerized provider order entry -related medication errors and address the sociotechnical factors impacting the safe use of computerized provider order entry. By using PubMed and Google Scholar databases, a systematic search was conducted for articles published in English between 2007 and 2019 regarding the unintended consequences of computerized provider order entry and its related medication errors. A total of 288 articles were screened and categorized based on their use within the review. One hundred six articles met our pre-defined inclusion criteria and were read in full, in addition to another 27 articles obtained from references. All included articles were classified into the following categories: rates and statistics on computerized provider order entry -related medication errors, types of computerized provider order entry -related unintended consequences, factors contributing to computerized provider order entry failure, and recommendations based on addressing sociotechnical factors. Identifying major types of computerized provider order entry -related unintended consequences and addressing their causes can help in developing appropriate strategies for safe and effective computerized provider order entry. The interplay between social and technical factors can largely affect its safe implementation and use. This review discusses several factors associated with the unintended consequences of this technology in healthcare settings and presents recommendations for enhancing its effectiveness and safety within the context of sociotechnical factors.

Appropriateness of Overridden Alerts in Computerized Physician Order Entry: Systematic Review

BACKGROUND

The clinical decision support system (CDSS) has become an indispensable tool for reducing medication errors and adverse drug events. However, numerous studies have reported that CDSS alerts are often overridden. The increase in override rates has raised questions about the appropriateness of CDSS application along with concerns about patient safety and quality of care.

OBJECTIVE

The aim of this study was to conduct a systematic review to examine the override rate, the reasons for the alert override at the time of prescribing, and evaluate the appropriateness of overrides.

METHODS

We searched electronic databases, including Google Scholar, PubMed, Embase, Scopus, and Web of Science, without language restrictions between January 1, 2000 and March 31, 2019. Two authors independently extracted data and crosschecked the extraction to avoid errors. The quality of the included studies was examined following Cochrane guidelines.

RESULTS

We included 23 articles in our systematic review. The range of average override alerts was 46.2%-96.2%. An average of 29.4%-100% of the overrides alerts were classified as appropriate, and the rate of appropriateness varied according to the alert type (drug-allergy interaction 63.4%-100%, drug-drug interaction 0%-95%, dose 43.9%-88.8%, geriatric 14.3%-57%, renal 27%-87.5%). The interrater reliability for the assessment of override alerts appropriateness was excellent (kappa=0.79-0.97). The most common reasons given for the override were "will monitor" and "patients have tolerated before."

CONCLUSIONS

The findings of our study show that alert override rates are high, and certain categories of overrides such as drug-drug interaction, renal, and geriatric were classified as inappropriate. Nevertheless, large proportions of drug duplication, drug-allergy, and formulary alerts were appropriate, suggesting that these groups of alerts can be primary targets to revise and update the system for reducing alert fatigue. Future efforts should also focus on optimizing alert types, providing clear information, and explaining the rationale of the alert so that essential alerts are not inappropriately overridden.

Prevention of Nosocomial Catheter-Associated Urinary Tract Infections Through Computerized Feedback to Physicians and a Nurse-Directed Protocol

Catheter-associated urinary tract infections (CAUTIs) represent the most common nosocomial infection. The authors' baseline rate of CAUTI for general medical service was elevated at 36 per 1000 catheter-days. The medical literature has consistently linked inappropriate catheter use with the development of CAUTI. The baseline data also revealed a high rate of inappropriate use of indwelling urinary catheters. Using the dual modalities of technology through prompts in the computerized order/entry system and handheld bladder scanners, as well as in combination with staff education and nurse empowerment, the authors were successful in reducing the use and duration of urinary catheters as well as the incidence of CAUTI. In subsequent data collection cycles over the following 2 years, 81% reduction in device use and a 73% reduction in the clinical end point of nosocomial CAUTI (36/1000 catheter-days to 11/1000 catheter-days; P < .001) was demonstrated.

Clinical Decision Support Systems for Drug Allergy Checking: Systematic Review

BACKGROUND

Worldwide, the burden of allergies-in particular, drug allergies-is growing. In the process of prescribing, dispensing, or administering a drug, a medication error may occur and can have adverse consequences; for example, a drug may be given to a patient with a documented allergy to that particular drug. Computerized physician order entry (CPOE) systems with built-in clinical decision support systems (CDSS) have the potential to prevent such medication errors and adverse events.

OBJECTIVE

The aim of this review is to provide a comprehensive overview regarding all aspects of CDSS for drug allergy, including documenting, coding, rule bases, alerts and alert fatigue, and outcome evaluation.

METHODS

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed as much as possible and searches were conducted in 5 databases using CPOE, CDSS, alerts, and allergic or allergy as keywords. Bias could not be evaluated according to PRISMA guidelines due to the heterogeneity of study types included in the review.

RESULTS

Of the 3160 articles considered, 60 met the inclusion criteria. A further 9 articles were added based on expert opinion, resulting in a total of 69 articles. An interrater agreement of 90.9% with a reliability Κ=.787 (95% CI 0.686-0.888) was reached. Large heterogeneity across study objectives, study designs, study populations, and reported results was found. Several key findings were identified. Evidence of the usefulness of clinical decision support for drug allergies has been documented. Nevertheless, there are some important problems associated with their use. Accurate and structured documenting of information on drug allergies in electronic health records (EHRs) is difficult, as it is often not clear to healthcare providers how and where to document drug allergies. Besides the underreporting of drug allergies, outdated or inaccurate drug allergy information in EHRs poses an important problem. Research on the use of coding terminologies for documenting drug allergies is sparse. There is no generally accepted standard terminology for structured documentation of allergy information. The final key finding is the consistently reported low specificity of drug allergy alerts. Current systems have high alert override rates of up to 90%, leading to alert fatigue. Important challenges remain for increasing the specificity of drug allergy alerts. We found only one study specifically reporting outcomes related to CDSS for drug allergies. It showed that adverse drug events resulting from overridden drug allergy alerts do not occur frequently.

CONCLUSIONS

Accurate and comprehensive recording of drug allergies is required for good use of CDSS for drug allergy screening. We found considerable variation in the way drug allergy are recorded in EHRs. It remains difficult to reduce drug allergy alert overload while maintaining patient safety as the highest priority. Future research should focus on improving alert specificity, thereby reducing override rates and alert fatigue. Also, the effect on patient outcomes and cost-effectiveness should be evaluated.

[Factors in the occurrence of medication errors and the use of order sets]

The packaging of the medication and the writing on the label can be the cause of medication errors. Errors in the intake of sodium chloride and potassium chloride have notably been due to the fact that the label of the infusion solute did not explicitly indicate the quantities present in the 500 mL and 1 000 mL bottles. Moreover, the meaning of the description comprising the term 'q.s.p. 1 000 mL' was not known by some of the nursing staff. These two factors, combined with the possibility of prescribing predefined order sets, have led to medication errors which have given rise to a study of how practices can be improved.

Comparison of three commercial knowledge bases for detection of drug-drug interactions in clinical decision support

Objective

To compare 3 commercial knowledge bases (KBs) used for detection and avoidance of potential drug-drug interactions (DDIs) in clinical practice.

Methods

Drugs in the DDI tables from First DataBank (FDB), Micromedex, and Multum were mapped to RxNorm. The KBs were compared at the clinical drug, ingredient, and DDI rule levels. The KBs were evaluated against a reference list of highly significant DDIs from the Office of the National Coordinator for Health Information Technology (ONC). The KBs and the ONC list were applied to a prescription data set to simulate their use in clinical decision support.

Results

The KBs contained 1.6 million (FDB), 4.5 million (Micromedex), and 4.8 million (Multum) clinical drug pairs. Altogether, there were 8.6 million unique pairs, of which 79% were found only in 1 KB and 5% in all 3 KBs. However, there was generally more agreement than disagreement in the severity rankings, especially in the contraindicated category. The KBs covered 99.8-99.9% of the alerts of the ONC list and would have generated 25 (FDB), 145 (Micromedex), and 84 (Multum) alerts per 1000 prescriptions.

Conclusion

The commercial KBs differ considerably in size and quantity of alerts generated. There is less variability in severity ranking of DDIs than suggested by previous studies. All KBs provide very good coverage of the ONC list. More work is needed to standardize the editorial policies and evidence for inclusion of DDIs to reduce variation among knowledge sources and improve relevance. Some DDIs considered contraindicated in all 3 KBs might be possible candidates to add to the ONC list.

Implementation of a Goal-Directed Mechanical Ventilation Order Set Driven by Respiratory Therapists Improves Compliance With Best Practices for Mechanical Ventilation

PURPOSE

Data regarding best practices for ventilator management strategies that improve outcomes in acute respiratory distress syndrome (ARDS) are readily available. However, little is known regarding processes to ensure compliance with these strategies. We developed a goal-directed mechanical ventilation order set that included physician-specified lung-protective ventilation and oxygenation goals to be implemented by respiratory therapists (RTs). We sought as a primary outcome to determine whether an RT-driven order set with predefined oxygenation and ventilation goals could be implemented and associated with improved adherence with best practice.

METHODS

We evaluated 1302 patients undergoing invasive mechanical ventilation (1693 separate episodes of invasive mechanical ventilation) prior to and after institution of a standardized, goal-directed mechanical ventilation order set using a controlled before-and-after study design. Patient-specific goals for oxygenation partial pressure of oxygen in arterial blood (Pao ₂), ARDS Network [Net] positive end-expiratory pressure [PEEP]/fraction of inspired oxygen [Fio ₂] table use) and ventilation (pH, partial pressure of carbon dioxide) were selected by prescribers and implemented by RTs.

RESULTS

Compliance with the new mechanical ventilation order set was high: 88.2% compliance versus 3.8% before implementation of the order set ( P < .001). Adherence to the PEEP/Fio ₂ table after implementation of the order set was significantly greater (86.0% after vs 82.9% before, P = .02). There was no difference in duration of mechanical ventilation, intensive care unit (ICU) length of stay, and in-hospital or ICU mortality.

CONCLUSIONS

A standardized best practice mechanical ventilation order set can be implemented by a multidisciplinary team and is associated with improved compliance to written orders and adherence to the ARDSNet PEEP/Fio ₂ table.

Treatment of Hyperkalemia With a Low-Dose Insulin Protocol Is Effective and Results in Reduced Hypoglycemia

Introduction

Complications associated with insulin treatment for hyperkalemia are serious and common. We hypothesize that, in chronic kidney disease (CKD) and end-stage renal disease (ESRD), giving 5 units instead of 10 units of i.v. regular insulin may reduce the risk of causing hypoglycemia when treating hyperkalemia.

Methods

A retrospective quality improvement study on hyperkalemia management (K⁺ ≥ 6 mEq/l) from June 2013 through December 2013 was conducted at an urban emergency department center. Electronic medical records were reviewed, and data were extracted on presentation, management of hyperkalemia, incidence and timing of hypoglycemia, and whether treatment was ordered as a protocol through computerized physician order entry (CPOE). We evaluated whether an educational effort to encourage the use of a protocol through CPOE that suggests the use of 5 units might be beneficial for CKD/ESRD patients. A second audit of hyperkalemia management from July 2015 through January 2016 was conducted to assess the effects of intervention on hypoglycemia incidence.

Results

Treatments ordered using a protocol for hyperkalemia increased following the educational intervention (58 of 78 patients [74%] vs. 62 of 99 patients [62%]), and the number of CKD/ESRD patients prescribed 5 units of insulin as per protocol increased (30 of 32 patients [93%] vs. 32 of 43 [75%], P = .03). Associated with this, the incidence of hypoglycemia associated with insulin treatment was lower (7 of 63 patients [11%] vs. 22 of 76 patients [28%], P = .03), and there were no cases of severe hypoglycemia compared to the 3 cases before the intervention.

Conclusion

Education on the use of a protocol for hyperkalemia resulted in a reduction in the number of patients with severe hypoglycemia associated with insulin treatment.

Community-acquired pneumonia management and outcomes in the era of health information technology

Pneumonia continues to be a leading cause of hospitalization and mortality. Implementation of health information technology (HIT) can lead to cost savings and improved care. In this review, we examine the literature on the use of HIT in the management of community-acquired pneumonia. We also discuss barriers to adoption of technology in managing pneumonia, the reliability and quality of electronic health data in pneumonia research, how technology has assisted pneumonia diagnosis and outcomes research. The goal of using HIT is to develop and deploy generalizable, real-time, computerized clinical decision support integrated into usual pneumonia care. A friendly user interface that does not disrupt efficiency and demonstrates improved clinical outcomes should result in widespread adoption.

National trends in safety performance of electronic health record systems in children's hospitals

Objective

To evaluate the safety of computerized physician order entry (CPOE) and associated clinical decision support (CDS) systems in electronic health record (EHR) systems at pediatric inpatient facilities in the US using the Leapfrog Group's pediatric CPOE evaluation tool.

Methods

The Leapfrog pediatric CPOE evaluation tool, a previously validated tool to assess the ability of a CPOE system to identify orders that could potentially lead to patient harm, was used to evaluate 41 pediatric hospitals over a 2-year period. Evaluation of the last available test for each institution was performed, assessing performance overall as well as by decision support category (eg, drug-drug, dosing limits). Longitudinal analysis of test performance was also carried out to assess the impact of testing and the overall trend of CPOE performance in pediatric hospitals.

Results

Pediatric CPOE systems were able to identify 62% of potential medication errors in the test scenarios, but ranged widely from 23-91% in the institutions tested. The highest scoring categories included drug-allergy interactions, dosing limits (both daily and cumulative), and inappropriate routes of administration. We found that hospitals with longer periods since their CPOE implementation did not have better scores upon initial testing, but after initial testing there was a consistent improvement in testing scores of 4 percentage points per year.

Conclusions

Pediatric computerized physician order entry (CPOE) systems on average are able to intercept a majority of potential medication errors, but vary widely among implementations. Prospective and repeated testing using the Leapfrog Group's evaluation tool is associated with improved ability to intercept potential medication errors.

JOURNAL CLUB: Predictors of Provider Response to Clinical Decision Support: Lessons Learned From the Medicare Imaging Demonstration

OBJECTIVE

The efficacy of imaging clinical decision support (CDS) varies. Our objective was to identify CDS factors contributing to imaging order cancellation or modification.

SUBJECTS AND METHODS

This pre-post study was performed across four institutions participating in the Medicare Imaging Demonstration. The intervention was CDS at order entry for selected outpatient imaging procedures. On the basis of the information entered, computerized alerts indicated to providers whether orders were not covered by guidelines, appropriate, of uncertain appropriateness, or inappropriate according to professional society guidelines. Ordering providers could override or accept CDS. We considered actionable alerts to be those that could generate an immediate order behavior change in the ordering physician (i.e., cancellation of inappropriate orders or modification of orders of uncertain appropriateness that had a recommended alternative). Chi-square and logistic regression identified predictors of order cancellation or modification after an alert.

RESULTS

A total of 98,894 radiology orders were entered (83,114 after the intervention). Providers ignored 98.9%, modified 1.1%, and cancelled 0.03% of orders in response to alerts. Actionable alerts had a 10 fold higher rate of modification (8.1% vs 0.7%; p < 0.0001) or cancellation (0.2% vs 0.02%; p < 0.0001) orders compared with nonactionable alerts. Orders from institutions with preexisting imaging CDS had a sevenfold lower rate of cancellation or modification than was seen at sites with newly implemented CDS (1.4% vs 0.2%; p < 0.0001). In multivariate analysis, actionable alerts were 12 times more likely to result in order cancellation or modification. Orders at sites with preexisting CDS were 7.7 times less likely to be cancelled or modified (p < 0.0001).

CONCLUSION

Using results from the Medicare Imaging Demonstration project, we identified potential factors that were associated with CDS effect on provider imaging ordering; these findings may have implications for future design of such computerized systems.

Clinical Decision Support for Pediatric Blood Product Prescriptions

Since the beginning of the 20th century, blood products have been used to effectively treat life-threatening conditions. Over time, we have come to appreciate the many benefits along with significant risks inherent to blood product transfusions. As such, recommendations for the safe and effective use of blood products have evolved over time. Current evidence supports the use of restrictive transfusion strategies that can avoid the risks of unnecessary transfusions. In spite of good evidence, there is a considerable amount of variability in transfusion practices across providers. Clinical decision support (CDS) is an effective tool capable of increasing adherence to evidence-based practices. CDS has been used successfully to improve adherence to transfusion guidelines. Pediatric literature demonstrates strong evidence for the use of CDS to improve appropriateness of red blood cell and plasma transfusion utilization. Further studies in more diverse settings with more standardized reporting are needed to provide more clarity around the effectiveness of CDS in blood product prescriptions.

Prescriber Compliance with a New Computerized Insulin Guideline for Noncritically Ill Adults

BACKGROUND

In March 2008, the University of California, Davis Medical Center (UCDMC), implemented a guideline for the inpatient management of diabetes in noncritically ill adults. In accordance with national guidelines, all patients with type 2 diabetes are prescribed basal, nutritional, and correctional insulin. The guideline was added to the electronic medical record as a standardized physician order set in April 2008 and provider training on the insulin guideline occurred in May 2008.

OBJECTIVE

To evaluate provider compliance with a new electronic standardized insulin order set in a hospital setting.

METHODS

All patients with insulin orders admitted to the general internal medicine service between June 1, 2008, and November 1, 2008, were evaluated in this single-center retrospective chart review at UCDMC in Sacramento. Patients older than 18 years with a history of type 2 diabetes were included in the analysis. Insulin orders were categorized as preferred (followed the guideline) or nonpreferred regimens (did not follow all components of the guideline).

RESULTS

A total of 265 patients were identified during the study period. The preferred regimen was ordered in 82 (30.9%) of the evaluated patient admissions. Of the 183 (69.1%) nonpreferred regimens, more than half (54.6%) contained correctional insulin alone; 84.2% of patient admissions prescribed nonpreferred regimens lacked nutritional insulin. Average admission blood glucose readings were higher in the preferred versus nonpreferred regimen group (224.4 vs 164.8 mg/dL, p < 0.001).

CONCLUSIONS

The preferred regimen was not prescribed for the majority of patients admitted with a history of type 2 diabetes, despite computerized decision support. Nutritional insulin was the most common missing component in the nonpreferred regimens. Baseline clinical factors, educational modalities, and guideline content may have influenced prescribing patterns.

JOURNAL CLUB: Radiologists' Perceptions of Computerized Decision Support: A Focus Group Study From the Medicare Imaging Demonstration Project

OBJECTIVE

The purpose of this study was to discern radiologists' perceptions regarding the implementation of a decision support system intervention as part of the Medicare Imaging Demonstration project and the effect of decision support on radiologists' interactions with ordering clinicians, their radiology work flow, and appropriateness of advanced imaging.

SUBJECTS AND METHODS

A focus group study was conducted with a diverse sample of radiologists involved in interpreting advanced imaging studies at Medicare Imaging Demonstration project sites. A semistructured moderator guide was used, and all focus group discussions were recorded and transcribed verbatim. Qualitative data analysis software was used to code thematic content and identify representative segments of text. Participating radiologists also completed an accompanying survey designed to supplement focus group discussions.

RESULTS

Twenty-six radiologists participated in four focus group discussions. The following major themes related to the radiologists' perceptions after decision support implementation were identified: no substantial change in radiologists' interactions with referring clinicians; no substantial change in radiologist work flow, including protocol-writing time; and no perceived increase in imaging appropriateness. Radiologists provided suggestions for improvements in the decision support system, including increasing the usability of clinical data captured, and expressed a desire to have greater involvement in future development and implementation efforts.

CONCLUSION

Overall, radiologists from health care systems involved in the Medicare Imaging Demonstration did not perceive that decision support had a substantial effect, either positive or negative, on their professional roles and responsibilities. Radiologists expressed a desire to improve efficiencies and quality of care by having greater involvement in future efforts.

The effect of clinical decision support for advanced inpatient imaging

PURPOSE

To examine the effect of integrating point-of-care clinical decision support (CDS) using the ACR Appropriateness Criteria (AC) into an inpatient computerized provider order entry (CPOE) system for advanced imaging requests.

METHODS

Over 12 months, inpatient CPOE requests for nuclear medicine, CT, and MRI were processed by CDS to generate an AC score using provider-selected data from pull-down menus. During the second 6-month period, AC scores were displayed to ordering providers, and acknowledgement was required to finalize a request. Request AC scores and percentages of requests not scored by CDS were compared among primary care providers (PCPs) and specialists, and by years in practice of the responsible physician of record.

RESULTS

CDS prospectively generated a score for 26.0% and 30.3% of baseline and intervention requests, respectively. The average AC score increased slightly for all requests (7.2 ± 1.6 versus 7.4 ± 1.5; P < .001), for PCPs (6.9 ± 1.9 versus 7.4 ± 1.6; P < .001), and minimally for specialists (7.3 ± 1.6 versus 7.4 ± 1.5; P < .001). The percentage of requests lacking sufficient structured clinical information to generate an AC score decreased for all requests (73.1% versus 68.9%; P < .001), for PCPs (78.0% versus 71.7%; P < .001), and for specialists (72.9% versus 69.1%; P < .001).

CONCLUSIONS

Integrating CDS into inpatient CPOE slightly increased the overall AC score of advanced imaging requests as well as the provision of sufficient structured data to automatically generate AC scores. Both effects were more pronounced in PCPs compared with specialists.

Towards Better Test Utilization - Strategies to Improve Physician Ordering and Their Impact on Patient Outcomes

Laboratory medicine is the single highest volume medical activity in healthcare and demand for laboratory testing is increasing disproportionately to medical activity. It has been estimated that $6.8 billion of medical care in the US involves unnecessary testing and procedures that do not improve patient care and may even harm the patient. Physicians face many challenges in accurately, efficiently and safely ordering and interpreting diagnostic tests. In order to improve patient outcomes, laboratory tests must be appropriately ordered, properly conducted, reported in a timely manner, correctly interpreted and affect a decision for future diagnosis and treatment of the patient.

Improving influenza vaccination coverage in the pediatric asthma population: the case for combined methodologies

The Advisory Committee on Immunization Practices recommends annual influenza vaccine for pediatric asthma patients. Despite considerable risk for influenza complications in pediatric asthma patients, including hospitalization and death, influenza vaccination among children with asthma remains low, especially among low-income pediatric asthma patients. Multiple interventions have been attempted to increase immunization in the pediatric asthma population, including recall and reminders, parent/patient education, and physician education. More recently, information technology methods have been employed, including electronic alerts and computerized physician order entry/clinical decision support interventions. Each of these interventions, as well as a recent legislative intervention, has evidence of effectiveness, but none achieved the Healthy People 2020 vaccination goals of 80 percent for this population. This goal may be achievable with a combination of these methodologies and strategies that increase access to care for underserved patients.

Impact of clinical decision support preventing the use of QT-prolonging medications for patients at risk for torsade de pointes

We developed and implemented a 'CPOE-QT Alert' system, that is, clinical decision support integrated in the computerized physician order entry system (CPOE), in 2011. The system identifies any attempts to order medications with risk of torsade de pointes (TdP) for patients with a history of significant QT prolongation (QTc ≥500 ms) and alerts the provider entering the order. We assessed its impact by comparing orders and subsequent medication administration before and after activation of the system. We found a significant decrease in the proportion of completed order per ordering attempt after system activation (94% (1293/1379) vs 77% (1888/2453), difference 16.8%; p<0.001). This resulted in a 13.9% reduction in the administration of those medications to patients. A significant decrease was observed across all provider types, educational levels, and specialties. The CPOE-QT Alert system successfully reduced exposure to QT-prolonging medications in high risk patients.

Improving care for pediatric diabetic ketoacidosis

OBJECTIVE

We sought to create and implement recommendations from an evidence-based pathway for hospital management of pediatric diabetic ketoacidosis (DKA) and to sustain improvement. We hypothesized that development and utilization of standard work for inpatient care of DKA would lead to reduction in hypokalemia and improvement in outcome measures.

METHODS

Development involved systematic review of published literature by a multidisciplinary team. Implementation included multidisciplinary feedback, hospital-wide education, daily team huddles, and development of computer decision support and electronic order sets.

RESULTS

Pathway-based order sets forced clinical pathway adherence; yet, variations in care persisted, requiring ongoing iterative review and pathway tool adjustment. Quality improvement measures have identified barriers and informed subsequent adjustments to interventions. We compared 281 patients treated postimplementation with 172 treated preimplementation. Our most notable findings included the following: (1) monitoring of serum potassium concentrations identified unanticipated hypokalemia episodes, not recognized before standard work implementation, and earlier addition of potassium to fluids resulted in a notable reduction in hypokalemia; (2) improvements in insulin infusion management were associated with reduced duration of ICU stay; and (3) with overall improved DKA management and education, cerebral edema occurrence and bicarbonate use were reduced. We continue to convene quarterly meetings, review cases, and process ongoing issues with system-based elements of implementing the recommendations.

CONCLUSIONS

Our multidisciplinary development and implementation of an evidence-based pathway for DKA have led to overall improvements in care. We continue to monitor quality improvement metric measures to sustain clinical gains while continuing to identify iterative improvement opportunities.

Interventions to reduce pediatric medication errors: a systematic review

BACKGROUND AND OBJECTIVE

Medication errors cause appreciable morbidity and mortality in children. The objective was to determine the effectiveness of interventions to reduce pediatric medication errors, identify gaps in the literature, and perform meta-analyses on comparable studies.

METHODS

Relevant studies were identified from searches of PubMed, Embase, Scopus, Web of Science, the Cochrane Library, and the Cumulative Index to Nursing Allied Health Literature and previous systematic reviews. Inclusion criteria were peer-reviewed original data in any language testing an intervention to reduce medication errors in children. Abstract and full-text article review were conducted by 2 independent authors with sequential data extraction.

RESULTS

A total of 274 full-text articles were reviewed and 63 were included. Only 1% of studies were conducted at community hospitals, 11% were conducted in ambulatory populations, 10% reported preventable adverse drug events, 10% examined administering errors, 3% examined dispensing errors, and none reported cost-effectiveness data, suggesting persistent research gaps. Variation existed in the methods, definitions, outcomes, and rate denominators for all studies; and many showed an appreciable risk of bias. Although 26 studies (41%) involved computerized provider order entry, a meta-analysis was not performed because of methodologic heterogeneity. Studies of computerized provider order entry with clinical decision support compared with studies without clinical decision support reported a 36% to 87% reduction in prescribing errors; studies of preprinted order sheets revealed a 27% to 82% reduction in prescribing errors.

CONCLUSIONS

Pediatric medication errors can be reduced, although our understanding of optimal interventions remains hampered. Research should focus on understudied areas, use standardized definitions and outcomes, and evaluate cost-effectiveness.

Toward successful migration to computerized physician order entry for chemotherapy

BACKGROUND

Computerized physician order entry (cpoe) systems allow for medical order management in a clinical setting. Use of a cpoe has been shown to significantly improve chemotherapy safety by reducing the number of prescribing errors. Usability of these systems has been identified as a critical factor in their successful adoption. However, there is a paucity of literature investigating the usability of cpoe for chemotherapy and describing the experiences of cancer care providers in implementing and using a cpoe system.

METHODS

A mixed-methods study, including a national survey and a workshop, was conducted to determine the current status of cpoe adoption in Canadian oncology institutions, to identify and prioritize knowledge gaps in cpoe usability and adoption, and to establish a research agenda to bridge those gaps. Survey respondents were representatives of cancer care providers from each Canadian province. The workshop participants were oncology clinicians, human factors engineers, patient safety researchers, policymakers, and hospital administrators from across Canada, with participation from the United States.

RESULTS

A variety of issues related to implementing and using a cpoe for chemotherapy were identified. The major issues concerned the need for better understanding of current practices of chemotherapy ordering, preparation, and administration; a lack of system selection and procurement guidance; a lack of implementation and maintenance guidance; poor cpoe usability and workflow support; and other cpoe system design issues. An additional three research themes for addressing the existing challenges and advancing successful adoption of cpoe for chemotherapy were identified: The need to investigate variances in workflows and practices in chemotherapy ordering and administrationThe need to develop best-practice cpoe procurement and implementation guidance specifically for chemotherapyThe need to measure the effects of cpoe implementation in medical oncology.

CONCLUSIONS

Addressing the existing challenges in cpoe usability and adoption for chemotherapy, and accelerating successful migration to cpoe by cancer care providers requires future research focusing on workflow variations, chemotherapy-specific cpoe procurement needs, and implementation guidance needs.

A computerized standard protocol order entry for pediatric inpatient acute seizure emergencies reduces time to treatment

Time to treatment of seizures is critical to efficacy. We performed a quality initiative and evaluated time to treatment of inpatient seizure emergencies with first- and second-line medicines before and after implementation of a computerized, standard treatment protocol. Data from 125 patients revealed that 179 seizure episodes required first-line antiepileptic drugs, and the mean time to treatment was 7.72 minutes. In 87 episodes, patients (49%) received the drugs within 5 minutes. Forty-six episodes required second-line drugs. In 17 (37%), patients received them within 30 minutes (mean 49.48 minutes). After implementation of the protocol, the mean time to treatment with first-line drugs was 3.74 minutes, a reduction of >50% (P < .0001). The mean time to treatment with second-line drugs was 25.05 minutes, a reduction of ∼50% (P < .0001). This effective model for reducing the time to treatment of seizure emergencies may be useful to similar institutions.

Evaluating incorporation of drug restrictions into computerized drug order entries after transition to an electronic health record

BACKGROUND

Incorporation of drug restriction policy into electronic drug order entries (DOEs) can promote responsible medication use and resource utilization when implemented systematically.

OBJECTIVE

To identify drugs that require further incorporation of formulary restriction policy into their DOEs after migration to an electronic health record with computerized prescriber order entry (CPOE).

METHODS

After transition to CPOE, test orders for formulary restricted drugs were entered in the CPOE environment. Data were collected about rationale for drug restriction, type of formulary restriction, presence of incorporation of restriction policy into the DOE, and whether incorporation was consistent with a recommended method. Restricted drugs requiring revision of policy incorporation into their DOEs were analyzed to create a prioritized task list based on rationale for the restriction.

RESULTS

Of all restricted drugs, 63.6% (287/451) did not have restriction policy incorporated into their DOEs consistent with the recommended method and therefore required revision. Eighteen percent (81/451) of restricted drugs had no incorporation of restriction policy in their DOEs. Safety was the rationale for restriction in 21% (17/81) of these, which received highest priority for revision. When drugs were orderable but restricted, 61.9% (78/126) lacked optimal incorporation of policy in DOEs to promote adherence. When drugs were not orderable, 64% (206/322) did not provide guidance to formulary alternatives in DOEs when they should have.

CONCLUSION

After transition to CPOE, almost two-thirds of all analyzed restricted drugs lacked optimal incorporation of formulary restriction policies in their DOEs. DOEs with restrictions related to safety reasons were among those most frequently requiring revision. Some DOEs can better promote adherence and provide guidance to prescribers through revision. Predefined, systematic implementation strategies should be used during changes in computerized drug use processes.

Assessing physician utilization of laboratory practice guidelines: barriers and opportunities for improvement

OBJECTIVES

To assess physician utilization of laboratory practice guidelines (LPGs)³ to improve LPG uptake and use.

DESIGN AND METHODS

A statewide survey of 4987 primary care physicians (PCPs) and 75 infectious disease (ID) specialists was conducted in 2005-2006 to correlate guideline source with users' awareness, utilization, and perceived usefulness of LPGs. We compared LPGs developed by the Centers for Disease Control and Prevention (CDC) to LPGs developed by the Washington State Department of Health through its Clinical Laboratory Advisory Council (CLAC).

RESULTS

Physician awareness of LPGs was a major impediment to utilization of CLAC LPGs, and they were perceived as inaccessible, too numerous and unhelpful. However, once aware, respondents tended to use LPGs and there were no important differences in impediments or the ways CDC and CLAC LPGs were used. Of the PCPs who had a computerized physician order entry system (CPOE), a majority (92%) found, or expected that they would find, the integration of guidelines into their system helpful.

CONCLUSIONS

For both CDC and CLAC LPGs, the greatest impediments to uptake were awareness and familiarity, which depended upon LPG source, physician specialty, and practice setting. There was no apparent impediment to uptake of CLAC or CDC LPGs based upon their credibility. Because better promotion could increase uptake, CLAC LPGs are now promoted by the Washington State Medical Association. Integration of LPGs into CPOE and smart phone applications could address major impediments to clinician use. The Cabana paradigm would be useful for any organization seeking to improve LPG impact.

Relationship between medication event rates and the Leapfrog computerized physician order entry evaluation tool

OBJECTIVE

The Leapfrog CPOE evaluation tool has been promoted as a means of monitoring computerized physician order entry (CPOE). We sought to determine the relationship between Leapfrog scores and the rates of preventable adverse drug events (ADE) and potential ADE.

MATERIALS AND METHODS

A cross-sectional study of 1000 adult admissions in five community hospitals from October 1, 2008 to September 30, 2010 was performed. Observed rates of preventable ADE and potential ADE were compared with scores reported by the Leapfrog CPOE evaluation tool. The primary outcome was the rate of preventable ADE and the secondary outcome was the composite rate of preventable ADE and potential ADE.

RESULTS

Leapfrog performance scores were highly related to the primary outcome. A 43% relative reduction in the rate of preventable ADE was predicted for every 5% increase in Leapfrog scores (rate ratio 0.57; 95% CI 0.37 to 0.88). In absolute terms, four fewer preventable ADE per 100 admissions were predicted for every 5% increase in overall Leapfrog scores (rate difference -4.2; 95% CI -7.4 to -1.1). A statistically significant relationship between Leapfrog scores and the secondary outcome, however, was not detected.

DISCUSSION

Our findings support the use of the Leapfrog tool as a means of evaluating and monitoring CPOE performance after implementation, as addressed by current certification standards.

CONCLUSIONS

Scores from the Leapfrog CPOE evaluation tool closely relate to actual rates of preventable ADE. Leapfrog testing may alert providers to potential vulnerabilities and highlight areas for further improvement.

"Reducing unnecessary testing in a CPOE system through implementation of a targeted CDS intervention"

BACKGROUND

We describe and evaluate the development and use of a Clinical Decision Support (CDS) intervention; an alert, in response to an identified medical error of overuse of a diagnostic laboratory test in a Computerized Physician Order Entry (CPOE) system. CPOE with embedded CDS has been shown to improve quality of care and reduce medical errors. CPOE can also improve resource utilization through more appropriate use of laboratory tests and diagnostic studies. Observational studies are necessary in order to understand how these technologies can be successfully employed by healthcare providers.

METHODS

The error was identified by the Test Utilization Committee (TUC) in September, 2008 when they noticed critical care patients were being tested daily, and sometimes twice daily, for B-Type Natriuretic Peptide (BNP). Repeat and/or serial BNP testing is inappropriate for guiding the management of heart failure and may be clinically misleading. The CDS intervention consists of an expert rule that searches the system for a BNP lab value on the patient. If there is a value and the value is within the current hospital stay, an advisory is displayed to the ordering clinician. In order to isolate the impact of this intervention on unnecessary BNP testing we applied multiple regression analysis to the sample of 41,306 patient admissions with at least one BNP test at LVHN between January, 2008 and September, 2011.

RESULTS

Our regression results suggest the CDS intervention reduced BNP orders by 21% relative to the mean. The financial impact of the rule was also significant. Multiplying by the direct supply cost of $28.04 per test, the intervention saved approximately $92,000 per year.

CONCLUSIONS

The use of alerts has great positive potential to improve care, but should be used judiciously and in the appropriate environment. While these savings may not be generalizable to other interventions, the experience at LVHN suggests that appropriately designed and carefully implemented CDS interventions can have a substantial impact on the efficiency of care provision.

Systems that prevent unwanted represcription of drugs withdrawn because of adverse drug events: a systematic review

Represcription of medication that was withdrawn after the occurrence of an adverse drug event (including allergy), is a recognized medication safety issue on a patient level. We performed a systematic review to identify systems (electronic and nonelectronic) that can prevent the represcription of drugs withdrawn because of an adverse drug event and the effects of these systems. The review was performed using PRISMA and Cochrane guidelines. PubMed and Embase were searched for articles describing systems that can prevent represcription of drugs that had been withdrawn for causing an adverse drug event. Information on the characteristics of the studies, systems, and if present results achieved with such systems, was extracted. The results showed that of 6793 articles screened, 137 full-text articles were assessed for eligibility. A total of 45 studies describing 33 systems (28 electronic) were included. The five nonelectronic systems used allergy bracelets or allergy labels on hospital medical records or on drug orders. Systems differed in the way adverse drug events were documented and how users were alerted to drug represcription. Most systems functioned within a specific healthcare setting. Of 12 studies that compared pre- and post-intervention periods or wards with and without intervention, 7 showed a reduction in represcription after adverse drug event. In conclusion, several systems have been developed that can prevent the represcription of drugs that elicited an adverse drug event, but the evidence that these systems are effective is limited.

Physicians' perceptions on the usefulness of contextual information for prioritizing and presenting alerts in Computerized Physician Order Entry systems

BACKGROUND

One possible approach towards avoiding alert overload and alert fatigue in Computerized Physician Order Entry (CPOE) systems is to tailor their drug safety alerts to the context of the clinical situation. Our objective was to identify the perceptions of physicians on the usefulness of clinical context information for prioritizing and presenting drug safety alerts.

METHODS

We performed a questionnaire survey, inquiring CPOE-using physicians from four hospitals in four European countries to estimate the usefulness of 20 possible context factors.

RESULTS

The 223 participants identified the 'severity of the effect' and the 'clinical status of the patient' as the most useful context factors. Further important factors are the 'complexity of the case' and the 'risk factors of the patient'.

CONCLUSIONS

Our findings confirm the results of a prior, comparable survey inquiring CPOE researchers. Further research should focus on implementing these context factors in CPOE systems and on subsequently evaluating their impact.

Adverse drug event rates in six community hospitals and the potential impact of computerized physician order entry for prevention

CONTEXT

Medications represent a major cause of harm and are costly for hospitalized patients, but more is known about these issues in large academic hospitals than in smaller hospitals.

OBJECTIVE

To assess the incidence of adverse drug events (ADEs) in six community hospitals.

DESIGN

Multicenter, retrospective cohort study.

SETTING

Six Massachusetts community hospitals with 100 to 300 beds.

PATIENTS

From 109,641 adult patients hospitalized from January 2005 through August 2006, a random sample of 1,200 patients was drawn, 200 per site.

MAIN OUTCOME MEASURES

ADEs and preventable ADEs.

METHODS

Presence of an ADE was evaluated using an adaptation of a trigger instrument developed by the Institute for Health Care Improvement. Independent reviewers classified events by preventability, severity, and potential for preventability by computerized physician order entry (CPOE).

RESULTS

A total of 180 ADEs occurred in 141 patients (rate, 15.0/100 admissions). Overall, 75% were preventable. ADEs were rated as serious in 49.4% and life threatening in 11.7%. Patients with ADEs were older (mean age, 74.6 years, p < 0.001), more often female (60.3%, p = 0.61), and more often Caucasian (96.5%, p < 0.001) than patients without ADEs. Of the preventable ADEs, 81.5% were judged potentially preventable by CPOE.

CONCLUSIONS

The incidence of ADEs in these community hospital admissions was high, and most ADEs were preventable, mostly through CPOE. These data suggest that CPOE may be beneficial in this setting.

Retrospective evaluation of a computerized physician order entry adaptation to prevent prescribing errors in a pediatric emergency department

OBJECTIVE

The goal was to determine the impact on medication prescribing errors of adding a pediatric medication list (quicklist) to a computerized physician order entry system in a pediatric emergency department.

METHODS

The quicklist is a drug dosing support tool that targets the most common medications in our clinical setting. We performed a retrospective comparison of orders from 420 randomly selected visits before and after quicklist introduction. Error rates were analyzed with respect to urgency level, physician training level, and patient age. The quicklist was examined for frequency of use and error rates.

RESULTS

The 840 patient visits (420 before intervention and 420 after intervention) generated 724 medication orders, which contained 156 medication prescribing errors (21%). The groups did not differ with respect to urgency level, physician training level, or patient age. There were significant decreases in the rate of errors per 100 visits, from 24 to 13 errors per 100 visits, and in the rate of errors per 100 orders, from 31 to 14 errors per 100 orders. The decrease in the error rates did not vary according to urgency score, age group, or physician training level. The quicklist was used in 30% of the orders in the postintervention group. In this group, the error rate was 1.9 errors per 100 orders when the quicklist was used, compared with 18.3 errors per 100 orders when the list was not used. Errors of wrong formulation, allergy, drug-drug interaction, and rule violations were eliminated.

CONCLUSION

The introduction of the quicklist was followed by a significant reduction in medication prescribing errors. A list with dosing support for commonly used pediatric medications may help adapt computerized physician order entry systems designed for adults to serve pediatric populations more effectively.

The effect of computerized physician order entry with clinical decision support on the rates of adverse drug events: a systematic review

CONTEXT

Computerized physician order entry (CPOE) with clinical decision support (CDS) has been promoted as an effective strategy to prevent the development of a drug injury defined as an adverse drug event (ADE).

OBJECTIVE

To systematically review studies evaluating the effects of CPOE with CDS on the development of an ADE as an outcome measure.

DATA SOURCES

PUBMED versions of MEDLINE (from inception through March 2007) were searched to identify relevant studies. Reference lists of included studies were also searched.

METHODS

We searched for original investigations, randomized and nonrandomized clinical trials, and observational studies that evaluated the effect of CPOE with CDS on the rates of ADEs. The studies identified were assessed to determine the type of computer system used, drug categories being evaluated, types of ADEs measured, and clinical outcomes assessed.

RESULTS

Of the 543 citations identified, 10 studies met our inclusion criteria. These studies were grouped into categories based on their setting: hospital or ambulatory; no studies related to the long-term care setting were identified. CPOE with CDS contributed to a statistically significant (P < or = .05) decrease in ADEs in 5 (50.0%) of the 10 studies. Four studies (40.0%) reported a nonstatistically significant reduction in ADE rates, and 1 study (10.0%) demonstrated no change in ADE rates.

CONCLUSIONS

Few studies have measured the effect of CPOE with CDS on the rates of ADEs, and none were randomized controlled trials. Further research is needed to evaluate the efficacy of CPOE with CDS across the various clinical settings.

Improving patient safety in hospitals: Contributions of high-reliability theory and normal accident theory

OBJECTIVE

To identify the distinctive contributions of high-reliability theory (HRT) and normal accident theory (NAT) as frameworks for examining five patient safety practices.

DATA SOURCES/STUDY SETTING

We reviewed and drew examples from studies of organization theory and health services research.

STUDY DESIGN

After highlighting key differences between HRT and NAT, we applied the frames to five popular safety practices: double-checking medications, crew resource management (CRM), computerized physician order entry (CPOE), incident reporting, and root cause analysis (RCA).

PRINCIPAL FINDINGS

HRT highlights how double checking, which is designed to prevent errors, can undermine mindfulness of risk. NAT emphasizes that social redundancy can diffuse and reduce responsibility for locating mistakes. CRM promotes high reliability organizations by fostering deference to expertise, rather than rank. However, HRT also suggests that effective CRM depends on fundamental changes in organizational culture. NAT directs attention to an underinvestigated feature of CPOE: it tightens the coupling of the medication ordering process, and tight coupling increases the chances of a rapid and hard-to-contain spread of infrequent, but harmful errors.

CONCLUSIONS

Each frame can make a valuable contribution to improving patient safety. By applying the HRT and NAT frames, health care researchers and administrators can identify health care settings in which new and existing patient safety interventions are likely to be effective. Furthermore, they can learn how to improve patient safety, not only from analyzing mishaps, but also by studying the organizational consequences of implementing safety measures.