Computerised provider order entry combined with clinical decision support systems to improve medication safety: a narrative review

Do computerized clinical decision support systems improve the prescribing of oral anticoagulants? A systematic review

BACKGROUND

Serious adverse drug reactions have been associated with the underuse or the misuse of oral anticoagulant therapy. We systematically reviewed the impact of computerized clinical decision support systems (CDSS) on the prescribing of oral anticoagulants and we described CDSS features associated with success or failure.

METHODS

We searched Medline, Embase, CENTRAL, CINHAL, and PsycINFO for studies that compared CDSS for the initiation or monitoring of oral anticoagulants with routine care. Two reviewers performed study selection, data collection, and risk-of-bias assessment. Disagreements were resolved with a third reviewer. Potentially important CDSS features, identified from previous literature, were evaluated.

RESULTS

Sixteen studies were included in our qualitative synthesis. Most trials were performed in primary care (n = 7) or hospitals (n = 6) and included atrial fibrillation (AF) patients (n = 9). Recommendations mainly focused on anticoagulation underuse (n = 11) and warfarin-drug interactions (n = 5). Most CDSS were integrated in electronic records or prescribing and provided support automatically at the time and location of decision-making. Significant improvements in practitioner performance were found in 9 out of 16 studies, while clinical outcomes were poorly reported. CDSS features seemed slightly more common in studies that demonstrated improvement.

CONCLUSIONS

CDSS might positively impact the use of oral anticoagulants in AF patients at high risk of stroke. The scope of CDSS should now evolve to assist prescribers in selecting the most appropriate and tailored medication. Efforts should nevertheless be made to improve the relevance of notifications and to address implementation outcomes.

The Effect of Eliminating Intermediate Severity Drug-Drug Interaction Alerts on Overall Medication Alert Burden and Acceptance Rate

OBJECTIVE

This study aimed to determine the effects of reducing the number of drug-drug interaction (DDI) alerts in an order entry system.

METHODS

Retrospective pre-post analysis at an urban medical center of the rates of medication alerts and alert acceptance during a 5-month period before and 5-month period after the threshold for firing DDI alerts was changed from "intermediate" to "severe." To ensure that we could determine varying response to each alert type, we took an in-depth look at orders generating single alerts.

RESULTS

Before the intervention, 241,915 medication orders were placed, of which 25.6% generated one or more medication alerts; 5.3% of the alerts were accepted. During the postintervention period, 245,757 medication orders were placed of which 16.0% generated one or more medication alerts, a 37.5% relative decrease in alert rate (95% confidence interval [CI]: -38.4 to -36.8%), but only a 9.6% absolute decrease (95% CI: -9.4 to -9.9%). 7.4% of orders generating alerts were accepted postintervention, a 39.6% relative increase in acceptance rate (95% CI: 33.2-47.2%), but only a 2.1% absolute increase (95% CI: 1.8-2.4%). When only orders generating a single medication alert were considered, there was a 69.1% relative decrease in the number of orders generating DDI alerts, and an 85.7% relative increase in the acceptance rate (95% CI: 58.6-126.2%), though only a 1.8% absolute increase (95% CI: 1.3-2.3%).

CONCLUSION

Eliminating intermediate severity DDI alerts resulted in a statistically significant decrease in alert burden and increase in the rate of medication alert acceptance, but alert acceptance remained low overall.

Unintended adverse consequences of a clinical decision support system: two cases

Many institutions have implemented clinical decision support systems (CDSSs). While CDSS research papers have focused on benefits of these systems, there is a smaller body of literature showing that CDSSs may also produce unintended adverse consequences (UACs). Detailed here are 2 cases of UACs resulting from a CDSS. Both of these cases were related to external systems that fed data into the CDSS. In the first case, lack of knowledge of data categorization in an external pharmacy system produced a UAC; in the second case, the change of a clinical laboratory instrument produced the UAC. CDSSs rely on data from many external systems. These systems are dynamic and may have changes in hardware, software, vendors, or processes. Such changes can affect the accuracy of CDSSs. These cases point to the need for the CDSS team to be familiar with these external systems. This team (manager and alert builders) should include members in specific clinical specialties with deep knowledge of these external systems.

Effect of Electronic Prescribing Strategies on Medication Error and Harm in Hospital: a Systematic Review and Meta-analysis

BACKGROUND

Computerized physician order entry and clinical decision support systems are electronic prescribing strategies that are increasingly used to improve patient safety. Previous reviews show limited effect on patient outcomes. Our objective was to assess the impact of electronic prescribing strategies on medication errors and patient harm in hospitalized patients.

METHODS

MEDLINE, EMBASE, CENTRAL, and CINAHL were searched from January 2007 to January 2018. We included prospective studies that compared hospital-based electronic prescribing strategies with control, and reported on medication error or patient harm. Data were abstracted by two reviewers and pooled using random effects model. Study quality was assessed using the Effective Practice and Organisation of Care and evidence quality was assessed using Grading of Recommendations Assessment, Development, and Evaluation.

RESULTS

Thirty-eight studies were included; comprised of 11 randomized control trials and 27 non-randomized interventional studies. Electronic prescribing strategies reduced medication errors (RR 0.24 (95% CI 0.13, 0.46), I² 98%, n = 11) and dosing errors (RR 0.17 (95% CI 0.08, 0.38), I² 96%, n = 9), with both risk ratios significantly affected by advancing year of publication. There was a significant effect of electronic prescribing strategies on adverse drug events (ADEs) (RR 0.52 (95% CI 0.40, 0.68), I² 0%, n = 2), but not on preventable ADEs (RR 0.55 (95% CI 0.30, 1.01), I² 78%, n = 3), hypoglycemia (RR 1.03 (95% CI 0.62-1.70), I² 28%, n = 7), length of stay (MD - 0.18 (95% - 1.42, 1.05), I² 94%, n = 7), or mortality (RR 0.97 (95% CI 0.79, 1.19), I² 74%, n = 9). The quality of evidence was rated very low.

DISCUSSION

Electronic prescribing strategies decrease medication errors and adverse drug events, but had no effect on other patient outcomes. Conservative interpretations of these findings are supported by significant heterogeneity and the preponderance of low-quality studies.

Systematic review of interventions to improve safety and quality of anticoagulant prescribing for therapeutic indications for hospital inpatients

PURPOSE

Anticoagulation-associated adverse drug events are common in hospitalised patients and result in morbidity, mortality, increased length of hospital stay and higher costs of care. Many are preventable. We reviewed the literature to identify and assess interventions intended to improve safety or quality anticoagulant prescribing.

METHODS

A systematic search of EMBASE, MEDLINE, the Cochrane Library, Pretty Darn Quick-Evidence and Health Systems Evidence was undertaken to identify controlled studies assessing system-level interventions to improve prescribing of oral or parenteral therapeutic anticoagulation for any indication in hospitalised adults. Data were extracted for safety and quality outcomes, with studies grouped by intervention type for meta-analysis and narrative review.

RESULTS

Of 10,640 records screened, 19 trials evaluating 12,742 participants were included for analysis. No study specifically evaluated prescribing of low molecular weight heparins (LMWHs) or direct acting oral anticoagulants (DOACs). Our findings suggest that physician-led anticoagulation consultation services may reduce bleeding rates in high-risk patients. On meta-analysis, decision supported warfarin dosing resulted in higher proportion of time with international normalised ratio in therapeutic range (p = 0.0007). Studies of other clinical decision support systems and heparin monitoring systems did not demonstrate improved safety, and quality findings were inconsistent. Systematic education and feedback programs were not efficacious.

CONCLUSIONS

There is currently insufficient high-quality evidence to recommend any reviewed intervention, though several warrant closer evaluation. Adequately powered controlled trials assessing safety outcomes and evidence-based quality markers in high-risk patient groups and studies of interventions to improve safety of LMWH and DOAC prescribing are needed.

How do stakeholders experience the adoption of electronic prescribing systems in hospitals? A systematic review and thematic synthesis of qualitative studies

Background

Electronic prescribing (ePrescribing) or computerised provider/physician order entry (CPOE) systems can improve the quality and safety of health services, but the translation of this into reduced harm for patients remains unclear. This review aimed to synthesise primary qualitative research relating to how stakeholders experience the adoption of ePrescribing/CPOE systems in hospitals, to help better understand why and how healthcare organisations have not yet realised the full potential of such systems and to inform future implementations and research.

Methods

We systematically searched 10 bibliographic databases and additional sources for citation searching and grey literature, with no restriction on date or publication language. Qualitative studies exploring the perspectives/experiences of stakeholders with the implementation, management, use and/or optimisation of ePrescribing/CPOE systems in hospitals were included. Quality assessment combined criteria from the Critical Appraisal Skills Programme Qualitative Checklist and the Standards for Reporting Qualitative Research guidelines. Data were synthesised thematically.

Results

79 articles were included. Stakeholders’ perspectives reflected a mixed set of positive and negative implications of engaging in ePrescribing/CPOE as part of their work. These were underpinned by further-reaching change processes. Impacts reported were largely practice related rather than at the organisational level. Factors affecting the implementation process and actions undertaken prior to implementation were perceived as important in understanding ePrescribing/CPOE adoption and impact.

Conclusions

Implementing organisations and teams should consider the breadth and depth of changes that ePrescribing/CPOE adoption can trigger rather than focus on discrete benefits/problems and favour implementation strategies that: consider the preimplementation context, are responsive to (and transparent about) organisational and stakeholder needs and agendas and which can be sustained effectively over time as implementations develop and gradually transition to routine use and system optimisation.

Systematic review of computerized prescriber order entry and clinical decision support

PURPOSE

Results of a systematic review of published data on the effect of computerized prescriber order entry (CPOE) with clinical decision support on medication error (ME) and adverse drug event (ADE) rates are presented.

METHODS

Literature searches of MEDLINE, Embase, and other databases were conducted to identify English- and Spanish-language articles on selected CPOE outcomes published from 1995 through 2016; in addition, 5 specific journals were searched for pertinent articles published during the period 2010-16. Publications on controlled prospective studies and before-and-after studies that assessed MEs and/or ADEs as main outcomes were selected for inclusion in the review.

RESULTS

Nineteen studies met the inclusion criteria. Data on MEs and ADEs could not be pooled, mainly due to heterogeneity in outcome definitions and study methodologies. The reviewed evidence indicated that CPOE implementation led to an overall reduction in errors at the prescription stage of the medication-use process (relative risk reduction, 0.29 [95% confidence interval, 0.10-0.85]; I ² = 99%) and reductions in most types of prescription errors, but CPOE also resulted in the emergence of other types of errors.

CONCLUSION

CPOE reduces the overall ME rate in the prescription process, as well as specific types of errors, such as wrong dose or strength, wrong drug, frequency, administration route, and drug-drug interaction errors. The implementation of CPOE can lead to new errors, such as wrong drug selection from drop-down menus.

Understanding CancelRx: Results of End-to-End Functional Testing, Proactive Risk Assessment, and Pilot Implementation

BACKGROUND

CancelRx allows prescribers to send electronic cancellation messages to pharmacies when medications are discontinued. Little is known about its functionality and impact on clinical workflows.

OBJECTIVES

To understand CancelRx functionality, its potential impact on workflows and medication safety risks, and to develop mitigating strategies for risks introduced by implementation.

METHODS

We conducted direct observations and semi-structured interviews to develop CancelRx use cases and assessed CancelRx in an end-to-end test environment, proactive risk assessment, and pilot implementation from April 16 to July 15, 2018.

RESULTS

E-cancellations were sent upon discontinuation of e-prescriptions written within the electronic health record (EHR), but not other medications (e.g., printed prescriptions) and could be initiated by nonprescribers. In our proactive risk assessment, CancelRx implementation eliminated five of seven failure modes in outpatient prescribing to Johns Hopkins pharmacies, but introduced new risks, including (1) failure to act if an e-cancellation was not sent or was unsuccessful; (2) failure to cancel all prescriptions for a medication; (3) errors in manual matching; and (4) erroneous medication cancellations. We identified potential mitigation strategies for these risks. During pilot implementation, 92.4% (428/463) of e-cancellations had confirmed approval by the receiving pharmacy, while 4.5% (21/463) were denied, and 3.0% (14/463) had no e-cancellation response. Among e-cancellations received by the pilot pharmacy, 1.7% (7/408) required manual matching by pharmacy staff. Based on performance in testing, 73.4% (340/463) of completed e-cancellations would be expected to generate an in-basket message, including 21 (6.2%) denials and 319/340 (93.8%) approvals with a note from the pharmacy.

CONCLUSION

CancelRx is an important functionality with the potential to decrease adverse events due to medication errors. However, changes in implementation in our EHR and pharmacy software and enhancements in the CancelRx standard are needed to maximize safety and usability. Further studies are needed to evaluate the impact of e-cancellation on medication safety.

What is the impact of introducing inpatient electronic prescribing on prescribing errors? A naturalistic stepped wedge study in an English teaching hospital

Most studies evaluating the impact of electronic prescribing on prescribing safety have used comparatively weak study designs such as uncontrolled before-and-after studies. This study aimed to apply a more robust naturalistic stepped wedge study design to compare the prevalence and types of prescribing errors for electronic prescribing and paper prescribing. Data were collected weekly during a phased electronic prescribing implementation across 20 wards in a large English hospital. We identified 511 (7.8%) erroneous orders in 6523 paper medication orders, and 312 (6.0%) in 5237 electronic prescribing orders. Logistic regression suggested no statistically significant effect of electronic prescribing use or of study week; patient and ward had significant effects. Errors involving incorrect doses and illegible or incomplete orders were less common with electronic prescribing; those involving duplication, omission, incorrect drug and incorrect formulation were more common. Actions are needed to mitigate these error types; future studies should give more consideration to the effects of patient and ward.

Experience of Emergency Department Patients With Using the Talking Pole Device: Prospective Interventional Descriptive Study

BACKGROUND

Patient engagement is important. However, it can be difficult in emergency departments (EDs).

OBJECTIVE

The aim of this study was to evaluate the satisfaction of ED patients using a patient-friendly health information technology (HIT) device, the "Talking Pole," and to assess the factors relevant to their satisfaction.

METHODS

This study was conducted in May 2017 at the ED of a tertiary hospital. The "Talking Pole" is a smartphone-based device attached to a intravenous infusion pole with sensors. It is capable of sensing patient movement and fluid dynamics. In addition, it provides clinical information from electronic medical records to patients and serves as a wireless communication tool between patients and nurses. Patients and caregivers who entered the observation room of the ED were selected for the study. The "Talking Pole" devices were provided to all participants, regardless of their need for an intravenous pole upon admittance to the ED. After 2 hours, each participant was given an 18-item questionnaire created for this research, measured on a 5-point Likert scale, regarding their satisfaction with "Talking Pole."

RESULTS

Among 52 participants recruited, 54% (28/52) were patients and the remaining were caregivers. In total, 38% (20/52) were male participants; the average age was 54.6 (SD 12.9) years, and 63% (33/52) of the participants were oncology patients and their caregivers. The overall satisfaction rate was 4.17 (SD 0.79 ) points. Spearman correlation coefficient showed a strong association of "overall satisfaction" with "comparison to the previous visit" (ρ=.73 ), "perceived benefit" (ρ=.73), "information satisfaction" (ρ=.70), and "efficiency" (ρ=.70).

CONCLUSIONS

In this study, we introduced a patient-friendly HIT device, the "Talking Pole." Its architecture focused on enhancing information delivery, which is regarded as a bottleneck toward achieving patient engagement in EDs. Patient and caregiver satisfaction with the "Talking Pole" was positive in the ED environment. In particular, correlation coefficient results improved our understanding about patients' satisfaction, HIT devices, and services used in the ED.

Developing a learning health system: Insights from a qualitative process evaluation of a pharmacist-led electronic audit and feedback intervention to improve medication safety in primary care

INTRODUCTION

Developments in information technology offer opportunities to enhance medication safety in primary care. We evaluated the implementation and adoption of a complex pharmacist-led intervention involving the use of an electronic audit and feedback surveillance dashboard to identify patients potentially at risk of hazardous prescribing or monitoring of medicines in general practices. The intervention aimed to create a rapid learning health system for medication safety in primary care. This study aimed to explore how the intervention was implemented, adopted and embedded into practice using a qualitative process evaluation.

METHODS

Twenty two participants were purposively recruited from eighteen out of forty-three general practices receiving the intervention as well as clinical commissioning group staff across Salford UK, which reflected the range of contexts in which the intervention was implemented. Interviews explored how pharmacists and GP staff implemented the intervention and how this affected care practice. Data analysis was thematic with emerging themes developed into coding frameworks based on Normalisation Process Theory (NPT).

RESULTS

Engagement with the dashboard involved a process of sense-making in which pharmacists considered it added value to their work. The intervention helped to build respect, improve trust and develop relationships between pharmacists and GPs. Collaboration and communication between pharmacists and clinicians was primarily initiated by pharmacists and was important for establishing the intervention. The intervention operated as a rapid learning health system as it allowed for the evidence in the dashboard to be translated into changes in work practices and into transformations in care.

CONCLUSIONS

Our study highlighted the importance of the combined use of information technology and the role of pharmacists working in general practice settings. Medicine optimisation activities in primary care may be enhanced by the implementation of a pharmacist-led electronic audit and feedback system. This intervention established a rapid learning health system that swiftly translated data from electronic health records into changes in practice to improve patient care. Using NPT provided valuable insights into the ways in which developing relationships, collaborations and communication between health professionals could lead to the implementation, adoption and sustainability of the intervention.

Managing the patient safety risks of bottom-up health information technology innovations: Recommendations for healthcare providers

Health information technology (IT) offers exciting opportunities for providing novel services to patients, and for improving the quality and safety of care. Many healthcare professionals are already improving services through the development of numerous bottom-up local health IT innovations. Such innovations from the ground up are to be welcomed, but healthcare providers are struggling to develop processes for managing the risks that come with the introduction of health IT into clinical processes. I argue that too often the main strategy appears to be one of organisational ignorance. This puts patients at risk, and it threatens the successful adoption of health IT. I recommend that healthcare providers focus on strengthening their processes for organisational learning, promoting proactive risk management strategies, and making risk management decisions transparent and explicit.

Prevalence of computerized physician order entry systems-related medication prescription errors: A systematic review

OBJECTIVE

The positive impact of computerized physician order entry (CPOE) systems on prescription safety must be considered in light of the persistence of certain types of medication-prescription errors. We performed a systematic review, based on the PRISMA statement, to analyze the prevalence of prescription errors related to the use of CPOE systems.

MATERIALS AND METHODS

We searched MEDLINE, EMBASE, CENTRAL, DBLP, the International Clinical Trials Registry, the ISI Web of Science, and reference lists of relevant articles from March 1982 to August 2017. We included original peer-reviewed studies which quantitatively reported medication-prescription errors related to CPOE. We analyzed the prevalence of medication-prescription errors according to an adapted version of the National Coordinating Council for Medication Error Reporting and Prevention (NCCMERP) taxonomy and assessed the mechanisms responsible for each type of prescription error due to CPOE.

RESULTS

Fourteen studies were included. The prevalence of CPOE systems-related medication errors relative to all prescription medication errors ranged from 6.1 to 77.7% (median = 26.1% [IQR:17.6-42,1]) and was less than 6.3% relative to the number of prescriptions reviewed. All studies reported "wrong dose" and "wrong drug" errors. The "wrong dose" error was the most frequently reported (from 7 to 67.4%, median = 31.5% [IQR:20.5-44.5]). We report the associated mechanism for each type of medication described (those due to CPOE or those occurring despite CPOE).

DISCUSSION

We observed very heterogeneous results, probably due to the definition of error, the type of health information system used for the study, and the data collection method used. Each data collection method provides valuable and useful information concerning the prevalence and specific types of errors related to CPOE systems.

CONCLUSIONS

The reporting of prescription errors should be continued because the weaknesses of CPOE systems are potential sources of error. Analysis of the mechanisms behind CPOE errors can reveal areas for improvement.

Computerized prescriber order entry-related patient safety reports: analysis of 2522 medication errors

Objective

To examine medication errors potentially related to computerized prescriber order entry (CPOE) and refine a previously published taxonomy to classify them.

Materials and Methods

We reviewed all patient safety medication reports that occurred in the medication ordering phase from 6 sites participating in a United States Food and Drug Administration-sponsored project examining CPOE safety. Two pharmacists independently reviewed each report to confirm whether the error occurred in the ordering/prescribing phase and was related to CPOE. For those related to CPOE, we assessed whether CPOE facilitated (actively contributed to) the error or failed to prevent the error (did not directly cause it, but optimal systems could have potentially prevented it). A previously developed taxonomy was iteratively refined to classify the reports.

Results

Of 2522 medication error reports, 1308 (51.9%) were related to CPOE. Of these, CPOE facilitated the error in 171 (13.1%) and potentially could have prevented the error in 1137 (86.9%). The most frequent categories of "what happened to the patient" were delays in medication reaching the patient, potentially receiving duplicate drugs, or receiving a higher dose than indicated. The most frequent categories for "what happened in CPOE" included orders not routed to or received at the intended location, wrong dose ordered, and duplicate orders. Variations were seen in the format, categorization, and quality of reports, resulting in error causation being assignable in only 403 instances (31%).

Discussion and Conclusion

Errors related to CPOE commonly involved transmission errors, erroneous dosing, and duplicate orders. More standardized safety reporting using a common taxonomy could help health care systems and vendors learn and implement prevention strategies.

Clinical reminder alert fatigue in healthcare: a systematic literature review protocol using qualitative evidence

BACKGROUND

Integrated reminders within clinical systems have become more prevalent due to the use of electronic health records and evidence demonstrating an increase in compliance within practice. Clinical reminders are assessed for effectiveness on an individual basis, rather than in combination with existing prompts for other conditions. The growing number of prompts may be counter-productive as healthcare professionals are increasingly suffering from "reminder fatigue" meaning many reminders are ignored. This work will review the qualitative evidence to identify barriers and enablers of existing prompts found within computerised decision support systems. Our focus will be on primary care where clinicians have to negotiate a plethora of reminders as they deal with increasingly complex patients and sophisticated treatment regimes. The review will provide a greater understanding of existing systems and the way clinicians interact with them to inform the development of more effective and targeted clinical reminders.

METHODS

A comprehensive search using piloted terms will be used to identify relevant literature from 1960 (or commencement of database) to 2017. MEDLINE, MEDLINE In Process, EMBASE, HMIC, PsycINFO, CDSR DARE, HTA, CINAHL and CPCI, will be searched, as well as grey literature and references and citations of included papers. Manuscripts will be assessed for eligibility, bias and quality using the CASP tool with narrative data being included and questionnaire based studies excluded. Inductive thematic analysis will be performed in order to produce a conceptual framework defining the key barriers around integrated clinical reminders.

DISCUSSION

Indications of alert and reminder fatigue are found throughout the current literature. However, this has not been fully investigated using a robust qualitative approach, particularly in a rapidly growing body of evidence. This review will aid people forming new clinical systems so that alerts can be incorporated appropriately.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO: CRD42016029418.

Impact of an inpatient electronic prescribing system on prescribing error causation: a qualitative evaluation in an English hospital

BACKGROUND

Few studies have applied a systems approach to understanding the causes of specific prescribing errors in the context of hospital electronic prescribing (EP). A comprehensive understanding of underlying causes is essential for developing effective interventions to improve prescribing safety. Our objectives were to explore prescribers' perspectives of the causes of errors occurring with EP and to make recommendations to maximise benefits and minimise risks.

METHODS

We studied a large hospital using inpatient EP. From April to June 2016, semistructured interviews were conducted with purposively sampled prescribers involved with a prescribing error. Interviews explored prescribers' perceived causes of the error and views about EP; they were audio-recorded and transcribed verbatim. Data were thematically analysed against a framework based on Reason's accident causation model, with a focus on identifying latent conditions.

RESULTS

Twenty-five interviews explored causes of 32 errors. Slips and rule-based mistakes were the most common active failures. Error causation was multifactorial; environmental, individual, team, task and technology error-producing conditions were all influenced by EP. There were three broad groups of latent conditions: the EP system's functionality and design; the organisation's decisions around EP implementation and use; and prescribing behaviours in the context of EP.

CONCLUSIONS

Errors were associated with the design of EP itself and its integration within the healthcare environment. Findings suggest that EP vendors should focus on revolutionising interface design and usability issues, bearing in mind the wider healthcare context in which such software is used. Healthcare organisations should draw upon human factors principles when implementing EP. Consideration of work environment, infrastructure, training, prescribing responsibilities and behaviours should be considered to address local issues identified.

Prescriber response to computerized drug alerts for electronic prescriptions among hospitalized patients

BACKGROUND

Clinical decision support systems (CDSS) reduce prescription errors, but their effectiveness is reduced by high alert rates, "alert fatigue", and indiscriminate rejection.

OBJECTIVES

To compare acceptance rates of alerts generated by the SafeRx^® prescription CDSS among different alert types and departments in a tertiary care hospital, identify factors associated with alert acceptance, and determine whether alert overrides were justified.

METHODS

In a retrospective study, we compared acceptance rates of all prescription alerts generated in 2013 in 18 departments of Israel's largest tertiary care center. In a prospective study in 2 internal medicine departments, we collected data on factors potentially associated with alert override, and an expert panel evaluated the justification for each overridden alert. We used multivariate analyses to examine the association between patient and physician-related factors and alert acceptance.

RESULTS

In the retrospective study, of 390,841 prescriptions, 37.1% triggered at least one alert, 5.3% of which were accepted. Acceptance rates ranged from 7.9% for excessive dose alerts to 4.0% for duplicate drug and major drug-drug interactions alerts (p<0.001). In the prospective study, common reasons for alert overriding included "irrelevance to the specific condition" and "medication previously tolerated by the patient". Weekend shifts (incident rate ratio [IRR]=1.50 [95% CI, 1.01-2.22]) and a specific department (IRR=1.87 [1.23-2.87]) were associated with higher alert acceptance, while night shift (IRR=0.47 [0.26-0.85]) was associated with alert override. Most alert overrides (88.6%) were judged justified.

CONCLUSIONS

The vast majority of SafeRx^® alerts are overridden, and overriding is justified in most cases. Minimizing the number of alerts is essential to reduce the likelihood of developing "alert fatigue". Our findings may inform a rational, department-specific approach for alert silencing.

The impact of a hospital electronic prescribing and medication administration system on medication administration safety: an observational study

Background

The aim of the study was to explore the impact of the implementation of an electronic prescribing and medication administration system (ePA) on the safety of medication administration in an inpatient hospital setting. Objectives were to compare the prevalence and types of: 1) medication administration errors, and 2) documentation discrepancies, between a paper and an ePA system. Additionally, we wanted to describe any observed changes to medication administration practices.

Methods

The study was based on an elderly medicine ward in an English hospital. From December 2014 to June 2015, nurses’ medication administration rounds were observed every 5 days before and after ePA implementation using an interrupted time-series approach. Medication administration error and documentation discrepancy rates pre- versus post-ePA were analysed descriptively and chi-squared tests used to test for any difference; segmented regression analysis was used to determine changes in longitudinal trend.

Results

Observations were made at 15 pre- and 15 post-ePA implementation time-points. Pre-ePA on paper, there were 18 medication administration errors in 428 opportunities for error (4.2%; 95% confidence interval 2.3–6.1%), and with ePA there were 18 in 528 (3.4%; 95% confidence interval 1.9–5.0%; p = 0.64). Regarding documentation, pre-ePA on paper there were 5 discrepancies in 460 observed documentations (1.1%; 95% confidence interval 0.1–2.0%); with ePA there were 18 in 557 (3.2%; 95% confidence interval 1.8–4.7%; p = 0.04). The most common electronic documentation discrepancy was documentation that a dose had been administered when it had not. Segmented regression analysis was unable to detect any significant longitudinal changes. Changes to working practices post-ePA were observed, such as nurses demonstrating less-consistent self-checking when preparing and administering medications.

Conclusions

Findings suggest no change in medication error rate, although ePA encourages certain types of errors and mitigates others. There was a statistically significant increase in documentation discrepancies which is likely to be due to adoption of new working practices with ePA.

Electronic supplementary material

The online version of this article (doi:10.1186/s12913-017-2462-2) contains supplementary material, which is available to authorized users.

Personalization and Patient Involvement in Decision Support Systems: Current Trends

OBJECTIVES

This survey aims at highlighting the latest trends (2012-2014) on the development, use, and evaluation of Information and Communication Technologies (ICT) based decision support systems (DSSs) in medicine, with a particular focus on patient-centered and personalized care.

METHODS

We considered papers published on scientific journals, by querying PubMed and Web of ScienceTM. Included studies focused on the implementation or evaluation of ICT-based tools used in clinical practice. A separate search was performed on computerized physician order entry systems (CPOEs), since they are increasingly embedding patient-tailored decision support.

RESULTS

We found 73 papers on DSSs (53 on specific ICT tools) and 72 papers on CPOEs. Although decision support through the delivery of recommendations is frequent (28/53 papers), our review highlighted also DSSs only based on efficient information presentation (25/53). Patient participation in making decisions is still limited (9/53), and mostly focused on risk communication. The most represented medical area is cancer (12%). Policy makers are beginning to be included among stakeholders (6/73), but integration with hospital information systems is still low. Concerning knowledge representation/management issues, we identified a trend towards building inference engines on top of standard data models. Most of the tools (57%) underwent a formal assessment study, even if half of them aimed at evaluating usability and not effectiveness.

CONCLUSIONS

Overall, we have noticed interesting evolutions of medical DSSs to improve communication with the patient, consider the economic and organizational impact, and use standard models for knowledge representation. However, systems focusing on patient-centered care still do not seem to be available at large.

The development and feasibility of a personal health-optimization system for people with bipolar disorder

Background

People with bipolar disorder often experience ill health and have considerably reduced life expectancies. Suboptimal treatment is common and includes a lack of effective medicines, overtreatment, and non-adherence to medical interventions and lifestyle measures. E- and m-health applications support patients in optimizing their treatment but often exhibit conceptual and technical shortcomings. The objective of this work was to develop and test the usability of a system targeting suboptimal treatment and compare the service to other genres and strategies.

Methods

Based on the frameworks of shared decision-making, multi-criteria decision analysis, and single-subject research design, we interviewed potential users, reviewed research and current approaches, and created a first version using a rapid prototyping framework. We then iteratively improved and expanded the service based on formative usability testing with patients, healthcare providers, and laypeople from Norway, the UK, and Ukraine. The evidence-based health-optimization system was developed using systematic methods. The System Usability Scale and a questionnaire were administered in formative and summative tests. A comparison of the system to current standards for clinical practice guidelines and patient decision aids was performed.

Results

Seventy-eight potential users identified 82 issues. Driven by user feedback, the limited first version was developed into a more comprehensive system. The current version encompasses 21 integrated core features, supporting 6 health-optimization strategies. One crucial feature enables patients and clinicians to explore the likely value of treatments based on mathematical integration of self-reported and research data and the patient’s preferences. The mean ± SD (median) system usability score of the patient-oriented subsystem was 71 ± 18 (73). The mean ± SD (median) system usability score in the summative usability testing was 78 ± 18 (75), well above the norm score of 68. Feedback from the questionnaire was generally positive. Eighteen out of 23 components in the system are not required in international standards for patient decision aids and clinical practice guidelines.

Conclusion

We have developed the first evidence-based health-optimization system enabling patients, clinicians, and caregivers to collaborate in optimizing the patient’s health on a shared platform. User tests indicate that the feasibility of the system is acceptable.

Electronic supplementary material

The online version of this article (doi:10.1186/s12911-017-0481-x) contains supplementary material, which is available to authorized users.

Antimicrobial Stewardship Approaches in the Intensive Care Unit

Antimicrobial stewardship programs aim to monitor, improve, and measure responsible antibiotic use. The intensive care unit (ICU), with its critically ill patients and prevalence of multiple drug-resistant pathogens, presents unique challenges. This article reviews approaches to stewardship with application to the ICU, including the value of diagnostics, principles of empirical and definitive therapy, and measures of effectiveness. There is good evidence that antimicrobial stewardship results in more appropriate antimicrobial use, shorter therapy durations, and lower resistance rates. Data demonstrating hard clinical outcomes, such as adverse events and mortality, are more limited but encouraging; further studies are needed.

Making Decisions Better: an evaluation of an educational intervention

RATIONALE, AIMS AND OBJECTIVES

Despite the widespread inclusion of consultation skills in undergraduate healthcare curricula, patient-doctor interactions are often an imparting of evidence or information rather than an exchange. Evidence-based practice may be further enhanced by increasing explicit understanding of decision-making processes used by healthcare professionals and patients. This exploratory investigation evaluated the impact of an educational intervention on understanding of decision-making processes and practice. The effect of session schedule was assessed to inform the future delivery strategy of such approaches.

METHODS

Three groups of primary care health professionals (n = 85) completed questionnaires using Likert scales to assess strength of agreement with decision-making statements exploring four themes - Theory, Applied Theory, Practice and Joint Practice - pre-intervention and post-intervention. Responses were analysed, firstly to assess the impact of the intervention on understanding of decision-making processes and practice across all participants and then by group to determine the effect of session schedules on outcome measures.

RESULTS

Overall agreement with the decision-making statements significantly increased after the learning set (Mean = -0.162, SD = 0.355); t(64) = -3.666, p < 0.001). Multivariate analysis on effect of session schedule only found significant interactions for the theme 'Joint Practice' with group (p < 0.025) and 3-way interaction of Group and Main role. (p < 0.048). No consistent positive impact of longer session schedule was found.

CONCLUSION

Participation in the learning sessions significantly improved self-reported understanding of decision-making processes and application to clinical practice. The extended learning sessions did not provide additional benefits over and above 2 half days or 1 whole day learning sessions.

Understanding the implementation and adoption of a technological intervention to improve medication safety in primary care: a realist evaluation

Background

Monitoring for potentially hazardous prescribing is increasingly important to improve medication safety. Healthcare information technology can be used to achieve this aim, for example by providing access to prescribing data through surveillance of patients’ electronic health records. The aim of our study was to examine the implementation and adoption of an electronic medicines optimisation system that was intended to facilitate clinical audit in primary care by identifying patients at risk of an adverse drug event. We adopted a sociotechnical approach that focuses on how complex social, organisational and institutional factors may impact upon the use of technology within work settings.

Methods

We undertook a qualitative realist evaluation of the use of an electronic medicines optimisation system in one Clinical Commissioning Group in England. Five semi-structured interviews, four focus groups and one observation were conducted with a range of stakeholders. Consistent with a realist evaluation methodology, the analysis focused on exploring the links between context, mechanism and outcome to explain the ways the intervention might work, for whom and in what circumstances.

Results

Using the electronic medicines optimisation system could lead to a number of improved patient safety outcomes including pre-emptively reviewing patients at risk of adverse drug events. The effective use of the system depended upon engagement with the system, the flow of information between different health professionals centrally placed at the Clinical Commissioning Group and those locally placed at individual general practices, and upon variably adapting work practices to facilitate the use of the system. The use of the system was undermined by perceptions of ownership, lack of access, and lack of knowledge and awareness.

Conclusions

The use of an electronic medicines optimisation system may improve medication safety in primary care settings by identifying those patients at risk of an adverse drug event. To fully realise the potential benefits for medication safety there needs to be better utilisation across primary care and with a wider range of stakeholders. Engaging with all potential stakeholders and users prior to implementation of such systems might allay perceptions that the system is owned centrally and increase knowledge of the potential benefits.

A Mobile Computerized Decision Support System to Prevent Hypoglycemia in Hospitalized Patients With Type 2 Diabetes Mellitus

BACKGROUND

Diabetes management requires complex and interdisciplinary cooperation of health care professionals (HCPs). To support this complex process, IT-support is recommended by clinical guidelines. The aim of this article is to report on results from a clinical feasibility study testing the prototype of a mobile, tablet-based client-server system for computerized decision and workflow support (GlucoTab®) and to discuss its impact on hypoglycemia prevention.

METHODS

The system was tested in a monocentric, open, noncontrolled intervention study in 30 patients with type 2 diabetes mellitus (T2DM). The system supports HCPs in performing a basal-bolus insulin therapy. Diabetes therapy, adverse events, software errors and user feedback were documented. Safety, efficacy and user acceptance of the system were investigated.

RESULTS

Only 1.3% of blood glucose (BG) measurements were <70 mg/dl and only 2.6% were >300 mg/dl. The availability of the system (97.3%) and the rate of treatment activities documented with the system (>93.5%) were high. Only few suggestions from the system were overruled by the users (>95.7% adherence). Evaluation of the 3 anonymous questionnaires showed that confidence in the system increased over time. The majority of users believed that treatment errors could be prevented by using this system.

CONCLUSIONS

Data from our feasibility study show a significant reduction of hypoglycemia by implementing a computerized system for workflow and decision support for diabetes management, compared to a paper-based process. The system was well accepted by HCPs, which is shown in the user acceptance analysis and that users adhered to the insulin dose suggestions made by the system.

JOURNAL CLUB: Predictors of Provider Response to Clinical Decision Support: Lessons Learned From the Medicare Imaging Demonstration

OBJECTIVE

The efficacy of imaging clinical decision support (CDS) varies. Our objective was to identify CDS factors contributing to imaging order cancellation or modification.

SUBJECTS AND METHODS

This pre-post study was performed across four institutions participating in the Medicare Imaging Demonstration. The intervention was CDS at order entry for selected outpatient imaging procedures. On the basis of the information entered, computerized alerts indicated to providers whether orders were not covered by guidelines, appropriate, of uncertain appropriateness, or inappropriate according to professional society guidelines. Ordering providers could override or accept CDS. We considered actionable alerts to be those that could generate an immediate order behavior change in the ordering physician (i.e., cancellation of inappropriate orders or modification of orders of uncertain appropriateness that had a recommended alternative). Chi-square and logistic regression identified predictors of order cancellation or modification after an alert.

RESULTS

A total of 98,894 radiology orders were entered (83,114 after the intervention). Providers ignored 98.9%, modified 1.1%, and cancelled 0.03% of orders in response to alerts. Actionable alerts had a 10 fold higher rate of modification (8.1% vs 0.7%; p < 0.0001) or cancellation (0.2% vs 0.02%; p < 0.0001) orders compared with nonactionable alerts. Orders from institutions with preexisting imaging CDS had a sevenfold lower rate of cancellation or modification than was seen at sites with newly implemented CDS (1.4% vs 0.2%; p < 0.0001). In multivariate analysis, actionable alerts were 12 times more likely to result in order cancellation or modification. Orders at sites with preexisting CDS were 7.7 times less likely to be cancelled or modified (p < 0.0001).

CONCLUSION

Using results from the Medicare Imaging Demonstration project, we identified potential factors that were associated with CDS effect on provider imaging ordering; these findings may have implications for future design of such computerized systems.

Information Technology-Based Interventions to Improve Drug-Drug Interaction Outcomes: A Systematic Review on Features and Effects

The purpose of this systematic review was to identify features and effects of information technology (IT)-based interventions on outcomes related to drug-drug interactions (DDI outcomes). A literature search was conducted in Medline, EMBASE, and the Cochrane Library for published English-language studies. Studies were included if a main outcome was related to DDIs, the intervention involved an IT-based system, and the study design was experimental or observational with controls. Study characteristics, including features and effects of IT-based interventions, were extracted. Nineteen studies comprising five randomized controlled trials (RCT), five non-randomized controlled trials (NRCT) and nine observational studies with controls (OWC) were included. Sixty-four percent of prescriber-directed interventions, and all non-prescriber interventions, were effective. Each of the following characteristics corresponded to groups of studies of which a majority were effective: automatic provision of recommendations within the providers' workflow, intervention at the time of decision-making, integration into other systems, and requiring the reason for not following the recommendations. Only two studies measured clinical outcomes: an RCT that showed no significant improvement and an OWC that showed improvement, but did not statistically assess the effect. Most studies that measured surrogate outcomes (e.g. potential DDIs) and other outcomes (e.g. adherence to alerts) showed improvements. IT-based interventions improve surrogate clinical outcomes and adherence to DDI alerts. However, there is lack of robust evidence about their effectiveness on clinical outcomes. It is recommended that researchers consider the identified features of effective interventions in the design of interventions and evaluate the effectiveness on DDI outcomes, particularly clinical outcomes.

A Survey of the Literature on Unintended Consequences Associated with Health Information Technology: 2014-2015

OBJECTIVE

To summarize recent research on unintended consequences associated with implementation and use of health information technology (health IT). Included in the review are original empirical investigations published in English between 2014 and 2015 that reported unintended effects introduced by adoption of digital interventions. Our analysis focuses on the trends of this steam of research, areas in which unintended consequences have continued to be reported, and common themes that emerge from the findings of these studies.

METHOD

Most of the papers reviewed were retrieved by searching three literature databases: MEDLINE, Embase, and CINAHL. Two rounds of searches were performed: the first round used more restrictive search terms specific to unintended consequences; the second round lifted the restrictions to include more generic health IT evaluation studies. Each paper was independently screened by at least two authors; differences were resolved through consensus development.

RESULTS

The literature search identified 1,538 papers that were potentially relevant; 34 were deemed meeting our inclusion criteria after screening. Studies described in these 34 papers took place in a wide variety of care areas from emergency departments to ophthalmology clinics. Some papers reflected several previously unreported unintended consequences, such as staff attrition and patients' withholding of information due to privacy and security concerns. A majority of these studies (71%) were quantitative investigations based on analysis of objectively recorded data. Several of them employed longitudinal or time series designs to distinguish between unintended consequences that had only transient impact, versus those that had persisting impact. Most of these unintended consequences resulted in adverse outcomes, even though instances of beneficial impact were also noted. While care areas covered were heterogeneous, over half of the studies were conducted at academic medical centers or teaching hospitals.

CONCLUSION

Recent studies published in the past two years represent significant advancement of unintended consequences research by seeking to include more types of health IT applications and to quantify the impact using objectively recorded data and longitudinal or time series designs. However, more mixed-methods studies are needed to develop deeper insights into the observed unintended adverse outcomes, including their root causes and remedies. We also encourage future research to go beyond the paradigm of simply describing unintended consequences, and to develop and test solutions that can prevent or minimize their impact.

Structured Pharmacist Review of Medication in Older Hospitalised Patients: A Cost-Effectiveness Analysis

BACKGROUND

A recent cluster randomised controlled trial (RCT) conducted in an Irish hospital evaluating a structured pharmacist review of medication (SPRM), supported by computerised clinical decision support software (CDSS), demonstrated positive outcomes in terms of reduction of adverse drug reactions (ADR).

OBJECTIVE

The aim of this study was to examine the cost effectiveness of pharmacists applying an SPRM in conjunction with CDSS to older hospitalised patients compared with usual pharmaceutical care.

METHOD

Cost-effectiveness analysis alongside a cluster RCT. The trial was conducted in a tertiary hospital in the south of Ireland. Patients in the intervention arm (n = 361) received a multifactorial intervention consisting of medicines reconciliation, deployment of CDSS and generation of a pharmaceutical care plan. Patients in the control arm (n = 376) received usual care from the hospital pharmacy team. Incremental cost effectiveness was examined in terms of costs to the healthcare system and an outcome measure of ADRs during an inpatient hospital stay. Uncertainty in the analysis was explored using a cost-effectiveness acceptability curve (CEAC).

RESULTS

On average, the intervention arm was the dominant strategy in terms of cost effectiveness. Compared with usual care (control), the intervention was associated with a decrease of €807 [95% confidence interval (CI) -3443 to 1829; p = 0.548) in mean healthcare cost, and a decrease in the mean number of ADR events per patient of -0.064 (95% CI -0.135 to 0.008; p = 0.081). The probability of the intervention being cost effective at respective threshold values of €0, €250, €500, €750, €1000 and €5000 was 0.707, 0.713, 0.716, 0.718, 0.722 and 0.784, respectively.

CONCLUSIONS

Based on the evidence presented, SPRM/CDSS is likely to be determined to be cost effective compared with usual pharmaceutical care. However, neither incremental costs nor effects demonstrated a statistically significant difference, therefore the results of this single-site study should be interpreted with caution.

Development of a Standardized Rating Tool for Drug Alerts to Reduce Information Overload

BACKGROUND

A well-known problem in current clinical decision support systems (CDSS) is the high number of alerts, which are often medically incorrect or irrelevant. This may lead to the so-called alert fatigue, an overriding of alerts, including those that are clinically relevant, and underuse of CDSS in general.

OBJECTIVES

The aim of our study was to develop and to apply a standardized tool that allows its users to evaluate the quality of system-generated drug alerts. The users' ratings can subsequently be used to derive recommendations for developing a filter function to reduce irrelevant alerts.

METHODS

We developed a rating tool for drug alerts and performed a web-based evaluation study that also included a user review of alerts. In this study the following categories were evaluated: "data linked correctly", "medically correct", "action required", "medication change", "critical alert", "information gained" and "show again". For this purpose, 20 anonymized clinical cases were randomly selected and displayed in our customized CDSS research prototype, which used the summary of product characteristics (SPC) for alert generation. All the alerts that were provided were evaluated by 13 physicians. The users' ratings were used to derive a filtering algorithm to reduce overalerting.

RESULTS

In total, our CDSS research prototype generated 399 alerts. In 98 % of all alerts, medication data were rated as linked correctly to drug information; in 93 %, the alerts were assessed as "medically correct"; 19.5 % of all alerts were rated as "show again". The interrater-agreement was, on average, 68.4 %. After the application of our filtering algorithm, the rate of alerts that should be shown again decreased to 14.8 %.

CONCLUSIONS

The new standardized rating tool supports a standardized feedback of user-perceived clinical relevance of CDSS alerts. Overall, the results indicated that physicians may consider the majority of alerts formally correct but clinically irrelevant and override them. Filtering may help to reduce overalerting and increase the specificity of a CDSS.

Risk management of in-hospital administration of anticancer drugs: impact of Raccomandazione 14 from the Italian Ministry of Health

PURPOSE

The different stages of antineoplastic agent management build up a complex process, from supply to prescription, preparation, and administration. All steps in this process must be carefully monitored in order to control/reduce the risk of errors that can impact on patient safety. This work overviews the prevention of medication errors in oncology, including regulatory and legislative frameworks with specific reference to the Raccomandazione 14 (Recommendation 14) issued by the Italian Ministry of Health.

METHODS

We searched the literature for types, causes, and contributing factors of medication errors during administration of antineoplastic agents. International guidelines and recommendations were examined, with specific focus on the Raccomandazione 14.

RESULTS

Medication errors may occur along the entire therapeutic process, involving physicians, pharmacists, nurses, and other healthcare providers. A computerized prescribing system combined with a clinical decision support system helps physicians in minimizing prescribing errors. Hospital pharmacists play a crucial role in preventing inpatient prescription errors and in managing storage, dispensing, and compounding of the anticancer drugs. The Italian Ministry of Health issued the Raccomandazione 14 to provide the Italian health system with shared univocal procedures for anticancer drug supply, compounding, storage, prescription, and administration. Other themes addressed are patient and family involvement, humanization of cancer care, and training and accountability of the personnel involved.

CONCLUSIONS

The most effective means of managing the risk of medication errors remains prevention, which lies on the systematic documentation of medication errors reporting systems. All professionals of the healthcare team involved in anticancer drug management and the institutional authorities are called upon to strive for any possible effort to prevent and eliminate medication errors.

Pharmacist-Physician Communications in a Highly Computerised Hospital: Sign-Off and Action of Electronic Review Messages

BACKGROUND

Some hospital Computerized Physician Order Entry (CPOE) systems support interprofessional communication. The aim of this study was to investigate the effectiveness of pharmacist-physician messages sent via a CPOE system.

METHOD

Data from the year 2012 were captured from a large university teaching hospital CPOE database on: 1) review messages assigned by pharmacists; 2) details of the prescription on which the messages were assigned; and 3) details of any changes made to the prescription following a review message being assigned. Data were coded for temporal, message and prescription factors. Messages were analysed to investigate: 1) whether they were signed-off; and 2) the time taken. Messages that requested a measurable action were further analysed to investigate: 1) whether they were actioned as requested; and 2) the time taken. We conducted a multivariable analysis using Generalised Estimating Equations (GEE) to account for the effects of multiple factors simultaneously, and to adjust for any potential correlation between outcomes for repeated review messages on the same prescription. All analyses were performed using SPSS 22 (IBM SPSS Inc., Chicago, IL, USA), with p<0.05 considered significant.

RESULTS

Pharmacists assigned 36,245 review messages to prescriptions over the 12 months, 34,506 of which were coded for analysis after exclusions. Nearly half of messages (46.6%) were signed-off and 65.5% of these were signed-off in ≤ 48 hours. Of the 9,991 further analysed for action, 35.8% led to an action as requested by the pharmacist and just over half of these (57.0%) were actioned in ≤ 24 hours. Factors predictive of an action were the time since the prescription was generated (p<0.001), pharmacist grade (p<0.001), presence of a high-risk medicine (p<0.001), messages relating to reconciliation (p = 0.004), theme of communication (p<0.001), speciality, (p<0.001), category of medicine (p<0.001), and regularity of the prescription (p<0.001).

CONCLUSION

In this study we observed a lower rate of sign-off and action than we might have expected, suggesting uni-directional communication via the CPOE system may not be optimal. An established pharmacist-physician collaborative working relationship is likely to influence the prioritisation and response to messages, since a more desirable outcome was observed in settings and with grades of pharmacists where this was more likely. Designing systems that can facilitate collaborative communication may be more effective in practice.

Do false positive alerts in naïve clinical decision support system lead to false adoption by physicians? A randomized controlled trial

OBJECTIVES

False positive alerts in patient-safety-related clinical decision support systems (CDSS) are defined as alerts which incorrectly prompt when no-risk patients are encountered. It is an unfavorable condition which may potentially mislead physicians. The aim is to investigate physician responses toward false positive (FP) and true positive (TP) alerts in CDSS for the prevention of contrast-induced nephropathy (CIN).

METHODS

A two-arm cluster randomized controlled trial was conducted in university hospitals. Eligible physicians were randomized to receive alert intervention or no intervention (groups 1 and 2, respectively). The alert system was embedded with a deliberately non-specific risk detection tool in order to generate TP and FP alerts. The naïve alert system would alert the physician to cancel the order regardless of the patient being at-risk or not at-risk. CIN risk was stratified as at-risk and no-risk according to a patient's pre-existing renal function. Contrast imaging order-cancellation rate was measured as primary outcome.

RESULTS

3802 contrast-enhanced examination orders from 66 physicians were analyzed. Demographic data and risk distributions of patients were similar and well-balanced between two groups. In the intervention group, a total of 1892 alerts were generated (332 TP alerts and 1560 FP alerts). Order-cancellation rates were 5.1% versus 1.4% in groups 1 and 2 for at-risk patients (relative risk [RR] = 3.69) from TP alerts, and 1.0% versus 1.4% for no-risk patients (RR = 0.71) from FP alerts. Using generalized linear model with generalized estimating equation, the FP alerts had no order-cancellation effect when compared to the control arm (adjusted RR = 0.69; 95%CI, 0.36-1.32). The TP alerts had a larger order-cancellation effect than that of the control arm (adjusted RR = 2.95; 95%CI, 0.94-9.27), which revealed a marginal trend toward significance. However, the effect was not statistically significant (adjusted RR = 1.24; 95%CI, 0.71-2.18) if TP and FP alerts were mixed.

CONCLUSIONS

Physicians are not likely to adopt recommendations provided by false positive alerts in patient-safety-related CDSS. If reporting only the adoption rate of CDSS as a whole without differentiating between TP and FP alerts, the effects of TP and FP alerts will be mixed, and thus, will lead to an underestimation of system effectiveness.

Perceptions and experiences of the implementation, management, use and optimisation of electronic prescribing systems in hospital settings: protocol for a systematic review of qualitative studies

INTRODUCTION

There is increasing evidence that electronic prescribing (ePrescribing) or computerised provider/physician order entry (CPOE) systems can improve the quality and safety of healthcare services. However, it has also become clear that their implementation is not straightforward and may create unintended or undesired consequences once in use. In this context, qualitative approaches have been particularly useful and their interpretative synthesis could make an important and timely contribution to the field. This review will aim to identify, appraise and synthesise qualitative studies on ePrescribing/CPOE in hospital settings, with or without clinical decision support.

METHODS AND ANALYSIS

Data sources will include the following bibliographic databases: MEDLINE, MEDLINE In Process, EMBASE, PsycINFO, Social Policy and Practice via Ovid, CINAHL via EBSCO, The Cochrane Library (CDSR, DARE and CENTRAL databases), Nursing and Allied Health Sources, Applied Social Sciences Index and Abstracts via ProQuest and SCOPUS. In addition, other sources will be searched for ongoing studies (ClinicalTrials.gov) and grey literature: Healthcare Management Information Consortium, Conference Proceedings Citation Index (Web of Science) and Sociological abstracts. Studies will be independently screened for eligibility by 2 reviewers. Qualitative studies, either standalone or in the context of mixed-methods designs, reporting the perspectives of any actors involved in the implementation, management and use of ePrescribing/CPOE systems in hospital-based care settings will be included. Data extraction will be conducted by 2 reviewers using a piloted form. Quality appraisal will be based on criteria from the Critical Appraisal Skills Programme checklist and Standards for Reporting Qualitative Research. Studies will not be excluded based on quality assessment. A postsynthesis sensitivity analysis will be undertaken. Data analysis will follow the thematic synthesis method.

ETHICS AND DISSEMINATION

The study does not require ethical approval as primary data will not be collected. The results of the study will be published in a peer-reviewed journal and presented at relevant conferences.

TRIAL REGISTRATION NUMBER

CRD42016035552.

The support of medication reviews in hospitalised patients using a clinical decision support system

Objectives

First, to estimate the added value of a clinical decision support system (CDSS) in the performance of medication reviews in hospitalised elderly. Second, to identify the limitations of the current CDSS by analysing generated drug-related problems (DRPs).

Methods

Medication reviews were performed in patients admitted to the geriatric ward of the Zuyderland medical centre. Additionally, electronically available patient information was introduced into a CDSS. The DRP notifications generated by the CDSS were compared with those found in the medication review. The DRP notifications were analysed to learn how to improve the CDSS.

Results

A total of 223 DRP strategies were identified during the medication reviews. The CDSS generated 70 clinically relevant DRP notifications. Of these DRP notifications, 63 % (44) were also found during the medication reviews. The CDSS generated 10 % (26) new DRP notifications and conveyed 28 % (70) of all 249 clinically relevant DRPs that were found. Classification of the CDSS generated DRP notifications related to ‘medication error type’ revealed that ‘contraindications/interactions/side effects’ and ‘indication without medication’ were the main categories not identified during the manual medication review. The error types ‘medication without indication’, ‘double medication’, and ‘wrong medication’ were mostly not identified by the CDSS.

Conclusions

The CDSS used in this study is not yet sufficiently advanced to replace the manual medication review, though it does add value to the manual medication review. The strengths and weaknesses of the current CDSS can be determined according to the medication error types.

Use of Contraindicated Antiplatelet Medications in the Setting of Percutaneous Coronary Intervention: Insights From the Veterans Affairs Clinical Assessment, Reporting, and Tracking Program

BACKGROUND

Several antiplatelet medications used during and after percutaneous coronary intervention (PCI) are contraindicated for specific patient groups. A broad assessment of contraindicated medication use and associated clinical outcomes is not well described.

METHODS AND RESULTS

Using national Veterans Affairs Clinical Assessment, Reporting, and Tracking Program data for all PCI between 2007 and 2013, we evaluated patients with contraindications to commonly used antiplatelet medications during and after PCI, defined in accordance with package inserts. Adjusted association between contraindicated medication use and outcomes of periprocedural bleeding and 30-day mortality were assessed using Cox proportional hazards with inverse probability weighting. Among 64 294 patients undergoing PCI, 11 315(17.6%) had a contraindication to a common antiplatelet medication and 737 (6.5%) of these patients received a contraindicated medication. In unadjusted analyses, any contraindicated medication use was associated with both increased bleeding and 30-day mortality. In adjusted models, contraindicated abciximab use in patients with thrombocytopenia (hazard ratio, 2.23; 95% confidence interval, 1.58-3.16) and in patients with a previous stroke (hazard ratio, 1.93; 95% confidence interval, 1.37-2.71) remained significantly associated with increased bleeding. Contraindicated abciximab use was not significantly associated with 30-day mortality in adjusted models. Use of eptifibatide in dialysis patients was not significantly associated with an increased risk of bleeding or mortality.

CONCLUSIONS

In this national cohort, ≈18% of patients undergoing PCI had contraindications to common antiplatelet medications. Approximately 6% of those patients received a contraindicated medication with attendant bleeding risk, although this did not translate into significantly higher risk of 30-day mortality. Continued efforts to reduce contraindicated medication use may help avoid periprocedural complications.

Recommendations for health information technology implementation in rural hospitals

Purpose

– The purpose of this paper is to investigate violations against work standards associated with using a new health information technology (HIT) system. Relevant recommendations for implementing HIT in rural hospitals are provided and discussed to achieve meaningful use.

Design/methodology/approach

– An observational study is conducted to map medication administration process while using a HIT system in a rural hospital. Follow-up focus groups are held to determine and verify potential adverse factors related to using the HIT system while passing drugs to patients.

Findings

– A detailed task analysis demonstrated several violations, such as only relying on the barcode scanning system to match up with patient and drugs could potentially result in the medical staff forgetting to provide drug information verbally before administering drugs. There was also a lack of regulated and clear work procedure in using the new HIT system. In addition, the computer system controls and displays could not be adjusted so as to satisfy the users’ expectations. Nurses prepared medications and documentation in an environment that was prone to interruptions.

Originality/value

– Recommendations for implementing a HIT system in rural healthcare facilities can be categorized into five areas: people, tasks, tools, environment, and organization. Detailed remedial measures are provided for achieving continuous process improvements at resource-limited healthcare facilities in rural areas.

Quality in paediatric emergency medicine: Measurement and reporting

There is a clear demand for quality in the delivery of health care around the world; paediatric emergency medicine is no exception to this movement. It has been identified that gaps exist in the quality of acute care provided to children. Regulatory bodies in Australia and New Zealand are moving to mandate the implementation of quality targets and measures. Within the paediatric emergency department (ED), there is a lack of research into paediatric specific indicators. The existing literature regarding paediatric acute care quality measures has been recently summarised, and expert consensus has now been reported. It is clear that there is much work to be performed to generalise this work to ED. We review suggestions from the current literature relating to feasible indicators within the paediatric acute care setting. We propose options to develop a quality 'scorecard' that could be used to assist Australian and New Zealand EDs with quality measurement and benchmarking for their paediatric patients.

Usability Flaws in Medication Alerting Systems: Impact on Usage and Work System

OBJECTIVES

Previous research has shown that medication alerting systems face usability issues. There has been no previous attempt to systematically explore the consequences of usability flaws in such systems on users (i.e. usage problems) and work systems (i.e. negative outcomes). This paper aims at exploring and synthesizing the consequences of usability flaws in terms of usage problems and negative outcomes on the work system.

METHODS

A secondary analysis of 26 papers included in a prior systematic review of the usability flaws in medication alerting was performed. Usage problems and negative outcomes were extracted and sorted. Links between usability flaws, usage problems, and negative outcomes were also analyzed.

RESULTS

Poor usability generates a large variety of consequences. It impacts the user from a cognitive, behavioral, emotional, and attitudinal perspective. Ultimately, usability flaws have negative consequences on the workflow, the effectiveness of the technology, the medication management process, and, more importantly, patient safety. Only few complete pathways leading from usability flaws to negative outcomes were identified.

CONCLUSION

Usability flaws in medication alerting systems impede users, and ultimately their work system, and negatively impact patient safety. Therefore, the usability dimension may act as a hidden explanatory variable that could explain, at least partly, the (absence of) intended outcomes of new technology.

Application of a trigger tool in near real time to inform quality improvement activities: a prospective study in a general medicine ward

Background

Retrospective record review using trigger tools remains the most widely used method for measuring adverse events (AEs) to identify targets for improvement and measure temporal trends. However, medical records often contain limited information about factors contributing to AEs. We implemented an augmented trigger tool that supplemented record review with debriefing front-line staff to obtain details not included in the medical record. We hypothesised that this would foster the identification of factors contributing to AEs that could inform improvement initiatives.

Method

A trained observer prospectively identified events in consecutive patients admitted to a general medical ward in a tertiary care academic medical centre (November 2010 to February 2011 inclusive), gathering information from record review and debriefing front-line staff in near real time. An interprofessional team reviewed events to identify preventable and potential AEs and characterised contributing factors using a previously published taxonomy.

Results

Among 141 patients, 14 (10%; 95% CI 5% to 15%) experienced at least one preventable AE; 32 patients (23%; 95% CI 16% to 30%) experienced at least one potential AE. The most common contributing factors included policy and procedural problems (eg, routine protocol violations, conflicting policies; 37%), communication and teamwork problems (34%), and medication process problems (23%). However, these broad categories each included distinct subcategories that seemed to require different interventions. For instance, the 32 identified communication and teamwork problems comprised 7 distinct subcategories (eg, ineffective intraprofessional handovers, poor interprofessional communication, lacking a shared patient care, paging problems). Thus, even the major categories of contributing factors consisted of subcategories that individually related to a much smaller subset of AEs.

Conclusions

Prospective application of an augmented trigger tool identified a wide range of factors contributing to AEs. However, the majority of contributing factors accounted for a small number of AEs, and more general categories were too heterogeneous to inform specific interventions. Successfully using trigger tools to stimulate quality improvement activities may require development of a framework that better classifies events that share contributing factors amenable to the same intervention.

Simvastatin prescribing patterns before and after FDA dosing restrictions: a retrospective analysis of a large healthcare claims database

BACKGROUND

Muscle-related events, or myopathies, are a commonly reported adverse event associated with statin use. In June 2011, the US FDA released a Drug Safety Communication that provided updated product labeling with dosing restrictions for simvastatin to minimize the risk of myopathies.

OBJECTIVE

Our objective was to describe prescribing patterns of simvastatin in combination with medications known to increase the risk of myopathies following updated product labeling dosing restrictions in June 2011.

METHODS

A retrospective observational analysis was carried out, in which administrative claims data were utilized to identify prescribing patterns of simvastatin in combination with calcium channel blockers (CCBs) and other pre-specified drug therapies. Prescribing patterns were analyzed on a monthly basis 24 months prior to and 9 months following product label changes. Incidence of muscle-related events was also analyzed.

RESULTS

In June 2011, a total of 60% of patients with overlapping simvastatin-CCB claims and 94% of patients with overlapping simvastatin-non-CCB claims were prescribed an against-label combination. As of March 2012, a total of 41% and 93% of patients continued to be prescribed against-label simvastatin-CCB and simvastatin-non-CCB combinations, respectively. The most commonly prescribed dose of simvastatin was 20 mg (39%). Against-label combinations were most commonly prescribed at a simvastatin dose of 40 mg (56%). Amlodipine was the most commonly prescribed CCB in combination with simvastatin (70%) and the most common CCB prescribed against-label (67%).

CONCLUSIONS

Despite improvements in prescribing practices, many patients are still exposed to potentially harmful simvastatin combinations. Aggressive changes in simvastatin prescribing systems and processes are needed to improve compliance with FDA labeling to improve medication and patient safety.

Impact of a warning CPOE system on the inappropriate pill splitting of prescribed medications in outpatients

Background

Prescribing inappropriate pill splitting is not rare in clinical practice. To reduce inappropriate pill splitting, we developed an automatic warning system linked to a computerized physician order entry (CPOE) system for special oral formulation drugs in outpatient settings. We examined the impact of the warning system on inappropriate prescribing of pill splitting and assess prescribers' responses to the warnings.

Methods

Drugs with extended-release or enteric-coated formulations that were not originally intended to be split were recognized as “special oral formulations”. A hard-stop system which could examine non-integer doses of drugs with special oral formulations, provide warnings to interrupt inappropriate prescriptions was integrated in CPOE in a medical center since June 2010. We designed an intervention study to compare the inappropriate splitting before and after the implementation of the warning system (baseline period 2010 January to May vs. intervention period 2010 June to 2011 August). During the intervention period, prescription changes in response to a warning were logged and analyzed.

Results

A total of 470,611 prescribed drug items with 34 different drugs with special oral formulations were prescribed in the study period. During the 15-month intervention period, 909 warnings for 26 different drugs were triggered among 354,523 prescribed drug items with special oral formulations. The warning rate of inappropriate splitting in the late intervention period was lower than those in baseline period (0.16% vs. 0.61%, incidence rate ratio 0.27, 95% CI 0.23–0.31, P<0.001). In respond to warnings, physicians had to make adjustments, of which the majority was changing to an unsplit pill (72.9%).

Conclusions

The interruptive warning system could avoid the prescriptions with inappropriate pill splitting. Accordingly, physicians changed their behavior of prescribing special oral formulations regarding inappropriate pill splitting. We suggest the establishment of such system to target special oral formulations with warnings to prevent inappropriate pill splitting.

Health information technology in oncology practice: a literature review

The adoption and implementation of information technology are dramatically remodeling healthcare services all over the world, resulting in an unstoppable and sometimes overwhelming process. After the introduction of the main elements of electronic health records and a description of what every cancer-care professional should be familiar with, we present a narrative review focusing on the current use of computerized clinical information and decision systems in oncology practice. Following a detailed analysis of the many coveted goals that oncologists have reached while embracing informatics progress, the authors suggest how to overcome the main obstacles for a complete physicians' engagement and for a full information technology adoption, and try to forecast what the future holds.