The effectiveness of integrated health information technologies across the phases of medication management: a systematic review of randomized controlled trials

Feature engineering and a proposed decision-support system for systematic reviewers of medical evidence

OBJECTIVES

Evidence-based medicine depends on the timely synthesis of research findings. An important source of synthesized evidence resides in systematic reviews. However, a bottleneck in review production involves dual screening of citations with titles and abstracts to find eligible studies. For this research, we tested the effect of various kinds of textual information (features) on performance of a machine learning classifier. Based on our findings, we propose an automated system to reduce screeing burden, as well as offer quality assurance.

METHODS

We built a database of citations from 5 systematic reviews that varied with respect to domain, topic, and sponsor. Consensus judgments regarding eligibility were inferred from published reports. We extracted 5 feature sets from citations: alphabetic, alphanumeric(+), indexing, features mapped to concepts in systematic reviews, and topic models. To simulate a two-person team, we divided the data into random halves. We optimized the parameters of a Bayesian classifier, then trained and tested models on alternate data halves. Overall, we conducted 50 independent tests.

RESULTS

All tests of summary performance (mean F3) surpassed the corresponding baseline, P<0.0001. The ranks for mean F3, precision, and classification error were statistically different across feature sets averaged over reviews; P-values for Friedman's test were .045, .002, and .002, respectively. Differences in ranks for mean recall were not statistically significant. Alphanumeric(+) features were associated with best performance; mean reduction in screening burden for this feature type ranged from 88% to 98% for the second pass through citations and from 38% to 48% overall.

CONCLUSIONS

A computer-assisted, decision support system based on our methods could substantially reduce the burden of screening citations for systematic review teams and solo reviewers. Additionally, such a system could deliver quality assurance both by confirming concordant decisions and by naming studies associated with discordant decisions for further consideration.

A rehabilitation tool designed for intensive web-based cognitive training: description and usability study

Background

Cognitive deficits are among the most disabling of neurological diseases and have a serious impact on the quality of life of patients and families. Cognitive training has been proven successful in improving or compensating for neuropsychological deficits after acute brain injury, but its efficacy highly depends on the intensity of treatment over an extended period of time. Therefore, cognitive training indicates expensive human resources and renders the rehabilitation process vulnerable to physical and economic barriers for the majority of patients.

Objective

The aim of this study was to develop and test a new Web-based rehabilitation tool that provides intensive cognitive training at home under clinical prescription and monitoring, at affordable costs.

Methods

From a pool of 60 original exercises, designed and used over the past 10 years for cognitive training at our center, we developed 27 exercises on a computer game format, with automatic increase or decrease of difficulty levels. These exercises were assembled in a clean, user-friendly design and covered various cognitive domains such as attention (n=4), memory (n=11), language (n=3), calculus (n=3), praxis (n=2), and executive functions (n=3). A Web 2.0 platform was also designed to provide medical prescription of cognitive training sessions, performed at the patient’s home. These sessions included continuous monitoring of compliance, performance, and evolution; algorithms for automatic adjustment and long-term learning through use, and database recording of all activities. The end-user interaction test included 80 patients from our memory clinic from several groups including subjective memory complaints (n=20), traumatic brain injury (n=20), stroke and other static brain lesions (n=20), and mild Alzheimer’s disease (n=20). During a 1-hour session, patients and their relatives were taught to use the system and allowed to practice using it. At the end of the session, they were asked to complete a questionnaire.

Results

A total of 48/80 patients (60%) attended the training session. The mean age of the patients was 60 years (SD 13.3, range 41-78), and the mean level of formal education was 6 years (range 4-16). Of all the participants, 32/48 patients (66%) have previously used a computer. All patients and their relatives made a positive evaluation of the cognitive training tool. Only 2/48 patients (4%) were not interested in performing the exercises at home; 19/48 patients (39%) mentioned the need for further coaching from a relative or health care professional. The patients who mentioned difficulties in performing the exercises have not used the computer earlier.

Conclusions

This new Web-based system was very well accepted by patients and their relatives, who showed high levels of motivation to use it on a daily basis at home. The simplicity of its use and comfort were especially outlined. This tool will have an important effect on human resource management, in increasing the patient access to specialized health care and improving the quality and national health system costs of rehabilitation programs.

Use and perceived benefits of mobile devices by physicians in preventing adverse drug events in the nursing home

OBJECTIVE

Although mobile devices equipped with drug reference software may help prevent adverse drug events (ADEs) in the nursing home (NH) by providing medication information at the point of care, little is known about their use and perceived benefits. The goal of this study was to conduct a survey of a nationally representative sample of NH physicians to quantify the use and perceived benefits of mobile devices in preventing ADEs in the NH setting.

DESIGN/SETTING/PARTICIPANTS

We surveyed physicians who attended the 2010 American Medical Directors Association Annual Symposium about their use of mobile devices, and beliefs about the effectiveness of drug reference software in preventing ADEs.

RESULTS

The overall net valid response rate was 70% (558/800) with 42% (236/558) using mobile devices to assist with prescribing in the NH. Physicians with 15 or fewer years of clinical experience were 67% more likely to be mobile device users, compared with those with more than 15 years of clinical experience (odds ratio = 1.68; 95% confidence interval = 1.17-2.41; P = .005). For those who used a mobile device to assist with prescribing, almost all (98%) reported performing an average of 1 or more drug look-ups per day, performed an average of 1 to 2 lookups per day for potential drug-drug interactions (DDIs), and most (88%) believed that drug reference software had helped to prevent at least 1 potential ADE in the preceding 4-week period.

CONCLUSIONS

The proportion of NH physicians who use mobile devices with drug reference software, although significant, is lower than in other clinical environments. Our results suggest that NH physicians who use mobile devices equipped with drug reference software believe they are helpful for reducing ADEs. Further research is needed to better characterize the facilitators and barriers to adoption of the technology in the NH and its precise impact on NH ADEs.

Effect of health information technology interventions on lipid management in clinical practice: a systematic review of randomized controlled trials

BACKGROUND

Large gaps in lipid treatment and medication adherence persist in high-risk outpatients in the United States. Health information technology (HIT) is being applied to close quality gaps in chronic illness care, but its utility for lipid management has not been widely studied.

OBJECTIVE

To perform a qualitative review of the impact of HIT interventions on lipid management processes of care (screening or testing; drug initiation, titration or adherence; or referrals) or clinical outcomes (percent at low density lipoprotein cholesterol goal; absolute lipid levels; absolute risk scores; or cardiac hospitalizations) in outpatients with coronary heart disease or at increased risk.

METHODS

PubMed and Google Scholar databases were searched using Medical Subject Headings related to clinical informatics and cholesterol or lipid management. English language articles that described a randomized controlled design, tested at least one HIT tool in high risk outpatients, and reported at least 1 lipid management process measure or clinical outcome, were included.

RESULTS

Thirty-four studies that enrolled 87,874 persons were identified. Study ratings, outcomes, and magnitude of effects varied widely. Twenty-three trials reported a significant positive effect from a HIT tool on lipid management, but only 14 showed evidence that HIT interventions improve clinical outcomes. There was mixed evidence that provider-level computerized decision support improves outcomes. There was more evidence in support of patient-level tools that provide connectivity to the healthcare system, as well as system-level interventions that involve database monitoring and outreach by centralized care teams.

CONCLUSION

Randomized controlled trials show wide variability in the effects of HIT on lipid management outcomes. Evidence suggests that multilevel HIT approaches that target not only providers but include patients and systems approaches will be needed to improve lipid treatment, adherence and quality.

Clinical relevance of target identity and biology: implications for drug discovery and development

Many of the most commonly used drugs precede techniques for target identification and drug specificity and were developed on the basis of efficacy and safety, an approach referred to as classical pharmacology and, more recently, phenotypic drug discovery. Although substantial gains have been made during the period of focus on target-based approaches, particularly in oncology, these approaches have suffered a high overall failure rate and lower productivity in terms of new drugs when compared with phenotypic approaches. This review considers the importance of target identity and biology in clinical practice from the prescriber's viewpoint. In evaluating influences on prescribing behavior, studies suggest that target identity and mechanism of action are not significant factors in drug choice. Rather, patients and providers consistently value efficacy, safety, and tolerability. Similarly, the Food and Drug Administration requires evidence of safety and efficacy for new drugs but does not require knowledge of drug target identity or target biology. Prescribers do favor drugs with novel mechanisms, but this preference is limited to diseases for which treatments are either not available or suboptimal. Thus, while understanding of drug target and target biology is important from a scientific perspective, it is not particularly important to prescribers, who prioritize efficacy and safety.

Clinical evaluation of the ADE scorecards as a decision support tool for adverse drug event analysis and medication safety management

AIMS

The prevention of adverse drug events (ADEs) demands co-ordination of different health care professionals. ADE scorecards are a novel approach to raise the team awareness regarding ADE risks and causes. It makes information on numbers and on possible causes of possible ADE cases available to the clinical team. The aim of the study was to investigate the usage and acceptance of ADE scorecards by healthcare professionals and their impact on rates of possible ADEs.

METHODS

ADE scorecards were introduced in three departments of a French hospital. A controlled time series analysis of ADE data was conducted to assess the impact of the ADE scorecards. In addition, qualitative interviews and a standardized survey with all participating staff members were performed.

RESULTS

Physicians, nurses and pharmacists found ADE scorecards effective to increase medication safety and recommended future usage. The time-series analysis did not show changes in rates of possible ADEs.

CONCLUSION

ADE scorecards appear to be useful to raise awareness of ADE-related issues among professionals. Although the evaluation did not show significant reductions of ADE rates, the participating physicians, nurses and pharmacists believed that the ADE scorecards could contribute to increased patient safety and to a reduction in ADE rates. Strategies need to be designed to integrate ADE scorecards better into the clinical routine and to increase the precision of ADE detection.

The evidence for the effectiveness of safety alerts in electronic patient medication record systems at the point of pharmacy order entry: a systematic review

BACKGROUND

Electronic Patient Medication Record (ePMR) systems have important safety features embedded to alert users about potential clinical hazards and errors. To date, there is no synthesis of evidence about the effectiveness of these safety features and alerts at the point of pharmacy order entry. This review aims to systematically explore the literature and synthesise published evidence about the effectiveness of safety features and alerts in ePMR systems at the point of pharmacy order entry, in primary and secondary care.

METHODS

We searched MEDLINE, EMBASE, Inspec, International Pharmaceutical Abstracts, PsycINFO, CINHAL (earliest entry to March 2012) and reference lists of articles. Two reviewers examined the titles and abstracts, and used a hierarchical template to identify comparative design studies evaluating the effectiveness of safety features and alerts at the point of pharmacy order entry. The two reviewers independently assessed the quality of the included studies using Cochrane Collaboration's risk of bias tool.

RESULTS

Three randomised trials and two before-after studies met our criteria. Four studies involved integrated care facilities and one was hospital-based. The studies were all from the United States (US). The five studies demonstrated statistically significant reduction in medication errors in patients with renal insufficiency, pregnant women dispensed US Food Drug and Administration (FDA) risk category D (evidence of fetal risk but therapeutic benefits can outweigh the risk) or X (evidence suggests that risk to the fetus outweighs therapeutic benefits) medication, first dispensing of inappropriate medications in patients aged 65 and above, co-dispensing of interacting drugs, and adverse drug events related to hyperkalaemia.

CONCLUSIONS

This systematic review shows that the safety features of ePMR systems are effective in alerting users about potential clinical hazards and errors during pharmacy order entry. There are however, problems such as false alerts and inconsistencies in alert management. More studies are needed from other countries and pharmacy practice settings to assess the effectiveness of electronic safety features and alerts in preventing error and reducing harm to patients.

Lessons learned from implementation of computerized provider order entry in 5 community hospitals: a qualitative study

Background

Computerized Provider Order Entry (CPOE) can improve patient safety, quality and efficiency, but hospitals face a host of barriers to adopting CPOE, ranging from resistance among physicians to the cost of the systems. In response to the incentives for meaningful use of health information technology and other market forces, hospitals in the United States are increasingly moving toward the adoption of CPOE. The purpose of this study was to characterize the experiences of hospitals that have successfully implemented CPOE.

Methods

We used a qualitative approach to observe clinical activities and capture the experiences of physicians, nurses, pharmacists and administrators at five community hospitals in Massachusetts (USA) that adopted CPOE in the past few years. We conducted formal, structured observations of care processes in diverse inpatient settings within each of the hospitals and completed in-depth, semi-structured interviews with clinicians and staff by telephone. After transcribing the audiorecorded interviews, we analyzed the content of the transcripts iteratively, guided by principles of the Immersion and Crystallization analytic approach. Our objective was to identify attitudes, behaviors and experiences that would constitute useful lessons for other hospitals embarking on CPOE implementation.

Results

Analysis of observations and interviews resulted in findings about the CPOE implementation process in five domains: governance, preparation, support, perceptions and consequences. Successful institutions implemented clear organizational decision-making mechanisms that involved clinicians (governance). They anticipated the need for education and training of a wide range of users (preparation). These hospitals deployed ample human resources for live, in-person training and support during implementation. Successful implementation hinged on the ability of clinical leaders to address and manage perceptions and the fear of change. Implementation proceeded smoothly when institutions identified and anticipated the consequences of the change.

Conclusions

The lessons learned in the five domains identified in this study may be useful for other community hospitals embarking on CPOE adoption.

Quality improvement in preoperative assessment by implementation of an electronic decision support tool

OBJECTIVES

To evaluate the impact of the electronic decision support (eDS) tool 'PReOPerative evaluation' (PROP) on guideline adherence in preoperative assessment in statutory health care in Salzburg, Austria.

MATERIALS AND METHODS

The evaluation was designed as a non-randomized controlled trial with a historical control group (CG). In 2007, we consecutively recruited 1363 patients admitted for elective surgery, and evaluated the preoperative assessment. In 2008, PROP was implemented and available online. In 2009 we recruited 1148 patients preoperatively assessed using PROP (294 outpatients, 854 hospital sector). Our analysis includes full blood count, liver function tests, coagulation parameters, electrolytes, ECG, and chest x-ray.

RESULTS

The number of tests/patient without indication was 3.39 in the CG vs 0.60 in the intervention group (IG) (p<0.001). 97.8% (CG) vs 31.5% (IG) received at least one unnecessary test. However, we also observed an increase in recommended tests not performed/patient (0.05±0.27 (CG) vs 0.55±1.00 (IG), p<0.001). 4.2% (CG) vs 30.1% (IG) missed at least one necessary test. The guideline adherence (correctly tested/not tested) improved distinctively for all tests (1.6% (CG) vs 49.3% (IG), p<0.001).

DISCUSSION

PROP reduced the number of unnecessary tests/patient by 2.79 which implied a reduction of patients' burden, and a relevant cut in unnecessary costs. However, the advantage in specificity caused an increase in the number of patients incorrectly not tested. Further research is required regarding the impact of PROP on perioperative outcomes.

Use of a computerized order set to increase prescription of calcium and vitamin D supplementation in patients receiving glucocorticoids

BACKGROUND

American College of Rheumatology guidelines recommend that patients taking glucocorticoids also take calcium and vitamin D supplements, regardless of the dose or intended duration of glucocorticoid use, to decrease their risk of glucocorticoid-induced osteopenia or osteoporosis (GIOP).

OBJECTIVE

To increase the number of prescriptions made for calcium and vitamin D in patients who receive a prescription for glucocorticoids using an automated, computerized order set.

DESIGN

Pre-post test design.

PATIENTS

A total of 1,041 outpatients receiving care at a single VA medical center. INTERVENTION/MAIN MEASURES: We developed an automated order set in which calcium and vitamin D were automatically co-ordered with glucocorticoid prescriptions of at least 2-week duration. We tested the impact of the order set by comparing the number of calcium and vitamin D prescriptions in patients taking glucocorticoids during a 12-month period before (T1) and after (T2) implementation. The automated order set could be modified by the treating physician, and it was not generated for patients with hypercalcemia.

KEY RESULTS

A total of 535 patients during T1 and 506 patients during T2 had a glucocorticoid prescription of at least 2-week duration. The percent of co-prescriptions for calcium increased from 37 to 49% and vitamin D from 38 to 53% (both p < 0.0001) after the new automated order set was implemented.

CONCLUSIONS

Implementation of an automatic prescription for calcium and vitamin D supplementation modestly increases the number of patients on glucocorticoids who are prescribed calcium and vitamin D supplementation.

The effects of Computerized Provider Order Entry implementation on communication in Intensive Care Units

The literature shows that communication in health care is one of the most important factors associated with quality of care and patients safety. Especially in Intensive Care Units (ICUs) communication is of importance, due to the characteristics of the setting. However, relatively little is known about the different aspects of communication in health care and how Computerized Provider Order Entry (CPOE) implementation may impact communication, and consequently, quality of care. In this study we adapted an existing questionnaire developed by Shortell et al. to examine the impact of CPOE implementation on communication in a repeated cross-sectional design (6 months before implementation, 3 months after implementation and one-year after implementation). Results show overall that CPOE did not have a negative effect on communication, especially in the long term.

Prevalence and risk of potential cytochrome P450-mediated drug-drug interactions in older hospitalized patients with polypharmacy

BACKGROUND

As rates of polypharmacy rise and medication regimens become more complex, the risk of potential cytochrome P450 (CYP)-mediated drug-drug interactions (DDIs) is a growing clinical concern for older adults.

OBJECTIVE

To determine the prevalence of potential CYP-mediated DDIs in older hospitalized adults with polypharmacy and analyze the relationship between the number of drugs dispensed and the probability of these interactions in this high-risk population.

METHODS

A prospective 16-week cohort study was conducted among consecutive new patients aged 65 years and older with polypharmacy (>5 drugs) admitted to a community hospital. The medication profiles of these patients were analyzed with a new multidrug cytochrome-specific software program. The prevalence of potential CYP-mediated DDIs was determined, with the probability calculated as a function of the number of medications dispensed using multivariate Poisson regression adjusted for age and sex. Comparative performance of the software program and a standard 2-drug alert program for detecting these DDIs was evaluated using the Wilcoxon-Mann-Whitney rank-sum test. Pharmacists' decisions to recommend medication adjustment based on the probability of CYP-mediated DDIs were recorded.

RESULTS

The prevalence of potential CYP-mediated DDIs detected among 275 older adults with polypharmacy was 80%. The probability of at least 1 CYP-mediated DDI was 50% for persons taking 5-9 drugs, 81% with 10-14 drugs, 92% with 15-19 drugs, and 100% with 20 or more drugs. Addition of each medication to a 5-drug regimen conferred a 12% increased risk of a potential CYP-mediated DDI after adjustment for age and sex (OR 1.12; 95% CI 1.09-1.14). The multidrug software identified a median increase of 3 (95% CI 2.5-3.5) potential CYP-mediated DDIs per patient, compared to use of the standard 2-drug alert software. Pharmacists targeted patients for medication adjustment or close clinical monitoring in 23% of cases.

CONCLUSIONS

The prevalence of potential CYP-mediated DDIs is high in geriatric patients with polypharmacy. The risk of DDIs increases as a function of the number of medications dispensed. Pharmacists' decision to intervene for potential CYP-mediated DDIs depends on clinical judgment in addition to the output from drug alert software programs, but may be facilitated by a single multicomponent, multidrug potential CYP-mediated DDI assessment.

How many medication orders are entered through free-text in EHRs?--a study on hypoglycemic agents

Computerized Provider Order Entry (CPOE) can reduce medication errors; however, its benefits are only achieved when data are entered in a structured format and entries are properly coded. This paper aims to explore the incidence of free-text medication order entries involving hypoglycemic agents in an ambulatory electronic health record (EHR) system with CPOE. Our results showed that free-text order entry continues to be frequent. During 2010, 9.3% of hypoglycemic agents were entered as free-text for 2,091 patients. 17.4% of the entries contained misspellings. The highest proportion of free-text entries were found in urgent care clinics (49.4%) and among registered nurses (31.5%). Additionally, 92 drug-drug interaction alerts were not triggered due to free-text entries. Only 25.9% of the patients had diabetes recorded in their problem list. Solutions will require policy to enforce structured entry, ongoing improvement in user-interface design, improved training for users, and strategies for maintaining a complete medication list.

Effects of clinical communication interventions in hospitals: a systematic review of information and communication technology adoptions for improved communication between clinicians

OBJECTIVE

To conduct a systematic review of the literature to identify, describe and assess interventions of information and communication technology on the processes of communication and associated patient outcomes within hospital settings.

MATERIALS AND METHODS

Studies published from the years 1996 to 2010 were considered and were selected if they described an evaluation of information and communication technology interventions to improve clinical communication within hospitals. Two authors abstracted data from full text articles, and the quality of individual articles were appraised. Results of interventions were summarized by their effect.

RESULTS

There were 18 identified studies that evaluated the use of interventions that included alphanumeric paging, hands-free communication devices, mobile phones, smartphones, task management systems and a display based paging system. Most quantitative studies used a before and after study design and were of lower quality. Of all the studies, there was only one prospective randomized study, but this study used only simulated communication events. Quantitative studies identified improved perceptions of communication and some improvement in communication metrics. Qualitative studies described improvements in efficiency of communication but also issues of loss of control and reliability.

CONCLUSIONS

Despite the rapid advancement in information and communications technology over the last decade, there is limited evidence suggesting improvements in the ability of health professionals to communicate effectively. Given the critical nature of communication, we advocate further evaluation of information and communication technology designed to improve communication between clinicians. Outcome measures should include measures of patient-oriented outcomes and efficiency for clinicians.

The dangerous decade

Over the next 10 years, more information and communication technology (ICT) will be deployed in the health system than in its entire previous history. Systems will be larger in scope, more complex, and move from regional to national and supranational scale. Yet we are at roughly the same place the aviation industry was in the 1950s with respect to system safety. Even if ICT harm rates do not increase, increased ICT use will increase the absolute number of ICT related harms. Factors that could diminish ICT harm include adoption of common standards, technology maturity, better system development, testing, implementation and end user training. Factors that will increase harm rates include complexity and heterogeneity of systems and their interfaces, rapid implementation and poor training of users. Mitigating these harms will not be easy, as organizational inertia is likely to generate a hysteresis-like lag, where the paths to increase and decrease harm are not identical.