Development of an intelligent decision support system for medication review

HIV retention in care: results and lessons learned from the Positive Pathways Implementation Trial

BACKGROUND

Sustained, routine care is vital to the health of people with HIV (PWH) and decreasing transmission of HIV. We evaluated whether the identification of PWH at-risk of falling out of care and prompts for outreach were effective in retaining PWH in care in the United States.

METHODS

In this cluster randomized controlled trial, 20 AIDS Healthcare Foundation Healthcare Centers (HCCs) were randomized to the intervention (n = 10) or control (n = 10) arm; all maintained existing retention efforts. The intervention included daily automated flags in CHORUS™, a mobile app and web-based reporting solution utilizing electronic health record data, that identified PWH at-risk of falling out of care to clinic staff. Among flagged PWH, the association between the intervention and visits after a flag was assessed using logistic regression models fit with generalized estimating equations (independent correlation structure) to account for clustering. To adjust for differences between HCCs, models included geographic region, number of PWH at HCC, and proportions of PWH who self-identified as Hispanic or had the Ryan White Program as a payer.

RESULTS

Of 15,875 PWH in care, 56% were flagged; 76% (intervention) and 75% (control) resulted in a visit, of which 76% were within 2 months of the flag. In adjusted analyses, flags had higher odds of being followed by a visit (odds ratio [OR]: 1.08, 95% confidence interval [CI]: 0.97, 1.21) or a visit within 2 months (OR: 1.07, 95% CI: 0.97, 1.17) at intervention than control HCCs. Among at-risk PWH with viral loads at baseline and study end, the proportion with < 50 copies/mL increased in both study arms, but more so at intervention (65% to 74%) than control (62% to 67%) HCCs.

CONCLUSION

Despite challenges of the COVID-19 pandemic, adding an intervention to existing retention efforts, and the reality that behavior change takes time, PWH flagged as at-risk of falling out of care were marginally more likely to return for care at intervention than control HCCs and a greater proportion achieved undetectability. Sustained use of the retention module in CHORUS™ has the potential to streamline retention efforts, retain more PWH in care, and ultimately decrease transmission of HIV.

TRIAL REGISTRATION

The study was first registered at Clinical Trials.gov (NCT04147832, https://clinicaltrials.gov/show/NCT04147832 ) on 01/11/2019.

Clinical decision support systems-based interventions to improve medication outcomes: A systematic literature review on features and effects

Background: Clinical decision support systems (CDSSs) interventions were used to improve the life quality and safety in patients and also to improve practitioner performance, especially in the field of medication. Therefore, the aim of the paper was to summarize the available evidence on the impact, outcomes and significant factors on the implementation of CDSS in the field of medicine. Methods: This study is a systematic literature review. PubMed, Cochrane Library, Web of Science, Scopus, EMBASE, and ProQuest were investigated by 15 February 2017. The inclusion requirements were met by 98 papers, from which 13 had described important factors in the implementation of CDSS, and 86 were medicated-related. We categorized the system in terms of its correlation with medication in which a system was implemented, and our intended results were examined. In this study, the process outcomes (such as; prescription, drug-drug interaction, drug adherence, etc.), patient outcomes, and significant factors affecting the implementation of CDSS were reviewed. Results: We found evidence that the use of medication-related CDSS improves clinical outcomes. Also, significant results were obtained regarding the reduction of prescription errors, and the improvement in quality and safety of medication prescribed. Conclusion: The results of this study show that, although computer systems such as CDSS may cause errors, in most cases, it has helped to improve prescribing, reduce side effects and drug interactions, and improve patient safety. Although these systems have improved the performance of practitioners and processes, there has not been much research on the impact of these systems on patient outcomes.

A user-centered evaluation of medication therapy management alerts for community pharmacists: Recommendations to improve usability and usefulness

BACKGROUND

Community pharmacists provide comprehensive medication reviews (CMRs) through pharmacy contracts with medication therapy management (MTM) vendors. These CMRs are documented in the vendors' web-based MTM software platforms, which often integrate alerts to assist pharmacists in the detection of medication therapy problems. Understanding pharmacists' experiences with MTM alerts is critical to optimizing alert design for patient care.

OBJECTIVES

The objectives of this study were to 1) assess the usability and usefulness of MTM alerts for MTM vendor-contracted community pharmacists and 2) generate recommendations for improving MTM alerts for use by community pharmacists.

METHODS

This was a convergent, parallel mixed-methods evaluation of data collected from 3 sources, with individual pharmacists contributing data to one or more sources: 1) community pharmacists' submissions of observational data about MTM alerts encountered during routine MTM provision, 2) videos of naturalistic usability testing of MTM alerts, and 3) semi-structured interviews to elicit pharmacists' perspectives on MTM alert usefulness and usability. MTM alert data submitted by pharmacists were summarized with descriptive statistics. Usability testing videos were analyzed to determine pharmacists' time spent on MTM alerts and to identify negative usability incidents. Interview transcripts were analyzed using a hybrid approach of deductive and inductive codes to identify emergent themes. Triangulation of data (i.e., determination of convergence/divergence in findings across all data sources) occurred through investigator discussion and identified overarching findings pertaining to key MTM alert challenges. These resulted in actionable recommendations to improve MTM alerts for use by community pharmacists.

RESULTS

Collectively, two and four overarching key challenges pertaining to MTM alert usability and usefulness, respectively, were identified, resulting in 15 actionable recommendations for improving the design of MTM alerts from a user-centered perspective.

CONCLUSIONS

Recommendations are expected to inform enhanced MTM alert designs that can improve pharmacist efficiency, patient and prescriber satisfaction with MTM, and patient outcomes.

Economic impact of clinical pharmaceutical activities in hospital wards: A systematic review

BACKGROUND

The positive impact of clinical pharmacy services (CPS) in improving clinical outcomes such as reduction of drug related problems is well demonstrated. Despite these results, the deployment of these activities is not systematically observed in the hospital setting.

OBJECTIVES

This systematic review first aimed to describe existing evidence regarding economic evaluation of ward-based CPS focusing on the entire treatment of a patient in a hospital setting. Secondly, the quality of economic evaluations of existing evidence was assessed.

METHODS

A comprehensive literature search was performed in PubMed/Medline, Science Direct and the NHS Economic Evaluation databases from January 2000 to March 2019. English or French language articles describing an economic evaluation of ward-based CPS on inpatients in hospital settings were included. Articles not describing a single study, dealing with a CPS not considering the entire medication regimen of the patient or presenting both inpatient and outpatient CPS were excluded. Selected articles were analyzed according to Drummond's check-list for assessing economic evaluations.

RESULTS

Forty-one studies were included. About one third were American publications. CPS implemented in ICU represented about half of the selected articles. Pharmacist-to-bed ratios varied according to countries and care unit type with the most favorable ratios in ICU and in American studies. Cost-avoidance was mostly used to express economic impact and ranged from €1579 to €3,089 328. Studies yielding the greater economic impact were conducted in the USA with implementation of full-time equivalents pharmacists or establishing of collaborative practice agreements. Only 6 articles dealt correctly with at least 7 of the 10 Drummond's checklist assessment criteria.

CONCLUSION

This review suggests that the existing evidence is not sufficient to conclude to a positive economic impact of CPS conducted according to clinical pharmacy guidelines. Funding resources, remuneration of clinical pharmacy activities and provision of standardized national clinical and economic databases appear to be essential evolutions to improve CPS development.

[Impact of introducing assisted electronic prescription on paediatric patient safety]

OBJECTIVE

There have been very few studies on the effect of assisted electronic prescription on paediatric patient safety. The objective of this study is to compare medication errors that occurred before and after its introduction in a tertiary hospital.

MATERIAL AND METHODS

A quasi-experimental comparative study of medication errors detected before and after assisted electronic prescription introduction. All treatment lines were analysed in order to detect the point in the chain where the medication error occurred, as well as its type and cause. A Delphi study was conducted on the importance of each medication error involving doctors, nurses, and pharmacists.

RESULTS

The study included 166 patients (83 at each stage). At least one medication error was detected in 92% in the pre-introduction phase patients (2.8±2.1 errors/patient) and 7.2% of post-introduction phase patients (0.1±0.4 errors/patient). The assisted electronic prescription led to an absolute risk reduction of 40% (95% confidence interval=35.6-44.4%). The main cause of error was lapses and carelessness in both stages. Medication errors were considered serious in 9.5% of cases in the pre-introduction phase, while all of them were mild or moderate in the post-introduction phase.

CONCLUSIONS

The assisted electronic prescription implementation with prescription, validation and medication administration assistance systems significantly reduces medication errors and eliminates serious errors.

Exploring Electronic Medical Record and Self-Administered Medication Risk Screening Tools in a Primary Care Clinic

BACKGROUND

Electronic medical record (EMR) screening for indicators of medication risk could improve efficiency in identifying primary care clinic patients in need of clinical pharmacist care compared with patient self-reporting.

OBJECTIVES

To (a) compare the performance of an EMR medication risk assessment questionnaire (MRAQ) with a self-administered (SA) MRAQ and (b) explore each tool's ability to predict indicators of health behavior, health status, and health care utilization.

METHODS

A prospective cohort study was conducted with 143 adults who attended an academic family medicine center and were taking ≥ 2 medications. All participants completed the 10-item SA-MRAQ, Morisky Medication Adherence Scale, Chew's health literacy screener, Stanford Health Distress Scale, and SF-36 overall rating of health. A blinded investigator completed the EMR-MRAQ and a chart review to ascertain 6 months of health care utilization. Outcome measures included the following: (a) scores from the 5- and 10-item SA-MRAQs and 5-item EMR-MRAQ; (b) sensitivity and specificity to determine the accuracy of the 5-item EMR versus the 5-item SA risk scores; (c) correlations between risk assessments and health behavior/status scales; and (d) area under the receiver operator curve to determine how well a high-risk score predicted health care utilization.

RESULTS

The 5-item SA-MRAQ, the 5-item EMR-MRAQ, and the 10-item SA-MRAQ categorized 52.9% (55/104), 69.2% (99/143), and 17.6% (18/102) of participants as high risk, respectively. For the 104 participants who completed both 5-item MRAQ tools, the EMR-MRAQ had a sensitivity of 81.8% and specificity of 49.0% in detecting a high-risk SA-MRAQ score. Both 5-item risk assessments showed weak correlations with health distress and overall health, while the 10-item SA-MRAQ additionally showed weak correlations with medication adherence. The EMR-MRAQ was most effective in predicting all-cause emergency room visits/hospitalization (c-statistic = 0.69; 95% CI=0.57-0.81) and high clinic utilization (≥ 4 visits per 6 months; c-statistic = 0.77; 95% CI = 0.69-0.85). The EMR-MRAQ had high sensitivities but low specificities for these health care utilization outcomes, respectively (82.6% and 33.3%; 88.9% and 42.7%).

CONCLUSIONS

This pilot study suggests that EMR-MRAQ screening has high sensitivity but low specificity in comparison with self-reporting and was able to discriminate between those who would and would not experience health care utilization outcomes. These results justify further development and validation of an automated EMR-based tool to predict patient-important consequences of medication-related problems.

DISCLOSURES

This work was funded by the Canadian Society of Hospital Pharmacists Research and Education Foundation, which had no role in the analysis or interpretation of data or the decision to submit the manuscript for publication. The authors have no conflict of interests, potential or otherwise, to report. Makowsky had full access to all of the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. Study concept and design were contributed by Makowsky and Cor. Makowsky and Wong collected the data, and data interpretation was performed by Makowsky, Cor, and Wong. The manuscript was written by Makowsky and was critically reviewed for intellectual content by Makowsky, Cor, and Wong.

An investigation into drug-related problems identifiable by commercial medication review software

BACKGROUND

Accredited pharmacists conduct home medicines reviews (HMRs) to detect and resolve potential drug-related problems (DRPs). A commercial expert system, Medscope Review Mentor (MRM), has been developed to assist pharmacists in the detection and resolution of potential DRPs.

AIMS

This study compares types of DRPs identified with the commercial system which uses multiple classification ripple down rules (MCRDR) with the findings of pharmacists.

METHOD

HMR data from 570 reviews collected from accredited pharmacists was entered into MRM and the DRPs were identified. A list of themes describing the main concept of each DRP identified by MRM was developed to allow comparison with pharmacists. Theme types, frequencies, similarity and dissimilarity were explored.

RESULTS

The expert system was capable of detecting a wide range of potential DRPs: 2854 themes; compared to pharmacists: 1680 themes. The system identified the same problems as pharmacists in many patient cases. Ninety of 119 types of themes identifiable by pharmacists were also identifiable by software. MRM could identify the same problems in the same patients as pharmacists for 389 problems, resulting in a low overlap of similarity with an averaged Jaccard Index of 0.09.

CONCLUSION

MRM found significantly more potential DRPs than pharmacists. MRM identified a wide scope of DRPs approaching the range of DRPs that were identified by pharmacists. Differences may be associated with system consistency and perhaps human oversight or human selective prioritisation. DRPs identified by the system were still considered relevant even though the system identified a larger number of problems.

Efficacy of a clinical decision-support system in an HIV practice: a randomized trial

BACKGROUND

Data to support improved patient outcomes from clinical decision-support systems (CDSSs) are lacking in HIV care.

OBJECTIVE

To test the efficacy of a CDSS in improving HIV outcomes in an outpatient clinic.

DESIGN

Randomized, controlled trial. (ClinicalTrials.gov registration number: NCT00678600)

SETTING

Massachusetts General Hospital HIV Clinic.

PARTICIPANTS

HIV care providers and their patients.

INTERVENTION

Computer alerts were generated for virologic failure (HIV RNA level >400 copies/mL after a previous HIV RNA level ≤400 copies/mL), evidence of suboptimal follow-up, and 11 abnormal laboratory test results. Providers received interactive computer alerts, facilitating appointment rescheduling and repeated laboratory testing, for half of their patients and static alerts for the other half.

MEASUREMENTS

The primary end point was change in CD4 cell count. Other end points included time to clinical event, 6-month suboptimal follow-up, and severe laboratory toxicity.

RESULTS

Thirty-three HIV care providers followed 1011 patients with HIV. In the intervention group, the mean increase in CD4 cell count was greater (0.0053 vs. 0.0032 × 109 cells/L per month; difference, 0.0021 × 109 cells/L per month [95% CI, 0.0001 to 0.004]; P = 0.040) and the rate of 6-month suboptimal follow-up was lower (20.6 vs. 30.1 events per 100 patient-years; P = 0.022) than those in the control group. Median time to next scheduled appointment was shorter in the intervention group than in the control group after a suboptimal follow-up alert (1.71 vs. 3.48 months; P < 0.001) and after a toxicity alert (2.79 vs. >6 months; P = 0.072). More than 90% of providers supported adopting the CDSS as part of standard care.

LIMITATION

This was a 1-year informatics study conducted at a single hospital subspecialty clinic.

CONCLUSION

A CDSS using interactive provider alerts improved CD4 cell counts and clinic follow-up for patients with HIV. Wider implementation of such systems can provide important clinical benefits.

PRIMARY FUNDING SOURCE

National Institute of Allergy and Infectious Diseases.

[Development of integrated support software for drug validation]

OBJECTIVE

To describe the development of a tool to automate detection of adverse drug-related events (ADRE) in all patients in a hospital.

METHOD

We selected the ADRE that we wished to detect (administering drugs to patients with kidney failure and/or by enteral feeding tube) We designed software to record, process and integrate analytical results from SELENE(®) clinical history programme, treatment prescribed using Farmatools(®), and the information included in the tables we designed.

RESULTS

The programme allows us to automatically detect patients likely to experience the ADRE we defined, and recommends a modified treatment to the pharmacist. This new tool enables us to search for all patients who might have a specific ADRE.

CONCLUSIONS

The software we designed may be a useful drug validation tool.