Community pharmacist workflow and medication therapy management delegation: An assessment of preferences and barriers

Effect of Uncertainty-Aware AI Models on Pharmacists' Reaction Time and Decision-Making in a Web-Based Mock Medication Verification Task: Randomized Controlled Trial

Background

Artificial intelligence (AI)-based clinical decision support systems are increasingly used in health care. Uncertainty-aware AI presents the model's confidence in its decision alongside its prediction, whereas black-box AI only provides a prediction. Little is known about how this type of AI affects health care providers' work performance and reaction time.

Objective

This study aimed to determine the effects of black-box and uncertainty-aware AI advice on pharmacist decision-making and reaction time.

Methods

Recruitment emails were sent to pharmacists through professional listservs describing a web-based, crossover, randomized controlled trial. Participants were randomized to the black-box AI or uncertainty-aware AI condition in a 1:1 manner. Participants completed 100 mock verification tasks with AI help and 100 without AI help. The order of no help and AI help was randomized. Participants were exposed to correct and incorrect prescription fills, where the correct decision was to "accept" or "reject," respectively. AI help provided correct (79%) or incorrect (21%) advice. Reaction times, participant decisions, AI advice, and AI help type were recorded for each verification. Likelihood ratio tests compared means across the three categories of AI type for each level of AI correctness.

Results

A total of 30 participants provided complete datasets. An equal number of participants were in each AI condition. Participants' decision-making performance and reaction times differed across the 3 conditions. Accurate AI recommendations resulted in the rejection of the incorrect drug 96.1% and 91.8% of the time for uncertainty-aware AI and black-box AI respectively, compared with 81.2% without AI help. Correctly dispensed medications were accepted at rates of 99.2% with black-box help, 94.1% with uncertainty-aware AI help, and 94.6% without AI help. Uncertainty-aware AI protected against bad AI advice to approve an incorrectly filled medication compared with black-box AI (83.3% vs 76.7%). When the AI recommended rejecting a correctly filled medication, pharmacists without AI help had a higher rate of correctly accepting the medication (94.6%) compared with uncertainty-aware AI help (86.2%) and black-box AI help (81.2%). Uncertainty-aware AI resulted in shorter reaction times than black-box AI and no AI help except in the scenario where "AI rejects the correct drug." Black-box AI did not lead to reduced reaction times compared with pharmacists acting alone.

Conclusions

Pharmacists' performance and reaction times varied by AI type and AI accuracy. Overall, uncertainty-aware AI resulted in faster decision-making and acted as a safeguard against bad AI advice to approve a misfilled medication. Conversely, black-box AI had the longest reaction times, and user performance degraded in the presence of bad AI advice. However, uncertainty-aware AI could result in unnecessary double-checks, but it is preferred over false negative advice, where patients receive the wrong medication. These results highlight the importance of well-designed AI that addresses users' needs, enhances performance, and avoids overreliance on AI.

Effect of Artificial Intelligence Helpfulness and Uncertainty on Cognitive Interactions with Pharmacists: Randomized Controlled Trial

BACKGROUND

Clinical decision support systems leveraging artificial intelligence (AI) are increasingly integrated into health care practices, including pharmacy medication verification. Communicating uncertainty in an AI prediction is viewed as an important mechanism for boosting human collaboration and trust. Yet, little is known about the effects on human cognition as a result of interacting with such types of AI advice.

OBJECTIVE

This study aimed to evaluate the cognitive interaction patterns of pharmacists during medication product verification when using an AI prototype. Moreover, we examine the impact of AI's assistance, both helpful and unhelpful, and the communication of uncertainty of AI-generated results on pharmacists' cognitive interaction with the prototype.

METHODS

In a randomized controlled trial, 30 pharmacists from professional networks each performed 200 medication verification tasks while their eye movements were recorded using an online eye tracker. Participants completed 100 verifications without AI assistance and 100 with AI assistance (either with black box help without uncertainty information or uncertainty-aware help, which displays AI uncertainty). Fixation patterns (first and last areas fixated, number of fixations, fixation duration, and dwell times) were analyzed in relation to AI help type and helpfulness.

RESULTS

Pharmacists shifted 19%-26% of their total fixations to AI-generated regions when these were available, suggesting the integration of AI advice in decision-making. AI assistance did not reduce the number of fixations on fill images, which remained the primary focus area. Unhelpful AI advice led to longer dwell times on reference and fill images, indicating increased cognitive processing. Displaying AI uncertainty led to longer cognitive processing times as measured by dwell times in original images.

CONCLUSIONS

Unhelpful AI increases cognitive processing time in the original images. Transparency in AI is needed in "black box" systems, but showing more information can add a cognitive burden. Therefore, the communication of uncertainty should be optimized and integrated into clinical workflows using user-centered design to avoid increasing cognitive load or impeding clinicians' original workflow.

TRIAL REGISTRATION

ClinicalTrials.gov NCT06795477; https://clinicaltrials.gov/study/NCT06795477.

Pharmacist-initiated interventions using RxChange message communication with prescribers for electronic prescriptions: A retrospective descriptive study

BACKGROUND

RxChange messages improve patient medication management by enhancing pharmacist-prescriber communication, but their usage patterns in the United States are not well-documented.

OBJECTIVE

To determine intervention characteristics by pharmacists and prescribers using RxChange messages.

METHODS

A retrospective analysis of electronic prescription and RxChange messages from 2022 to 2023, using data from Surescripts, LLC, was conducted. This included NewRx messages and RxChange Responses, categorized by 7 RxChange use cases and Anatomical Therapeutic Chemical level 4 medication classes. Descriptive statistics and nonparametric tests were used for statistical analysis.

RESULTS

The study analyzed 1,361,528 RxChange messages. Therapeutic interchange was the predominant use case (76.14%). Direct approvals accounted for 10.44% of requests, approvals with changes for 42.55%, and denials for 47.01%. Script clarification had the highest approval rate (64.21%), while prior authorization faced the most frequent denials (73.38%). The top denial reason was "Request addressed through alternate methods such as phone or fax (41.50%)." The most frequent drug classes observed in the data were selective beta-2 adrenoreceptor agonists, extended-spectrum penicillins, selective serotonin reuptake inhibitors, and glucagon-like peptide 1 analogues. Time from new e-prescription issuance to RxChange request submission was longer than from request to response, with a significant statistical difference (median 1.57 vs. 0.27 days, P value < 0.05).

CONCLUSION

This study highlights interventions pharmacists make using RxChange with electronic prescriptions to improve patient care and medication safety. It underlined the need for improved RxChange message content and data on the effectiveness of RxChange messages in improving medication use.

Assessing Community Pharmacists' Perception on Readiness to Initiate Point-of-Care Testing for SARS-CoV-2 in New York State During the Pandemic

Introduction: Pursuant to the COVID-19 pandemic, an executive order issued by the New York State (NYS) governor allowed pharmacists to act as laboratory directors for a limited-service laboratory (LSL) to order and perform Food and Drug Administration (FDA) and Emergency Use Authorization (EUA) Clinical Laboratory Improvement Amendment (CLIA)-waived COVID-19 point-of-care testing (POCT). Objectives: To (i) assess the status of NYS community pharmacists with POCT in the early stages of the COVID-19 pandemic, (ii) assess the readiness and willingness of community pharmacists to incorporate COVID-19 POCT into their workflow during a pandemic, and (iii) assess community pharmacists' perception of the barrier to initiating COVID-19 POCT. Methods: This is a prospective cross-sectional study conducted from February 4 to February 21, 2021. An electronic survey consisting of 66 Likert-type questions, select all that apply, and fill-in-style questions were emailed to 250 Community Pharmacy Enhanced Service Network (CPESN) NY pharmacies, with a follow-up email sent halfway into the data collection period. The data were analyzed using descriptive statistics. Results: The result indicated that most participants (median = 5) demonstrated readiness and willingness to offer COVID-19 testing. Barriers to COVID-19 POCT were identified: impact on pharmacy workflow (59%), lack of payment mechanism (55%) and lack of sufficient training (21%). Most participants expressed interest in continuing POCT beyond the pandemic (86.1%). Conclusion: Community pharmacists in NYS reported willingness to initiate COVID-19 POCT. Addressing the identified barriers, such as workflow disruption and reimbursement challenges, will enable pharmacies to be better prepared to provide patient care, including POCT.

A primer on quality measurement and reporting in pharmacy benefit plans

Pharmacy benefit plans in the United States are evaluated on quality measures and other requirements of the government and accrediting organizations. This primer describes the roles of key organizations involved in measuring and reporting quality in pharmacy benefit plans and explains the methods that pharmacy benefit plans use to promote quality of medication use.

Mindfulness-Based Stress Reduction (MBSR) for Chronic Pain Management in the Community Pharmacy Setting: A Cross-Sectional Survey of the General Public's Knowledge and Perceptions

Patient access to mindfulness-based stress reduction (MBSR), a complementary and integrative health approach that is proven to reduce chronic pain, can be increased via community pharmacy-based implementation. However, the general public's awareness and preferences regarding MBSR as a treatment option for chronic pain, including provider roles (pharmacist vs. non-pharmacist), are unclear. Therefore, the purpose of this study was to assess the U.S. general public's knowledge, attitudes, barriers, and programmatic preferences regarding MBSR for chronic pain management, particularly in the community pharmacy setting. A cross-sectional, anonymous online survey was distributed to U.S. adults ≥18 years via the Amazon Mechanical Turk (MTurk) online survey platform. The survey instrument was informed by Anderson's framework for health service utilization. Measures were assessed using multiple-choice and 5-point Likert-type scales (1 = strongly disagree, 5 = strongly agree). Primary outcome measures included: (1) knowledge and awareness of MBSR (12-items); (2) confidence in seeking out MBSR for pain (5-items); (3) barriers to receiving MBSR (11-items); (4) beliefs about MBSR in general (12-items); (5) beliefs about community pharmacy-delivered MBSR (15-items); and (6) preferences for MBSR classes/programs (6-items). Outcomes were analyzed using descriptive statistics, and influential factors associated with mean beliefs regarding community pharmacy-delivered MBSR for chronic pain management were assessed via multiple linear regression. Of the 302 survey respondents, the majority were white (79.1%) and female (50.7%), with a mean age of 44.65 years. Respondents' self-rated MBSR knowledge (mean [SD] scale score: 2.30 [0.68]) and confidence (2.65 [0.87]) were low, although perceived barriers to access were low overall (2.22 [0.53]). Beliefs regarding the use of MBSR for treatment of chronic pain were positive in general (3.67 [0.71]), but more negative regarding community pharmacy-delivered MBSR (2.38 [0.56]). Confidence in seeking out MBSR (β = 0.297, 95% CI = 0.219 to 0.375; p < 0.001) and current opioid use (β = 0.419, 95% CI = 0.147 to 0.690; p = 0.003) were positively associated with beliefs regarding pharmacy-delivered MBSR, while annual household income (β = -0.124, 95% CI = -0.244 to -0.004; p = 0.043) and level of bodily pain (β = -0.149, 95% CI = -0.291 to -0.008; p = 0.039) exerted statistically significant negative influences. Respondents preferred a hybrid MBSR class format including both online and in-person components (29.7%) as well as both group and individual session options (43.7%). In conclusion, further education is necessary to increase the public's perception of community pharmacies as a resource for complementary and integrative health.

Perceived Role, Identity and Experiences of Pharmacists and the Potential Impact on COVID-19 Vaccine Uptake per Louisiana Region: A Prospective Cohort Study

Some of the lowest COVID-19 community vaccination rates in America are found in Louisiana. This study investigated: (1) barriers that Louisiana pharmacists encountered during the pandemic; and (2) the effect of pharmacists' role and identity confidence on willingness to enforce vaccine mandates, and COVID-19 vaccine uptake. Fifty-four community pharmacists from nine regions of Louisiana participated in the study. Pharmacists completed questionnaires about: personal demographics, patient population, vaccination encouragement, COVID-19 concerns, and vaccination administration rates. The importance of feeling like a trusted voice in the community, as well as professional perception and self-assurance, were measured using Likert scale questions. During focus groups, participants discussed experiences with the COVID-19 vaccination rollout and vaccination-related obstacles. As the pandemic progressed, pharmacists reported being overworked, understaffed, and overburdened with new responsibilities. In regions with lower vaccination rates, pharmacists were less likely to feel at ease enforcing vaccine mandates. Independent pharmacists were less comfortable enforcing vaccine mandates than chain pharmacists but had more positive perceptions of their role and identity. This study contributes to further understanding of pharmacy workflow obstacles and pharmacists' perceptions of their professional roles and identities in the community.

Barriers to Medication Review Process Implementation—Cross-Sectional Study among Community Pharmacists in Jordan

The medication review process (MRP) is an extended, vital role of community pharmacists in improving health outcomes of medication use, yet it is neither systematically nor comprehensively provided bycommunity pharmacies in Jordan. This study aimed to identify the potential barriers hinderingMRP implementation bycommunity pharmacists in Jordan. A total of 550 community pharmacists electronically received a previously constructed and validated Arabic questionnaire explicitly developed to assess the current medication review practices and factors hindering the MRP, of whom 417 answered the questionnaire, giving a response rate of 75.8%. Among the investigated six categories’ seventeen barriers tothe implementation of the MRP, the highest rating was found for remuneration barriers (55.8%), followed by barriers related to regulations and patients, which scored 52.3% and 48.8%, respectively. Resource-related barriers were recognizedby 44.6% of participants, while qualifications and barriers related to physicians scored 42.9% and 41.8%, respectively. Although community pharmacists in Jordan are eager to extend their roles from traditional to more patient-centered ones, they encounter various barriers hinderingsuch development. Regulation adjustments accompanied by cost-effective remuneration and proper training are strong facilitators for community pharmacists to initiate the medication review service; make available the needed resources; and invest efforts, time, and money to operate it.

An exploration of barriers, facilitators, and practical solutions for adopting medication synchronization into community pharmacies: A qualitative analysis

Background

Community pharmacies across the nation have adopted medication synchronization (Med Sync) services with the aim of improving medication adherence. To help incorporate Med Sync into a pharmacy's workflow, pharmacy associations and organizations developed implementation guides for community pharmacies. However, considerable variability in the adoption of this service exists as pharmacies struggle to implement Med Sync into traditional workflow. Researchers identified early adopters of Med Sync who dispense majority of their prescriptions as part of a Med Sync program. An exploratory study was undertaken with the aim to reveal themes surrounding facilitators and barriers to adoption of Med Sync in community pharmacies.

Objectives

The objective of this study was to explore the barriers and facilitators associated with Med Sync adoption in community pharmacies and generate practical solutions for service adoption. Methods Community pharmacies participating in the North Carolina's Community Pharmacy Enhanced Services Network (CPESNsm) who were early adopters of Med Sync and had greater than 50% of their prescription volume being dispensed as part of a Med Sync program were recruited to participate in semi-structured interviews. Interviews were conducted, recorded, and transcribed verbatim with representatives who led the adoption of Med Sync in their pharmacy. Inductive coding and summary analysis were used to analyze the interview data and determine themes associated with facilitators and barriers.

Results

Analysis of the interviews revealed four key themes: program organization, staff engagement, patient engagement, and provider engagements for Med Sync adoption. Each of these themes had several sub-themes, contributing to facilitators and barriers to Med Sync adoption. Subthemes of program organization included having organizational infrastructure, including a pharmacy software system, a dedicated area, and a consistent enrollment process. Subthemes of staff engagement included having a team-based approach, job training, and staff incentives. Patient engagement's subthemes included communication, finances, health literacy, and transportation. Provider engagement resulted with subthemes including lack of communication and provider-pharmacist relationships.

Conclusion

To ensure successful adoption of Med Sync into traditional workflow, community pharmacies should employ a multi-factorial approach that includes internal and external components to the community pharmacy. This study identified facilitators associated with successful Med Sync adoption such as adequate staff engagement and requisite program organization. Barriers hindering successful Med Sync adoption resulted from challenges with provider and patient engagement. This study also makes an important contribution by providing practical solutions to Med Sync adoption based on participant responses and identified themes and sub-themes.

Screening for social determinants of health in community pharmacy: Identifying best practices, barriers, and strategies for success

The social determinants of health (SDOH) play a key role in patients' access to health care and medications. There exists an area of opportunity to leverage community pharmacists to make a large impact in identifying and incorporating an understanding of a patient's SDOH into their treatment plan. Community pharmacies are accessible and trusted avenues for health care interventions. With the advancement of appointment-based models as well as the increased training of support personnel, community pharmacies may be well suited for this public health task. However, there are major challenges such as paradigm shifts in workflow, reimbursement, and training that must be addressed to make this endeavor successful. This commentary explores the sparse literature related to community pharmacists conducting screening for social risk factors to identify best practices and barriers to implementation and outlines how screening for social needs aligns with the Pharmacists' Patient Care Process.

Facilitating pneumococcal vaccination among high-risk adults: Impact of an assertive communication training program for community pharmacists

BACKGROUND

Community pharmacies are vital access points to provide a range of vaccines to adults, including pneumococcal vaccines; however, despite a growth in the number of vaccines given at these sites, the most recent rates of adults being immunized against pneumococcal disease remain below the goals set by Health People 2020. Low patient awareness is a leading reason for suboptimal vaccination rates, suggesting that a need exists to improve provider communication in recommending pneumococcal vaccination in high-risk adults.

OBJECTIVES

To evaluate the impact of a communication training program to improve pharmacist promotion of the pneumococcal vaccine among high-risk adults in Tennessee.

METHODS

A multiphase training program was initiated in partnership with 2 regions of a nationwide community pharmacy chain (n = 100) focusing on improving evidence-based, presumptive recommendations related to pneumococcal vaccination. All locations were randomized to one of 3 arms on the basis of training intensity: (1) no training; (2) online training only; and (3) online and in-person simulation training. The program focused on improving evidence-based, pharmacist vaccine recommendations using health behavior theories, sales techniques, and improvisation provided through online and in-person simulation training. Changes in vaccinations (compared with the same 6-month period in the previous year) and provider self-efficacy were evaluated by Mann-Whitney U tests, chi-square tests, and general linear models.

RESULTS

Completing the full training program led to nominal changes in pharmacist self-efficacy across the 6 items measured (P > 0.05). Overall counts of all pneumococcal vaccines were lower (-11.3%) across all stores in the period after training; however, a small increase (2.1%) was observed in the stores that underwent the full training, versus changes of -22.0% (P = 0.084) and -9.4% (P = 0.199) in control and online-only training comparisons, respectively.

CONCLUSIONS

Pharmacists' vaccine-related self-efficacy may be improved through an evidence-based communication training program, but a more holistic focus on all recommended adult vaccines may be necessary to realize meaningful improvements.