"It's like rotations, but in the classroom": Creation of an innovative course to prepare students for advanced pharmacy practice experiences

A scoping review of advanced pharmacy practice experience readiness assessment measures across schools of pharmacy

BACKGROUND

The development and implementation of Advanced Pharmacy Practice Experience (APPE) readiness assessments has been an area of increased interest to the academy since the publication of the Accreditation Council for Pharmacy Education (ACPE) standards in 2016. This scoping literature review aims to provide an updated summary of current APPE readiness assessment practices among ACPE-accredited institutions in the United States (US).

METHODS

A literature search was conducted between 2022 and 2024 using the terms "APPE student readiness," "APPE readiness assessment," "APPE preparedness," "APPE student preparedness," "pharmacy" AND "readiness assessment", "pharmacy" AND "practice readiness," and "pharmacy" AND "student practice readiness" in Pubmed and Embase. The websites for the American Journal of Pharmaceutical Education and Currents in Pharmacy Teaching and Learning were also searched using these terms. Abstracts for all results were reviewed. Abstract only and poster presentations were excluded, as well as articles centered on non-US and/or non-ACPE-accredited institutions. Data was collected regarding the outcomes assessed, type of assessment activity, and how the assessment was implemented. Results were reviewed by a second author to ensure consistency in reporting.

RESULTS

A total of 289 unique abstracts were reviewed by author pairs for inclusion based on relevance to the review objectives. A total of 13 articles were included in the final analysis. Each institution measured different knowledge areas, abilities, and entrustable professional activities (EPAs). Most programs had a summative component, with APPE readiness being primarily assessed in the final didactic year of the pharmacy curriculum. Most programs report at least one source of validity.

IMPLICATIONS

Given the lack of specific APPE readiness assessment requirements in the ACPE Standards 2016, the different assessment methods among programs were not surprising. However, the commonalities identified can be leveraged with the release of the Curricular Outcomes and Entrustable Professional Activities (COEPA) 2022 to promote a standardized definition of APPE readiness. Future research should focus on formative assessment methods embedded throughout the didactic curriculum to identify "at-risk" students prior to a "high-stakes" summative assessment at the end of the didactic curriculum that impedes student progression to the APPE year.

Mapping Course Assessments to Canadian Pharmacy Educational Outcomes to Ensure Pharmacy Students' Practice Readiness

Objective. The entry-to-practice PharmD degree is designed to meet the Educational Outcomes of the Association of Faculties of Pharmacy of Canada (AFPC). We set out to evaluate how assessment strategies in a "capstone" course align with AFPC educational outcomes, their respective key and enabling competencies, and whether enough assessments exist for students to demonstrate achievement of competencies prior to embarking on advanced pharmacy practice experiences.Methods. We mapped each assessment's objectives, content, and methods to the key and enabling competencies of each role of a pharmacist. The number of enabling competencies mapped represents the extent to which the assessment addressed the associated key competency and broader role. Deidentified student performance data were analyzed to identify achievement of competencies despite failed assessments.Results. Of the seven role descriptions, the roles care provider, communicator, and collaborator were the most comprehensively assessed. The roles leader-manager and health advocate were assessed to a limited extent. The role scholar was not covered to a great depth across assessments. The role professional was not represented in most assessments except for the final examination. Students with failed assessments generally had ample opportunity to demonstrate competencies through other assessments.Conclusion. Mapping assessments to AFPC educational outcomes is an essential step to demonstrate direct evidence that students have achieved the intended learning outcomes. Our map revealed that the assessments sufficiently overlapped with most AFPC educational outcomes with a few exceptions. It is important to create multiple opportunities within a course for students to demonstrate achievement of competencies to ensure practice readiness.

Activities to enhance introductory pharmacy practice experiences

INTRODUCTION

The goal of this initiative was to provide a meaningful introductory pharmacy practice experience (IPPE) to third-year students when opportunities for direct patient interaction are limited.

METHODS

A single, pretest/posttest quasi-experiment was used to evaluate the impact of a structured pharmacy-based education series (intervention 1) and an interprofessional simulation (intervention 2) during combined internal medicine (IM) and infectious diseases (ID) IPPEs. Intervention 1 consisted of five, three-part pharmacy-based educational sessions, while intervention 2 consisted of an interprofessional simulated rounding experience. Pre- and post-rotation examinations were given to evaluate the impact of the interventions on student knowledge. Confidence was measured in 11 or 12-question pre- and post-surveys using a four-point Likert scale: strongly disagree, disagree, agree, strongly agree.

RESULTS

Thirty-six students (30 in intervention 1 and six in intervention 2) were included. In intervention 1, there was a 19% improvement in IM knowledge (45% vs. 64%) and 10% improvement in ID knowledge (40% vs. 50%). In intervention 2, there was a significant improvement in both IM (30% vs. 40%) and ID (50% vs. 65%) and knowledge questions (10% and 15% improvements, respectively). In both interventions, most students reported increased confidence.

CONCLUSIONS

Knowledge and confidence improved in both intervention groups, demonstrating that there are ways to enhance IPPEs without direct patient interaction.

The Impact of an Early Clinical Experience on Pharmacy Student Learning About Ambulatory Care Practice

Objective. To determine whether student confidence in their knowledge of ambulatory care pharmacy and ability to contribute to patient care in this setting increased after participating in an ambulatory care introductory pharmacy practice experience (IPPE), and whether it changed student interest in pursuing a career in ambulatory care pharmacy.Methods. Second-year pharmacy students (n=86) completed a required ambulatory care experience which included four hours of didactic work and 13.5 hours of clinic experience with an ambulatory care pharmacist. Before and after the experience, students completed an eight-question survey in which they rated their confidence in their knowledge of ambulatory care practice and in providing patient care in this setting, as well as their interest in a career in ambulatory care. A five-point Likert scale was used to assess student confidence (1=not at all confident, 5=very confident) and interest in ambulatory care (1=not at all interested, 5=extremely interested). The Wilcoxon signed rank test was used to compare pre-post survey responses.Results. Eighty-five pharmacy students completed both the pre- and post-survey. Median scores on the post-intervention test increased from 3 to 4 in seven of the domains assessed. Student interest in a career in ambulatory care remained unchanged.Conclusion. An ambulatory care IPPE increased student confidence in their understanding of ambulatory care pharmacy practice and caring for patients in this setting.

Connecting a simulated virtual patient program with experiential practicums: Perspectives from year three students

BACKGROUND AND PURPOSE

Research indicates that the simulated learning tools known as virtual patients (VPs) are valued by pharmacy students and impact students' knowledge and confidence. However, research is needed to understand how students can be supported to make intended connections between VP cases and real-life clinical scenarios. The purpose of this study was to examine whether and how VP cases influence students' clinical reasoning skills, confidence, thought processes, and preparedness for their experiential practicums.

EDUCATIONAL ACTIVITY AND SETTING

Third-year entry-to-practice doctor of pharmacy students who had completed at least one VP case in second year prior to their experiential practicums were surveyed in fall 2018 after having completed their experiential practicums. Surveys were structured to solicit student perceptions related to how students bridged VP cases and real-life clinical scenarios and were analyzed using a mixed-methods design.

FINDINGS

Forty-three students completed the survey. Students perceived that VP cases most significantly impacted their clinical reasoning skills due to the opportunity cases afforded them to explore patient data and navigate relevant information. The largest limitation of VP cases to students' learning was that the cases differed from their experiences. Students' suggestions included opportunities for more practice using VP cases and an expanded repertoire of medical conditions offered through case exposure.

SUMMARY

More research is needed to understand how to help students connect VP cases to their experiential practicums to make them more effective learning tools.

Implementation of general medicine topics for acute care inpatient advanced pharmacy practice experiences

INTRODUCTION

The purpose of this study was to describe the development of a general medicine student workbook to standardize acute care inpatient fourth-year pharmacy rotations among faculty with varied pharmacy practice sites.

METHODS

Four faculty designed an advanced pharmacy practice experience (APPE) student workbook on general medicine topics consisting of short answer and multiple-choice questions to ensure standardization by exposing all students to the same topics. A pre- and posttest was administered on the first and last day of the five-week rotation block to evaluate the effects of the APPE workbook on student understanding of general medicine topics. A paired t-test was used to evaluate the significance of the difference in test scores.

RESULTS

The average of the posttest exam was found to be significantly higher after the completion of the student workbook. The average grade on the pre-rotation 30-item exam was 22.8 (76.73%) and the post-rotation 30-item exam was 25.7 (86.26%), with a difference of 9.53% (P < .001, 95% CI = 7.11 to 11.96).

CONCLUSIONS

Creating a standardized student workbook for an inpatient acute care rotation was a valuable addition. All students assigned to the faculty involved were exposed to the same topics despite variability in preceptors and practice sites. Overall the verbal feedback from the students was positive about the student workbook and discussions, especially since the information was applicable to their patients on rotation. Faculty will continue to use this workbook as a tool to teach various inpatient general medicine topics during the acute care APPE.

Development of coupled patient care experience courses to enhance patient care skills in the ambulatory and acute care settings

BACKGROUND AND PURPOSE

Providing opportunities to allow pharmacy students to apply clinical skills is essential to ensure that they are comfortable and competent to perform these skills during advanced pharmacy practice experiences (APPEs) and in practice. We describe unique coupled courses that require students to apply clinical skills during real patient encounters and simulation activities in the ambulatory and acute care setting to ensure that they are ready for APPEs.

EDUCATIONAL ACTIVITY AND SETTING

New required courses were developed at West Virginia University School of Pharmacy that focused on teaching and reinforcing patient care skills in the ambulatory and acute care settings. Both courses were designed to provide students with multiple opportunities to offer supervised patient care and to become more comfortable and confident in their patient care skills.

FINDINGS

The coupled courses were well-received by students. Feedback indicated that students felt more comfortable in these patient care settings and in performing patient care activities as a result of these courses.

SUMMARY

These coupled courses offered multiple opportunities for students to practice patient care skills and gain valuable experience participating in activities that increased their confidence and competence at being integral members of the healthcare team. The interactions with real patients, simulated patient scenarios, standardized patients, and other members of the healthcare team helped students advance communication skills, clinical skills, and ability to identify and resolve medication-related problems in preparation for APPEs.

Curriculum integration of virtual patients

BACKGROUND AND PURPOSE

Virtual patients (VP) offer an enhanced learning experience for students to assume the role of health professional and make therapeutic decisions in a simulated environment. While VPs are valued by students and offer benefits to the learner, little is known about how best to implement them in pharmacy education curricula. The purpose of our study was to investigate students' perceptions of VPs and build understanding about how to optimally implement them in the future.

EDUCATIONAL ACTIVITY AND SETTING

Four VP cases were implemented over the first three years of the entry to practice doctor of pharmacy program. Each case was focused on a different condition and implemented in one of three settings (i.e. integration activities, large lecture setting, or independent review). Students were invited to complete a survey and participate in a focus group after completing the patient case.

FINDINGS

One-hundred eighty students completed the survey and six students participated in a focus group. Ninety-four percent of respondents strongly agreed/agreed that VPs were valuable for their learning. Students preferred the VP cases be implemented in small-group settings and be relevantly timed with course material. Students found helpful that cases were realistic, clear, comprehensive, engaging, and incorporated feedback. Perceived benefits included enhanced learning about medical conditions, development of clinical reasoning skills and processes for working through cases.

SUMMARY

VPs continue to be identified as a valuable learning experience. When implemented it is important to consider the learner setting in order to get the greatest value from their use.

Closing the Classroom Theory to Practice Gap by Simulating a Psychiatric Pharmacy Practice Experience

Objective. To examine the feasibility and effectiveness of combining whole-task and guided reflection educational design principles with cloud-based learning technologies to simulate the clinical psychiatric advanced pharmacy practice experience (APPE) in the classroom to begin to close the theory to practice gap. Methods. Components of the typical student experience while completing an APPE were integrated into the course experience, ie, patient case work-ups, facilitated sessions with a preceptor, personal statement of goals and progress with feedback, and intentional interaction with peer-learners. Multiple sources of quantitative and qualitative data were collected and analyzed. Results. Twelve third-year pharmacy students from two campuses participated in and successfully completed this one-credit elective advanced psychiatric pharmacotherapy course. Eleven board-certified psychiatric pharmacists (BCPP) served as visiting experts, some participating for multiple weeks, and provided preceptor-like feedback to the case presentations in spring 2017. All BCPP pharmacists plus an additional geriatric pharmacist specialist participated in the course in spring 2018. Results of the quantitative and qualitative analyses demonstrated that students progressed in their readiness for APPEs and gained additional psychiatric pharmacy knowledge and evidence-based medicine decision making skills. Conclusion. Pharmacy programs are challenged to find additional ways to improve student readiness for APPEs and expand psychiatric learning opportunities to meet the increasing mental health needs across clinical settings. This example provides a feasible and effective strategy to do both without the requirement to create extensive new learning materials or add significant faculty workload.

Scoping Pharmacy Students' Learning Outcomes: Where Do We Stand?

Background: The professional abilities of graduate pharmacists have been associated with pharmacy undergraduates’ educational settings and features. This study aimed to perform a scoping review on how students’ learning outcomes are achieved, including learning assessment strategies, focusing on current pharmacy practice education. Methods: Relevant keywords, e.g., “pharmacy practice”, “(students or undergraduates)” and “outcomes” were browsed in Public/Publisher MEDLINE, Scientific Electronic Library Online, Directory of Open Access Journals, and other relevant databases for recently published sources (2018 and 2017). Preferred Reporting Items for Systematic Reviews and Meta-Analyses criteria were followed to assure the scoping quality. All types of students’ learning outcomes were addressed for indexed publications in English, Portuguese or Spanish. Reviews, descriptive studies and commentaries were excluded. Study data are presented in tables comprising objectives, methods, number of participants and main research findings. Results: Overall, 100 studies were identified and 22 were selected. The selected studies were distributed into seven main topics: real practices (n = 9); active-learning strategies (n = 5); comparisons between different teaching pedagogies (n = 3); pharmacy curriculum (n = 2); and other evaluations (n = 3). Conclusions: Studies on pharmacy students’ learning outcomes are limited. Pharmacy undergraduates’ performance was dependent on the learning strategies and extension of syllabus implementation.