Feedback for Learning in Pharmacy Education: A Scoping Review

Considerations for conducting a scoping review in pharmacy education

Interrogating the literature is among the first steps a researcher undertakes when actuating a research project or also when any scholar might seek to know what has been done in an area, best practices for conducting a certain activity, or simply to seek answers for a question ranging from one's own personal curiosity to those that might affect departmental or institutional guidance. Decisions on the type of review process to undertake is one that is not taken lightly. This methods commentary outlines the reasons for conducting a scoping review versus a systematic review for topics related to pharmacy education. Considerations for conducting the scoping review are outlined including considerations for writing a protocol prior to conducting a scoping review, to potential platforms to use for transparency of sharing data, processes related to guidelines for data extraction and types of search strategies utilized.

Evaluating the Strengths and Barriers of Competency-Based Education in the Health Professions

OBJECTIVE

This study aimed to define competency-based education (CBE) for pharmacy education and describe how strengths and barriers of CBE can support or hinder implementation.

FINDINGS

Sixty-five studies were included from a variety of health professions in order to define competency based pharmacy education (CBPE) and identify barriers and benefits from the learner, faculty, institution, and society perspectives. From the 7 identified thematic categories, a CBPE definition was developed: "Competency-based pharmacy education is an outcomes-based curricular model of an organized framework of competencies (knowledge, skills, attitudes) for pharmacists to meet health care and societal needs. This learner-centered curricular model aligns authentic teaching and learning strategies and assessment (emphasizing workplace assessment and quality feedback) while deemphasizing time."

SUMMARY

This article provides a definition of CBE for its application within pharmacy education. The strengths and barriers for CBE were elucidated from other health professions' education literature. Identified implementation strengths and barriers aid in the discussions on what will support or hinder the implementation of CBE in pharmacy education.

Exploring Feedback Mechanics during Experiential Learning in Pharmacy Education: A Scoping Review

(1) Background: This scoping review aims to explore the literature on feedback for pharmacy students during experiential learning, with a focus on identifying the modes of delivery of feedback and the perceived impact of feedback on student learning outcomes. (2) Methods: The scoping review was conducted in accordance with the Joanna Briggs Institute (JBI) methodology and reported following the Preferred Reporting Items for Systematic Reviews Extension for Scoping Reviews (PRISMA-ScR) guidelines. PubMed, Web of Science, Embase, EBSCO, ERIC, and ProQuest Central were searched electronically from their inception until the end of February 2023 using a combination of keywords and MeSH terms related to feedback, pharmacy education, and student learning outcomes. Data were synthesized narratively. (3) Results: This review included 13 studies published between 2008 and 2022. Almost half of the included studies were conducted in the USA (n = 6, 46%) and reported the perspective of undergraduate pharmacy students (n = 6, 46%). Verbal feedback was the most common mode of feedback delivery (n = 6, 46%). The enablers of effective feedback included timely feedback (n = 6, 46%), feedback provided in a goal-oriented and objective manner (n = 5, 40%), and student-specific feedback (n = 4, 30%). On the other hand, the most common impediments to feedback efficacy were providing extremely positive feedback and lack of constructive criticism. (4) Conclusions: Our findings highlight the importance of feedback model implementation in pharmacy education and preceptor training programs to ensure effective and quality feedback to pharmacy students.

Student Pharmacists Provide Similar Quality Clinical Reasoning Feedback as Resident Teaching Assistants

OBJECTIVE

Pharmacists utilize clinical reasoning (CR) to improve patient outcomes via medication optimization. It is critical to develop these skills in student pharmacists, yet optimal pedagogies to teach and assess CR are unknown. Peer feedback may be used to develop CR in student pharmacists, but a certain feedback quality must be reached to be effective. This study sought to evaluate if student pharmacists could provide similar quality peer feedback compared to pharmacy resident teaching assistant (TA) feedback.

METHODS

This was a retrospective, mixed-methods pedagogical analysis comparing the quality of first-year student pharmacist peer feedback to resident TA CR feedback. The CR comments were defined using the intellectual standards of CR. Quality was assessed for task specification, gap identification, actionability, and process orientation by 2 independent investigators. Student performance and perceptions were also assessed. Mann-Whitney U, t tests, and descriptive statistics were used to analyze data where appropriate.

RESULTS

Clinical reasoning feedback from peers (N = 805) and TAs (N = 206) were analyzed. Interrater reliability for feedback quality was moderate to substantial. Overall, peer CR feedback was of higher quality regarding task specification and process orientation while TA CR feedback was of higher quality regarding gap identification and actionability. Students receiving peer feedback performed better on a final patient case than those receiving TA feedback (95.2% vs 92.3%). Overall, the peer feedback process was well received by students.

CONCLUSION

Student pharmacists can provide similar quality feedback as resident TAs. Peer feedback offers an alternative to resident TA feedback and has the potential to contribute to improved CR skills.

Examining Competency-Based Education Through the Lens of Implementation Science: A Scoping Review

OBJECTIVES

This study aimed to identify evidence for the implementation and assessment of competency-based education (CBE) in health professions curricula using an implementation science framework.

FINDINGS

Using the PRISMA framework, a systematic review of the literature applying a prespecified and piloted search strategy from 2017 to the present in PubMed and CINAHL was performed. References identified from the search strategy were imported into Covidence for title and abstract screening and full-text review by 2 researchers. A third researcher resolved discrepancies. Data were extracted and synthesized to identify key elements from the article related to implementation science, with a quality appraisal. A total of 25 studies out of 304 initially identified records were included. The studies covered a broad range of health professions and countries. Key findings were limited use of implementation science elements, including variability in CBE implementation, limited fidelity assessment, and partial examination of the process continuum. Programs with a more robust implementation approach have a team-based strategy to lead, implement, and support CBE. Motivation and training of faculty are also key components of successful CBE implementation.

SUMMARY

Competency-based education is implemented differently across institutions, with variation among programs in their choice of elements of implementation science used. Further research is needed to examine CBE from an implementation science perspective and address remaining questions.

Less Points, Less Stress, Better Learning in a Skills Laboratory Course Using Alternative Grading

OBJECTIVE

The objective of this study was to evaluate the impact of alternative grading strategies on students' knowledge and confidence in a redesigned pharmacy skills laboratory course.

METHODS

Alternative grading strategies including revise-and-resubmit assignments, purposeful peer and instructor feedback, and self-reflection were used to partially replace traditional grading strategies. Pre-post knowledge and confidence surveys were administered to 3 consecutive cohorts of students. Cohort 1 (N = 65) was exposed to traditional assessment strategies and was used as the control arm. Cohorts 2 (N = 59) and 3 (N = 51) were exposed to alternative grading strategies and were used as the intervention arms. Cohort 3 completed an additional postsurvey to evaluate students' perceptions of alternative grading strategies.

RESULTS

Students enrolled in a pharmacy skills laboratory course at a single institution demonstrated increased pre-to-post knowledge and confidence when assessed using both traditional and alternative grading strategies. Students in the alternative grading cohort entered the course with statistically significant lower levels of knowledge of institutional pharmacy-related topics but exited the course with higher levels of knowledge of institutional pharmacy-related topics as compared to the traditionally graded cohort.

CONCLUSION

Findings from the evaluation of a two-year course redesign indicated that transitioning from a traditional to an alternative grading strategy resulted in similar or higher learning outputs and a significant increase in students' confidence in institutional pharmacy practice skills and abilities.

Analysis of Expert Feedback to Determine Intellectual Standards for Student Pharmacist Clinical Reasoning Development

Objectives. Clinical reasoning (CR) is one of the most important skills for pharmacy learners. Feedback has been proposed as a pedagogy to improve CR skills; however, essential components of CR have yet to be determined within pharmacy education. This study sought to streamline feedback to align with the Pharmacists' Patient Care Process (PPCP).Methods. The investigators used deidentified clinical reasoning "Keep," "Start," or "Stop" (KSS) feedback comments from student-written CR "think-aloud" sessions with pharmacy students in their third professional year. Sections were mapped to the PPCP and were coded by 2 independent investigators according to proposed essential components of CR, using an adapted grounded-theory approach. Investigators could inductively add codes after conferring with the other. Coded feedback was analyzed using a summative content approach. Intercoder reliability was calculated via Holsti index.Results. Five essential components of CR were identified after analysis of 635 KSS comments. The 5 essential components of CR were coded 1178 times. "Accurate," "Concise," "Specific," and "Thorough" were identified a priori, while "Connected" was discovered during feedback comment review. Literature analysis added supporting data to these results through the Paul-Elder Critical Thinking Framework. To maintain consistency in language, these essential components will be referred to as "intellectual standards" moving forward.Conclusion. This novel study successfully identified 5 key intellectual standards of CR. These intellectual standards provide a framework for pharmacy educators to focus feedback to improve student CR. Future research of other intellectual standards pertinent to experiential education is imperative.

A Scoping Review of the Hidden Curriculum in Pharmacy Education

Objective. The hidden curriculum has been defined as teaching and learning that occur outside the formal curriculum and includes the knowledge, skills, attitudes, behaviors, values, and beliefs that students consciously or subconsciously acquire and accept. It has been identified as an inherent part of learning in health professions education and may affect students' formation of professional identity. This scoping review investigated the definition and evidence of the hidden curriculum for pharmacy education.Findings. A comprehensive literature search was conducted for primary articles investigating the hidden curriculum in pharmacy education through August 2021. A total of five papers were included in the review: four papers from the United Kingdom and one from Sweden. The focus of each paper and the elements of the hidden curriculum, along with the study quality as assessed by the quality assessment tool, varied. Three papers focused on professionalism or professional socialization, and the other two focused on patient safety. All five studies used qualitative methods including focus groups and semistructured interviews of the students and faculty. Studies also identified approaches to addressing the hidden curriculum, such as integrating formal and informal learning activities, integrating work experiences, providing sustained exposure to pharmacy practice, and development of professionalism.Summary. The definition of the hidden curriculum varied across the five studies of varying quality. The evidence of the hidden curriculum was measured qualitatively in experiential and academic settings. Recognition of the impact of the hidden curriculum and strategies for addressing its negative effects are critical to the success of not only the students but also the pharmacy profession at large.

The impact of assessment and feedback practice on the student learning experiences in higher education

Sound knowledge of the learning process and connectedness of assessment in higher education is imperative. Assessment is essential for both learners and teachers to ensure, and to provide evidence, that learning outcomes/objectives against set competency levels have been achieved for the chosen programme of the study. However, many coming into higher education are often unaware of the rules of the game. In this perspective, we will highlight the reasons why assessment is important, how assessment and feedback affect students' learning process and why the process of assessment can often affect students' mental well-being. We will appraise the different methods of assessment with a specific example (Objective Structured Clinical Examination, OSCE) and highlight why it is important that we adopt a holistic approach towards fostering assessment know-how and student well-being.