1
|
Sobieraj DM, Chen AMH, Kelsch MP, Lebovitz L, Spinler SA. A Description of Required NAPLEX Preparation Courses Among US Pharmacy Programs. Am J Pharm Educ 2024; 88:100655. [PMID: 38237686 DOI: 10.1016/j.ajpe.2024.100655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 12/19/2023] [Accepted: 01/10/2024] [Indexed: 02/09/2024]
Abstract
OBJECTIVE One of the final tasks for pharmacy graduates to enter practice is passing the North American Pharmacist Licensure Examination (NAPLEX). Given the recent national declines in pass rates, programs are making significant investments of time and money in NAPLEX preparation. The objective is to characterize the structure and content of required NAPLEX preparation courses. METHODS A survey on NAPLEX preparation practices was developed and distributed to all Accreditation Council for Pharmacy Education-accredited pharmacy schools. NAPLEX preparation course syllabi were also collected as part of this survey. Syllabus information was summarized into 4 elements: course structure, content, resources, and assessment strategies. RESULTS Of 144 colleges/schools of pharmacy, 100 responded to the survey, 87 reported having a NAPLEX preparation program, and 47 reported having a NAPLEX preparation course. Twenty syllabi were collected. Most courses (14) were longitudinal through the Advanced Pharmacy Practice Experiences year, 16 were credit-bearing, and 19 included a vendor NAPLEX preparatory product. Fourteen courses were hybrid delivery, and 12 focused on licensure preparation and included test-taking strategies, calculations practice, case-based discussions, etc. All 20 courses reported using unproctored timed quizzes and practice examinations, half conducted proctored timed assessments, and 11 included written reflections and/or continuous professional development activities. Most courses were pass/fail (15), and high stakes (16) were defined by delayed or withheld graduation as a consequence for failure. Only 3 of 20 NAPLEX preparation courses were mapped to NAPLEX competencies. CONCLUSION Although required NAPLEX preparation courses focus on assessments, the content is infrequently mapped to NAPLEX competencies. This project provides some information on how schools might create their own NAPLEX preparatory courses.
Collapse
Affiliation(s)
- Diana M Sobieraj
- Department of Pharmacy Practice, University of Connecticut School of Pharmacy, Storrs, CT, USA
| | - Aleda M H Chen
- Department of Pharmacy Practice, Cedarville University School of Pharmacy, Cedarville, OH, USA
| | - Michael P Kelsch
- Department of Pharmacy Practice, North Dakota State University School of Pharmacy, Fargo, ND, USA
| | - Lisa Lebovitz
- Office of the Dean, University of Maryland School of Pharmacy, Baltimore, MD, USA
| | - Sarah A Spinler
- Department of Pharmacy Practice, Binghamton University School of Pharmacy and Pharmaceutical Sciences, Binghamton, NY, USA.
| |
Collapse
|
2
|
Sato H, Ogasawara K. ChatGPT (GPT-4) passed the Japanese National License Examination for Pharmacists in 2022, answering all items including those with diagrams: a descriptive study. J Educ Eval Health Prof 2024; 21:4. [PMID: 38413129 PMCID: PMC10948916 DOI: 10.3352/jeehp.2024.21.4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Accepted: 02/28/2024] [Indexed: 02/29/2024]
Abstract
PURPOSE The objective of this study was to assess the performance of ChatGPT (GPT-4) on all items, including those with diagrams, in the Japanese National License Examination for Pharmacists (JNLEP) and compare it with the previous GPT-3.5 model’s performance. METHODS The 107th JNLEP, conducted in 2022, with 344 items input into the GPT-4 model, was targeted for this study. Separately, 284 items, excluding those with diagrams, were entered into the GPT-3.5 model. The answers were categorized and analyzed to determine accuracy rates based on categories, subjects, and presence or absence of diagrams. The accuracy rates were compared to the main passing criteria (overall accuracy rate ≥62.9%). RESULTS The overall accuracy rate for all items in the 107th JNLEP in GPT-4 was 72.5%, successfully meeting all the passing criteria. For the set of items without diagrams, the accuracy rate was 80.0%, which was significantly higher than that of the GPT-3.5 model (43.5%). The GPT-4 model demonstrated an accuracy rate of 36.1% for items that included diagrams. CONCLUSION Advancements that allow GPT-4 to process images have made it possible for LLMs to answer all items in medical-related license examinations. This study’s findings confirm that ChatGPT (GPT-4) possesses sufficient knowledge to meet the passing criteria.
Collapse
Affiliation(s)
- Hiroyasu Sato
- Department of Pharmacy, Abashiri Kosei General Hospital, Abashiri, Japan
| | - Katsuhiko Ogasawara
- Graduate School of Health Sciences, Hokkaido University, Sapporo, Japan
- Graduate School of Engineering, Muroran Institute of Technology, Muroran, Japan
| |
Collapse
|
3
|
Sobieraj DM, Chen AMH, Kelsch MP, Lebovitz L, Spinler SA, Ray ME. NAPLEX Preparation Program Characteristics and Resources Associated With First-Time Exam Pass Rates. Am J Pharm Educ 2023; 87:100580. [PMID: 37531995 DOI: 10.1016/j.ajpe.2023.100580] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Revised: 07/12/2023] [Accepted: 07/27/2023] [Indexed: 08/04/2023]
Abstract
OBJECTIVE Pharmacy colleges and schools invest substantial faculty effort and financial resources in North America Pharmacist Licensure Exam (NAPLEX) preparation, including vendor products purported to improve NAPLEX pass rates. The objective of this project was to examine NAPLEX preparation program characteristics associated with first-time pass rates. METHODS A national survey investigated which pharmacy schools provided a formal NAPLEX preparation program in the 2021/2022 academic year, and what resources students were required to use. Pharmacy school characteristics and the unique resources provided in NAPLEX preparation programs were separately analyzed for association with 2022 NAPLEX first-time pass rates. RESULTS The survey response rate was 71% (100 pharmacy schools). Of the 6 pharmacy school characteristics analyzed, offering a formal NAPLEX preparation program and private status were both weakly correlated with a decrease in the 2022 NAPLEX pass rate, while founding year of 2000 or earlier was weakly correlated with an increase in the pass rate. In a generalized linear model, a decrease in 2022 NAPLEX pass rate was associated with offering a formal NAPLEX preparation program (-5.90% [-11.55 to -0.23]) and with a 3-year accelerated curriculum (-9.15% [-15.55 to -2.75]). Of 12 resources required in NAPLEX preparation programs, 3 were weakly correlated with a decrease in 2022 pass rate: a vendor question bank, vendor review book/materials, and a live, synchronous faculty-led review. In a generalized linear model, a decrease in 2022 NAPLEX pass rate was associated with a live, synchronous faculty-led review (-6.62% [-11.16 to -2.08]). Among schools without a formal preparation program, NAPLEX pass rates consistently exceeded the national average in 2020, 2021, and 2022, while the proportion of schools with NAPLEX preparation programs and first-time pass rates above the national average dropped from 59% in 2021 and 58% in 2020 to 44% in 2022. CONCLUSION Simply implementing a NAPLEX preparation program is insufficient to overcome other systemic/programmatic influences of successfully passing the NAPLEX; programs should invest earlier resources to address NAPLEX competencies.
Collapse
Affiliation(s)
| | - Aleda M H Chen
- Cedarville University, School of Pharmacy, Cedarville, OH, USA
| | - Michael P Kelsch
- North Dakota State University, School of Pharmacy, Fargo, ND, USA
| | - Lisa Lebovitz
- University of Maryland, School of Pharmacy, Baltimore, MD, USA
| | - Sarah A Spinler
- Binghamton University, School of Pharmacy and Pharmaceutical Sciences, Johnson City, NY, USA
| | - Mary E Ray
- University of Iowa, College of Pharmacy, Iowa City, IA, USA
| |
Collapse
|
4
|
Lebovitz L, Chen AMH, Carey L, Carter JT, Kelsch MP, Ray ME, Spinler SA, Sobieraj DM. A Description of NAPLEX and MPJE Preparation Strategies Among US Colleges and Schools of Pharmacy. Am J Pharm Educ 2023; 87:100067. [PMID: 37316127 DOI: 10.1016/j.ajpe.2023.100067] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 12/05/2022] [Accepted: 12/07/2022] [Indexed: 06/16/2023]
Abstract
OBJECTIVE The purpose of this study was to describe the different strategies used to supplement North American Pharmacist Licensure Examination (NAPLEX) and Multistate Pharmacy Jurisprudence Examination (MPJE) preparation in the US pharmacy programs. METHODS An online survey was developed to gather information from 141 accredited schools/colleges of pharmacy about the preparation methods used during the 2021-22 academic year. The questionnaire contained 19 NAPLEX- and 10 MPJE-specific questions related to timing, content, use of commercial products and programs, faculty involvement, and whether these activities were required or recommended. Characteristics of schools/colleges were compared based on the presence or absence of preparation programs; preparation programs were descriptively reported. RESULTS The response rate was 71%. Most schools (87/100 respondents) provided NAPLEX preparation programs starting in the advanced pharmacy practice experiential year, required students to participate, and focused on reviewing the content instead of assessing students' examination readiness. Similar elements were reported among 61 schools providing MPJE preparation programs. Schools used a variety of resources including access to vendor-based question banks or review materials, and completing live, proctored, NAPLEX-like examinations. Characteristics of schools or colleges did not differ significantly based on presence or absence of a preparation program. CONCLUSION Schools/colleges of pharmacy use a variety of strategies to prepare students for licensing examinations. Many require student participation in vendor-based preparation programs for NAPLEX, and homegrown programs for MPJE preparation. The next step will be to determine the effectiveness of various approaches used by the schools/colleges on first-time licensure examination attempts.
Collapse
Affiliation(s)
- Lisa Lebovitz
- University of Maryland School of Pharmacy, Baltimore, MD, USA
| | - Aleda M H Chen
- Cedarville University School of Pharmacy, Cedarville, OH, USA
| | | | - Jean T Carter
- University of Montana Skaggs School of Pharmacy, Missoula, MT, USA
| | - Michael P Kelsch
- North Dakota State University School of Pharmacy, Fargo, ND, USA
| | - Mary E Ray
- University of Iowa College of Pharmacy, Iowa City IA
| | - Sarah A Spinler
- Binghamton University School of Pharmacy and Pharmaceutical Sciences, Johnson City, New York
| | | |
Collapse
|
5
|
Ni Sheachnasaigh E, Cadogan C, Strawbridge J, Sahm LJ, Ryan C. A scoping review of the methods and processes used by regulatory bodies to determine pharmacists' readiness for practice. Res Social Adm Pharm 2022; 18:4028-4037. [PMID: 35835686 DOI: 10.1016/j.sapharm.2022.06.010] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2022] [Revised: 06/07/2022] [Accepted: 06/24/2022] [Indexed: 10/17/2022]
Abstract
BACKGROUND There is an expectation from government, regulatory bodies, patients, the public, and other healthcare professions that pharmacists are competent professionals who can practice independently. Regulation of the profession requires pharmacy graduates to register with a recognised regulatory body before being considered 'ready to practise' independently. OBJECTIVE To examine the methods and processes used by national regulatory bodies to determine pharmacists' readiness to practise. METHODS A scoping review was conducted using three electronic databases (Embase, Scopus, CINAHL) and websites of national regulatory bodies. Articles were eligible for inclusion if they described the methods and processes used by regulatory bodies to determine pharmacists' readiness to practise. Data were extracted relating to readiness to practise, the registration exam and the role of newly qualified pharmacists, post-registration. Extracted data were collated using narrative descriptive summaries and accompanying tables. RESULTS Identified data sources referred to registration of pharmacists across 11 different countries. No sources provided a definition for the term 'ready to practise'. Ten countries were identified as holding a registration examination with varying formats and curricula. Written and oral exams, competency based written assessments, Objective Structured Clinical Examinations and a combination of these were identified with written exam being the most popular (n = 8). In all but one country, the regulator was responsible for delivery of the exam. In most cases (n = 7), the exam was mapped to a pre-defined set of competencies with only a few (n = 4) explaining how these competencies were developed. Only two sources made reference to the role of the newly qualified pharmacist post-registration. CONCLUSION The review has established a paucity of research and publicly available information on the methods and processes used by national regulators to determine pharmacists' readiness to practise. There is no pharmacy definition of being 'ready to practise'. Assessment methods vary widely and, currently, no gold standard is apparent.
Collapse
Affiliation(s)
| | - Cathal Cadogan
- School of Pharmacy and Pharmaceutical Sciences, Trinity College Dublin, Dublin, Ireland.
| | - Judith Strawbridge
- School of Pharmacy and Biomolecular Sciences, Royal College of Surgeons in Ireland, Dublin, Ireland.
| | - Laura J Sahm
- School of Pharmacy, University College Cork, Cork, Ireland.
| | - Cristin Ryan
- School of Pharmacy and Pharmaceutical Sciences, Trinity College Dublin, Dublin, Ireland.
| |
Collapse
|
6
|
Alhifany AA, Almalki FA, Alatawi YM, Basindowh LA, Almajnoni SS, Elrggal ME, Alotaibi AF, Almarzoky Abuhussain SS, Almangour TA. Association between graduates' factors and success rate on the Saudi Pharmacist Licensure Examination: A single-Institution cross-sectional study. Saudi Pharm J 2021; 28:1830-1833. [PMID: 33424271 PMCID: PMC7783223 DOI: 10.1016/j.jsps.2020.11.009] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2020] [Accepted: 11/19/2020] [Indexed: 11/26/2022] Open
Abstract
Introduction The Saudi Pharmacists Licensure Examination’s (SPLE) initial results were revealed in February 2020, which showed enormous inconsistency with the passing rates. Hence, we aimed to investigate the predictors of pharmacy graduates’ success rate on the SPLE of a single-college in Saudi Arabia. Methods In a cross-sectional study of 2019-graduates, data were collected via-phone interviews and retrieved from the college’s database. Graduates’ data were retrieved from the college’s database, which includes high school grade point average (GPA), General Aptitude Test, Scholastic Achievement Admission Test, preparatory year GPA, pharmacy GPA, and all courses' grades. The data collected via-phone interview includes information that was not recorded in the college’s database, such as date of birth, SPLE score, and the number of SPLE attempts. We only included students who agreed to be interviewed and had attempted the SPLE at least once. We developed a prediction model using correlational analyses and stepwise multiple linear regression to examine graduates’ factors in predicting success on the SPLE. Results Out of the 149 graduates, 105 fulfilled the inclusion criteria. Around 84% of them passed the SPLE. Correlation analyses showed a significant direct correlation between preparatory year GPA and pharmacy GPA with SPLE scores (r = 0.228, P = 0.0193 and r = 0.533, P < 0.0001, respectively). In addition, the results showed that all of the four SPLE content areas were positively correlated with SPLE scores (P < 0.0001). The stepwise multivariable regression showed that being a male graduate and scoring high-grade points in pharmacology and therapeutics courses were significantly associated with high SPLE scores (P = 0.0053, P = 0.0256, and P = 0.0001, respectively). Conclusion This single cross-sectional study found that being a male, pharmacology GPA, and therapeutics GPA were significantly associated with a higher SPLE score. Further studies should focus on the GPA cut off below which we should give remediation to improve SPLE passing rate.
Collapse
Affiliation(s)
- Abdullah A Alhifany
- Department of Clinical Pharmacy, College of Pharmacy, Umm Al-Qura University, Makkah 21955, Saudi Arabia
| | - Faisal A Almalki
- Department of Pharmaceutical Chemistry, College of Pharmacy, Umm Al-Qura University, Makkah 21955, Saudi Arabia
| | - Yasser M Alatawi
- Department of Clinical Pharmacy, College of Pharmacy, Tabuk University, Tabuk, Saudi Arabia
| | - Linah A Basindowh
- College of Pharmacy, Umm Al-Qura University, Makkah 21955, Saudi Arabia
| | | | - Mahmoud E Elrggal
- Department of Clinical Pharmacy, College of Pharmacy, Umm Al-Qura University, Makkah 21955, Saudi Arabia
| | - Amal F Alotaibi
- Department of Clinical Pharmacy, College of Pharmacy, Umm Al-Qura University, Makkah 21955, Saudi Arabia
| | | | - Thamer A Almangour
- Department of Clinical Pharmacy, College of Pharmacy, King Saud University, Riyadh, Saudi Arabia
| |
Collapse
|