1
|
Pillay TS, Jafri L, Punchoo R. Formulation of workplace-based assessments (WBAs) and entrustable professional activities (EPAs) for postgraduate medical trainees in clinical biochemistry. J Clin Pathol 2025; 78:240-250. [PMID: 39667849 DOI: 10.1136/jcp-2024-209796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2024] [Accepted: 10/21/2024] [Indexed: 12/14/2024]
Affiliation(s)
- Tahir S Pillay
- Department of Chemical Pathology, University of Pretoria & National Health Laboratory Service, Pretoria, South Africa
- Division of Chemical Pathology, University of Cape Town, Rondebosch, South Africa
| | - Lena Jafri
- The Aga Khan University, Karachi, Pakistan
| | - Rivak Punchoo
- Division of Chemical Pathology, University of Cape Town Faculty of Health Sciences, Observatory, Western Cape, South Africa
| |
Collapse
|
2
|
Vos S, Hebeda K, Milota M, Sand M, Drogt J, Grünberg K, Jongsma K. Making Pathologists Ready for the New Artificial Intelligence Era: Changes in Required Competencies. Mod Pathol 2025; 38:100657. [PMID: 39542175 DOI: 10.1016/j.modpat.2024.100657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2024] [Revised: 09/11/2024] [Accepted: 11/07/2024] [Indexed: 11/17/2024]
Abstract
In recent years, there has been an increasing interest in developing and using artificial intelligence (AI) models in pathology. Although pathologists generally have a positive attitude toward AI, they report a lack of knowledge and skills regarding how to use it in practice. Furthermore, it remains unclear what skills pathologists would require to use AI adequately and responsibly. However, adequate training of (future) pathologists is essential for successful AI use in pathology. In this paper, we assess which entrustable professional activities (EPAs) and associated competencies pathologists should acquire in order to use AI in their daily practice. We make use of the available academic literature, including literature in radiology, another image-based discipline, which is currently more advanced in terms of AI development and implementation. Although microscopy evaluation and reporting could be transferrable to AI in the future, most of the current pathologist EPAs and competencies will likely remain relevant when using AI techniques and interpreting and communicating results for individual patient cases. In addition, new competencies related to technology evaluation and implementation will likely be necessary, along with knowing one's own strengths and limitations in human-AI interactions. Because current EPAs do not sufficiently address the need to train pathologists in developing expertise related to technology evaluation and implementation, we propose a new EPA to enable pathology training programs to make pathologists fit for the new AI era "using AI in diagnostic pathology practice" and outline its associated competencies.
Collapse
Affiliation(s)
- Shoko Vos
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands.
| | - Konnie Hebeda
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Megan Milota
- Department of Bioethics and Health Humanities, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Martin Sand
- Faculty of Technology, Technical University Delft, Delft, the Netherlands
| | - Jojanneke Drogt
- Department of Bioethics and Health Humanities, University Medical Center Utrecht, Utrecht, the Netherlands
| | - Katrien Grünberg
- Department of Pathology, Radboud University Medical Center, Nijmegen, the Netherlands
| | - Karin Jongsma
- Department of Bioethics and Health Humanities, University Medical Center Utrecht, Utrecht, the Netherlands
| |
Collapse
|
3
|
Jeffus SK, Chen C, Keskin T, Massoll N, Korourian S, Allard F. Entrustable professional activities for cytopathology fellowship. J Am Soc Cytopathol 2025; 14:5-10. [PMID: 39567307 DOI: 10.1016/j.jasc.2024.10.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2024] [Revised: 10/18/2024] [Accepted: 10/19/2024] [Indexed: 11/22/2024]
Abstract
Entrustable professional activities (EPAs) are an educational tool in the framework of competency-based medical education. EPAs are a relatively new concept in pathology. No studies to date exist on the utilization of EPAs during cytopathology fellowship training. This article reviews the recent literature on this topic and shares our institutional experience with the implementation of an EPA for fine needle aspirations and rapid on-site evaluations. While EPAs allow for tracking the competence of the cytopathology fellow toward independent practice for fine needle aspirations and rapid on-site evaluations, the required amount of documentation may represent a potential barrier for the widespread adoption of this new tool.
Collapse
Affiliation(s)
- Susanne K Jeffus
- Division of Cytopathology, Department of Pathology, University of Arkansas for Medical Sciences, Little Rock, Arkansas.
| | - Chien Chen
- Division of Cytopathology, Department of Pathology, University of Arkansas for Medical Sciences, Little Rock, Arkansas
| | - Taha Keskin
- Division of Cytopathology, Department of Pathology, University of Arkansas for Medical Sciences, Little Rock, Arkansas
| | - Nicole Massoll
- Division of Cytopathology, Department of Pathology, University of Arkansas for Medical Sciences, Little Rock, Arkansas
| | - Soheila Korourian
- Division of Cytopathology, Department of Pathology, University of Arkansas for Medical Sciences, Little Rock, Arkansas
| | - Felicia Allard
- Division of Cytopathology, Department of Pathology, University of Arkansas for Medical Sciences, Little Rock, Arkansas
| |
Collapse
|
4
|
Gama A, Felicelli C, Agarwal I, Bronson T, Choy B, Escobar DJ, Ju JY, LaBoy C, Nayar R, Nezami BG, Nguyen J, Obeidin F, Purdy J, Shanes E, Strickland AL, Blanco LZ, Novo JE. Entrustable professional activities (EPAs) in surgical pathology: implementation experience and longitudinal observations of resident development. Acad Pathol 2024; 11:100150. [PMID: 39512707 PMCID: PMC11541477 DOI: 10.1016/j.acpath.2024.100150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2024] [Revised: 08/14/2024] [Accepted: 08/18/2024] [Indexed: 11/15/2024] Open
Abstract
Entrustable professional activities (EPAs) have been implemented in various medical specialties, and the Pathology National EPA Working Group has piloted the implementation of four pathology EPAs. We recently published the development of EPAs within our surgical pathology rotation. Following a six-month pilot, a survey demonstrated that faculty and residents found the forms helpful and easy to use and easy to understand, and EPAs have been fully incorporated into our surgical pathology rotation. Here, we discuss our experience, challenges, and results of resident EPA performance for intraoperative consultations (IOC) and sign-out (SO) after 21 months of implementation. Between June 2022 and March 2024, 24 residents were evaluated by 13 faculty members, resulting in 136 IOC and 298 SO EPA forms. Paper forms were predominantly used, with only five electronic forms submitted. EPA performance scores for SO increased from 2.4 ± 0.8 in Block 1 to 4.6 ± 0.2 in Block 14 (p < 0.0001), whereas performance scores for IOC increased from 2.7 ± 1.0 in Block 1 to 4.8 ± 0.2 in Block 14 (p < 0.0001). The progressive decrease in the standard deviation throughout residency denotes higher competence homogeneity as residency graduation approaches. Overall, our EPA evaluation method showed ease of use, provided valuable tracking tools, and long-term feasibility. EPAs are robust tools for tracking resident progression toward independent practice in surgical pathology, offering valuable insights for program and rotation directors to assess and track individual EPA skills, identify intervention points, and provide an opportunity for immediate, actionable feedback based on current performance.
Collapse
Affiliation(s)
- Alcino Gama
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Christopher Felicelli
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Indu Agarwal
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Taylor Bronson
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Bonnie Choy
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - David J. Escobar
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jennifer Y. Ju
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Carissa LaBoy
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Ritu Nayar
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Behtash G. Nezami
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jessica Nguyen
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Farres Obeidin
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jenna Purdy
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Elisheva Shanes
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Amanda L. Strickland
- Department of Pathology, University of North Carolina School of Medicine, Chapel Hill, NC, USA
| | - Luis Z. Blanco
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jorge E. Novo
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
5
|
Bryant BH, Anderson SR, Brissette M, Childs JM, Gratzinger D, Johnson K, Powell DE, Zein-Eldin Powell S, Timmons CF, McCloskey CB. Leveraging faculty development to support validation of entrustable professional activities assessment tools in anatomic and clinical pathology training. Acad Pathol 2024; 11:100111. [PMID: 38560424 PMCID: PMC10978475 DOI: 10.1016/j.acpath.2024.100111] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 01/26/2024] [Accepted: 02/03/2024] [Indexed: 04/04/2024] Open
Abstract
Entrustable professional activities (EPAs) are observable activities that define the practice of medicine and provide a framework of evaluation that has been incorporated into US medical school curricula in both undergraduate and graduate medical education. This manuscript describes the development of an entrustment scale and formative and summative evaluations for pathology EPAs, outlines a process for faculty development that was employed in a pilot study implementing two Anatomic Pathology and two Clinical Pathology EPAs in volunteer pathology residency programs, and provides initial validation data for the proposed pathology entrustment scales. Prior to implementation, faculty development was necessary to train faculty on the entrustment scale for each given activity. A "train the trainer" model used performance dimension training and frame of reference training to train key faculty at each institution. The session utilized vignettes to practice determination of entrustment ratings and development of feedback for trainees as to strengths and weaknesses in the performance of these activities. Validity of the entrustment scale is discussed using the Messick framework, based on concepts of content, response process, and internal structure. This model of entrustment scales, formative and summative assessments, and faculty development can be utilized for any pathology EPA and provides a roadmap for programs to design and implement EPA assessments into pathology residency training.
Collapse
Affiliation(s)
- Bronwyn H. Bryant
- University of Vermont Medical Center, Department of Pathology and Laboratory Medicine, Burlington, VT, USA
| | - Scott R. Anderson
- University of Vermont Medical Center, Department of Pathology and Laboratory Medicine, Burlington, VT, USA
| | - Mark Brissette
- University of Colorado Anschutz Medical Campus, Department of Pathology, Aurora, CO, USA
| | - John M. Childs
- Geisinger Medical Center, Department of Pathology, Danville, PA, USA
| | - Dita Gratzinger
- Stanford University School of Medicine, Department of Pathology, Stanford, CA, USA
| | | | - Deborah E. Powell
- University of Minnesota Medical School, Department of Laboratory Medicine and Pathology, Minneapolis, MN, USA
| | | | - Charles F. Timmons
- UT Southwestern Medical Center, Department of Pathology, Dallas, TX, USA
| | - Cindy B. McCloskey
- University of Oklahoma College of Medicine, Department of Pathology, Oklahoma City, OK, USA
| |
Collapse
|