Entrustable Professional Activities in Hematopathology Pathology Fellowship Training: Consensus Design and Proposal

Leveraging faculty development to support validation of entrustable professional activities assessment tools in anatomic and clinical pathology training

Entrustable professional activities (EPAs) are observable activities that define the practice of medicine and provide a framework of evaluation that has been incorporated into US medical school curricula in both undergraduate and graduate medical education. This manuscript describes the development of an entrustment scale and formative and summative evaluations for pathology EPAs, outlines a process for faculty development that was employed in a pilot study implementing two Anatomic Pathology and two Clinical Pathology EPAs in volunteer pathology residency programs, and provides initial validation data for the proposed pathology entrustment scales. Prior to implementation, faculty development was necessary to train faculty on the entrustment scale for each given activity. A "train the trainer" model used performance dimension training and frame of reference training to train key faculty at each institution. The session utilized vignettes to practice determination of entrustment ratings and development of feedback for trainees as to strengths and weaknesses in the performance of these activities. Validity of the entrustment scale is discussed using the Messick framework, based on concepts of content, response process, and internal structure. This model of entrustment scales, formative and summative assessments, and faculty development can be utilized for any pathology EPA and provides a roadmap for programs to design and implement EPA assessments into pathology residency training.

National pilot of entrustable professional activities in pathology residency training

Entrustable professional activities (EPAs) are observable clinical skills and/or procedures that have been introduced into medical education at the student and resident levels in most specialties to determine readiness to advance into residency or independent practice, respectively. This publication describes the process and outcomes of a pilot study looking at the feasibility of using two anatomic pathology and two clinical pathology EPAs in pathology residency in 6 pathology residency programs that volunteered for the study. Faculty development on EPAs and their assessment was provided to pilot program faculty, and EPA assessment tools were developed and used by the pilot programs. Pre- and post-study surveys were given to participating residents, faculty, and program directors to gauge baseline practices and to gather feedback on the EPA implementation experience. Results demonstrated overall good feasibility in implementing EPAs. Faculty acceptance of EPAs varied and was less than that of program directors. Residents reported a significant increase in the frequency with which faculty provided formative assessments that included specific examples of performance and specific ways to improve, as well as increased frequency with which faculty provided summative assessments that included specific ways to improve. EPAs offered the most benefit in setting clear expectations for performance of each task, for providing more specific feedback to residents, and in increasing Program director's understanding of resident strengths abilities and weaknesses.

Development, implementation, and evaluation of entrustable professional activities (EPAs) for medical radiation technologists in Taiwan: a nationwide experience

BACKGROUND

Competency-based medical education (CBME) is an outcomes-oriented approach focused on developing competencies that translate into clinical practice. Entrustable professional activities (EPAs) bridge competency assessment and clinical performance by delineating essential day-to-day activities that can be entrusted to trainees. EPAs have been widely adopted internationally, but not yet implemented for medical radiation professionals in Taiwan.

MATERIALS AND METHODS

A nationwide consensus process engaged 97 experts in radiation technology education representing diagnostic radiography, radiation therapy, and nuclear medicine. Preliminary EPAs were developed through the focus group discussion and the modified Delphi method. The validity of these EPAs was evaluated using the QUEPA and EQual tools.

RESULTS

Through iterative consensus building, six core EPAs with 18 component observable practice activities (OPAs) in total were developed, encompassing routines specific to each radiation technology specialty. QUEPA and EQual questionnaire data verified these EPAs were valid, and of high quality for clinical teaching and evaluation.

CONCLUSION

The consensus development of tailored EPAs enables rigorous competency assessment during medical radiation technology education in Taiwan. Further expansion of EPAs and training of clinical staff could potentially enhance care quality by producing competent professionals.

From principles to practice: Implementation of entrustable professional activities (EPAs) for surgical pathology residency education in a large academic hospital

Over the past decade, competency-based medical education (CBME) has gained momentum in the United States to develop trainees into independent and confident physicians by the end of their training. Entrustable professional activities (EPAs) are an established methodology for assessing trainee development through an outcomes-driven rather than a time-based model. While EPAs have been utilized as an assessment tool for CBME in Europe and Canada, their validation and implementation in some medical specialties has occurred more recently in the United States. Pediatrics was the first specialty in the US to conduct a large-scale UME-GME pilot. Pathology Residency EPAs were published in 2018; however, implementation in training programs has been slow. We have piloted EPAs in our residency program's surgical pathology rotation and propose a unique set of 4 surgical pathology EPAs to track trainee preparedness for independent practice.

Inconsistently reporting post-licensure EPA specifications in different clinical professions hampers fidelity and practice translation: a scoping review

BACKGROUND

Entrustable Professional Activities (EPAs) are defined units of professional practice entrusted to professionals once they have attained the specific competencies required to complete the end-to-end task. They provide a contemporary framework for capturing real-world clinical skillsets and integrating clinical education with practice. Our scoping review question was: how are post-licensure EPAs reported in peer reviewed literature, in different clinical professions?

METHOD

We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) checklist, Arksey and O'Malley and Joanna Briggs Institute (JBI) methodology. Searching ten electronic databases returned 1622 articles, with 173 articles included. Data extracted included demographics, EPA discipline, titles and further specifications.

RESULTS

All articles were published between 2007-2021 across sixteen country contexts. The majority were from North America (n = 162, 73%) describing medical sub-specialty EPAs (n = 126, 94%). There were comparably few EPA frameworks reported in clinical professions other than medicine (n = 11, 6%). Many articles reported only EPA titles without further explanation and limited content validation. The majority did not include information about the EPA design process. Few EPAs and frameworks were reported according to all the recommended EPA attributes. There was unclear distinction between specialty-specific EPAs and those that could be useful across disciplines.

DISCUSSION

Our review highlights the large volume of EPAs reported in post-licensure medicine, including the volume disparity compared to other clinical professions. Basing our enquiry upon existing guidelines for EPA attributes and features, our experience in conducting the review and our primary finding demonstrated heterogeneity of EPA reporting according to these specifications. To promote EPA fidelity, and quality appraisal, and to reduce interpretation subjectivity, we advocate: diligently reporting EPA attributes and features; including reference or citation to EPA design and content validity information; and considering distinguishing EPAs as specialty-specific or transdisciplinary.

CONCLUSION

A large volume of post-licensure EPAs were identified in medicine relative to other clinical professions. EPA specifications were absent or variously reported in the literature, risking ambiguous interpretation. The authors recommend that future EPAs are reported with reference to established and evolving construct recommendations, which is integral to concept fidelity and translation to practice and education.

Teaching and assessing intra-operative consultations in competency-based medical education: development of a workplace-based assessment instrument

Competency-based medical education (CBME) is being implemented worldwide. In CMBE, residency training is designed around competencies required for unsupervised practice and use entrustable professional activities (EPAs) as workplace “units of assessment”. Well-designed workplace-based assessment (WBA) tools are required to document competence of trainees in authentic clinical environments. In this study, we developed a WBA instrument to assess residents’ performance of intra-operative pathology consultations and conducted a validity investigation. The entrustment-aligned pathology assessment instrument for intra-operative consultations (EPA-IC) was developed through a national iterative consultation and used clinical supervisors to assess residents’ performance at an anatomical pathology program. Psychometric analyses and focus groups were conducted to explore the sources of evidence using modern validity theory: content, response process, internal structure, relations to other variables, and consequences of assessment. The content was considered appropriate, the assessment was feasible and acceptable by residents and supervisors, and it had a positive educational impact by improving performance of intra-operative consultations and feedback to learners. The results had low reliability, which seemed to be related to assessment biases, and supervisors were reluctant to fully entrust trainees due to cultural issues. With CBME implementation, new workplace-based assessment tools are needed in pathology. In this study, we showcased the development of the first instrument for assessing resident’s performance of a prototypical entrustable professional activity in pathology using modern education principles and validity theory.