Competency Committees in Undergraduate Medical Education: Approaching Tensions Using a Polarity Management Framework

Occupying liminal spaces: The figured worlds of student affairs senior leaders in the United States

INTRODUCTION

Student Affairs Senior Leaders (SASLs) in the United States lead offices responsible for academic advising, administrative documentation, scheduling, student health, financial aid, and transition to residency, yet they infrequently draw attention in the field's literature. We explore the role of SASLs and how they describe the social space of medical education.

METHODS

Using a constructivist approach informed by Figured Worlds theory, we conducted a sequential narrative and thematic analysis of the stories SASLs tell about their roles and experiences in the world of medical education.

RESULTS

SASLs inhabit complex roles centred on advocating for medical students' academic, personal and social well-being. Their unique position within the medical school allows them to see the harm to vulnerable students made possible by misalignments inherent within medical education. Yet even with the challenges inherent in the environment, SASLs find reasons for hope.

CONCLUSION

SASLs' identities are full of potential contradictions, but they have a unique view into the often-chaotic world of medical education.

Assessment of Clinical Reasoning in Undergraduate Medical Education: A Pragmatic Approach to Programmatic Assessment

PURPOSE

Clinical reasoning, a complex construct integral to the practice of medicine, has been challenging to define, teach, and assess. Programmatic assessment purports to overcome validity limitations of judgments made from individual assessments through proportionality and triangulation processes. This study explored a pragmatic approach to the programmatic assessment of clinical reasoning.

METHOD

The study analyzed data from 2 student cohorts from the University of Utah School of Medicine (UUSOM) (n = 113 in cohort 1 and 119 in cohort 2) and 1 cohort from the University of Colorado School of Medicine (CUSOM) using assessment data that spanned from 2017 to 2021 (n = 199). The study methods included the following: (1) asking faculty judges to categorize student clinical reasoning skills, (2) selecting institution-specific assessment data conceptually aligned with clinical reasoning, (3) calculating correlations between assessment data and faculty judgments, and (4) developing regression models between assessment data and faculty judgments.

RESULTS

Faculty judgments of student clinical reasoning skills were converted to a continuous variable of clinical reasoning struggles, with mean (SD) ratings of 2.93 (0.27) for the 232 UUSOM students and 2.96 (0.17) for the 199 CUSOM students. A total of 67 and 32 discrete assessment variables were included from the UUSOM and CUSOM, respectively. Pearson r correlations were moderate to strong between many individual and composite assessment variables and faculty judgments. Regression models demonstrated an overall adjusted R2 (standard error of the estimate) of 0.50 (0.19) for UUSOM cohort 1, 0.28 (0.15) for UUSOM cohort 2, and 0.30 (0.14) for CUSOM.

CONCLUSIONS

This study represents an early pragmatic exploration of regression analysis as a potential tool for operationalizing the proportionality and triangulation principles of programmatic assessment. The study found that programmatic assessment may be a useful framework for longitudinal assessment of complicated constructs, such as clinical reasoning.

Towards a flexible and personalised development of veterinarians and veterinary nurses working in a companion animal referral care setting

In the Netherlands, the demand for veterinarians and veterinary nurses (VNs) working within referral care is rapidly growing and currently exceeds the amount of available board-certified specialists. Simultaneously, a transparent structure to guide training and development and to assess quality of non-specialist veterinarians and VNs working in a referral setting is lacking. In response, we developed learning pathways guided by an entrustable professional activity (EPA) framework and programmatic assessment to support personalised development and competence of veterinarians and VNs working in referral settings. Between 4 and 35 EPAs varying per discipline (n = 11) were developed. To date, 20 trainees across five disciplines have been entrusted. Trainees from these learning pathways have proceeded to acquire new EPAs in addition to their already entrusted set of EPAs or progressed to specialist training during (n = 3) or after successfully completing (n = 1) the learning pathway. Due to their outcome-based approach, the learning pathways support flexible ways of development.

Transition From Normative to Criterion-Based Grading in the Obstetrics and Gynecology Clerkship

OBJECTIVES

To compare grades, National Board of Medical Examiners (NBME) Shelf Exam scores, and student satisfaction with the Obstetrics and Gynecology (OB/GYN) clerkship after transitioning from normative to criterion-based grading.

METHODS

Between July 2021 and July 2022, the Icahn School of Medicine at Mount Sinai (ISMMS) adhered to a normative grading scheme in which ∼60% of students achieved a grade of Honors, 30% achieved a grade of High Pass and 10% achieved a grade of Pass for the OB/GYN clerkship. In July 2022, ISMMS transitioned to a criterion-based scheme. In this scheme, 6 competencies were created. Criteria were determined for each competency, delineating achieving a score of "Pass" versus "Honors" for the specific objective. Students needed to meet the criteria for Honors for 4 out of 6 of the competencies in order to ultimately receive a grade of Honors for the clerkship. The number of students achieving Honors, NBME shelf exam scores, and student clerkship satisfaction ratings between the normative and criterion-based schemes were compared.

RESULTS

The number of students studying in academic year (AY) 2021-2022 and AY 2022-2023 were 134 and 137, respectively. A significantly lower percentage of students received Honors in AY 2021-2022 than in AY 2022-2023 (66% vs. 96%, P < .01). Mean exam scores were significantly higher for those receiving Honors in AY 2021-2022 than in AY 2022-2023 (P < .05); scores for AY 2021-2022 and AY 2022-2023 were 78.9, 95% CI [77.6, 80.1] and 76.7, 95% CI [75.6, 77.8], respectively. Mean exam scores for all students were not significantly different between the 2 academic cohorts (77.8 vs. 76.2, P = .06). Clerkship satisfaction rating was significantly higher in AY 2022-2023 than in AY 2021-2022 (4.1 vs. 3.7, P < .05).

CONCLUSIONS

These findings support a paradigm that compares learner performance to predefined measures as opposed to peer performance.

Is it Time for Competency-Based Education to Move Forward in Pharmacy Education?

Competency-based education is rapidly emerging as a paradigmatic shift in health professions education, as we grapple with the realities of ever-changing and increasing demands of society and health systems. While pharmacy educators are becoming more familiar with this paradigm, colleagues in medical education have been exploring models and methods of competency-based education for many years, and their experiences can be illuminating for us. The persistent question that drives continuous quality improvement in pharmacy education and the development of initiatives within American Association of Colleges of Pharmacy might be stated as "Is there a better (more effective, more efficient) way to prepare pharmacists (future and current) to meet the medication-related needs of the public?"

Extending growth curves: a trajectory monitoring approach to identification and interventions in struggling medical student learners

Given gaps in both identifying and providing targeted interventions to struggling learners, the purpose of this study is to both improve rapid identification and to improve individualized academic advising for learners using this visual representation of performance. Across three graduating classes, individual growth curves were calculated for each student on National Board of Medical Examiners customized assessments during the pre-clerkship period using their deviation from the class average at each assessment point. These deviation scores were cumulatively summed over time and were regressed onto the sequence of exams. We analyzed the difference between the regression slopes of those students placed on Academic Probation (AP) versus not, as well as differences in slopes based on the timing of when a struggling learner was placed on AP to explore learner trajectory after identification. Students on AP had an average growth slope of - 6.06 compared to + 0.89 for those not on AP. Findings also suggested that students who were placed on AP early during pre-clerkship showed significant improvement (positive changes in trajectory) compared to students identified later in the curriculum. Our findings suggest that earlier academic probation and intervention with struggling learners may have a positive effect on academic trajectory. Future research can better explore how academic trajectory monitoring and performance review can be regularly used in advising sessions with students.

Remediation in Practice: A Polarity to be Managed

Originally developed in the business literature, a polarity is a concept where 2 distinctive and opposing characteristics (poles), each presenting advantages and disadvantages or opportunities and pitfalls, must both be taken into account to ensure effective management of a challenging problem. Managing a polarity is a thorny endeavor because it entails striving to maximize the benefits of both poles while simultaneously minimizing or controlling the downsides of each. Previous investigations into stakeholder conceptualizations of remediation led us to suggest that remediation is framed in stakeholders' minds simultaneously as an educational endeavor (ie, the remediatee needs educational support to regain full competence) and a regulatory act (ie, the revocation of the individual's professional right to self-regulate their practice and learning). In this article, we argue that viewing remediation for practicing physicians as a polarity to be managed offers a framework that can further the conversation about how to address some of remediation's challenges.

Entrustment Decision Making in the Core Entrustable Professional Activities: Results of a Multi-Institutional Study

PURPOSE

In 2014, the Association of American Medical Colleges defined 13 Core Entrustable Professional Activities (EPAs) that all graduating students should be ready to do with indirect supervision upon entering residency and commissioned a 10-school, 5-year pilot to test implementing the Core EPAs framework. In 2019, pilot schools convened trained entrustment groups (TEGs) to review assessment data and render theoretical summative entrustment decisions for class of 2019 graduates. Results were examined to determine the extent to which entrustment decisions could be made and the nature of these decisions.

METHOD

For each EPA considered (4-13 per student), TEGs recorded an entrustment determination (ready, progressing but not yet ready, evidence against student progressing, could not make a decision); confidence in that determination (none, low, moderate, high); and the number of workplace-based assessments (WBAs) considered (0->15) per determination. These individual student-level data were de-identified and merged into a multischool database; chi-square analysis tested the significance of associations between variables.

RESULTS

The 2,415 EPA-specific determinations (for 349 students by 4 participating schools) resulted in a decision of ready (n = 997/2,415; 41.3%), progressing but not yet ready (n = 558/2,415; 23.1%), or evidence against student progression (n = 175/2,415; 7.2%). No decision could be made for the remaining 28.4% (685/2,415), generally for lack of data. Entrustment determinations' distribution varied across EPAs (chi-square P < .001) and, for 10/13 EPAs, WBA availability was associated with making (vs not making) entrustment decisions (each chi-square P < .05).

CONCLUSIONS

TEGs were able to make many decisions about readiness for indirect supervision; yet less than half of determinations resulted in a decision of readiness to perform this EPA with indirect supervision. More work is needed at the 10 schools to enable authentic summative entrustment in the Core EPAs framework.

Polarity Based Model for Guiding Medical School Strategy During Crisis - A Cross Sectional Qualitative Study

BACKGROUND

Crises in academia can best be dealt with as a polarity that needs to be leveraged rather than a problem that needs to be solved. This work aimed at utilizing the Polarity Approach for Continuity and Transformation (PACT)™ to establish a guide for medical schools during times of crisis to minimize the effect of crisis-driven decisions on strategic growth.

SUBJECTS AND METHODS

A qualitative study following the 5-Steps of the PACT process was conducted. A virtual mapping session was held with 108 medical educators from 22 countries to determine the upsides and downsides of strategic orientation and crisis management subsequently.

RESULTS

Four polarity maps were generated identifying four tension areas; University reputation, mission, teams, and individuals followed by a 72-item assessment and another mapping session to map the warning signs and action steps. A comparison between private school scores and the whole cohort of respondents showed that private schools had the least problems in team-oriented work.

CONCLUSION

This study highlighted the importance of taking measures to communicate the mission and supporting team functions inside universities either by enhancing resources or utilizing time and effort-saving strategies.

The critical role of infrastructure and organizational culture in implementing competency-based education and individualized pathways in undergraduate medical education

In 2010, several key works in medical education predicted the changes necessary to train modern physicians to meet current and future challenges in health care, including the standardization of learning outcomes paired with individualized learning processes. The reframing of a medical expert as a flexible, adaptive team member and change agent, effective within a larger system and responsive to the community's needs, requires a new approach to education: competency-based medical education (CBME). CBME is an outcomes-based developmental approach to ensuring each trainee's readiness to advance through stages of training and continue to grow in unsupervised practice. Implementation of CBME with fidelity is a complex and challenging endeavor, demanding a fundamental shift in organizational culture and investment in appropriate infrastructure. This paper outlines how member schools of the American Medical Association Accelerating Change in Medical Education Consortium developed and implemented CBME, including common challenges and successes. Critical supporting factors include adoption of the master adaptive learner construct, longitudinal views of learner development, coaching, and a supportive learning environment.

Medical Students' Views on Implementing the Core EPAs: Recommendations From Student Leaders at the Core EPAs Pilot Institutions

In 2014, the Association of American Medical Colleges recruited 10 institutions across the United States to pilot the 13 Core Entrustable Professional Activities for Entering Residency (Core EPAs). The goal was to establish a competency-based framework to prepare graduating medical students for the transition to residency. Within the Core EPAs pilot, medical students play an influential role in the development and implementation of EPA-related curricula. Student engagement was a priority for the Core EPAs institutions given students' roles as the end users of the curriculum, thus they may offer valuable insight into its design and implementation. Here, the authors provide the perspective of medical students who serve as leaders in the Core EPAs pilot at their respective institutions. They describe student leadership models across the pilot institutions as well as 6 key challenges to implementation of the Core EPAs: (1) How and when should the Core EPAs be introduced? (2) Who is responsible for driving the assessment process? (3) What feedback mechanisms are required? (4) What systems are required for advising, mentoring, or coaching students? (5) Should EPA performance contribute to students' grades? and (6) Should entrustment decisions be tied to graduation requirements? Using a polarity management framework to address each challenge, the authors describe inherent tensions, approaches used by the Core EPAs pilot institutions, and student-centered recommendations for resolving each tension. By sharing the experiences and perspectives of students engaged in the Core EPAs pilot, the authors hope to inform implementation of EPA-oriented assessment practices and feedback across institutions in the United States.

Alignment of Perceived Competencies and Perceived Job Tasks among Primary Care Managers

In this study we aimed to explore how managers in primary health care (PHC) organizations assess their managerial knowledge and skills, as well as the importance of these competencies for their job, and to identify whether there is an alignment between these two perceptions; therefore, whether there is a need for management competency improvement. With this study, we tried to address a high demand for information about health managers, especially in health systems in low- and middle-income countries. In a sample of 58 primary health care centers (n = 106 managers) in Serbia, we used a basic managerial competency matrix consisting of the following six competencies—communication, team-building, planning and priority-setting, performance assessment, problem-solving, and leading. Managerial perception of the importance of their job tasks differs by educational level and managerial position. The best alignment between the importance of knowledge and skills was for communication and leading. The study pointed out that managers were aware of the necessity to improve their level of managerial competencies, particularly in the domains of planning and priority-setting, performance assessment, and problem solving. The study highlights the need for formal managerial education for managers in PHC settings and commitment to continuously evaluate and improve management competencies in order to better manage PHC.