The dynamics of self-monitoring in medicine: Safety, efficiency and clinical implications

.@MedEdDoc et al. delve into how the concepts of 'safety' and 'efficiency' in self‐monitoring can be used to influence clinical practice and #MedEd.

Physician educators' perceptions of experiences contributing to teaching

INTRODUCTION

Physician educators are essential in training the next generation of physicians. However, physician educators' perspectives about what experiences they find beneficial to their teaching and the prevalence of these experiences remain unknown. Guided by social cognitive career theory (SCCT) and communities of practice (CoP), we explored what experiences physician educators perceive as beneficial in preparing them to teach.

METHODS

In 2019, the Uniformed Services University School of Medicine in the United States surveyed its physician alumni to understand their education experiences during medical school, their current career path and what has contributed to their teaching role. Content analysis was applied to extract themes across the text response. Chi-square analysis was applied to examine if perceived contributing factors vary based on physician educators' gender, specialty and academic ranks.

RESULTS

The five most prevalent contributing factors participants (n = 781) identified are (1) experiences gained during residency and fellowship (29.8%), (2) teaching as faculty member (28.9%) and (3) class experiences and peer interaction during medical school (26%). We organised three themes that reflected major avenues of how physician educators acquire teaching skills: reflection about quality teaching, journey as learners and learning by doing. Gender and clinical specialty were differentially associated with contributing factors such as faculty development and meta-reflection.

CONCLUSION

The results are in line with theories of SCCT and CoP, in which we identified self-directed learning and regulation in shaping physician educators' teaching. The findings also revealed gaps and potential contexts for more formalised teaching practices to develop physician educators.

In Search of a "Metric System" for Measuring Faculty Effort: A Qualitative Study on Educational Value Units at U.S. Medical Schools

PURPOSE

Faculty at academic health centers (AHCs) are charged with engaging in educational activities. Some faculty have developed educational value units (EVUs) to track the time and effort dedicated to these activities. Although several AHCs have adopted EVUs, there is limited description of how AHCs engage with EVU development and implementation. This study aimed to understand the collective experiences of AHCs with EVUs to illuminate benefits and barriers to their development, use, and sustainability.

METHOD

Eleven faculty members based at 10 AHCs were interviewed between July and November 2022 to understand their experiences developing and implementing EVUs. Participants were asked to describe their experiences with EVUs and to reflect on benefits and barriers to their development, use, and sustainability. Transcripts were analyzed using thematic analysis.

RESULTS

EVU initiatives have been designed and implemented in a variety of ways, with no AHCs engaging alike. Despite differences, the authors identified shared themes that highlighted benefits and barriers to EVU development and implementation. Within and between these themes, a series of tensions were identified in conjunction with the ways in which AHCs attempted to mitigate them. Related to barriers, the majority of participants abandoned or paused their EVU initiatives; however, no differences were identified between those AHCs that retained EVUs and those that did not.

CONCLUSIONS

The collective themes identified suggest that AHCs implementing or sustaining an EVU initiative would need to balance benefits and barriers in light of their unique context. Study findings align with reviews on EVUs and provide additional nuance related to faculty motivation to engage in education and the difficulties of defining EVUs. The lack of differences observed between those AHCs that retained EVUs and those that did not suggests that EVUs may be challenging to implement because of the complexity of AHCs and their faculty.

Physiologic measurements of cognitive load in clinical reasoning

OBJECTIVES

Cognitive load is postulated to be a significant factor in clinical reasoning performance. Monitoring physiologic measures, such as Heart Rate Variability (HRV) may serve as a way to monitor changes in cognitive load. The pathophysiology of why HRV has a relationship to cognitive load is unclear, but it may be related to blood pressure changes that occur in a response to mental stress.

METHODS

Fourteen residents and ten attendings from Internal Medicine wore Holter monitors and watched a video depicting a medical encounter before completing a post encounter form used to evaluate their clinical reasoning and standard psychometric measures of cognitive load. Blood pressure was obtained before and after the encounter. Correlation analysis was used to investigate the relationship between HRV, blood pressure, self-reported cognitive load measures, clinical reasoning performance scores, and experience level.

RESULTS

Strong positive correlations were found between increasing HRV and increasing mean arterial pressure (MAP) (p=0.01, Cohen's d=1.41). There was a strong positive correlation with increasing MAP and increasing cognitive load (Pearson correlation 0.763; 95 % CI [; 95 % CI [-0.364, 0.983]). Clinical reasoning performance was negatively correlated with increasing MAP (Pearson correlation -0.446; 95 % CI [-0.720, -0.052]). Subjects with increased HRV, MAP and cognitive load were more likely to be a resident (Pearson correlation -0.845; 95 % CI [-0.990, 0.147]).

CONCLUSIONS

Evaluating HRV and MAP can help us to understand cognitive load and its implications on trainee and physician clinical reasoning performance, with the intent to utilize this information to improve patient care.

Exploring Impostor Phenomenon During Onboarding Into a Military Medical School

INTRODUCTION

Impostor phenomenon (IP) is an experience where an individual believes that their success was because of chance or luck and was not associated with the mastery of skills. There is a gap in the literature in understanding what role, if any, onboarding (e.g., orientation weeks) into a military medical school plays into student experiences with IP. For many, onboarding serves as the first exposure to the climate, culture, and learning environment of both medical school and the military. Prevention, or early intervention, of IP may reduce potential effects on a medical trainee's confidence and competence in their profession, which may ultimately enhance health care team performance and impact patient outcomes. This study explores if and why military medical students experience IP during a 2-week-long orientation into a military medical school.

MATERIALS AND METHODS

The study participants were medical students at a military medical school. Researchers conducted semi-structured interviews in August 2022 to explore if and why students experienced IP and deployed the Clance IP Scale as a measure with validity evidence for ascertaining the presence and magnitude of IP. Researchers calculated total scores from the Clance IP Scale and thematically analyzed interview transcripts.

RESULTS

Researchers interviewed 29 matriculating military medical students. Twenty-one (75%) students reported frequent or intense IP experiences on the Clance IP Scale indicating that IP was present in our study sample. Thematic analysis identified six themes that drove one's experience with IP: reevaluation of merit, individualized diversity and inclusion experiences, administrative and financial support, preconceived expectations, building relationships, and new community roles.

CONCLUSIONS

Our identified themes provide us with a better understanding of if and why military medical students experience IP during onboarding. Our findings are also consistent with the situated learning theory, which places emphasis on the sense of belonging and may provide a unique and insightful lens through which IP can be further explored and studied, particularly at a military medical school where various identities, dynamics, and aspirations can converge simultaneously. Additionally, our findings suggest that existing practices may benefit from a number of improvements including, but not limited to, tailoring onboarding activities to entail more reflective discussion using small groups, especially for topics related to diversity and inclusion, revisiting areas where students may feel inadequately prepared to transition and perform well in a medical school, reevaluating administrative and financial support that can be roadblocks to a student's transition into the new environment and removing these barriers, and ensuring cultural coherence (organizational alignment of vision and mission) among faculty, staff, and upperclassmen. Future research directions include better understanding how developing single or multiple, identities can impact a medical students' experience with IP during onboarding, pre-clerkship, clerkship, or post-clerkship period, if at all.

Distributed cognition: Theoretical insights and practical applications to health professions education: AMEE Guide No. 159

Distributed cognition (DCog) is a member of the family of situativity theories that widens the lens of cognition from occurring solely inside the head to being socially, materially and temporally distributed within a dynamic system. The concept of extending the view of cognition to outside the head of a single health professional is relatively new in the healthcare system. DCog has been increasingly used by researchers to describe many ways in which health professionals perform in teams within structured clinical environments to deliver healthcare for patients. In this Guide, we expound ten central tenets of the macro (grand) theory of DCog (1. Cognition is decentralized in a system; 2. The unit of analysis is the system; 3. Cognitive processes are distributed; 4. Cognitive processes emerge from interactions; 5. Cognitive processes are interdependent; 6. Social organization is a cognitive architecture; 7. Division of labour; 8. Social organization is a system of communication; 9. Buffering and filtering; 10. Cognitive processes are encultured) to provide theoretical insights as well as practical applications to the field of health professions education.

Does Masking MCAT Scores During Admissions Increase Equity?

PURPOSE

To improve admissions process equity, the Uniformed Services University masked Medical College Admission Test (MCAT) scores at or above the 51st percentile to admissions committee members. This policy was aimed at improving admissions rates for applicants in 2 priority groups: those from races and ethnicities underrepresented in medicine (URM) and those from lower socioeconomic status, represented by first-generation college (FGC) graduates.

METHOD

All applicants invited to interview were included: 1,624 applicants from admissions years 2014-2016 before MCAT score masking and 1,668 applicants from admissions years 2018-2020 during MCAT score masking. Logistic regression determined admissions likelihood before and during masking. Independent sample t tests compared average admissions committee scores for all applicants and for those in priority groups. Linear regression determined the weight of MCAT scores on admissions committee scores.

RESULTS

Despite there being more priority group applicants during MCAT score masking, the admissions likelihood for an individual priority group applicant decreased during this period. URM applicants had an odds ratio of 0.513 for acceptance during MCAT score masking compared to before masking, and FGC applicants had an odds ratio of 0.695. Masking significantly reduced mean admissions committee scores, which decreased approximately twice as much for priority group applicants as for nonpriority group applicants (0.96 points vs 0.51 points). These score decreases were highest for priority group applicants with MCAT scores above the 67th percentile. Masking reduced the weight of MCAT scores; 10.9% of admissions committee score variance was explained by MCAT scores before masking and only 1.2% during masking.

CONCLUSIONS

Despite known disparities in MCAT scores with respect to race, ethnicity, and socioeconomic status, admissions decisions in this study were more equitable when MCAT scores were included. While masking MCAT scores reduced the influence of the exam in admissions decisions, it also reduced admissions rates for URM and FGC applicants.

A Comparison of Uniformed Services University and Health Professions Scholarship Program Graduates' First Deployment Readiness

INTRODUCTION

Military physicians must be prepared to lead health care teams across complex landscapes of war during future small- and large-scale combat operations. This preparation optimally begins in medical school so that early career physicians are fully ready for their first deployment. Past qualitative research has suggested that military physicians who attended civilian medical school are not as well prepared for the operational environment as physicians who attended the Uniformed Services University (USU), our nation's military medical school. However, there is a lack of larger-scale quantitative research comparing the readiness differences between the two medical school pathways. The purpose of this study, therefore, was to quantify any differences in first deployment preparation between students attending USU and civilian medical schools through the Health Professions Scholarship Program (HPSP).

MATERIALS AND METHODS

We compared USU and HPSP graduates' first deployment experiences by distributing a 14-item Likert survey to active duty military physicians in the U.S. Army, U.S. Navy, and U.S. Air Force who graduated within the past 10 years from medical school (USU or civilian).

RESULTS

The USU graduates rated themselves significantly higher than the HPSP graduates on their readiness for deployment (3.83 vs. 3.24; P < .001); ability to navigate the operational environment (3.59 vs. 2.99; P < .001); confidence in communicating with their commanding officer (3.59 vs. 2.99; P = .002); navigating the combined role as physician and officer (3.33 vs. 2.84; P = .004); leading a health care team (3.94 vs. 3.43; P = .001); preparation by a medical school (3.78 vs. 2.52; P < .001); and overall readiness compared to peers (4.20 vs. 3.49; P < .001). There was no significant difference between the two pathways regarding their stress level at the beginning of deployment (2.74 vs. 2.68; P = .683); clinical preparation (3.94 vs. 3.76; P = .202); and success of first deployment (3.87 vs. 3.91; P = .792). The largest effect size of the difference between the two pathways was noted on the question "How well did medical school prepare you for your first deployment" (Cohen's d = 1.02).

CONCLUSIONS

While both groups believed that they were prepared for their first deployment, USU graduates consistently reported being more prepared by medical school for their first deployment than HPSP graduates. To close this readiness gap, supplemental military unique curricula may help to optimize HPSP students' readiness.

Addressing HPSP Learner Needs: A Pilot Study of a "Fundamentals of Military Medicine" Course

INTRODUCTION

Military medicine is uniquely different from civilian medicine, and military physicians in the USA are primarily recruited through the Health Professions Scholarship Program (HPSP) and the Uniformed Services University of the Health Sciences (USUHS). Medical students at the USUHS receive more than 650 hours of military-specific curriculum and spend 21 days engaged in field exercises. HPSP students complete two 4-week officer training sessions during their 4 years of medical school. There is a clear discrepancy in preparation for military medicine between HPSP and USUHS students. The USUHS School of Medicine undertook an initiative to develop a fully online self-paced course on the fundamentals of military medicine topics to help HPSP students bridge the gap in their preparation. This article will describe how the online self-paced course was designed and present feedback from the pilot offering of this course.

MATERIALS AND METHODS

As proof of concept of the effectiveness of an online self-paced course for teaching the fundamentals of military medicine to HPSP students, two chapters from the "Fundamentals of Military Medicine" published by the Borden Institute were transferred to an online format. Each chapter was offered as a module. In addition to the chapters, an introduction and closing module were added to the pilot course. The pilot course was offered over 6 weeks. Data for this study were obtained from module feedback surveys, pre- and post-course quizzes, participant focus groups, and course evaluation surveys. Pre- and post-test scores were analyzed to evaluate content knowledge. The open-ended survey questions on the feedback forms and focus group transcripts were collated and analyzed as textual data.

RESULTS

Fifty-six volunteers enrolled in the study, and 42 completed the pre- and post-course quizzes. This participant pool included HPSP students (79%, n = 44) and military residents in civilian graduate medical education programs (21%, n = 12). The module feedback surveys showed that most participants spent 1 to 3 hours on each of the modules, which they rated as extremely or quite reasonable (Module 1: 64%, Module 2: 86%, Module 3: 83%). There was not much difference between the overall quality of the three modules. The participants found content on application to the military-specific context very valuable. Of the different course elements, video content was rated as the most effective. Participant feedback clearly highlighted that HPSP students want a course that informs them about the fundamentals of military medicine and demonstrates how the information would apply to their lives. Overall, the course was effective. HPSP students showed knowledge gains and self-reported satisfaction with the course's objectives. They were able to locate information easily and understand the course expectations.

CONCLUSIONS

This pilot study has shown that there is a need for a course that provides the fundamentals of military medicine to HPSP students. A fully online self-paced course provides flexibility for the students and improves access.

Clinical reasoning: What do nurses, physicians, and students reason about

Clinical reasoning is a core ability in the health professions, but the term is conceptualised in multiple ways within and across professions. For interprofessional teamwork it is indispensable to recognise the differences in understanding between professions. Therefore, our aim was to investigate how nurses, physicians, and medical and nursing students define clinical reasoning. We conducted 43 semi-structured interviews with an interprofessional group from six countries and qualitatively analysed their definitions of clinical reasoning based on a coding guide. Our results showed similarities across professions, such as the emphasis on clinical skills as part of clinical reasoning. But we also revealed differences, such as a more patient-centered view and a broader understanding of the clinical reasoning concept in nurses and nursing students. The explicit sharing and discussion of differences in the understanding of clinical reasoning across health professions can provide valuable insights into the perspectives of different team members on clinical practice and education. This understanding may lead to improved interprofessional collaboration, and our study's categories and themes can serve as a basis for such discussions.

Using Self-Regulated Learning Microanalysis to Examine Regulatory Processes in Clerkship Students Engaged in Practice Questions

Introduction

Self-regulated learning is a cyclical process of forethought, performance, and self-reflection that has been used as an assessment tool in medical education. No prior studies have evaluated SRL processes for answering multiple-choice questions (MCQs) and most evaluated one or two iterations of a non-MCQ task. SRL assessment during MCQs may elucidate reasons why learners are successful or not on these questions that are encountered repeatedly during medical education.

Methods

Internal medicine clerkship students at three institutions participated in a SRL microanalytic protocol that targeted strategic planning, metacognitive monitoring, causal attributions, and adaptive inferences across seven MCQs. Responses were transcribed and coded according to previously published methods for microanalytic protocols.

Results

Forty-four students participated. In the forethought phase, students commonly endorsed prioritizing relevant features as their diagnostic strategy (n = 20, 45%) but few mentioned higher-order diagnostic reasoning processes such as integrating clinical information (n = 5, 11%) or comparing/contrasting diagnoses (n = 0, 0%). However, in the performance phase, students' metacognitive processes included high frequencies of integration (n = 38, 86%) and comparing/contrasting (n = 24, 55%). In the self-reflection phase, 93% (n = 41) of students faulted their management reasoning and 84% (n = 37) made negative references to their abilities. Less than 10% (n = 4) of students indicated that they would adapt their diagnostic reasoning process for these questions.

Discussion

This study describes in detail student self-regulatory processes during MCQs. We found that students engaged in higher-order diagnostic reasoning processes but were not explicit about it and seldom reflected critically on these processes after selecting an incorrect answer. Self-reflections focused almost exclusively on management reasoning and negative references to abilities which may decrease self-efficacy. Encouraging students to identify and evaluate diagnostic reasoning processes and make attributions to controllable factors may improve performance.

The Making of an Educator: Professional Identity Formation Among Graduate Medical Education Faculty Through Situated Learning Theory

INTRODUCTION

Professional identity formation (PIF) is a foundational element to professional medical education and training. Given the impact of faculty role models and mentors to student and trainee learning, mapping the landscape of PIF among faculty takes on increased importance. We conducted a scoping review of PIF through the lens of situated learning theory. Our scoping review question was: How is situated learning theory used to understand the process of PIF among graduate medical educators?

METHODS

The scoping review methodology described by Levac et al served as the architecture for this review. Medline, Embase, PubMed, ERIC, CINAHL, PsycINFO, and Web of Science Core Collection were searched (from inception) using a combination of terms that describe PIF among graduate medical educators.

RESULTS

Of the 1434 unique abstracts screened, 129 articles underwent full-text review, with 14 meeting criteria for inclusion and full coding. Significant results organized into three main themes: importance of using common definitions; evolution of theory over time with untapped explanatory power; identity as a dynamic construct.

DISCUSSION

The current body of knowledge leaves many gaps. These include lack of common definitions, need to apply ongoing theoretical insights to research, and exploration of professional identity as an evolving construct. As we come to understand PIF among medical faculty more fully, twin benefits accrue: (1) Community of practices can be designed deliberately to encourage full participation of all graduate medical education faculty who desire it, and (2) Faculty can more effectively lead trainees in negotiating the ongoing process of PIF across the landscape of professional identities.

Teaching Clinical Reasoning in the Preclinical Period

INTRODUCTION

Developing the clinical reasoning skills necessary to becoming an astute diagnostician is essential for medical students. While some medical schools offer longitudinal opportunities for students to practice clinical reasoning during the preclinical curriculum, there remains a paucity of literature fully describing what that curriculum looks like. As a result, medical educators struggle to know what an effective clinical reasoning curriculum should look like, how it should be delivered, how it should be assessed, or what faculty development is necessary to be successful. We present our Introduction to Clinical Reasoning course that is offered throughout the preclinical curriculum of the Uniformed Services University of the Health Sciences. The course introduces clinical reasoning through interactive lectures and 28 case-based small group activities over 15 months.The curriculum is grounded in script theory with a focus on diagnostic reasoning. Specific emphasis is placed on building the student's semantic competence, constructing problem lists, comparing and contrasting similar diagnoses, constructing a summary statement, and formulating a prioritized differential diagnosis the student can defend. Several complementary methods of assessment are utilized across the curriculum. These include assessments of participation, knowledge, and application. The course leverages clinical faculty, graduate medical education trainees, and senior medical students as small group facilitators. Feedback from students and faculty consistently identifies the course as a highly effective and engaging way to teach clinical reasoning.

CONCLUSION

Our Introduction to Clinical Reasoning course offers students repeated exposure to well-selected cases to promote their development of clinical reasoning. The course is an example of how clinical reasoning can be taught across the preclinical curriculum without extensive faculty training in medical education or clinical reasoning theory. The course can be adapted into different instructional formats to cover a variety of topics to provide the early learner with sequential exposure and practice in diagnostic reasoning.

A scoping review of self-monitoring in graduate medical education

BACKGROUND

Physicians and physicians-in-training have repeatedly demonstrated poor accuracy of global self-assessments, which are assessments removed from the context of a specific task, regardless of any intervention. Self-monitoring, an in-the-moment self-awareness of one's performance, offers a promising alternative to global self-assessment. The purpose of this scoping review is to better understand the state of self-monitoring in graduate medical education.

METHODS

We performed a scoping review following Arksey and O'Malley's six steps: identifying a research question, identifying relevant studies, selecting included studies, charting the data, collating and summarising the results and consulting experts. Our search queried Ovid Medline, Web of Science, PsychINFO, Eric and EMBASE databases from 1 January 1999 to 12 October 2022.

RESULTS

The literature search yielded 5363 unique articles. The authors identified 77 articles for inclusion. The search process helped create a framework to identify self-monitoring based on time and context dependence. More than 20 different terms were used to describe self-monitoring, and only 13 studies (17%) provided a definition for the equivalent term. Most research focused on post-performance self-judgements of a procedural skill (n = 31, 42%). Regardless of task, studies focused on self-judgement (n = 66, 86%) and measured the accuracy or impact on performance of self-monitoring (n = 41, 71%). Most self-monitoring was conducted post-task (n = 65, 84%).

CONCLUSION

Self-monitoring is a time- and context-dependent phenomenon that seems promising as a research focus to improve clinical performance of trainees in graduate medical education and beyond. The landscape of current literature on self-monitoring is sparse and heterogeneous, suffering from a lack of theoretical underpinning, inconsistent terminology and insufficiently clear definitions.

Using the think aloud protocol in health professions education: an interview method for exploring thought processes: AMEE Guide No. 151

The think aloud protocol (TAP) has two components, the think aloud interview, a technique for verbal data collection, and protocol analysis, a technique for predicting and analyzing verbal data. TAP is a useful method for those attempting to observe, explore, and understand individuals' thoughts, which remain among the most difficult research areas in health professions education. Notably, the long, complex history and heterogeneous implementation of variations of TAP can make it difficult to understand and implement rigorously. In this Guide, we define the TAP and related concepts, describe the origins, outline applications, offer a detailed roadmap for rigorous implementation as a technique for data collection and/or data analysis, and suggest opportunities for adaptation of the traditional TAP. We aim to arm researchers with the tools to implement a rigorous think aloud interview, while explaining its origins to empower them to adapt the traditional TAP intentionally and justifiably to modern health professions education research.

Management reasoning and patient-clinician interactions: Insights from shared decision-making and simulated outpatient encounters

PURPOSE

To expand understanding of patient-clinician interactions in management reasoning.

METHODS

We reviewed 10 videos of simulated patient-clinician encounters to identify instances of problematic and successful communication, then reviewed the videos again through the lens of two models of shared decision-making (SDM): an 'involvement-focused' model and a 'problem-focused' model. Using constant comparative qualitative analysis we explored the connections between these patient-clinician interactions and management reasoning.

RESULTS

Problems in patient-clinician interactions included failures to: encourage patient autonomy; invite the patient's involvement in decision-making; convey the health impact of the problem; explore and address concerns and questions; explore the context of decision-making (including patient preferences); meet the patient where they are; integrate situational preferences and priorities; offer >1 viable option; work with the patient to solve a problem of mutual concern; explicitly agree to a final care plan; and build the patient-clinician relationship. Clinicians' 'management scripts' varied along a continuum of prioritizing clinician vs patient needs. Patients also have their own cognitive scripts that guide their interactions with clinicians. The involvement-focused and problem-focused SDM models illuminated distinct, complementary issues.

CONCLUSIONS

Management reasoning is a deliberative interaction occurring in the space between individuals. Juxtaposing management reasoning alongside SDM generated numerous insights.

What Stops Fairness from Emerging in Assessment? The Forces on a Complex Adaptive System

Introduction

Workplace-based assessment occurs in authentic, dynamic clinical environments where reproducible, measurement-based assessments can often not be implemented. In these environments, research approaches that respect these multiple dynamic interactions, such as complexity perspectives, are encouraged. Previous research has shown that fairness in assessment is a nonlinear phenomenon that emerges from interactions between its components and behaves like a complex adaptative system. The aim of this study was to understand the external forces on the complex adaptive system which may disrupt fairness from emerging.

Methods

We conducted online focus groups with a purposeful sample of nineteen academic leaders in the Netherlands. We used an iterative approach to collection, analysis and coding of the data and interpreted the results using a lens of complexity, focusing on how individual elements of fairness work in concert to create systems with complex behaviour.

Results

We identified three themes of forces which can disrupt fairness: forces impairing interactivity, forces impairing adaption and forces impairing embeddedness. Within each of these themes, we identified subthemes: assessor and student forces, tool forces and system forces.

Discussion

Consistent with complexity theory, this study suggests there are multiple forces which can hamper the emergence of fairness. Whilst complexity thinking does not reduce the scale of the challenge, viewing forces through this lens provides insight into why and how these forces are disrupting fairness. This allows for more purposeful, meaningful changes to support the use of fair judgement in assessment in dynamic authentic clinical workplaces.

Do All Roads Lead to Full Participation? Examining Trajectories of Clinical Educators in Graduate Medical Education through Situated Learning Theory

Phenomenon: As new faculty members begin their careers in Graduate Medical Education, each begins a journey of Professional Identity Formation from the periphery of their educational communities. The trajectories traveled vary widely, and full participation in a given educational community is not assured. While some medical school and post-graduate training programs may nurture Professional Identity Formation, there is scant support for faculty. To date, the trajectories that Graduate Medical Education faculty travel, what may derail inbound trajectories, and what tools Graduate Medical Education faculty use to navigate these trajectories have not been explicitly described. We explore these three questions here. Approach: Communities of Practice, a component of Situated Learning Theory, serves as a helpful framework to explore trajectories of educator identity development among Graduate Medical Educators. We used a inductive and deductive approach to Thematic Analysis, with Situated Learning Theory as our interpretive frame. Semi-structured interviews of faculty members of GME programs matriculating into a Health Professions Education Program were conducted, focusing on participants' lived experiences in medical education and how these experiences shaped their Professional Identity Formation. Findings: Participants noted peripheral, inbound, boundary, and outbound trajectories, but not an insider trajectory. Trajectory derailment was attributed to competing demands, imposter syndrome and gendered marginality. Modes of belonging were critical tools participants used to shape PIF, not only engagement with educator roles but disengagement with other roles; imagination of future roles with the support of mentors; and fluid alignment with multiple mutually reinforcing identities. Participants identified boundary objects like resumes and formal roles that helped them negotiate across Community of Practice boundaries. Insights: Despite a desire for full participation, some clinical educators remain marginal, struggling along a peripheral trajectory. Further research exploring this struggle and potential interventions to strengthen modes of belonging and boundary objects is critical to create equitable access to the inbound trajectory for all of our colleagues, leaving the choice of trajectories up to them.

Clinical Reasoning Curricula in Preclinical Undergraduate Medical Education: A Scoping Review

PURPOSE

Clinical reasoning is the process of observing, collecting, analyzing, and interpreting patient information to arrive at a diagnosis and management plan. Although clinical reasoning is foundational in undergraduate medical education (UME), the current literature lacks a clear picture of the clinical reasoning curriculum in preclinical phase of UME. This scoping review explores the mechanisms of clinical reasoning education in preclinical UME.

METHOD

A scoping review was performed in accordance with the Arksey and O'Malley framework methodology for scoping reviews and is reported using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis for Scoping Reviews.

RESULTS

The initial database search identified 3,062 articles. Of these, 241 articles were selected for a full-text review. Twenty-one articles, each reporting a single clinical reasoning curriculum, were selected for inclusion. Six of the reports included a definition of clinical reasoning, and 7 explicitly reported the theory underlying the curriculum. Reports varied in the identification of clinical reasoning content domains and teaching strategies. Only 4 curricula reported assessment validity evidence.

CONCLUSIONS

Based on this scoping review, we recommend 5 key principles for educators to consider when reporting clinical reasoning curricula in preclinical UME: (1) explicitly define clinical reasoning within the report, (2) report clinical reasoning theory(ies) used in the development of the curriculum, (3) clearly identify which clinical reasoning domains are addressed in the curriculum, (4) report validity evidence for assessments when available, and (5) describe how the reported curriculum fits into the larger clinical reasoning education at the institution.

Reframing context specificity in team diagnosis using the theory of distributed cognition

Context specificity refers to the vexing phenomenon whereby a physician can see two patients with the same presenting complaint, identical history and physical examination findings, but due to specific situational (contextual) factors arrives at two different diagnostic labels. Context specificity remains incompletely understood and undoubtedly leads to unwanted variance in diagnostic outcomes. Previous empirical work has demonstrated that a variety of contextual factors impacts clinical reasoning. These findings, however, have largely focused on the individual clinician; here we broaden this work to reframe context specificity in relation to clinical reasoning by an internal medicine rounding team through the lens of Distributed Cognition (DCog). In this model, we see how meaning is distributed amongst the different members of a rounding team in a dynamic fashion that evolves over time. We describe four different ways in which context specificity plays out differently in team-based clinical care than for a single clinician. While we use examples from internal medicine, we believe that the concepts we present apply equally to other specialties and fields in health care.

Developing a European longitudinal and interprofessional curriculum for clinical reasoning

Clinical reasoning is a complex and crucial ability health professions students need to acquire during their education. Despite its importance, explicit clinical reasoning teaching is not yet implemented in most health professions educational programs. Therefore, we carried out an international and interprofessional project to plan and develop a clinical reasoning curriculum with a train-the-trainer course to support educators in teaching this curriculum to students. We developed a framework and curricular blueprint. Then we created 25 student and 7 train-the-trainer learning units and we piloted 11 of these learning units at our institutions. Learners and faculty reported high satisfaction and they also provided helpful suggestions for improvements. One of the main challenges we faced was the heterogeneous understanding of clinical reasoning within and across professions. However, we learned from each other while discussing these different views and perspectives on clinical reasoning and were able to come to a shared understanding as the basis for developing the curriculum. Our curriculum fills an important gap in the availability of explicit clinical reasoning educational materials both for students and faculty and is unique with having specialists from different countries, schools, and professions. Faculty time and time for teaching clinical reasoning in existing curricula remain important barriers for implementation of clinical reasoning teaching.

Semantic competence and prototypical verbalizations are associated with higher OSCE and global medical degree scores: a multi-theory pilot study on year 6 medical student verbalizations

OBJECTIVES

The organization of medical knowledge is reflected in language and can be studied from the viewpoints of semantics and prototype theory. The purpose of this study is to analyze student verbalizations during an Objective Structured Clinical Examination (OSCE) and correlate them with test scores and final medical degree (MD) scores. We hypothesize that students whose verbalizations are semantically richer and closer to the disease prototype will show better academic performance.

METHODS

We conducted a single-center study during a year 6 (Y6) high-stakes OSCE where one probing intervention was included at the end of the exam to capture students' reasoning about one of the clinical cases. Verbalizations were transcribed and coded. An assessment panel categorized verbalizations regarding their semantic value (Weak, Good, Strong). Semantic categories and prototypical elements were compared with OSCE, case-based exam and global MD scores.

RESULTS

Students with Semantic 'Strong' verbalizations displayed higher OSCE, case-based exam and MD scores, while the use of prototypical elements was associated with higher OSCE and MD scores.

CONCLUSIONS

Semantic competence and verbalizations matching the disease prototype may identify students with better organization of medical knowledge. This work provides empirical groundwork for future research on language analysis to support assessment decisions.

Cognitive biases in internal medicine: a scoping review

BACKGROUND

Medical errors account for up to 440,000 deaths annually, and cognitive errors outpace knowledge deficits as causes of error. Cognitive biases are predispositions to respond in predictable ways, and they don't always result in error. We conducted a scoping review exploring which biases are most prevalent in Internal Medicine (IM), if and how they influence patient outcomes, and what, if any, debiasing strategies are effective.

CONTENT

We searched PubMed, OVID, ERIC, SCOPUS, PsychINFO, and CINAHL. Search terms included variations of "bias", "clinical reasoning", and IM subspecialties. Inclusion criteria were: discussing bias, clinical reasoning, and physician participants.

SUMMARY

Fifteen of 334 identified papers were included. Two papers looked beyond general IM: one each in Infectious Diseases and Critical Care. Nine papers distinguished bias from error, whereas four referenced error in their definition of bias. The most commonly studied outcomes were diagnosis, treatment, and physician impact in 47 % (7), 33 % (5), and 27 % (4) of studies, respectively. Three studies directly assessed patient outcomes. The most commonly cited biases were availability bias (60 %, 9), confirmation bias (40 %, 6), anchoring (40 %, 6), and premature closure (33 %, 5). Proposed contributing features were years of practice, stressors, and practice setting. One study found that years of practice negatively correlated with susceptibility to bias. Ten studies discussed debiasing; all reported weak or equivocal efficacy.

OUTLOOK

We found 41 biases in IM and 22 features that may predispose physicians to bias. We found little evidence directly linking biases to error, which could account for the weak evidence of bias countermeasure efficacy. Future study clearly delineating bias from error and directly assessing clinical outcomes would be insightful.

Fairness in Assessment: Identifying a Complex Adaptive System

Introduction

Assessment design in health professions education is continuously evolving. There is an increasing desire to better embrace human judgement in assessment. Thus, it is essential to understand what makes this judgement fair. This study builds upon existing literature by studying how assessment leaders conceptualise the characteristics of fair judgement.

Methods

Sixteen assessment leaders from 15 medical schools in Australia and New Zealand participated in online focus groups. Data collection and analysis occurred concurrently and iteratively. We used the constant comparison method to identify themes and build on an existing conceptual model of fair judgement in assessment.

Results

Fairness is a multi-dimensional construct with components at environment, system and individual levels. Components influencing fairness include articulated and agreed learning outcomes relating to the needs of society, a culture which allows for learner support, stakeholder agency and learning (environmental level), collection, interpretation and combination of evidence, procedural strategies (system level) and appropriate individual assessments and assessor expertise and agility (individual level).

Discussion

We observed that within the data at fractal, that is an infinite pattern repeating at different scales, could be seen suggesting fair judgement should be considered a complex adaptive system. Within complex adaptive systems, it is primarily the interaction between the entities which influences the outcome it produces, not simply the components themselves. Viewing fairness in assessment through a lens of complexity rather than as a linear, causal model has significant implications for how we design assessment programs and seek to utilise human judgement in assessment.

Profiles of Military Medical Students' Well-being, Burnout, and Retention

BACKGROUND

Well-being concerns among medical students are more prevalent than their age-matched peers in the United States. It remains unknown, however, if individual differences in well-being exist among U.S. medical students serving in the military. In this study, we sought to identify profiles (i.e., subgroups) of well-being in military medical students and examine the associations between these well-being profiles and burnout, depression, and intended retention in military and medical fields.

METHODS

Using a cross-sectional research design, we surveyed military medical students and then conducted latent class analysis to explore profiles of well-being, and applied the three-step latent class analysis method to assess predictors and outcomes of well-being profiles.

RESULTS

Heterogeneity in well-being was identified among the 336 military medical students surveyed, portraying medical students' falling into three distinct subgroups: High well-being (36%), low well-being (20%), and moderate well-being (44%). Different subgroups were associated with different risks of outcomes. Students in the subgroup of low well-being were at the highest risk of burnout, depression, and leaving medicine. In contrast, students in the moderate well-being group were at the highest risk of leaving military service.

CONCLUSIONS

These subgroups may be clinically important as burnout, depression, and intention to leave medical field and/or military service occurred with varying likelihoods among medical students across the different well-being subgroups. Military medical institutions may consider improving recruitment tools to identify the best alignment between students' career goals and the military setting. Besides, it is crucial for the institution to address diversity, equity, and inclusion issues that may lead to alienation, anxiety, and a sense of wanting to leave the military community.

Breaking Down Grit: Persistency and Flexibility in the Career Plans of Military Medical Students

INTRODUCTION

The field of medicine is experiencing a crisis as high levels of physician and trainee burnout threaten the pipeline of future physicians. Grit, or passion and perseverance for long-term goals, has been studied in high-performing and elite military units and found to be predictive of successful completion of training in adverse conditions. The Uniformed Services University of the Health Sciences (USU) graduates military medical leaders who make up a significant portion of the Military Health System physician workforce. Taken together, an improved understanding of the relationships between burnout, well-being, grit, and retention among USU graduates is critical to the success of the Military Health System.

MATERIALS AND METHODS

The current study was approved by the Institutional Review Board at USU and explored these relations among 519 medical students across three graduating classes. These students participated in two surveys approximately one year apart from October 2018 until November 2019. Participants completed measures on grit, burnout, and likelihood of leaving the military. These data were then merged with demographic and academic data (e.g., Medical College Admission Test scores) from the USU Long Term Career Outcome Study. These variables were then analyzed simultaneously using structural equation modeling to examine the relationships among variables in a single model.

RESULTS

Results reaffirmed the 2-factor model of grit as both passion and perseverance (or interest consistency). No significant relationships emerged between burnout and other study variables. Sustained and focused interest was predictive of less likelihood of staying in the military.

CONCLUSION

This study offers important insights into the relationship among well-being factors, grit, and long-term career planning in the military. The limitations of using a single-item measure of burnout and measuring behavioral intentions in a short time frame during undergraduate medical education highlight the importance of future longitudinal studies that can examine actual behaviors across a career lifespan. However, this study offers some key insights into potential impacts on the retention of military physicians. The findings suggest that military physicians who are most likely to stay in the military tend to embrace a more fluid and flexible medical specialty path. This is critical in expectation setting for the military to train and retain military physicians across a wide range of critical wartime specialties.

Evaluating a Competency-Based Blended Health Professions Education Program: A Programmatic Approach

INTRODUCTION

Competency-based education (CBE) programs usually evaluate student learning outcomes at a course level. However, a more comprehensive evaluation of student achievement of competencies requires evaluation at a programmatic level across all courses. There is currently insufficient literature on accomplishing this type of evaluation. In this article, we present an evaluation strategy adopted by the competency-based master's degree program at the Center for Health Professions Education at the Uniformed Services University of Health Sciences to assess student achievement of competencies. We hypothesized that (1) learners would grow in the competencies through their time in the program and (2) learners would exhibit a behavioristic change as a result of their participation in the program.

MATERIALS AND METHODS

The degree program at the Center for Health Professions Education conducts an annual student self-assessment of competencies using a competency survey. The competency survey data from graduated master's students were collected, providing data from three time points: initial (pre-program survey), middle, and final (end-of-program survey). Open-ended responses from these three surveys were also analyzed. A general linear model for repeated measures was conducted. Significant effects were followed by post hoc tests across time. We also conducted post hoc analysis across domains to better understand the comparative levels of the domains at each time point. The responses to the open-ended prompt were thematically analyzed.

RESULTS

Analysis of the quantitative data revealed that (1) learners reported significant growth across time, (2) learners had different perceptions of their competencies in each of the domains, and (3) not all domains experienced similar changes over time. Analysis of the free responses highlighted the impact of coursework on competency attainment and the behavioristic change in learners.

CONCLUSIONS

This study presents a strategic evaluation tool for course-based CBE programs that follow a traditional credit hour model. Programmatic evaluation of CBE programs should enable the inclusion of the learner's voice and provide evaluation data that go beyond individual course evaluations.

Prior Enlisted Medical Students at the Uniformed Services University: Outcomes During Four Years of Medical School

INTRODUCTION

The Uniformed Services University (USU) implemented the Enlisted to Medical Degree Preparatory Program (EMDP2) with the goal of enhancing the diversity of the military physician corps. Programs like EMDP2 can assist students in making the social and intellectual transition from undergraduate studies to medical school and beyond. These types of programs are also opportunities to reduce health disparities and prepare students to work in multicultural settings. The purpose of this study was to evaluate whether there was any significant difference in performance between USU medical students who had attended the EMDP2 and those who had not.

MATERIALS AND METHODS

We compared the results of National Board of Medical Examiners (NBME) Clinical Science Subjects, United States Medical Licensing Examination (USMLE) Step 1, and USMLE Step 2 Clinical Knowledge exams of EMDP2 learners from the School of Medicine classes of 2020 to 2023 to those of four similarly sized cohorts of their peers who varied by age and prior military service.

RESULTS

We found that the performance of EMDP2 graduates was comparable to their peers who followed more traditional and other alternative paths to medical school. For example, regression models showed that EMDP2 status was not a statistically significant predictor of average clerkship NBME exam score, nor of USMLE Step 1 failure.

CONCLUSION

EMDP2 graduates performed on a par with their medical school peers, and EMDP2 status does not appear to influence NBME or USMLE performance. EMDP2 provides a focused curriculum and addresses the mandate to make medical education opportunities available to a more diverse population.

Career Accomplishments of Uniformed Services University of the Health Sciences Medical Graduates: Classes 1980-2017

BACKGROUND

The current study reports career accomplishments of Uniformed Services University (USU) graduates in four areas: (1) positions held over the course of their entire career, (2) military awards, decorations, and rank, (3) first residency completed, and (4) academic achievements.

METHOD

Utilizing the responses to the alumni survey sent to USU graduates in the Class 1980 to 2017, we extracted relevant data and reported descriptive statistics.

RESULTS

1,848 out of 4,469 responded to the survey (41%). 86% (n = 1,574) of respondents indicated having served as a full-time clinician (seeing patients at least 70% of the time during a typical week), while many of them serve in leadership such as educational, operational, or command leadership roles. 87% (n = 1,579) of respondents are ranked from O-4 to O-6, and 64% (n = 1,169) of the respondents received a military award or medal. Family medicine, internal medicine, and pediatrics were the most chosen medical specialties, which is similar to the national patterns reported by AAMC. 45% (n = 781) held an academic appointment.

CONCLUSION

USU graduates continue to make significant contributions to military medicine. USU graduates' medical specialty preferences are similar to the past, which calls for further investigation to identify driving factors on such preference.

Blinding of Admissions Committee to MCAT Scores: Is There a Difference in Subsequent Medical School Performance Between Cohorts?

BACKGROUND

The Medical College Admission Test (MCAT) is designed to inform members of the admissions committee about applicants' academic readiness for medical school. Although previous work has shown that MCAT scores have some predictive validity evidence for a variety of medical student outcomes, there is also a concern that the MCAT is overly emphasized by admissions committees, which may, for example, affect matriculant diversity. The purpose of this study was to understand whether deemphasizing the MCAT by blinding committee members to applicants' specific scores has resulted in matriculants with different pre-clerkship and clerkship performance.

METHOD

The Admissions Committee from the Uniformed Services University of the Health Sciences (USU) created a policy to blind admissions committee members to MCAT scores. The MCAT-blinded policy was implemented for classes of 2022 to 2024. This MCAT-blinded cohort's performance was compared with a previous cohort, classes of 2018 to 2020. Two analyses of covariance were performed to test for differences in the pre-clerkship and clerkship module scores. Undergraduate grade point average (uGPA) and MCAT percentile for matriculants were included as covariates.

RESULTS

There were no statistically significant differences in either pre-clerkship or clerkship performance between the MCAT-revealed and MCAT-blinded cohorts.

CONCLUSION

This study found similar medical school performance between the MCAT-blinded and MCAT-revealed cohorts. The research team plans to continuously follow these two cohorts to understand their performance further down their education path, including step 1 and step 2 examinations.

LTCOS Data Management: CHPE and PDC

The purpose of this short essay is to describe the data management processes utilized in the Long Term Career Outcome Study at the Center for Health Professions Education and the Postgraduate Dental College of the Uniformed Services University. It includes descriptions of our workflow, how we obtain the data, challenges, and recommendations based on our experience for data managers and institutions to follow. This descriptive writing may help guide practice for other institutions looking to streamline their data management plan.

Well-being at a Military Medical School and Implications for Military Retention

INTRODUCTION

Physical and psychological well-being play a critical role in the academic and professional development of medical students and can alter the trajectory of a student's quality of personal and professional life. Military medical students, given their dual role as officer and student, experience unique stressors and issues that may play a role in their future intentions to continue military service, as well as practice medicine. As such, this study explores well-being across the 4 years of medical school at Uniformed Services University (USU) and how well-being relates to a student's likelihood to continue serving in the military and practicing medicine.

METHODS

In September 2019, 678 USU medical students were invited to complete a survey consisting of three sections-the Medical Student Well-being Index (MSWBI), a single-item burnout measure, and six questions regarding their likelihood of staying in the military and medical practice. Survey responses were analyzed using descriptive statistics, analysis of variance (ANOVA), and contingency table analysis. Additionally, thematic analysis was conducted on open-ended responses included as part of the likelihood questions.

RESULTS

Our MSWBI and burnout scores suggest that the overall state of well-being among medical students at USU is comparable to other studies of the medical student population. ANOVA revealed class differences among the four cohorts, highlighted by improved well-being scores as students transitioned from clerkships to their fourth-year curriculum. Fewer clinical students (MS3s and MS4s), compared to pre-clerkship students, indicated a desire to stay in the military. In contrast, a higher percentage of clinical students seemed to "reconsider" their medical career choice compared to their pre-clerkship student counterparts. "Medicine-oriented" likelihood questions were associated with four unique MSWBI items, whereas "military-oriented" likelihood questions were associated with one unique MSWBI item.

CONCLUSION

The present study found that the overall state of well-being in USU medical students is satisfactory, but opportunities for improvement exist. Medical student well-being seemed to have a stronger association with medicine-oriented likelihood items than with military-oriented likelihood items. To obtain and refine best practices for strengthening engagement and commitment, future research should examine if and how military and medical contexts converge and diverge throughout training. This may enhance the medical school and training experience and, ultimately, reinforce, or strengthen, the desire and commitment to practice and serve in military medicine.

The Retention of USUHS Military Physicians: An Exploratory Study

BACKGROUND

Previously, researchers investigated the career accomplishments of USU medical graduates using the data from a USU alumni survey. To better understand if such accomplishments are related to military retention, the current study investigates the relationship between accomplishments (such as military career milestones and academic achievement) and military retention.

METHODS

Utilizing the responses to the alumni survey sent to USU graduates in the Classes of 1980 to 2017, the researchers investigated the relationship between a series of survey items (e.g., military rank, medical specialties, and operation experiences) and military retention.

RESULTS

Among the respondents who had a deployment history in support of an operational mission, 206 (67.1%) stayed longer than their initial active duty service or planned on staying longer than their current active duty service commitment. Fellowship directors (n = 65, 72.3%) showed a higher retention rate than other positions. The PHS alumni had the highest retention rate (n = 39, 69%) of the military branches, whereas physicians in medical specialties with higher demand (e.g., otolaryngology and psychiatry) showed less promising retention.

CONCLUSIONS

By conducting future research on underlying reasons as to why full-time clinicians, junior physicians, and physicians in medical specialties with higher demand showed less promising retention, stakeholders will be able to identify what needs to be addressed to retain highly skilled physicians in the military.

Teaching Students How to Think: A Longitudinal Qualitative Study of Preclerkship Clinical Reasoning Instruction

INTRODUCTION

An objective of undergraduate medical education is to teach students how to think like physicians through a process called clinical reasoning. Currently, clerkship directors often feel that students enter their clinical years with a marginal comprehension of clinical reasoning concepts; instruction in this area could be improved. Although there have been previous educational studies assessing curricular interventions to improve the instruction of clinical reasoning, it is not yet known what happens at an individual level between an instructor and a small group of students in the teaching of clinical reasoning. This research will identify how clinical reasoning is being taught in a longitudinal clinical reasoning course.

METHODS

The Introduction to Clinical Reasoning course is a 15-month-long case-based course held in the preclinical curriculum of the USU. Individual sessions involve small-group learning with approximately seven students per group. Throughout the academic year of 2018-2019, 10 of these sessions were videotaped and transcribed. All participants provided informed consent. A thematic analysis was performed using a constant comparative approach. Transcripts were analyzed until thematic sufficiency was reached.

RESULTS

Over 300 pages of text were analyzed; new themes ceased to be identified after the eighth session. Topics included obstetrics, general pediatric issues, jaundice, and chest pain; these sessions were taught either by attendings, fellows, or fourth-year medical students with attending supervision. The thematic analysis revealed themes associated with clinical reasoning processes, themes associated with knowledge organization, and a theme associated with clinical reasoning in the military. The clinical reasoning process themes included problem list construction and refinement, differential diagnosis, naming and defending a leading diagnosis, and clinical reasoning heuristics. The knowledge organization themes included illness script development and refinement and semantic competence. The final theme was military relevant care.

CONCLUSIONS

In individual teaching sessions, preceptors emphasized problem lists, differential diagnoses, and leading diagnoses in a course designed to strengthen diagnostic reasoning in preclerkship medical students. The use of illness scripts was more often implicitly used rather than explicitly stated, and students used these sessions to use and apply new vocabularies related to a clinical presentation. Instruction in clinical reasoning could be improved by encouraging faculty to provide further context to their thinking, by encouraging the comparing and contrasting of illness scripts, and by using a shared vocabulary for clinical reasoning. Limitations of this study include that it was done in the context of a clinical reasoning course and that it was done at a military medical school, which may limit generalizability. Future studies could determine if faculty development could improve the frequency of references to the clinical reasoning processes that could improve student readiness for clerkship.

Military Medical Students' Coping With Stress to Maintain Well-being

INTRODUCTION

Previous studies have shown that medical students experience a great level of burnout and poor well-being during their clinical training periods. In this study, we sought to understand how military medical students cope with stress to prevent burnout and support their well-being. We also investigated if these coping strategies are associated with military medical students' self-reported well-being, burnout, and depression levels. The findings could help inform programming, resources, and educational strategies to better support students to thrive in their careers long term.

METHODS

Using a cross-sectional research design, we surveyed military medical students and conducted content analysis on participant responses to the open-ended item by trained coders. Coding was based on the existing coping theory frameworks as well as categories that emerged inductively to represent the data.

RESULTS

The primary four strategies military medical students utilized included social connection (59.9%), exercise (58.3%), personal relaxation (36%), and work-life balance (15.7%). The use of work-life balance strategy was significantly associated with more positive well-being and lower depression compared to those who did not use this strategy. Three main coping typologies were further extracted, including personal care, connection, and cognitive strategies. Based on the typologies, 62% of students were recognized as multi-type copers (who combined more than two coping typologies), who reported significantly more positive well-being compared to students who relied on a single typology.

CONCLUSIONS

The findings demonstrate that certain coping strategies are more positively associated with a good state of well-being and less burnout, and that utilization of multiple types of coping strategies is more supportive. This study amplifies the voice of military medical students concerning the importance of prioritizing self-care and available resources given the unique pressures and demands of their dual military medical curriculum.

Relationship Between Gender and Academic and Military Achievement Among USU Medical School Graduates

INTRODUCTION

Despite increases in the number of female matriculants in medical school, civilian data demonstrate that women still struggle to reach parity in attainment of leadership positions. In military medicine, we have seen a major increase in the number of women graduating from the USU. Yet, we still know little about the representation of female military physicians in leadership positions. The aim of this study is to examine the relationship between gender and academic and military achievement among USU School of Medicine graduates.

METHODS

Utilizing the USU alumni survey sent to graduates from the classes of 1980 to 2017, items of interest, such as highest military rank, leadership positions held, academic rank, and time in service, were used to evaluate the relationship between gender and academic and military achievement. Contingency table statistical analysis was conducted to compare the gender distribution on the survey items of interest.

RESULTS

Pairwise comparison demonstrated significant differences between gender in the O-4 (P = .003) and O-6 (P = .0002) groups, with females having a higher-than-expected number of O-4 officers and males having a higher-than-expected number of O-6 officers. These differences persisted in a subsample analysis that excluded those who separated from active duty prior to 20 years of service. There was a significant association between gender and holding the position of commanding officer (χ2(1) = 6.61, P < .05) with fewer females than expected. In addition, there was a significant association between gender and the highest academic rank achieved (χ2(3) = 9.48, P < 0.05) with lower-than-expected number of females reaching the level of full professor, in contrast to males who exceed the expected number.

CONCLUSIONS

This study suggests that female graduates of USU School of Medicine have not achieved promotion to the highest levels of rank, military, or academic leadership at the projected rate. Efforts to explore what barriers may impact military medicine's desire to have more equal representation of women in higher ranks and positions should be undertaken with specific attention to what drives retention versus separation of medical officers and if systematic changes are needed to help promote equity for women in military medicine.

Evaluating Intersite Consistency Across 11 Geographically Distinct Pediatric Clerkship Training Sites: Providing Assurance That Educational Comparability Is Possible

INTRODUCTION

We compared core pediatric clerkship student assessments across 11 geographically distinct learning environments following a major curriculum change. We sought to determine if intersite consistency existed, which can be used as a marker of program evaluation success.

METHODS

We evaluated students' overall pediatric clerkship performance along with individual assessments that target our clerkship learning objectives. Using the data of graduating classes from 2015 to 2019 (N = 859), we conducted an analysis of covariance and multivariate logistic regression analysis to investigate whether the performance varied across training sites.

RESULTS

Of the students, 833 (97%) were included in the study. The majority of the training sites did not show statistically significant differences from each other. After controlling for the Medical College Admission Test total score and the average pre-clerkship National Board of Medical Examiners final exam score, the clerkship site only explained a 3% additional variance of the clerkship final grade.

CONCLUSIONS

Over the ensuing 5-year period after a curriculum overhaul to an 18-month, integrated module pre-clerkship curriculum, we found that student pediatric clerkship performance in clinical knowledge and skills did not differ significantly across 11 varied geographic teaching sites when controlling for students' pre-clerkship achievement. Specialty-specific curriculum resources, faculty development tools, and assessment of learning objectives may provide a framework for maintaining intersite consistency when faced with an expanding network of teaching facilities and faculty.

"Primum Non Nocere"-First, Do No Harm: A Retrospective Review of the Impact of Curricular Reform on USUHS Graduates' Performance During Their PGY-1 Year

PURPOSE

To determine whether medical school curricular change impacted the assessment of graduates in their first year of postgraduate training.

METHODS

The authors examined for differences in the survey of postgraduate year one (PGY-1) program directors for Uniformed Services University (USU) medical school graduates from the Classes of 2011 and 2012 (pre-curriculum reform, pre-CR), Classes of 2015, 2016, and 2017 (curriculum transition), and Classes of 2017, 2018, and 2019 (post-curriculum reform, post-CR). Multivariate analysis of variance was used to explore for differences among the cohorts in the 5 previously identified factors on the PGY-1 survey (Medical Expertise; Professionalism; Military Unique Practice, Deployments and Humanitarian Missions; System-Based Practice and Practiced-Based Learning; Communication and Interpersonal Skills). Nonparametric tests were used when the error variance between cohorts was found to be unequal across samples. Kruskal-Wallis (a rank ordered analysis of variance) and Tamhan's T2 were used to characterize specific differences.

RESULTS

There were 801 students included: 245 (pre-CR); 298 (curricular transition); and 212 (post-CR). Multivariate analysis of variance demonstrated significant differences in all survey factors among the comparison groups. From pre-CR to the curricular transition, ratings in all factors declined, but none reached the level of a statistical significance. Ratings of all 5 factors showed significant improvement from the curricular transition to post-CR, and scores from pre-CR to post-CR trended in the positive direction with Practice-Based Learning (effect size 0.77), showing significant gains.

CONCLUSION

Ratings by PGY-1 program directors of USU graduates over time demonstrated a very small decline soon after curriculum reform but later showed a large improvement in domains reflecting areas of emphasis in the curriculum. In the eyes of a key stakeholder, the USU curriculum reform did no harm and led to improved PGY-1 assessments.

A Comparison of HPSP and USU Graduates' Preparation for Residency

INTRODUCTION

Military medical students enter residency through two main pathways: (1) The Uniformed Services University (USU) and (2) the Armed Services Health Professions Scholarship Program (HPSP). The purpose of this study was to compare how these two pathways prepare military medical students for residency.

METHODS

We conducted semi-structured interviews with 18 experienced military residency program directors (PDs) in order to explore their perceptions of the preparedness of USU and HPSP graduates. We used a transcendental phenomenological qualitative research design to bracket our biases and guide our data analysis. Our research team coded each of the interview transcripts. We then organized these codes into themes, which served as the results of our study.

RESULTS

Five themes emerged from our data regarding the residents' preparedness: (1) Ability to navigate the military culture, (2) understanding of the military's medical mission, (3) clinical preparation, (4) ability to navigate the Military Health System (MHS), and (5) teamwork. The PDs described how USU graduates better understand the military's medical mission and are more easily able to navigate the military culture and the MHS because of their lived experiences during military medical school. They also discussed the various levels of clinical preparation of HPSP graduates, in contrast to the USU graduates' more consistent skills and abilities. Finally, the PDs believed both groups to be strong team players.

CONCLUSIONS

USU students were consistently prepared for a strong start to residency because of their military medical school training. HPSP students often experienced a steep learning curve because of the newness of the military culture and MHS.

Reflecting on LTCOS Scholarship and Implications for Educational Practice

The Long Term Career Outcome Study is a central program of research in the Center for Health Professions Education at the Uniformed Services University. The overarching goal of Long Term Career Outcome Study is to perform evidence-based evaluations before, during, and after medical school, and as such, it represents a form of educational epidemiology. In this essay, we highlighted the findings of the investigations published in this special issue. These investigations span from "before" medical school matriculation to "during" medical school and "after" learners go on to graduate training and practice. Furthermore, we discuss how this scholarship might shed light on improving the educational practices at the Uniformed Services University and potentially elsewhere. We hope that this work demonstrates how research can enhance medical education processes and connect research, policy, and practice.

Supporting the Transition to Distance Education During the Pandemic and Beyond

INTRODUCTION

The coronavirus disease 2019 (COVID-19) pandemic affected almost every country around the world, and various forms of lockdown or quarantine measures were implemented. The lockdowns forced medical educators to step beyond traditional educational approaches and adopt distance education technologies to maintain continuity in the curriculum. This article presents selected strategies implemented by the Distance Learning Lab (DLL) at the Uniformed Services University of Health Sciences (USU), School of Medicine (SOM), in transitioning their instruction to an emergency distance education format during the COVID-19 pandemic.

MATERIALS AND METHODS

When moving programs/courses to a distance education format, it is important to recognize that two primary stakeholders are involved in the process: faculty members and students. Therefore, to be successful in transitioning to distance education, strategies must address the needs of both groups and provide support and resources for both.The DLL used two lenses of adult learning and targeted needs assessment to design faculty and student support during the pandemic. The DLL adopted a learner-centered approach to education, focusing on meeting the faculty members and students where they are. This translated into three specific support strategies for faculty: (1) workshops, (2) individualized support, and (3) just-in-time self-paced support. For students, DLL faculty members conducted orientation sessions and provided just-in-time self-paced support.

RESULTS

The DLL has conducted 440 consultations and 120 workshops for faculty members since March 2020, serving 626 faculty members (above 70% of SOM faculty members locally) at USU. In addition, the faculty support website has had 633 visitors and 3,455 pageviews. Feedback comments provided by faculty members have specifically highlighted the personalized approach and the active, participatory elements of the workshops and consultations.Evaluations of the student orientation sessions showed that they felt more confident in using the technologies after the orientation. The biggest increase in confidence levels was seen in the topic areas and technology tools unfamiliar to them. However, even for tools that students were familiar with before the orientation, there was an increase in confidence ratings.

CONCLUSION

Post-pandemic, the potential to use distance education remains. It is important to have support units that recognize and cater to the singular needs of medical faculty members and students as they continue to use distance technologies to facilitate student learning.

Surveying the Middle Ground: A Thematic Analysis of the Medical School Applications of Standard Performers

INTRODUCTION

As gatekeepers to the medical profession, admissions committees make important decisions through the analysis of quantitative (e.g. test scores and grade point averages) and qualitative (e.g. letters of recommendation and personal statements) data. One area of the application that deserves additional study is the Work and Activities section, where students describe their extracurricular experiences. Previous research has found different themes that sometimes overlap in the applications of exceptional performing and low performing medical students, but it is unclear if these themes are present in the applications of standard performers.

MATERIALS AND METHODS

An exceptional performing medical student is defined as one who was inducted into both the Alpha Omega Alpha Honor Medical Society and the Gold Humanism Honor Society. A low performing medical student is one who was referred to the Student Promotions Committee (SPC) where an administrative action was made. A standard performing medical student is defined as someone who was neither a member of an honor society nor referred to the SPC during medical school. Using a constant comparative method, the applications of standard performers who graduated from the Uniformed Services University between 2017 and 2019 was assessed using exceptional performer themes (success in a practiced activity, altruism, teamwork, entrepreneurship, wisdom, passion, and perseverance) and low performer themes (witnessing teamwork, embellishment of achievement, and description of a future event). The presence of novel themes was also assessed. The absolute number of themes and the diversity of themes were determined. Demographic data were collected (age, gender, number of Medical School Admissions Test [MCAT] attempts, highest MCAT score, and cumulative undergraduate grade point average), and descriptive statistics was performed.

RESULTS

A total of 327 standard performers were identified between 2017 and 2019. No novel themes were found after coding 20 applications. All exceptional performer themes were identified in the population of standard performers. The low performing theme of embellishment of achievement was not found. Standard performers had a lower number of total exceptional performer themes and a lower diversity of exceptional performer themes compared to low and exceptional performers, but standard performers also had a lower number and less diversity of low performing themes compared to low performers.

CONCLUSIONS

This study suggests that the diversity and frequency of exceptional performing themes in a medical school application may be useful in distinguishing between exceptional performers and other performers, though the small sample size limits quantitative conclusions. Low performing themes may be specific to low performers and thus could be useful to admissions committees. Future studies should include a larger sample size and could assess for predictive validity evidence of these exceptional performing and low performing themes through a blinded protocol.

Undergraduate Medical Education Leader Performance Predicts Postgraduate Military Leader Performance

INTRODUCTION

Developing physicians as leaders has gained attention across the United States. Undergraduate medical education (UME) and graduate medical education (GME) leader development programs have increased. During postgraduate years (PGY), graduates bring their leadership education to the bedside; however, associations between leader performance in medical school and GME is largely unknown. It is important to find experiences that can assess leader performance that may be useful to predict future performance. The purpose of this study was to determine if (1) there is a correlation between leader performance during the fourth year of medical school versus leader performance in PGY1 and 3, and (2) leader performance during the fourth year of medical school is associated with military leadership performance in PGY1 and 3s while taking previous academic performance markers into account.

METHODS

This study examined overall leader performance of learners (classes of 2016-2018) during the fourth year of medical school and their graduate leader performance post-medical school. Leader performance was assessed by faculty during a medical field practicum (UME leader performance) and graduate leader performance was assessed by program directors at the end of PGY1 (N = 297; 58.3%) and 3 (N = 142; 28.1%). Pearson correlation analysis examined relationships among UME leader performance and between the PGY leader performance items. In addition, stepwise multiple linear regression analyses were conducted to examine the relationship between leader performance at the end of medical school with military leadership performance in PGY1 and 3, while taking into account the academic performance markers.

RESULTS

Pearson correlation analyses revealed that the UME leader performance was correlated with 3 of 10 variables at PGY1, and was correlated at PGY3 with 10 out of 10 variables. Results of the stepwise multiple linear regression analysis indicated that leader performance during the fourth year of medical school explained an additional 3.5% of the variance of PGY1 leader performance after controlling for the previous academic performance markers (MCAT total score, USMLE Step 1 score and Step 2 CK score). In contrast, leader performance during the fourth year of medical school alone accounted for an additional 10.9% of the variance of PGY3 leader performance above and beyond the set of academic performance markers. Overall, UME leader performance has more predictive power in PGY leader performance than the MCAT or USMLE Step exams.

CONCLUSIONS

The findings of this study indicate that a positive relationship exists between leader performance at the end of medical school and leader performance in PGY1 and 3 years of residency. These correlations were stronger in PGY3 compared to PGY1. During PGY1, learners may be more focused on being a physician and an effective team member compared to PGY3 where they have a deeper understanding of their roles and responsibilities and can take on more leadership roles. Additionally, this study also found that MCAT and USMLE Step exams performance was not predictive of PGY1 or PGY3 leader performance. These findings provide evidence of the power of continued leader development in UME and beyond.

Using Resident-Sensitive Quality Measures Derived From Electronic Health Record Data to Assess Residents' Performance in Pediatric Emergency Medicine

PURPOSE

Traditional quality metrics do not adequately represent the clinical work done by residents and, thus, cannot be used to link residency training to health care quality. This study aimed to determine whether electronic health record (EHR) data can be used to meaningfully assess residents' clinical performance in pediatric emergency medicine using resident-sensitive quality measures (RSQMs).

METHOD

EHR data for asthma and bronchiolitis RSQMs from Cincinnati Children's Hospital Medical Center, a quaternary children's hospital, between July 1, 2017, and June 30, 2019, were analyzed by ranking residents based on composite scores calculated using raw, unadjusted, and case-mix adjusted latent score models, with lower percentiles indicating a lower quality of care and performance. Reliability and associations between the scores produced by the 3 scoring models were compared. Resident and patient characteristics associated with performance in the highest and lowest tertiles and changes in residents' rank after case-mix adjustments were also identified.

RESULTS

274 residents and 1,891 individual encounters of bronchiolitis patients aged 0-1 as well as 270 residents and 1,752 individual encounters of asthmatic patients aged 2-21 were included in the analysis. The minimum reliability requirement to create a composite score was met for asthma data (α = 0.77), but not bronchiolitis (α = 0.17). The asthma composite scores showed high correlations ( r = 0.90-0.99) between raw, latent, and adjusted composite scores. After case-mix adjustments, residents' absolute percentile rank shifted on average 10 percentiles. Residents who dropped by 10 or more percentiles were likely to be more junior, saw fewer patients, cared for less acute and younger patients, or had patients with a longer emergency department stay.

CONCLUSIONS

For some clinical areas, it is possible to use EHR data, adjusted for patient complexity, to meaningfully assess residents' clinical performance and identify opportunities for quality improvement.

Gender and Racial Representation Trends Among Internal Medicine Department Chairs from 2010-2020

BACKGROUND

Quality medical education, reduction in health disparities, and healthcare research that includes all members of society are enhanced by diversity in departments of internal medicine (IM). Research on increasing diversity within the academic medicine student body or faculty notes the important role of leadership. Yet, there is a scarcity in research into diversity in leadership.

OBJECTIVE

The purpose of this study is to go beyond aggregate numbers and answer the question: What is the level of parity representation, by gender and race, at department chair positions in academic IM departments?

DESIGN

A cross-sectional analysis of race/ethnicity and gender in IM medical school departments from 2010 to 2020 was conducted using data from the American Association of Medical College's (AAMC) Faculty Roster. The proportion of IM department chairs to IM faculty by race/ethnicity for each year (2010-2020) was used to calculate the Leadership Parity Index (LPI) in this study. LPI by gender and by gender and race/ethnicity were also calculated for each year.

RESULTS

In aggregate numbers, Black or African American and Hispanic, Latino, or of Spanish Origin faculty remain under-represented in academic IM each making up, on average, approximately 4% of the total IM faculty. The LPI calculations revealed that faculty who identified as White were consistently over-represented as department chairs while Asian faculty were consistently under-represented in leadership and ranked lowest in leadership parity among the ethnic groups studied. The leadership parity index also showed that women faculty across all races were under-represented.

CONCLUSION

Women and Asian faculty encounter a ceiling effect that may be at play in IM departments. While significant progress still needs to be made in the representation of under-represented minorities, the findings of this study show that aggregate data does not provide a true picture of equity and parity in Internal Medicine faculties.

From Their Eyes: What Constitutes Quality Formative Written Feedback for Neurosurgery Residents

BACKGROUND

The characteristics of quality feedback from the neurosurgery resident's perspective are not fully elucidated. The Surgical Autonomy Program is an intraoperative assessment tool based on Vygotsky's Zone of Proximal Development (ZPD). SAP facilitates assessment of a resident's operative performance accompanied by written feedback.

OBJECTIVE

The goal of this study was twofold: to identify themes from the written feedback of SAP operative assessments and to examine if these themes influenced the neurosurgery residents' perception of feedback quality.

METHODS

In 2021, SAP data from 2019-2021 at two neurosurgery programs were reviewed. Feedback quality from the SAP was determined by the resident at the time of their assessment. Using a constant comparative technique, the feedback was coded using a thematic analysis. The quality of feedback within each code was analyzed.

RESULTS

There were 2968 SAP entries evaluated. When the ZPD concept was fully used, residents reported high quality feedback 91.4% of the time compared to 58.6% when ZPD was not used (p < 0.001). Qualitative analysis of the written feedback revealed five themes: Non-Specific, Specific General Observations, Key Points, Next Steps, and Independent Practice. Feedback in the Specific General Observations, Key Points, and Independent Practice categories were associated with higher level feedback than leaving the space blank (p < 0.001) or writing Non-Specific comments (p < 0.001).

CONCLUSIONS

Providing comments that discuss the resident's specific performance in the case, key learning points, or their progress towards independence, results in high quality feedback. Utilizing a theory-based tool such as the SAP can provide meaningful feedback to neurosurgical residents.

Clinical Reasoning Curricula in Health Professions Education: A Scoping Review

OBJECTIVES

This scoping review aimed to explore and synthesize current literature to advance the understanding of how to design clinical reasoning (CR) curricula for students in health professions education.

METHODS

Arksey and O'Malley's 6-stage framework was applied. Peer-reviewed articles were searched in PubMed, Web of Science, CINAHL, and manual searches, resulting in the identification of 2932 studies.

RESULTS

Twenty-six articles were included on CR in medical, nursing, physical therapy, occupational therapy, midwifery, dentistry, and speech language therapy education. The results describe: features of CR curriculum design; CR theories, models, and frameworks that inform curricula; and teaching content, methods, and assessments that inform CR curricula.

CONCLUSIONS

Several CR theories, teaching, and assessment methods are integrated into CR curricula, reflecting the multidimensionality of CR among professions. Specific CR elements are addressed in several curricula; however, no all-encompassing CR curriculum design has been identified. These findings offer useful insights for educators into how CR can be taught and assessed, but they also suggest the need for further guidance on educational strategies and assessments while learners progress through an educational program.

Management Reasoning: Empirical Determination of Key Features and a Conceptual Model

PURPOSE

Management reasoning is a critical yet understudied phenomenon in clinical practice and medical education. The authors sought to empirically identify key features of management reasoning and construct a model describing the management reasoning process.

METHOD

In November 2020, 4 investigators each reviewed 10 video clips of simulated outpatient physician-patient encounters and used a coding form to document key features and insights related to management reasoning. The team used a constant comparative approach to distill 120 pages of raw observations into an 18-page list of management tasks, processes, and insights. The team then had a series of discussions to iteratively refine these findings into a parsimonious model of management reasoning.

RESULTS

The investigators empirically identified 12 distinct features of management reasoning: contrasting and selection among multiple solutions; prioritization of patient, clinician, and system preferences and constraints; communication and shared decision making; ongoing monitoring and adjustment of the management plan; dynamic interplay among people, systems, and competing priorities; illness-specific knowledge; process knowledge; management scripts; clinician roles as patient teacher and salesperson; clinician-patient relationship; prognostication; and organization of the clinical encounter (sequencing and time management). Management scripts seemed to play a prominent and critical role. The model of management reasoning comprised 4 steps: instantiation of a management script, identifying (multiple) options and beginning to teach the patient, shared decision making, and ongoing monitoring and adjustment. This model also conceives 2 overarching features: that management reasoning is personalized to the patient and that it occurs between individuals rather than exclusively within the clinician's mind.

CONCLUSIONS

Management scripts constitute a key feature of management reasoning, along with teaching patients about viable options, shared decision making, ongoing monitoring and adjustment, and personalization. Management reasoning seems to be constructed and negotiated between individuals rather than exclusively within the clinician.

Context matters: toward a multilevel perspective on context in clinical reasoning and error

Context in diagnosis and management of patients is a vexing phenomenon in medicine and health professions education that can lead to unwanted variation in clinical reasoning performance and even errors that cause patient harm. Studies have examined individual-, team-, and system-level contextual factors, but the ways in which multiple contextual factors can interact, how both distracting and enabling factors can impact performance and error, and the boundaries between context and content information are not well understood. In this paper, we use a theory-based approach to enhance our understanding of context. We introduce a multilevel perspective on context that extends prior models of clinical reasoning and propose a micro-meso-macro framework to provide a more integrated understanding of how clinical reasoning is both influenced by and emerges from multiple contextual factors. The multilevel approach can also be used to study other social phenomena in medicine such as professionalism, learning, burnout, and implicit bias. We call for a new paradigm in clinical reasoning research and education that uses multilevel theory and analysis to enhance clinical reasoning performance expertise and improve the quality of patient care.