Health Systems Science in Medical Education: Unifying the Components to Catalyze Transformation

The interplay between research expectations and perceived barriers: a mediation analysis among Chinese medical undergraduates

BACKGROUND

Scientific research activity is essential to drive undergraduate medical education innovation, but many barriers prevent students from participating in research activities. While many studies have identified these challenges, the psychological factors, such as research expectations and interest, influencing students' perceptions of these barriers have been less explored. This study intends to explore these barriers and how research expectations, through interest, influence student engagement in research.

METHODS

This cross-sectional study involved 322 medical students from Shandong University. The majority of participants were from the specialty of Clinical Medicine (72.36%), with other students from non-Clinical specialties (e.g. Public Health and Preventive Medicine, etc.). A structured questionnaire was used, measuring five key areas: demographics, scholarly characteristics, current research experience, attitudes toward research barriers, and research expectations. Statistical analyses, including Ordered logistic regression, Spearman's correlation, and Mediation analysis, were employed to assess research expectations' direct and indirect effects on perceived barriers through research interest.

RESULTS

The study found that the most significant barriers to research were lack of mentorship, heavy academic workload, lack of research skills, and insufficient funding. Students with higher research expectations reported greater perceived barriers, but their higher levels of research interest reduced the perceived impact of these barriers. Mediation analysis found that research interest acted as a mediator between expectations and barriers, with a significant indirect effect of expectations on barriers through interest. This study highlights the complex interaction between research expectations, interest, and perceived barriers in undergraduate medical education.

CONCLUSIONS

The findings suggest that while high expectations may increase the awareness of challenges, strong intrinsic interest in research mitigates the impact of these barriers. Integrating more research-related courses into the training program, and providing adequate mentorship and resources to support students' research engagement will help cultivate a research-oriented mindset among medical undergraduates.

Lessons learned from implementing health systems science and community service course for fourth-year medical students

BACKGROUND

With the call to integrate health systems science (HSS) in medical education curriculum comes the need for more practical guidance from implementation experiences. In June 2020, the University of Texas Medical Branch John Sealy School of Medicine implemented a required course entitled "Health Systems Science and Community Service (HSS)" for fourth-year medical students. This quality improvement study describes the course and the lessons learned in the first four iterations.

METHODS

The course was formatted as a 10-month-long, asynchronous course that ran concurrently with post-clerkship rotations. Throughout the four iterations, we used close- and open-ended questions to systematically collect students' feedback twice annually. Descriptive analysis of quantitative data was performed, and general themes were drawn from qualitative items from the evaluations. In addition, the National Board of Medical Examiner (NBME) HSS Subject Examination was administered in the course during the third and fourth iterations; student performance was analyzed. The course contents were iteratively revised each year to incorporate more HSS and community service components.

RESULTS

The course cohorts 1 through 4 from each iteration had 234, 221, 220, and 217 students, respectively. The response rates for the end-of-year course evaluations were 91% for cohorts 1, 2, and 3, and 94% for cohort 4. Most students reported that the amount of material they were required to cover was reasonable across all four iterations. While most respondents from cohorts 1, 2, and 4 found the number of community service hours reasonable, the majority of respondents in cohort 3 indicated it was excessive. The common themes from students' responses across cohorts included that some of the course content should have been taught in earlier years of their medical training, that community service activities are valuable but should have been optional, and that students appreciated the flexibility of the course. Student performance on the NBME exam was comparable to national performance. We summarized the iterative changes for each cohort based on feedback.

CONCLUSIONS

We described the implementation of a post-clerkship course on health systems science integrating with community service and service-learning. A major lesson learned was the need to take an iterative approach in building components like service-learning and addressing challenges, including student buy-in.

Building a health systems science bridge between medical school and the clinical learning environment via a pilot faculty development cohort program

BACKGROUND

Clinical faculty development focused on Health Systems Science (HSS) is crucial for integrating HSS concepts into medical education. The 2021 HSSIP Faculty Development program was created to support faculty in effectively creating and incorporating comprehensive HSS content into the clerkship experience.

METHODS

Nine clinical champions, selected for their diverse backgrounds and interest in HSS, participated from November 2021 through October 2022 in monthly day-long, in-person workshops, and bi-monthly self-directed sessions, covering both HSS domains and foundational learning in curriculum development. Using a community of practice model, clinical champions gained expertise in HSS domains and developed curricula throughout the year-long program. Evaluation methods included surveys and feedback, focusing on satisfaction, self-efficacy, and curricular content creation.

RESULTS

Post-engagement surveys showed increased comfort in teaching HSS content, with significant improvement in specific areas. Participants valued learning from experts and collaborating with peers but found virtual sessions challenging. Despite systemic challenges and time constraints, clinical champions successfully created and implemented HSS-focused curricular content. They also contributed to broader HSS education efforts, presenting scholarly work and integrating HSS into various educational activities.

CONCLUSIONS

This study showcases an innovative approach to preparing faculty to integrate HSS into clinical education. Key lessons included the value of subject matter experts, community engagement, and the challenges of virtual participation. Despite limitations such as low response numbers and context-specific results, the program demonstrated the potential for broad HSS integration. Further research with more participants and more rigorous data collection protocols is needed to more fully understand the generalizability of such an innovation. The initiative serves as a model for other academic health centers.

Implementation of High-Value Care for Physical Therapy Residents Through Systems-Based Practice Curriculum Development: Case Report

BACKGROUND AND PURPOSE

Systems-based practice is a core competency for physical therapy residents, best acquired through experiential learning. Peer health professions are further along than physical therapy in implementing curricula that support systems-based practice. Clinical and practice data in residency programs could provide for education in high-value care (HVC) as a foundation for systems-based practice. Our purpose was to develop and assess a HVC curriculum incorporating reflective practice to help residents achieve competency in systems-based practice.

CASE DESCRIPTION

The Logic Model, which evaluates key components needed for success and sustainability, was used to identify resources for a curriculum in HVC. Two orthopedic physical therapy residents and 5 faculty mentors participated in didactic and mentoring sessions. A practice dashboard for each clinician was developed to facilitate resident-mentor discussions. Focus group input was used to refine the curriculum. The validated Systems Thinking Scale, the Quality Improvement Knowledge Application Tool Rubric, and the American Physical Therapy Association Residency Core Competency Score were used to assess residents' progress and to make comparisons to prior years' residents.

OUTCOMES

The residents demonstrated increases in systems thinking and quality-improvement knowledge and improvements in clinical outcomes and practice efficiencies. Three themes emerged from semistructured interviews: challenges to HVC, current approach in HVC, and future-oriented thinking in HVC in practice.

DISCUSSION AND CONCLUSION

This study demonstrates that HVC activities and a personalized clinical dashboard in a physical therapy residency program can facilitate experiential learning of systems-based practice, a core competency for value-centered, inclusive practice.

Current status of healthcare financial literacy among medical trainees and junior hospitalists: An observational survey study

The absence of comprehensive education on hospital value-based purchasing during undergraduate medical education may lead to inadequate comprehension of healthcare finance during Graduate Medical Education and subsequent medical practice. Medicine residents and junior hospitalists (defined as those who completed their residency in the last 5 years) may lack essential healthcare financial skills to address the needs of their patients and the healthcare system effectively. To assess healthcare financial literacy among medical students, medicine residents, and junior hospitalists, we conducted a survey at an academic Internal Medicine residency affiliated with a US Medical School. Participants completed a 40-item questionnaire sourced from federal government healthcare system websites, providing demographic data and indicating prior formal healthcare finance education. Of the 126 respondents, only 15.6% reported receiving formal healthcare financial education, with merely 4 out of 34 junior hospitalists having prior education. Notably, there were no significant differences in correct answer percentages between 3rd and 4th-year medical students, medicine residents, and junior hospitalists across 3 domains: Medicaid/Medicare insurance, US healthcare systems & insurance, and healthcare access, quality and value-based purchasing. However, participants performed better in the domain of Medicaid/Medicare insurance compared to the other domains. This study underscores the potential deficiency in financial skills among junior healthcare providers, highlighting the importance of addressing this gap to ensure effective patient care.

Exploring clinician perspectives of systems-based practice: A physician training challenge

INTRODUCTION

Systems-based practice (SBP) has been a competency in US graduate medical education for over 20 years, but it is not well implemented. SBP is loosely defined as physician's responsiveness to the larger system of healthcare. The aim of this study was to describe healthcare professionals' perspectives regarding: (1) their knowledge and beliefs about SBP and (2) their beliefs regarding factors in clinical learning environments (CLE) that facilitate or hinder operationalisation and learning of SBP.

METHODS

Semi-structured interviews were conducted between November 2020 and April 2021 with 42 individuals from four health systems. Participants were healthcare professionals involved in graduate medical education, including physicians and interprofessional clinicians (e.g., nursing staff). Interviews were transcribed and coded using a social constructivist, codebook thematic analysis approach and themes were agreed upon through discussion amongst the research team.

RESULTS

Five themes were constructed: (1) SBP remains a challenge to define, (2) SBP may be intuitively understood, particularly when framed at the microsystem level, (3) SBP aligns with the Health Systems Science framework, (4) SBP learning must be intentionally integrated into the CLE, through training such as onboarding and (5) multidisciplinary settings and work processes are critical to engage in SBP. Workload compression is a barrier to SBP implementation.

CONCLUSIONS

Healthcare professionals highlighted that current CLEs are not designed to prioritise SBP. Graduate medical education programmes may benefit from focusing systems content at the microsystem level and purposefully integrating onboarding procedures, clinical settings and rotations specifically designed to teach SBP into their residencies.

Supporting Care Transformation Through a Comprehensive Graduate Medical Education Curricular Program in a Department of Internal Medicine

BACKGROUND

The imperative to train physicians in skills required to lead care transformation is increasingly recognized, yet few Graduate Medical Education (GME) programs exist to meet this need.

AIM

Describe the development, outcomes, and lessons learned from a novel GME care transformation curricular program.

SETTING

Department of Internal Medicine (IM) at Dell Medical School at The University of Texas, Austin.

PARTICIPANTS

Between 2020 and 2023, 33 IM residents and fellows completed training with participation in the Care Transformation program.

PROGRAM DESCRIPTION

Department leadership developed a comprehensive educational and experiential program that included (1) Dell Medical School-wide Distinction in Care Transformation curriculum; (2) Primary Care Residency track with care transformation projects; (3) participation in the national Veterans Affairs Chief Resident in Quality and Safety program; and (4) Hospital Medicine Fellowship in Quality and Safety.

PROGRAM EVALUATION

Each trainee led a care transformation project spanning a variety of topics and settings. Graduates who responded to a follow-up survey (22 of 33 graduates) reported they used skills learned through the program in their current roles and these experiences better prepared them for fellowship and/or faculty positions.

DISCUSSION

The Care Transformation program provides real-world experiences and skillsets that are increasingly valuable in modern healthcare delivery.

Identity Work: A Qualitative Study of Residents' Experiences Navigating Identity Struggles

Introduction

Medical training traditionally holds a deterministic view of professional socialization wherein many medical learners struggle to construct a professional identity. Previous research has demonstrated the dysfunctional norms and conflicting ideologies that create identity struggle, disproportionally affecting women and individuals underrepresented in medicine. Symbolic interactionism can help explain identity struggles, emphasizing the influence of socio-contextual factors on identity construction. The purpose of this study was to explore how residents navigate identity struggles during residency training.

Method

We conducted a qualitative exploration of 12 residents in three specialties at three academic institutions in the United States. Participants engaged in rich picture drawings followed by one-on-one interviews. We coded transcript data and met regularly to identify themes related to residents' experiences with navigating professional identity struggles.

Results

We identified three main themes on navigating identity struggles: the weight of identity work, the isolating nature of identity work, and the navigation that occurs with and against socio-contextual currents. Residents described identity work as navigation like a boat at sea. This work felt weighty and at times overwhelming and residents often felt unable to discuss their identity struggles with others. Residents utilized what agency they had to either navigate with the current, navigating towards acceptable-albeit imperfect-paths forward, or attempting to go against the current to forge new paths through resistance.

Discussion

This study highlights how context enables and constrains identity construction, how contextual constraints can create dissonance between identities, and the considerable effort required to reconcile dissonance and construct professional identities. Training program adjustments, enhanced resident support, and cultural shifts are required to sustain residents' identity work. Medical professionals should engage in collective identity work to reimagine the profession's identity by addressing dysfunctional cultural norms.

Systems-Based Practice: Expert Perspectives on the Origin and Evolution of an Ambiguous Competency

PURPOSE

Systems-based practice (SBP) has been a core competency in graduate medical education in the United States since 1999, but it has been difficult to operationalize in residency programs due to its conceptual ambiguity. The authors explored the historical origin and subsequent development of the SBP competency from the perspective of individuals who were influential across critical phases of its implementation and ensuing development. The goal of this study was to elicit the history of SBP from the perspective of individuals who have expertise in it and to use those findings to inform the current SBP construct.

METHOD

Between March and July 2021, 24 physicians, nurses, educators, and leaders in the field of SBP were individually interviewed about the origin and meaning of SBP as practiced in U.S. medical education using a semistructured guide. Individuals were selected based upon their influence on the origin or evolution of the SBP competency. Data were iteratively collected and analyzed using real-time analytic memos, regular adjudication sessions with the research team, and thematic analysis. Researchers identified themes from participants' perspectives and agreed upon the final results and quotations.

RESULTS

Five themes were identified: SBP has many different definitions, SBP was intentionally designed to be vague, systems thinking was identified as the foundation of the SBP competency, the 6 core competencies established in the United States by the Accreditation Council for Graduate Medical Education were developed to be interdependent, and the SBP and practice-based learning and improvement competencies are uniquely related and synergistic.

CONCLUSIONS

Interview data indicate that since its inception, SBP has been a nuanced and complex competency, resulting in a lack of mutually shared understanding among stakeholders. This deliberate historical examination of expert perspectives provides insight into specific areas for improving how SBP is taught and learned.

Systems-Based Practice in Graduate Medical Education: Evolving Toward an Ideal Future State

ABSTRACT

Systems-based practice (SBP) was first introduced as a core competency in graduate medical education (GME) in 2002 by the Accreditation Council for Graduate Medical Education as part of the Outcomes Project. While inclusion of SBP content in GME has become increasingly common, there have also been well-documented stumbling blocks, including perceptions that SBP has eroded the amount of curricular time available for more medically focused competencies, is not relevant for some practice contexts, and is not introduced early enough in training. As a result, SBP learning experiences often feel disconnected from medical trainees' practical reality. In this commentary, the authors provide guidance regarding potential changes that may facilitate the evolution of SBP toward an ideal future state where graduates bring a systems science mindset to all aspects of their work. Specific suggestions include the following: (1) expanding the SBP toolbox to reflect current-day health system needs, (2) evolve the teaching methodology, (3) broadening the scope of relevant SBP content areas, and (4) emphasizing SBP as an integrated responsibility for all health care team members. Levers to enact this transformation exist and must be used to influence change at the learner, faculty, program, and clinical learning environment levels.Physicians operate within an increasingly complex health care system that highlights the intersection of health care with complex social, environmental, and relational contexts. Consequently, the role of SBP in both physician work responsibilities and educational requirements continues to expand. To meet this growing demand, GME must adapt how it supports and trains the next generation of systems thinkers, ensuring they understand how levers in the health care system directly affect health outcomes for their patients, and integrate SBP into the foundation of GME curricula in an inclusive, holistic, and unrestrained way.

Advocacy for Health Justice: An Innovative Pilot Course for MD and Master of Public Policy Students

Problem: U.S. medical schools are searching for ways to address issues of health justice in undergraduate medical education. Physicians have not typically received training in how to be effective advocates for systemic change and individuals in policy fields are not usually equipped to understand the complex issues of health science and their intersection with the health system and society. To address this gap, medical school faculty partnered with school of public policy faculty on a collaborative learning model that engaged MD and Master of Public Policy students together to strengthen their collective knowledge of the healthcare landscape, and to build skills to work for health justice. Intervention: We hypothesized that pairing medical students with public policy students to learn about the intersections of health justice and advocacy could enhance the efficacy of each group and provide a new model of collaboration between medical and policy professionals. The students collaborated on a health justice advocacy project through which they provided consultation to an established community organization. Context: The 8-week course took place in the spring of 2021 in Los Angeles, California. Due to Covid-19 the course was taught online and included asynchronous learning modules and live Zoom sessions. The project also served as a pilot for the post-clerkship phase of a new longitudinal health justice curriculum for MD students that launched in August 2021. Impact: Analysis of student work products, course evaluations, partner interviews, and student focus groups showed that students valued learning through their interdisciplinary collaborative work which gave them new perspectives on health justice issues. The community partners indicated that the students consultative work products were useful for their initiatives, and that they found working with MD and MPP students to be a valuable way to think about how to build stronger and more inclusive coalitions to advocate for health justice. This project has the potential for national impact as it aligns with the Association of American Medical Colleges' renewed focus on the responsibility of academic medicine to partner with communities for health justice. The project also contributed to the national conversation on how to align health systems science education with the aims of health justice through our participation in the American Medical Association Accelerating Change in Medical Education Consortium. Lessons Learned: Leveraging faculty relationships with community partners was crucial for developing meaningful projects for students. Cultivating and expanding community partner networks is necessary to sustain and scale up this type of intervention. Centering the needs of communities and supporting their on-going work for health justice is essential for becoming an effective advocate. Learning communities that bring interdisciplinary students, healthcare providers, policy professionals, and community partners together to learn from one another can create key opportunities for ameliorating health inequities.

Integrating basic, clinical, and health system science in a medical neuroscience course of an integrated pre-clerkship curriculum

Basic science, clinical science, and health system science (HSS) have become three pillars of integration upon which modern, post-Flexner, medical education is now based. Because of this new approach to curricular integration in a clinical presentation curruculum, medical training is now placed in the context of healthcare delivery. This study described the design, implementation, and assessment of an integrated teaching strategy, including the effect on students' performance in a medical neuroscience course's summative and formative examinations of an integrated clinical presentation curriculum. The integrated teaching of basic science content, clinical case discussion, and HSS was performed in the first year of an allopathic integrated pre-clerkship curriculum. The two cohorts were from two different years, spring 2018 and 2019. The acceptance of the integrated teaching strategy by medical students was above 80% in all categories that were assessed, including enhancing the integrated experience in learning basic and clinical science materials in the context of HSS; understanding of the learning lessons; facilitation of self-directed learning; provision of a better learning environment; and a holistic understanding of materials including the relevance of HSS issues in the discussion of neurological cases in the medical career of the students. More than 90% of the students scored ≥70% in summative questions mapped to the four learning objectives of the integrated teaching session. The objectives are the correlation of structure to specific functions (94.0 ± 0.21), clinical anatomical features of the nervous system (95.0 ± 0.27), cross-sectional features of the nervous system (96.0 ± 0.31), and the effect of lesions on the structure and functional pathways of the nervous system (97.0 ± 0.34). This result was significantly higher when compared to students' performance in the non-integrated teaching cohort (p < 0.05). Formative assessments (F(7,159) = 92.52, p < 0.001) were significantly different between the two groups. When medical students were evaluated using the same questions for formative assessment, they performed better in the integrated teaching cohort (*p < 0.05) compared to the non-integrated teaching cohort (**p < 0.05).

Twelve tips for creating a longitudinal quality improvement and safety education for early health professions students

Despite the numerous calls for integrating quality improvement and patient safety (QIPS) curricula into health professions education, there are limited examples of effective implementation for early learners. Typically, pre-clinical QIPS experiences involve lectures or lessons that are disconnected from the practice of medicine. Consequently, students often prioritize other content they consider more important. As a result, they may enter clinical settings without essential QIPS skills and struggle to incorporate these concepts into their early professional identity formation. In this paper, we present twelve tips aimed at assisting educators in developing QIPS education early in the curricula of health professions students. These tips address various key issues, including aligning incentives, providing longitudinal experiences, incorporating real-world care outcomes, optimizing learning environments, communicating successes, and continually enhancing education and care delivery processes.

"The Water in Which We Swim:" A Unique, Post-Clerkship Multidisciplinary Course

OBJECTIVE

To improve patient outcomes and promote health equity, medical students must be taught not only biomedicine, but also the social sciences to understand the larger contexts in which patients live and health care operates. Yet, most undergraduate medical education does not explicitly cover these topics in a required, longitudinal curriculum.

METHODS

In January 2015 at Harvard Medical School, we created a two-part sequence (pre- and post-clerkship) of required, 4-week multidisciplinary courses-"Essentials of the Profession I and II"-to fill this gap. "Essentials of the Profession II (EOP2)" is an advanced social sciences course anchored in patient narratives and the lived experiences of students and includes clinical epidemiology and population health, healthcare delivery and leadership, health policy, medical ethics and professionalism, and social medicine that engages students to conduct structural analyses to be effective healers, advocates, and leaders.

RESULTS

Per student course evaluations, the overall course rating was 1.7 (SD 0.9, 1 = excellent and 5 = poor); its overall rating has improved over time; and it has scored well even when run virtually. It was rated highly in application of critical thinking, integration of the disciplines, and relevance for clinical work. Qualitative analyses of student responses revealed the following key course strengths: breadth of topics, teaching faculty and guest speakers, and small group discussions. The weaknesses included workload, lack of diversity of opinions, repetition, and time spent in lectures.

CONCLUSIONS

We argue that EOP2 is "essential" for post-clerkship medical education. It offers an opportunity to re-ignite and enhance humanism and activism; remind students why they chose the medical profession; equip them with frameworks and toolkits to help them to overcome challenges; and devise solutions to improve health care and patient outcomes that are applicable to their future training and ongoing practice of medicine.

Effects of an Experiential Learning Curriculum on Systems-Thinking

Introduction

Though health systems science (HSS) is referred to as the third pillar of medical education along with the pillars of basic science and clinical care, the effects of learning theories used to teach components of HSS including quality improvement/ patient safety (QI/PS), are poorly understood. Experiential learning theory is often referenced in QI/ PS education but its effects on QI/PS education are not well-described.

Objective

To examine the effects of teaching QI using experiential learning theory on resident systems-thinking.

Methods

Data was gathered from 30 resident participants in a 3-h QI workshop designed using experiential learning theory. Using a mixed-methods design, aspects of learner systems-thinking were analyzed both before and after the workshop. Learners were asked about their confidence in systems-thinking behaviors, and their QI plans were evaluated qualitatively for themes as well as quantitatively via the QIKAT-R.

Results

There was a significant increase in self-reported confidence in systems-thinking behaviors post-workshop. Odds ratio of the QI aim statement focusing on the systems-level of the problem after the workshop was 41.4 with a 95% CI of 8.9142 to 192.2721, p-value .0001. Thematic analysis of QI plans revealed a change in residents' thinking about healthcare problems. They shifted from attributing problems to individual actors to thinking about the problem as lying in the interaction between systems.

Conclusion

Experiential learning theory can be an effective framework for QI to transform learners into systems-thinkers.

Supporting Medical Education Innovation: Evaluation of a Grants Initiative

PROBLEM

Medical education must evolve to meet the changing needs of patients and communities. Innovation is a critical component of that evolution. As medical educators pursue innovative curricula, assessments, and evaluation techniques, the impact of innovations may be limited by minimal funding. The American Medical Association (AMA) Innovation Grant Program, launched in 2018, seeks to address the gap in funding and stimulate educational innovation and research in medical education.

APPROACH

In 2018 and 2019, the Innovation Grant Program targeted innovation in content areas including health systems science, competency-based medical education, coaching, learning environment, and emerging technology. The authors reviewed the content of applications and final reports for the 27 projects completed during the first 2 years of the program. They also noted measures of success (completion of project, achievement of grant objectives, development of transferrable educational product, dissemination).

OUTCOMES

In 2018, the AMA received 52 submissions and funded 13 proposals, dispersing $290,000 ($10,000 and $30,000 grants). In 2019, the AMA received 80 submissions and funded 15 proposals, dispersing $345,000. Among the 27 completed grants, 17 (63%) supported innovations related to health systems science. Fifteen (56%) were used to create educational products that could be shared, such as new assessment tools, curricula, and teaching modules. Five grant recipients (29%) published articles and 15 (56%) presented at national conferences.

NEXT STEPS

The grant program advanced educational innovations, particularly in health systems science. The next steps will involve examining the long-term outcomes and impact of the completed projects on medical students, patients, and the health system; the professional development of the grantees; and the adoption and dissemination of the innovations.

Health Systems Science - A Primer for Radiologists

Health systems science (HSS) is an educational framework designed to promote improved care through enhanced citizenship and the training of systems-fluent individuals trained in the science of health care delivery.  HSS education in residency builds upon foundations established during medical school, emphasizing practical skills development, and fostering a growth mindset among trainees.  The HSS framework organizes elements of system-based practice for radiology trainees, promoting practice-readiness for providing safe, timely, effective, efficient, equitable and patient centered radiological care. This paper serves as a primer for radiologists to understand and apply the HSS framework. Additionally, we highlight radiology-specific curricular elements aligned with the HSS framework, and provide teaching resources both for classroom education and for resident self-study.

A theoretical and practical approach to quality improvement education

Quality Improvement (QI) knowledge and skills are required at all levels of physician training. System improvement efforts need to include understanding of health disparities and design of interventions to reduce those disparities, thus health equity needs to be integrated into QI education. Payors, accreditation bodies and health systems' emphases on QI result in the need for QI curricula that meet the needs of diverse learners. This article presents a theoretical background and practical tools for designing, implementing, and evaluating a QI educational program across the spectrum of physician training with an emphasis on competency-based education and a goal of continuous practice improvement. Practice-based learning and improvement and systems-based practice are two core domains of competencies for readiness to practice. These competencies can be met through the health systems science framework for studying improvement in patient care and health care delivery coupled with QI science. Curricula should incorporate interactive learning of theory and principles of QI as well as mentored, experiential QI project work with multidisciplinary teams. QI projects often develop ideas and implement changes but are often inconsistent in studying intervention impacts or reaching the level of patient outcomes. Curriculum design should incorporate adult learning principles, competency based medical education, environmental and audience factors, and formats for content delivery. Key QI topics and how they fit into the clinical environment and teaching resources are provided, as well as options for faculty development. Approaches to evaluation are presented, along with tools for assessing learner's beliefs and attitudes, knowledge and application of QI principles, project evaluation, competency and curriculum evaluation. If the goal is to empower the next generation of change agents, there remains a need for development of scientific methodology and scholarly work, as well as faculty development and support by institutions.

Consensus on Social Determinants of Health Knowledge Topics and Behavior Learning Goals Across Primary Care Residencies: Results of a Delphi Study

PURPOSE

Social determinants of health (SDH) are a substantial contributor to health outcomes and health inequities across populations. The Accreditation Council for Graduate Medical Education has called for the incorporation of SDH into graduate medical education (GME), yet there is no consensus on what SDH knowledge or skills residents in primary care specialties should have on completion of training. The aim of this study was to develop expert consensus on the most important SDH knowledge topics and behavior learning goals for residents in 4 primary care fields.

METHOD

The authors used a modified Delphi technique to develop consensus among experts in internal medicine, pediatrics, family medicine, and obstetrics and gynecology across the United States via a survey administered between February and October 2021. They conducted a literature review on SDH in GME to develop an initial set of topics and learning goals and recruited experts who published about SDH and GME or led an SDH curriculum in GME. Consensus was determined a priori as 80% agreement that a topic or learning goal was very or extremely important.

RESULTS

Forty-one experts participated in the first round of the survey and 33 participated in the second round (80% retention). Experts reached consensus on the importance of 22/51 (43%) topics and 18/47 (38%) learning goals. Topics reaching consensus emphasized structural forces, broad domains of SDH, resources for addressing SDH, and advocacy strategies and resources. Learning goals reaching consensus focused on individual- and interpersonal-level behaviors.

CONCLUSIONS

To the authors' knowledge, this study represents the first rigorous evaluation of expert consensus on SDH in GME across 4 primary care specialties. The results could inform curriculum development and implementation and program evaluation, residency program goals, and shared GME milestones. Among other things, future studies can assess expert consensus on SDH in GME across nonprimary care specialties.

A Pilot Study Assessment of Medical Student Knowledge and System Citizenship Attitudes Pertaining to Health Systems Science

Background and Purpose

Health system science (HSS) has been described as the third pillar of medical education. We introduced a new health system science and interprofessional practice (HSSIP) curriculum, and measured students' HSS knowledge and attitudes concerning health system citizenship.

Methods

This pilot study involved first-year (M1) and fourth-year (M4) medical students in two cohorts across 2 years. Only M1 students in the second cohort participated in the new HSSIP curriculum. We compared student performance on a new National Board of Medical Examiners (NBME) HSS subject exam, and student attitudes toward system citizenship via a new attitudinal survey.

Results

Fifty-six eligible fourth-year students (68%) and 70 (76%) study eligible first-year students participated in the study. NBME HSS exam performance by M4 students was statistically significantly higher than M1 students for both cohorts, with moderate to large effect sizes. Exam performance for M1 students not experiencing the HSS curriculum was higher than for M1 students who received HSS curricular content. Attitudes toward HSS by M4 versus M1 students were statistically significantly different on several survey items with moderate effect sizes. Scale internal consistency for the HSS attitude survey was strong (0.83 or higher).

Discussion

There were differences among M4 and M1 medical students concerning knowledge of and attitudes toward HSS, with performance on the NBME subject exam similar to a national sample. Exam performance by M1 students was likely impacted by class size and other factors. Our results support the need for increased attention to HSS during medical education. Our health system citizenship survey has potential for further development and cross-institutional collaboration.

Advancing Systems Citizenship in Colleges and Schools of Pharmacy

The pharmacy academy works collectively to serve the educational needs of diverse stakeholders by promulgating expectations for professional programs to achieve standards for both practice and professional development. Building systems thinking into the learning process, with its associative benefits to postgraduate preparation and lifelong practice, offers a pathway to achieve this educational mission. The concept of systems citizenship has been suggested as a process for helping health professional students incorporate a meaningful professional identity and responsibly seek out an understanding of the connections between patients, communities, and the larger institutions and environments that affect each. Drawing on the discipline of systems thinking, the student and pharmacist learn to be effective locally by thinking globally. Systems thinking, a basis for effective citizenship, is a proactive and shared approach to problem-solving that integrates professional identity with the goal of closing gaps in care. Pharmacy colleges/schools provide an opportune forum for educating professional students and postgraduates with the knowledge, skills, and abilities critical to becoming valuable and contributing systems citizens.

Neurology Education in 2035: The Neurology Future Forecasting Series

In the past decade, there have been dramatic changes in all aspects of neurologic care, and along with this, neurology education has transformed. These changes have affected all aspects of education across the educational continuum, including learners, teachers, educators, content, delivery methods, assessments, and outcomes. Health systems science, health humanities, diversity, equity, and inclusion and health disparities are becoming core components of neurology curricula, and, in the future, will be integrated into every aspect of our educational mission. The ways in which material is taught and learned have been influenced by technologic innovations and a growing understanding of the science of learning. We forecast that this trend will continue, with learners choosing from an array of electronic resources to engage with fundamental topics, allowing front-line clinical teachers to spend more time supporting critical reasoning and teaching students how to learn. There has been a growing differentiation of educational roles (i.e., teachers, educators, and scholars). We forecast that these roles will become more distinct, each with an individualized pattern of support and expectations. Assessment has become more aligned with the work of the learners, and there are growing calls to focus more on the impact of educational programs on patient care. We forecast that there will be an increased emphasis on educational outcomes and public accountability for training programs. In this article, we reflect on the history of medical education in neurology and explore the current state to forecast the future of neurology education and discuss ways in which we can prepare.

Clinical informatics training in medical school education curricula: a scoping review

OBJECTIVES

This scoping review evaluates the existing literature on clinical informatics (CI) training in medical schools. It aims to determine the essential components of a CI curriculum in medical schools, identify methods to evaluate the effectiveness of a CI-focused education, and understand its delivery modes.

MATERIALS AND METHODS

This review was informed by the methodological guidance of the Joanna Briggs Institute. Three electronic databases including PubMed, Scopus, and Web of Science were searched for articles discussing CI between January 2010 and December 2021.

RESULTS

Fifty-nine out of 3055 articles were included in our final analysis. Components of CI education include its utilization in clinical practice, ethical implications, key CI-related concepts, and digital health. Evaluation of educational effectiveness entails external evaluation by organizations external to the teaching institute, and internal evaluation from within the teaching institute. Finally, modes of delivery include various pedagogical strategies and teaching CI using a multidisciplinary approach.

DISCUSSION

Given the broad discussion on the required competencies, we propose 4 recommendations in CI delivery. These include situating CI curriculum within specific contexts, developing evidence-based guidelines for a robust CI education, developing validated assessment techniques to evaluate curriculum effectiveness, and equipping educators with relevant CI training.

CONCLUSION

The literature reveals that CI training in the core curricula will complement if not enhance clinical skills, reiterating the need to equip students with relevant CI competencies. Furthermore, future research needs to comprehensively address current gaps in CI training in different contexts, evaluation methodologies, and delivery modes to facilitate structured training.

The Primary Care Transformation Executive Fellowship to Develop Community Health Center Leaders

INTRODUCTION

Although many primary care providers from community health centers recognize health disparities and work to transform healthcare, skill gaps and limited support may hinder their ability to be change agents. The Primary Care Transformation Executive (PCTE) Fellowship at A.T. Still University School of Osteopathic Medicine in Arizona (ATSU-SOMA) seeks to address these barriers by providing professional development and support to primary care providers interested in leading change in the nation's health centers.

METHODS

The PCTE Fellowship is a structured, one-year interprofessional learning experience that emphasizes topics such as healthcare transformation, interprofessional practice, leadership development, and systems thinking. Quantitative and qualitative evaluation of the program was accomplished through surveys and semi-structured interviews throughout the fellowship.

RESULTS

Feedback from 18 fellows showed perceived improvements in knowledge and skills related to the various curricular topics, increased engagement in leadership activities, and career advancement. Fellows developed practice and quality improvement projects and successfully implemented the projects within their health systems, addressing observed disparities.

CONCLUSION

Professional development and directed support for primary care providers can enhance their engagement in healthcare transformation and advance health equity.

An Investment in Knowledge: Personal Finance Education for Medical Students

The financial burden of pursuing a medical education continues to grow, with the average medical student now owing over $240,000 in total student loan debt by the time they graduate. This burden peaks at a time when trainees are making some of the most consequential decisions of their careers. Additionally, many students are simultaneously making important financial decisions related to personal aspirations, all before a drastic change in earning potential once they begin practicing as attending physicians. Medical trainees' financial stress is linked to specialty choice, mental quality of life, and physician burnout, with additional implications of such stress for patient health and safety.1- 3 Despite these issues, there are few examples of medical schools providing direct personal finance education to their students. Given the lack of personal finance education opportunities for medical students, the authors designed and implemented a medical student-specific personal finance curriculum at their home institution in conjunction with the Association of American Medical Colleges' (AAMC) Financial Information, Resources, Services, and Tools program. The curriculum, which is primarily delivered through interactive lectures, covers topics ranging from the basics of saving and investment to clinicians' potential future roles as administrators and innovators. The authors (1) present details regarding the creation of their personal finance education program; (2) invite fellow medical trainees and their respective institutions to start their own personal finance education programs or add similar curriculum to their health sciences coursework; and (3) call for recommendations by the American Medical Association (AMA) and AAMC in support of formal personal finance instruction for medical students on a national level.

Development and Implementation of a Medical School Course Integrating Basic, Clinical, and Health Systems Sciences

OBJECTIVE

In recent years, significant steps have been made in integrating basic science and clinical medicine. There remains a gap in adding the third pillar of education: health systems science (HSS). Core clerkships represent an ideal learning venue to integrate all three. Students can experience the value of integrating basic science as they learn clinical medicine in environments where HSS is occurring all around them.

METHODS

We outline the creation of Sciences and Art of Medicine Integrated (SAMI), a course that runs parallel with the clerkship year and integrates basic science and HSS with clinical medicine. A complete description of the planning and implementation of SAMI is provided. We include the participants and educational setting, the goals and objectives, and the structure of each session. To encourage the integration of basic science, HSS, and clinical medicine, students utilize a series of tools, described in detail. Examples of each tool are provided utilizing a case of a patient presenting with obstructive sleep apnea.

RESULTS

We successfully implemented this course with positive reception from students.

CONCLUSION

This course represents a step not only toward the integration of HSS with basic science and clinical medicine but also an advancement in training future clinicians to provide high-value care. Future curricular development must consider the validation of a measure of clinical reasoning that assesses a student's ability to think in a cognitively integrated fashion about basic science, HSS, and clinical medicine demonstrated by enhanced justification of clinical reasoning and a more holistic approach to planning patient care.

"Finding My Piece in That Puzzle": A Qualitative Study Exploring How Medical Students at Four U.S. Schools Envision Their Future Professional Identity in Relation to Health Systems

PURPOSE

Health systems science (HSS) curricula equip future physicians to improve patient, population, and health systems outcomes (i.e., to become "systems citizens"), but the degree to which medical students internalize this conception of the physician role remains unclear. This study aimed to explore how students envision their future professional identity in relation to the system and identify experiences relevant to this aspect of identity formation.

METHOD

Between December 2018 and September 2019, authors interviewed 48 students at 4 U.S. medical schools with HSS curricula. Semistructured interviews were audiorecorded, transcribed, and analyzed iteratively using inductive thematic analysis. Interview questions explored how students understood the health system, systems-related activities they envisioned as future physicians, and experiences and considerations shaping their perspectives.

RESULTS

Most students anticipated enacting one or more systems-related roles as a future physician, categorized as "bottom-up" efforts enacted at a patient or community level (humanist, connector, steward) or "top-down" efforts enacted at a system or policy level (system improver, system scholar, policy advocate). Corresponding activities included attending to social determinants of health or serving medically underserved populations, connecting patients with team members to address systems-related barriers, stewarding health care resources, conducting quality improvement projects, researching/teaching systems topics, and advocating for policy change. Students attributed systems-related aspirations to experiences beyond HSS curricula (e.g., low-income background; work or volunteer experience; undergraduate studies; exposure to systems challenges affecting patients; supportive classmates, faculty, and institutional culture). Students also described future-oriented considerations promoting or undermining identification with systems-related roles (responsibility, affinity, ability, efficacy, priority, reality, consequences).

CONCLUSIONS

This study illuminates systems-related roles medical students at 4 schools with HSS curricula envisioned as part of their future physician identity and highlights past/present experiences and future-oriented considerations shaping identification with such roles. These findings inform practical strategies to support professional identity formation inclusive of systems engagement.

Bridging medical education goals and health system outcomes: An instrumental case study of pre-clerkship students' improvement projects

INTRODUCTION

Many medical schools engage students in health system improvement (HSI) efforts. Evaluation of these efforts often focuses on students' learning outcomes and rarely considers the impact on health systems, despite the significant commitment health systems make to these efforts. Our study identified and evaluated system-level outcomes of pre-clerkship medical students' engagement in HSI efforts.

METHODS

We used an instrumental case study approach to examine the effects of pre-clerkship medical students' engagement in HSI projects as part of a 15-month experiential curriculum. We extracted data from 53 project summaries and posters completed during the 2017-18 academic year and follow-up survey data collected in May 2019 from physician coaches and health system professionals who mentored students, contributed to these projects, and worked in the clinical microsystems where the projects occurred.

RESULTS

We identified three categories and ten indicators of health system outcomes relevant to medical student engagement in HSI. Using these indicators, our evaluation found multiple benefits to the microsystems in which projects occurred. These included achievement of project aims, perceived immediate and sustained project impact on the health system, and development and implementation of projects with aims that aligned with national and health system priorities.

CONCLUSION

Evaluation of HSI curricula needs to include effects on health systems so that program design can optimize the experience for all involved. Our study offers a framework others can use to evaluate system-level effects of project-based HSI curricula and shows several ways in which students' engagement can add value to health systems.

A lasting impact? Exploring the immediate and longitudinal impact of an emergency department service learning help desk program

Background

The emergency department (ED) help desk is an undergraduate-run service learning program that screens ED patients for social needs, connects them to community resources, and follows-up to promote connections with resources. Students accepted to the program participate in a didactic course on the fundamentals of social emergency medicine as well as available community resources. Students also receive training around interviewing patients and use of screening software. Students commit to at least three quarters of service, during which they attend weekly team meetings.

Methods

This qualitative study explores the impact of this service learning experience for students. Current and former students were identified by the director of the program. Purposive and snowball sampling was used to select a sample of participants that participated in a semistructured interview. Our codebook was developed inductively using thematic analysis. Themes were presented and discussed with the entire research team for further analysis and refinement. Data collection and analysis used a constant comparative approach, and data collection ceased when saturation was achieved.

Results

Study participants consisted of current and former ED help desk student volunteers (n = 21). All participants believed that the ED help desk service learning experience prepared them for future careers by providing an experience that filled a gap in their education. We identified four main themes: (1) participants' perceived impact on patients, (2) learning from patients' experiences and differences, (3) appreciating patients' vulnerability and collaboratively addressing patients' needs, and (4) learning to navigate patients' social needs within the broader health care system.

Conclusions

Our ED help desk service learning program offers a unique experience for students to learn about patients' social needs, participate in meaningfully interactions with patients, and empower themselves and patients to work together as coproducers of patients' care.

Preparing Faculty to Incorporate Health Systems Science into the Clinical Learning Environment: Factors Associated with Sustained Outcomes

This study assesses participants' perceptions of long-term impacts of the Teachers of Quality Academy, a medical school faculty development program designed to prepare faculty to both practice and teach health system science. A previously published 1-year evaluation of the first cohort of 27 participants showed improved perceived skills, with positive career and health system impacts. In this 5-year evaluation, a mixed-methods design included a questionnaire followed by semistructured interviews to assess perceived long-term impacts on participants. Quantitative and qualitative analyses were completed. Questionnaire response rate was 88% (N = 22), and 14 interviews were analyzed. Results demonstrated that participants had incorporated quality improvement concepts into their clinical work and teaching, better understood interprofessionalism, and observed continued improvements in care delivery. They felt the longitudinal training, delivered in a shared setting, created a learning community with lasting positive effects in institutional culture, supported long-term professional development, and had broader institutional impact. Advancements in clinical care, medical education, and professional and academic advancements were noted.

Evolving the Systems-Based Practice Competency in Graduate Medical Education to Meet Patient Needs in the 21st-Century Health Care System

Medical education is increasingly recognizing the importance of the systems-based practice (SBP) competency in the emerging 21st-century U.S. health care landscape. In the wake of data documenting insufficiencies in care delivery, notably in patient safety and health care disparities, the Accreditation Council for Graduate Medical Education created the SBP competency to address gaps in health outcomes and facilitate the education of trainees to better meet the needs of patients. Despite the introduction of SBP over 20 years ago, efforts to realize its potential have been incomplete and fragmented. Several challenges exist, including difficulty in operationalizing and evaluating SBP in current clinical learning environments. This inconsistent evolution of SBP has compromised the professional development of physicians who are increasingly expected to advance systems of care and actively contribute to improving patient outcomes, patient and care team experience, and costs of care. The authors prioritize 5 areas of focus necessary to further evolve SBP: comprehensive systems-based learning content, a professional development continuum, teaching and assessment methods, clinical learning environments in which SBP is learned and practiced, and professional identity as systems citizens. Accelerating the evolution of SBP in these 5 focus areas will require health system leaders and educators to embrace complexity with a systems thinking mindset, use coproduction between sponsoring health systems and education programs, create new roles to drive alignment of system and educational goals, and use design thinking to propel improvement efforts. The evolution of SBP is essential to cultivate the next generation of collaboratively effective, systems-minded professionals and improve patient outcomes.

Expert Consensus Guidelines for Assessing Students on the Social Determinants of Health

PHENOMENON

Assessment and evaluation guidelines inform programmatic changes necessary for educational effectiveness. Presently, no widely accepted guidelines exist for educators to assess learners and evaluate programs regarding social determinants of health (SDOH) during physician and physician assistant (PA) education. We sought to garner expert consensus about effective SDOH learner assessment and program evaluation, so as to make recommendations for best practices related to SDOH education.

APPROACH

We used a Delphi approach to conduct our study (September 2019 to December 2020). To administer our Delphi survey, we followed a three-step process: 1) literature review, 2) focus groups and semi-structured interviews, 3) question development and refinement. The final survey contained 72 items that addressed SDOH content areas, assessment methods, assessors, assessment integration, and program evaluation. Survey participants included 14 SDOH experts at US medical schools and PA programs. The survey was circulated for three rounds seeking consensus, and when respondents reached consensus on a particular question, that question was removed from subsequent rounds.

FINDINGS

The geographically diverse sample of experts reached consensus on many aspects of SDOH assessment and evaluation. The experts selected three important areas to assess learners' knowledge, skills, and attitudes about SDOH. They identified assessment methods that were "essential", "useful, but not essential", and "not necessary." The essential assessment methods are performance rating scales for knowledge and attitudes and skill-based assessments. They favored faculty and patients as assessors, as well as learner self-assessment, over assessments conducted by other health professionals. Questions about separation versus incorporation of SDOH assessment with other educational assessment did not yield consensus opinion. The experts reached consensus on priority outcome measures to evaluate a school's SDOH program which included student attitudes toward SDOH, Competence-Based Assessment Scales, and the percentage of graduates involved in health equity initiatives.

INSIGHTS

Based on the Delphi survey results, we make five recommendations that medical and PA educators can apply now when designing learner assessments and evaluating SDOH programming. These recommendations include what should be assessed, using what methods, who should do the assessments, and how they should be incorporated into the curriculum. This expert consensus should guide future development of an assessment and evaluation toolkit to optimize SDOH education and clinical practice.

Supplemental data for this article is available online at https://doi.org/10.1080/10401334.2022.2045490 .

Final-year medical students' self-assessment of facets of competence for beginning residents

BACKGROUND

Final-year undergraduate medical students often do not feel well prepared for their start of residency training. Self-assessment of competences is important so that medical trainees can take responsibility for their learning. In this study, we investigated how final-year medical students self-assessed their competences as they neared their transition to postgraduate training. The aim was to identify areas for improvement in undergraduate training.

METHODS

In the academic year 2019/2020, a national online survey was sent to final-year undergraduate medical students via their respective medical schools. The survey included ten facets of competence (FOC) most relevant for beginning residents. The participants were asked to self-assess their competence for each FOC on a 5-point Likert scale (1: strongly disagree to 5: strongly agree). We established an order of self-assessed FOC performance by means and calculated paired t-tests. Gender differences were assessed with independent t-tests.

RESULTS

A total of 1083 students from 35 medical schools completed the questionnaire. Mean age was 27.2 ± 3.1 years and 65.8% were female. Students rated their performance highest in the FOCs 'Teamwork and collegiality' and 'Empathy and openness' (97.1 and 95.0% 'strongly agree' or 'agree', respectively) and lowest in 'Verbal communication with colleagues and supervisors' and 'Scientifically and empirically grounded method of working' (22.8 and 40.2% 'strongly disagree', 'disagree', or 'neither agree nor disagree', respectively). Women rated their performance of 'Teamwork and collegiality', 'Empathy and openness', and 'Knowing and maintaining own personal bounds and possibilities' significantly higher than men did (Cohen's d > .2), while men showed higher self-assessed performance in 'Scientifically and empirically grounded method of working' than women (Cohen's d = .38). The FOCs 'Responsibility', 'Knowing and maintaining own personal bounds and possibilities', 'Structure, work planning, and priorities', 'Coping with mistakes', and 'Scientifically and empirically grounded method of working' revealed lower self-assessed performance than the order of FOC relevance established by physicians for beginning residents.

CONCLUSIONS

The differences between the level of students' self-assessed FOC performance and physicians' ranking of FOC relevance revealed areas for improvement in undergraduate medical education related to health system sciences. Final-year students might benefit from additional or better training in management skills, professionalism, and evidence-based medicine. Surveys of self-assessed competences may be useful to monitor competence development during undergraduate training.

The promise of a health professions education imagination

CONTEXT

Social factors play a key role in health professions education and are thus a foundational topic that medical trainees must be taught. Although medical educators have discussed the best ways to teach these concepts for decades, there are still significant barriers to full incorporation of 'the social' into medical training.

FRAMEWORK

Building upon previous scholarship in medical education, the author argues for the development in trainees of a 'health professions education imagination' or a unique 'quality of mind' that facilitates navigating competing ways of knowing. This concept borrows explicitly from 'the sociological imagination', which is briefly described. Next, some of the principles of thinking that might contribute to a similar 'imagination' in health professions education are identified. Finally, exemplars are provided highlighting how recent scholars have used their health professions education imaginations in recent research and teaching practice.

IMPLICATIONS

The health professions education imagination provides a useful framework to help guide clinical and research trainees to integrate the epistemologically diverse forms of knowledge they are exposed to and to break down the silos that these forms of knowledge are commonly taught within.

Curriculum Development by Design Thinking: Analyzing a Program for Social Determinants of Health Screening by Pre-Clerkship Medical Students

PROBLEM

Health systems science (HSS) curricula in medical schools facilitate an understanding of social determinants of health (SDOH) and their impact on health outcomes. After implementation of an experiential, patient-centered program based around SDOH screening, however, our medical college noted poor student receptivity and engagement. In order to improve the program, we chose a design thinking approach based on the perceived value of actively engaging learners in the design of education. The role of design thinking in curricular quality improvement, however, remains unclear.

INTERVENTION

We sought to determine if a current educational model for SDOH screening could be improved by reforming the curriculum using a design thinking workshop involving student and faculty stakeholders.

CONTEXT

The current study is a retrospective analysis of first-year medical student, end-of-year evaluations of the Clinical Experience (CE) program at the Sidney Kimmel Medical College before (2018-19) and after (2019-20) implementation of the design thinking workshop and subsequent curriculum changes.

IMPACT

Overall positive results significantly increased across all survey questions after the curricular intervention (p < 0.01), indicating increased student satisfaction with the revised curriculum.

LESSONS LEARNED

Few studies assess outcomes of design thinking-driven curricular changes. The current study of an SDOH screening program details the implementation of initiatives that originated from a design thinking sprint and assesses program evaluations following these curricular changes. Most of the well-received curricular changes concerned improvements in student training, patient screening and follow-up, and the leveraging of existing technology. The study reinforces the importance of co-creation among stakeholders when redesigning medical curricula.

Defining Successful Practice Within Health Systems Science Among Entering Residents: A Single-Institution Qualitative Study of Graduate Medical Education Faculty Observations

PURPOSE

The American Medical Association's Accelerating Change in Medical Education consortium defined health systems science (HSS) as the study of how health care is delivered, how health care professionals work together to deliver that care, and how the health system can improve patient care and health care delivery. This framework is increasingly being incorporated into medical school curricula. Graduate medical education (GME) had previously elevated systems-based practice (SBP) as a core competency, but expectations are defined by specialty-specific milestones. The lack of a shared competency framework between undergraduate medical education (UME) and GME makes it challenging to ensure that entering residents are prepared to implement HSS/SBP concepts in the workplace. The authors explored GME faculty observations of residents exemplifying successful practice across HSS domains to inform targets for UME training and assessment.

METHOD

Authors performed a single-institution qualitative study using transcribed phone interviews with eligible Vanderbilt residency program directors, associate program directors, and core faculty. Participants described observations of successful residents within each HSS domain. Two researchers independently coded, discussed, and reconciled deidentified transcripts using inductive-deductive approaches to identify themes.

RESULTS

Seventeen faculty participated across specialties (17/39, 45%). Faculty responses emphasize precurricular experiences including professional degrees, work experience, extracurriculars, and medical school exposure. Importantly, successful residents exhibit foundational core workforce characteristics including growth mindset, curiosity, and a desire to learn about systems. GME faculty identified HSS domain-specific skills, noting distinctions among learning environments. Outcomes resulting from residents' application of HSS concepts include delivering high-quality, person-centered care and systems improvements.

CONCLUSIONS

Descriptions of successful practice within HSS domains highlight preparatory experiences and core workforce characteristics and outline entry-level HSS behaviors. Conceptualized in a logic model framework, these findings describe key inputs, learning activities, outputs, and outcomes for systems-prepared entering residents bridging the UME-GME transition.

Using Kern's 6-Step Approach to Integrate Health Systems Science Curricula Into Medical Education

The term "health systems science" (HSS) has recently emerged as a unifying label for competencies in health care delivery and in population and community health. Despite strong evidence that HSS competencies are needed in the current and future health care workforce, heretofore the integration of HSS into medical education has been slow or fragmented-due, in part, to a lack of evidence that these curricula improve education or population outcomes. The recent COVID-19 pandemic and the national reckoning with racial inequities in the United States further highlight the time-sensitive imperative to integrate HSS content across the medical education continuum. While acknowledging challenges, the authors highlight the unique opportunities inherent in an HSS curriculum and present an elaborated curricular framework for incorporating health care delivery and population health into undergraduate medical education. This framework includes competencies previously left out of medical education, increases the scope of faculty development, and allows for evidence of effectiveness beyond traditional learner-centric metrics. The authors apply a widely adopted 6-step approach to curriculum development to address the unique challenges of incorporating HSS. Two examples-of a module on quality improvement (health care delivery) and of an introductory course on health equity (population and community health)-illustrate how the 6-step approach can be used to build HSS curricula. The Supplemental Digital Appendix (at http://links.lww.com/ACADMED/B106) outlines this approach and provides specific examples and resources. Adapting these resources within local environments to build HSS curricula will allow medical educators to ensure future graduates have the expertise and commitment necessary to effect health systems change and to advocate for their communities, while also building the much-needed evidence for such curricula.

Health systems science education: The new post-Flexner professionalism for the 21st century

The foundations of medical education have drawn from the Flexner Report to prepare students for practice for over a century. These recommendations relied, however, upon a limited set of competencies and a relatively narrow view of the physician's role. There have been increasing calls and recommendations to expand those competencies and the professional identity of the physician to better meet the current and future needs of patients, health systems, and society. We propose a framework for the twenty-first century physician that includes an expectation of new competency in health systems science (HSS), creating 'system citizens' who are effective stewards of the health care system. Experiential educational strategies, in addition to knowledge-centered learning, are critically important for students to develop their professional identity as system citizens working alongside interprofessional colleagues. Challenges to HSS adoption range from competing priorities for learners, to the need for faculty development, to the necessity for buy-in by medical schools and their associated health care systems. Ultimately, success will depend on our ability to articulate, encourage, support, and evaluate system citizenship and its impact on health care and health care systems.

Assessing the Transition of Training in Health Systems Science From Undergraduate to Graduate Medical Education

BACKGROUND

The American Medical Association Accelerating Change in Medical Education (AMA-ACE) consortium proposes that medical schools include a new 3-pillar model incorporating health systems science (HSS) and basic and clinical sciences. One of the goals of AMA-ACE was to support HSS curricular innovation to improve residency preparation.

OBJECTIVE

This study evaluates the effectiveness of HSS curricula by using a large dataset to link medical school graduates to internship Milestones through collaboration with the Accreditation Council for Graduate Medical Education (ACGME).

METHODS

ACGME subcompetencies related to the schools' HSS curricula were identified for internal medicine, emergency medicine, family medicine, obstetrics and gynecology (OB/GYN), pediatrics, and surgery. Analysis compared Milestone ratings of ACE school graduates to non-ACE graduates at 6 and 12 months using generalized estimating equation models.

RESULTS

At 6 months both groups demonstrated similar HSS-related levels of Milestone performance on the selected ACGME competencies. At 1 year, ACE graduates in OB/GYN scored minimally higher on 2 systems-based practice (SBP) subcompetencies compared to non-ACE school graduates: SBP01 (1.96 vs 1.82, 95% CI 0.03-0.24) and SBP02 (1.87 vs 1.79, 95% CI 0.01-0.16). In internal medicine, ACE graduates scored minimally higher on 3 HSS-related subcompetencies: SBP01 (2.19 vs 2.05, 95% CI 0.04-0.26), PBLI01 (2.13 vs 2.01; 95% CI 0.01-0.24), and PBLI04 (2.05 vs 1.93; 95% CI 0.03-0.21). For the other specialties examined, there were no significant differences between groups.

CONCLUSIONS

Graduates from schools with training in HSS had similar Milestone ratings for most subcompetencies and very small differences in Milestone ratings for only 5 subcompetencies across 6 specialties at 1 year, compared to graduates from non-ACE schools. These differences are likely not educationally meaningful.

Assessment Question Characteristics Predict Medical Student Performance in General Pathology

CONTEXT.—

Evaluation of medical curricula includes appraisal of student assessments in order to encourage deeper learning approaches. General pathology is our institution's 4-week, first-year course covering universal disease concepts (inflammation, neoplasia, etc).

OBJECTIVE.—

To compare types of assessment questions and determine which characteristics may predict student scores, degree of difficulty, and item discrimination.

DESIGN.—

Item-level analysis was employed to categorize questions along the following variables: type (multiple choice question or matching answer), presence of clinical vignette (if so, whether simple or complex), presence of specimen image, information depth (simple recall or interpretation), knowledge density (first or second order), Bloom taxonomy level (1-3), and, for the final, subject familiarity (repeated concept and, if so, whether verbatim).

RESULTS.—

Assessments comprised 3 quizzes and 1 final exam (total 125 questions), scored during a 3-year period (total 417 students) for a total 52 125 graded attempts. Overall, 44 890 attempts (86.1%) were correct. In multivariate analysis, question type emerged as the most significant predictor of student performance, degree of difficulty, and item discrimination, with multiple choice questions being significantly associated with lower mean scores (P = .004) and higher degree of difficulty (P = .02), but also, paradoxically, poorer discrimination (P = .002). The presence of a specimen image was significantly associated with better discrimination (P = .04), and questions requiring data interpretation (versus simple recall) were significantly associated with lower mean scores (P = .003) and a higher degree of difficulty (P = .046).

CONCLUSIONS.—

Assessments in medical education should comprise combinations of questions with various characteristics in order to encourage better student performance, but also obtain optimal degrees of difficulty and levels of item discrimination.

Contributions of Health Professions Students to Health System Needs During the COVID-19 Pandemic: Potential Strategies and Process for U.S. Medical Schools

The COVID-19 pandemic poses an unprecedented challenge to U.S. health systems, particularly academic health centers (AHCs) that lead in providing advanced clinical care and medical education. No phase of AHC efforts is untouched by the crisis, and medical schools, prioritizing learner welfare, are in the throes of adjusting to suspended clinical activities and virtual classrooms. While health professions students are currently limited in their contributions to direct clinical care, they remain the same smart, innovative, and motivated individuals who chose a career in health care and who are passionate about contributing to the needs of people in troubled times. The groundwork for operationalizing their commitment has already been established through the identification of value-added, participatory roles that support learning and professional development in health systems science (HSS) and clinical skills. This pandemic, with rapidly expanding workforce and patient care needs, has prompted a new look at how students can contribute. At the Penn State College of Medicine, staff and student leaders formed the COVID-19 Response Team to prioritize and align student work with health system needs. Starting in mid-March 2020, the authors used qualitative methods and content analysis of data collated from several sources to identify 4 categories for student contributions: the community, the health care delivery system, the workforce, and the medical school. The authors describe a nimble coproduction process that brings together all stakeholders to facilitate work. The learning agenda for these roles maps to HSS competencies, an evolving requirement for all students. The COVID-19 pandemic has provided a unique opportunity to harness the capability of students to improve health.Other AHCs may find this operational framework useful both during the COVID-19 pandemic and as a blueprint for responding to future challenges that disrupt systems of education and health care in the United States.

General Internists as Change Agents: Opportunities and Barriers to Leadership in Health Systems and Medical Education Transformation

Health systems are increasingly engaging in mission development around the quadruple aim of patient experience of care, population health, cost of care, and work-life balance of clinicians. This integrated approach is closely aligned with the education principles and competencies of health systems science (HSS), which includes population health, high-value care, leadership, teamwork, collaboration, and systems thinking. Influenced by health outcomes research, the systems-based practice competency, and the Clinical Learning Environment Review, many medical schools and residency programs are taking on the challenge of comprehensively incorporating these HSS competencies into the education agenda. General internal medicine physicians, inclusive of hospitalists, geriatricians, and palliative and primary care physicians, are at the frontlines of this transformation and uniquely positioned to contribute to and lead health system transformation, role model HSS competencies for trainees, and facilitate the education of a new workforce equipped with HSS skills to accelerate change in healthcare. Although GIM faculty are positioned to be early adopters and leaders in evolving systems of care and education, professional development and changes with academic health systems are required. This Perspective article explores the conceptualization and opportunities to effectively link GIM with healthcare and medical education transformation.