Improving Graduate Medical Education by Aggregating Data Across the Medical Education Continuum

The Impact of a One-Day Multidisciplinary Workshop on Medical Students' Self-Assessed Confidence, Knowledge, and Teamwork Skills: A Pre-Post Study

Background and Objectives

Medical workshops serve as interactive learning sessions that allow medical students to apply their extensive theoretical knowledge in a structured, low-stress environment. This study aimed to evaluate the impact of a self-developed multidisciplinary workshop on participants' self-reported confidence, teamwork, leadership skills, and theoretical knowledge acquisition.

Methods

The present study gathered data from 100 participants. Two surveys, each comprising three sections, were administered: a multiple-choice questionnaire (MCQ), with distinct versions for pre- and post-workshop assessment; a self-confidence questionnaire; and a non-technical skills questionnaire structured using a Likert-scale format.

Results

Regarding self-assessed confidence, significant increases were observed across all workshop stations (p < 0.001, Wilcoxon signed-rank test), with all effect sizes classified as large (Cohen's d > 0.8). In terms of theoretical knowledge, students demonstrated substantial improvement, with the median score increasing from 5.92 to 8.2, and no significant differences identified between study years (p = 0.895). Non-technical skills, including teamwork and leadership, were assessed using two questions each, revealing a statistically significant improvement in pre- and post-intervention (p < 0.001) with large effect sizes.

Conclusion

This study demonstrated that the one-day multidisciplinary workshop increases medical students' confidence by refining their communication skills, broadening their understanding of different roles in healthcare, and improving their ability to collaborate effectively.

Regional Distribution of Foreign-Born Medical Graduates in US Primary Care Specialty Residencies from 2010 to 2022

BACKGROUND

The United States has more foreign-born (FB) individuals than any other country and a large international medical graduate (IMG) workforce. Yet little is known about the trends of FB IMGs matching into primary care specialties residency programs or the alignment between FB individuals and FB IMGs.

OBJECTIVE

This study examined the recent trends in FB IMGs entry into primary care specialty residency programs and their distribution in relation to the US FB population.

DESIGN

In this retrospective study, we used archives of National Resident Matching Program (NRMP) data on the main residency match from 2010 to 2022.

MAIN MEASURES

We extracted match data and program directors' policies for internal medicine, pediatrics, family medicine, and internal medicine/pediatrics. We also extracted data on the total population and FB individuals from the US Census Bureau for each US state from 2010 to 2022.

KEY RESULTS

From 2010 to 2022, 17.2% of primary care specialty positions were filled by FB IMGs, with 22.1% for internal medicine, 11.3% for pediatrics, 10.7% for family medicine, and 3.2% for internal medicine/pediatrics. The percentage of primary care specialty positions filled by FB IMGs was significantly higher than the percentage of FB people in the US overall and 7 of 9 US regions (p < 0.001) (excepting Pacific and Mountain). The percentage of family medicine, pediatrics, and internal medicine/pediatrics positions filled by FB IMGs was significantly lower than the proportion of FB people (p < 0.001). Internal medicine had a higher proportion of positions filled by FB IMGs compared to the proportion of FB individuals in the general population (p < 0.001).

CONCLUSION

Distribution of FB IMGs varies in primary care specialties compared to FB people in the US. Given the importance of aligning medical education with patients' needs, programs could take into account population demographics while assessing and admitting the applicants.

Data sharing and big data in health professions education: Ottawa consensus statement and recommendations for scholarship

Changes in digital technology, increasing volume of data collection, and advances in methods have the potential to unleash the value of big data generated through the education of health professionals. Coupled with this potential are legitimate concerns about how data can be used or misused in ways that limit autonomy, equity, or harm stakeholders. This consensus statement is intended to address these issues by foregrounding the ethical imperatives for engaging with big data as well as the potential risks and challenges. Recognizing the wide and ever evolving scope of big data scholarship, we focus on foundational issues for framing and engaging in research. We ground our recommendations in the context of big data created through data sharing across and within the stages of the continuum of the education and training of health professionals. Ultimately, the goal of this statement is to support a culture of trust and quality for big data research to deliver on its promises for health professions education (HPE) and the health of society. Based on expert consensus and review of the literature, we report 19 recommendations in (1) framing scholarship and research through research, (2) considering unique ethical practices, (3) governance of data sharing collaborations that engage stakeholders, (4) data sharing processes best practices, (5) the importance of knowledge translation, and (6) advancing the quality of scholarship through multidisciplinary collaboration. The recommendations were modified and refined based on feedback from the 2022 Ottawa Conference attendees and subsequent public engagement. Adoption of these recommendations can help HPE scholars share data ethically and engage in high impact big data scholarship, which in turn can help the field meet the ultimate goal: high-quality education that leads to high-quality healthcare.

Practical, Privacy and Ethical, and Philosophical Considerations for Using Big Data in Medical Education

ABSTRACT

In this issue of Academic Medicine , Thelen and colleagues present a thoughtful perspective on the emerging opportunity to use longitudinal educational data to improve graduate medical education and optimize the education of individual residents, and call for the accelerated development of large interinstitutional data sets for this purpose. Such applications of big data to medical education hold great promise in terms of informing the teaching of individuals, enhancing transitions between phases of training and between institutions, and permitting better longitudinal education research. At the same time, there is a tension between whose data they are and consequently how they ought to be used. This commentary proposes some practical, privacy and ethical, and philosophical considerations that need to be explored as early efforts to aggregate data across the medical education continuum mature and new efforts are undertaken.