Research integrity and academic medicine: the pressure to publish and research misconduct

CONTEXT

This narrative review article explores research integrity and the implications of scholarly work in medical education. The paper describes how the current landscape of medical education emphasizes research and scholarly activity for medical students, resident physicians, and faculty physician educators. There is a gap in the existing literature that fully explores research integrity, the challenges surrounding the significant pressure to perform scholarly activity, and the potential for ethical lapses by those involved in medical education.

OBJECTIVES

The objectives of this review article are to provide a background on authorship and publication safeguards, outline common types of research misconduct, describe the implications of publication in medical education, discuss the consequences of ethical breaches, and outline possible solutions to promote research integrity in academic medicine.

METHODS

To complete this narrative review, the authors explored the current literature utilizing multiple databases beginning in June of 2021, and they completed the literature review in January of 2023. To capture the wide scope of the review, numerous searches were performed. A number of Medical Subject Headings (MeSH) terms were utilized to identify relevant articles. The MeSH terms included "scientific misconduct," "research misconduct," "authorship," "plagiarism," "biomedical research/ethics," "faculty, medical," "fellowships and scholarships," and "internship and residency." Additional references were accessed to include medical school and residency accreditation standards, residency match statistics, regulatory guidelines, and standard definitions.

RESULTS

Within the realm of academic medicine, research misconduct and misrepresentation continue to occur without clear solutions. There is a wide range of severity in breaches of research integrity, ranging from minor infractions to fraud. Throughout the medical education system in the United States, there is pressure to publish research and scholarly work. Higher rates of publications are associated with a successful residency match for students and academic promotion for faculty physicians. For those who participate in research misconduct, there is a multitude of potential adverse consequences. Potential solutions to ensure research integrity exist but are not without barriers to implementation.

CONCLUSIONS

Pressure in the world of academic medicine to publish contributes to the potential for research misconduct and authorship misrepresentation. Lapses in research integrity can result in a wide range of potentially adverse consequences for the offender, their institution, the scientific community, and the public. If adopted, universal research integrity policies and procedures could make major strides in eliminating research misconduct in the realm of academic medicine.

Education Scholarship Assessment Reconsidered: Expansion of Glassick's Criteria to Incorporate Health Equity

ABSTRACT

Recent events have ignited widespread attention to structural racism and implicit bias throughout the U.S. health care system and medical institutions, resulting in a call for antiracism approaches to advance health equity. Medical education leaders are well positioned to advance health equity, not only through their training of fellows, residents, and medical students, but also in their approach to scholarship. Education scholarship drives innovation and critical evaluation of current practices; it impacts and intersects with multiple factors that have the potential to reduce health inequities. Thus, it is critical to prioritize the assessment of education scholarship through a health equity lens. Medical education scholarly dissemination has markedly expanded over the past 2 to 3 decades, yet medical educators have continued to embrace Boyer's and Glassick and colleagues' definitions of scholarship. The authors propose an approach to medical education scholarship assessment that expands each of Glassick's 6 existing criteria to address health inequities and adds health equity as a seventh criterion. With this, medical educators, researchers, reviewers, and others can consider how education scholarship affects diverse populations and settings, direct educational products and scholarship to address health inequities, and raise the importance of advancing health equity in medical education scholarship. By expanding and standardizing the assessment of scholarship to incorporate health equity, the medical education community can foster a cultural shift that brings health equity to the forefront of education scholarship.

Social justice in medical education: a student-led approach to addressing COVID-19 vaccine equity in the Hispanic/Latinx community

The current healthcare system disproportionately affects vulnerable populations, leading to disparities in health outcomes. As a result, medical schools need to equip future physicians with the tools to identify and address healthcare disparities. The University of Nevada, Reno School of Medicine implemented a Scholarly Concentration in Medical Social Justice (SCiMSJ) program to address this issue. Three medical students joined the program and pioneered a project to address the equitable vaccine distribution within the local Hispanic/Latinx community. After identifying the disparity in vaccine uptake and high levels of vaccine hesitancy, they collaborated with local organizations to address vaccine misinformation and accessibility. They organized outreach events, provided vaccine education, and hosted a vaccine clinic at a Catholic church with a high Hispanic/Latinx congregation. Through their efforts, they administered 1,456 vaccines. The estimated economic and societal impacts of their work was 879 COVID-19 cases avoided, 5 deaths avoided, 45 life years saved, and $29,286 in economic value. The project's success highlights the effectiveness of a student-led approach to promote skill development in social justice training. Leadership skills and coalition building were crucial in overcoming resource limitations and connecting organizations with the necessary volunteer force. Building trust with the Hispanic/Latinx community through outreach efforts and addressing vaccine hesitancy contributed to the well-attended vaccine clinic. The project's framework and approach can be adopted by other medical students and organizations to address health disparities and improve health outcomes in their communities.

Authentic Pathology Specimen Reception: A Valuable Resource for Developing Biomedical Science Student Competencies and Employability

Background/Introduction: The pathology specimen reception is fundamental to the services provided by Biomedical Science laboratories worldwide. To ensure patient safety and that samples are of adequate quality to send for analysis, prospective Biomedical Scientists should have a robust knowledge of the processes involved and the acceptance criteria of the pathology specimen reception. This knowledge has been highlighted by employers as a current gap in Biomedical Science graduates and therefore needs to be addressed within higher education settings. To do this, this study aimed to 1) design a practical session to simulate the key processes of the pathology specimen reception and 2) to understand Biomedical Science students' opinions on these activities and the development of transferable skills required for post-graduate employment. Methods: The practical session was designed based on industrial requirements and academic knowledge of student skill sets to ensure suitability. Qualitative information regarding participant demographics and career interests was acquired through open-answer or multiple-choice questions. Quantitative student feedback was acquired via questionnaires utilising a 5-point Likert scale (n = 77). Results: The scenario-based practical session provided students with a positive learning experience with 98.7% of participants enjoying the session, with 87.0% stating they learned a lot by completing the session. It was also identified that participants preferred this style of learning to that of conventional higher education teaching modalities with 97.4% stating they would prefer simulated employment focussed scenarios embedded into the curriculum more often. The majority of participants also thought this session was helpful for the development of their key transferrable skills including teamworking, communication, and confidence. When stratified based on demographic data, there was minimal difference between cohorts and in the majority of cases, those participants from non-traditional university entry backgrounds had a more positive experience and better transferable skill development following the completion of this style of learning experience. Conclusion: This study highlights simulation-based learning as a tool to develop core Biomedical Science knowledge, build student graduate capital, and ensure the preparedness of students for post-graduation employment.

Determining intra-standard-setter inconsistency in the Angoff method using the three-parameter item response theory

Objectives

To measure intra-standard-setter variability and assess the variations between the pass marks obtained from Angoff ratings, guided by the latent trait theory as the theoretical model.

Methods

A non-experimental cross-sectional study was conducted to achieve the purpose of the study. Two knowledge-based tests were administered to 358 final-year medical students (223 females and 135 males) as part of their normal summative programme of assessments. The results of judgmental standard-setting using the Angoff method, which is widely used in medical schools, were used to determine intra-standard-setter inconsistency using the three-parameter item response theory (IRT). Permission for this study was granted by the local Research Ethics Committee of the University of Nottingham. To ensure anonymity and confidentiality, all identifiers at the student level were removed before the data were analysed.

Results

The results of this study confirm that the three-parameter IRT can be used to analyse the results of individual judgmental standard setters. Overall, standard-setters behaved fairly consistently in both tests. The mean Angoff ratings and conditional probability were strongly positively correlated, which is a matter of inter-standard-setter validity.

Conclusions

We recommend that assessment providers adopt the methodology used in this study to help determine inter and intra-judgmental inconsistencies across standard setters to minimise the number of false positive and false negative decisions.

Implications of the Dobbs Decision for Medical Education: Inadequate Training and Moral Distress

This Viewpoint discusses how states’ restrictions on abortion will affect medical students’ training in providing reproductive health care and also create moral distress by being forced to provide care that may harm patients.

Implementing and optimizing a communication curriculum in medical teaching: Stakeholders’ perspectives

Objective

The relevance of communication in medical education is continuously increasing. At the Medical Faculty of Hamburg, the communication curriculum was further developed and optimized during this project. This article aims to describe the stakeholders’ perceived challenges and supporting factors in the implementation and optimization processes.

Methods

The initial communication curriculum and its development after a one-year optimization process were assessed with a curricular mapping. A SWOT analysis and group discussions were carried out to provide information on the need for optimization and on challenges the different stakeholders faced.

Results

The curricular mapping showed that the communication curriculum is comprehensive, coherent, integrated and longitudinal. In both the implementation and the project-related optimization processes, support from the dean, cooperation among all stakeholders and structural prerequisites were deemed the most critical factors for successfully integrating communication content into the curriculum.

Conclusion

The initiative and support of all stakeholders, including the dean, teachers and students, were crucial for the project’s success.

Practice implications

Although the implementation of a communication curriculum is recommended for all medical faculties, their actual implementation processes may differ. In a “top-down” and “bottom-up” approach, all stakeholders should be continuously involved in the process to ensure successful integration.

Downstream funding success of early career researchers for resubmitted versus new applications: A matched cohort

Background

Early career researchers face a hypercompetitive funding environment. To help identify effective intervention strategies for early career researchers, we examined whether first-time NIH R01 applicants who resubmitted their original, unfunded R01 application were more successful at obtaining any R01 funding within 3 and 5 years than original, unfunded applicants who submitted new NIH applications, and we examined whether underrepresented minority (URM) applicants differentially benefited from resubmission. Our observational study is consistent with an NIH working group’s recommendations to develop interventions to encourage resubmission.

Methods and findings

First-time applicants with US medical school academic faculty appointments who submitted an unfunded R01 application between 2000–2014 yielded 4,789 discussed and 7,019 not discussed applications. We then created comparable groups of first-time R01 applicants (resubmitted original R01 application or submitted new NIH applications) using optimal full matching that included applicant and application characteristics. Primary and subgroup analyses used generalized mixed models with obtaining any NIH R01 funding within 3 and 5 years as the two outcomes. A gamma sensitivity analysis was performed. URM applicants represented 11% and 12% of discussed and not discussed applications, respectively.

First-time R01 applicants resubmitting their original, unfunded R01 application were more successful obtaining R01 funding within 3 and 5 years than applicants submitting new applications—for both discussed and not discussed applications: discussed within 3 years (OR 4.17 [95 CI 3.53, 4.93]) and 5 years (3.33 [2.82–3.92]); and not discussed within 3 years (2.81 [2.52, 3.13]) and 5 years (2.47 [2.22–2.74]). URM applicants additionally benefited within 5 years for not discussed applications.

Conclusions

Encouraging early career researchers applying as faculty at a school of medicine to resubmit R01 applications is a promising potential modifiable factor and intervention strategy. First-time R01 applicants who resubmitted their original, unfunded R01 application had log-odds of obtaining downstream R01 funding within 3 and 5 years 2–4 times higher than applicants who did not resubmit their original application and submitted new NIH applications instead. Findings held for both discussed and not discussed applications.

The Content Quality of YouTube Videos for Professional Medical Education: A Systematic Review

PURPOSE

To evaluate the content quality of YouTube videos intended for professional medical education based on quality rating tool (QRT) scores and determine if video characteristics, engagement metrics, or author type are associated with quality.

METHOD

The authors searched 7 databases for English-language studies about the quality of YouTube videos intended for professional medical education from each database's inception through April 2019. To be included, studies had to be published in 2005 (when YouTube was created) or later. Studies were classified according to the type of QRT used: externally validated, internally validated, or limited global. Study information and video characteristics and engagement metrics were extracted. Videos were classified by video author type.

RESULTS

Thirty-one studies were included in this review. Three studies used externally validated QRTs, 20 used internally validated QRTs, and 13 used limited global QRTs. Studies using externally validated QRTs had average scores/total possible scores of 1.3/4, 26/80, and 1.7/5. Among the 18 studies using internally validated QRTs, from which an average percentage of total possible QRT score could be computed or extracted, the average score was 44% (range: 9%-71%). Videos with academic-physician authors had higher internally validated QRT mean scores (46%) than those with nonacademic-physician or other authors (26%; P < .05).

CONCLUSIONS

The authors found a wide variation in QRT scores of videos, with many low QRT scores. While videos authored by academic-physicians were of higher quality on average, their quality still varied significantly. Video characteristics and engagement metrics were found to be unreliable surrogate measures of video quality. A lack of unifying grading criteria for video content quality, poor search algorithm optimization, and insufficient peer review or controls on submitted videos likely contributed to the overall poor quality of YouTube videos that could be used for professional medical education.

The Dissolution of the Step 2 Clinical Skills Examination and the Duty of Medical Educators to Step Up the Effectiveness of Clinical Skills Assessment

In this Invited Commentary, the authors explore the implications of the dissolution of the Step 2 Clinical Skills Examination (Step 2 CS) for medical student clinical skills assessment. The authors describe the need for medical educators (at both the undergraduate and graduate levels) to work collaboratively to improve medical student clinical skills assessment to assure the public that medical school graduates have the requisite skills to begin residency training. The authors outline 6 specific recommendations for how to capitalize on the discontinuation of Step 2 CS to improve clinical skills assessment: (1) defining national, end-of-clerkship, and transition-to-residency standards for required clinical skills and for levels of competence; (2) creating a national resource for standardized patient, augmented reality, and virtual reality assessments; (3) improving workplace-based assessment through local collaborations and national resources; (4) improving learner engagement in and coproduction of assessments; (5) requiring, as a new standard for accreditation, medical schools to establish and maintain competency committees; and (6) establishing a national registry of assessment data for research and evaluation. Together, these actions will help the medical education community earn the public's trust by enhancing the rigor of assessment to ensure the mastery of skills that are essential to providing safe, high-quality care for patients.

Using Kern's 6-Step Approach to Integrate Health Systems Science Curricula Into Medical Education

The term "health systems science" (HSS) has recently emerged as a unifying label for competencies in health care delivery and in population and community health. Despite strong evidence that HSS competencies are needed in the current and future health care workforce, heretofore the integration of HSS into medical education has been slow or fragmented-due, in part, to a lack of evidence that these curricula improve education or population outcomes. The recent COVID-19 pandemic and the national reckoning with racial inequities in the United States further highlight the time-sensitive imperative to integrate HSS content across the medical education continuum. While acknowledging challenges, the authors highlight the unique opportunities inherent in an HSS curriculum and present an elaborated curricular framework for incorporating health care delivery and population health into undergraduate medical education. This framework includes competencies previously left out of medical education, increases the scope of faculty development, and allows for evidence of effectiveness beyond traditional learner-centric metrics. The authors apply a widely adopted 6-step approach to curriculum development to address the unique challenges of incorporating HSS. Two examples-of a module on quality improvement (health care delivery) and of an introductory course on health equity (population and community health)-illustrate how the 6-step approach can be used to build HSS curricula. The Supplemental Digital Appendix (at http://links.lww.com/ACADMED/B106) outlines this approach and provides specific examples and resources. Adapting these resources within local environments to build HSS curricula will allow medical educators to ensure future graduates have the expertise and commitment necessary to effect health systems change and to advocate for their communities, while also building the much-needed evidence for such curricula.

Farewell to the Step 2 Clinical Skills Exam: New Opportunities, Obligations, and Next Steps

The unexpected discontinuation of the United States Medical Licensing Examination Step 2 Clinical Skills (CS) exam in January 2021 carries both risks and opportunities for medical education in the United States. Step 2 CS had far-reaching effects on medical school curricula and school-based clinical skills assessments. Absent the need to prepare students for this high-stakes exam, will the rigor of foundational clinical skills instruction and assessment remain a priority at medical schools? In this article, the authors consider the potential losses and gains from the elimination of Step 2 CS and explore opportunities to expand local summative assessments beyond the narrow bounds of Step 2 CS. The responsibility for implementing a rigorous and credible summative assessment of clinical skills that are critical for patient safety as medical students transition to residency now lies squarely with medical schools. Robust human simulation (standardized patient) programs, including regional and virtual simulation consortia, can provide infrastructure and expertise for innovative and creative local assessments to meet this need. Novel applications of human simulation and traditional formative assessment methods, such as workplace-based assessments and virtual patients, can contribute to defensible summative decisions about medical students' clinical skills. The need to establish validity evidence for decisions based on these novel assessment methods comprises a timely and relevant focus for medical education research.

Discontinuation of the USMLE Step 2 Clinical Skills Examination: Studying the Past to Define the Future

The United States Medical Licensing Examination (USMLE) Step 2 Clinical Skills (CS) was discontinued in January 2021, marking a significant milestone in assessment of clinical skills. In this commentary, the authors trace the history of the Step 2 CS exam-beginning with its early roots in the 1960s up to its discontinuation in 2021. In this new era, the medical education community is replete with opportunities for advancing methodology and content associated with clinical skills assessment. The authors propose 3 main lessons gleaned from this rich history and modern evolution, which are aimed at defining a future that includes creative collaboration toward development of comprehensive, equitable, student-focused, and patient-centered clinical performance assessment. First, as it has done throughout history, the medical education community should continue to innovate, collaborate, and improve upon methods of clinical skills assessment. Second, medical educators should continue to shift to more complex and student-driven approaches of assessment, that is, assessments that provide an unstructured environment, are realistic with respect to the natural conditions, and do not limit students to lists of options or force them to take a certain path of reasoning. Third, medical educators should continue to rethink the role of assessment and ensure that all assessments, regardless of stakes or type, provide sufficient feedback for the student to identify areas of strength and weakness.

A systematic review and meta-analysis of measurement properties of objective structured clinical examinations used in physical therapy licensure and a structured review of licensure practices in countries with well-developed regulation systems

BACKGROUND

The Objective Structured Clinical Examination (OSCE) is a commonly used tool internationally to assess clinical competency. Physical therapy (PT) licensure processes vary internationally. The OSCE is the tool used in Canada to assess clinical competency for PT graduates seeking licensure. Previous studies that examined the measurement properties of OSCEs present contradictory results.

OBJECTIVES

The first objective was to investigate the reliability and validity of OSCEs when administered to PTs during their education or as part of a licensure process. The second objective was to conduct a structured review to report PT educational and licensing components and policies in 17 countries with well-developed PT regulation systems.

METHODS

An electronic search was performed in four databases from inception to 31st March 2021 to identify relevant articles. Two reviewers performed the critical appraisal of the included studies using a validated quality assessment tool. We deployed a random effects meta-analysis on reliability and validity estimates of OSCEs and examined sources of heterogeneity with univariate meta-regressions. We searched websites of professional regulatory bodies and associations for data on educational and licencing components and policies. Educational and licensing components across countries were synthesized descriptively.

RESULTS

A pooled estimate of Cronbach's alpha of 0.55, (95% CI: 0.41, 0.67) was determined for OSCEs. The pooled estimate of Intraclass Correlation Coefficient (ICC) between assessors was 0.77 (95% CI: 0.70, 0.83). The pooled estimate of Pearson Correlation between multiple OSCE stations' scores was 0.27 (95% CI: 0.15, 0.39); and between each station score and the total score was 0.71 (95% CI: 0.61, 0.79). The pooled estimates for kappa Coefficients were 0.75 (95% CI: 0.58, 0.86) and 0.84, (95% CI: 0.72, 0.91) for intra-rater and inter-rater reliability of the standardised patient respectively. From the 17 included countries, Canada (excluding Quebec) was the only country that required both a clinical and written competency exam following graduation from an accredited PT program. Two countries (USA, UAE) required a written competency exam. The remaining 14 countries did not require an additional competency examination after completion of degree requirements from an accredited program.

CONCLUSIONS

We found weak evidence that OSCE examinations items are internally consistent when used to assess PTs. Canada (excluding Quebec) is the only country out of 17 implementing a national clinical competency examination for their PT graduates to achieve licensure after completing professional degree requirements.

Management of residents in difficulty in a Swiss general internal medicine outpatient clinic: Change is necessary!

AIMS OF THE STUDY

Residents in difficulty are a major cause for concern in medical education, with a prevalence of 7-15%. They are often detected late in their training and cannot make use of remediation plans. Nowadays, most training hospitals in Switzerland do not have a specific program to identify and manage residents in difficulty. The aim of the study was to explore the challenges perceived by physicians regarding the process of identifying, diagnosing, and supporting residents in difficulty in a structured and programmatic way. We explored perceptions of physicians at different hierarchical levels (residents (R), Chief residents (CR), attending physicians (A), Chief Physician (CP)) in order to better understand these challenges.

METHODS

We conducted an exploratory qualitative study between December 2015 and July 2016. We asked volunteers from the Primary Care Division of the Geneva University Hospitals to partake to three focus groups (with CR, A, R) and one interview with the division's CP. We transcribed, coded, and qualitatively analyzed the three focus groups and the interview, using a content thematic approach and Fishbein's conceptual framework.

RESULTS

We identified similarities and differences in the challenges of the management of residents in difficulty on a programmatic way amongst physicians of different hierarchical levels. Our main findings: Supervisors (CR, A, CP) have good identification skills of residents in difficulty, but they did not put in place systematic remediation strategies.Supervisors (CR, A) were concerned about managing residents in difficulty. They were aware of the possible adverse effects on patient care, but "feared to harm" resident's career by documenting a poor institutional assessment.Residents "feared to share" their own difficulties with their supervisors. They thought that it would impact their career negatively.The four physician's hierarchical level reported environmental constraints (lack of funding, time constraint, lack of time and resources…).

CONCLUSION

Our results add two perspectives to specialized recommendations regarding the implementation of remediation programs for residents in difficulty. The first revolves around the need to identify and fully understand not only the beliefs but also the implicit norms and the feeling of self-efficacy that are shared by teachers and that are likely to motivate them to engage in the management of residents in difficulty. The second emphasizes the importance of analyzing these elements that constitute the context for a change and of identifying, in close contact with the heads of the institutions, which factors may favor or hinder it. This research action process has fostered awareness and discussions at different levels. Since then, various actions and processes have been put in place at the Faculty of Medicine in Geneva.

Comparison of the influence of massive open online courses and traditional teaching methods in medical education in China: A meta-analysis

In the past 5 years, the MOOC-based teaching method has been extensively applied as an experimental educational method in medical education in China. However, the effects of this teaching method on medical education are still controversial and ambiguous. To assess the effectiveness of the MOOC-based teaching method in medical education in China, we conducted the meta-analysis. Literature search was performed through the PubMed, Embase, Web of Knowledge and CNKI databases through March 3, 2020. Studies evaluating the effectiveness of the MOOC-based teaching method in medical education in China were included in our meta-analysis. All data were pooled using a fixed- or random-effect model based on a heterogeneity test. Hedges' g was calculated to evaluate the effectiveness of the MOOC-based teaching method on the final exam knowledge scores of participants. Subgroup analyses were also carried out. There were 27 studies (25 records) identified in our meta-analysis. The final exam knowledge scores of participants were statistically higher in the MOOC group compared with the controls in medical courses in China (Hedges' g = 1.080, 95%CI 0.592-1.567, p < 0.001). Obvious heterogeneity across studies was found in the study. Further analysis demonstrated that a significant difference in favor of the MOOC-based teaching method compared with the traditional teaching method in medical students and doctors. The MOOC-based teaching method may be applicable to medical education in China, strengthening the roles of MOOCs in medical education.

Interventions to improve the well-being of medical learners in Canada: a scoping review

BACKGROUND

Medical education affects learner well-being. We explored the breadth and depth of interventions to improve the well-being of medical learners in Canada.

METHODS

We searched MEDLINE, EMBASE, CINAHL and PsycINFO from inception to July 11, 2020, using the Arksey-O'Malley, 5-stage, scoping review method. We included interventions to improve well-being across 5 wellness domains (i.e., social, mental, physical, intellectual, occupational) for medical learners in Canada, grouped as undergraduate or graduate nonmedical (i.e., health sciences) students, undergraduate medical students or postgraduate medical students (i.e., residents). We categorized interventions as targeting the individual (learner), program (i.e., in which learners are enrolled) or system (i.e., higher education or health care) levels.

RESULTS

Of 1753 studies identified, we included 65 interventions that aimed to improve well-being in 10 202 medical learners, published from 1972 through 2020; 52 (80%) were uncontrolled trials. The median year for intervention implementation was 2010 (range 1971-2018) and the median length was 3 months (range 1 h-48 mo). Most (n = 34, 52%) interventions were implemented with undergraduate medical students. Two interventions included only undergraduate, nonmedical students; none included graduate nonmedical students. Most studies (n = 51, 78%) targeted intellectual well-being, followed by occupational (n = 32, 49%) and social (n = 17, 26%) well-being. Among 19 interventions implemented for individuals, 14 (74%) were for medical students; of the 27 program-level interventions, 17 (63%) were for resident physicians. Most (n = 58, 89%) interventions reported positive well-being outcomes.

INTERPRETATION

Many Canadian medical schools address intellectual, occupational and social well-being by targeting interventions at medical learners. Important emphasis on the mental and physical well-being of medical learners in Canada warrants further exploration.

Medical Education During the COVID-19 Pandemic

All aspects of medical education were affected by the COVID-19 pandemic. Several challenges were experienced by trainees and programs alike, including economic repercussions of the pandemic; social distancing affecting the delivery of medical education, testing, and interviewing; the surge of patients affecting redeployment of personnel and potential compromises in core training; and the overall impact on the wellness and mental health of trainees and educators. The ability of medical teams and researchers to peer review, conduct clinical research, and keep up with literature was similarly challenged by the rapid growth in peer-reviewed and preprint literature. This article reviews these challenges and shares strategies that institutions, educators, and learners adopted, adapted, and developed to provide quality education during these unprecedented times.

Simulated ward round training in the medical curriculum Munich

Conducting a ward round in a structured and goal-oriented manner is one of the central competencies of a physician's work. Despite its relevance, ward round competence was only addressed in an unstructured way in the Medical Curriculum Munich (MeCuM) prior to 2011. Therefore, the project's aim was to implement an evidence-based course on medical ward round competence. This project report provides a guideline for developing such a training course. Project planning and development was guided by the steps of the "Kern cycle", beginning with needs assessment, learning objectives definition, and selection of appropriate teaching methods, and ending with implementation and evaluation.

Collaborative clinical simulation in cardiologic emergency scenarios for medical students. An exploratory study on model applicability and assessment instruments

Aims: This paper evaluates the feasibility of piloting the collaborative clinical simulation (CCS) model and its assessment instruments applicability for measuring interpersonal, collaborative, and clinical competencies in cardiologic emergency scenarios for medical students. The CCS model is a structured learning model for the acquisition and assessment of clinical competencies through small groups working collaboratively to design and perform in simulated environments supported by technology. Methods: Fifty-five students were allocated in five sessions (one weekly session) conducted with the CCS model within the course Cardiovascular Diseases. The applied practice aimed at the diagnosis and treatment of tachyarrhythmias in a simulated emergency department. In addition to the theoretical classes four weeks before the simulation sessions, students were sent a study guide that summarized the Guide to the European Society of Cardiology. For each simulation session, one clinical simulation instructor, one cardiologist teacher, and the principal investigator participated. Students were divided into three groups (3-5 students) for each-session. They designed, performed, role-played, and debriefed three different diagnoses. Three instruments to assess each group's performance were applied: peer assessment used by groups, performance assessment, created and applied by the cardiologist teacher, and individual satisfaction questionnaire for students. Results: The applicability of the CCS model was satisfactory for both students and teachers. The assessment instruments' internal reliability was good, as was internal consistency with a Cronbach Alpha of 0.7, 0.4, and 0.8 for each section (Interpersonal, Clinical, and Collaborative competencies, respectively). The performance group's evaluation was 0.8 for the two competencies assessed (Tachyarrhythmia and Electrical Cardioversion) and 0.8 for the satisfaction questionnaire's reliability. Conclusions: The CCS model for teaching emergency tachyarrhythmias to medical students was applicable and well accepted. The internal reliability of the assessment instruments was considered satisfactory by measuring satisfaction and performance in the exploratory study.

Enrollment Management in Undergraduate Medical School Admissions: A Complementary Framework to Holistic Review for Increasing Diversity in Medicine

Medical schools implemented holistic review more than a decade ago, which led to more deliberate consideration and inclusion of applicants historically underrepresented in medicine. This article presents a theory of holistic enrollment management that unites holistic review with enrollment management principles. This theory contextualizes medical school admissions as a complex marketplace with multifaceted, competing forces. Applying an enrollment management framework of mission, market, means, and metrics can improve the capacity of a medical school to efficiently advance its mission over time. Medical schools employing a clear, compelling, and focused mission to direct all aspects of the medical education enterprise can more effectively attract applicants who are better prepared to enact that mission throughout their careers. Medical schools share a marketplace and collectively compete to identify, attract, admit, and matriculate the most mission-aligned student body within the pool of applicants they share. Institutions that deliberately mobilize resources within this dynamic marketplace will engage, admit, and matriculate the most suiting applicants and attract even more mission-aligned matriculants over time. Widespread adoption of this holistic framework of enrollment management may enhance the capacity of the medical education system to better capitalize on the existing diversity in the national pool of applicants, encourage more underrepresented applicants to apply in the future, admit and matriculate a more diverse national student body, and ultimately better prepare new physicians to meet the increasingly diverse health care needs of the nation.

The Longitudinal Communication Curriculum at Leipzig University, Medical Faculty - implementation and first experiences

Purpose: Communication skills are an essential instrument for building a sustainable patient-doctor-relationship for future doctors. They are learnable and teachable. The learning should be facilitated with the help of a longitudinal curriculum, which is planned at Leipzig University. Project: At the Medical Faculty of Leipzig University, the Longitudinal Communication Curriculum is established since 2016/17. Up to now, the curriculum consists of four parts in which students repeatedly practise their communication skills in curricular and extracurricular courses. Several formats help to teach an integrated learning of communication and physical examination skills. Assessment of communication skills is also performed. Curricular implementation is accompanied by concomitant evaluation. Results: Three parts of the curriculum already have taken place. Students report an increase in communication skills. Students rate the units as instructive and helpful. The assessment of communication skills occurs in two clinical practical examinations (OSCEs). Together with summative assessment a formative feedback was implemented. Students judge this practice as highly positive. Discussion: The curriculum is part of undergraduate medical education in Leipzig. It would be beneficial to add another simulated patient encounter, as well as interprofessional units. Student questionnaires will be evaluated and results will help to develop the curriculum. Conclusion: Consolidation of the curriculum accompanied by evaluation and adaption of content can help to assure the quality of the curriculum. Additional professions and study units shall be integrated in the Longitudinal Communication Curriculum in the future.

Medical students' perception of the reliability, usefulness and feasibility of unproctored online formative assessment tests

Medical education has gone online because of the COVID-19 pandemic. Formative assessment is essential to facilitate the learning process in medical education. However, various challenges arise during online assessment, which include reliability, when done without monitoring and practical concerns like Internet connectivity issues. This study was done to assess the medical students' perceptions of the reliability, usefulness, and practical challenges of online tests. One hundred first-year undergraduate medical students taking up online classes and tests in the subject of physiology were enrolled in this study. A questionnaire with items regarding practical challenges, reliability, and usefulness of the online tests, in general, and about different types of online assessment methods, in particular, were sent to the students online. Each item was rated on a five-point Likert scale, and the responses were analyzed anonymously. A large percentage of students used mobile phones (81.4%) to undertake online tests. Although most students (73.2%; P < 0.001) felt that online tests helped them substantially in learning the subject, network connectivity issues were considered to be a matter of serious concern (85.5%, P < 0.001). Among the assessment methods used, viva voce by video conferencing was thought to be most reliable (83%, P < 0.001). Multiple-choice question-based assessment when done online was felt to be more practically feasible with faster feedback than classroom assessment. The results of the study suggest that medical students find online formative assessments helpful for their learning, despite their concerns about reliability and practical challenges.

Students' perceptions on race in medical education and healthcare

Major racial disparities continue to exist in our healthcare education, from the underrepresentation of ethnic minorities when teaching about clinical signs to health management in primary and secondary care. A multi-centre group of students discuss what needs to change in medical education to cultivate physicians who are better prepared to care for patients of all backgrounds. We argue that the accurate portrayal of race in medical education is a vital step towards educating medical students to consider alternative explanations to biology when considering health inequities.

Multi-source evaluation of an educational program aimed at medical students for interviewing/taking the clinical history using standardized patients

Introduction: Simulations with standardized patients (SP) have long been used for teaching/assessing communication skills. The present study describes and evaluates an experiential training methodology aimed at medical students and based on interviews with standardized simulated patients. The training was focused on developing basic communication skills and taking medical histories. Methods: Longitudinal observational study of a cohort of third-year medical students. Three interviews with SP were carried out and videotaped. These interviews were assessed by the students, the SPs and the professors of the relevant subject areas. Results: 83 students conducted the interviews. The self-evaluations performed by the students showed an improvement between the first and third interviews, as demonstrated by the increase of 6.7% (CI 95%=3.6-10.0%) (p<0.001) in the percentage of detected items. The SPs stated an improvement of 8.5% (CI 95%=2.9-14.1) (p=0.003) from the first to the third interview regarding the percentage of students that showed a level of interest in, and ease with, the patients' concerns. Finally, the teachers found a mean percentage of items identified in the third written clinical history of 61.4% (CI 95%=59.1-63.7) of the total available. Conclusions: This educational program, carried out with standardized simulated patients, showed positive signs of improvement from the first to the third interview, in both the student self-evaluations and the level of interest and ease perceived by the SPs. Additionally, the mean level of information recorded in the written medical histories was considered to be acceptable.

Health and medical care for refugees: design and evaluation of a multidisciplinary clinical elective for medical students

Objective: Caring for refugee patients places special demands on health professionals. To date, medical students in Germany have rarely been systematically prepared for these challenges. This article reports on the development, conceptualisation, implementation, evaluation, and relevance of a multidisciplinary elective for medical students in the clinical study phase. Methodology: The course content was developed based on a needs-assessment among medical students and in cooperation with medical colleagues working in the field of refugee care. The course consisted of a seminar with medical, legal, administrative and socio-cultural learning content as well as a field placement in the medical outpatient clinic of the local reception centre for asylum seekers, which was accompanied by a systematic reflection process. The evaluation concept contained qualitative and quantitative elements. Results: 123 students completed the elective over six semesters (summer 2016 through to winter 2018). It was continuously evaluated and further developed. The students reported learning progress mainly in the following areas: Legal foundations of the asylum procedure and health care entitlements for asylum seekers; multi-perspectivity through multidisciplinarity as well as professional, ethical, interpersonal, and political insights gained through the practical experience. Summary: To prepare students for the complex challenges to be faced in medical care for refugees, a structured, multidisciplinary teaching programme, which combines theory, practice and reflection helps to foster insights into the many facets of this field of activity. The questions students brought to the seminar, the course contents and evaluation results are intended to inspire the design and implementation of similar courses at other universities.

Entrustment Decision Making: Extending Miller's Pyramid

The iconic Miller's pyramid, proposed in 1989, characterizes 4 levels of assessment in medical education ("knows," "knows how," "shows how," "does"). The frame work has created a worldwide awareness of the need to have different assessment approaches for different expected outcomes of education and training. At the time, Miller stressed the innovative use of simulation techniques, geared at the third level ("shows how"); however, the "does" level, assessment in the workplace, remained a largely uncharted area. In the 30 years since Miller's conference address and seminal paper, much attention has been devoted to procedures and instrument development for workplace-based assessment. With the rise of competency-based medical education (CBME), the need for approaches to determine the competence of learners in the clinical workplace has intensified. The proposal to use entrustable professional activities as a framework of assessment and the related entrustment decision making for clinical responsibilities at designated levels of supervision of learners (e.g., direct, indirect, and no supervision) has become a recent critical innovation of CBME at the "does" level. Analysis of the entrustment concept reveals that trust in a learner to work without assistance or supervision encompasses more than the observation of "doing" in practice (the "does" level). It implies the readiness of educators to accept the inherent risks involved in health care tasks and the judgment that the learner has enough experience to act appropriately when facing unexpected challenges. Earning this qualification requires qualities beyond observed proficiency, which led the authors to propose adding the level "trusted" to the apex of Miller's pyramid.

"There Is a Lot of Change Afoot": A Qualitative Study of Faculty Adaptation to Elimination of Tiered Grades With Increased Emphasis on Feedback in Core Clerkships

PURPOSE

Medical schools responding to challenges with fairness, equity, learning environments, and student wellness have reconsidered clerkship grades. This study used the Concerns-Based Adoption Model (CBAM) to explore how faculty responded to a change in the approach to assessment from focus on grades toward focus on feedback.

METHOD

This qualitative study used an inductive approach to analyze data from semistructured interviews with teaching faculty and education leaders at University of California, San Francisco, School of Medicine 6 months following the elimination of traditional tiered clerkship grades. Participants were recruited in 2019 using purposive sampling. Interview questions addressed participants' perceptions of the new approach to assessment and grading that emphasizes assessment for learning, including advantages and concerns. The authors analyzed data using thematic analysis informed by sensitizing concepts from CBAM.

RESULTS

Nineteen faculty participated (11 medicine, 8 surgery). Faculty expressed optimism about the impact of the change on their clinical educator roles and sought faculty development to enhance feedback and assessment skills. Perceived benefits to students addressed learning and wellness, with concern for students' motivation and professional development. Faculty shared uncertainty about their roles and larger systemic consequences involving the residency match and institutional reputation. Participants acknowledged that traditional grading is imperfect, yet felt a departure from this system represented significant culture change.

CONCLUSIONS

Faculty perceptions of the assessment and grade change in 2 large departments demonstrated tensions around grading. Their descriptions of change as an ongoing process aligned with CBAM and required them to consider new approaches and perspectives. While discourse about assessment and grading frequently focuses on learners, these findings support institutional consideration of the impact of changes in assessment on teaching faculty.

The COVID-19 Pandemic as an Imperative to Advance Medical Student Assessment: Three Areas for Change

Conditions caused by the COVID-19 pandemic have disrupted clinical practice and all aspects of medical education. Yet the need to continue to train physicians to care for patients and communities is greater than ever. Medical educators are responding by adapting curricula in response to requirements for social distancing, changing availability of clinical learning opportunities, and limitations on testing center availability for examinations. These disruptions require a systems approach to ensure that learners achieve competence in preparation for advancement in training toward unsupervised practice. In this article, the authors assert that medical educators, obligated by current conditions to adapt educational experiences, should seize the opportunity presented by the pandemic to make needed changes in 3 areas aligned with competency-based medical education: focusing on outcomes, broadening the assessment toolbox, and improving the undergraduate medical education-to-graduate medical education (UME-to-GME) transition. Defined outcomes, as exemplified by entrustable professional activities, will enable curricular designers to shorten and adapt learning experiences by focusing on students' achievement of prespecified learning outcomes. Broadening the assessment toolbox entails capturing more and different assessment information about learners to provide a well-rounded view of their strengths and areas for growth in both traditional and novel settings, such as telehealth. Limitations on available data, such as licensing examination scores and clerkship grades, heighten the urgency to revise the system for the UME-to-GME transition by enhancing the quality and usability of information available to residency program directors. Educators should capitalize on the opportunity presented by altered conditions due to the COVID-19 pandemic to make these needed changes to the educational system, to prepare physicians to provide health care and lead the health care system into the future.

Ethics in times of physical distancing: virtual training of ethical competences

Ethics teaching in medicine, nursing and other health care professions does not only consist of knowledge transfer that can be easily implemented digitally. Rather, it focuses on specific ethical competences (such as arguing and articulating one's own moral position) and attitudes (such as empathic patient orientation, critical self-reflection, and ambiguity tolerance), for whose development interactive formats are superior. Competence-oriented ethical learning goals are important for the development of professionalism, but require time, space and personal exchange. Due to contact restrictions and the widespread cancellation of (face-to-face) courses in the wake of the corona pandemic, ethics teaching was forced to keep its distance in many places, which posed great challenges. This article is based on an exchange of experiences from members of the working group ethik learning of the Academy for Ethics in Medicine about ethics teaching in times of physical distancing. Recommendations will be given on how ethical competence can be successfully taught in the context of exclusively digital teaching. Starting with the question what is at risk of being lost in digital teaching, the potentials of digital formats are explored and illustrated with concrete practical examples. Beyond ethics teaching, the article also aims to provide ideas and suggestions for other specialist and cross-sectional areas where interactive formats are central.

Peer teaching under pandemic conditions - options and challenges of online tutorials on practical skills

Background: Within days, the corona crisis has forced the "Lernzentrum", as well as all other places of training and further education, to discontinue classroom teaching at German universities and vocational schools. In order to start teaching online, tutors had to face the challenge to develop new digital learning formats (virtual classrooms) for the peer teaching of practical skills within a short time. This paper aims at outlining the project of developing e-tutorials with regard to the teaching of practical skills. Methodology: After analyzing the classroom lessons (n=30), some of the tutorials were transformed into digital formats. These so-called "e-tutorials" were held via a digital platform. They have been evaluated continuously with a standardized online questionnaire. The results of this evaluation have been analyzed descriptively. Results: From 27/04/2020 to 17/07/2020 eleven different e-tutorial formats were offered on 246 dates. The evaluation revealed a high degree of acceptance with these course offers as well as with the implementation by the tutors. Interpretation: During the pandemic crisis the substitution of peer teaching into forms of e-tutorials was considered valuable; however, these learning formats present challenges, especially with regard to the interaction between teachers and students. They cannot therefore fully replace the peer teaching of practical skills.

Priorities for the global advancement of care for older adults with cancer: an update of the International Society of Geriatric Oncology Priorities Initiative

In 2011, the International Society of Geriatric Oncology (SIOG) published the SIOG 10 Priorities Initiative, which defined top priorities for the improvement of the care of older adults with cancer worldwide.¹ Substantial scientific, clinical, and educational progress has been made in line with these priorities and international health policy developments have occurred, such as the shift of emphasis by WHO from communicable to non-communicable diseases and the adoption by the UN of its Sustainable Development Goals 2030. Therefore, SIOG has updated its priority list. The present document addresses four priority domains: education, clinical practice, research, and strengthening collaborations and partnerships. In this Policy Review, we reflect on how these priorities would apply in different economic settings, namely in high-income countries versus low-income and middle-income countries. SIOG hopes that it will offer guidance for international and national endeavours to provide adequate universal health coverage for older adults with cancer, who represent a major and rapidly growing group in global epidemiology.

Significant differences in written assessments as a result of a blended learning approach used in a clinical examination course in internal medicine: a randomized controlled pilot study

Background: Taking a medical history and performing a physical examination represent basic medical skills. However, numerous national and international studies show that medical students and physicians-to-be demonstrate substantial deficiencies in the proper examination of individual organ systems. Aim: The objective of this study was to conduct a randomized controlled pilot study to see if, in the context of a bedside clinical examination course in internal medicine, an additional app-based blended-learning strategy resulted in (a) higher satisfaction, better self-assessments by students when rating their history-taking skills (b1) and their ability to perform physical examinations (b2), as well as (c) higher multiple-choice test scores at the end of the course, when compared to a traditional teaching strategy. Methods: Within the scope of a bedside course teaching the techniques of clinical examination, 26 students out of a total of 335 students enrolled in the 2012 summer semester and 2012/2013 winter semester were randomly assigned to two groups of the same size. Thirteen students were in an intervention group (IG) with pre- and post-material for studying via an app-based blended-learning tool, and another 13 students were in a control group (CG) with the usual pre- and post-material (handouts). The IG was given an app specifically created for the history-taking and physical exam course, an application program for smartphones enabling them to view course material directly on the smartphone. The CG received the same information in the form of paper-based notes. Prior to course begin, all of the students filled out a questionnaire on sociodemographic data and took a multiple-choice pretest with questions on anamnesis and physical examination. After completing the course, the students again took a multiple-choice test with questions on anamnesis and physical examination. Results: When compared to the CG, the IG showed significantly more improvement on the multiple-choice tests after taking the clinical examination course (p=0.022). This improvement on the MC tests in the IG significantly correlated with the amount of time spent using the app (Spearman's rho=0.741, p=0.004). Conclusion: When compared to conventional teaching, an app-based blended-learning approach leads to improvement in test scores, possibly as a result of more intensive preparation for and review of the clinical examination course material.