Competencies for first year residents - physicians' views from medical schools with different undergraduate curricula

[Interprofessional evaluation of "soft skills" of students in the practical year]

OBJECTIVE

The present study deals with the implementation of a questionnaire with 360° evaluation to assess the performance of students in the practical year (PJ). A special focus is put on the "soft skills" (self-competence, methodological competence, social competence), whose evaluation in medical studies has not yet taken place comprehensively.

MATERIAL & METHODS

The study was conducted prospectively with 21 PJ students of the Medical Faculty of the TU Dresden. The assessment was performed by means of a self-designed questionnaire, which was divided into 4 sub-competencies (self-competence, methodological competence, social competence, clinical skills and abilities), which could be assessed by means of a 6-point Likert scale. Four professions were involved in the assessment: Medical Service, Nursing Service, Functional Service, and Administration.

RESULTS

On average, the strongest deficits in terms of self-confidence, willingness to perform, and ability to deal with conflict were revealed by students in the PJ. Students showed a very good performance in performing a medical history and basic skills of clinical examination.

CONCLUSION

The implementation of 360° feedback is possible and useful for students in the internship year across disciplines and professions. Such personal and interprofessional feedback has not been widely available. The questionnaire represents the first comprehensive measurement tool of soft skills for medical students and provides a good basis for comprehensive feedback.

Development of an instrument for medical students' self-assessment of facets of competence for patient-centred care

OBJECTIVE

To develop a facets of competence self-assessment instrument (FOCSI) with operationalised items for ten competence facets required for patient-centred care at the beginning of residency.

METHODS

We conducted focus groups and cognitive interviews with final-year medical students to develop items that match students' clinical experience. We tested 50 items in two samples and analysed model fit and internal consistency of all possible combinations to identify the optimal ten-item-solution. Item analysis was performed as well as correlation with six personality traits.

RESULTS

An optimal ten-item solution for the self-assessment instrument emerged for sample 1 (n = 101, 27.2 ± 3.5 years, 75.2 % female). We validated the model fit with sample 2 (n = 135, 27.7 ± 3.9 years, 66.7 % female): χ2(35) = 49.3, p = .055, CFI = .94, RMSEA = .055, SRMR = .058, Cronbach's alpha = .78. The personality factors 'Conscientiousness' and 'Extraversion' correlate positively with most FOCSI items.

CONCLUSION

The operationalised FOCSI items support undergraduate medical students close to graduation in realistic self-assessment of facets of competences for patient-centred care in their transition to residency.

PRACTICE IMPLICATIONS

Realistic self-assessment of facets of competence will provide medical students with the opportunity to monitor their competence development as part of self-directed learning for gaining adaptive expertise in professional, patient-centred care.

"Fit for the finals" - project report on a telemedical training with simulated patients, peers, and assessors for the licensing exam

Background

Undergraduate medical students take the licensing exam (M3) as a two-day oral-practical examination. The main requirements are to demonstrate history taking skills and coherent case presentations. The aim of this project was to establish a training in which students can test their communication skills during history taking and their clinical reasoning skills in focused case presentations.

Methods

In the newly developed training, final-year students took four telemedical histories in the role of physicians from simulated patients (SP). They received further findings for two SPs and presented these in a handover, in which they also received a handover of two SPs which they had not seen themselves. Each student presented one of the two received SPs in a case discussion with a senior physician. Feedback was given to the participants on their communication and interpersonal skills by the SPs with the ComCare questionnaire and on the case presentation by the senior physician. Sixty-two students from the universities of Hamburg and Freiburg in their final year participated in September 2022 and evaluated the training.

Results

Participants felt that the training was very appropriate for exam preparation. The SPs' feedback on communication and the senior physician's feedback on clinical reasoning skills received the highest ratings in importance to the students. Participants highly valued the practice opportunity for structured history taking and case presentation and would like to have more such opportunities in the curriculum.

Conclusion

Essential elements of the medical licensing exam can be represented, including feedback, in this telemedical training and it can be offered independent of location.

The ICU Bridge Program: volunteers bridging medicine and people together

Background

The intensive care unit (ICU) is an emotionally taxing environment. Patients and family members are at an increased risk of long-term physical and psychological consequences of critical illness, known collectively as post-intensive care syndrome (PICS). These environmental strains can lead to a high incidence of staff turnover and burnout.

Aim

The ICU Bridge Program (ICUBP) is a student-led organization that attempts to mitigate these stressors on patients, family, and staff, by assigning university volunteers to ICUs across Montreal.

Setting

ICU.

Participants

ICU volunteers, staff, patients, and families.

Program description

The ICUBP volunteers support staff by orienting patients and families, while using effective communication strategies to provide comfort and promote a calm environment. The presence of volunteer visitors is helpful to patients who do not have the support of family members and/or friends. The program provides students with profound learning experiences by allowing them to shadow multidisciplinary teams, gaining a privileged and varied exposure to an acute medical environment, while developing their communications skills.

Program evaluation

The program reassesses its methods and impact via internal student-designed surveys distributed on a yearly basis to staff and volunteers.

Discussion

Research is warranted to assess the impact of the program on ICU patients, visitors, staff, and volunteers.

Assessment of final-year medical students' entrustable professional activities after education on an interprofessional training ward: A case-control study

INTRODUCTION

Interprofessional training wards (ITWs) are implemented to provide medical students with a holistic and authentic health care experience to improve their clinical competencies. Controlled outcome studies assessing students' competencies after ITW-training are uncommon. In this case-control study, we assessed final-year medical students who received ITW-training regarding entrustable professional activities (EPAs) and communicative as well as social competencies.

METHODS

In March 2021, 32 final-year students, 16 with (ITW group) and 16 without (control group) a previous four-week placement on an ITW participated in a training simulating the first day of residency. The simulated patients assessed students' communication and interpersonal skills for history taking with the ComCare index after every consultation. Twelve prospective EPAs were assessed by three senior physicians after watching videos of the students' case presentations.

RESULTS

While baseline characteristics and ComCare index ratings were not significantly different between the two groups, the overall mean entrustment level for the 12 EPAs was significantly higher (p < 0.001) in the ITW group compared to the control group (median = 3.15 versus 2.22). The interrater reliability for all EPAs was high and entrustment in students from the ITW group was significantly higher in 10 out of 12 EPAs.

DISCUSSION

ITW training seems to prepare medical students well to practice competencies which are relevant for prospective entrustment decisions and can be deduced by senior physicians from case presentations. Further studies with larger student cohorts are needed to corroborate this finding and observable EPAs could also be defined to assess students' competencies after ITW training.

Advanced undergraduate medical students' perceptions of basic medical competences and specific competences for different medical specialties - a qualitative study

BACKGROUND

Medical graduates should have acquired basic competences that enable them to practice medicine independently as physicians and to enter postgraduate training in any specialty they wish. Little is known about advanced undergraduate medical students' perceptions of basic medical competences needed to start postgraduate training and about specialty-specific competences. This qualitative study aims to identify medical students' perceptions of basic medical competences and specific competence requirements for different specialties.

METHODS

In December 2020, sixty-four advanced undergraduate medical students participated in the role of a resident in a competence-based telemedicine training simulating a first day in postgraduate training. After the training, eight focus group interviews were conducted about students' perceptions of basic medical competences and specialty-specific competences using a semi-structured interview guide. The interviews were transcribed and analysed thematically according to the six steps of Braun and Clarke. The analysis was carried out by an inductive search for themes, which were deductively assigned to the six competence areas of the requirement-tracking questionnaire (R-Track).

RESULTS

Regarding basic medical competences, four R-Track competence areas could be identified as main themes. The students considered 'Social-interactive competences' to be particularly relevant for basic clinical work, including 'Structuring information', 'Tactfulness', and 'Stress resistance'. Students especially emphasized 'Concentration' as an important aspect of the competence area 'Mental abilities'. Among 'Personality traits', 'Honesty' was mentioned most frequently, and students were also aware that 'Expertise' is particularly important for 'Motivation'. For different specialties, some competence areas were newly added to the competences needed for the respective specialty. For surgery, the competence areas 'Sensory abilities' and 'Psychomotor & multitasking abilities' were mentioned anew. 'Sensory abilities' were also newly attributed to radiology. 'Mental abilities' were mentioned as new competence area for psychiatry and internal medicine, while for anaesthesiology, 'Psychomotor & multitasking abilities' were newly added.

CONCLUSIONS

Advanced students seem to be well aware of basic competences needed for clinical practice. Good consensus between students and physicians was only found for psychiatry-specific competences. Medical schools should support their students in matching their perceptions of competences needed for specific specialties with specialty-specific requirements for a realistic choice of a specialty for postgraduate training.

A New Vision of Teaching Clinical Pharmacology and Therapeutics for Undergraduate Medical Students

For many years, clinical pharmacology (CP) has been taught at schools of medicine via traditional methods including classic lectures and experimental sessions. The explosion of scientific knowledge and the availability of many treatment options have necessitated the development of new strategies for pharmacology teaching and learning. Applying information learnt in real-life situations has become more important than finding information that is readily available in many places. The newly implemented reformed curriculum at Umm Al Qura University - Faculty of Medicine (UQUMED) is a student-centred, competency-based curriculum with enhanced integration across the disciplines. Teachers and students have a great responsibility in updating the curriculum. The "Use of Medicine" (UofM) vertical module is part of this reformed curriculum that focuses on key principles, a core list of medications, the vertical and horizontal integration of subjects, the knowledge application to real case situations, enhanced critical thinking and self-learning. It emphasizes rational prescribing, safe medical practice and excellence in teaching CP and therapeutics. The adoption of newer and innovative teaching and assessment methods and the training of faculty/staff can help to refresh CP education. One challenge in CP education is that teachers are shifting from acting as information providers to acting as facilitators so that students become life-long learners. The assessment of our reformed curriculum uses several valid reliable tools to evaluate the achieved skills and competencies. This manuscript describes the transformational changes in CP education at UQU up to the development and implementation of the UofM vertical module as part of the reformed UQUMED curriculum. Continuous updates in CP education are critical for rational, safe, and affordable medication prescribing for better patient care.

Student characteristics associated with interpersonal skills in medical consultations

BACKGROUND

The quality of medical care depends on effective physician-patient communication. Interpersonal skills can be improved through teaching, but the determinants are poorly understood. We therefore assessed the factors associated with the interpersonal skills of medical students during simulated medical consultations.

METHODS

We conducted a cross-sectional study of fourth-year medical students participating in simulated consultations with standardized patients. Each video-recorded medical consultation was independently assessed by two raters, using a cross-cultural adaptation of the Four Habits Coding Scheme (4-HCS) into French. We then collected information on demographics and education-related characteristics. The relationship between the overall 4-HCS score and student characteristics was modeled using univariable and multivariable linear regression.

RESULTS

Our analytical sample included 165 medical students for analysis. The factors significantly associated with 4-HCS score were gender (β = - 4.8, p = 0.011) and completion of an international clinical placement (β = 6.2, p = 0.002) or a research laboratory clerkship (β = 6.5, p = 0.005). Education-related characteristics, multiple-choice examinations in the first to third preclinical years, and number of medicine or surgery clerkships were not significantly associated with 4-HCS score.

CONCLUSIONS

Undergraduate students with higher level of interpersonal skills during video-recorded medical consultations with standardized patients are more likely to be female, to have completed international clinical placement as part of the ERASMUS exchange program or research laboratory clerkship.

Final-year medical students' self-assessment of facets of competence for beginning residents

BACKGROUND

Final-year undergraduate medical students often do not feel well prepared for their start of residency training. Self-assessment of competences is important so that medical trainees can take responsibility for their learning. In this study, we investigated how final-year medical students self-assessed their competences as they neared their transition to postgraduate training. The aim was to identify areas for improvement in undergraduate training.

METHODS

In the academic year 2019/2020, a national online survey was sent to final-year undergraduate medical students via their respective medical schools. The survey included ten facets of competence (FOC) most relevant for beginning residents. The participants were asked to self-assess their competence for each FOC on a 5-point Likert scale (1: strongly disagree to 5: strongly agree). We established an order of self-assessed FOC performance by means and calculated paired t-tests. Gender differences were assessed with independent t-tests.

RESULTS

A total of 1083 students from 35 medical schools completed the questionnaire. Mean age was 27.2 ± 3.1 years and 65.8% were female. Students rated their performance highest in the FOCs 'Teamwork and collegiality' and 'Empathy and openness' (97.1 and 95.0% 'strongly agree' or 'agree', respectively) and lowest in 'Verbal communication with colleagues and supervisors' and 'Scientifically and empirically grounded method of working' (22.8 and 40.2% 'strongly disagree', 'disagree', or 'neither agree nor disagree', respectively). Women rated their performance of 'Teamwork and collegiality', 'Empathy and openness', and 'Knowing and maintaining own personal bounds and possibilities' significantly higher than men did (Cohen's d > .2), while men showed higher self-assessed performance in 'Scientifically and empirically grounded method of working' than women (Cohen's d = .38). The FOCs 'Responsibility', 'Knowing and maintaining own personal bounds and possibilities', 'Structure, work planning, and priorities', 'Coping with mistakes', and 'Scientifically and empirically grounded method of working' revealed lower self-assessed performance than the order of FOC relevance established by physicians for beginning residents.

CONCLUSIONS

The differences between the level of students' self-assessed FOC performance and physicians' ranking of FOC relevance revealed areas for improvement in undergraduate medical education related to health system sciences. Final-year students might benefit from additional or better training in management skills, professionalism, and evidence-based medicine. Surveys of self-assessed competences may be useful to monitor competence development during undergraduate training.

Teaching and assessing communication skills in the postgraduate medical setting: a systematic scoping review

BACKGROUND

Poor communication skills can potentially compromise patient care. However, as communication skills training (CST) programs are not seen as a priority to many clinical departments, there is a discernible absence of a standardised, recommended framework for these programs to be built upon. This systematic scoping review (SSR) aims to gather prevailing data on existing CSTs to identify key factors in teaching and assessing communication skills in the postgraduate medical setting.

METHODS

Independent searches across seven bibliographic databases (PubMed, PsycINFO, EMBASE, ERIC, CINAHL, Scopus and Google Scholar) were carried out. Krishna's Systematic Evidence-Based Approach (SEBA) was used to guide concurrent thematic and content analysis of the data. The themes and categories identified were compared and combined where possible in keeping with this approach and then compared with the tabulated summaries of the included articles.

RESULTS

Twenty-five thousand eight hundred ninety-four abstracts were identified, and 151 articles were included and analysed. The Split Approach revealed similar categories and themes: curriculum design, teaching methods, curriculum content, assessment methods, integration into curriculum, and facilitators and barriers to CST. Amidst a wide variety of curricula designs, efforts to develop the requisite knowledge, skills and attitudes set out by the ACGME current teaching and assessment methods in CST maybe categorised into didactic and interactive methods and assessed along Kirkpatrick's Four Levels of Learning Evaluation.

CONCLUSIONS

A major flaw in existing CSTs is a lack of curriculum structure, focus and standardisation. Based upon the findings and current design principles identified in this SSR in SEBA, we forward a stepwise approach to designing CST programs. These involve 1) defining goals and learning objectives, 2) identifying target population and ideal characteristics, 3) determining curriculum structure, 4) ensuring adequate resources and mitigating barriers, 5) determining curriculum content, and 6) assessing learners and adopting quality improvement processes.

Assessing clinical reasoning in undergraduate medical students during history taking with an empirically derived scale for clinical reasoning indicators

BACKGROUND

The clinical reasoning process, which requires biomedical knowledge, knowledge about problem-solving strategies, and knowledge about reasons for diagnostic procedures, is a key element of physicians' daily practice but difficult to assess. The aim of this study was to empirically develop a Clinical Reasoning Indicators-History Taking-Scale (CRI-HT-S) and to assess the clinical reasoning ability of advanced medical students during a simulation involving history taking.

METHODS

The Clinical Reasoning Indictors-History Taking-Scale (CRI-HT-S) including a 5-point Likert scale for assessment was designed from clinical reasoning indicators identified in a qualitative study in 2017. To assess indicators of clinical reasoning ability, 65 advanced medical students (semester 10, n = 25 versus final year, n = 40) from three medical schools participated in a 360-degree competence assessment in the role of beginning residents during a simulated first workday in hospital. This assessment included a consultation hour with five simulated patients which was videotaped. Videos of 325 patient consultations were assessed using the CRI-HT-S. A factor analysis was conducted and the students' results were compared according to their advancement in undergraduate medical training.

RESULTS

The clinical reasoning indicators of the CRI-HT-S loaded on three factors relevant for clinical reasoning: 1) focusing questions, 2) creating context, and 3) securing information. Students reached significantly different scores (p < .001) for the three factors (factor 1: 4.07 ± .47, factor 2: 3.72 ± .43, factor 3: 2.79 ± .83). Students in semester 10 reached significantly lower scores for factor 3 than students in their final year (p < .05).

CONCLUSIONS

The newly developed CRI-HT-S worked well for quantitative assessment of clinical reasoning indicators during history taking. Its three-factored structure helped to explore different aspects of clinical reasoning. Whether the CRI-HT-S has the potential to be used as a scale in objective structured clinical examinations (OCSEs) or in workplace-based assessments of clinical reasoning has to be investigated in further studies with larger student cohorts.

Entrustable professional activities and facets of competence in a simulated workplace-based assessment for advanced medical students

Background: Competence-based assessment formats in medical education usually focus on individual facets of competence (FOCs). The concept of 'Entrustable Professional Activities' (EPAs) encompasses supervisors' decisions on which level of supervision a trainee requires to perform a professional activity including several FOCs. How the different FOCs as perceived by clinician raters contribute to entrustment decisions is yet unclear.Objective: How do FOC perceptions relate to entrustment-decisions?Methods: Sixty-seven advanced medical students participated in an assessment simulating the first day of a resident physician. Participants were rated by supervisors for seven FOCs and twelve EPAs.Results: There was a positive correlation between FOC and EPA scores. Each EPA displayed a different correlation pattern with FOC ratings.Discussion: For most EPAs high levels of entrustment were associated with high ratings for selected FOCs. The results are in alignment with the assumption that each EPA encompasses a different set of FOCs.Conclusions: In our simulated workplace-based assessment, entrustment decisions for EPAs reflect the FOCs observed in a trainee. Thus, assessment of FOCs alongside with EPA ratings could add to the understanding of factors contributing to entrustment decisions.

Are we preparing for collaboration, advocacy and leadership? Targeted multi-site analysis of collaborative intrinsic roles implementation in medical undergraduate curricula

BACKGROUND

The Collaborator, Health Advocate and Leader/Manager roles are highly relevant for safe patient management and optimization of healthcare system in rehabilitation and prevention. They are defined in competency-based frameworks and incorporate competencies empowering physicians to master typical daily tasks in interdisciplinary, interprofessional and institutional collaboration. However, appropriate implementation of roles remains difficult in undergraduate medical education (UME) and needs to be closely monitored. The aim of this cross-institutional mapping study was to examine for the roles of Collaborator, Health Advocate and Leader/Manager: (1) To what extent do German UME programs explicitly meet the given standards after 5 years of study? (2) Which information may be obtained from multi-site mapping data for evidence-based reflection on curricula and framework?

METHODS

In a joint project of eight German UME programs, 80 to 100% of courses were mapped from teachers' perspective against given national standards: (sub-)competency coverage, competency level attainment and assessment. All faculties used a common tool and consented procedures for data collection and processing. The roles' representation was characterized by the curricular weighting of each role content expressed by the percentage of courses referring to it (citations). Data were visualized in a benchmarking approach related to a general mean of the intrinsic roles as reference line.

RESULTS

(Sub-)competencies of the Health Advocate are consistently well-integrated in curricula with a wide range of generally high curricular weightings. The Collaborator reveals average curricular representation, but also signs of ongoing curricular development in relevant parts and clear weaknesses regarding assessment and achieved outcomes. The Leader/Manager displays consistently lowest curricular weightings with several substantial deficiencies in curricular representation, constructive alignment and/or outcome level. Our data allow identifying challenges to be considered by local curriculum developers or framework reviewers (e.g. non-achievement of competency levels, potential underrepresentation, lacking constructive alignment).

CONCLUSION

Our non-normative, process-related benchmarking approach provides a differentiated crosscut snapshot to compare programs in the field of others, thus revealing shortcomings in role implementation, especially for Leader/Manager and Collaborator. The synopsis of multi-site data may serve as an external reference for program self-assessment and goal-oriented curriculum development. It may also provide practical data for framework review.

Validation of a competence-based assessment of medical students' performance in the physician's role

BACKGROUND

Assessing competence of advanced undergraduate medical students based on performance in the clinical context is the ultimate, yet challenging goal for medical educators to provide constructive alignment between undergraduate medical training and professional work of physicians. Therefore, we designed and validated a performance-based 360-degree assessment for competences of advanced undergraduate medical students.

METHODS

This study was conducted in three steps: 1) Ten facets of competence considered to be most important for beginning residents were determined by a ranking study with 102 internists and 100 surgeons. 2) Based on these facets of competence we developed a 360-degree assessment simulating a first day of residency. Advanced undergraduate medical students (year 5 and 6) participated in the physician's role. Additionally knowledge was assessed by a multiple-choice test. The assessment was performed twice (t1 and t2) and included three phases: a consultation hour, a patient management phase, and a patient handover. Sixty-seven (t1) and eighty-nine (t2) undergraduate medical students participated. 3) The participants completed the Group Assessment of Performance (GAP)-test for flight school applicants to assess medical students' facets of competence in a non-medical context for validation purposes. We aimed to provide a validity argument for our newly designed assessment based on Messick's six aspects of validation: (1) content validity, (2) substantive/cognitive validity, (3) structural validity, (4) generalizability, (5) external validity, and (6) consequential validity.

RESULTS

Our assessment proved to be well operationalised to enable undergraduate medical students to show their competences in performance on the higher levels of Bloom's taxonomy. Its generalisability was underscored by its authenticity in respect of workplace reality and its underlying facets of competence relevant for beginning residents. The moderate concordance with facets of competence of the validated GAP-test provides arguments of convergent validity for our assessment. Since five aspects of Messick's validation approach could be defended, our competence-based 360-degree assessment format shows good arguments for its validity.

CONCLUSION

According to these validation arguments, our assessment instrument seems to be a good option to assess competence in advanced undergraduate medical students in a summative or formative way. Developments towards assessment of postgraduate medical trainees should be explored.

Exploring Behavioral Competencies for Effective Medical Practice in Nigeria

INTRODUCTION

Clinical performance varies due to academic, clinical, and behavioral factors. However, in many countries, selection of medical professionals tends to focus on exclusively academic ability and clinical acumen. Appropriate selection processes for medical professionals should consider behavioral factors, which may vary across contexts. This study was conducted to identify behavioral competencies considered relevant for effective medical practice in Nigeria, by medical students and doctors, and compared with other contexts.

METHODS

This mixed methods study draws on a scoping review and nominal group technique exercises. We undertook a scoping review to develop a list of behavioral attributes that may correlate with effective service provision in the empirical literature, across contexts. Drawing on nominal group technique exercises with 17 medical students and 11 physicians, this starting list was modified through scoring and ranking of selected competencies. We compared the list of competencies and rankings between medical students, doctors, and the scoping review.

RESULTS

The scoping review identified 9 articles for full-text review, resulting in a starting list of 21 behavioral competencies defined in studies, all of which had been conducted in non-African countries. The nominal group technique exercises conducted with medical students and doctors yielded a condensed list of 32 and 27 behavioral competencies respectively. For doctor-client interactions, effective communication and patient-centeredness were ranked highly, while for doctor-colleague interactions, teamwork, respectfulness, and management ability were ranked highly. There were also divergences in the condensed list of behavioral competencies and the scoping review, which may be explained by cultural and non-cultural factors.

DISCUSSION

This study is one of the few to examine the perspectives of medical students and physicians on behavioral competencies for effective medical practice in an African country. We found differences in the perspectives of medical physicians and students, and in the prioritized competencies across countries. Our study illustrates the need for careful consideration in identifying subject matter experts and in generalizing competencies across contexts. Future research in this field in Nigeria should examine effective ways of testing for key behavioral competencies among medical students and for residency programs. Also, investigating the perspectives of medical faculty and administrators on important competencies, and exploring the generalizability of these competencies across cultures in Nigeria should be considered.

The modular curriculum of medicine at the Charité Berlin - a project report based on an across-semester student evaluation

Aim: The introduction of a reform clause into the German licensing laws for medical doctors has enabled German faculties to pilot alternative designs for medical degree programmes. The aim of this project report is to outline the curricular features of the modular curriculum of medicine (MCM) at the Charité and to assess the results of its implementation based on a student evaluation across semesters. Project outline: The MCM was planned and implemented in a competency- and outcome-based manner from 2010-2016 in a faculty-wide process. The curriculum is characterised by a modular structure, longitudinal teaching formats and the integration of basic and clinical science. In the winter semester 2017, evaluations by students in semesters 1-10 were carried out. The results were analysed descriptively, and the coverage of overarching learning outcomes was compared to the results of a survey carried out amongst students on the traditional regular curriculum of medicine track in 2016. Results: A total of 1,047 students participated in the across-semester evaluation (return rate 35%). A high percentage of the respondents positively rated the achieved curricular integration and longitudinal teaching formats. The majority of the respondents agreed with the relevance of the overarching learning outcomes. Students' evaluations of the coverage of learning outcomes showed a differentiated picture for the MCM. Compared to the regular curriculum track, the coverage in the MCM programme showed substantial improvements in all aspects. Students found themselves to be better prepared for the M2 state examination and the practical year. The students' overall satisfaction with their decisions to study in the MCM was high. Conclusions: The results of the student evaluation show that a significant improvement in medical education has been achieved at the Charité with the new integrated, outcome-oriented design and the implementation of the MCM. At the same time, ongoing weaknesses have been revealed that serve as a basis for the continued development of the curriculum. This report aims to contribute to the discussion of the future of undergraduate medical education in Germany.

Scoping Review of Entrustable Professional Activities in Undergraduate Medical Education

PURPOSE

Entrustable professional activities (EPAs) are a hot topic in undergraduate medical education (UME); however, the usefulness of EPAs as an assessment approach remains unclear. The authors sought to better understand the literature on EPAs in UME through the lens of the 2010 Ottawa Conference Criteria for Good Assessment.

METHOD

The authors conducted a scoping review of the health professions literature (search updated February 2018), mapping publications to the Ottawa Criteria using a collaboratively designed charting tool.

RESULTS

Of the 1,089 publications found, 71 (6.5%) met inclusion criteria. All were published after 2013. Forty-five (63.4%) referenced the 13 Core Entrustable Professional Activities for Entering Residency developed by the Association of American Medical Colleges (AAMC). Forty (56.3%) were perspectives, 5 (7.0%) were reviews, and 26 (36.6%) were prospective empirical studies. The publications mapped to the Ottawa Criteria 158 times. Perspectives mapped more positively (83.7%) than empirical studies (76.7%). Reproducibility did not appear to be a strength of EPAs in UME; however, reproducibility, equivalence, educational effect, and catalytic effect all require further study. Inconsistent use of the term "EPA" and conflation of concepts (activity vs assessment vs advancement decision vs curricular framework) limited interpretation of published results. Overgeneralization of the AAMC's work on EPAs has influenced the literature.

CONCLUSIONS

Much has been published on EPAs in UME in a short time. Now is the time to move beyond opinion, clarify terms, and delineate topics so that well-designed empirical studies can demonstrate if and how EPAs should be implemented in UME.

Embracing Multiple Stakeholder Perspectives in Defining Trainee Competence

PURPOSE

To explore how multiple stakeholder groups contribute to the understanding of trainee competence.

METHOD

The authors conducted a constructivist qualitative study in 2015 using focus group discussions to explore the perceptions of different stakeholder groups (patients, nurses/nurse practitioners, supervisors/senior physicians, leaders/administrators, trainees) regarding trainee competence in the emergency department. The authors used a conventional content analysis, a comparative analysis of supervisors'/senior physicians' versus other stakeholders' perspectives, and a directed analysis informed by stakeholder theory to analyze the focus group transcripts.

RESULTS

Forty-six individuals participated in nine focus groups. Four categories of competence were identified: Core Clinical Activities, Patient Centeredness, Aligning Resources, and Code of Conduct. Stakeholders generally agreed in their overall expectations regarding trainee competence. Within individual categories, each stakeholder group identified new considerations, details, and conflicts, which were a replication, elaboration, or complication of a previously identified theme. All stakeholders stressed those aspects of trainee competence that were relevant to their work or values. Trainees were less aware of the patient perspective than that of the other stakeholder groups.

CONCLUSIONS

Considering multiple stakeholder perspectives enriched the description and conceptualization of trainee competence. It also can inform the development of curricula and assessment tools and guide learning about inter- and intradisciplinary conflicts. Further research should explore how trainees' perceptions of value are influenced by their organizational context and, in particular, how trainees adapt their learning goals in response to the divergent demands of key stakeholders.

Challenges & Issues: Evidence-Based Clinical Skills Teaching and Learning: What Do We Really Know?

The recent programmatic focus on skills development in veterinary medicine means that many programs are devoting increased time to formal clinical skills teaching. This expansion makes it essential that we use the time as effectively as possible. This review examines current practices and veterinary training principles using the broader field of evidence-based motor skills learning as a lens. In many areas, current practices may be hindering learning. Proposed practices include using videos and discussions for pre-laboratory training, focusing on a single complex skill at a time, using more near-peer instructors rather than faculty, including assessments in each teaching or practice session, and encouraging supervised distributed practice by incorporating practice sessions into the formal curriculum. Ensuring mastery of a few core skills rather than exposure to many may be the new goal. Further research is urgently needed on block versus spiral curricula, optimum instructor-to-student ratios, learning and practice schedules, hours required for proficiency, and the benefits of exercise on motor skills learning.

Interprofessional assessment of medical students' competences with an instrument suitable for physicians and nurses

BACKGROUND

Physicians need a set of specific competences to perform well in interprofessional teams in their first year of residency. These competences should be achieved with graduation from medical school. Assessments during undergraduate medical studies are mostly rated by supervisors only. The aim of our study was to compare the rating of core facets of competence of medical students late in their undergraduate training as well as the rating confidence between three different groups of assessors (supervisors, residents, and nurses) in an assessment simulating the first day of residency.

METHODS

Sixty-seven advanced medical students from three different medical schools (Hamburg, Oldenburg and Munich) participated in a 360-degree assessment simulating the first working day of a resident. Each participant was rated by three assessors - a supervisor, a resident and a nurse - in seven facets of competence relevant for the first year of residency: (1) responsibility, (2) teamwork and collegiality, (3) knowing and maintaining own personal bounds and possibilities, (4) structure, work planning and priorities, (5) coping with mistakes, (6) scientifically and empirically grounded method of working, and (7) verbal communication with colleagues and supervisors. Means of all assessed competences and confidences of judgement of the three rating groups were compared. Additionally, correlations between assessed competences and confidence of judgement within each group of raters were computed.

RESULTS

All rating groups showed consistent assessment decisions (Cronbach's α: supervisors = .90, residents = .80, nurses = .78). Nurses assessed the participants significantly higher in all competences compared to supervisors and residents (all p ≤ .05) with moderate and high effect sizes (d = .667-1.068). While supervisors' and residents' ratings were highest for "teamwork and collegiality", participants received the highest rating by nurses for "responsibility". Competences assessed by nurses were strongly positively correlated with their confidence of judgment while supervisors' assessments correlated only moderately with their confidence of judgment in two competences.

CONCLUSIONS

Different professional perspectives provide differentiated competence ratings for medical students in the role of a beginning resident. Rating confidence should be enhanced by empirically derived behavior checklists with anchors, which need to be included in rater training to decrease raters' subjectivity.

Assessing core competences of medical students with a test for flight school applicants

BACKGROUND

Important competences of physicians regarding patient safety include communication, leadership, stress resistance, adherence to procedures, awareness, and teamwork. Similarly, while selected, prospective flight school applicants are tested for the same set of skills. The aim of our study was to assess these core competences in advanced undergraduate medical students from different medical schools.

METHODS

In 2017, 67 medical students (year 5 and 6) from the universities of Hamburg, Oldenburg, and TU Munich, Germany, participated in the verified Group Assessment Performance (GAP)-Test at the German Aerospace Center (DLR) in Hamburg. All participants were rated by DLR assessment observers with a set of empirically derived behavioural checklists. This lists consisted of 6-point rating scales (1: very low occurrence to 6: very high occurrence) and included the competences leadership, teamwork, stress resistance, communication, awareness, and adherence to procedures. Medical students' scores were compared with the results of 117 admitted flight school applicants.

RESULTS

Medical students showed significantly higher scores than admitted flight school applicants for adherence to procedures (p < .001, d = .63) and communication (p < .01, d = .62). They reached significantly lower ratings for teamwork (p < .001, d = .77), stress resistance (p < 0.001, d = .70), and awareness (p < .001, d = 1.31). Students in semester 10 showed significantly (p < .02, d = .58) higher scores in domain awareness compared to the final year students. On average, flight school entrance level was not reached by either group for this domain.

CONCLUSIONS

Advanced medical students' low results for awareness are alarming as awareness is essential and integrative for clinical reasoning and patient safety. Further studies should elucidate and discuss whether awareness needs to be included in medical student selection or integrated into the curriculum in training units.

Perceived strain of undergraduate medical students during a simulated first day of residency

BACKGROUND

Residents face demanding situations on the job and have been found to perceive high levels of strain. Medical students also reported a high degree of strain and even depressive tendencies when entering their clinical rotations. The aim of this study was to explore the perceived strain of medical students from different undergraduate curricula and at different stages of academic advancement during different phases of an assessment simulating a resident's first day in hospital.

METHODS

Sixty-seven undergraduate medical students participated in the following three phases of the assessment in the role of a resident: a consultation hour with five simulated patients, a management phase with interprofessional contact, and a patient handover with a colleague. They completed the Strain Perception Questionnaire (STRAIPER) after each phase. Students from different undergraduate curricula (VI: vertically integrated, n = 35 versus non-VI: not vertically integrated, n = 26) and different academic advancement (semester 10, n = 26 versus final year, n = 41) were compared.

RESULTS

All students showed the highest strain level after the management phase compared to the consultation hour and the handover. Medical students from a non-VI curriculum felt significantly more strain in the dimension of agitation (p < .05) after the consultation hour compared to students from a VI curriculum and compared to the management phase and the handover. No significant difference in perceived strain was found between students from semester 10 compared to final year students.

CONCLUSIONS

During the consultation hour and the handover with a colleague medical students faced tasks which are familiar to them from undergraduate education. Their higher strain levels during the management phase might occur because they are confronted with unfamiliar tasks and decisions. Feeling responsible for the right actions in this phase of multitasking and professional interaction might have added to the strain students perceived during this phase. Patient management should be emphasized more in any type of undergraduate medical curriculum.