Assessing core competences of medical students with a test for flight school applicants

A scoping review of emotions and related constructs in simulation-based education research articles

BACKGROUND

While acknowledgement of emotions' importance in simulation-based education is emerging, there are concerns regarding how education researchers understand the concept of emotions for them to deliberately incorporate emotionally charged scenarios into simulation-based education. This concern is highlighted especially in the context of medical education often lacking strong theoretical integration. To map out how current simulation-based education literature conceptualises emotion, we conducted a scoping review on how emotions and closely related constructs (e.g. stress, and emotional intelligence) are conceptualised in simulation-based education articles that feature medical students, residents, and fellows.

METHODS

The scoping review was based on articles published in the last decade identified through database searches (EMBASE and Medline) and hand-searched articles. Data extraction included the constructs featured in the articles, their definitions, instruments used, and the types of emotions captured. Only empirical articles were included (e.g. no review or opinion articles). Data were charted via descriptive analyses.

RESULTS

A total of 141 articles were reviewed. Stress was featured in 88 of the articles, while emotions and emotional intelligence were highlighted in 45 and 34 articles respectively. Conceptualisations of emotions lacked integration of theory. Measurements of emotions mostly relied on self-reports while stress was often measured via physiological and self-report measurements. Negative emotions such as anxiety were sometimes seen as interchangeable with the term stress. No inferences were made about specific emotions of participants from their emotional intelligence.

CONCLUSIONS

Our scoping review illustrates that learners in simulation-based education are most often anxious and fearful. However, this is partially due to medical education prioritising measuring negative emotions. Further theoretical integration when examining emotions and stress may help broaden the scope towards other kinds of emotions and better conceptualisations of their impact. We call for simulation education researchers to reflect on how they understand emotions, and whether their understanding may neglect any specific aspect of affective experiences their simulation participants may have.

Validation of a competence-based assessment of medical students' performance in the physician's role

BACKGROUND

Assessing competence of advanced undergraduate medical students based on performance in the clinical context is the ultimate, yet challenging goal for medical educators to provide constructive alignment between undergraduate medical training and professional work of physicians. Therefore, we designed and validated a performance-based 360-degree assessment for competences of advanced undergraduate medical students.

METHODS

This study was conducted in three steps: 1) Ten facets of competence considered to be most important for beginning residents were determined by a ranking study with 102 internists and 100 surgeons. 2) Based on these facets of competence we developed a 360-degree assessment simulating a first day of residency. Advanced undergraduate medical students (year 5 and 6) participated in the physician's role. Additionally knowledge was assessed by a multiple-choice test. The assessment was performed twice (t1 and t2) and included three phases: a consultation hour, a patient management phase, and a patient handover. Sixty-seven (t1) and eighty-nine (t2) undergraduate medical students participated. 3) The participants completed the Group Assessment of Performance (GAP)-test for flight school applicants to assess medical students' facets of competence in a non-medical context for validation purposes. We aimed to provide a validity argument for our newly designed assessment based on Messick's six aspects of validation: (1) content validity, (2) substantive/cognitive validity, (3) structural validity, (4) generalizability, (5) external validity, and (6) consequential validity.

RESULTS

Our assessment proved to be well operationalised to enable undergraduate medical students to show their competences in performance on the higher levels of Bloom's taxonomy. Its generalisability was underscored by its authenticity in respect of workplace reality and its underlying facets of competence relevant for beginning residents. The moderate concordance with facets of competence of the validated GAP-test provides arguments of convergent validity for our assessment. Since five aspects of Messick's validation approach could be defended, our competence-based 360-degree assessment format shows good arguments for its validity.

CONCLUSION

According to these validation arguments, our assessment instrument seems to be a good option to assess competence in advanced undergraduate medical students in a summative or formative way. Developments towards assessment of postgraduate medical trainees should be explored.

Medical knowledge and teamwork predict the quality of case summary statements as an indicator of clinical reasoning in undergraduate medical students

Background: Clinical reasoning refers to a thinking process including medical problem solving and medical decision making skills. Several studies have shown that the clinical reasoning process can be influenced by a number of factors, e.g. context or personality traits, and the results of this thinking process are expressed in case presentation. The aim of this study was to identify factors, which predict the quality of case summary statements as an indicator of clinical reasoning of undergraduate medical students in an assessment simulating the first day of residency. Methods: To investigate factors predicting aspects of clinical reasoning 67 advanced undergraduate medical students participated in the role of a beginning resident in our competence-based assessment, which included a consultation hour, a patient management phase, and a handover. Participants filled out a Post Encounter Form (PEF) to document their case summary statements and other aspects of clinical reasoning. After each phase, they filled out the Strain Perception Questionnaire (STRAIPER) to measure their situation dependent mental strain. To assess medical knowledge the participants completed a 100 questions multiple choice test. To measure stress resistance, adherence to procedures, and teamwork students took part in the Group Assessment of Performance (GAP) test for flight school applicants. These factors were included in a multiple linear regression analysis. Results: Medical knowledge and teamwork predicted the quality of case summary statements as an indicator of clinical reasoning of undergraduate medical students and explained approximately 20.3% of the variance. Neither age, gender, undergraduate curriculum, academic advancement nor high school grade point average of the medical students of our sample had an effect on their clinical reasoning skills. Conclusion: The quality of case summary statements as an indicator of clinical reasoning can be predicted in undergraduate medical students by their medical knowledge and teamwork. Students should be supported in developing abilities to work in a team and to acquire long term knowledge for good case summary statements as an important aspect of clinical reasoning.