Teaching and Assessment of Medical Students During Complex Multifactorial Team-Based Tasks: The "Virtual on Call" Case Study

Abstract

Although considerable efforts have been made to incorporate simulation-based learning (SBL) in undergraduate medical education, to date, most of the medical school curricula still focus on pure knowledge or individual assessment of objective structured clinical examination skills (OSCE). To this end, we designed a case study named "iG4 (integrated generation 4) virtual on-call (iVOC)". We aimed to simulate an on-call shift in a high-fidelity virtual hospital setting in order to assess delegates' team-based performance on tasks related to patient handovers (prioritisation, team allocation).

Methods

A total of 41 clinical year medical students were split into 3 cohorts, each of which included 3 groups of 4 or 5 people. The groups consisted of a structured mix of educational and cultural backgrounds of students to achieve homogeneity. Each performing group received the handover for 5 patients in the virtual hospital and had to identify and deal with the acutely unwell ones within 15 minutes. We used TEAMTM tool to assess team-based performances.

Results

The mean handover performance was 5.44/10 ± 2.24 which was the lowest across any performance marker. The overall global performance across any team was 6.64/10 ± 2.11. The first rotating team's global performance for each cycle was 6.44/10 ± 2.01, for the second 7.89/10 ± 2.09 and for the third 6.78/10 ± 1.64 (p = 0.099 between groups).

Conclusion

This is one of the first reported, high-fidelity, globally reproducible SBL settings to assess the capacity of students to work as part of a multinational team, highlighting several aspects that need to be addressed during undergraduate studies. Medical schools should consider similar efforts with the aim to incorporate assessment frameworks for individual performances of students as part of a team, which can be a stepping-stone for enhancing safety in clinical practice.

Group in-course assessment promotes cooperative learning and increases performance

The authors describe and evaluate a method to motivate medical students to maximize the effectiveness of dissection opportunities by using In-Course-Assessments (ICAs) to encourage teamwork. A student's final mark was derived by combining the group dissection mark, group mark for questions, and their individual question mark. An analysis of the impact of the ICA was performed by comparing end of module practical summative marks in student cohorts who had, or had not, participated in the ICAs. Summative marks were compared by two-way ANOVA followed by Dunnets test, or by repeated measures ANOVA, as appropriate. A cohort of medical students was selected that had experienced both practical classes without (year one) and with the new ICA structure (year two). Comparison of summative year one and year two marks illustrated an increased improvement in year two performance in this cohort. A significant increase was also noted when comparing this cohort with five preceding year two cohorts who had not experienced the ICAs (P <0.0001). To ensure that variation in the practical summative examination was not impacting on the data, a comparison was made between three cohorts who had performed the same summative examination. Results show that students who had undertook weekly ICAs showed significantly improved summative marks, compared with those who did not (P <0.0001). This approach to ICA promotes engagement with learning resources in an active, team-based, cooperative learning environment.