Use of a Serious Game to Teach Infectious Disease Management in Medical School: Effectiveness and Transfer to a Clinical Examination

Purpose

Physicians of all specialties must be familiar with important principles of infectious diseases, but curricular time for this content is limited and clinical teaching requires considerable resources in terms of available patients and teachers. Serious games are scalable interventions that can help standardize teaching. This study assessed whether knowledge and skills acquired in a serious game translate to better performance in a clinical examination.

Methods

Fifth-year undergraduate medical students (n = 100) at Goettingen Medical School were randomized to three groups receiving different levels of exposure to virtual patients presenting with signs and symptoms of either infective endocarditis or community-acquired pneumonia in a serious game simulating an accident and emergency department. Student performance was assessed based on game logfiles and an objective standardized clinical examination (OSCE).

Results

Higher exposure to virtual patients in the serious game did not result in superior OSCE scores. However, there was good agreement between student performance in the OSCE and in game logfiles (r = 0.477, p = 0.005). An Item Response Theory analysis suggested that items from the serious game covered a wider range of ability, thus better differentiating between students within a given cohort.

Conclusion

Repeated exposure to virtual patients with infectious diseases in a serious game did not directly impact on exam performance but game logfiles might be good and resource-sparing indicators of student ability. One advantage of using serious games in medical education is standardized content, a lower inhibition threshold to learn, and a need of less staff time compared to small-group clinical teaching.

Effectiveness of a serious game addressing guideline adherence: cohort study with 1.5-year follow-up

BACKGROUND

Patients presenting with acute shortness of breath and chest pain should be managed according to guideline recommendations. Serious games can be used to train clinical reasoning. However, only few studies have used outcomes beyond student satisfaction, and most of the published evidence is based on short-term follow-up. This study investigated the effectiveness of a digital simulation of an emergency ward regarding appropriate clinical decision-making.

METHODS

In this prospective trial that ran from summer 2017 to winter 2018/19 at Göttingen Medical University Centre, a total of 178 students enrolled in either the fourth or the fifth year of undergraduate medical education took six 90-min sessions of playing a serious game ('training phase') in which they managed virtual patients presenting with various conditions. Learning outcome was assessed by analysing log-files of in-game activity (including choice of diagnostic methods, differential diagnosis and treatment initiation) with regard to history taking and patient management in three virtual patient cases: Non-ST segment elevation myocardial infarction (NSTEMI), pulmonary embolism (PE) and hypertensive crisis. Fourth-year students were followed up for 1.5 years, and their final performance was compared to the performance of students who had never been exposed to the game but had otherwise taken the same five-year undergraduate course.

RESULTS

During the training phase, overall performance scores increased from 57.6 ± 1.1% to 65.5 ± 1.2% (p < 0.001; effect size 0.656). Performance remained stable over 1.5 years, and the final assessment revealed a strong impact of ever-exposure to the game on management scores (72.6 ± 1.2% vs. 63.5 ± 2.1%, p < 0.001; effect size 0.811). Pre-exposed students were more than twice as likely to correctly diagnose NSTEMI and PE and showed significantly greater adherence to guideline recommendations (e.g., troponin measurement and D-dimer testing in suspected PE).

CONCLUSIONS

The considerable difference observed between previously exposed and unexposed students suggests a long-term effect of using the game although retention of specific virtual patient cases rather than general principles might partially account for this effect. Thus, the game may foster the implementation of guideline recommendations.

The Impact of Medical Students' Individual Teaching Format Choice on the Learning Outcome Related to Clinical Reasoning

BACKGROUND

Repeated formative assessments using key feature questions have been shown to enhance clinical reasoning. Key feature questions augmented by videos presenting clinical vignettes may be more effective than text-based questions, especially in a setting where medical students are free to choose the format they would like to work with. This study investigated learning outcomes related to clinical reasoning in students using video- or text-based key feature questions according to their individual preferences.

OBJECTIVE

The aim of this study was to test the hypothesis that repeated exposure to video-based key feature questions enhances clinical reasoning to a greater extent than repeated exposure to text-based key feature questions if students are allowed to choose between those different formats on their own.

METHODS

In this monocentric, prospective, nonrandomized trial, fourth-year medical students attended 12 computer-based case seminars during which they worked on case histories containing key feature questions. Cases were available in a text- and a video-based format. Students chose their preferred presentation format at the beginning of each case seminar. Student performance in key feature questions was assessed in formative entry, exit, and retention exams and was analyzed with regard to preceding exposure to video- or text-based case histories.

RESULTS

Of 102 eligible students, 75 provided written consent and complete data at all study exams (response rate=73.5%). A majority of students (n=52) predominantly chose the text-based format. Compared with these, students preferring the video-based format achieved a nonsignificantly higher score in the exit exam (mean 76.2% [SD 12.6] vs 70.0% [SD 19.0]; P=.15) and a significantly higher score in the retention exam (mean 75.3% [SD 16.6] vs 63.4% [SD 20.3]; P=.02). The effect was independent of the video- or text-based presentation format, which was set as default in the respective exams.

CONCLUSIONS

Despite students' overall preference for text-based case histories, the learning outcome with regard to clinical reasoning was higher in students with higher exposure to video-based items. Time-on-task is one conceivable explanation for these effects as working with video-based items was more time-consuming. The baseline performance levels of students do not account for the results as the preceding summative exam results were comparable across the 2 groups. Given that a substantial number of students chose a presentation format that was less effective, students might need to be briefed about the beneficial effects of using video-based case histories to be able to make informed choices about their study methods.

Serious Games in Surgical Medical Education: A Virtual Emergency Department as a Tool for Teaching Clinical Reasoning to Medical Students

Background

Serious games enable the simulation of daily working practices and constitute a potential tool for teaching both declarative and procedural knowledge. The availability of educational serious games offering a high-fidelity, three-dimensional environment in combination with profound medical background is limited, and most published studies have assessed student satisfaction rather than learning outcome as a function of game use.

Objective

This study aimed to test the effect of a serious game simulating an emergency department (“EMERGE”) on students’ declarative and procedural knowledge, as well as their satisfaction with the serious game.

Methods

This nonrandomized trial was performed at the Department of General, Visceral and Cancer Surgery at University Hospital Cologne, Germany. A total of 140 medical students in the clinical part of their training (5th to 12th semester) self-selected to participate in this experimental study. Declarative knowledge (measured with 20 multiple choice questions) and procedural knowledge (measured with written questions derived from an Objective Structured Clinical Examination station) were assessed before and after working with EMERGE. Students’ impression of the effectiveness and applicability of EMERGE were measured on a 6-point Likert scale.

Results

A pretest-posttest comparison yielded a significant increase in declarative knowledge. The percentage of correct answers to multiple choice questions increased from before (mean 60.4, SD 16.6) to after (mean 76.0, SD 11.6) playing EMERGE (P<.001). The effect on declarative knowledge was larger in students in lower semesters than in students in higher semesters (P<.001). Additionally, students’ overall impression of EMERGE was positive.

Conclusions

Students self-selecting to use a serious game in addition to formal teaching gain declarative and procedural knowledge.

Effect of different scoring approaches upon credit assignment when using Multiple True-False items in dental undergraduate examinations

INTRODUCTION

Various scoring approaches for Multiple True-False (MTF) items exist. This study aimed at comparing scoring results obtained with different scoring approaches and to assess the effect of item cues on each scoring approaches' result.

MATERIALS AND METHODS

Different scoring approaches (MTF, Count-2, Count-3, "Vorkauf-Method," PS₅₀ , Dichotomized MTF, "Blasberg-Method," Multiple response (MR), Correction for Guessing, "Ripkey-Method," Morgan-Method, Balanced Scoring Method) were retrospectively applied to all MTF items used within electronic examinations of undergraduate dental students at the University Medical Center Göttingen in the winter term 2016/2017 (1297 marking events). Item quality was evaluated regarding formal parameters such as presence of cues and correctness of content. Differences between scoring results of all scoring approaches and the differences between each methods' scoring results of items with and without cues were calculated by Wilcoxon rank sum tests (P < .05).

RESULTS

Average scoring results per item highly differed between the scoring approaches and ranged from 0.46 (MR) to 0.92 (Dichotomized MTF). Presence of cues leads to significantly higher scoring in case of all scoring approaches (P < .001; +0.14 on average). However, effect of cues differed amongst scoring approaches and ranged from +0.04 (Dichotomized MTF) to +0.20 (MR).

CONCLUSION

Scoring of MTF items is complex. The data presented in this manuscript may help educators make informed choices about scoring algorithms.

Training of clinical reasoning with a Serious Game versus small-group problem-based learning: A prospective study

INTRODUCTION

Serious Games are increasingly being used in undergraduate medical education. They are usually intended to enhance learning with a focus on knowledge acquisition and skills development. According to the current literature, few studies have assessed their effectiveness regarding clinical reasoning (CR). The aim of this prospective study was to compare a Serious Game, the virtual Accident & Emergency department 'EMERGE' to small-group problem-based learning (PBL) regarding student learning outcome on clinical reasoning in the short term.

METHODS

A total of 112 final-year medical students self-selected to participate in ten 90-minute sessions of either small-group PBL or playing EMERGE. CR was assessed in a formative examination consisting of six key feature cases and a final 45-minute EMERGE session.

RESULTS

Overall, the EMERGE group (n = 78) scored significantly higher than the PBL group (n = 34) in the key feature examination (62.5 (IQR: 17.7)% vs. 54.2 (IQR: 21.9)%; p = 0.015). There was no significant difference in performance levels between groups regarding those cases which had been discussed in both instructional formats during the training phase. In the final EMERGE session, the EMERGE group achieved significantly better results than the PBL group in all four cases regarding the total score as well as in three of four cases regarding the final diagnosis and the correct therapeutic interventions.

CONCLUSION

EMERGE can be used effectively for CR training in undergraduate medical education. The difference in key feature exam scores was driven by additional exposure to more cases in EMERGE compared to PBL despite identical learning time in both instructional formats. EMERGE is a potential alternative to intensive small-group teaching. Further work is needed to establish how Serious Games enhance CR most effectively.

Diagnosis of invasive fungal diseases in haematology and oncology: 2018 update of the recommendations of the infectious diseases working party of the German society for hematology and medical oncology (AGIHO)

Invasive fungal diseases (IFD) are a primary cause of morbidity and mortality in patients with haematological malignancies. These infections are mostly life-threatening and an early diagnosis and initiation of appropriate antifungal therapy are essential for the clinical outcome. Most commonly, Aspergillus and Candida species are involved. However, other Non-Aspergillus moulds are increasingly identified in case of documented IFD. For definite diagnosis of IFD, a combination of diagnostic tools have to be applied, including conventional mycological culture and non-conventional microbiological tests such as antibody/antigen and molecular tests, as well as histopathology and radiology. Although varying widely in cancer patients, the risk of invasive fungal infection is highest in those with allogeneic stem cell transplantation and those with acute leukaemia and markedly lower in patients with solid cancer. Since the last edition of Diagnosis of Invasive Fungal Diseases recommendations of the German Society for Hematology and Oncology in 2012, integrated care pathways have been proposed for the management and therapy of IFDs with either a diagnostic driven strategy as opposed to a clinical or empirical driven strategy. This update discusses the impact of this additional evidence and effective revisions.

How can we teach medical students to choose wisely? A randomised controlled cross-over study of video- versus text-based case scenarios

BACKGROUND

The Choosing Wisely campaign highlights the importance of clinical reasoning abilities for competent and reflective physicians. The principles of this campaign should be addressed in undergraduate medical education. Recent research suggests that answering questions on important steps in patient management promotes knowledge retention. It is less clear whether increasing the authenticity of educational material by the inclusion of videos further enhances learning outcome.

METHODS

In a prospective randomised controlled cross-over study, we assessed whether repeated video-based testing is more effective than repeated text-based testing in training students to choose appropriate diagnostic tests, arrive at correct diagnoses and identify advisable therapies. Following an entry exam, fourth-year undergraduate medical students attended 10 weekly computer-based seminars during which they studied patient case histories. Each case contained five key feature questions (items) on the diagnosis and treatment of the presented patient. Students were randomly allocated to read text cases (control condition) or watch videos (intervention), and assignment to either text or video was switched between groups every week. Using a within-subjects design, student performance on video-based and text-based items was assessed 13 weeks (exit exam) and 9 months (retention test) after the first day of term. The primary outcome was the within-subject difference in performance on video-based and text-based items in the exit exam.

RESULTS

Of 125 eligible students, 93 provided data for all three exams (response rate 74.4%). Percent scores were significantly higher for video-based than for text-based items in the exit exam (76.2 ± 19.4% vs. 72.4 ± 19.1%, p = 0.026) but not the retention test (69.2 ± 20.2% vs. 66.4 ± 20.3%, p = 0.108). An additional Bayesian analysis of this retention test suggested that video-based training is marginally more effective than text-based training in the long term (Bayes factor 2.36). Regardless of presentation format, student responses revealed a high prevalence of erroneous beliefs that, if applied to the clinical context, could place patients at risk.

CONCLUSION

Repeated video-based key feature testing produces superior short-term learning outcome compared to text-based testing. Given the high prevalence of misconceptions, efforts to improve clinical reasoning training in medical education are warranted. The Choosing Wisely campaign lends itself to being part of this process.

[Choosing Wisely in medical education]

Choosing Wisely recommendations address situations where physicians will have to make decisions about further diagnostic and therapeutic steps. Undergraduate medical education needs to equip students with the foundations on which clinical reasoning skills can be acquired and fostered throughout their clinical career. Teaching these skills usually involves patients (e.g., bedside teaching, electives, clinical attachments) but it can also be delivered in the format of formalised small-group, case-based learning. Case-based key feature tests have been developed to facilitate the assessment of learning outcomes related to clinical reasoning. Repeated testing with key feature cases yields better medium-term retention than repeatedly studying the same material (without questions). The project 'Choosing Wisely in medical education', which was funded by the German Association for Internal Medicine, involves the creation of key feature cases with reference to the German set of Choosing Wisely recommendations. This article presents the results of the first pilot study using these new cases.

How can we improve teaching of ECG interpretation skills? Findings from a prospective randomised trial

BACKGROUND

There is an ongoing debate on how ECG interpretation should be taught during undergraduate medical training. This study addressed the impact of teaching format, examination consequences and student motivation on skills retention.

METHODS

A total of 493 fourth-year medical students participated in a six-group, partially randomised trial. Students received three levels of teaching intensity: self-directed learning (2 groups), lectures (2 groups) or small-group peer-teaching (2 groups). On each level of teaching intensity, end-of-course written examinations (ECG exit exam) were summative in one group and formative in the other. Learning outcome was assessed in a retention test two months later.

RESULTS

Retention test scores were predicted by summative assessments (adjusted beta 4.08; 95% CI 1.39-6.78) but not by the type of teaching. Overall performance levels and motivation did not predict performance decrease or skills retention.

CONCLUSIONS

Summative assessments increase medium-term retention of ECG interpretation skills, irrespective of instructional format.

Moving Knowledge Acquisition From the Lecture Hall to the Student Home: A Prospective Intervention Study

BACKGROUND

Podcasts are popular with medical students, but the impact of podcast use on learning outcomes in undergraduate medical education has not been studied in detail.

OBJECTIVE

Our aim was to assess the impact of podcasts accompanied by quiz questions and lecture attendance on short- and medium-term knowledge retention.

METHODS

Students enrolled for a cardio-respiratory teaching module were asked to prepare for 10 specific lectures by watching podcasts and submitting answers to related quiz questions before attending live lectures. Performance on the same questions was assessed in a surprise test and a retention test.

RESULTS

Watching podcasts and submitting answers to quiz questions (versus no podcast/quiz use) was associated with significantly better test performance in all items in the surprise test and 7 items in the retention test. Lecture attendance (versus no attendance) was associated with higher test performance in 3 items and 1 item, respectively. In a linear regression analysis adjusted for age, gender, and overall performance levels, both podcast/quiz use and lecture attendance were significant predictors of student performance. However, the variance explained by podcast/quiz use was greater than the variance explained by lecture attendance in the surprise test (38.7% vs. 2.2%) and retention test (19.1% vs. 4.0%).

CONCLUSIONS

When used in conjunction with quiz questions, podcasts have the potential to foster knowledge acquisition and retention over and above the effect of live lectures.

Multikinase inhibitor sorafenib exerts cytocidal efficacy against Non-Hodgkin lymphomas associated with inhibition of MAPK14 and AKT phosphorylation

Intracellular signal transduction by kinase-mediated phosphorylation is essential for the survival and growth of lymphoma cells. This study analysed the multikinase inhibitor sorafenib for its cytotoxic activity against lymphoma cells. We found that sorafenib reduced cell viability at low micromolar concentrations in a time-dependent manner in cell lines and primary cell suspensions representing major types of aggressive B- and T-cell lymphomas. In cells surviving short term exposure, proliferative arrest occurred leading to complete loss of in vitro clonogenicity. Previously described sorafenib targets within the RAF kinase family were found to be expressed and phosphorylated in all cell lines, and sorafenib perturbed the activation of classical RAF/MEK/ERK pathway targets. However, using a global phoshoprotein array, the most consistent downstream effect of sorafenib in NHL cells was the inhibition of mitogen-activated protein kinase 14 (MAPK14) and panAKT phosphorylation. In conclusion, sorafenib has significant in vitro efficacy against aggressive B- and T-cell lymphoma cells, associated with inhibition of MAPK14 and panAKT.