Weekly quizzes in extended-matching format as a means of monitoring students' progress in gross anatomy

The anatomy lesson of the SARS-CoV-2 pandemic: irreplaceable tradition (cadaver work) and new didactics of digital technology

Aim

To compare the efficacy of different components of online and contact anatomy classes as perceived by medical students.

Methods

An anonymous course evaluation survey was conducted at the end of the academic year 2019/2020. The organization of classes due to the SARS-CoV-2 pandemic provided our students with a unique opportunity to compare online and contact classes. Students’ responses were analyzed according to the type of obtained data (ratio, ordinal, and categorical).

Results

The response rate was 95.58%. Approximately 90% of students found anatomical dissection and practical work in general to be the most important aspect of teaching, which could not be replaced by online learning. During online classes, students missed the most the interaction with other students, followed by the interaction with student teaching assistants and teaching staff. Very few students found contact lectures useful, with most students reporting that they could be replaced with recorded video lectures. In contrast, recorded video lectures were perceived as extremely helpful for studying. Regular weekly quizzes were essential during online classes as they gave students adequate feedback and guided their learning process. Students greatly benefitted from additional course materials and interactive lessons, which were made easily available via e-learning platform.

Conclusions

Anatomical dissection and interaction during contact classes remain the most important aspects of teaching anatomy. However, online teaching increases learning efficiency by allowing alternative learning strategies and by substituting certain components of contact classes, thus freeing up more time for practical work.

Table Quizzes as an Assessment Tool in the Gross Anatomy Laboratory

Using cadaveric instruction in a graduate-level anatomy course is an expensive and time-consuming undertaking. While this is a worthwhile endeavor, most first-year medical students and students in the health fields struggle with the independent, self-directed learning approach in the cadaveric laboratory, and going beyond rote memorization of the material. As such, effective assessment tools that maximize student learning in the cadaveric laboratory are critical, especially if no lecture component is present. Dissection quality often reflects student attention to detail and therefore may be tied to overall performance in the course. The aim of this study was to investigate the relationship between weekly table quizzes and the overall student outcomes in a graduate biomedical human dissection class as well as examining the benefits and implications of this approach. In this course, a uniquely structured weekly quiz assessed dissection quality and probed student understanding in human anatomy. Student data compiled from 5 years of dissection courses were analyzed to evaluate the relationship between performance in the weekly assessment and on the unit examinations. The results showed a statistically significant relationship between the weekly quizzes and the student examinations at the end of each dissection block in 2013, 2015, 2016, and 2017. The data suggest a potential correlation between performance on weekly quizzes and on unit examinations. The unique nature of the table quizzes provides the students with the opportunity to practice the retrieval of their knowledge, feel more guided throughout their dissection, and receive immediate feedback on their performance. This assessment tool also provides a way to predict student outcomes and an opportunity for early intervention to help at-risk students. The analysis of this research study contributes to the need for more data on the usage of assessment tools in a graduate human dissection class.

A Comparison of Fourth-Year Health Sciences Students' Knowledge of Gross Lower and Upper Limb Anatomy: A Cross-Sectional Study

OBJECTIVE

The aim of the study was to assess and compare the knowledge of fourth-year medicine, physiotherapy (PT), nursing, and podiatry students in carpal and tarsal bone anatomy.

METHODS

A cross-sectional study was carried out. Based on a nonprobability convenience sampling, 177 fourth-year students (117 women and 60 men, mean age of 23.16 ± 3.82 years) from the podiatry (n = 39), nursing (n = 26), PT (n = 73), and medicine (n = 39) schools at a large Spanish university were included. Measurements were taken of their gross anatomy knowledge by means of the carpal and the tarsal bone tests. Students were asked to identify all carpal and tarsal bones in an illustration of the bony skeleton of both regions and were given a maximum of 5 minutes per test.

RESULTS

Of a total of 15 bones to be labeled, the PT (11.07 ± 3.30) and podiatry (9.36 ± 2.93) students had the highest rate of correct answers compared with the medicine (6.13 ± 3.27) and nursing (4.04 ± 3.72) undergraduates. When assessing academic degrees and test scores, significant differences were observed between PT and podiatry participants vs those from the medicine and nursing schools (P < .001).

CONCLUSION

Fourth-year students from the PT and podiatry programs correctly identified a higher number of carpal and tarsal bones than students from the nursing and medicine schools.

Multiple choice questions are superior to extended matching questions to identify medicine and biomedical sciences students who perform poorly

In recent years, medical faculties at Dutch universities have implemented a legally binding study advice to students of medicine and biomedical sciences during their propaedeutic phase. Appropriate examination is essential to discriminate between poor (grade <6), moderate (grade 6-8) and excellent (grade ≥8) students. Therefore, we compared the discriminatory properties of extended matching questions (EMQs) versus multiple-choice questions (MCQs) and identified the role of sex, age and examination preference on this score. Data were collected for 452 first-year medical and biomedical science students during three distinct course examinations: one examination with EMQ only, one with MCQ only and one mixed examination (including EMQ and MCQ). Logistic regression analysis revealed that MCQ examination was 3 times better in identifying poor students compared with EMQ (RR 3.0, CI 2.0-4.5), whereas EMQ better detected excellent students (average grade ≥8) (RR 1.93, CI 1.47-2.53). Mixed examination had comparable characteristics to MCQ. Sex and examination preference did not impact the score of the student. Students ≥20 years had a 4-fold higher risk ratio of obtaining a poor grade (<6) compared with students ≤18 years old (RR 4.1, CI 2.1-8.0). Given the strong discriminative capacity of MCQ examinations to identify poor students, we recommend the use of this type of examination during the propaedeutic phase of medicine and biomedical science study programmes, in the light of the binding study advice.

What is an objective structured practical examination in anatomy?

Assessing teaching-learning outcomes in anatomical knowledge is a complex task that requires the evaluation of multiple domains: theoretical, practical, and clinical knowledge. In general, theoretical knowledge is tested by a written examination system constituted by multiple choice questions (MCQs) and/or short answer questions (SAQ). The assessment of practical knowledge (three-dimensional anatomical concepts) involves oral, spot, or objective structured practical examinations (OSPE). Finally, the application of anatomical knowledge to patients is tested mainly through objective structured clinical examinations (OSCE). The major focus of this study is the OSPE. Although many schools challenge students using this tool in practical examinations in the early phase of the curriculum, the true meaning of OSPE is frequently forgotten and it becomes, in reality, a spot examination. This article, for the first time, describes how the concept of the OSPE has evolved and is currently being used to assess the practical domain of anatomical knowledge in a problem-based curriculum at Alfaisal University College of Medicine. In addition, it describes the main differences from the spot examination, which is normally used in traditional medical curricula. The authors believe that the OSPE remains the most efficient tool to assess the practical aspects of anatomical knowledge in a system where basic knowledge is integrated with the clinical or functional part of anatomy. However, this contention only holds true if the OSPE process revolves around structured objectives.

Do images influence assessment in anatomy? Exploring the effect of images on item difficulty and item discrimination

Anatomists often use images in assessments and examinations. This study aims to investigate the influence of different types of images on item difficulty and item discrimination in written assessments. A total of 210 of 460 students volunteered for an extra assessment in a gross anatomy course. This assessment contained 39 test items grouped in seven themes. The answer format alternated per theme and was either a labeled image or an answer list, resulting in two versions containing both images and answer lists. Subjects were randomly assigned to one version. Answer formats were compared through item scores. Both examinations had similar overall difficulty and reliability. Two cross-sectional images resulted in greater item difficulty and item discrimination, compared to an answer list. A schematic image of fetal circulation led to decreased item difficulty and item discrimination. Three images showed variable effects. These results show that effects on assessment scores are dependent on the type of image used. Results from the two cross-sectional images suggest an extra ability is being tested. Data from a scheme of fetal circulation suggest a cueing effect. Variable effects from other images indicate that a context-dependent interaction takes place with the content of questions. The conclusion is that item difficulty and item discrimination can be affected when images are used instead of answer lists; thus, the use of images as a response format has potential implications for the validity of test items.

Daily mini quizzes as means for improving student performance in anatomy course

AIM

To evaluate daily-written 10-question quizzes in a medical anatomy course as a way to integrate assessment into the course and to evaluate their effect on the course success.

METHODS

Students answering correctly 8/10 or more questions were awarded 0.5 points per quiz. There were 34 quizzes with a maximum point score 17. Measurable outcomes of academic progress in anatomy course (pass rates on 4 examination terms, total pass rate, and average marks) were calculated, and 2007/08 academic year was compared with the previous academic year in which daily written quizzes were not a part of the course. The relationship between cumulative points on daily quizzes and 3 components of the final examination (written, practical, and oral) for 2007/08 academic year was assessed by non-parametric correlation testing.

RESULTS

Individual scores on quizzes ranged from 1.5 to 13.5 points. There was a positive correlation between scores on quizzes and grades on 3 components of the final examination: written (Spearman rho=0.784, P<0.001, n=79), practical (Spearman rho=0.342, P<0.002, n=79), and oral (Spearman rho=0.683, P<0.001, n=79) part. Compared with students in the previous academic year, students attending the course with daily quizzes significantly improved their academic achievement, expressed as the pass rate at the first examination term (39% vs 62%, respectively, chi(2) test, P=0.006, ) and the average course grade (2.71+/-1.08 vs 3.38+/-1.26, respectively; t test, P<0.001).

CONCLUSION

Despite their frequency and possible associated stress, daily quizzes were associated with better academic success in the anatomy course.

Temporal structure of first-year courses and success at course exams: comparison of traditional continual and block delivery of anatomy and chemistry courses

AIM

To evaluate students' academic success at delivered in a traditional continual course, spread over the two semesters, or in alternating course blocks.

METHOD

We analyzed the data on exam grades for Anatomy and Chemistry courses in the first year of the curriculum for academic year 2001/02, with the traditional continual delivery of the courses (n=253 for chemistry and n=243 for anatomy), and academic year 2003/04, with block delivery of the courses (n=255 for Chemistry and n=260 for Anatomy). Grades from the final examination were analyzed only for students who sat the exam at the first available exam term and passed the course. For the Anatomy block course, grades at 2 interim written tests and 2 parts of the final exam (practical stage exam and oral exam) in each block were analyzed for students who passed all interim tests and the final exam.

RESULTS

There were no differences between two types of course delivery in the number of students passing the final examination at first attempt. There was a decrease in passing percentage for the two Anatomy block course student groups in 2003/04 (56% passing students in block 1 vs 40% in block 2, P=0.014). There was an increase in the average grades from 2001/02 to 2003/04 academic year due to an increase in Chemistry grades (F1,399=18.4, P<0.001, 2 x 2 ANOVA). There was no effect of the sequence of their delivery (F1,206=1.8, P=0.182, 2 x 2 ANOVA). There was also a significant difference in grades on interim assessments of Anatomy when it was delivered in the block format (F3,85=28.8, P<0.001, between-within subjects 2 x 4 ANOVA).

CONCLUSIONS

The type of course delivery was not associated with significant differences in student academic success in Anatomy and Chemistry courses in the medical curriculum. Students can successfully pass these courses when they are delivered either in a continual, whole year format or in a condensed time format of a course block, regardless of the number and type of courses preceding the block course.

Web-based learning in undergraduate medical education: development and assessment of an online course on experimental surgery

In order to increase the number of practical and discussion classes offered to students in the traditional-curriculum scenario, while decreasing the lecture-based ones and to create an online community to share knowledge on surgery, we developed and assessed the first online course for undergraduate medical students on experimental surgery at the Federal University of Sao Paulo-UNIFESP, Brazil. The purposes of the present study are: describe and discuss the process and the lessons learned involved in developing an undergraduate web-based course and analyze the students' attitude towards this educational environment. A group of medical students was taught online during 5 weeks on the theory of experimental surgery through video quizzes, required readings, collaborative activities using discussion board and asynchronous communication. The students' knowledge gain, their web session variables and the results of the course evaluation were used to support our study. The students have significantly improved their knowledge on experimental surgery after the course. Among factors in the online course that could possibly have contributed to this gain, the interactive activities (video quizzes), key element in our online material, seemed to be promising for candidates. The evaluation results demonstrated high levels of course functionality, effectiveness of its online content and acceptance among medical students. This study indicated that a web-based course for undergraduate students may be successfully developed and implemented in medical settings and the students seem to be quite supportive. We encourage undergraduate medical learning strategies involving the Web.