A systematic review of audience response systems in pharmacy education

Mentimeter Improves Student Engagement in Online Clinical Anatomy Revision Sessions: A Programme Evaluation

Background There is a need to develop evidence-based strategies to maximise student engagement in online learning contexts. Audience response systems (ARS) are well-established active learning tools that improve engagement in the face-to-face classroom, but they remain under-researched in the online context. Aims This study aimed to directly compare student engagement, perceptions and learning following clinical anatomy revision sessions including interactive questions asked using an ARS (Mentimeter) compared to interactive questions asked using videoconferencing interaction only. Materials and methods We designed a series of 11 online clinical anatomy revision sessions advertised to all undergraduate medical students at a UK university. Five of these sessions were randomised to include interactive questions asked using an ARS (Mentimeter), and the remainder included interactive questions asked using videoconferencing (Microsoft Teams) functionality only. Data on attendance and engagement were collected, and attendees were asked to complete an end-of-session survey and an end-of-session test of knowledge. Results On average, significantly more attendees engaged with each interactive question asked using Mentimeter compared to questions asked without (30.1% vs 6.4%; p=2.20×10-16). Students scored higher on the end-of-session test of knowledge following sessions using Mentimeter (6.6 vs 5.3; p=0.007) and had a higher survey response rate (24.6% vs 14.3%; p=0.003). Students reported that Mentimeter improved engagement, interest, learning and testing of knowledge. Conclusions This study adds to the existing literature by demonstrating student engagement is significantly higher when using ARS (Mentimeter) to ask interactive questions during online revision sessions than using videoconferencing interaction alone.

Addition of an audience response system in a biomedical science course improves learning environment and student performance

The effectiveness of incorporating an audience response system (ARS) in improving the learning environment and student performance was assessed in a didactic biomedical science course at a large US dental school. Instructors and students were surveyed for their experiences of using Top Hat-based ARS in a multi-disciplinary biomedical science course. Average exam scores and grade distribution for challenging sections on immunology and developmental biology were compared before and after incorporating ARS. Pearson's chi-squared test, likelihood ratio test, Student's t-test and Fisher's exact test using beta regression model were used to assess statistical significance (p < 0.05). Student survey results with 78% (82/105) response rate, indicated that incorporating ARS improved student engagement, reinforced lecture material, and prepared them better for exams (p < 0.0001). Sixty seven percent of student respondents recommended continued integration of ARS questions in lectures (p < 0.0001). Although faculty survey data (n = 5, 100% response rate) were not statistically significant, the majority of faculty agreed that real-time feedback through ARS allowed them to appropriately pace lecture delivery and restructure forthcoming material. The average exam scores and grade distribution for challenging sections showed modest improvement after incorporation of ARS (p < 0.05). There was no significant correlation between final course grades and ARS grades for participation or correctness. Incorporating the ARS in a multi-disciplinary biomedical science course is perceived by faculty and students as an effective instructional approach that improves the learning environment, teaching strategies, and student performance.

Teaching medicine web-based with the help of interactive audience response systems

The COVID-19 pandemic confronted the medical community worldwide with numerous challenges, not only with respect to medical care, but also for teaching the next generation of physicians. To minimize the risk of infections patient-unrelated classes can be held digitally. Here we present a student initiated, web-based teaching approach, called "From symptom to diagnosis". In this seminar case reports of rare diseases were presented to the audience in a symptom-focused manner. The patients´ most significant symptoms were presented, followed by an in-depth discussion about differential diagnosis. First glance diagnosis pictures were shown to improve students´ ability to identify important clinical scenarios. We used chat functions as well as an audience response system to make the seminar more interactive. By this we attracted between 71 and 147 participants per session. The online seminar was very well perceived and 97% of the students saw an improvement of their diagnostic skills. In summary, we successfully established an interactive, web-based teaching format for medical students.

An overview of Instructional approaches and decision-making strategies to curtail curricular overload

OBJECTIVES

Curriculum overload often occurs when content is kept in the curriculum that may no longer be necessary to prepare students for professional practice. The overload becomes compounded by the addition of new content from the ever-changing professional practice needs and updates to accreditation standards. Challenges may occur when programs must first determine the "level" of proficiency a new graduate should attain and then determine the appropriate breadth and depth of educational outcomes in relation to proficiency, while examining what content should be retained from past curricula. Thus, the purpose of this manuscript is to summarize institutional approaches for making content delivery more effective and efficient with the goal of curtailing curriculum expansion.

FINDINGS

Four key elements were consistently identified in the literature as important considerations to address curriculum overload - 1) communication and coordination among faculty, 2) incorporation of active learning strategies, 3) effective utilization of technology, and 4) minimizing faculty and student workload and cognitive burden.

SUMMARY

Each pharmacy program will need to take an individualized approach in addressing curriculum overload; however, consideration of the aforementioned key elements can assist in making these decisions. With increased student engagement in the classroom, intentional design to reduce content and student workload, enhanced communication among faculty, and appropriate technology utilization, curriculum overload can be addressed at every level of pharmacy education.

Impact of Audience Response System in Enhancing Teaching of Anatomy and Physiology for Health Sciences Students at King Saud bin Abdulaziz University for Health Sciences

Purpose

Instructional methods that offer students' opportunity for engagement are essential to develop an active learning environment. This paper aims (1) to assess whether the use of an Audience Response System (ARS) during anatomy and physiology lectures improves students' engagement, knowledge retention and academic achievement and (2) to evaluate the feasibility of introducing ARS as a formative tool from both instructors' and students' perspectives.

Materials and Methods

This quasi-experimental study was conducted across ten lectures for the second-year Pre-Applied Medical Science (PAMS) and Pre-Medical (PMED) students at the College of Sciences and Health Professions, King Saud bin Abdulaziz University for Health Sciences (KSAU-HS), Jeddah, Saudi Arabia. The ARS was integrated into five lectures, whereas the remaining were conducted without ARS. A comparison of the immediate post-lecture and prior laboratory session quiz scores between the lectures with and without ARS was performed using an independent sample t-test. An online survey was completed by the students as well as informal feedback was taken from the instructors to assess ARS usefulness.

Results

A total of 65 PMAS and 126 PMED students participated in the study. Students achieved significantly better scores for ARS lectures than non-ARS lectures: PAMS (p 0.038) and PMED (p 0.018). Students and instructors agreed that ARS was easy to use, allowing students to engage and actively participate in the teaching process by responding to questions and receiving instant and anonymous feedback about their learning progress.

Conclusion

Employing suitable interactive teaching methods facilitates students' learning and improves their retention of knowledge. Students and instructors positively view the ARS strategy as a means to promote learning in a traditional lecture setting. Increased practice on how to integrate its use into classrooms could lead to further utilization.

Use of an audience response system during a continuing education action about oral lesion diagnosis

OBJECTIVES

The present cross-sectional study aimed to evaluate the perceptions of continuing education action (CEA) participants on the use of an audience response system (ARS). Secondarily, the study assessed the association between the diagnostic abilities of participants and their self-confidence in managing oral lesions METHODS: Oral medicine specialists, dentists, hygienists, and students (n = 193) who attended the 'Maio Vermelho Project', a CEA held in a Southern Brazilian State, answered a diagnostic ability test using the ARS Socrative software during a case discussion section. The test comprised 16 simulated clinical cases based on photos of oral lesions. The questions required classification of the lesion's nature, diagnostic hypothesis, and decision making (manage the case or refer it to a specialist) for each case. A second questionnaire composed of 12 questions was also applied to evaluate satisfaction and perception of the use of ARS Socrative RESULTS: Hygienists displayed lower scores in the diagnostic abilities test, whereas the other groups' performances were quite similar. Dentists and dental students who scored higher on the diagnostic abilities test showed higher self-confidence in the management of benign lesions. All participants stated that the use of technology can improve their learning experience and should be incorporated into the classroom. Moreover, the participants' perception was highly favorable to the use of Socrative in educational activities CONCLUSION: Our findings showed good acceptance of the ARS tool in a CEA environment and suggest an association between performance on the questionnaire and self-confidence in oral lesion management.

Assessing Female Pharmacy Students' Satisfaction with Active Learning Techniques at King Saud University

BACKGROUND

Studies conducted in Saudi Arabia assess student's perception towards using the flipped classroom or audience response system (ARS) separately, none integrated the two strategies. This study aims to evaluate pharmacy students at King Saud University - college of pharmacy's perceptions of student engagement and satisfaction with audience response system (ARS), and the flipped classroom techniques.

METHODS

Two lecture topics were flipped and delivered to female students enrolled in the pharmacy practice lab course at the university. An audience response system was integrated into the flipped classroom. The satisfaction of the students was measured using an online questionnaire. They then rated their satisfaction on a 5-point Likert scale ranging from 1 (strongly disagree) to 5 (strongly agree).

RESULTS

Overall, 82.1% of the students stated that the ARS made the class better; 71.64% agreed that taking a course in a flipped classroom was a useful learning experience. Online questionnaire revealed that the ARS fostered students' thinking skills and peers' interaction. Many students report that the flipped classroom made them evaluate their learning processes and pace themselves according to their speed, time, and level of interest. Students, however, stated that technical issues and time-consuming tasks were a downside to these teaching strategies.

CONCLUSION

Although the students' overall response to the use of ARS and flipped classroom techniques was positive; limited class time hindered students from achieving the full benefits reaped from these strategies. Therefore, as per our study's results, modifying the duration of the class to ensure it is not too short to be overwhelming can help instructors utilize these startegies in the best possible manner. Alternatively, a thorough and pre-emptive selection of familiar discussion topics ahead of time would also help in this regard.

An Emergency Switch to Distance Learning in Response to the COVID-19 Pandemic: Experience from an Internationally Accredited Undergraduate Pharmacy Program at Qatar University

The world is experiencing an unprecedented public health emergency owing to the COVID-19 pandemic. To control virus spread, many countries temporarily suspended classes. In this context, the availability of e-tools and distance learning platforms in higher education institutions has proven very useful to facilitate the emergency switch to distance learning to ensure continuity of the educational process. We discuss here the experience of the College of Pharmacy at Qatar University in responding to suspension of classes using available educational technologies. Furthermore, we provide some reflection points for optimal implementation of technology-enhanced learning into distance education for future academic years.

Debate: Lessons learned in lockdown - a one-day remotely delivered training on low-intensity psychological interventions for common mental health conditions

The coronavirus pandemic has highlighted the need for remote technologies to be used in child and adolescent mental health services. With the UK being placed in lockdown one week before a scheduled 'face-to-face' low-intensity CBT training day due to COVID-19, there was a need for rapid adaptations to be made to the content, structure and format of a training day for practitioners in mental health services, to suit the online environment. The content covered the core areas of low-intensity CBT in children and adolescents. Findings showed that the one-day low-intensity training day increased knowledge and understanding in all key areas measured, and was positively received, providing further evidence for the effectiveness and acceptability of remote delivery. Given discussed benefits of remote delivery, as well as rapid developments in technologies helping to address some of the challenges raised, going forward, remote delivery could continue to be beneficial for increasing access to much needed evidence-based interventions.

Student Characteristics Associated with Passing the Exam in Undergraduate Pharmacology Courses-a Cross-sectional Study in Six University Degree Programs

Adequate knowledge in pharmacology is crucial in many professions but a non-negligible proportion of students fail the exams and knowledge of underlying factors is largely lacking. This study was performed to evaluate to what extent various factors are related to student performance in pharmacology-related courses in higher education, linking administrative data to attendance at non-mandatory teaching sessions and questionnaire replies. A total of 596 students (median age: 22 years; 70% female) were included from eight courses which are part of either the medical, pharmacy, dentistry, nursing, or biomedical analyst degree programs at the Sahlgrenska Academy, Gothenburg, Sweden. In all, 380 (64%) students passed the regular program- and course-specific exam. Multivariate logistic regression analysis revealed that a high participation rate in non-mandatory teaching sessions, as well as a perceived great interest in pharmacology, was associated with students' passing of the exam; adjusted odds ratio (95% confidence interval): 1.30 (1.19 to 1.42; per 10 percentage unit increase in attendance) and 3.38 (1.86 to 6.12), respectively. Working for wages during the course weeks and pre-university grades used in the program application were significant factors in subgroups of students, negatively and positively associated with the exam results, respectively. Age, having Swedish as a second language, and time spent studying were only associated with the exam result in the univariate analyses. To conclude, both students and teachers can contribute significantly to successful education within pharmacology, students by participating in the teaching sessions and teachers by encouraging students to find the subject interesting.

Application of a Blended Assessment Strategy to Enhance Student Interest and Effectiveness in Learning: Case Study With Information Security Literacy

In the Internet era, information security literacy is a global imperative for nursing students. This study combined an audience response system and an online system to formulate an assessment strategy based on the concept of blended learning. The participants of this study comprised two college nursing classes of an introductory computer science course in Taiwan. With information security as the teaching content, we adopted a quasi-experimental approach to conduct a 5-week teaching experiment. A blended assessment model was adopted for the experiment group, while slide presentation and verbal assessment were used for the control group. Pretests and posttests were administered for information security literacy and learning environment stimulation. The study results indicate the following: (1) the experimental group performed significantly better than the control group in information security literacy, with statistically significant differences in scores regarding information security knowledge and information security skills; (2) the experimental group also presented higher learning motivation than the control group, with statistically significant differences in scores regarding self-efficacy, achievement goals, and learning environment stimulation.

Poll Everywhere to Encourage Learner Satisfaction and Participation in Internal Medicine Fellowship Didactics

Active learning improves self-reported engagement and satisfaction in medical education. Audience response systems are one mechanism of encouraging participation, especially in a setting in which learners in varying educational levels are present. Three fellowships participated in this educational quality improvement project where Poll Everywhere® was incorporated into didactics. Attendees were invited to complete a 4-question retrospective pre-post satisfaction survey. Incorporation of the Poll Everywhere® audience response system resulted in a shift in more favorable satisfaction scores and self-perceived attentiveness compared to the pre-intervention responses.