Problem-based learning versus lecture-based learning in postgraduate medical education

Enhancing postpartum hemorrhage training by integrating case-problem based learning with simulation: a quasi experimental study

BACKGROUND

Postpartum haemorrhage (PPH) is the leading cause of maternal mortality worldwide, and effective training in PPH rescue techniques is crucial. This study aims to evaluate the effectiveness of combining case-based learning (CBL) and problem-based learning (PBL) with simulation teaching methods in improving midwifery trainees' technical proficiency in managing PPH.

METHODS

This quasi-experimental study involved 76 trainees who received PPH training at Peking University Third Hospital from March to July 2023. They were divided into two groups: the control group (n = 50) followed traditional simulation training methods, and the research group (n = 26) used a combination of CBL-PBL and scenario simulation. After the training, all participants completed a theoretical examination and questionnaire to assess their satisfaction with the program and self-assessment of clinical management skills in PPH. Statistical analysis was performed using unpaired t-tests and chi-square tests to compare the groups.

RESULTS

The combination of CBL-PBL and scenario simulation was highly satisfactory compared to traditional simulation training, significantly enhancing self-assessed skills in clinical thinking (100% vs. 61.8%, p = .03), operant skills related to PPH (100% vs. 57.4%, p < .01), relevant knowledge pertaining to PPH (100% vs. 58.7%, p < .01), and management abilities (97.1% vs. 39%, p < .01) among midwifery trainees in the research group, who also scored significantly higher on post-training assessments of PPH knowledge than control groups(91.7 ± 6.0 vs 76.0 ± 7.1, p < .01). A majority of trainees expressed a preference for regular simulation exercises (98.7%) and detailed discussions on PPH cases (93.4%) in future training sessions.

CONCLUSION

Combining CBL-PBL with simulation practice is a more effective teaching method for PPH management training in maternity staffs with a certain level of clinical experience, compared to traditional methods. Future studies should explore the implementation of regular PPH rescue skill training in real clinical settings to support these findings.

Effect of integrated case-based and problem-based learning on clinical thinking skills of assistant general practitioner trainees: a randomized controlled trial

BACKGROUND

Case-Based Learning (CBL) and Problem-Based Learning (PBL) are popular methods in medical education. However, we do not fully understand how they affect the clinical thinking skills of Assistant General Practitioner (AGP) trainees. This randomised controlled trial aimed to assess the effectiveness of combining CBL and PBL and compare their impact on the clinical thinking skills of AGP trainees with that of traditional lecture-based learning (LBL).

METHODS

This randomised controlled trial involved 70 second-year AGP trainees who were randomly assigned to either the CBL-PBL group or the LBL group using a simple randomisation method. The CBL-PBL group engaged in a curriculum that integrated case-based and problem-based learning, whereas the LBL group followed a traditional lecture-based format, as described in the syllabus. To evaluate clinical thinking skills, the participants were assessed using the Clinical Thinking Skills Evaluation Scale (CTSES) and an assistant general practitioner's professional knowledge test. In addition, this study analysed various factors that influence clinical thinking skills.

RESULTS

Compared with the LBL group, the CBL-PBL group showed significantly improved performance in all domains assessed by the CTSES in post-course tests (p < 0.001). Specifically, the mean scores for critical, systematic, and evidence-based thinking showed notable improvement in the CBL-PBL group. Additionally, the scores on the professional knowledge test reflected a substantial increase in this group. Furthermore, multiple linear regression analysis showed that both CBL-PBL curriculum performance scores and number of weekly article readings significantly influenced the development of clinical thinking skills.

CONCLUSION

The CBL-PBL teaching method positively influenced the clinical thinking skills of assistant general practitioner trainees, with a positive correlation between these skills and course performance in the CBL-PBL curriculum.

TRIAL REGISTRATION

Not applicable.

Application of problem-based learning and case-based learning in teaching ectopic pregnancy to fifth-year medical students

OBJECTIVE

This study explored the effectiveness of combining problem-based learning (PBL) and case-based learning (CBL) in the clinical teaching of ectopic pregnancy.

METHODS

Fifth-year students majoring in clinical medicine were recruited from the Department of Gynecology at the Hengyang Central Hospital and Hainan General Hospital between September 2023 and June 2024. The students were randomly assigned to either the combined PBL-CBL or the traditional group. At the end of the class, both groups of students were required to complete a post-class quiz and an anonymous questionnaire.

RESULTS

The basic knowledge score in the combined PBL-CBL group was significantly higher than that in the traditional group (42.6 ± 3.6 vs 35.0 ± 2.3, p = 0.000). Similarly, the case analysis score was higher in the combined PBL-CBL group than that in the traditional group (37.1 ± 6.2 versus 33.8 ± 5.7, p = 0.013). The scores for learning motivation, understanding, student-teacher interaction, communication skills, clinical thinking skills, self-learning skills, knowledge absorption, and satisfaction with the course in the combined PBL-CBL group were significantly higher than those in the traditional group (p < 0.05). However, the score for the amount of free time consumed by the combined PBL-CBL group was significantly higher than that of the traditional group (p < 0.05).

CONCLUSION

The study suggests that the combined PBL-CBL teaching method might be a promising new mode of gynecological education.

The impact of three learning methods on dental students' satisfaction and knowledge acquisition

OBJECTIVES

Health professionals' education presents unique challenges including clinical application of knowledge and interprofessional collaboration. Additionally, institutions suffer from faculty shortages while class sizes increase. Therefore, educators seek innovative andragogical techniques utilizing minimal resources. Several active learning methods have been introduced as a solution. The aim of this study is to assess the impact of lecture (LBL), case (CBL), and team (TBL) based learning on the students' satisfaction and knowledge attainment.

METHODS

A total of 134 sophomore dental students are taught pediatric dentistry course using LBL, CBL, and TBL techniques. At the end of the course, students are invited to participate in a satisfaction survey. Statistical analysis is conducted using a two-sided chi-square goodness of fit test. Students' comments are used for qualitative analysis. Final exam analysis is administered via Examsoft software.

RESULTS

A total of 98% of the students participated in the survey out of which 83% met the inclusion criteria (N = 110). Students chose LBL as the method that helped them learn in a comprehensive way, provided the most comfortable environment, and presented the overall highest satisfaction with statistically significant difference (p value = 0.001). LBL questions scored the highest point biserial and discrimination index. The percentage of correct answers and difficulty level was highest for TBL.

CONCLUSION

Students preferred LBL over the other learning methods. Final exam psychometrics showed favorable results for LBL and TBL. Students could potentially benefit from combining both techniques. However, more research is needed to assess the effectiveness of various teaching methods on the short- and long-term learning outcomes.

Online Case-Based Course in Veterinary Radiographic Interpretation Generates Better Short- and Long-Term Learning Outcomes than a Virtual Lecture-Based Course

Accurate interpretation of radiographs is necessary for the correct diagnosis and treatment of patients. Research has shown that active learning methods, including case-based learning, are superior to passive learning methods, such as lectures. Short-term learning outcomes were compared between two groups by enrolling 80 fourth-semester veterinary students in either an online case-based radiology course (n = 40) or a virtual lecture-based course (n = 40). Long-term learning outcomes were compared among three groups: one group completed case-based instruction in the fourth semester, followed by lecture-based instruction in the fourth semester (n = 19); the second group completed only lecture-based instruction in the fourth semester (n = 22), and the third group completed lecture-based instruction in the fourth semester, followed by case-based instruction in the fifth semester (n = 9). Learning was assessed using a multiple-choice examination and two independently written small animal radiograph reports. In the fourth semester, students completing the case-based course had higher examination scores and radiograph report scores than students who took the lecture-based course. Students completing the lecture-based course in the fourth semester and the case-based course in the fifth semester wrote better radiograph reports than students who completed both courses in the fourth semester; both groups wrote better reports than students who did not take the case-based course. A case-based diagnostic imaging course may be better than a lecture-based course for both short- and long-term retention of knowledge; however, there is a significant loss of knowledge following an instructional gap, and spaced refreshers may boost retention.

Effects of problem-based learning on delivering medical and nursing education: A systematic review and meta-analysis of randomized controlled trials

BACKGROUND

There is still a lack of high-level evidence on the effects of problem-based learning (PBL) in general medical and nursing education.

AIMS

We aimed to summarize current evidence on the effects of PBL in delivering medical and nursing education from randomized controlled trials (RCTs).

METHODS

A systematic search was performed in MEDLINE, EMBASE, Cochrane Central Library, and CINAHL Complete. RCTs that assessed the effects of a PBL module in delivering medical education were eligible. Outcomes included knowledge, performance, and satisfaction. The risk of bias was assessed according to Cochrane handbook guidelines. Standardized mean differences with 95% confidence intervals of each outcome between PBL and control groups were pooled using a random-effects model.

RESULTS

In all, 22 RCTs with 1969 participants were included. Both pooled analyses of changes in scores compared with baseline and absolute post-interventional scores favored PBL module in knowledge and performance. The satisfaction degree was also higher in participants receiving PBL methods. Publication bias might exist in satisfaction; however, not in knowledge and performance. Eleven of the 22 studies were assessed as having a high risk of bias.

LINKING EVIDENCE TO ACTION

Compared with traditional lecture-based modules, PBL delivered medical education in different medical science specialities more efficiently from both theoretical knowledge and practice skill perspectives. The feedback from participants receiving PBL methods was more positive than that from those receiving traditional methods. However, the high heterogeneity and low quality of the included studies prevented drawing definite conclusions.

From the West to the East: an evidence-based educational reform for modern medical students in traditional Chinese medicine learning

Introduction

Generally, Traditional Chinese Medicine (TCM) courses are now given to modern medicine students without proper course scheduling, resulting in poor teaching results.

Methods

To analyze the main factors affecting TCM learning, we surveyed the medical students and TCM teachers from Xiangya School of Medicine of Central South University via online questionnaires. The questionnaire comprised two parts, the students' part included the basic information, the subjective cognition in TCM, the attitude toward TCM course arrangements, and the attitude toward curriculum content and the design of TCM. The teachers' part included the basic information, the attitudes and opinions on TCM course arrangements, and suggestions and views on TCM teaching reform. The related data were collected from 187 medical students divided into two groups, namely, clinical medical students and non-clinical medical students.

Results

We found a more positive attitude toward TCM [including "Scientific nature of TCM" (P = 0.03) and "Necessity for modern medicine students to learn TCM" (P = 0.037)] in clinical medical students compared with non-clinical medical students, clinical and non-clinical medical students tended to find TCM courses difficult, and the students prefer clinical training to be better than theoretical teaching, while the teachers believe that lecture-based education should have a more significant proportion.

Discussion

Hence, to optimize the current TCM teaching, we conducted education reform, including differentiated teaching, hybrid teaching, and selective teaching.

Enhancing medical education in respiratory diseases: efficacy of a 3D printing, problem-based, and case-based learning approach

OBJECTIVES

The present study aims to investigate the efficacy of utilizing three-dimensional (3D) printing technology in concert with Problem-Based Learning (PBL) and Case-Based Learning (CBL) pedagogical approaches in educating senior undergraduate clinical medical students on respiratory diseases.

METHODS

A cohort of 422 fourth-year clinical medicical students of from Anhui Medical University, pursuing a five-year program, were arbitrarily segregated into two distinct groups. The experimental group was subjected to a combined pedagogical approach, which included 3D printing technology, PBL and CBL (referred to as DPC). Conversely, the control group was exposed to conventional teaching methodologies for respiratory disease education. The effectiveness of the teaching methods was subsequently appraised using both theoretical test scores and custom questionnaires.

RESULTS

Post-quiz scores indicated a statistically significant improvement in the DPC group as compared to the traditional group (P < 0.01). Self-evaluation and satisfaction questionnaires revealed that the DPC group's self-assessment scores outperformed the traditional group in several aspects, including clinical thinking ability, learning initiative, self-study ability, anatomical knowledge mastery, confidence in learning, ability to analyze and solve problems, comprehension of the knowledge, help to clinical thinking and level of satisfaction on the teaching methods (P < 0.01). However, within the unsatisfied DPC sub-group, none of these self-assessment aspects, except for comprehension of the knowledge, impacted the learning efficacy (P > 0.05).

CONCLUSION

The deployment of the DPC pedagogical approach may confer unique experiential learning opportunities for students, potentially enhancing theoretical test scores and promoting self-evaluation and satisfaction in the context of respiratory disease education. Hence, it may be instrumental in augmenting the overall teaching efficacy.

Cognitive and motor skill competence are different: Results from a prospective randomized trial using virtual reality simulator and educational video in laparoscopic cholecystectomy

BACKGROUND AND PURPOSE

Cognitive transfer represents an important issue in surgical education. It is essential for the acquisition of competence, such as decision making and error avoidance. This randomized study aims to compare the effectivity of cognitive transfer by observing the surgery versus using modern virtual reality simulators for learning a laparoscopic cholecystectomy.

METHOD

This was a prospective, randomized, single centre study. 40 medical students from a university hospital, a tertiary care teaching institution, were enrolled. After a short introduction of laparoscopic cholecystectomy, they were randomized into two groups (video group and simulator group). In the video group, participants watched the step-by-step educational video twice. In the simulator group, participants underwent training using the virtual reality simulator, including tutorial procedural tasks of laparoscopic cholecystectomy as well as a complete cholecystectomy on the simulator. After the training, cognitive competence including decision making and error awareness was assessed using a questionnaire.

RESULTS

In the most critical step of laparoscopic cholecystectomy, "Dissection in Calot's triangle", as well as in the aspect of planning next step, the video group was superior significantly (P = 0.038 and P = 0.04). No significant differences concerning the recognition of critical anatomical structures, choosing the necessary instruments as well as error awareness were found.

CONCLUSIONS

Learning by watching a high-quality educational video is more effective in acquiring the cognitive competence to combine learned single tasks. Traditional learning means as watching educational videos and modern, sophisticated VRS should be deployed complementarily to establish cognitive and motor competencies separately.

Cross-sectional study of the quality of randomized control trials on problem-based learning in medical education

Problem-based learning (PBL) is increasingly being used in medical education globally, but its effectiveness in teaching remains controversial. A randomized controlled trial (RCT) is the method of choice for evaluating its effectiveness. The quality of an RCT has a significant effect on this evaluation, but to date we have not seen an assessment of the quality of RCTs for PBL. Two researchers searched MEDLINE and EMBASE for RCTs addressing PBL in medical education. The overall quality of each report was measured on a 28-point overall quality score (OQS) based on the 2010 revised Comprehensive Standards for Reporting and Testing (CONSORT) Statement. Furthermore, to study the key factors affecting OQS more effectively, a linear regression model of those factors was established using SPSS. After literature screening, 30 RCTs were eventually included and analyzed. The median OQS was 15 (range, 7-20), which meant that half of the items in the revised 2010 CONSORT statement were poorly reported in at least 40% of the RCTs analyzed. The regression model showed that the year of publication of RCTs and the impact factors of the journals in which they were published were the main factors affecting OQS. The overall quality of reporting of RCTs on PBL teaching in medical education was not satisfactory. Some RCTs were subjectively selective in reporting certain items, leading to heterogeneity in quality. It is expected that statisticians will develop new standards more suitable for evaluating RCTs related to teaching research and that editors and peer reviewers will be required to review the relevant RCTs more strictly.

Symposium: Better teaching through science: incorporating the scholarship of teaching & learning

The Scholarship of Teaching and Learning, also referred to as SOTL, provides a framework for instructors to evaluate student learning and use evidence to determine pedagogical changes in the classroom. Engagement in SOTL challenges scholars to ask questions about their teaching practices and share with a larger community of practice. Examples of this include manuscript submissions to peer-reviewed journals, presenting abstracts at conferences, and other outlets that allow scholars to disseminate their findings. SOTL practices can be applied within an individual classroom or across a curriculum. Additionally, the promotion and tenure process at many institutions of higher education are highly recommending that faculty demonstrate impact on student learning. This symposium, presented at the 2022 Poultry Science Association Annual Meeting, highlighted best practices in SOTL, implementation of SOTL programming, and discussed using SOTL as a tool to evaluate teaching effectiveness. Poultry and animal science educators shared their experiences with implementing SOTL in their classroom and the benefits to students. From this symposium, we can conclude that there are multiple ways to document teaching excellence and conduct SOTL projects. This is of interest to educators implementing scholarly teaching in their classrooms.

The application of the spot the difference teaching method in clinical skills training for residents

BACKGROUND

Clinical skill training (CST) is indispensable for first-year surgical residents. It can usually be carried out through video-based flipped learning (FL) within a web-based learning environment. However, we found that residents lack the process of reflection, blindly imitating results in losing interest and passion for learning in the traditional teaching pattern. The teaching method of "spot the difference" (SDTM), which is based on the fundamentals of the popular game of "spot the difference," is designed to improve students' participation and reflective learning during skill training. This study aimed to evaluate this novel educational model's short-term and long-term effectiveness for surgical residents in China.

METHODS

First-year residents who required a three-month rotation in the head and neck surgery department were recruited to participate in a series of CSTs. They were randomized into SDTM and traditional FL (control) groups. Clinical skill performance was assessed with validated clinical skill scoring criteria. Evaluations were conducted by comparing the scores that contain departmental rotation skill examinations and the first China medical licensing examination (CMLE) performance on practical skills. In addition, two-way subjective evaluations were also implemented as a reference for the training results. Training effects were assessed using t tests, Mann-Whitney-Wilcoxon tests, chi-square tests, and Cohen' s effect size (d). The Cohen' s d value was considered to be small (<0.2), medium (0.2-0.8), or large (>0.8).

RESULTS

The SDTM group was significantly superior to the control group in terms of after-department skill examination (t=2.179, p<0.05, d=0.5), taking medical history (t=2.665, p<0.05, d=0.59), and CMLE performance on practical skill (t=2.103, p<0.05, d=0.47). The SDTM members rated the curriculum more highly than the control on the items relating to interestingness and participation (p < 0.05) with large effect sizes (d >0.8). There were no significant differences between the two groups on clinical competence (t=0.819, p=0.415, d=0.18), the first-time pass rate for CMLE (χ2 =1.663, p=0.197, d=0.29), and short-term operational skills improvement (t=1.747, p=0.084, d=0.39).

CONCLUSIONS

SDTM may be an effective method for enhancing residents' clinical skills, and the effect is significant both short- and long-term. The improvement effect seemed to be more significant in the peer-involved SDTM than training alone. However, despite positive objective results, SDTM still risks student learning burnout.

TRIAL REGISTRATION

ISRCTN registry, ISRCTN10598469 , 02/04/2022，retrospectively registered.

Effectiveness of a combined problem-based learning and flipped classroom teaching method in ophthalmic clinical skill training

BACKGROUND

Previous studies have primarily implemented problem-based learning (PBL) or flipped classroom (FC) teaching models in different majors; however, research on the combined PBL-FC teaching method in clinical medicine is scarce. Therefore, we investigated the combined PBL-FC teaching method in teaching ocular trauma on students' competencies.

METHOD

About 75 ophthalmology postgraduates were randomly divided into PBL-FC and traditional teaching groups. Students completed pre-and post-class theoretical examinations, skills evaluation, learning ability scales, and feedback questionnaires.

RESULTS

Both groups showed significantly higher theoretical scores and improved learning ability. Feedback questionnaire scores of the PBL-FC group's postgraduates without clinical experience were significantly higher than the traditional group's for some items; there was no difference between groups in postgraduates with clinical experience. PBL-FC group's pre-class preparation time was significantly longer than the traditional group's, but the post-class review time was significantly shorter. PBL-FC group's post-class theoretical performance was significantly higher than the traditional group's. There was no statistical difference between the groups regarding skill operation. Among postgraduates without clinical experience, the PBL-FC group's skill operation performance was significantly higher than the traditional group's; for postgraduates with clinical experience, the traditional group's skill operation performance was significantly higher than the PBL-FC group's.

CONCLUSIONS

PBL-FC teaching is better for students without clinical experience or knowledge of ophthalmic diseases. Meanwhile, traditional teaching is a good choice for students with clinical experience who need more relevant knowledge.

A quality improvement project assessing a new mode of lecture delivery to improve postgraduate clinical exposure time in the Department of Internal Medicine, Makerere University, Uganda

BACKGROUND

The Masters in Internal Medicine at the Makerere University College of Health Sciences is based on a semester system with a blend of lectures and clinical work. The programme runs for 3 years with didactic lectures set mostly for mornings and clinical care thereafter. Anecdotal reports from attending physicians in the department highlighted clinical work time interruption by didactic lectures which was thought to limit postgraduate (PG) students' clinical work time. We set out to evaluate the clinical learning environment and explore avenues to optimise clinical exposure time.

METHODS

Baseline data in form of time logs documenting first-year PG activities was collected by intern doctors without the awareness of the PGs. In addition, a PG and attending physician survey on PG ward performance was carried out. These data informed a root cause analysis from which an intervention to change the mode of lecture delivery from daily lecturers across the semester to a set of block lectures was undertaken. Postimplementation time logs and survey data were compared with the pre-intervention data.

RESULTS

Post-intervention, during a period of 50 ward round observations, PGs missed 3/50 (6%) ward rounds as compared with 10/50 (20%) pre-intervention. PGs arrived on wards before attending physicians 18/24 (75%) times post-intervention and on average had 59 min to prepare for ward rounds as compared with 5/26 (19.2%) times and 30 min, respectively, pre-intervention. Both PGs and physicians believed PGs had enough time for patient care post-intervention (17/17 (100%) vs 4/17 (23.5%) and 7/8 (87.5%) vs 2/8 (25%)), respectively.

CONCLUSION

The baseline data collected confirmed the anecdotal reports and a change to a block week lecture system led to improvements in PGs' clinical work time and both resident and physician approvals of PG clinical work.

Problem-based learning for in-service training on breastfeeding in Friuli Venezia Giulia, Italy

Background

Problem-Based Learning (PBL) is extensively used in pre- and post-graduate teaching programmes. However, it has been seldom used for in-service training and continuing medical education. We aimed to develop a PBL curriculum for a short in-service training on breastfeeding for maternal and child health professionals, and to assess the effect of these courses on their knowledge and skills. Also, the project aimed at increasing exclusive breastfeeding rates and duration in an Italian region.

Methods

After initial training on PBL and an assessment of the learning needs of about 400 health professionals, a small working group developed learning objectives, designed a curriculum, produced manuals, and shaped assessment tools for a new PBL course on breastfeeding. The field test of the new course allowed selection of the tutors for the scaling up of the training to the whole region. During this extension phase, participants were asked to complete an evaluation questionnaire. In addition, the health professionals who attended the PBL courses in 2019 were asked to complete an online survey to assess knowledge, attitudes and practices (KAP) just before, soon after the course, and 4–6 months later.

Results

The new 29 − hour PBL course, to be delivered in four days over four consecutive weeks, gives priority to tutorial groups and practical activities (71% of the total time). Supervised clinical practices absorb 16% of time. Ethics, communication and woman-centred clinical management content run throughout the four days and all activities. The three manuals, for tutors, participants and practical activities, facilitate the tasks and performance of tutors and participants. After the field test, 32 regional tutors ran courses for 562 health professionals. The analysis of the evaluation showed a high level of satisfaction for perceived effectiveness, relevance to practice, and educational quality. The KAP questionnaires indicated a general improvement after the course and retention after 4–6 months.

Conclusions

Despite some predictable shortcomings, this new PBL approach for short in-service training courses on breastfeeding showed encouraging results as far as participants’ satisfaction and KAP are concerned. The possible effects on rates and duration of exclusive breastfeeding need further research.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13006-021-00439-4.

Evaluating the efficacy of self-study videos for the surgery clerkship rotation: an innovative project in undergraduate surgical education

Background:

Educational videos have become valuable resources and can address some of the pitfalls of traditional learning. To ensure clerkship students have adequate exposure to curriculum objectives, a series of objective-aligned self-directed learning video podcasts covering core surgical concepts were developed by medical students and surgical residents. The objective of the study was to evaluate the efficacy of the video podcasts in the surgery clerkship rotation.

Methods:

Nineteen video podcasts were created, housed at www.surgicaleducationportal.com, and distributed to third-year medical students completing their surgical clerkship. A 10-question multiple-choice quiz was administered before and after students viewed each video, and they were also asked to complete a satisfaction survey.

Results:

A total of 302 paired pretests and posttests were completed. There was a mean increase of 2.7 points in posttest scores compared with pretest scores (p < 0.001). On a Likert scale from 1 to 5, with 5 being excellent, students rated the usefulness of the videos as 4.3, the quality of the content as 4.3 and the quality of the video as 4.2. Ninety-eight percent of students would recommend these videos to their classmates.

Conclusion:

Video podcasts are an effective modality for engaging medical students and may improve standardization of learning during their surgical clerkship.

Supporting Occupational Physicians in the Implementation of Workers' Health Surveillance: Development of an Intervention Using the Behavior Change Wheel Framework

Workers’ health surveillance (WHS) is an important preventive activity aimed at prevention of work-related diseases. However, WHS is not regularly implemented in some EU-countries. As occupational physicians (OPs) have to play an important role in implementation of WHS, this study aimed to develop an intervention to support OPs in implementation of WHS. The behavior change wheel framework (BCW) was used to develop the intervention. First, the problem was defined, and target behavior was selected by using results from a survey study among OPs. Subsequently, change objectives in target behavior were specified. Finally, appropriate intervention functions, behavior change techniques, and modes of delivery were identified to develop the intervention. Target behaviors were (1) OPs initiate WHS, and (2) OPs conduct preventive consultations with workers. OPs’ capabilities, and experienced opportunities were identified as change objectives. Intervention functions (education, training, enablement) and behavior change techniques (information about consequences, demonstration, instructions, behavioral practice, feedback on behavior, goal setting, action planning, reviewing goals) were selected to develop the intervention, delivered by face-to-face group training and e-learning. The proposed intervention consists of training and e-learning to support OPs in implementing WHS. Feasibility and effect of the intervention will be evaluated in future studies.

Effectiveness of case-based teaching of cardiovascular physiology in clinical pharmacy students

OBJECTIVE

This study aimed to formulate and implement a case-based cardiovascular physiology module for second year clinical pharmacy (CP) students. We also evaluated the students' feedback and compared the academic performance between a case-based teaching (CBT) group and a traditional didactic lectures (TDL) group.

METHODS

This descriptive quantitative study was conducted on 181 students who were divided into two groups. Group 1 (77 students) underwent TDL and the same topics were delivered to Group 2 (94 students) through CBT. A written examination was conducted at the end of both modules. A validated questionnaire was used to obtain feedback from the CBT group regarding CBT and their assessment grades (response rate - 93.6%).

RESULTS

Students' feedback about CBT was positive. The majority of students, 63 (72%), preferred learning and understanding through CBT, finding it an enjoyable experience. Participants stated that CBT stimulated critical thinking (67; 76%) and linked theory to practice (69, 78%). Furthermore, 70 (80%) preferred this type of teaching and assessment in the future and 70 (80%) agreed to include CBT in all preclinical subjects. Students feedback was supported by exam results: the mean percentage of exam scores in the CBT group was significantly higher in comparison to the TDL group (81.2% vs. 79%, p value <0.05). Further comparison within the CBT group revealed improved student performance in "case-based" as compared to "conventional" questions (82.75% vs. 80%, p value <0.05).

CONCLUSION

Students greatly appreciated CBT, as it stimulated logical thinking and active participation in the class, resulting in improved performance in exams.

Knowledge and Confidence of Final-Year Medical Students Regarding Critical Care Core-Concepts, a Comparison between Problem-Based Learning and a Traditional Curriculum

BACKGROUND

Medical undergraduates should be prepared to recognize life threating critical conditions. Undergraduate medical curriculum development to incorporate more critical care education is an essential requirement. Problem Based Learning curriculum has a potential advantage in providing more focused critical care education to medical undergraduate.

OBJECTIVES

We aimed to evaluate the final year medical students' knowledge and confidence in key critical care concepts in Problem Based Learning (PBL) curriculum compared to those in Traditional (Lecture) Based Learning curriculum. We also aimed to evaluate undergraduate's level of satisfaction with the exposure to critical care education during medical education and training.

MATERIALS AND METHODS

This is a cross-sectional anonymous self-administered survey questionnaire completed by two groups of final-year medical students (PBL and TBL) from three Saudi medical schools to assess the degree of undergraduate exposure to critical care and their knowledge of key critical care assessment parameters.

RESULTS

The responses of 279 final year medical students was analyzed (70% response rate). The majority (53%) was male and the mean age 23.9 ± 1.4 years. Only 13% of students felt confident to manage hypovolemic shock and 15% could recognize the signs of a threatened airway. One third of the students (29%) correctly identified the critical level of lactic acid in shock and less than 2% of the sample responded correctly to all the questions related to the formal assessment of critically ill patients. Lectures were the main source of information in acute care. More than two-thirds (46%) of the sample indicated that they received tuition in critical care, however the total duration spent in a critical care rotation or teaching was 1 day or less. The medical students, who completed their training with a Problem-Based Learning curriculum, had a higher knowledge base and were more confident in many critical care concepts. Only 6.5% choose critical care as their likely future career.

CONCLUSION

Medical undergraduates in PBL have an overall better knowledge on key concepts and assessment tools applicable to evaluating and managing critically ill patients compared to students in TBL. However the gap in knowledge and confidence in assessing ill patients in both groups is evident. Critical care was not chosen as a preferred future career in all surveyed students. There is a need for institutional support and endorsement of undergraduate critical care exposure and education in Saudi Universities both to better prepare medical students for their imminent post-graduates exposure to ill patients and to help in closing the gap in critical care physicians through promoting the specialty.

Comparative Study of Attitudes towards Communication Skills Learning between Medical and Dental Students in Saudi Arabia

Background: Communication skills (CS) learning is a core skill in medical and dental education. The comparison of attitudes towards CS between dental and medical students based on the taught curriculum (problem-based learning vs. traditional teaching) in Saudi Arabia awaits investigation. Aims: (1) To assess the attitudes of both undergraduate dental and medical students towards communication skills (CS) learning and (2) to compare the attitudes towards CS between Medical and Dental students in relation to sociodemographic and education-related characteristics. Methods and Materials: A cross-sectional study, using an online survey, invited 260 conveniently sampled Taibah university medical and dental undergraduate students. The survey collected data on sociodemographic characteristics, education-related factors, and CS using Communication Skills Attitude Scale (CSAS) that assess positive and negative attitudes (PAS, NAS). Data analysis included descriptive statistics and the Mann–Whitney U test. Results: Of the distributed questionnaire 91% responded (145 dental and 91 medical students). There were, overall, non-significant scores’ differences between medical and dental students on PAS (Medicine Median 51 vs. Dentistry Median 50, p = 0.059) and NAS (Medicine Median 32 vs. Dentistry Median 32, p = 0.596). Older medical students, those at clinical levels and those who reported they need to improve their communication skills and student whose parents were not doctors, tended to score statistically significantly (p = 0.032, 0.017, 0.034, and 0.004, respectively) on PAS compared with dental students; on the other hand, medical students with doctor parents scored significantly high in NAS compared to dental students (p = 0.015). Conclusion: Demographic and education-related characteristics underpinned medical student positive attitude towards CS compared to dental students. Although medical and dental students showed no differences in self-rating their attitudes towards (CS). Different factors influence medical and dental students’ attitudes towards CS learning.

Comparison Between Problem-Based Learning and Lecture-Based Learning: Effect on Nursing Students' Immediate Knowledge Retention

BACKGROUND

The basic role of teaching at any degree of training is to bring a rudimentary change within the student. To facilitate the method of information transmission, educators ought to apply acceptable teaching strategies that best suit specific objectives and outcomes. Identifying the best method through comparison of problem-based learning (PBL) and the lecture method; so as to improve students' overall academic performance appear to be important.

OBJECTIVE

The aim of the study was to undertake comparison between problem-based and lecture-based learning methodologies for immediate knowledge retention of nursing students at Dire Dawa University.

METHODS

Quantitative research method which used a pre-experimental two group pretest and post-test research design was employed to identify effective teaching methods for immediate knowledge retention on 38 nursing students from June 1 to June 15, 2019. The students were grouped randomly into problem-based learning and lecture methods. The pretest-posttest analysis was done after an intervention made: a two-hour lecture and four-hour problem-based learning accordingly. Content validity ratio and content validity index was conducted for authentication of instruments and Cronbach alpha was computed to verify its reliability. A paired t-test was conducted to identify mean score change, and p<0.05 was cut off value to determine if there is a significant mean change in the posttest.

RESULT

Both methods showed significant knowledge score improvement (t=13.6, p< 0.001) for lecture-based method and (t=11.302, p< 0.001) for problem-based learning. But as compared to the lecture method, problem-based learning has little effect on students' immediate knowledge retention, and 63.2% of the nursing students prefer the lecture method as the best teaching method.

CONCLUSION

The lecture method is the best teaching method for immediate knowledge retention for nursing students; it is also the most preferred method of teaching method by the students.

The effectiveness of the combined problem-based learning (PBL) and case-based learning (CBL) teaching method in the clinical practical teaching of thyroid disease

Background

This study aimed to evaluate the effectiveness and efficiency of PBL–CBL combined teaching in thyroid surgery and make observations from the students’ perspectives, based on their satisfaction with the learning process.

Methods

We prospectively enrolled 354 fourth-year students majoring in clinical medicine, along with 232 residents, from September 2014 to June 2019. These participants were randomly allocated into either the combined PBL–CBL teaching group or the traditional lecture-based classroom group to attend a course about thyroid nodules. Both pre- and post-class quizzes were conducted. An anonymous questionnaire was also administered to both groups to evaluate the students’ perceptions and experiences. We compared the two teaching methods among all the students as well as with the fourth-year students and residents in subgroups.

Results

The traditional group’s pre-class quiz scores were significantly higher than the PBL–CBL group’s (as determined by a two-tailed t-test at a 95% confidence interval, T = 16.483, P < 0.001). After class, in the PBL–CBL group, the mean total quiz score and the basic knowledge and case analysis scores increased significantly (P < 0.001). The PBL–CBL group’s performance improvement was significantly higher than the traditional group’s (increasing from 52.76 to 70.51 vs. from 67.03 to 71.97). Furthermore, the scores for learning motivation, understanding, student–teacher interaction, the final examination, communication skills, clinical thinking skills, self-learning skills, teamwork skills, and knowledge absorption, as measured by the survey, were significantly higher in the PBL–CBL group than in the traditional group (P < 0.001). Meanwhile, the survey scores representing the amount of students’ free time the course consumed were significantly lower in the PBL–CBL group than in the traditional group (P < 0.001).

Conclusions

PBL combined with CBL may be an effective method for improving medical students’ and residents’ performance and enhancing their clinical skills.

Effectiveness of a tailored implementation strategy to improve adherence to a guideline on mental health problems in occupational health care

BACKGROUND

As compliance to guidelines is generally low among health care providers, little is known about the impact of guidelines on the quality of delivery of care. To improve adherence to guideline recommendations on mental health problems, an implementation strategy was developed for Dutch occupational physicians (OPs). The aims were 1) to assess adherence to a mental health guideline in occupational health care and 2) to evaluate the effect of a tailored implementation strategy on guideline adherence compared to traditional guideline dissemination.

METHODS

An audit of medical records was conducted as part of a larger RCT study. Participants were 66 OPs (32 intervention and 34 control) employed at one of six sites of an Occupational Health Service in southern Netherlands. OPs in the intervention group received multiple-session peer group training which focused on identifying and addressing barriers to using the guideline, using a Plan-Do-Check-Act approach. The control group did not receive training. Medical records of 114 workers sick-listed with mental health problems were assessed (56 intervention and 58 control). Guideline adherence was determined by auditing the records using 12 guideline-based performance indicators (PI), grouped into 5 PIs: process diagnosis, problem orientation, interventions/treatment, relapse prevention, and continuity of care. Differences in performance rates of the PIs between the intervention and control groups were analyzed, taking into account the cluster study design.

RESULTS

OPs who received the training showed significantly greater adherence compared to the controls (p < .028) in 4 out of 5 grouped PIs, i.e. process diagnosis, problem orientation, interventions/treatment and relapse prevention. In one out of 12 PIs adherence was found adequate (53% of the medical records), in 6 PIs adherence was found minimal, and in 5 PIs the majority of the records showed no adherence.

CONCLUSIONS

An implementation strategy which addressed key barriers for change and tailor-made interventions improves adherence to an occupational health guideline for mental health problems compared to traditional guideline dissemination. However, adherence to the guideline recommendations is still far from optimal. To optimize adherence, it is recommended that implementation strategies focus on the workers level, organizational level, and the professional level.

TRIAL REGISTRATION

ISRCTN86605310 . Registered 30 June 2010.

Use of Web 2.0 tools and social media for continuous professional development among primary healthcare practitioners within the Defence Primary Healthcare: a qualitative review

INTRODUCTION

Alongside traditional attendance at learning, general practitioners use social media and Web 2.0 tools in the UK for continuous professional development (CPD). Research has demonstrated, however, barriers to their uptake and use, as well as a requirement for training. Primary care doctors working for the Defence Primary Healthcare (DPHC) use similar technologies, but it is not known what factors affect the uptake. This qualitative research aimed to explore the knowledge and attitudes of this demographic further.

METHODS

An online questionnaire was distributed to DPHC doctors via email and a social networking service (SNS) tool. Questions included demographic and open free-text response boxes. These were subjected to thematic analysis to identify initial concepts subsequently grouped into categories.

RESULTS

DPHC doctors are already using Web 2.0 and social media for education. The benefits of convenience are recognised, but protected time is required to maximise impact. They also identified attendance at learning events, better quality information technology (IT) and further training as important enablers for their CPD.

CONCLUSIONS

The results reaffirmed previous findings that while there is engagement with online learning and Web 2.0 technologies, training in Web 2.0 use and substandard IT infrastructure were barriers to greater uptake. Attended learning events are also popular due to the peer-to-peer networking that takes place, but also as they allow protected time out of the office. The use of Web 2.0 for CPD and of SNS should be given equal status to allow the development of a DPHC doctors' 'community of practice'.

Student engagement and higher order skill proficiency: a comparison of traditional didactic and renewed integrated active learning curricula

A large, multicampus, public medical school underwent curricular renewal, emphasizing a student-centered approach with 50% of all course contact time devoted to active learning. Determining the impact of active learning on student engagement and higher order skill (HOS) proficiency was the primary aim of this study. Following Institutional Review Board approval, two cohort groups of first-year medical students were enrolled. The first cohort ( n = 54) included students before curriculum reform in the legacy curriculum (LC). The second cohort ( n = 73) included students completing studies in the renewed curriculum (RC). Near the end of the first year of medical school, both cohorts completed a validated survey of student engagement, and a proctored problem-based assessment of HOS proficiency [Collegiate Learning Assessment (CLA+)]. Results indicated RC students perceived greater levels of engagement than LC (39.5+5.8 vs. 33.3+5.6), and greater reliance on HOS, including analysis, synthesis, and application. However, there were no significant differences between cohorts in proficiency of HOS when assessed by the CLA+ (LC = 1,878 ± 161 vs. RC = 1,900 ± 157). Additionally, poor correlation between engagement and HOS for both LC and RC indicated more engaged students do not necessarily possess greater HOS proficiency. Ceiling effect may explain results as medical students enter medical school as highly skilled learners with potentially little room for improvement. It will be informative to continue to track engagement and HOS of both cohort groups as they continue their medical studies.

Focused educational intervention improves but may not sustain knowledge regarding falls management

Background

The number of falls in hospital ranges from 3.8 to 8.6 falls per 1000 bed days.¹ Around 30% of falls as inpatients are injurious, and 4%–6% can result in serious and life-threatening injury.^{2 3} This results in significant health burdens and economic burdens due to increased hospital stays following a fall. Junior doctors are usually the first point of contact for managing patients who fall in hospital. It is therefore important they understand the preventative measures and postfalls management.

Aim

To assess the retention of knowledge regarding falls management in foundation year 1 (FY1) doctors before and after a short educational intervention.

Methods

A 3-stage quality improvement project was conducted at a West Midlands teaching hospital to highlight issues regarding falls management. A questionnaire assessing areas of knowledge regarding assessment and management of falls was delivered to 31 F1s. This was followed by a short presentation regarding falls management. The change in knowledge was assessed at 6 and 16 weeks postintervention. The questionnaire results were analysed using unpaired t-tests on STATA (V.14.2).

Results

The mean score for knowledge regarding falls management in the preintervention, early postintervention and late postintervention were 73.7%, 85.2% and 76.4%, respectively. Although there was an improvement in the knowledge at 6 weeks’ postintervention, this returned to almost baseline at 16 weeks. The improvement in knowledge did not translate to clinical practice of falls management during this period.

Conclusion

Although educational interventions improve knowledge, the intervention failed to sustain over period of time or translate in clinical practice. Further work is needed to identify alternative methods to improve sustainability of the knowledge of falls and bring in the change in clinical practice.

Development and psychometric pilot-testing of a questionnaire for the evaluation of satisfaction with continuing education in infection control nurses

Satisfaction with continuing education can be defined as positive attitudes towards educational programs, which has potential to strengthen learning outcomes. A multi-dimensional construct may enhance continuing education program evaluation processes. The objective is to describe the development and psychometric testing of the 'affective - behavioral - cognitive - satisfaction questionnaire' (ABC-SAT) for assessing participants' satisfaction with a continuing education program for nurses in infection control. The multi-staged development of a satisfaction questionnaire comprised of three subscales. The pilot tool was administered to a nationwide sample of 126 infection control nurses to assess satisfaction after participating in a continuing education program. Satisfaction scores were calculated and psychometric testing was performed to determine reliability, using Cronbach's alpha, face validity, objectivity, and economy. A principle component analysis using varimax rotation and Kaiser normalization was performed. The analysis led to a three-factor solution of the questionnaire with 11 items, explaining 61.4% of the variance. Internal consistency of three scales using Cronbach's alpha was 0.83, 0.60, and 0.66, respectively. Selectivity coefficients varied between 0.39 and 0.70. Participants needed approximately three minutes to complete the questionnaire. Initial findings refer to a satisfying scale structure and internal consistency of the 3-dimensional ABC-SAT questionnaire. Further research is required to confirm the questionnaires' psychometric properties.

Occupational Physicians' Reasoning about Recommending Early Return to Work with Work Modifications

Previous research indicates that work modifications can effectively enhance return to work (RTW) at an early stage of work disability. We aimed to examine how occupational physicians (OPs) reason about recommending early return to work (RTW) with work modifications. Pre-defined propositions regarding the use of work modifications in promoting early RTW were discussed in four focus groups with altogether 11 Finnish OPs. Discussions were audio recorded, and the transcribed data were analyzed using qualitative content analysis. Five different rationales for supporting early RTW were identified: to manage medical conditions, to enhance employee well-being, to help workplace stakeholders, to reduce costs to society, and to enhance OP's own professional fulfillment. However, OPs identified situations and conditions in which early RTW may not be suitable. In addition, there were differences between the OPs in the interpretation of the rationales, suggesting variation in clinical practice. In conclusion, encouraging early RTW with work modifications was perceived by OPs as a meaningful task and, to a large extent, beneficial for employees and several stakeholders. However, this practice was not accepted without consideration to the RTW situation and context. If early RTW and work modifications are to be promoted, OPs should be offered education that addresses their views regarding this practice.

Osteoporosis knowledge assessment and osteoporosis education recommendations in the health professions

A previous systematic review on osteoporosis knowledge published showed that only several studies investigated osteoporosis knowledge in health professionals, and it found that their knowledge was not as adequate and sufficient as it should be. Since then, studies published on osteoporosis knowledge among health professionals have also assessed and found that they still do not have adequate and sufficient osteoporosis knowledge. To increase and improve osteoporosis knowledge among health professionals, recommendations in osteoporosis education in the health professions, including the application of the cognitive load theory, online learning, problem-based learning, practical learning, simulation-based learning, interactive learning, and feedback are covered in order to ensure health professionals can have adequate and sufficient osteoporosis knowledge to best prevent and treat individuals with the disease.

Comparison of Lecture-Based Learning vs Discussion-Based Learning in Undergraduate Medical Students

OBJECTIVE

To compare lecture-based learning (LBL) and discussion-based learning (DBL) by assessing immediate and long-term knowledge retention and application of practical knowledge in third- and fourth-year medical students.

DESIGN

A prospective, randomized control trial was designed to study the effects of DBL. Medical students were randomly assigned to intervention (DBL) or control (LBL) groups. Both the groups were instructed regarding the management of gastroschisis. The control group received a PowerPoint presentation, whereas the intervention group was guided only by an objectives list and a gastroschisis model. Students were evaluated using a multiple-choice pretest (Pre-Test MC) immediately before the teaching session, a posttest (Post-Test MC) following the session, and a follow-up test (Follow-Up MC) at 3 months. A practical examination (PE), which tested simple skills and management decisions, was administered at the end of the clerkship (Initial PE) and at 3 months after clerkship (Follow-Up PE). Students were also given a self-evaluation immediately following the Post-Test MC to gauge satisfaction and comfort level in the management of gastroschisis.

SETTING

University of Iowa Hospitals and Clinics and the Carver College of Medicine, Iowa City, IA.

PARTICIPANTS

A total of 49 third- and fourth-year medical students who were enrolled in the general surgery clerkship were eligible for this study. Enrollment into the study was completely voluntary. Of the 49 eligible students, 36 students agreed to participate in the study, and 27 completed the study.

RESULTS

Mean scores for the Pre-Test MC, Post-Test MC, and Follow-Up MC were similar between the control and intervention groups. In the control group, the Post-Test MC scores were significantly greater than Pre-Test MC scores (8.92 ± 0.79 vs 4.00 ± 1.04, p < 0.0001), whereas the Follow-Up MC scores were significantly lower than Post-Test MC scores (7.17 ± 1.75 vs 8.92 ± 0.79, p = 0.005). In the control group, the Follow-Up MC scores were significantly greater than Pre-Test MC scores (7.17 ± 1.75 vs 4.00 ± 1.04, p < 0.0001). Analysis of variance for all control group MC examinations had a p < 0.0001. In the intervention group, the Post-Test MC scores were significantly greater than Pre-Test MC scores (8.33 ± 1.23 vs 4.60 ± 1.55, p < 0.0001), whereas the Follow-Up MC scores were significantly lower than Post-Test MC scores (7.13 ± 1.77 vs 8.33 ± 1.23, p = 0.04). In the intervention group, the Follow-Up MC scores were significantly greater than Pre-Test MC scores (7.13 ± 1.77 vs 4.60 ± 1.55, p = 0.0002). Analysis of variance for all intervention group MC examinations had a p < 0.0001. Mean scores for the Initial PE were significantly higher for the intervention group compared with the control group's score (7.47 ± 1.68 vs 5.25 ± 2.34, p = 0.008). Mean scores for the Follow-Up PE were significantly higher for the intervention group compared with the control group's score (7.87 ± 1.77 vs 5.83 ± 2.04, p = 0.005). A comparison of Initial PE vs Follow-Up PE was not significant in either group. Students in the intervention group were more comfortable in the immediate management of gastroschisis and placement of a silo and felt that the educational experience was more worthwhile than students in the control group did.

CONCLUSIONS

After a single instructional session, there was a significant difference in the students' scores between the control and the intervention groups on both administrations of the PEs. There were no significant differences between the 2 groups in any administration of the MC examinations. This seems to suggest that DBL may lead to better practical knowledge and potentially improved long-term knowledge retention when compared with LBL. Students in the DBL group also felt more comfortable with the management of gastroschisis and were more satisfied with the educational session.

Experiences of Using Prezi in Psychiatry Teaching

OBJECTIVE

Prezi is a presentation software allowing lecturers to develop ideas and produce mind maps as they might do on an old-style blackboard. This study examines students' experience of lectures presented using Prezi to identify the strengths and weaknesses of this new teaching medium.

METHODS

Prezi was used to present mental health lectures to final-year medical and physiotherapy students. These lectures were also available online. This cross-sectional study used a questionnaire to assess students' experience of the software.

RESULTS

Of students approached, 75.5 % (74/98) took part in the study. A majority, 98.6 % (73/74), found Prezi to be a more engaging experience than other styles of lecture delivery. The overview or "mind map" provided by Prezi was found to be helpful by 89.2 % (66/74). Problems arose when students used Prezi in their personal study, with 31.1 % (23/74) reporting some difficulties, mostly of a technical nature.

CONCLUSION

This study highlights the potential of Prezi for providing students with an engaging and stimulating educational experience. For Prezi to be effective, however, the lecturer has to understand and be familiar with the software and its appropriate use.

A 3-armed randomized controlled trial of nurses' continuing education meetings on adverse drug reactions

INTRODUCTION

Nurses' insufficient knowledge of adverse drug reactions is reported as a barrier to spontaneous reporting. Therefore, CE meetings could be utilized to enhance nurses' competencies.

METHODS

In a 3-armed randomized controlled trial, 496 nurses, working in a tertiary medical center, were randomly allocated to a didactic lecture, brainstorming workshop, or the control group (delayed education). Similar instructors (2 clinical pharmacists) prepared and delivered the educational content to all 3 groups. Outcomes were declarative/procedural knowledge (primary outcome), participation rate, and satisfaction. Knowledge was evaluated using a validated researcher-made questionnaire in 3 time points: immediately before, immediately after, and 3 months after each session. Participants' satisfaction was assessed immediately after each meeting via a standard tool. Data were analyzed using appropriate parametric and nonparametric tests.

RESULTS

Rate of participation was 37.7% for the lecture group and 47.5% for the workshop group. The workshop participants were significantly more satisfied in comparison with the lecture group (p < .05). Mean knowledge scores were similar at baseline in the 3 study groups (43-47). Immediately after the meeting, knowledge was significantly higher in the lecture group (79.1 ± 11.9 vs 73.7 ± 11.3; p = .01). At the follow-up, knowledge scores of the lecture and workshop groups were similar, while significantly higher than the control group. However, the reduction of knowledge score was significantly higher in the lecture group (-13.0 ± 15.9% vs -5.7 ± 15.1%, p = .02).

DISCUSSION

Educational interventions can improve nurses' knowledge of adverse drug reactions. Short-term learning could be achieved with lecture, but the retention of knowledge will be enhanced by simple interactive techniques.

Assessing the effectiveness of problem-based learning of preventive medicine education in China

Problem-based learning (PBL) is defined as a student-centered pedagogy which can provide learners more opportunities for application of knowledge acquired from basic science to the working situations than traditional lecture-based learning (LBL) method. In China, PBL is increasingly popular among preventive medicine educators, and multiple studies have investigated the effectiveness of PBL pedagogy in preventive medicine education. A pooled analysis based on 15 studies was performed to obtain an overall estimate of the effectiveness of PBL on learning outcomes of preventive medicine. Overall, PBL was associated with a significant increase in students' theoretical examination scores (SMD = 0.62, 95% CI = 0.41–0.83) than LBL. For the attitude- and skill-based outcomes, the pooled PBL effects were also significant among learning attitude (OR = 3.62, 95% CI = 2.40–5.16), problem solved skill (OR = 4.80, 95% CI = 2.01–11.46), self-directed learning skill (OR = 5.81, 95% CI = 3.11–10.85), and collaborative skill (OR = 4.21, 95% CI = 0.96–18.45). Sensitivity analysis showed that the exclusion of a single study did not influence the estimation. Our results suggest that PBL of preventive medicine education in China appears to be more effective than LBL in improving knowledge, attitude and skills.

Comparison of Problem-based Learning With Lecture-based Learning

Background:

Problem-based learning (PBL) is one of the most commonly used educational methods in medical schools of different countries. By working through this method, students think critically, generate ideas, and acquire the knowledge and skills required to become a doctor.

Objectives:

This study aimed to compare problem-based learning with lecture-based learning in the education of medical students.

Materials and Methods:

This crossover interventional study was conducted on 40 medical students in pediatric ward of Zanjan University of Medical Sciences. All of the students were enrolled in the study and divided into two groups by simple randomization. Then two topics in pediatric courses were chosen. One of the topics was presented as LBL for the first group and as PBL for the second group. The other topic was presented as PBL for the first group and as LBL for the second group.

Results:

The median score of the exam was higher in the intervention group compare to the control group for both topics. However, the difference was not statistically significant. Students preferred problem-based learning over lecture-based learning because of motivation boost, a higher quality of education, knowledge retention, class attractiveness, and practical use.

Conclusions:

Students’ knowledge was similar in both methods.

Didactic Lecture Versus Interactive Workshop for Continuing Pharmacy Education on Reproductive Health

Pharmacists are routinely providing reproductive health counseling in community pharmacies, but studies have revealed significant deficits in their competencies. Therefore, continuing pharmacy education (CPE) could be utilized as a valuable modality to upgrade pharmacists’ capabilities. A randomized controlled trial was designed to compare the efficacy of CPE meetings (lecture based vs. workshop based) on contraception and male sexual dysfunctions. Sixty pharmacists were recruited for each CPE meeting. Small group training using simulated patients was employed in the workshop-based CPE. Study outcomes were declarative/procedural knowledge, attitudes, and satisfaction of the participants. Data were collected pre-CPE, post-CPE, and 2 months afterward and were analyzed using repeated measure analysis of variance and Mann–Whitney U test. Results showed that lecture-based CPE was more successful in improving pharmacists’ knowledge post-CPE ( p < .001). In contrast, a significant decrease was observed in the lecture-based group at follow-up ( p = .002), whereas the workshop-based group maintained their knowledge over time ( p = 1.00). Knowledge scores of both groups were significantly higher at follow-up in comparison with pre-CPE ( p < .01). No significant differences were observed regarding satisfaction and attitudes scores between groups. In conclusion, an interactive workshop might not be superior to lecture-based training for improving pharmacists’ knowledge and attitudes in a 1-day CPE meeting.

Evaluation of a musculoskeletal training package for occupational health practitioners

BACKGROUND

Musculoskeletal disorders (MSDs) are a common cause of disability in the workplace. Despite this, there is known to be a wide variation in the assessment of MSDs by UK occupational health (OH) professionals. Therefore we developed a workshop, supported by a bespoke, on-line video, focussing on the assessment and management of MSDs.

AIMS

To assess the impact of the training package on the knowledge, confidence and reported behaviour of attendees.

METHODS

Workshops were held in two regional centres in England. Delegates completed a questionnaire on arrival to establish their baseline knowledge and confidence and again at the end of the training. A third questionnaire, with one reminder, was e-mailed to delegates 4 months following the workshops.

RESULTS

Ninety-two OH professionals (77 nurses, 10 doctors and 5 'others') attended and more than 80% reported that they had no previous training in examining the upper or lower limb or in distinguishing specific from non-specific MSDs. Confidence among delegates in examination, diagnosis and management of MSDs improved after the workshop and these changes were sustained and remained statistically significant from baseline 4 months afterwards. Following the training, 79% (50) of delegates reported that they had shared the knowledge and skills acquired with their colleagues and 71% reported that they had used the examination techniques in their day-to-day practice.

CONCLUSIONS

We have developed a training package which resulted in improved knowledge among attendees and gave them confidence to use their skills in practice.

Effective in-service training design and delivery: evidence from an integrative literature review

BACKGROUND

In-service training represents a significant financial investment for supporting continued competence of the health care workforce. An integrative review of the education and training literature was conducted to identify effective training approaches for health worker continuing professional education (CPE) and what evidence exists of outcomes derived from CPE.

METHODS

A literature review was conducted from multiple databases including PubMed, the Cochrane Library and Cumulative Index to Nursing and Allied Health Literature (CINAHL) between May and June 2011. The initial review of titles and abstracts produced 244 results. Articles selected for analysis after two quality reviews consisted of systematic reviews, randomized controlled trials (RCTs) and programme evaluations published in peer-reviewed journals from 2000 to 2011 in the English language. The articles analysed included 37 systematic reviews and 32 RCTs. The research questions focused on the evidence supporting educational techniques, frequency, setting and media used to deliver instruction for continuing health professional education.

RESULTS

The evidence suggests the use of multiple techniques that allow for interaction and enable learners to process and apply information. Case-based learning, clinical simulations, practice and feedback are identified as effective educational techniques. Didactic techniques that involve passive instruction, such as reading or lecture, have been found to have little or no impact on learning outcomes. Repetitive interventions, rather than single interventions, were shown to be superior for learning outcomes. Settings similar to the workplace improved skill acquisition and performance. Computer-based learning can be equally or more effective than live instruction and more cost efficient if effective techniques are used. Effective techniques can lead to improvements in knowledge and skill outcomes and clinical practice behaviours, but there is less evidence directly linking CPE to improved clinical outcomes. Very limited quality data are available from low- to middle-income countries.

CONCLUSIONS

Educational techniques are critical to learning outcomes. Targeted, repetitive interventions can result in better learning outcomes. Setting should be selected to support relevant and realistic practice and increase efficiency. Media should be selected based on the potential to support effective educational techniques and efficiency of instruction. CPE can lead to improved learning outcomes if effective techniques are used. Limited data indicate that there may also be an effect on improving clinical practice behaviours. The research agenda calls for well-constructed evaluations of culturally appropriate combinations of technique, setting, frequency and media, developed for and tested among all levels of health workers in low- and middle-income countries.

Evaluating learning among undergraduate medical students in schools with traditional and problem-based curricula

This study aimed to assess knowledge and skills in a respiratory physiology course in traditional versus problem-based learning (PBL) groups in two different medical schools. Two different undergraduate medical schools were selected for this study. The first medical school followed the traditional [lecture-based learning (LBL)] curriculum, and the second medical school followed the PBL curriculum. Sixty first-year male medical students (30 students from each medical school) volunteered; they were apparently healthy and of the same age, sex, nationality, and regional and cultural background. Students were taught respiratory physiology according to their curriculum for a period of 2 wk. At the completion of the study period, knowledge was measured based on a single best multiple-choice question examination, and skill was measured based on the objective structured practical examination in the lung function laboratory (respiratory physiology). A Student's t-test was applied for the analysis of the data, and the level of significance was set at P < 0.05. Students belonging to the PBL curriculum obtained a higher score in the multiple-choice question examination (P = 0.001) and objective structured practical examination (P = 0.0001) compared with traditional (LBL) students. Students in the PBL group obtained significantly higher knowledge and skill scores in the respiratory physiology course compared with students in the traditional (LBL) style of medical schools.

Prospective evaluation of mental health training for occupational health practitioners

BACKGROUND

Occupational health (OH) practitioners need to be confident in identifying and managing mental health problems in the workforce.

AIMS

To evaluate the effectiveness of a one-day workshop in improving the knowledge, attitude and confidence of OH practitioners in detecting and managing depression, anxiety, suicide risk, alcohol misuse and drug abuse.

METHODS

Interactive mental health workshops for 164 OH practitioners held in five regions in England were evaluated by self-administered questionnaire. Data were collected immediately prior to the workshop (T1), immediately after the workshop (T2) and 4 months following the workshop (T3).

RESULTS

At T1, the response rate was 97% (159/164), 90% at T2 and 63% at T3. The mean improvement in participants' knowledge was 8% (95% CI 6-10) at T2 compared with T1. The biggest improvement was in participants with no previous training in the management of common mental health problems in the workplace, mean improvement 9% (95% CI 6-12). Participants' confidence improved in all areas assessed at T2, and the improvement in confidence compared with that at baseline was sustained at 4 months (T3). Participants reported using the knowledge gained in clinical practice in all topic areas covered. Use of knowledge gained at the workshop was significantly higher in those who had had previous training in managing common mental health disorders.

CONCLUSIONS

This one-day interactive workshop was a feasible and effective method of improving OH professionals' confidence, knowledge and application of skills in practice in key areas of mental health.

A brief intervention to improve food allergy knowledge among US pediatricians: lessons learned

OBJECTIVE

To evaluate a brief educational tool for pediatricians developed to address known gaps in food allergy knowledge.

STUDY DESIGN

Pre- and post-assessments were administered to a convenience sample of 61 US pediatricians completing the Food Allergy Comprehension Tool between February and March of 2010. McNemar's and Wilcoxon signed rank tests were used to determine whether clinical knowledge of food allergy and level of comfort in caring for food-allergic children increased significantly after reviewing the tool. Logistic regression models were used to measure the association of participant characteristics with increased knowledge and comfort.

RESULTS

Sixty-one percent of surveyed physicians answered more knowledge questions correctly after reviewing the tool. Significantly more participants correctly indicated that anaphylaxis poses the greatest threat to teenagers rather than young children, and correctly rejected chronic nasal problems as a symptom of food allergy (p < 0.05). Comfort in caring for food-allergic children increased significantly on all items post-intervention (p < 0.05). Odds of increased knowledge and comfort were significantly higher among pediatricians without previous training in food allergy.

CONCLUSION

The Food Allergy Comprehension Tool is a rapid way to address known knowledge gaps among pediatricians and to identify areas in need of further intervention. We recommend integration of the tool with current food allergy guidelines.

Educational interventions to improve the effectiveness in clinical competence of general practitioners: problem-based versus critical reading-based learning

BACKGROUND

Evidence suggests that continuing medical education improves the clinical competence of general practitioners and the quality of health care services. Thus, we evaluated the relative impact of two educational strategies, critical reading (CR) and problem based learning (PBL), on the clinical competence of general practitioners in a healthcare system characterized by excessive workload and fragmentation into small primary healthcare centers.

METHODS

Clinical competence was evaluated in general practitioners assigned to three groups based on the educational interventions used: 1) critical reading intervention; 2) problem based learning intervention; and 3) no intervention (control group, which continued clinical practice as normal). The effect on the clinical competence of general practitioners was evaluated in three dimensions: the cognitive dimension, via a self-administered questionnaire; the habitual behavioral dimension, via information from patient's medical records; and the affective dimension, through interviews with patients. A paired Student´s t-test was used to evaluate the changes in the mean clinical competence scores before and after the intervention, and a 3 x 2 ANOVA was used to analyze groups, times and their interaction.

RESULTS

Nine general practitioners participated in the critical reading workshop, nine in the problem-based learning workshop, and ten were assigned to the control group. The participants exhibited no significant differences in clinical competence measures at baseline, or in socio-demographic or job characteristics (p > 0.05). Significant improvements in all three dimensions (cognitive, 45.67 vs 54.89; habitual behavioral, 53.78 vs 82.33; affective, 4.16 vs 4.76) were only observed in the problem-based learning group after the intervention (p > 0.017).

CONCLUSIONS

While no differences in post-intervention scores were observed between groups, we conclude that problem-based learning can be effective, particularly in a small-group context. Indeed, problem-based learning was the only strategy to induce a significant difference between pre- and post- intervention scores for all three CC dimensions.

Development and reliability of performance indicators for measuring adherence to a guideline for depression by insurance physicians

INTRODUCTION

We wanted to measure adherence to the guideline for depression in disability assessments. The research questions we addressed were: How can we develop performance indicators (PIs) for adherence to the Dutch guideline for disability assessment of patients with depression and how can we measure the quality of the scores? What is the inter-rater reliability of these PIs? What is the quality of the PI scores?

METHODS

PIs, developed by the researchers, were reviewed on various aspects, by a panel of seven experts in several consulting rounds. After adjustments, senior insurance physicians (IPs) attended two training sessions and scored the PIs on 10 different simulated case reports. Two researchers developed proxy 'gold standard' scores for these 10 case reports. To assess the inter-rater reliability and the quality of the scores, we calculated the intra-class correlations (ICC) and 95% confidence intervals (CI) of the PI scores and of the PI scores compared to the proxy 'gold standard', respectively.

RESULTS

Six specific and relevant PIs resulted from the consultation of the panel of experts. The PI scores for the 10 case reports, rated by seven (of the eight) senior IPs who completed both training sessions, showed that the PIs were not reliable at individual level (ICC = 0.543; 95% CI 0.426-0.642). However, the ICC became more reliable as an average of two raters was calculated (ICC = 0.704). The ICC of the PI scores with the proxy 'gold standard' was 0.538 (95% CI 0.419-0.640), but the quality was higher when calculated as an average of two raters (ICC = 0.700).

CONCLUSION

The PIs for adherence to the guideline were sufficiently reliable, and the quality of their scores was adequate if at least two well-trained raters were involved. The senior IPs evaluated the feasibility of the PIs as good, with a prerequisite of sufficient training. This method may be interesting for measuring guideline adherence and quality of disability assessments in general.

Problem-based learning in postgraduate dental education: a qualitative evaluation of students' experience of an orthodontic problem-based postgraduate programme

INTRODUCTION

Problem based learning (PBL) has gained wide acceptance in undergraduate education, but less so in postgraduate education. Qualitative research methodologies can help us gain insight and understanding of the students' experience in undertaking such programmes.

AIM

To evaluate the experiences of postgraduate students undertaking a PBL based postgraduate programme.

METHODS

Focus groups and semi-structured interviews were used to investigate students' experiences. The qualitative data were coded, the codes were grouped into categories and a coding framework developed. From this a construct is proposed to give insight into students' experiences. The validity of this construct was examined by reviewing the literature.

RESULTS

Students entered the programme with high expectations, but soon found they had challenges to overcome. They came to realise that they were on a journey, rather than undertaking a sequence of separate individual learning events. PBL led to significant tensions both within the individuals and the group, caused by the conflict between appreciating PBL as a 'good thing' and yet finding that ;it just doesn't seem to work'. The fear of failure in a high stakes setting only exacerbated these tensions. The literature review revealed an inconsistent approach to the use of PBL and its evaluation in a postgraduate/continuing medical education setting. However it did provide evidence of similar findings in qualitative studies, supporting the construct developed.

CONCLUSION

We have proposed a construct to help in understanding the PBL experience for students undergoing a 'high stakes' orthodontic postgraduate programme with a core of PBL.

Guideline-based care of common mental disorders by occupational physicians (CO-OP study): a randomized controlled trial

OBJECTIVE

To evaluate the effectiveness of guideline-based care (GBC) of workers with mental health problems, which promotes counseling by the occupational physician (OP) facilitating return to work (RTW).

METHODS

In a randomized controlled trial with police workers on sick leave due to mental health problems (n = 240), trained OPs delivered GBC in the intervention group. Time to RTW and recurrences during 1-year follow-up, analyzed using Cox proportional hazards models, were compared with usual care (UC) with easy access to a psychologist.

RESULTS

GBC by OPs did not result in earlier RTW than UC. Subgroup analysis showed a small effect in favor of GBC for workers with administrative functions and/or "minor" stress-related symptoms.

CONCLUSIONS

GBC did not differ in RTW compared with UC, but may be beneficial for the majority of workers with minor stress-related disorders.

Continuing education meetings and workshops: effects on professional practice and health care outcomes

BACKGROUND

Educational meetings are widely used for continuing medical education. Previous reviews found that interactive workshops resulted in moderately large improvements in professional practice, whereas didactic sessions did not.

OBJECTIVES

To assess the effects of educational meetings on professional practice and healthcare outcomes.

SEARCH STRATEGY

We updated previous searches by searching the Cochrane Effective Practice and Organisation of Care Group Trials Register and pending file, from 1999 to March 2006.

SELECTION CRITERIA

Randomised controlled trials of educational meetings that reported an objective measure of professional practice or healthcare outcomes.

DATA COLLECTION AND ANALYSIS

Two authors independently extracted data and assessed study quality. Studies with a low or moderate risk of bias and that reported baseline data were included in the primary analysis. They were weighted according to the number of health professionals participating. For each comparison, we calculated the risk difference (RD) for dichotomous outcomes, adjusted for baseline compliance; and for continuous outcomes the percentage change relative to the control group average after the intervention, adjusted for baseline performance. Professional and patient outcomes were analysed separately. We considered 10 factors to explain heterogeneity of effect estimates using weighted meta-regression supplemented by visual analysis of bubble and box plots.

MAIN RESULTS

In updating the review, 49 new studies were identified for inclusion. A total of 81 trials involving more than 11,000 health professionals are now included in the review. Based on 30 trials (36 comparisons), the median adjusted RD in compliance with desired practice was 6% (interquartile range 1.8 to 15.9) when any intervention in which educational meetings were a component was compared to no intervention. Educational meetings alone had similar effects (median adjusted RD 6%, interquartile range 2.9 to 15.3; based on 21 comparisons in 19 trials). For continuous outcomes the median adjusted percentage change relative to control was 10% (interquartile range 8 to 32%; 5 trials). For patient outcomes the median adjusted RD in achievement of treatment goals was 3.0 (interquartile range 0.1 to 4.0; 5 trials). Based on univariate meta-regression analyses of the 36 comparisons with dichotomous outcomes for professional practice, higher attendance at the educational meetings was associated with larger adjusted RDs (P < 0.01); mixed interactive and didactic education meetings (median adjusted RD 13.6) were more effective than either didactic meetings (RD 6.9) or interactive meetings (RD 3.0). Educational meetings did not appear to be effective for complex behaviours (adjusted RD -0.3) compared to less complex behaviours; they appeared to be less effective for less serious outcomes (RD 2.9) than for more serious outcomes.

AUTHORS' CONCLUSIONS

Educational meetings alone or combined with other interventions, can improve professional practice and healthcare outcomes for the patients. The effect is most likely to be small and similar to other types of continuing medical education, such as audit and feedback, and educational outreach visits. Strategies to increase attendance at educational meetings, using mixed interactive and didactic formats, and focusing on outcomes that are likely to be perceived as serious may increase the effectiveness of educational meetings. Educational meetings alone are not likely to be effective for changing complex behaviours.

Effect of an EBM course in combination with case method learning sessions: an RCT on professional performance, job satisfaction, and self-efficacy of occupational physicians

OBJECTIVE

An intervention existing of an evidence-based medicine (EBM) course in combination with case method learning sessions (CMLSs) was designed to enhance the professional performance, self-efficacy and job satisfaction of occupational physicians.

METHODS

A cluster randomized controlled trial was set up and data were collected through questionnaires at baseline (T0), directly after the intervention (T1) and 7 months after baseline (T2). The data of the intervention group [T0 (n = 49), T1 (n = 31), T2 (n = 29)] and control group [T0 (n = 49), T1 (n = 28), T2 (n = 28)] were analysed in mixed model analyses. Mean scores of the perceived value of the CMLS were calculated in the intervention group.

RESULTS

The overall effect of the intervention over time comparing the intervention with the control group was statistically significant for professional performance (p < 0.001). Job satisfaction and self-efficacy changes were small and not statistically significant between the groups. The perceived value of the CMLS to gain new insights and to improve the quality of their performance increased with the number of sessions followed.

CONCLUSION

An EBM course in combination with case method learning sessions is perceived as valuable and offers evidence to enhance the professional performance of occupational physicians. However, it does not seem to influence their self-efficacy and job satisfaction.

[Problem/case-based learning compared to lectures for acquiring knowledge of air embolism in continuing medical education]

OBJECTIVE

The efficacy of continuing medical education in anesthesiology has been examined very little. This study compared the efficacy of a lecture on air embolism to that of a class that used a problem/case-based learning approach.

MATERIAL AND METHODS

Prospective, randomized study enrolling 52 experienced anesthesiologists participating in a professional development course. Twenty-six anesthesiologists attended a lecture on air embolism in anesthesia and 25 attended a problem-based class. The objectives were the same for both groups and had been defined previously. The participants' knowledge was evaluated before and after the instruction with tests based on 2 cases dealing with the same knowledge areas: risk factors and symptoms, diagnosis, monitoring, and treatment.

RESULTS

No significant between-group differences were found for any of the knowledge areas before or after the classes. After instruction, participants who listened to the lecture improved their scores for knowledge of monitoring (P = .03) and treatment (P = .001). Participants in the problem-based learning group also improved their scores for knowledge of treatment (P = .003).

CONCLUSIONS

No between-group differences in participants' knowledge outcomes were detected; improvements were minimal. The study design allowed the knowledge acquired to be evaluated objectively.