Does integrated training in evidence-based medicine (EBM) in the general practice (GP) specialty training improve EBM behaviour in daily clinical practice? A cluster randomised controlled trial

Learning Conversations with Trainees: An Undervalued but Useful EBM Learning Opportunity for Clinical Supervisors

Phenomenon: Supervisors and trainees can learn skills related to evidence-based medicine from each other in the workplace by collaborating and interacting, in this way benefiting from each other's strengths. This study explores supervisors' perceptions of how they currently learn evidence-based medicine by engaging in learning conversations with their trainee. Approach: Semi-structured, video-stimulated elicitation interviews were held with twenty-two Dutch and Belgian supervisors in general practice. Supervisors were shown fragments of their video-recorded learning conversations, allowing them to reflect. Recorded interviews were analyzed using a grounded theory-based approach.Findings: Supervisors did not immediately perceive workplace learning conversations as an opportunity to learn evidence-based medicine from their trainee. They mostly saw these conversations as a learning opportunity for trainees and a chance to maintain the quality of care within their practice. Nevertheless, during the interviews, supervisors did acknowledge that learning conversations help them to gain up-to-date knowledge and search skills or more awareness of their own knowledge or gaps in their knowledge. Not identified as a learning outcome was how to apply evidence-based medicine within a clinical practice by combining evidence with clinical expertise and the patient's preferences. Insights: Supervisors acknowledge that they learn elements of the three aspects of evidence-based medicine by having learning conversations with their trainee, but they currently see this as secondary to the trainee's learning process. Emphasizing opportunities for bidirectional learning could improve learning of evidence-based medicine during workplace learning conversations.

Evidence-based medicine curricula and barriers for physicians in training: a scoping review

OBJECTIVES

To describe the published literature on EBM curricula for physicians in training and barriers during curriculum implementation.

METHODS

We performed a systematic search and review of the medical literature on PubMed, Embase, ERIC, Scopus and Web of Science from the earliest available date until September 4, 2019.

RESULTS

We screened 9,042 references and included 29 full-text studies and 14 meeting abstracts. Eighteen studies had moderate validity, and 6 had high validity. The EBM curricular structure proved highly variable in between studies. The majority of the EBM curricula was longitudinal with different lengths. Only five studies reported using Kern's six-step approach for curriculum development. Twenty-one articles reported on EBM skills and knowledge, and only 5/29 full-text articles used a validated assessment tool. Time was the main barrier to EBM curriculum implementation. All the included studies and abstracts, independent of the EBM curriculum structure or evaluation method used, found an improvement in the residents' attitudes and/or EBM skills and knowledge.

CONCLUSIONS

The current body of literature available to guide educators in EBM curriculum development is enough to constitute a strong scaffold for developing any EBM curriculum. Given the amount of time and resources needed to develop and implement an EBM curriculum, it is very important to follow the curriculum development steps and use validated assessment tools.

Examining aptitude and barriers to evidence-based medicine among trainees at an ACGME-I accredited program

BACKGROUND

The aims of Evidence-Based medicine (EBM) are to promote critical thinking and produces better patients' outcome (Profetto-McGrath J, J Prof Nurs Off J Am Assoc Coll Nurs 21:364-371, 2005). Accreditation Council for Graduate Medical Education (ACGME) competencies require trainees to locate, appraise and apply clinical evidence to patients' care. Despite the emphasis that ACGME place on EBM, few organizations provide adequate training in EBM. This is even more critical in regions where medical trainees matriculate from diverse backgrounds of undergraduate medical education, where EBM may not be emphasized nor taught at all. EBM practice has a history of research in the West, however, EBM has not been widely studied in the Middle East.

METHODS

Clinicians and trainees at Hamad Medical Corporation (HMC) matriculate from many countries in the Middle East and North Africa (MENA) and Asia. Because trainees in Graduate Medical Education (GME) come to HMC from a variety of geographic backgrounds, it is assumed that they also have a variety of experiences and aptitudes in EBM. To assess trainees EBM attitudes and knowledge in the internal medicine department at HMC in Doha, Qatar, the authors surveyed residents and fellows using a two-part survey. The first part was adapted from the evidence-based practice inventory by Kaper to assess trainees' attitudes and perceptions of EBM. Trainees were also asked to complete the Assessing Competency in Evidence Based Medicine (ACE) tool to evaluate their aptitude in different elements of EBM. The results from the two parts were analyzed.

RESULTS

The average score on the ACE tool among the participants was 8.9 (±1.6). Most participants rated themselves as beginners or intermediate in their EBM capabilities. Higher ACE scores were observed from participants with educational background from South Asia, and among those with more favorable attitudes towards EBM. There was no clear pattern that early incorporation of EBM into practice will result in better ACE score. Participants also reported reasonable abilities in EBM tasks and a favorable work atmosphere for EBM implementation. Lack of knowledge, resources, and time were the most reported barriers to utilizing EBM.

CONCLUSIONS

While it is clear that participants are enthusiastic about EBM and see it as a useful method for clinical decision making, their aptitude in EBM is not optimal and there are gaps and barriers for them to practice.

Applying evidence-based medicine in general practice: a video-stimulated interview study on workplace-based observation

Background

Evidence-based medicine (EBM) in general practice involves applying a complex combination of best-available evidence, the patient’s preferences and the general practitioner’s (GP) clinical expertise in decision-making. GPs and GP trainees learn how to apply EBM informally by observing each other’s consultations, as well as through more deliberative forms of workplace-based learning. This study aims to gain insight into workplace-based EBM learning by investigating the extent to which GP supervisors and trainees recognise each other’s EBM behaviour through observation, and by identifying aspects that influence their recognition.

Methods

We conducted a qualitative multicentre study based on video-stimulated recall interviews (VSI) of paired GP supervisors and GP trainees affiliated with GP training institutes in Belgium and the Netherlands. The GP pairs (n = 22) were shown fragments of their own and their partner’s consultations and were asked to elucidate their own EBM considerations and the ones they recognised in their partner’s actions. The interview recordings were transcribed verbatim and analysed with NVivo. By comparing pairs who recognised each other’s considerations well with those who did not, we developed a model describing the aspects that influence the observer’s recognition of an actor’s EBM behaviour.

Results

Overall, there was moderate similarity between an actor’s EBM behaviour and the observer’s recognition of it. Aspects that negatively influence recognition are often observer-related. Observers tend to be judgemental, give unsolicited comments on how they would act themselves and are more concerned with the trainee-supervisor relationship than objective observation. There was less recognition when actors used implicit reasoning, such as mindlines (internalised, collectively reinforced tacit guidelines). Pair-related aspects also played a role: previous discussion of a specific topic or EBM decision-making generally enhanced recognition. Consultation-specific aspects played only a marginal role.

Conclusions

GP trainees and supervisors do not fully recognise EBM behaviour through observing each other’s consultations. To improve recognition of EBM behaviour and thus benefit from informal observational learning, observers need to be aware of automatic judgements that they make. Creating explicit learning moments in which EBM decision-making is discussed, can improve shared knowledge and can also be useful to unveil tacit knowledge derived from mindlines.

Does evidence-based medicine training improve doctors' knowledge, practice and patient outcomes? A systematic review of the evidence

Courses in Evidence-Based Medicine (EBM) for doctors have consistently demonstrated short-term improvements in knowledge. However, there is no strong evidence linking EBM training to changes in clinical practice or patient outcomes. This systematic review investigates whether EBM training leads to sustained improvements in doctors' knowledge and practice behaviors that may also facilitate changes in patient outcomes and experiences. A literature search was undertaken in Ovid Medline, Ovid Embase, The Cochrane Library, ERIC and Scopus. Studies published from 1997 to 2016 that assessed outcomes of EBM educational interventions amongst doctors and used measures of knowledge, skills, attitudes, practice or patient outcomes were included. Fifteen studies were included in the analysis: four randomized controlled trials (RCTs), three non-RCTs, and eight before-after (longitudinal cohort) studies. Heterogeneity among studies prevented meaningful comparisons. Varying degrees of bias due to the use of subjective measures were identified, limiting study validity. Results showed that EBM interventions can improve short-term knowledge and skills, but there is little reliable evidence of changes in long-term knowledge, attitudes, and clinical practice. No study measured improvement in patient outcomes or experiences. EBM training for medical practitioners needs to incorporate measures of behavioral changes while incorporating patient outcomes and experience measures.

The Utrecht questionnaire (U-CEP) measuring knowledge on clinical epidemiology proved to be valid

OBJECTIVES

Knowledge on clinical epidemiology is crucial to practice evidence-based medicine. We describe the development and validation of the Utrecht questionnaire on knowledge on Clinical epidemiology for Evidence-based Practice (U-CEP); an assessment tool to be used in the training of clinicians.

STUDY DESIGN AND SETTING

The U-CEP was developed in two formats: two sets of 25 questions and a combined set of 50. The validation was performed among postgraduate general practice (GP) trainees, hospital trainees, GP supervisors, and experts. Internal consistency, internal reliability (item-total correlation), item discrimination index, item difficulty, content validity, construct validity, responsiveness, test-retest reliability, and feasibility were assessed. The questionnaire was externally validated.

RESULTS

Internal consistency was good with a Cronbach alpha of 0.8. The median item-total correlation and mean item discrimination index were satisfactory. Both sets were perceived as relevant to clinical practice. Construct validity was good. Both sets were responsive but failed on test-retest reliability. One set took 24 minutes and the other 33 minutes to complete, on average. External GP trainees had comparable results.

CONCLUSION

The U-CEP is a valid questionnaire to assess knowledge on clinical epidemiology, which is a prerequisite for practicing evidence-based medicine in daily clinical practice.