Exploring deliberate practice in medicine: how do physicians learn in the workplace?

Best Practices in Formative Feedback in Resident Evaluations: A Narrative Review

BACKGROUND

Formative feedback is essential for the optimal development of a physician. The narrative portion of the evaluation is uniquely poised to help guide the resident. However, the quality of the feedback may be highly variable, and evaluators may be hampered by both a lack of formal training as well as time pressures.

OBJECTIVE

To determine best practices in providing narrative feedback for residents.

METHODS

We conducted a narrative review of the literature around formative feedback in residency using a Pubmed search of articles written in English over the 30 year span 1993-2023.

RESULTS

Several themes were identified. Comments should be specific, both to the task and to the individual. Commentary should also be actionable, rather than a statement of what cannot be changed by the learner. Ideally, the narration should be constructive, and strike the proper tone. There are additional operational items, such as the structure of the evaluation form itself, that may help optimize narrative commentary.

CONCLUSIONS

There is limited but compelling evidence that narrative commentary can be improved in educational value by being specific, actionable, constructive, and written with the proper tone. Changes in the evaluation form may optimize quality and improve timing of delivery.

Professional Identity Formation in Indian Undergraduate Medical Students

Medical training in India is experiencing a paradigm shift. The competency-based medical education (CBME) for undergraduate medical training was adopted from the admission session 2019. The Indian Medical Graduate (IMG) was identified under CBME, by explicitly documenting its roles viz. clinician, professional, communicator, leader and life-long learner. In the recently released amended guidelines, two additional roles of IMG have been added. Looking at the roles of the IMG, it can be inferred that professionalism is one of the core roles assigned to IMG, and most other roles like - clinician, leader, and communicator fall under the broad definition of role as professional. It is argued that the objective of the curriculum should not only be to equip the students for identifying their professional roles but to support them to develop their professional identities. The potential of the CBME to equip the teachers and students to develop the professional identity of students is adequately supported by literature. However, the professional identity of IMG has not been defined to date, and no structured framework to develop this professional identity of the undergraduate students in the Indian context is available. The conceptual paper is an effort to define the professional identity of IMG and provide a framework to develop their professional identity.

How breakthroughs happen: Unearthing the boundary conditions of eco-friendly deliberate practice and eco-innovation performance

Surprisingly innovation process based on deliberate practice has rarely been unearthed that might explore the boundary conditions of the eco-friendly deliberate practice and eco-innovation performance relationship. Anchored on the organizational support theory and the social cognitive, the current study seeks to investigate the impacts of perceived organizational support (POS) and developmental leadership (DL) on eco-innovation performance (EP) through the mediating role of eco-friendly deliberate practice (EDP). In addition, the study explores the boundary effects of employee resilience (ER) on the relationship between EDP and EP. The study collects time-lagged (i.e., "three-wave") and multisource (i.e., "self-rated and supervisor-rated") data from 383 respondents working in the service sector organizations in Pakistan. The authors processed data in SmartPLS (v 4.0) to assess the measurement model and the structural model. The study finds that POS and DL have significant positive relationships with EDP. Further, EDP partially mediates the links between POS, DL, and EP. Moreover, ER intervenes the association between EDP and EP such that at high levels of ER, the relationship is stronger and vice versa. Despite growing interest in deliberate practice, the boundary conditions of EDP in the work context are rarely investigated. This is the first study that explores the contextual and individual factors that can underpin the influence of EDP on EP.

Unravelling the art of developing skilled communication: a longitudinal qualitative research study in general practice training

Doctor-patient communication is a core competency in medical education, which requires learners to adapt their communication flexibly to each clinical encounter. Although conceptual learning models exist, information about how skilled communication develops over time is scant. This study aims to unpack this process of communication learning and to identify its facilitators. We conducted a longitudinal qualitative study employing a constructivist grounded theory approach in a General Practice training setting. Over a 6-month period, we closely monitored 8 first-year and 5 third-year trainees (n = 13) by means of clinical observations, stimulated recall interviews and audio diaries. In an iterative process of data collection and analysis, we triangulated these sources across trainees (horizontal analysis) and over time (vertical analysis) to identify how themes evolved. This analysis led us to the construction of a six-stage cyclic conceptual model during which trainees: (1) have an impactful experience; (2) become aware of own communication; (3) look for alternative communication behaviours; (4) experiment with new behaviours; (5) evaluate the effectiveness; and (6) internalise the new communication behaviours. Additionally, conditions were found to support learning and reflection. Becoming a skilled communicator seems to require a continuous approach, with repeated practice and reflection to adapt and internalise communication in the clinical encounter. Consequently, we recommend that trainees be supported with tailored feedback to strengthen their communication repertoire. Ideally, they should be guided by supervisors who serve as coaches in a safe learning environment with regular, planned learning activities.

"I Had No Idea This Happened": Electronic Feedback on Clinical Reasoning for Hospitalists

BACKGROUND

Feedback on the diagnostic process has been proposed as a method of improving clinical reasoning and reducing diagnostic errors. Barriers to the delivery and receipt of feedback include time constraints and negative reactions. Given the shift toward asynchronous, digital communication, it is possible that electronic feedback ("e-feedback") could overcome these barriers.

OBJECTIVES

We developed an e-feedback system for hospitalists around episodes of care escalation (transfers to ICU and rapid responses). The intervention was evaluated by measuring hospitalists' satisfaction with e-feedback and commitment to change.

DESIGN

A qualitative survey study conducted at one academic medical center from February to June 2023.

PARTICIPANTS

Hospitalists - physicians and advanced practice providers.

APPROACH

Two hospitalists, one internal medicine resident, and a nurse reviewed escalations of care on the hospitalist service each week using the Revised Safer Dx framework. Confidential feedback was emailed to the hospitalists involved in the patient's care. Hospitalists were asked to rate and explain their satisfaction with the e-feedback and whether they might modify their clinical practice based on the e-feedback. The open-ended text comments from the hospitalists were analyzed using a thematic analysis framework.

RESULTS

Forty-nine out of fifty-eight hospitalists agreed to participate. One hundred five out of one hundred twenty-four (85%) e-feedback surveys that were sent were returned by the hospitalists. Hospitalists were highly satisfied with 67% (n = 70) of the e-feedback reports, moderately satisfied with 23% (n = 24), and not satisfied with 10% (n = 11). Six themes were identified based on analysis of the comments. Themes related to satisfaction with the intervention included appreciation for learning about patient outcomes, general appreciation of feedback on clinical care, and importance of detailed and specific feedback. Themes related to changing clinical practice included reflection on clinical decision-making, value of new insights, and anticipated future behavior change.

CONCLUSIONS

E-feedback was well received by hospitalists. Their perspectives offer useful insights for enhancing electronic feedback interventions.

From Two Dimensions to Multidimensions: A Mechanistic Model to Support Deliberate CPD Development, Coordination, and Evaluation

INTRODUCTION

The effectiveness of continuing professional development as an intervention to improve health professional behavior and patient health is variable and contentious. To clarify the causal relationships underlying program outcomes and facilitate a necessary shift from outcomes-only-based approaches to outcome-based and theory-based approaches in program development and evaluation, we developed a model of mechanisms mapped to relevant outcomes.

METHODS

Mechanisms identified in a prior realist synthesis of opioid agonist therapy continuing professional development programs were iteratively tested and refined using purposive and opportunistic sampling and realist approaches against two systematic reviews of programs in analgesic prescribing and palliative care. Further testing involved practical application within programs in sustainable health care and pain management.

RESULTS

Ninety reports on 75 programs and practical application to multiple additional programs informed the final model consisting of five distinct mechanisms: motivation transformation, expert influence, confidence development, self-efficacy facilitation, and community of practice expansion. The mechanisms and related analysis emphasize that continuing professional development is heterogeneous, complex, and context dependent.

DISCUSSION

Shifting toward outcome-based and theory-based approaches facilitates further conceptual shifts at intraprogram and interprogram and interintervention levels toward more deliberate program development and evaluation, increased program complementarity and subsequent collaboration. It clarifies opportunities for intercalation of continuing professional development with other intervention sciences. The model presents a resource for practitioners, researchers, and policymakers to advance continuing professional development planning, coordination, and evaluation.

Doctors' understanding of their learning and learning needs in Kwazulu-Natal district hospitals

BACKGROUND

 Medicine is a self-regulating profession. Doctors must learn how to self-regulate to keep up-to-date with evolving health care needs. This is challenging for those working at District Hospitals (DHs) in rural settings, where limited resources and understaffing may compound a poor approach and understanding of how to become a self-directed learner.

AIM

 To explore perspectives of doctors working in rural DHs, regarding their understanding of learning and learning needs.

SETTING

 This study was conducted in Bethesda and Mseleni DHs, in rural KwaZulu-Natal.

METHODS

 This was a qualitative study. Data was collected through 16 semi-structured interviews and non-participatory observations.

RESULTS

 Four major themes emerged: "Why I learn," "What I need to learn," "How I learn," and our learning environment." This paper focussed on the first three themes. Doctors' learning is influenced by various factors, including their engagement with clinical practice, personal motivation, and their learning process. Deliberate practice and engagement in reflective practice as key principles for workplace learning became evident.

CONCLUSION

 In rural DHs, doctors need to take a proactive self-regulated approach to their learning due to difficulties they encounter. They must build competence, autonomy, a sense of connection in their learning process, thus recognizing the need for continuous learning, motivating themselves, and understanding where they lack knowledge, all essential for achieving success.Contribution: This article contributes towards strengthening medical education in African rural context, by empowering medical educators and facility managers to meet the learning needs of doctors, thus contributing to the provision of quality health care.

More Than Maintaining Competence: A Qualitative Study of How Physicians Conceptualize and Engage in Lifelong Learning

Purpose

Physicians have a professional responsibility to engage in lifelong learning. Some of this lifelong learning is required to maintain licensure and certification. Yet, this conceptualization captures only a small portion of the content areas and learning processes that physicians need to engage with to ensure quality patient care. Additionally, purposes beyond regulatory requirements and professional obligations likely drive physicians lifelong learning, though these purposes have not been explored. Given the centrality of lifelong learning to quality patient care, our study explores how physicians conceptualize and engage in lifelong learning.

Method

We conducted a qualitative interview study using an interpretivist approach. In 2019, we recruited 34 academic physicians from one institution. We analyzed our data to identify themes related to conceptualization of purposes, content areas, and processes of lifelong learning and actual lifelong learning practices.

Results

We interpreted participants' descriptions and examples of lifelong learning as serving three purposes: maintaining competence, supporting personal growth and fulfillment, and engaging in professional stewardship. Much of participants' discussion of lifelong learning centered around keeping up to date with medical knowledge and clinical/procedural skills, though some also mentioned efforts to improve communication, leadership, and teamwork. Participants engaged in lifelong learning through contextual, social, and individual processes.

Discussion

Academic physicians engage in lifelong learning for reasons beyond maintaining competence. Medical knowledge and clinical/procedural skills receive most attention, though other areas are recognized as important. Our findings highlight opportunities for a broader, more comprehensive approach to lifelong learning that spans all areas of medical practice.

Impact of Longitudinal Mechanical Ventilation Curriculum on Decay of Knowledge

Background

Prior evidence suggests that critical care trainees and attendings may have trouble recognizing common, potentially life-threatening mechanical ventilation (MV) waveform asynchronies. Although dedicated workshops may improve knowledge in MV, this knowledge may be prone to decay over time. Longitudinal, preceptorial-based curriculums may prevent this decay in knowledge.

Objective

To determine if the addition of a year-long, longitudinal MV preceptorial curriculum to a two-part, small-group, simulation-based education block curriculum reduces decay in MV knowledge compared with the education block curriculum alone.

Methods

This was a multicenter prospective cohort study including 123 first-year fellows from 12 critical care fellowship programs who completed a two-part simulation-based education block (control) after the first and sixth months of fellowship. Fellows from one of these programs also participated in a year-long preceptorial curriculum (intervention). MV waveform examination scores over time during fellowship were compared between control versus intervention groups.

Results

Mean test scores increased for both control and intervention groups after the education block courses at Months 1 and 6 of fellowship. Mean (standard deviation) test scores at Month 12 were higher for the intervention group than the control group (89.3 [14.8] vs. 47.7 [21.4]; P < 0.0001). Between 6 months and 3 years of fellowship, there was a significant decay in test scores for the control group (slope estimate [standard error], -13.4 [1.7]; P < 0.0001). However, there was no significant decay in test scores for the intervention group (slope estimate, -2.0 [4.7]; P = 0.67; difference in slope estimates, 11.4 [5.0]; P = 0.02).

Conclusion

The ability of critical care fellows to identify MV waveform asynchronies declines over fellowship training, despite a dedicated two-part, simulation-based MV educational curriculum. The addition of an MV preceptorial course decreased decay of MV knowledge over the course of fellowship training.

Should we add patients in concordance of judgment learning tool panels? - An analysis between patients and primary care physicians

INTRODUCTION

The Concordance of Judgment Learning Tool (CJLT) has been developed for distance asynchronous learning of professionalism in health sciences education. The learning of professionalism is induced by a student's comparison of their own responses with those of the panel members. Whilst CJLT programs typically include same profession experts in their panels, we believe that they could also include patients. Accordingly, we conducted a study aimed at comparing CJLT response patterns between two groups of primary care physicians (PCPs) and patients.

METHODS

We conducted a mixed prospective study of responses to a CJLT program based on a group of PCPs and a group of patients: an analysis of the response patterns of the two groups and a qualitative analysis of justifications.

RESULTS

A total of 110 participants were included in the study: 70 patients and 40 PCPs. We found a significant difference in response patterns between the PCP and patient groups for nine of the fifteen questions (60%). The qualitative analysis of justifications between groups allowed us to comprehend patients' views on the professionalism of PCPs.

CONCLUSIONS

Including patients in CJLT panels can enrich the feedback offered to students in these online training programs.

Assessing clinical reasoning skills following a virtual patient dizziness curriculum

OBJECTIVES

Dizziness is a common medical symptom that is frequently misdiagnosed. While virtual patient (VP) education has been shown to improve diagnostic accuracy for dizziness as assessed by VPs, trainee performance has not been assessed on human subjects. The study aimed to assess whether internal medicine (IM) interns after training on a VP-based dizziness curriculum using a deliberate practice framework would demonstrate improved clinical reasoning when assessed in an objective structured clinical examination (OSCE).

METHODS

All available interns volunteered and were randomized 2:1 to intervention (VP education) vs. control (standard clinical teaching) groups. This quasi-experimental study was conducted at one academic medical center from January to May 2021. Both groups completed pre-posttest VP case assessments (scored as correct diagnosis across six VP cases) and participated in an OSCE done 6 weeks later. The OSCEs were recorded and assessed using a rubric that was systematically developed and validated.

RESULTS

Out of 21 available interns, 20 participated. Between intervention (n=13) and control (n=7), mean pretest VP diagnostic accuracy scores did not differ; the posttest VP scores improved for the intervention group (3.5 [SD 1.3] vs. 1.6 [SD 0.8], p=0.007). On the OSCE, the means scores were higher in the intervention (n=11) compared to control group (n=4) for physical exam (8.4 [SD 4.6] vs. 3.9 [SD 4.0], p=0.003) and total rubric score (43.4 [SD 12.2] vs. 32.6 [SD 11.3], p=0.04).

CONCLUSIONS

The VP-based dizziness curriculum resulted in improved diagnostic accuracy among IM interns with enhanced physical exam skills retained at 6 weeks post-intervention.

Social Dynamics of Advice-Seeking: A Network Analysis of Two Residency Programs

Phenomenon: Residents interact with their peers and supervisors to ask for advice in response to complicated situations occurring during patient care. To provide a deeper understanding of workplace learning, this study explores the structure and dynamics of advice-seeking networks in two residency programs. Approach: We conducted a survey-based social network study. To develop the survey, we conducted focus group discussions and identified three main categories of advice: factual knowledge, clinical reasoning, and procedural skills. We invited a total of 49 emergency medicine and psychiatry residents who had completed at least six months of their training, to nominate their supervisors and peer residents, as their sources of advice, from a roster. Participants identified the number of occasions during the previous month that they turned to each person to seek advice regarding the three broad categories. We calculated the density, centrality, and reciprocity measures for each advice category at each department. Findings: The response rates were 100% (n = 21) and 85.7% (n = 24) in the emergency medicine and psychiatry departments, respectively. The advice network of emergency medicine residents was denser, less hierarchical, and less reciprocated compared to the psychiatry residents' network. In both departments, PGY-1s were the top advice-seekers, who turned to PGY-2s, PGY-3s, and supervisors for advice. The "procedural skills" network had the lowest density in both departments. There was less overlap in the sources of advice for different advice types in the psychiatry department, implying more selectivity of sources. Insights: Complex social structures and dynamics among residents vary by discipline and level of seniority. Program directors can develop tailored educational interventions informed by their departments' specific network patterns to promote a timely and effective advice-seeking culture which in turn, could lead to optimally informed patient care.

Factors Shaping Medical Students' Intentions Toward Neurosurgery: A Cross-Sectional Study

Background Choosing a medical specialty poses a significant challenge for students, with initial fascinations often evolving during their academic journey. Despite its inherent appeal, neurosurgery faces hesitancy among undergraduate students, potentially due to perceived difficulties and time demands. This study aims to investigate the factors influencing medical students' intentions toward neurosurgery at two institutions in the eastern province of Saudi Arabia. Methodology A cross-sectional study design was employed, utilizing a validated, anonymous questionnaire distributed electronically to medical students and interns in the eastern province of Saudi Arabia. The questionnaire comprised two sections, namely, demographic and academic profiles, and participants' intentions, knowledge, and attitudes toward neurosurgery. Data analysis involved descriptive statistics, and chi-square tests to explore relationships and identify significant predictors. Results Of the participants, 197 (34.1%) expressed interest in neurosurgery, but only 94 (16.3%) had a comprehensive understanding of the field. Motivations included high income, specialty prestige, and positive impact on patients, while stress and work-life balance were common deterring factors. Age and academic years were associated with a gradual decrease in interest, except for initial medical school students. Participants were attracted to innovative technological aspects, while high competition and neurophobia were deterring factors. Conclusions This study provides a comprehensive analysis of determinants influencing medical students' and interns' interest in neurosurgery. Early exposure, clinical training, and personal motivations play significant roles in shaping career preferences. Challenges, such as perceived difficulties and concerns related to work-life balance, need targeted interventions to enhance neurosurgery's attractiveness. Considerations extend beyond technical and academic facets to encompass personal and lifestyle dimensions.

Workplace-based learning about health promotion in individual patient care: a scoping review

OBJECTIVE

To outline current knowledge regarding workplace-based learning about health promotion in individual patient care.

DESIGN

Scoping review.

DATA SOURCES

PubMed, ERIC, CINAHL and Web of Science from January 2000 to August 2023.

ELIGIBILITY CRITERIA

We included articles about learning (activities) for healthcare professionals (in training), about health promotion in individual patient care and in the context of workplace-based learning.

DATA EXTRACTION AND SYNTHESIS

The studies were evaluated using a charting template and were analysed thematically using a template based on Designable Elements of Learning Environments model.

RESULTS

From 7159 studies, we included 31 that described evaluations of workplace-based learning about health promotion, around a variety of health promotion topics, for different health professions. In the articles, health promotion was operationalised as knowledge, skills or attitudes related to specific lifestyle factors or more broadly, with concepts such as health literacy, advocacy and social determinants of health. We assembled an overview of spatial and instrumental, social, epistemic and temporal elements of learning environments in which health promotion is learnt.

CONCLUSIONS

The studies included in our analysis varied greatly in their approach to health promotion topics and the evaluation of learning outcomes. Our findings suggest the importance of providing opportunities for health profession learners to engage in authentic practice situations and address potential challenges they may experience translating related theory into practice. Additionally, our results highlight the need for conscious and articulated integration of health promotion in curricula and assessment structures. We recommend the exploration of opportunities for health profession students, professionals and patients to learn about health promotion together. Additionally, we see potential in using participatory research methods to study future health promotion learning.

STUDY REGISTRATION

Open Science Framework, https://doi.org/10.17605/OSF.IO/6QPTV.

Reflecting on insight and insights into reflection: a systematic review of insight and reflection in post graduate medical education

BACKGROUND

Clinicians recognize insight as important for safe independent medical practice. Clinical education literature focuses on self-reflection. The aim of this review is to describe how clinical educators conceptualize reflection and ask is it analogous to how clinicians conceptualize insight?

METHODS

Using PRISMA guidelines, a systematic review of the literature around insight and reflection in postgraduate medical education was undertaken. A thematic analysis of the concepts of insight and reflection was performed.

RESULTS

A total of 75 reports were included in the analysis. The literature focussed predominantly on reflection with little discussion of insight. Three main themes were generated: episodic reflection; cyclic reflection; reflection as a state. Reflection as a state seemed to be the professional quality most often aspired to but was less well defined in terms of educational interventions. When more than one model was described, it was often with a reflective state being the ideal that episodic or cyclic reflection may approximate. It is not clear that it is possible to progress up the hierarchy.

CONCLUSION

We present a novel description of a hierarchy from discrete episodes of reflection, to cyclic processes that involve reflection, through to a state in which the practitioner is reflective. There is no unified understanding of how an individual ascends this hierarchy, or a cohesive description of what insight is for an independent medical practitioner. This review highlights the need for research into how practicing clinicians conceptualize and characterize insight in their training and practice.

Measuring informal workplace learning outcomes in residency training: a validation study

BACKGROUND

Informal workplace learning (WPL) has no concrete learning objective and takes place without a responsible supervisor, which makes it difficult to assess its learning outcomes. Formal learning situations, as they are known from universities or schools, do not exist in this context and make a conventional assessment of learning goals and achievements impossible. Informal learning in the workplace is of central importance, and the assessment of informal learning outcomes in medical education is an under-researched area. The aim of our study was to adapt and validate an informal WPL questionnaire (originally developed for social workers) to assess learning outcomes due to informal WPL in residency training.

METHODS

A total of 528 residents (n = 339 female; age: M = 29.79; SD = 3.37 years) completed an adapted questionnaire on informal WPL outcomes and the Freiburg Questionnaire to Assess Competencies in Medicine (i.e. medical knowledge, communication, and scholarship). Exploratory factor analysis was used to determine the underlying factor structure. The reliability of the factors was tested using McDonald's omega, and the correlation between the factors and the three subscales of the Freiburg questionnaire was tested using Spearman's rho correlation coefficient. To investigate construct validity, a structural equation model was calculated to examine the relationships between medical competencies and informal learning outcomes.

RESULTS

The exploratory factor analysis yielded a four-factor solution that best fit the data. The scores of all four factors (GLO-CD: generic learning outcomes-competence development, GLO-R: generic learning outcomes-reflection, JSLO: job-specific learning outcomes, and OLLO: organisational learning outcomes) showed good internal consistency (Ω ≥ .69). The structural equation model showed that "medical expertise" had an impact on all four factors of informal learning at work. "Scholarship" seemed to predict GLO-CD and GLO-R.

CONCLUSIONS

Our four-factor model reveals meaningful determinants of informal WPL in relation to residency training. The instrument is therefore the first promising attempt to assess informal WPL in the broader context of medical education during residency, thus supporting its construct validity.

"We don't need no education" - a qualitative study of barriers to continuous medical education among Danish general practitioners

BACKGROUND

Continuous medical education is essential for the individual patient care, the society, and the wellbeing of the general practitioner. There has been research into the reasons for participation in continuous medical education, but little is known about the barriers to participation. To tailor continuous medical education targeting general practitioners who are currently deselecting education, systematic knowledge of the barriers is needed. Continuous medical education can in addition to professional growth stimulate job satisfaction, diminish burnout, and reinforce feelings of competence. Continuous medical education may have positive implications for patients and for healthcare expenditures. Despite renumeration and a comprehensive continuous education model some Danish general practitioners do not participate in continuous medical education.

METHODS

From a total of 3440 Danish general practitioners 243 did not apply for reimbursement for accredited continuous medical education in a two-year period. Ten general practitioners were selected for an interview regarding maximum variation in practice form, number of listed patients, seniority as a general practitioner, geography, gender, and age. All ten selected general practitioners accepted to be interviewed. The interviews were analysed using Systematic Text Condensation.

RESULTS

Each of the ten interviewed general practitioners mentioned several barriers for participating in continuous education. The barriers fell into three main categories: barriers related to the individual general practitioner barriers related to the clinic barriers related to the accredited continuous medical education offered CONCLUSIONS: Approximately 7% of the Danish general practitioners did not participate in accredited remunerated continuous medical education. A knowledge of the barriers for participating in accredited continuous medical education can be used to better target continuous medical education to the general practitioners.

Academic half days, noon conferences and classroom-based education in postgraduate medical education: a scoping review

BACKGROUND

Classroom-based education (CBE) is ubiquitous in postgraduate medical education (PGME), but to date no studies have synthesized the literature on the topic. We conducted a scoping review focusing on academic half days and noon conferences.

METHODS

We searched 4 databases (MEDLINE [OVID], Embase [OVID], ERIC [EBSCO] and Web of Science) from inception to December 2021, performed reference and citation harvesting, and applied predetermined inclusion and exclusion criteria to our screening. We used 2 frameworks for the analysis: "experiences, trajectories and reifications" and "description, justification and clarification."

RESULTS

We included 90 studies, of which 55 focused on resident experiences, 29 on trajectories and 6 on reification. We classified 44 studies as "description," 38 as "justification" and 8 as "clarification." In the description studies, 12 compared academic half days with noon conferences, 23 described specific teaching topics, and 9 focused on resources needed for CBE. Justification studies examined the effects of CBE on outcomes, such as examination scores (17) and use of teaching strategies in team-based learning, principles of adult learning and e-learning (15). Of the 8 clarification studies, topics included the role of CBE in PGME, stakeholder perspectives and transfer of knowledge between classroom and workplace.

INTERPRETATION

Much of the existing literature is either a description of various aspects of CBE or justification of particular teaching strategies. Few studies exist on how and why CBE works; future studies should aim to clarify how CBE facilitates resident learning within the sociocultural framework of PGME.

Augmented Reality in Medical Education: A Mixed Methods Feasibility Study

BACKGROUND

Augmented reality (AR) is a novel technology with many applications in medical education. Perhaps one of the most beneficial potential applications is to enable better clinical access for students; however, there is limited research into this use. The purpose of this mixed-methods feasibility study was to evaluate the applicability and acceptability of AR in undergraduate and early postgraduate medical education.

METHODS

Single-group quasi-experimental study design was developed for critical care-themed simulation teaching delivered using Microsoft HoloLens (Microsoft Corporation, Redmond, Washington, United States). Post-test questionnaires were completed including a validated adapted immersive experience questionnaire (AIEQ) and an abridged intrinsic motivation inventory (AIMI). The AIMI focused on the domains of 'interest and enjoyment', and 'value and usefulness'. Following the teaching, focus group interviews with thematic analysis were conducted to evaluate participants' experiences with AR.

RESULTS

All 15 participants (100%) completed the AIEQ and AIMI. Co-located airway teaching (i.e., the demonstrator and participants were placed in the same AR environment) was reported as having a moderate level of user immersion (median 72) and a high level of user enjoyment and value (median 52). Thematic analysis revealed four key themes: visual conceptualization for learning, accessibility, varied immersion, and future application.  Conclusions: Remote simulation for the management of airways in critical care was found to be acceptable and afforded a high level of enjoyment and value. Similarly, this was reflected in the thematic analysis. However, immersion was rated variably in both AIEQ and thematic analysis. The challenges identified with the application of AR included technical infrastructure and patient consent. AR-enabled education benefits are relevant to a number of clinical teaching areas.

Surgical residents' approach to training: are elements of deliberate practice observed?

Background: Deliberate practice research has consistently shown that intense, concentrated, goal-oriented practice in a focused domain, such as medicine, can improve skill development and performance. To date, little is known about how surgical residents approach their surgical training, how they evaluate their current weaknesses, and how they plan to transition from one milestone to another. Without knowledge of residents' role in their development, educators miss the opportunity to optimize progression of these lifelong learning skills. Therefore, the purpose of this study was to gain a better understanding of how surgical residents approach their surgical training from the perspective of the surgical residents themselves and to explore if elements of deliberate practice are observed. Methods: Eight surgical trainees participated in one of two focus groups depending on their training level (five junior residents; three senior residents). With the exploratory nature of this research, a focus group methodology was utilized. Results: By employing both deductive and inductive thematic analysis techniques, three themes were extracted from the data: learning resources and strategies, role of a junior/senior, and approaching weaknesses. Conclusions: Although elements of deliberate practice were discussed, higher functioning is necessary to achieve performance excellence, leading to improved patient outcomes.

Surgical residents’ approach to training: are elements of deliberate practice observed?

Background: Research in the area of deliberate practice has consistently shown that intense, concentrated, goal-oriented practice in a focused domain, such as medicine, can improve both skill development and performance to attain a progressively higher standard of excellence. In theory, utilizing deliberate practice in a medical context could result in improved surgical training and in turn better patient outcomes. Therefore, the purpose of this study was to gain a better understanding of how surgical residents approach their training from the perspective of the surgical residents themselves and to explore if elements of deliberate practice are observed. Methods: Eight surgical trainees participated in one of two focus groups depending on their training level (five junior residents; three senior residents). With the exploratory nature of this research, a focus group methodology was utilized. Results: By employing both deductive and inductive thematic analysis techniques, three themes were extracted from the data: learning resources and strategies, role of a junior/senior, and approaching weaknesses. Conclusions: Although elements of deliberate practice were discussed, higher functioning is necessary to achieve performance excellence, leading to improved patient outcomes.

The Effect of Anonymity on Quality of Resident Feedback

OBJECTIVE

Quality feedback is critical to facilitate better performance and quicker learning. However, faculty may be hesitant to provide quality constructive feedback, especially in written form, due to fear of retaliation. We evaluated the impact of faculty anonymity on the quality of faculty-to-resident feedback.

DESIGN

A retrospective review was undertaken of faculty evaluation of resident performance from 2017 to 2018, when evaluations were identifiable, compared to 2018-2019, when evaluations were anonymous. Evaluations included 27 individual items with Likert type scoring and 2 open-ended questions. Open-ended responses and overall performance were de-identified and scored by 2 reviewers independently using the task, performance gap, action scoring model. Comparisons between groups were performed with the Wilcoxon-Mann-Whitney test.

SETTING

Tertiary Care Institution, University of Michigan, Ann Arbor, MI PARTICIPANTS: 415 resident performance evaluations were available for analysis with 251 in the identifiable group and 164 in the anonymous group.

RESULTS

The average composite score for the identifiable group was 105.2 and 103.4 in the anonymous group (p = 0.22). The effect size of the impact on composite score was small (Cohen's d 0.084, 95% CI -0.11-0.28). There was excellent inter-rater reliability. There were no differences between feedback groups for any of the 3 components of task, performance gap, and action model. While average scores for all 3 components were low, action scores were lowest.

CONCLUSIONS

Anonymity did not significantly impact faculty evaluations of resident performance. The quality of open-ended feedback on written evaluations was generally poor, especially in identifying actions for continued performance improvement. Additional mechanisms to improve feedback quality should be sought.

Coaching the Fundamentals: Exploring the Applicability and Usefulness of a Novel Skills-Based Feedback Modality

OBJECTIVE

Receiving and integrating feedback is a key to medical trainee development. To assist trainees seeking improvement through daily formative feedback and deliberate practice, the authors created a new skills-based framework called microskills, derived from the Accreditation Council for Graduate Medical Education (ACMGE) milestones and entrustable professional activities. The authors then explored pediatric resident perceptions around the applicability and usefulness of microskills.

METHODS

The authors conducted 4 qualitative semistructured focus groups of 28 pediatric residents. Focus group prompts asked participants to reflect on microskills as a new feedback modality and microskills in relation to existing feedback and assessment approaches. Focus group transcripts were analyzed through inductive thematic analysis through an iterative process until theoretical saturation was reached.

RESULTS

Participants felt microskills could facilitate skill-building and improvement, allow for consistent, targeted feedback, and establish a practice of coaching. Participants also perceived microskills' future success to be dependent on how the modality is adopted and utilized alongside existing assessment tools.

CONCLUSIONS

Trainees found microskills to be a granular, context-based, coaching tool that could improve skill-building and the feedback process. Microskills' emphasis on feedback and their delineation of clinical skills that can be repeatedly practiced has the potential to provide a roadmap for trainee growth. Though microskills could fill a current need in the medical training landscape, they are not a substitute for existing assessment frameworks.

Practical Strategies and Tools for Use by Occupational and Environmental Medicine Departments During COVID-19 Pandemic Surges

OBJECTIVES

Occupational and environmental medicine (OEM) departments in healthcare institutions can be quickly overwhelmed when COVID-19 infection rates rapidly and simultaneously increase in the workforce and the patients served. Our goal is to present a detailed toolkit of practical approaches for use by front-line OEM specialists to address workforce management tasks during pandemic surges.

METHODS

Specific focus is on tasks related to employee symptom triage, exposure risk assessment, workplace contact tracing, and work restrictions.

RESULTS

Tools include strategies used by customer call centers, two decision support algorithms (exposure due to cohabitation or non-cohabitation), a color-coded employee case tracking tool, a contact tracing protocol, and documentation templates that serve as memory aids for encounters.

CONCLUSIONS

These tools are created with commonly used software. Implementation is feasible in most front-line OEM settings, including those with limited resources.

Leveraging Technology to Overcome the "Scalability Problem" in Communication Skills Training Courses

Although multiple consensus statements have called for large-scale efforts to improve clinicians’ communication skills regarding a variety of difficult conversations in medicine, this goal will be difficult to attain because there are no readily scalable, validated communication skills training programs for clinicians. However, novel applications of existing technologies and approaches grounded in learning science can overcome the scalability barriers. Moreover, future advances in virtual reality and artificial intelligence are likely to greatly enhance the possibilities for communication skills training programs. The purpose of this paper is to propose a scalable, theoretically grounded method to train clinicians in advanced communication skills in medicine. First, we summarize four key principles of adult learning relevant to communication skills training in medicine. Second, we discuss recommended practices to design effective technology-enhanced educational interventions, with an emphasis on achieving high amounts of user engagement. Third, we synthesize these principles into a framework for a web- and videoconference-based platform for teaching advanced communication skills in medicine. Once developed, this low-cost, scalable training platform has the potential to allow thousands of clinicians to acquire the advanced communication skills needed for difficult conversations in medicine.

The Role of the Chief Resident in Promoting Health Equity

Drawing on recent experiences as a Chief Resident, the author proposes several strategies for promoting health equity. Challenges to this task are highlighted. The Chief Resident's ability to bypass these obstacles and construct experiences that promote long-term change is explored through the framework of the formal, informal, and hidden curricula. The strategic use of didactic conferences, role-modeling, and personnel decisions are emphasized.

Embracing complexity with systems thinking in general practitioners' clinical reasoning helps handling uncertainty

Clinical reasoning in general practice is increasingly challenging because of the rise in the number of patients with multimorbidity. This creates uncertainty because of unpredictable interactions between the symptoms from multiple medical problems and the patient's personality, psychosocial context and life history. Case analysis may then be more appropriately managed by systems thinking than by hypothetic-deductive reasoning, the predominant paradigm in the current teaching of clinical reasoning. Application of "systems thinking" tools such as causal loop diagrams allows the patient's problems to be viewed holistically and facilitates understanding of the complex interactions. We will show how complexity levels can be graded in clinical reasoning and demonstrate where and how systems thinking can have added value by means of a case history.

Purpose, Pleasure, Pace and Contrasting Perspectives: Teaching and Learning in the Emergency Department

OBJECTIVES

Teaching and learning in the clinical setting are vital for the training and development of emergency physicians. Increasing service provision and time pressures in the emergency department (ED) have led to junior trainees' perceptions of a lack of teaching and a lack of support during clinical shifts. We sought to explore the perceptions of learners and supervisors in our ED regarding teaching within this diverse and challenging context.

METHODS

Nine ED physicians and eight ED trainees were interviewed to explore perceptions of teaching in the ED. Clinical teaching was described as "on-the-floor" teaching during work shifts. We used a validated clinical teaching assessment instrument to help pilot and develop some of our interview questions, and data were analyzed using qualitative thematic analysis.

RESULTS

We identified three major themes in our study: 1) the strong sense of purpose and the pleasure gained through teaching and learning interactions, despite both groups being unsure of each other's engagement and enthusiasm; 2) contrasting perspectives of teaching with registrars holding a traditional knowledge transmission view, yet shared perspectives of teacher as being ED consultants; and 3) the effect of patient acuity and volume, which both facilitated learning until a critical point of busyness beyond which service provision pressures and staffing limitations were perceived to negatively impact learning.

CONCLUSIONS

The ED is a complex and fluid working and learning environment. We need to develop a shared understanding of teaching and learning opportunities in the ED, which helps all stakeholders move beyond learning as knowledge acquisition and sees the potential for learning from teachers of a multitude of professional backgrounds.

Real-world virtual patient simulation to improve diagnostic performance through deliberate practice: a prospective quasi-experimental study

OBJECTIVES

Diagnostic errors are pervasive in medicine and most often caused by clinical reasoning failures. Clinical presentations characterized by nonspecific symptoms with broad differential diagnoses (e.g., dizziness) are especially prone to such errors.

METHODS

We hypothesized that novice clinicians could achieve proficiency diagnosing dizziness by training with virtual patients (VPs). This was a prospective, quasi-experimental, pretest-posttest study (2019) at a single academic medical center. Internal medicine interns (intervention group) were compared to second/third year residents (control group). A case library of VPs with dizziness was developed from a clinical trial (AVERT-NCT02483429). The approach (VIPER - Virtual Interactive Practice to build Expertise using Real cases) consisted of brief lectures combined with 9 h of supervised deliberate practice. Residents were provided dizziness-related reading and teaching modules. Both groups completed pretests and posttests.

RESULTS

For interns (n=22) vs. residents (n=18), pretest median diagnostic accuracy did not differ (33% [IQR 18-46] vs. 31% [IQR 13-50], p=0.61) between groups, while posttest accuracy did (50% [IQR 42-67] vs. 20% [IQR 17-33], p=0.001). Pretest median appropriate imaging did not differ (33% [IQR 17-38] vs. 31% [IQR 13-38], p=0.89) between groups, while posttest appropriateness did (65% [IQR 52-74] vs. 25% [IQR 17-36], p<0.001).

CONCLUSIONS

Just 9 h of deliberate practice increased diagnostic skills (both accuracy and testing appropriateness) of medicine interns evaluating real-world dizziness 'in silico' more than ∼1.7 years of residency training. Applying condensed educational experiences such as VIPER across a broad range of common presentations could significantly enhance diagnostic education and translate to improved patient care.

High-Value, Cost-Conscious Care Attitudes in the Graduate Medical Education Learning Environment: Various Stakeholder Attitudes That Residents Misjudge

BACKGROUND

Training residents in delivering high-value, cost-conscious care (HVCCC) is crucial for a sustainable healthcare. A supportive learning environment is key. Yet, stakeholders' attitudes toward HVCCC in residents' learning environment are unknown.

OBJECTIVE

We aimed to measure stakeholders' HVCCC attitudes in residents' learning environment, compare these with resident perceptions of their attitudes, and identify factors associated with attitudinal differences among each stakeholder group.

DESIGN

We conducted a cross-sectional survey across the Netherlands between June 2017 and December 2018.

PARTICIPANTS

Participants were 312 residents, 305 faculty members, 53 administrators, and 1049 patients from 66 (non)academic hospitals.

MAIN MEASURES

Respondents completed the Maastricht HVCCC Attitude Questionnaire (MHAQ), containing three subscales: (1) high-value care, (2) cost incorporation, (3) perceived drawbacks. Additionally, resident respondents estimated the HVCCC attitudes of other stakeholders, and answered questions on job demands and resources. Univariate and multivariate analyses were used to analyze data.

KEY RESULTS

Attitudes differed on all subscales: faculty and administrators reported more positive HVCCC attitudes than residents (p ≤ 0.05), while the attitudes of patients were less positive (p ≤ 0.05). Residents underestimated faculty's (p < 0.001) and overestimated patients' HVCCC attitudes (p < 0.001). Increasing age was, among residents and faculty, associated with more positive attitudes toward HVCCC (p ≤ 0.05). Lower perceived health quality was associated with less positive attitudes among patients (p < 0.001). The more autonomy residents perceived, the more positive their HVCCC attitude (p ≤ 0.05).

CONCLUSIONS

Attitudes toward HVCCC vary among stakeholders in the residency learning environment, and residents misjudge the attitudes of both faculty and patients. Faculty and administrators might improve their support to residents by more explicitly sharing their thoughts and knowledge on HVCCC and granting residents autonomy in clinical practice.

Students’ experiences of study-related exhaustion, regulation of learning, peer learning and peer support during university studies

The present mixed-method longitudinal study examines students’ experiences of study-related exhaustion, regulation of learning, peer learning and peer support during university studies. At the first measurement point, 188 first-year students completed the questionnaire. At the second measurement point, 91 of the 188 students participated in the follow-up study at their fourth study year and completed the same questionnaire again. Of these, twelve students were interviewed. The results showed that experienced study-related exhaustion and self-regulation of content increased during studies. However, the results also showed a large individual variation in experienced study-related exhaustion. The students whose exhaustion decreased described experiences of peer support that helped them to develop their self-regulation skills. Students whose study-related exhaustion remained low evaluated their self-regulation skills as good. They experienced that they did not need other students’ support in the regulation of learning. The students whose study-related exhaustion increased or remained high described more problems in self-regulation. Most students relied on peer support because of self-regulation problems. However, not all students used other students’ support despite of problems in studying. It can be concluded that regulation skills have a key role in experienced study-related exhaustion during studies.

Competencies to promote collaboration between primary and secondary care doctors: an integrative review

Background

In a society where ageing of the population and the increasing prevalence of long-term conditions are major issues, collaboration between primary and secondary care is essential to provide continuous, patient-centred care. Doctors play an essential role at the primary-secondary care interface in realising ‘seamless’ care. Therefore, they should possess collaborative competencies. However, knowledge about these collaborative competencies is scarce. In this review we explore what competencies doctors need to promote collaboration between doctors at the primary-secondary care interface.

Methods

We conducted an integrative literature review. After a systematic search 44 articles were included in the review. They were analysed using a thematic analysis approach.

Results

We identified six themes regarding collaborative competencies: ‘patient-centred care: a common concern’, ‘roles and responsibilities’, ‘mutual knowledge and understanding’, ‘collaborative attitude and respect’, ‘communication’ and ‘leadership’. In every theme we specified components of knowledge, skills and attitudes as found in the reviewed literature. The results show that doctors play an important role, not only in the way they collaborate in individual patient care, but also in how they help shaping organisational preconditions for collaboration.

Conclusions

This review provides an integrative view on competencies necessary for collaborative practice at the primary-secondary care interface. They are part of several domains, showing the complexity of collaboration. The information gathered in this review can support doctors to enhance and learn collaboration in daily practice and can be used in educational programmes in all stages of medical education.

Learning in the workplace: Use of informal feedback cues in doctor-patient communication

OBJECTIVES

We expect physicians to be lifelong learners. Participation in clinical practice is an important potential source of that learning. To support physicians in this process, a better understanding of how they learn in clinical practice is necessary. This study investigates how physicians recognise and use informal feedback from interactions with patients in outpatient settings as learning cues to adjust their communication behaviours in daily practice.

METHODS

To understand physicians' use of informal feedback, we combined non-participant observations with semi-structured interviews. We enrolled 10 respiratory physicians and observed 100 physician-patient interactions at two teaching hospitals in the Netherlands. Data collection and analysis were performed iteratively according to the principles of constructivist grounded theory.

RESULTS

Following stages of open, axial and selective coding, we were able to conceptualise how physicians use cues to reflect on and adjust their communication. In addition to vast variations within and across patient encounters, we observed recurring adjustments in physicians' communication behaviours in response to specific informal feedback cues. Physicians recognised and used these cues to self-monitor communication performance. They had established 'communication repertoires' based on multiple patient interactions, which many saw as learning opportunities contributing to the development of expertise. Our findings, however, show differences in physicians' individual levels of sensitivity in recognising and using learning opportunities in daily practice, which were further influenced by contextual, personal and interpersonal factors. Whereas some described themselves as having little inclination to change, others used critical incidents to fine-tune their communication repertoires, and yet others constantly reshaped them, seeking learning opportunities in their daily work.

CONCLUSIONS

There is large variation in how physicians use learning cues from daily practice. To enhance learning in and from daily practice, we propose turning workplace learning into a collaborative effort with the aim of increasing awareness and the use of informal performance-relevant feedback.

Implementing a Practical Global Health Curriculum: The Benefits and Challenges of Patient-Based Learning in the Community

Background: A growing number of medical schools across the world have incorporated global health (GH) into their curricula. While several schools focus GH education on lecture-based courses, our premise is that global health education should embody a holistic approach to patient care and medical education in local communities. Medical students may learn global health by focusing on real patients, their families and communities as part of a practical curriculum.

Aims and Objectives: A unique GH curriculum was devised to compare student learning outcomes on a practical vs. lecture-based course. The premise was that learning from patients would result in a greater breadth of coverage of the global health syllabus as compared to that from a lecture-based course.

Methods: A teaching and learning program was developed over 3 years to provide medical students interaction with real patients in the community on a first-preclinical-year Introduction to Global Health and Medical Anthropology course. Learning outcomes on the practical vs. lecture-based course were compared using thematic analysis of the written assignments of both courses: global health case reports and literature reviews, respectively. All members of three cohorts of students undertaking the course in successive academic years were compared (Group A: literature review; Groups B and C: case reports; n = 87).

Results: Case reports provided evidence of a greater breadth of learning outcomes when compared to the literature review (p < 0.001). The writing of the case report was enhanced by completion of a field journal and family health needs assessment tool (p < 0.001). Students demonstrated a closeness to their patients that added depth, understanding and motivation to assist patients in health activities and advocate for their needs.

Discussion: Placements with patients in the community provided students with a rich learning environment and facilitated the formation of relationships with patients to better understand the social determinants of health and advocate for improvements in their living and working conditions and access to healthcare.

Conclusions: Global health may be better learned experientially by following patients rather than from frontal lectures. Patient-based learning inspires a commitment to the individual and facilitates medical schools in meeting their obligations to the communities they serve.

GP trainees' perceptions on learning EBM using conversations in the workplace: a video-stimulated interview study

BACKGROUND

To be able to practice evidence-based medicine (EBM) when making decisions for individual patients, it is important to learn how to combine the best available evidence with the patient's preferences and the physician's clinical expertise. In general practice training, these skills can be learned at the workplace using learning conversations: meetings between the supervising general practitioner (GP) and GP trainee to discuss medical practice, selected topics or professional performance. This study aimed to give insight into the perceptions of GP trainees on their EBM learning processes during learning conversations.

METHODS

We held semi-structured video-stimulated elicitation interviews (n = 22) with GP trainees affiliated to GP training institutes in the Netherlands and Belgium. GP trainees were shown fragments of their learning conversations, enabling reflection during the interview. Taking an inductive approach, interview recordings were transcribed verbatim and analysed with NVivo software.

RESULTS

GP trainees perceived learning conversations as useful for learning and discussing EBM. Multiple EBM learning activities were identified, such as discussing evidence together, relating evidence to cases in daily practice and discussing the supervisor's experience and the specific local context in the light of what the evidence recommends. However, for learning to occur, trainees need and expect specific behaviour, both from their supervisors and themselves. Supervisors should supply well-substantiated answers that are applicable in practice and give the trainee confirmation. In turn, the trainee needs to prepare well in order to ask focused, in-depth questions. A safe space allowing equal and open discussion between trainee and supervisor is perceived as an essential context for optimal EBM learning.

CONCLUSIONS

Our findings show that trainees find learning conversations useful for EBM learning in general practice. To bring EBM learning to its full potential, attention should be paid to optimising the behavioural and contextual factors found relevant to enhancing EBM learning.

Service Requirements of Liver Transplant Anesthesia Teams: Society for the Advancement of Transplant Anesthesia Recommendations

There are disparities in liver transplant anesthesia team (LTAT) care across the United States. However, no policies address essential resources for liver transplant anesthesia services similar to other specialists. In response, the Society for the Advancement of Transplant Anesthesia appointed a task force to develop national recommendations. The Conditions of Transplant Center Participation were adapted to anesthesia team care and used to develop Delphi statements. A Delphi panel was put together by enlisting 21 experts from the fields of liver transplant anesthesiology and surgery, hepatology, critical care, and transplant nursing. Each panelist rated their agreement with and the importance of 17 statements. Strong support for the necessity and importance of 13 final items were as follows: resources, including preprocedure anesthesia assessment, advanced monitoring, immediate availability of consultants, and the presence of a documented expert in liver transplant anesthesia credentialed at the site of practice; call coverage, including schedules to assure uninterrupted coverage and methods to communicate availability; and characteristics of the team, including membership criteria, credentials at the site of practice, and identification of who supervises patient care. Unstructured comments identified competing time obligations for anesthesia and transplant services as the principle reason that the remaining recommendations to attend integrative patient selection and quality review committees were reduced to a suggestion rather than being a requirement. This has important consequences because deficits in team integration cause higher failure rates in service quality, timeliness, and efficiency. Solutions are needed that remove the time-related financial constraints of competing service requirements for anesthesiologists. In conclusion, using a modified Delphi technique, 13 recommendations for the structure of LTATs were agreed upon by a multidisciplinary group of experts.

Applying Educational Theory and Best Practices to Solve Common Challenges of Simulation-based Procedural Training in Emergency Medicine

OBJECTIVES

Procedural competency is an essential prerequisite for the independent practice of emergency medicine. Multiple studies demonstrate that simulation-based procedural training (SBPT) is an effective method for acquiring and maintaining procedural competency and preferred over traditional paradigms ("see one, do one, teach one"). Although newer paradigms informing SBPT have emerged, educators often face circumstances that challenge and undermine their implementation. The goal of this paper is to identify and report on best practices and theory-supported solutions to some of these challenges as derived using a process of expert consensus building and reviews of the existing literature on SBPT.

METHODS

The Society for Academic Emergency Medicine (SAEM) Simulation Academy SBPT Workgroup convened approximately 8 months prior to the 2019 SAEM Annual Meeting to perform a review of the literature and participate in a consensus-building process to identify solutions (in the form of best practices and educational theory) to these challenges faced by educators engaging in SBPT.

RESULTS AND ANALYSIS

Thirteen distinct educational challenges to SBPT emerged from the expert group's primary literature reviews and consensus-building processes. Three domains emerged upon further analysis of the 13 challenges: learner, educator, and curriculum. Six challenges within the "learner" domain were selected for comprehensive discussion in this paper, as they were deemed representative of the most common and most significant threats to ideal SBPT. Each of the six challenges aligns with one of the following themes: 1) maximizing active learning, 2) maintaining learner engagement, 3) embracing learner diversity, 4) optimizing cognitive load, 5) promoting mindfulness and reflection, and 6) emphasizing deliberate practice for mastery learning. Over 20 "special treatments" for mitigating the impact of the 13 challenges were derived from the secondary literature search and consensus-building process prior to and during the preconference workshop; 11 of these that best address the six learner-centered challenges are explored, including implications for educators involved in SBPT.

CONCLUSIONS/IMPLICATIONS FOR EDUCATORS

We propose multiple consensus-generated solutions (in the form of best practices and applied educational theory) that we believe are suitable and well aligned to overcome commonly encountered learner-centered challenges and threats to optimal SBPT.

Using the Modified Delphi Method to Develop a Tool to Assess Pediatric Residents Supervising on Inpatient Rounds

BACKGROUND

Consensus about behaviors that define effective supervision by residents of more junior trainees on pediatric inpatient rounds is lacking.

OBJECTIVE

Use modified Delphi method to develop a checklist of essential supervisory behaviors pediatric residents demonstrate while leading inpatient, non-ICU, nonspecialty teaching rounds and pilot the checklist.

DESIGN/METHODS

One hundred and forty-one initial candidate behaviors were identified through literature review and narrowed by local stakeholders. Forty-one behaviors were submitted to national experts identified through purposive sampling to be refined using the modified Delphi method. Participants indicated agreement with behaviors' inclusion in the checklist and whether any were nonobservable. Measures of central tendency and dispersion were used to identify consensus with a behavior's inclusion in the next cycle. A criterion was eliminated if >25% of experts felt it was not observable. Cycles continued until consensus was reached on ≤20 behaviors. The resulting checklist was piloted at 2 hospitals.

RESULTS

After 2 modified Delphi cycles, consensus was obtained on 18 behaviors for inclusion in the final checklist. These were spread across 3 subcategories: teaching, leadership, and patient safety. In the pilot, the checklist of behaviors discriminated between residents with differing levels of competency in supervising trainees on inpatient rounds. For residents who had the checklist completed by 2 faculties, there was 75% agreement in behaviors observed.

CONCLUSION(S)

Based on literature review, local stakeholder input, and consensus of national experts through the modified Delphi method, we created and piloted a checklist of observable behaviors characteristic of effective clinical supervision by pediatric residents leading trainee teams on inpatient, non-ICU, nonspecialty rounds.

Digitalization and Physician Learning: Individual Practice, Organizational Context, and Social Norm

INTRODUCTION

The emerging context of online platforms and digitally engaged patients demands new competencies of health care professionals. Although information and communication technologies (ICTs) can strengthen continuous professional development (CPD) and learning at work, more research is needed on ICT for experiential and collegial learning.

METHODS

The study builds on prior qualitative research to identify issues and comprises a quantitative assessment of ICT usage for learning in health care. A survey was administered to Swedish physicians participating in a CPD program as part of specialist medical training. Conclusions focused specifically on learning dimensions are drawn from correlation analyses complemented with multiple regression.

RESULTS

The findings show that physicians' actual use of ICT is related to perceived performance, social influence, and organizational context. Social norm was the most important variable for measured general usage, whereas performance expectancy (perceived usefulness of ICT) was important for ICT usage for learning. The degree of individual digitalization affects performance and, in turn, actual use.

DISCUSSION

The study highlights the need to incorporate ICT effectively into CPD and clinical work. Besides formal training and support for specific systems, there is a need to understand the usefulness of digitalization integrated into practice. Moving beyond instrumentalist views of technology, the model in this study includes contextualized dimensions of ICT and learning in health care. Findings confirm that medical communities are influencers of use, which suggests that an emphasis on collegial expectations for digital collaboration will enhance practitioner adaptation.

Beyond 'driving': The relationship between assessment, performance and learning

OBJECTIVE

Is the statement 'assessment drives learning' a myth?

BACKGROUND

Instructors create assessments and students respond to these assessments. Although such responses are often labelled indications of learning, the responses educators observe can also be considered a performance. When responses are aligned with generating stable changes, then assessment drives learning. When responses are not aligned with stable changes, we must consider them to be something else: a performance put on partially or fully for the sake of implying capability rather than actual learning. The alignment between the assessments educators create and the way students respond to these assessments is determined by the actions students take in our curriculum, in preparation for our assessments and after engaging with our assessments.

CONCLUSIONS

Not all assessments need to or should support learning, but when we assume all assessments 'drive learning', we endorse the myth that assessment is necessarily a formative aspect of our curricula. When we create assessments that encourage performance activities such as cramming, competing for tutorial airtime and impression management in the clinical setting we drive students to a performance. By thinking about how our students, institutions, curricula and assessments support learning and how well they support performance, we can modify and more fully align our curricular and assessment efforts to support learners in achieving their (and our) desired outcome. So, is the phrase 'assessment drives learning' a myth? This paper will conclude that it often is but we as educators must, through our leadership, move this myth towards a reality.

Professionals' perspectives on factors affecting GP trainees' patient mix: results from an interview and focus group study among professionals working in Dutch general practice

INTRODUCTION

Seeing and treating patients in daily practice forms the basis of general practitioner (GP) training. However, the types of patients seen by GP trainees do not always match trainees' educational needs. Knowledge about factors that shape the mix of patient types is limited, especially with regard to the role of the professionals who work in the GP practice.

AIM

We investigated factors affecting the mix of patients seen by GP trainees from the perspective of professionals.

DESIGN AND SETTING

This qualitative study involved GP trainees, GP supervisors, medical receptionists and nurse practitioners affiliated with a GP Specialty Training Institute in the Netherlands.

METHODS

Twelve focus groups and seven interviews with 73 participants were held. Data collection and analysis were iterative, using thematic analysis with a constant comparison methodology.

RESULTS

The characteristics of patients' health problems and the bond between the doctor and patient are important determinants of GP trainees' patient mix. Because trainees have not yet developed bonds with patients, they are less likely to see patients with complex health problems. However, trainees can deliberately influence their patient mix by paying purposeful attention to bonding with patients and by gaining professional trust through focused engagement with their colleagues.

CONCLUSION

Trainees' patient mix is affected by various factors. Trainees and team members can take steps to ensure that this mix matches trainees' educational needs, but their success depends on the interaction between trainees' behaviour, the attitudes of team members and the context. The findings show how the mix of patients seen by trainees can be influenced to become more trainee centred and learning oriented.

How Physicians Prepare for Maintenance of Certification Exams: A Qualitative Study

PURPOSE

Little is known about how board-certified physicians prepare for their periodic maintenance of certification (MOC) examinations. This qualitative study explores how physicians experience MOC exam preparation: how they prepare for the exams and decide what to study and how exam preparation compares with what they normally do to keep their medical knowledge current.

METHOD

Between September 2016 and March 2017, the authors interviewed 80 primary care physicians who had recently taken either the American Board of Family Medicine or American Board of Internal Medicine MOC exam. They analyzed transcripts and notes from these interviews looking for patterns and emergent themes, using the constant comparative method and a social practice theory perspective.

RESULTS

Most interviewees studied for their MOC exams by varying from their routines for staying current with medical knowledge, both by engaging with a different scope of information and by adopting different study methods. Physicians described exam preparation as returning to a student/testing mindset, which some welcomed and others experienced negatively or with ambivalence.

CONCLUSIONS

What physicians choose to study bounds what they can learn from the MOC exam process and, therefore, also bounds potential improvements to their patient care. Knowing how physicians actually prepare, and how these activities compare with what they do when not preparing for an exam, can inform debates over the value of requiring such exams, as well as conversations about how certification boards and other key stakeholders in physicians' continuing professional development could improve the MOC process.

Clinical Improvement Interventions for Residents and Practicing Physicians: A Scoping Review of Coaching and Mentoring for Practice Improvement

BACKGROUND

Graduate medical education (GME) bodies are beginning to mandate coaching as an integral part of the learning process, in addition to current requirements for mentorship. Once an emergency medicine physician transitions beyond graduate training, there is no requirement and little focus on coaching as a method of improving or maintaining clinical practice. Our objective was to understand and describe the current state of the published literature with regard to the use of coaching and mentorship for both GME and practicing physicians.

METHODS

We conducted a structured review of the literature through PubMed and Google Scholar and included all articles applying coaching or mentorship modalities to GME trainees or practicing physicians. A Google Form was used for standardized data abstraction. Data were collected pertaining to the settings of intervention, the nature of the intervention, its effect, and its resource requirements.

RESULTS

A total of 3,546 papers were isolated during the literature review. After exclusion, 186 underwent full-text review by the authors of which 126 articles were included in the final data analysis. Eighty-two articles (65%) pertained to mentorship and 14 (11%) to coaching; the remainder of the articles discussed a combination or variation of these two concepts. Fifty-three (42%) articles were descriptive studies and 35 (28%) were narrative reviews or commentaries. Forty-seven (37%) articles originated from within surgical specialties and coaching was most commonly applied to procedural or manual skills with 22 (17%) instances among all studies.

CONCLUSIONS

Most literature on coaching and mentorship is descriptive or narrative, and few papers are in the specialty of emergency medicine. Most interventions are limited to single instances of coaching or mentorship without longitudinal application of the intervention. There is an important need to study and publish further evidence on coaching interventions.