A scoping review of artificial intelligence in medical education: BEME Guide No. 84

BACKGROUND

Artificial Intelligence (AI) is rapidly transforming healthcare, and there is a critical need for a nuanced understanding of how AI is reshaping teaching, learning, and educational practice in medical education. This review aimed to map the literature regarding AI applications in medical education, core areas of findings, potential candidates for formal systematic review and gaps for future research.

METHODS

This rapid scoping review, conducted over 16 weeks, employed Arksey and O'Malley's framework and adhered to STORIES and BEME guidelines. A systematic and comprehensive search across PubMed/MEDLINE, EMBASE, and MedEdPublish was conducted without date or language restrictions. Publications included in the review spanned undergraduate, graduate, and continuing medical education, encompassing both original studies and perspective pieces. Data were charted by multiple author pairs and synthesized into various thematic maps and charts, ensuring a broad and detailed representation of the current landscape.

RESULTS

The review synthesized 278 publications, with a majority (68%) from North American and European regions. The studies covered diverse AI applications in medical education, such as AI for admissions, teaching, assessment, and clinical reasoning. The review highlighted AI's varied roles, from augmenting traditional educational methods to introducing innovative practices, and underscores the urgent need for ethical guidelines in AI's application in medical education.

CONCLUSION

The current literature has been charted. The findings underscore the need for ongoing research to explore uncharted areas and address potential risks associated with AI use in medical education. This work serves as a foundational resource for educators, policymakers, and researchers in navigating AI's evolving role in medical education. A framework to support future high utility reporting is proposed, the FACETS framework.

Describing Ultrasound Skills Teaching by Near-Peer and Faculty Tutors Using Cognitive Apprenticeship

Phenomenon: Ultrasound skills are becoming increasingly important in clinical practice but are resource-intensive to teach. Near-peer tutors often alleviate faculty teaching burden, but little is known about what teaching methods near-peer and faculty tutors use. Using the lens of cognitive apprenticeship, this study describes how much time faculty and near-peer tutors spend on different teaching methods during abdominal ultrasound skills training. Approach: Sixteen near-peer and 16 faculty tutors were videotaped during one 55-min practical ultrasound lesson with randomly assigned students. Videos were directly coded using Cognitive Apprenticeship teaching methods and activities. Segment durations were summed up and compared quantitatively. Findings: All 32 tutors spent most of the time on observing and helping students (Coaching, Median 29:14 minutes), followed by asking open and stimulating questions (Articulation, 12:04 minutes and demonstrating and giving explanations (Modeling, 04:50 minutes). Overall, distributions of teaching methods used were similar between faculty and near-peer tutors. However, faculty tutors spent more time on helping students manually, whereas near-peer tutors spent more time on exploring students' learning gaps and establishing a safe learning climate. Cognitive Apprenticeship was well suited as observational framework to describe ultrasound skills. Insights: Ultrasound train-the-tutor programs should particularly focus on coaching and articulation. Near-peers' similar use of teaching methods adds to the evidence that supports the use of near-peer teaching in ultrasound skills education.

Spiritual dimension in palliative medicine: a qualitative study of learning tasks: medical students, teachers, educationalists

BACKGROUND

Palliative care is gaining importance within the physician's range of duties. In the undergraduate medical curriculum, education on the four dimensions of care is insufficient. The spiritual dimension is hardly addressed. Therefore, we developed a coherent set of learning tasks targeted at learning to communicate about the spiritual dimension. The learning tasks are based on educational principles of authentic learning, reflective learning and longitudinal integration in the curriculum. This article reports on the feasibility of using these learning tasks in the medical curricula.

METHODS

Teachers and educational scientists were interviewed and students were asked to evaluate the learning tasks in focus groups. Interview transcripts were analysed by three independent researchers.

RESULTS

The learning tasks encourage the students to reflect on the four dimensions of palliative care and their personal values. Learning was clearly organised around authentic learning tasks relevant to the later profession, using paper, video cases, as well as simulations and real patients. Participants suggest giving more attention to cultural diversity. As palliative care is an emotionally charged subject, the safety of both student and patient should be guaranteed. All participants indicated that the program should start in the bachelor phase and most agreed that it should be integrated vertically and horizontally throughout the undergraduate program, although there is some debate about the optimal moment to start.

CONCLUSION

The tasks, are authentic, encourage the students to reflect on the spiritual dimension of palliative care and are suitable for integration in the undergraduate medical curriculum.

Collaboration Scripts or Checklists to Engage Novice Observers in Immersive Simulation?

INTRODUCTION

In simulation, students often observe their peers perform a task. It is still unclear how different types of instructional guidance can turn the observational phase into an active learning experience for novices. This mixed-method study aims to understand similarities and differences between use of collaboration scripts and checklists by observers in terms of cognitive load and perception of learning.

METHODS

Second-year pharmacy students ( N = 162) were randomly assigned to 1 of 4 conditions when observing a simulation: collaboration scripts (heuristic to analyze in dyads while observing), checklists, both, or no guidance. We measured observers' intrinsic and extraneous cognitive load and self-perceived learning and conducted focus group interviews.

RESULTS

Intrinsic cognitive load was significantly lower for checklists (M = 3.6/10) than for scripts (M = 4.7/10) or scripts and checklists combined (M = 4.7/10). Extraneous cognitive load was significantly lower for checklists (M = 1.5/10) than for scripts combined with checklists (M = 2.6/10) or no guidance (M = 1.8/10). There was no statistical difference between conditions for self-perceived learning. Coding of focus group interviews revealed 6 themes on observers' perception of learning under different conditions of instructional guidance. Students explained that collaboration scripts felt more complex, whereas checklists were perceived as a simple fact-checking exercise. Observing the simulation, regardless of guidance, was a meaningful learning experience.

CONCLUSIONS

With or without guidance, observers are actively engaged with the simulation, but their effort differed depending on instructions. When choosing between checklists or collaboration scripts, educators should be guided by the type of simulation task.

Opening the black box of team-based learning (TBL): A study of verbal interactions in online application sessions

CONTEXT

In team-based learning (TBL), an instructional strategy that encourages in-depth team discussion and deep learning, interactions in terms of sharing, co-construction, constructive conflict and procedural interactions are important. Since TBL has also been applied online in recent years, the question is whether these interactions are sufficiently present in an online setting.

AIM

Gain insight into the nature and extent of these types of interactions in online TBL application sessions and to what extent these vary between teams and sessions.

METHODS

We made audiovisual recordings of 12 TBL teams in two online application sessions during assignments. Transcripts were coded and analyzed using a framework derived.

RESULTS

Teams spent more than 85% of their time on all four types of interactions in both sessions. The largest proportion of time was spent on sharing and co-construction. Constructive conflict occurred to a limited extent. We observed variation in proportion of time spent on and the distribution of the four types of interactions between teams and sessions.

DISCUSSION

All interactions important for achieving deep learning occurred in online TBL application sessions. However, the effective use of these types of interaction should not be left to chance.

Observation of behavioural skills by medical simulation facilitators: a cross-sectional analysis of self-reported importance, difficulties, observation strategies and expertise development

BACKGROUND

The association between team performance and patient care was an immense boost for team-based education in health care. Behavioural skills are an important focus in these sessions, often provided via a mannikin-based immersive simulation experience in a (near) authentic setting. Observation of these skills by the facilitator(s) is paramount for facilitated feedback with the team. Despite the acknowledgement that trained facilitators are important for optimal learning, insight into this observation process by facilitators is limited.

OBJECTIVES

What are the self-reported current practices and difficulties regarding the observation of behavioural skills amongst facilitators during team training and how have they been trained to observe behavioural skills?

METHODS

This cross-sectional study used a pilot-tested, content-validated, multi-linguistic online survey within Europe, distributed through a non-discriminative snowball sampling method. Inclusion was limited to facilitators observing behavioural skills within a medical team setting.

RESULTS

A total of 175 persons filled in the questionnaire. All aspects of behavioural skill were perceived as very important to observe. The self-perceived difficulty of the behavioural skill aspects ranged from slightly to moderately difficult. Qualitative analysis revealed three major themes elaborating on this perceived difficulty: (1) not everything can be observed, (2) not everything is observed and (3) interpretation of observed behavioural skills is difficult. Additionally, the number of team members health care facilitators have to observe, outnumbers their self-reported maximum. Strategies and tools used to facilitate their observation were a blank notepad, co-observers and predefined learning goals. The majority of facilitators acquired observational skills through self-study and personal experience and/or observing peers. Co-observation with either peers or experts was regarded as most learn some for their expertise development. Overall, participants perceived themselves as moderately competent in the observation of behavioural skills during team training.

CONCLUSIONS

Observation of behavioural skills by facilitators in health care remains a complex and challenging task. Facilitators' limitations with respect to attention, focus and (in)ability to perform concomitant tasks, need to be acknowledged. Although strategies and tools can help to facilitate the observation process, they all have their limitations and are used in different ways.

Targeting the school environment to enable participation: A scoping review

BACKGROUND

Children with special educational needs experience limited levels of participation at school; their participation is influenced by the physical and social environment. Interventions that have been applied in school environments are described in the literature.

AIMS

To illustrate the main features of interventions targeting school environments to support participation of children with special educational needs in mainstream education.

MATERIALS AND METHODS

A scoping review using a qualitative, thematic analysis was conducted in May 2021.

RESULTS

We included a total of 20 articles. We found that intervention features contributed to children's participation and targeted social and physical school environments. The majority of the intervention features focussed on applying supportive teaching methods to enable individual children's participation. A small number of interventions described a systemic holistic approach that involved changes to the school environment. In these interventions, different professionals such as occupational therapists collaborated with teachers to adapt the school environment.

CONCLUSIONS AND SIGNIFICANCE

A shift from individual child-focussed to environment-focussed approaches that target all children's participation could impact classroom setup and teachers' roles. Occupational therapists' expertise in matching school environments and task requirements with individual children's needs could be valuable in their collaboration with schools to support this transition.

Task complexity and cognitive load in simulation-based education: A randomised trial

INTRODUCTION

When designing simulation for novices, educators aim to design tasks and environments that are complex enough to promote learning but not too complex to compromise task performance and cause cognitive overload. This study aimed to determine the impact of modulating task and environment complexity on novices' performance and cognitive load during simulation.

METHODS

Second-year pharmacy students (N = 162) were randomly assigned to one of four conditions (2 × 2 factorial design) in simulation: simple task in simple environment, complex task in simple environment, simple task in complex environment and complex task in complex environment. Using video recordings, two raters assessed students' performance during the simulation. We measured intrinsic cognitive load (ICL) and extraneous cognitive load (ECL) with questionnaires after the task and tested knowledge after task and debriefing.

RESULTS

Mean performance scores in simple environment were 28.2/32 (SD = 3.8) for simple task and 25.8/32 (SD = 4.2) for complex task. In complex environment, mean performance scores were 24.6/32 (SD = 5.2) for simple task and 25.6/32 (SD = 5.3) for complex task. We found significant interaction effects between task and environment complexity for performance. In simple environment, mean ICL scores were 4.2/10 (SD = 2.2) for simple task and 5.7/10 (SD = 1.5) for complex task. In complex environment, mean ICL scores were 4.9/10 (SD = 1.8) for simple task and 5.1/10 (SD = 1.9) for complex task. There was a main effect of task complexity on ICL. For ECL, we found neither an interaction effect nor main effects of task and environment complexity. There was a main effect of task complexity on knowledge test after task and main effects of both task and environment complexity on knowledge after debriefing.

CONCLUSIONS

Performance was good, and cognitive load remained reasonable in all conditions, which suggests that, despite increased complexity, students seemed to strategically manage their own cognitive load and learn from the simulations. Our findings also indicate that environmental complexity contributes to ICL.

Longitudinal exploration of students' identity formation during the transition from pre-clinical to clinical training using research poetry

BACKGROUND

Transitions are critical periods that can lead to growth and, or, distress. Transitions are a sociocultural process, yet most approaches to transitions in practice and research do not explore the social or developmental aspects of entering a new training phase. Wenger reminds us that identity development is crucial when newcomers navigate change. In this paper, we use Wenger's modes of identification: engagement, imagination and alignment to explore students' identity development (as a student and professional) during the transition from pre-clinical to clinical training.

METHODS

We enrolled nine 2nd-year medical students who generated 61 entries comprising audio diary (or typed) reflections over 9 months (starting 3 months before clinical clerkships began) and interviewed them twice. We used research poems (transcripts reframed as poetry) to help construct a meaningful, emotive elicitation of our longitudinal data and analysed data using sensitising concepts from Wenger's modes of identification.

RESULTS

Students described their transition as a journey filled with positive and negative emotions and uncertainty about their current and future careers. Students navigated the transition using three mechanisms: (1) becoming more engaged through taking charge, (2) shaping their image of self through engagement and finding role models and (3) learning to flexibly adapt to clerkship norms by managing expectations and adopting a journey mindset.

CONCLUSIONS

We successfully narrated students' identity formation during their transition to clinical training. We learned that students became more engaged over time by learning to take charge. They shaped their image of self by engaging in team activities and reflecting on role models. They learnt to adapt flexibly to clerkship norms by managing expectations and adopting a journey mindset. We suggest that institutions provide a safe opportunity for medical students to reflect, allowing students' transition periods to be lived, reflected on and supported.

Virtual interviewing for graduate medical education recruitment and selection: A BEME systematic review: BEME Guide No. 80

BACKGROUND

The COVID-19 pandemic caused graduate medical education (GME) programs to pivot to virtual interviews (VIs) for recruitment and selection. This systematic review synthesizes the rapidly expanding evidence base on VIs, providing insights into preferred formats, strengths, and weaknesses.

METHODS

PubMed/MEDLINE, Scopus, ERIC, PsycINFO, MedEdPublish, and Google Scholar were searched from 1 January 2012 to 21 February 2022. Two authors independently screened titles, abstracts, full texts, performed data extraction, and assessed risk of bias using the Medical Education Research Quality Instrument. Findings were reported according to Best Evidence in Medical Education guidance.

RESULTS

One hundred ten studies were included. The majority (97%) were from North America. Fourteen were conducted before COVID-19 and 96 during the pandemic. Studies involved both medical students applying to residencies (61%) and residents applying to fellowships (39%). Surgical specialties were more represented than other specialties. Applicants preferred VI days that lasted 4-6 h, with three to five individual interviews (15-20 min each), with virtual tours and opportunities to connect with current faculty and trainees. Satisfaction with VIs was high, though both applicants and programs found VIs inferior to in-person interviews for assessing 'fit.' Confidence in ranking applicants and programs was decreased. Stakeholders universally noted significant cost and time savings with VIs, as well as equity gains and reduced carbon footprint due to eliminating travel.

CONCLUSIONS

The use of VIs for GME recruitment and selection has accelerated rapidly. The findings of this review offer early insights that can guide future practice, policy, and research.

Impact of the COVID-19 pandemic on surgical care in the Netherlands

BACKGROUND

The COVID-19 pandemic caused disruption of regular healthcare leading to reduced hospital attendances, repurposing of surgical facilities, and cancellation of cancer screening programmes. This study aimed to determine the impact of COVID-19 on surgical care in the Netherlands.

METHODS

A nationwide study was conducted in collaboration with the Dutch Institute for Clinical Auditing. Eight surgical audits were expanded with items regarding alterations in scheduling and treatment plans. Data on procedures performed in 2020 were compared with those from a historical cohort (2018-2019). Endpoints included total numbers of procedures performed and altered treatment plans. Secondary endpoints included complication, readmission, and mortality rates.

RESULTS

Some 12 154 procedures were performed in participating hospitals in 2020, representing a decrease of 13.6 per cent compared with 2018-2019. The largest reduction (29.2 per cent) was for non-cancer procedures during the first COVID-19 wave. Surgical treatment was postponed for 9.6 per cent of patients. Alterations in surgical treatment plans were observed in 1.7 per cent. Time from diagnosis to surgery decreased (to 28 days in 2020, from 34 days in 2019 and 36 days in 2018; P < 0.001). For cancer-related procedures, duration of hospital stay decreased (5 versus 6 days; P < 0.001). Audit-specific complications, readmission, and mortality rates were unchanged, but ICU admissions decreased (16.5 versus 16.8 per cent; P < 0.001).

CONCLUSION

The reduction in the number of surgical operations was greatest for those without cancer. Where surgery was undertaken, it appeared to be delivered safely, with similar complication and mortality rates, fewer admissions to ICU, and a shorter hospital stay.

ODP579 An EMR And Educational Intervention To Avoid Excessive Fingerstick Blood Glucose Testing In Low-risk Hospitalized Patients With Type Ii Diabetes

Introduction

Telemedicine has become the cornerstone of health care delivery in the COVID-19 pandemic, as it allows patients to be cared for at a distance. Though institutions have published experiences with telemedicine incorporated into residency training programs during the pandemic, there is a lack of qualitative data in this field. This descriptive qualitative study sought to (1) explore internal medicine resident experiences with telehealth patient encounters during the COVID-19 pandemic, and (2) understand resident experiences with virtually reviewing cases with their supervisors.

Methods

From November 2020 to March 2021, the authors conducted 20 semi-structured interviews with internal medicine residents at the University of Toronto. Residents were included if they completed ambulatory rotations such as endocrinology. Interviews were transcribed, line-by-line coding was done in parallel, and themes were derived through inductive and constant comparative analysis.

Results

Resident experiences with telemedicine were divided into themes according to the perceived benefits and challenges with patient encounters, and with virtually reviewing cases with supervisors. Perceived benefits in patient encounters included less pressure for time and increased efficiency, and residents looked at this patient care modality as an important component of their future careers. Challenges included a deficiency of nonverbal cues to use for building rapport with patients and confirming their understanding, inability to confidently form an impression of a patient and their disease severity, the lack of physical examination, and technical audio-visual challenges. While most residents preferred in-person to virtual review with their supervisors, the benefits of the virtual review included a supportive learning environment, and a high level of autonomy for senior residents. However, residents felt that feedback over a virtual platform was generic and not constructive, and junior trainees did not have opportunities to observe staff demonstrate essential skills needed for telemedicine care.

Discussion

Telemedicine incorporation into postgraduate medical education is still in its early stages, and data on resident experiences is crucial to inform ways of optimizing the learning environment and preceptorship of such encounters. The virtual review process, limited by the same communication challenges that residents faced with patients, inherently involves less supervision and guidance than an in-person review. While this may support the learning needs of more experienced residents by offering more autonomy, junior residents may be affected by the lack of opportunities for observation of essential skills and the absence of coaching through constructive feedback. More research is needed especially on educational interventions that can help overcome the virtual communication challenges between residents, patients, and their clinical supervisors.

Presentation: No date and time listed

ODP577 A Qualitative Exploration of Internal Medicine Resident Experiences with Telemedicine During the COVID-19 Pandemic

Telemedicine has become the cornerstone of health care delivery in the COVID-19 pandemic, as it allows patients to be cared for at a distance. This descriptive qualitative study sought to (1) explore internal medicine resident experiences with telehealth patient encounters during the COVID-19 pandemic, and (2) understand resident experiences with virtually reviewing cases with their supervisors. From November 2020 to March 2021, the authors conducted 20 semi-structured interviews with internal medicine residents who have completed ambulatory rotations such as endocrinology. Perceived benefits in patient encounters included increased efficiency. Challenges included a deficiency of nonverbal cues to use for building rapport with patients and confirming their understanding, inability to confidently form an impression of a patient and their disease severity, the lack of physical examination, and technical audio-visual challenges. While most residents preferred in-person to virtual review with their supervisors, the benefits of the virtual review included a supportive learning environment, and a high level of autonomy for senior residents. However, residents felt that feedback over a virtual platform was generic and not constructive, and junior trainees did not have opportunities to observe staff demonstrate essential skills needed for telemedicine care.

Presentation: No date and time listed

Medical Students' Socialization Tactics When Entering a New Clinical Clerkship: A Mixed Methods Study of Proactivity

PURPOSE

Socialization into clinical clerkships is difficult in part due to ambiguity around students' new roles and expected behaviors. Being proactive reduces ambiguity and is essential to socialization. Proactive behavior can be taught and goes beyond having a proactive personality. Among students entering new undergraduate clinical clerkships, this study aimed to investigate (1) reported proactive behaviors and their association with social integration and (2) enabling and inhibiting factors for proactive behavior.

METHOD

This study was conducted at the 5-year MBBS program at Western Sydney University during academic year 2019-2020. Using a convergent mixed methods approach, survey and interview data from third-, fourth-, and fifth-year students were collected. Surveys explored 5 proactive behaviors: feedback seeking, information seeking, task negotiation, positive framing, and relationship building. Interviews elicited descriptions of how students described their proactivity and what influenced students to be proactive when entering a new clerkship. Data were integrated using the following the thread and mixed methods matrix techniques.

RESULTS

Students exhibited all 5 proactive behaviors. Survey data showed positive framing and task negotiation had the highest and lowest scores, respectively. Only positive framing correlated significantly with social integration scores (r = 0.27; P < .01), but this contrasted to interviews, in which students described how other proactive behaviors also led to social integration. Proactive behavior scores decreased across academic years. Integrated data showed 3 linked antecedents to whether students exhibited proactive behavior: feeling capable of being proactive, individual intention to be proactive, and the immediate environment and system-level factors.

CONCLUSIONS

Students who framed the experience positively were more likely to report increased social integration. Initiating task negotiation was challenging for most students. The authors propose a conceptual model for proactivity and social integration to support socialization and learning during clinical transitions for future research and interventional design.

Supervisors' transformational leadership style and residents' job crafting in surgical training: the residents' views

OBJECTIVES

This study aims to explore the effects of three supervisors' leadership styles (transformational, transactional, and laissez-faire) on residents' job crafting.

METHODS

Sequential explanatory mixed-methods. First, a purposive sample of residents rated the leadership style of their supervisors and their own job crafting on the Multifactor Leadership Questionnaire and the Dutch Job Crafting Scale. The effects were tested through linear mixed effects regression analysis. Thereafter we conducted semi-structured interviews with residents and conducted a thematic analysis.

RESULTS

A total of 116 residents participated. A transformational style had a positive effect on residents' job crafting (b = .19, t₍₁₁₂₎ =3.76, p=. 009), whereas the transactional and laissez-faire styles did not. This could be explained by the fact that residents felt a positive influence of the supervisors with such style on the atmosphere for training, on the job resources available to them, and on their modelling function for how to handle the demands of the environment.

CONCLUSIONS

A transformational style of the supervisor has a positive effect on residents' job crafting. Future research should explore the supervisors' perspective, as well as the effectiveness of leadership training for supervisors with a focus on resident outcomes, such as job crafting.

How Surgical Leaders Transform Their Residents to Craft Their Jobs: Surgeons' Perspective

BACKGROUND

Surgeons should transform their residents to take the lead in their jobs and optimize their working conditions, so-called job crafting. We investigated the actions undertaken by surgeons with a transformational leadership style to encourage residents' job crafting, about which there is at present a paucity of information.

METHODS

We performed a qualitative study based on principles of constructivist grounded theory. In-depth interviews were held with a purposive sample of surgeons who were perceived as transformational leaders by their residents. During data analysis (open, axial, and selective coding), we compared inductive codes with deductive codes drawn from the job demands-resources and transformational leadership theories to reach a consensus on the interpretation of data and identification of the main themes.

RESULTS

Sixteen surgeons participated. Surgeons undertook five actions that enhanced job crafting in residents. They: one) modeled positive behaviors of a good surgeon; two) used a stepwise individual approach toward autonomy; three) connected with the resident as a person; four) supported residents in handling complications and errors; and five) they coached the resident to deal with competing interests. These actions had four consequences for residents. They led to: one) more responsibilities in patient care; two) more constructive relationships in the workplace; three) less pressure from workload and surgical care duties; and four) less personal difficulties and errors in patient care.

CONCLUSIONS

The actions undertaken by surgeons with a transformational leadership style have a positive association with the residents' ability to craft their jobs. This knowledge has implications for surgeons' leadership development with a view to workplace education.

Students' social networks are diverse, dynamic and deliberate when transitioning to clinical training

CONTEXT

Transitions in medical education are dynamic, emotional and complex yet, unavoidable. Relationships matter, especially in times of transition. Using qualitative, social network research methods, we explored social relationships and social support as medical students transitioned from pre-clinical to clinical training.

METHODS

Eight medical students completed a social network map during a semi-structured interview within two weeks of beginning their clinical clerkships (T0 ) and then again four months later (T1 ). They indicated meaningful interactions that influenced their transition from pre-clinical to clinical training and discussed how these relationshipsimpacted their transition. We conducted mixed-methods analysis on this data.

RESULTS

At T0 , eight participants described the influence of 128 people in their social support networks; this marginally increased to 134 at T1 . People from within and beyond the clinical space made up participants' social networks. As new relationships were created (eg with peers and doctors), old relationships were kept (eg with doctors and family) or dissolved over time (eg with near-peers and nurses). Participants deliberately created, kept or dissolved relationships over time dependent on whether they provided emotional support (eg they could trust them) or instrumental support (eg they provided academic guidance).

CONCLUSIONS

This is the first social networks analysis paper to explore social networks in transitioning students in medicine. We found that undergraduate medical students' social support networks were diverse, dynamic and deliberate as they transitioned to clerkships. Participants created and kept relationships with those they trusted and who provided emotional or instrumental support and dissolved relationships that did not provide these functions.

Appraising the use of smartphones and apps when conducting qualitative medical education research: AMEE Guide No. 130

Smartphone use is rampant in everyday life and is increasing in: patient management, teaching and learning of medicine and health research. There is untapped potential to use smartphones as research tools in MER for a range of research approaches. Qualitative research is increasingly common in medical education research (MER). Smartphone use as a research tool has not been well explored in MER and this Guide will be useful to researchers considering integrating smartphones specifically in qualitative MER. First, we discuss the potential for smartphones in qualitative MER. Then, we discuss the opportunities and drawbacks for using smartphones in qualitative MER. We then provide three principles to consider when conducting smartphone MER: communication, ethics and reflection. Next we share ten lessons that emerged from the literature and our experiences. We end by looking to the future of smartphones in qualitative MER and hope this Guide provides evidence-based information to optimise smartphone use in qualitative MER. This Guide is important as there is an urgent need to redefine ethical boundaries to account for blurred lines between personal and professional use of smartphones.

Organizational Conditions That Impact the Implementation of Effective Team-Based Models for the Treatment of Diabetes for Low Income Patients-A Scoping Review

Background: Team-based care models (TBC) have demonstrated effectiveness to improve health outcomes for vulnerable diabetes patients but have proven difficult to implement in low income settings. Organizational conditions have been identified as influential on the implementation of TBC. This scoping review aims to answer the question: What is known from the scientific literature about how organizational conditions enable or inhibit TBC for diabetic patients in primary care settings, particularly settings that serve low-income patients? Methods: A scoping review study design was selected to identify key concepts and research gaps in the literature related to the impact of organizational conditions on TBC. Twenty-six articles were finally selected and included in this review. This scoping review was carried out following a directed content analysis approach. Results: While it is assumed that trained health professionals from diverse disciplines working in a common setting will sort it out and work as a team, co-location, and health professions education alone do not improve patient outcomes for diabetic patients. Health system, organization, and/or team level factors affect the way in which members of a care team, including patients and caregivers, collaborate to improve health outcomes. Organizational factors span across seven categories: governance and policies, structure and process, workplace culture, resources, team skills and knowledge, financial implications, and technology. These organizational factors are cited throughout the literature as important to TBC, however, research on the organizational conditions that enable and inhibit TBC for diabetic patients is extremely limited. Dispersed organizational factors are cited throughout the literature, but only one study specifically assesses the effect of organizational factors on TBC. Thematic analysis was used to categorize organizational factors in the literature about TBC and diabetes and a framework for analysis and definitions for key terms is presented. Conclusions: The review identified significant gaps in the literature relating to the study of organizational conditions that enable or inhibit TBC for low-income patients with diabetes. Efforts need to be carried out to establish unifying terminology and frameworks across the field to help explain the relationship between organizational conditions and TBC for diabetes. Gaps in the literature include research be based on organizational theories, research carried out in low-income settings and low and middle income countries, research explaining the difference between the organizational conditions that impact the implementation of TBC vs. maintaining or sustaining TBC and the interaction between organizational factors at the micro, meso and macro level and their impact on TBC. Few studies include information on patient outcomes, and fewer include information on low income settings. Further research is necessary on the impact of organizational conditions on TBC and diabetic patient outcomes.

Exploring the evolving concept of 'patient ownership' in the era of resident duty hour regulations-experience of residents and faculty in an internal medicine night float system

BACKGROUND

Despite the use of 'patient ownership' as an embodiment of professionalism and increasing concerns over its loss among trainees, how its development in residents has been affected by duty hour regulations has not been well described. In this qualitative study, we aim to outline the key features of patient ownership in internal medicine, factors enabling its development, and how these have been affected by the adoption of a night float system to comply with duty hour regulations.

METHODS

In this qualitative descriptive study, we interviewed 18 residents and 12 faculty internists at one university centre and conducted a thematic analysis of the data focused on the concept of patient ownership.

RESULTS

We identified three key features of patient ownership: personal concern for patients, professional capacity for autonomous decision-making, and knowledge of patients' issues. Within the context of a night float system, factors that facilitate development of patient ownership include improved fitness for duty and more consistent interactions with patients/families resulting from working the same shift over consecutive days (or nights). Conversely, the increase in patient handovers, if done poorly, is a potential threat to patient ownership development. Trainees often struggle to develop ownership when autonomy is not supported with supervision and when role-modelling by faculty is lacking.

DISCUSSION

These features of patient ownership can be used to frame discussions when coaching trainees. Residency programs should be mindful of the downstream effects of shift-based scheduling. We propose strategies to optimize factors that enable trainee development of patient ownership.

Beyond the struggles: a scoping review on the transition to undergraduate clinical training

CONTEXT

The transition to clinical training within medical school is often seen as a struggle and students remain in distress despite numerous efforts to minimise threats. Efforts to change this may be misdirected if they are based on narrow conceptualisations of transitions. The authors conducted a scoping review to explore existing conceptual perspectives regarding the transition within medical school from pre-clinical training to clinical training to suggest a research agenda and practical implications.

METHODS

Between October 2017 and February 2018 the authors searched PubMed, MEDLINE, ERIC, PsycINFO, Web of Science and CINAHL for English language literature with no date limits and retrieved 1582 articles; 46 were included in this review. Two reviewers independently screened articles and extracted data. Data were then charted, analysed and discussed with the research team.

RESULTS

The transition to clinical training was often described negatively as 'difficult', 'a problem' and 'a struggle'. Our analysis found that researchers in medical education conducted studies on the transition to clinical training from three conceptual perspectives: educational; social, and developmental. Most research approached the transition to clinical training as a problem to be addressed from an educational perspective through transition to clerkship courses and curriculum innovations. Some research was conducted from a social perspective, focusing on building relationships. Regarding development, authors found a few articles highlighting opportunities for personal and professional development by nurturing transferrable learning strategies and reflection.

CONCLUSIONS

This review provides an empirical base on which future research can be built to better understand and support medical students' ability to navigate change. Finding new perspectives to approach the transition to clinical training could allow researchers to look beyond preparing students for struggles.

Discriminating Features of Narrative Evaluations of Communication Skills During an OSCE

Construct: Authors examined the use of narrative comments for evaluation of student communications skills in a standardized, summative assessment (Objective Structured Clinical Examinations [OSCE]). Background: The use of narrative evaluations in workplace settings is gaining credibility as an assessment tool, but it is unknown how assessors convey judgments using narratives in high-stakes standardized assessments. The aim of this study was to explore constructs (i.e., performance dimensions), as well as linguistic strategies that assessors use to distinguish between poor and good students when writing narrative assessment comments of communication skills during an OSCE. Approach: Eighteen assessors from Qatar University were recruited to write narrative assessment comments of communication skills for 14 students completing a summative OSCE. Assessors scored overall communication performance on a 5-point scale. Narrative evaluations for the top and bottom 2 performing students for each station (based on communication scores) were analyzed for linguistic strategies and constructs that informed assessment decisions. Results: Seventy-two narrative evaluations with 662 comments were analyzed. Most comments (77%) were written without the use of politeness strategies. A further 22% of comments were hedged. Hedging was used more commonly in poor performers, compared to good performers (30% vs. 15%, respectively). Overarching constructs of confidence, adaptability, patient safety, and professionalism were key dimensions that characterized the narrative evaluations of students' performance. Conclusions: Results contribute to our understanding regarding the utility of narrative comments for summative assessment of communication skills. Assessors' comments could be characterized by the constructs of confidence, adaptability, patient safety, and professionalism when distinguishing between levels of student performance. Findings support the notion that judgments are arrived at by clustering sets of behaviors into overarching and meaningful constructs rather than by solely focusing on discrete behaviors. These results call for the development of better-anchored evaluation tools for communication assessment during OSCEs, constructively aligned with assessors' map of the reality of professional practice.

Job Crafting to Persist in Surgical Training: A Qualitative Study From the Resident's Perspective

BACKGROUND

Attrition in surgical training, a result of poor well-being at work, continues to rise. Work engagement and persistence, the other side of the coin, depend on the proactivity of residents to optimize the demands and resources in the workplace to achieve a better fit with the environment. This type of proactivity refers to job-crafting. In this study, we sought to explore the specific mechanisms underlying residents' job-crafting to enhance work engagement and persistence, as well as the role of supervisors in this endeavor.

MATERIALS AND METHODS

We used a constructivist-grounded theory design. We conducted semistructured interviews of active residents. During the analysis of verbatim protocols, we developed codes and categories and identified the main themes (job-crafting mechanisms) related to work engagement and persistence. We anticipated procedures to engage in reflexivity.

RESULTS

The residents showed six job-crafting mechanisms (build trust with supervisors, manage proactively, seek help, see errors and frustrations as learning opportunities, find a suitable work-life balance, and seek challenges actively). The supervisors contributed to residents' job-crafting with four mechanisms (earning the trust of the residents, providing guidance and support, allowing residents to fulfill tasks befitting a surgeon in training, and offering increasingly challenging tasks to residents).

CONCLUSIONS

Work engagement and persistence in training are active processes that depend on the ability of residents to take advantage of resources and challenges and to diminish hindering demands at the workplace. Future research should focus on the perspectives of the supervisor, as well as on the effectiveness of job-crafting interventions, to enhance work engagement.

Taking control: Is job crafting related to the intention to leave surgical training?

OBJECTIVE

The intention to leave surgical training, hereinafter referred as proxy of "attrition," is associated with poor well-being in the workplace. Attrition is suggested to diminish when residents possess job-crafting skills, that is, the ability to redefine their job in meaningful ways and maximize well-being at work by increasing structural and social resources and challenges and decreasing hindering demands. However, the evidence supporting this relationship is scant. This study sought to: 1) investigate to what extent residents possess job-crafting skills and compare residents' levels of job-crafting skills across years of residency training; 2) investigate the relationship between job crafting, well-being as measured by burnout and work-engagement rates, and the intention to leave; and 3) compare the levels of job-crafting skills and well-being between residents with and without serious intentions to leave.

METHODS

This cross sectional study was conducted in fifteen residency programs in Colombia. Surgical residents completed different questionnaires including the Dutch Job Crafting Scale (DJCS), MBI-Human Services Survey (MBI-HSS), Utrecht Work Engagement Scale (UWES-17) and an adapted version of the Nurse Turnover Intention Scale (NTIS). The objectives were addressed by independent analyses of variance (ANOVA), structural equation modeling techniques (SEM) and independent t-tests, respectively.

RESULTS

A total of 202 residents participated. Residents generally scored high on their job-crafting skills to increase structural and social resources as well as challenging demands, but were less positive about their skills to reduce hindering demands. No differences across years of training were found. Job crafting correlated positively with work-engagement, which was inversely related to the intention to leave. Conversely, job crafting correlated negatively with burnout, which bore a positive relationship to the intention to leave. Residents with serious intentions to leave exhibited lower levels of most job-crafting skills and work-engagement, compared to those without such intentions.

CONCLUSIONS

This study adds evidence that attrition is a process mediated by residents' well being at work, which can be molded by their job-crafting endeavors. Future research is needed to evaluate the effectiveness of interventions aimed at cultivating resident's job-crafting abilities in order to reduce attrition.

Peer group reflection on student ratings stimulates clinical teachers to generate plans to improve their teaching

BACKGROUND

Previous studies have demonstrated that student ratings of a teachers' performance do not incentivize clinical teachers to reflect critically and generate plans to improve their teaching. Peer group reflection might offer a solution in mediating this change.

AIM

To investigate: (a) to which extent clinical teachers perceive self-evaluation, student ratings and peer group reflection effective; and (b) whether additional peer group reflection fosters critical reflection and the translation of feedback into concrete plans of action.

METHOD

We conducted a quasi-experiment, inviting two groups of 10 clinical teachers each (1) to complete a self-evaluation and (2) subsequently examine their student ratings. One group participated in (3) an additional peer group reflection meeting. All participants were finally requested to define plans for improvement and evaluate each activity's effectiveness.

RESULTS

Participants perceived all three activities to be effective. Levels of reflection did not differ across the two groups. However, participation in peer group reflection did result in generating more concrete plans to change clinical teaching.

CONCLUSIONS

Peer group reflection on student ratings shows promise as tool to assist clinical teachers in generating plans for improvement. Future research should focus on whether teaching indeed improves with the introduction of peer group reflection.

Electronic assessment of clinical reasoning in clerkships: A mixed-methods comparison of long-menu key-feature problems with context-rich single best answer questions

BACKGROUND

It remains unclear which item format would best suit the assessment of clinical reasoning: context-rich single best answer questions (crSBAs) or key-feature problems (KFPs). This study compared KFPs and crSBAs with respect to students' acceptance, their educational impact, and psychometric characteristics when used in a summative end-of-clinical-clerkship pediatric exam.

METHODS

Fifth-year medical students (n = 377) took a computer-based exam that included 6-9 KFPs and 9-20 crSBAs which assessed their clinical reasoning skills, in addition to an objective structured clinical exam (OSCE) that assessed their clinical skills. Each KFP consisted of a case vignette and three key features using a "long-menu" question format. We explored students' perceptions of the KFPs and crSBAs in eight focus groups and analyzed statistical data of 11 exams.

RESULTS

Compared to crSBAs, KFPs were perceived as more realistic and difficult, providing a greater stimulus for the intense study of clinical reasoning, and were generally well accepted. The statistical analysis revealed no difference in difficulty, but KFPs resulted more reliable and efficient than crSBAs. The correlation between the two formats was high, while KFPs correlated more closely with the OSCE score.

CONCLUSIONS

KFPs with long-menu exams seem to bring about a positive educational effect without psychometric drawbacks.

Medical professionalism frameworks across non-Western cultures: A narrative overview

BACKGROUND

Medical professionalism is context-specific, but most literature on professionalism stems from Western countries. This study is about benchmarking of different frameworks on professionalism and interpreting the commonalities and discrepancies of understanding professionalism across different cultures. We need to study the cultural underpinning of medical professionalism to graduate future "global" practitioners who are culturally sensitive enough to recognize differences (and also similarities) of expectations of patients in various contexts.

AIM

This study aims at describing culture specific elements of three identified non-Western frameworks of professionalism, as well as their commonalities and differences.

METHOD

A narrative overview was carried out of studies that address professionalism in non-Western cultures in the period 2002-2014.

RESULTS

Out of 143 articles on medical professionalism, only four studies provided three structured professionalism frameworks in non-Western contexts. Medical professionalism attributes in non-Western cultures were influenced by cultural values. Out of the 24 identified attributes of professionalism, 3 attributes were shared by the three cultures. Twelve attributes were shared by at least two cultures, and the rest of the attributes were unique to each culture.

CONCLUSIONS

The three frameworks provided culture-specific elements in a unique conceptual framework of medical professionalism according to the region they originated from. There is no single framework on professionalism that can be globally acknowledged. A culture-oriented concept of professionalism is necessary to understand what the profession is dedicated to and to incorporate the concept into the medical students' and physicians' professional identity formation.

Communities of teaching practice in the workplace: Evaluation of a faculty development programme

BACKGROUND

The focus of faculty development (FD) has recently shifted from individual and formal learning to formal and informal learning by a team of teachers in the workplace where the teaching is actually effected. This study aimed to evaluate the impact of a faculty development programme on teachers' educational workplace environment.

METHODS

We invited 23 teachers, who had successfully completed a University Teaching Qualification (UTQ) programme, to evaluate the faculty development programme and participate in focus group discussions. This UTQ programme spanned one year and covered 185 hours of formal and informal learning and training activities and formal coaching.

RESULTS

After having obtained their UTQ, teachers reported that coaching enhances reflection and feedback, to participate more frequently in educational networks, which enhances consultation among teachers, increased awareness of organizational educational policies and more confidence in fulfilling educational tasks and activities.

CONCLUSION

The evaluation of the UTQ programme demonstrated to enhance the development of a community of teachers at the workplace who share a passion for education and provide each other with support and feedback, which triggered a change in culture enhancing improvement of education. However, this did not hold for all teachers. Inhibiting factors hold sway, such as a prevailing commitment to research over education in some departments and a lack of interest in education by some department chairs.

A systematic review of faculty development initiatives designed to enhance teaching effectiveness: A 10-year update: BEME Guide No. 40

BACKGROUND

This review, which focused on faculty development initiatives designed to improve teaching effectiveness, synthesized findings related to intervention types, study characteristics, individual and organizational outcomes, key features, and community building.

METHODS

This review included 111 studies (between 2002 and 2012) that met the review criteria.

FINDINGS

Overall satisfaction with faculty development programs was high. Participants reported increased confidence, enthusiasm, and awareness of effective educational practices. Gains in knowledge and skills, and self-reported changes in teaching behaviors, were frequently noted. Observed behavior changes included enhanced teaching practices, new educational initiatives, new leadership positions, and increased academic output. Organizational changes were infrequently explored. Key features included evidence-informed educational design, relevant content, experiential learning, feedback and reflection, educational projects, intentional community building, longitudinal program design, and institutional support.

CONCLUSION

This review holds implications for practice and research. Moving forward, we should build on current success, broaden the focus beyond individual teaching effectiveness, develop programs that extend over time, promote workplace learning, foster community development, and secure institutional support. We should also embed studies in a theoretical framework, conduct more qualitative and mixed methods studies, assess behavioral and organizational change, evaluate transfer to practice, analyse key features, and explore the role of faculty development within the larger organizational context.

Stress and anxiety management strategies in health professions' simulation training: a review of the literature

Introduction

Simulation training has been used to teach clinical skills to health profession trainees. Stress and/or anxiety occur in high-acuity scenarios in the clinical environment, and affect clinician performance and patient outcomes. To date, strategies that have been used in conjunction with simulation training for healthcare professionals that address stress management are limited. This paper reports a literature review conducted to explore strategies used with simulations to enhance the ability of health profession trainees in reducing acute stress and/or anxiety during high-acuity clinical events.

Methods

Databases searched included Scopus, PubMed, CINAHL, Web of Knowledge and Science Direct. The examples of the literature chosen were those published in the English language from January 2005 to March 2015, and were peer-reviewed empirical papers that focused on the strategies addressing stress and/or anxiety during simulation training for healthcare profession trainees.

Results

Eight studies using various forms of stress/anxiety management strategies with simulations demonstrated varying degrees of effectiveness. Themes that emerged from these eight studies were excessive stress and clinical performance in simulation, emotional training strategies in simulation, and factors contributing to stress and anxiety reduction during simulation.

Conclusions

Excessive stress and/or anxiety in the clinical setting have been shown to affect performance and could compromise patient outcomes. Health profession training curricula might benefit from a stress/anxiety reduction strategy integrated into the simulation programmes. This review showed that the stress/anxiety management strategies that have been used with simulations, mostly in surgical training, have various degrees of effectiveness.

Use of a Night Float System to Comply With Resident Duty Hours Restrictions: Perceptions of Workplace Changes and Their Effects on Professionalism

PURPOSE

Although some evidence suggests that resident duty hours reforms can lead to shift-worker mentality and loss of patient ownership, other evidence links long hours and fatigue to poor work performance and loss of empathy, suggesting the restrictions could positively affect professionalism. The authors explored perceived impacts of a 16-hour duty restriction, achieved using a night float (NF) system, on the workplace and professionalism.

METHOD

In 2013, the authors conducted semistructured interviews with 18 residents, 9 staff physicians, and 3 residency program directors in the McGill University core internal medicine residency program regarding their perceptions of the program's 12-hour shift-based NF system. Interviews were transcribed and coded for common themes. The authors used a descriptive qualitative methodology.

RESULTS

Participants viewed implementation of the NF system as leading to decreased physical and mental exhaustion, more consistent interaction with patients, and more stable team structure within shifts compared with the previous 24-hour call system. These workplace changes were felt to improve teamwork and patient ownership within shifts, quality of work performed, and empathy. Across shifts, however, more frequent sign-overs, stricter application of shift time boundaries, and loose integration between daytime and NF teams were perceived as leading to emergence of shift-worker mentality around sign-over. Perceptions of optimal patient ownership changed from the traditional single-physician-24/7 model to team-based shared ownership.

CONCLUSIONS

Duty hours restrictions, as exemplified by an NF system, have both positive and negative impacts on professionalism. Interventions and training toward effective team-based care are needed to curb emergence of shift-worker mentality.

Development, implementation, and evaluation of a mental rehearsal strategy to improve clinical performance and reduce stress: A mixed methods study

BACKGROUND

Mental rehearsal is a form of mental training that has been used by physicians and nurses to improve performance of clinical skills, and as a vital component of stress management training. To help novice nurses deal with often stressful clinical events that require the processing of information essential to patient management, a mental rehearsal strategy was developed and implemented in a Year 3 nursing simulation program. Inherent to mental rehearsal is imagery, which facilitates cognitive and affective modification, and reduction of extraneous cognitive load. As such, it was expected that the mental rehearsal strategy would improve students' performance and reduce stress in managing deteriorating patients.

METHODS

The study used a mixed methods design. Eighteen Year 3 nursing students participated in the pre- and post-design study, which consisted of the development and implementation of a mental rehearsal strategy. The Rescuing A Patient In Deteriorating Situations (RAPIDS) tool was used to assess performance. Heart rates and systolic blood pressures were used to measure stress. The State-Trait Anxiety Inventory (STAI) was used as a psychological measure of stress/anxiety. Five participants were involved in a focus group discussion that evaluated the usefulness of the mental rehearsal strategy.

RESULTS

There was a significant improvement in performance (P<0.05). However, post-test heart rate and systolic blood pressure were not significantly different from pre-test measures. A comparison of STAI results did not show significant differences between pre- and post-test state anxiety and pre- and post-test trait anxiety. Three themes emerged from the focus group interview: managing stress, using a mental framework, and integrating realistic simulations with the mental rehearsal strategy.

CONCLUSION

The mental rehearsal strategy for deteriorating patient management can be valuable based on the findings on performance and based on the participants' feedback. Its role in reducing stress, however, needs further evaluation.

Comparison of standardized patients with high-fidelity simulators for managing stress and improving performance in clinical deterioration: A mixed methods study

BACKGROUND

The use of standardized patients in deteriorating patient simulations adds realism that can be valuable for preparing nurse trainees for stress and enhancing their performance during actual patient deterioration. Emotional engagement resulting from increased fidelity can provide additional stress for student nurses with limited exposure to real patients. To determine the presence of increased stress with the standardized patient modality, this study compared the use of standardized patients (SP) with the use of high-fidelity simulators (HFS) during deteriorating patient simulations. Performance in managing deteriorating patients was also compared. It also explored student nurses' insights on the use of standardized patients and patient simulators in deteriorating patient simulations as preparation for clinical placement.

METHODS

Fifty-seven student nurses participated in a randomized controlled design study with pre- and post-tests to evaluate stress and performance in deteriorating patient simulations. Performance was assessed using the Rescuing A Patient in Deteriorating Situations (RAPIDS) rating tool. Stress was measured using salivary alpha-amylase levels. Fourteen participants who joined the randomized controlled component then participated in focus group discussions that elicited their insights on SP use in patient deterioration simulations.

RESULTS

Analysis of covariance (ANCOVA) results showed no significant difference (p=0.744) between the performance scores of the SP and HFS groups in managing deteriorating patients. Amylase levels were also not significantly different (p=0.317) between the two groups. Stress in simulation, awareness of patient interactions, and realism were the main themes that resulted from the thematic analysis.

CONCLUSIONS

Performance and stress in deteriorating patient simulations with standardized patients did not vary from similar simulations using high-fidelity patient simulators. Data from focus group interviews, however, suggested that the use of standardized patients was perceived to be valuable in preparing students for actual patient deterioration management.

Understanding how residents' preferences for supervisory methods change throughout residency training: a mixed-methods study

BACKGROUND

A major challenge for clinical supervisors is to encourage their residents to be independent without jeopardising patient safety. Residents' preferences according to level of training on this regard have not been completely explored. This study has sought to investigate which teaching methods of the Cognitive Apprenticeship (CA) model junior, intermediate and senior residents preferred and why, and how these preferences differed between groups.

METHODS

We invited 301 residents of all residency programmes of Javeriana University, Bogotá, Colombia, to participate. Each resident was asked to complete a Maastricht Clinical Teaching Questionnaire (MCTQ), which, being based on the teaching methods of CA, asked residents to rate the importance to their learning of each teaching method and to indicate which of these they preferred the most and why.

RESULTS

A total of 215 residents (71 %) completed the questionnaire. All concurred that all CA teaching methods were important or very important to their learning, regardless of their level of training. However, the reasons for their preferences clearly differed between groups: junior and intermediate residents preferred teaching methods that were more supervisor-directed, such as modelling and coaching, whereas senior residents preferred teaching methods that were more resident-directed, such as exploration and articulation.

CONCLUSIONS

The results indicate that clinical supervision (CS) should accommodate to residents' varying degrees of development by attuning the configuration of CA teaching methods to each level of residency training. This configuration should initially vest more power in the supervisor, and gradually let the resident take charge, without ever discontinuing CS.

Theoretical perspectives and applications of group learning in PBL

An essential part of problem-based learning (PBL) is group learning. Thus, an in depth understanding of the theoretical underpinnings of group learning in PBL allows educators to bridge theory and practice more effectively thus providing ideas and tools to enhance PBL practices and research. The theory-driven applications examined in this article establish grounds for future research in PBL. The purpose of this article is to describe and examine two theoretical perspectives of group learning in PBL and their potential applications to improve educational practice. They include: (1) social interdependence theory and the meaning of positive interdependence, (2) socio cognitive theory of networked expertise and the concept of knowledge creation in innovative knowledge communities (IKC). Potential applications include the following: development of instructional material to foster positive interdependency using concept maps; formal and structured use of peer feedback throughout PBL courses to promote individual and group accountability; creation and sharing of new knowledge about different topics within and across IKC; and use of rotating students with hybrid abilities across PBL groups to foster distributed cognition.

Should we choose between problem-based learning and team-based learning? No, combine the best of both worlds!

BACKGROUND

To meet changes in society and health care, medical curricula require continuous improvement. A relatively new development in medical education is team-based learning (TBL). In the previous century, problem-based learning (PBL) emerged as an exciting new method.

AIMS

What are the similarities and differences between PBL and TBL? How do both approaches fit with current design principles? How might PBL and TBL benefit from each other's unique strengths?

METHODS

Analysis of the literature.

RESULTS

The overall similarities between PBL and TBL relate to the use of professionally relevant problems and small group learning, both fitting well with current instructional design principles. The main difference is that one teacher in TBL can run twenty or even more study teams, whereas in PBL each small group is run by one teacher.

CONCLUSION

In this paper we advocate for a joining of forces. By combining elements of PBL and TBL, we could create varied instructional approaches that are in keeping with current instructional design principles, thereby combining the best of both worlds to optimize student learning.

Impact of postgraduate training on communication skills teaching: a controlled study

Background

Observation of performance followed by feedback is the key to good teaching of communication skills in clinical practice. The fact that it occurs rarely is probably due to clinical supervisors’ perceived lack of competence to identify communication skills and give effective feedback. We evaluated the impact of a faculty development programme on communication skills teaching on clinical supervisors’ ability to identify residents’ good and poor communication skills and to discuss them interactively during feedback.

Methods

We conducted a pre-post controlled study in which clinical supervisors took part to a faculty development program on teaching communication skills in clinical practice. Outcome measures were the number and type of residents’ communication skills identified by supervisors in three videotaped simulated resident-patient encounters and the number and type of communication skills discussed interactively with residents during three feedback sessions.

Results

48 clinical supervisors (28 intervention group; 20 control group) participated. After the intervention, the number and type of communication skills identified did not differ between both groups. There was substantial heterogeneity in the number and type of communication skills identified. However, trained participants engaged in interactive discussions with residents on a significantly higher number of communication items (effect sizes 0.53 to 1.77); communication skills items discussed interactively included both structural and patient-centered elements that were considered important to be observed by expert teachers.

Conclusions

The faculty development programme did not increase the number of communication skills recognised by supervisors but was effective in increasing the number of communication issues discussed interactively in feedback sessions. Further research should explore the respective impact of accurate identification of communication skills and effective teaching skills on achieving more effective communication skills teaching in clinical practice.

Effectiveness of a training program in supervisors' ability to provide feedback on residents' communication skills

Teaching communication skills (CS) to residents during clinical practice remains problematic. Direct observation followed by feedback is a powerful way to teach CS in clinical practice. However, little is known about the effect of training on feedback skills in this field. Controlled studies are scarce as well as studies that go beyond self-reported data. The aim of the study was to develop and assess the effectiveness of a training program for clinical supervisors on how to give feedback on residents' CS in clinical practice. The authors designed a pretest-posttest controlled study in which clinical supervisors working in two different medical services were invited to attend a sequenced and multifaceted program in teaching CS over a period of 6-9 months. Outcome measures were self-perceived and observed feedback skills collected during questionnaires and three videotaped objective structured teaching encounters. The videotaped feedbacks made by the supervisors were analysed using a 20-item feedback rating instrument. Forty-eight clinical supervisors participated (28 in the intervention, 20 in the control group). After training, a higher percentage of trained participants self-reported and demonstrated statistically significant improvement in making residents more active by exploring residents' needs, stimulating self-assessment, and using role playing to test strategies and checking understanding, with effect sizes ranging from 0.93 to 4.94. A training program on how to give feedback on residents' communication skills was successful in improving clinical supervisors' feedback skills and in helping them operate a shift from a teacher-centered to a more learner-centered approach.

Learner preferences regarding integrating, sequencing and aligning virtual patients with other activities in the undergraduate medical curriculum: A focus group study

CONTEXT

E-learning resources, such as virtual patients (VPs), can be more effective when they are integrated in the curriculum. To gain insights that can inform guidelines for the curricular integration of VPs, we explored students' perceptions of scenarios with integrated and non-integrated VPs aimed at promoting clinical reasoning skills.

METHODS

During their paediatric clerkship, 116 fifth-year medical students were given at least ten VPs embedded in eight integrated scenarios and as non-integrated add-ons. The scenarios differed in the sequencing and alignment of VPs and related educational activities, tutor involvement, number of VPs, relevance to assessment and involvement of real patients. We sought students' perceptions on the VP scenarios in focus group interviews with eight groups of 4-7 randomly selected students (n = 39). The interviews were recorded, transcribed and analysed qualitatively.

RESULTS

The analysis resulted in six themes reflecting students' perceptions of important features for effective curricular integration of VPs: (i) continuous and stable online access, (ii) increasing complexity, adapted to students' knowledge, (iii) VP-related workload offset by elimination of other activities, (iv) optimal sequencing (e.g.: lecture--1 to 2 VP(s)--tutor-led small group discussion--real patient) and (V) optimal alignment of VPs and educational activities, (vi) inclusion of VP topics in assessment.

CONCLUSIONS

The themes appear to offer starting points for the development of a framework to guide the curricular integration of VPs. Their impact needs to be confirmed by studies using quantitative controlled designs.