1
|
Hindi AMK, Willis SC, Astbury J, Fenton C, Stearns S, Jacobs S, McDermott I, Moss A, Seston E, Schafheutle EI. Contribution of supervision to the development of advanced practitioners: a qualitative study of pharmacy learners' and supervisors' views. BMJ Open 2022; 12:e059026. [PMID: 35414562 PMCID: PMC9006828 DOI: 10.1136/bmjopen-2021-059026] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/04/2022] Open
Abstract
OBJECTIVE To apply educational theory to explore how supervision can contribute to the development of advanced practitioners using the example of several postregistration primary care training pathways for pharmacy professionals (pharmacists and pharmacy technicians). DESIGN Qualitative semistructured telephone interviews applying Billet's theory of workplace pedagogy for interpretation. SETTING England. PARTICIPANTS Fifty-one learners and ten supervisors. PRIMARY OUTCOME Contribution of clinical and educational supervision to the development of advanced practitioners in primary care. RESULTS Findings were mapped against the components of Billet's theory to provide insights into the role of supervision in developing advanced practitioners. Key elements for effective supervision included supporting learners to identify their learning needs (educational supervision), guiding learners in everyday work activities (clinical supervision), and combination of regular prearranged face-to-face meetings and ad hoc contact when needed (clinical supervision), along with ongoing support as learners progressed through a learning pathway (educational supervision). Clinical supervisors supported learners in developing proficiency and confidence in translating and applying the knowledge and skills they were gaining into practice. Learners benefited from having clinical supervisors in the workplace with good understanding and experience of working in the setting, as well as receiving clinical supervision from different types of healthcare professionals. Educational supervisors supported learners to identify their learning needs and the requirements of the learning pathway, and then as an ongoing available source of support as they progressed through a pathway. Educational supervisors also filled in some of the gaps where there was a lack of local clinical supervision and in settings like community pharmacy where pharmacist learners did not have access to any clinical supervision. CONCLUSIONS This study drew out important elements which contributed to effective supervision of pharmacy advanced practitioners. Findings can inform the education and training of advanced practitioners from different professions to support healthcare workforce development in different healthcare settings.
Collapse
Affiliation(s)
- Ali Mawfek Khaled Hindi
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry, The University of Manchester, Manchester, UK
- Division of Pharmacy, School of Health Sciences, Faculty of Biology Medicine and Health, The University of Manchester, Manchester, UK
| | - Sarah Caroline Willis
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry, The University of Manchester, Manchester, UK
| | - Jayne Astbury
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry, The University of Manchester, Manchester, UK
| | | | | | - Sally Jacobs
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry, The University of Manchester, Manchester, UK
- Division of Pharmacy, School of Health Sciences, Faculty of Biology Medicine and Health, The University of Manchester, Manchester, UK
| | - Imelda McDermott
- Centre for Primary Care, The University of Manchester, Manchester, UK
| | | | - Elizabeth Seston
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry, The University of Manchester, Manchester, UK
- Division of Pharmacy, School of Health Sciences, Faculty of Biology Medicine and Health, The University of Manchester, Manchester, UK
| | - Ellen Ingrid Schafheutle
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry, The University of Manchester, Manchester, UK
- Division of Pharmacy, School of Health Sciences, Faculty of Biology Medicine and Health, The University of Manchester, Manchester, UK
| |
Collapse
|
2
|
Hindi AMK, Willis SC, Schafheutle EI. Using communities of practice as a lens for exploring experiential pharmacy learning in general practice: Are communities of practice the way forward in changing the training culture in pharmacy? BMC MEDICAL EDUCATION 2022; 22:12. [PMID: 34980098 PMCID: PMC8722087 DOI: 10.1186/s12909-021-03079-8] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Accepted: 11/29/2021] [Indexed: 06/14/2023]
Abstract
BACKGROUND Currently, there is little experiential learning in general practice (GP) during UK undergraduate and postgraduate pharmacy education and training. AIM To apply educational theories to explore pharmacy stakeholders' perceptions of placements in general practice and contribute to the development of a model of experiential learning for pharmacy. METHODS Qualitative, semi-structured interviews, conducted as part of two studies exploring experiential learning in general practice, with learners and their GP based supervisors. Interviews explored experiences of learning and practice, and what aided or hindered this. An abductive approach to analysis combined inductive coding with deductive, theory-driven interpretation using Lave and Wenger's concept of "Communities of Practice". RESULTS Forty-four interviews were conducted, with learners and placement supervisors. Participants valued placements for providing authentic patient-facing learning experiences in the workplace, facilitated through legitimate peripheral participation by supervisors and supported by the use of pre- and de-briefing. Learners benefitted from support from their supervisor(s) and other staff during their day-to-day learning (informal learning), whilst also having protected time with their supervisors to discuss learning needs or go through workplace-based assessments (formal learning). Lack of clarity regarding which and how competencies should be assessed / demonstrated in general practice challenged monitoring progress from peripheral to full participation. Findings suggest that GP placements provide opportunities for learning about the patient journey between care settings; to work effectively with multidisciplinary teams; and consolidation and application of consultation / communication skills learning. CONCLUSIONS The learning culture of GP supports learners' development, providing time and opportunities for meaningful and authentic workplace learning, with healthcare professionals acting as supervisors and mentors. These findings can usefully inform implementation of meaningful learning opportunities in primary and secondary care for those involved in pharmacy education and training.
Collapse
Affiliation(s)
- Ali M. K. Hindi
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry; School of Health Sciences; Faculty of Biology, Medicine and Health, The University of Manchester, Oxford Road, Manchester, M13 9PT UK
| | - Sarah C. Willis
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry; School of Health Sciences; Faculty of Biology, Medicine and Health, The University of Manchester, Oxford Road, Manchester, M13 9PT UK
| | - Ellen I. Schafheutle
- Centre for Pharmacy Workforce Studies, Division of Pharmacy and Optometry; School of Health Sciences; Faculty of Biology, Medicine and Health, The University of Manchester, Oxford Road, Manchester, M13 9PT UK
| |
Collapse
|
3
|
Hyde C, Yardley S, Lefroy J, Gay S, McKinley RK. Clinical assessors' working conceptualisations of undergraduate consultation skills: a framework analysis of how assessors make expert judgements in practice. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2020; 25:845-875. [PMID: 31997115 PMCID: PMC7471149 DOI: 10.1007/s10459-020-09960-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/19/2019] [Accepted: 01/18/2020] [Indexed: 06/10/2023]
Abstract
Undergraduate clinical assessors make expert, multifaceted judgements of consultation skills in concert with medical school OSCE grading rubrics. Assessors are not cognitive machines: their judgements are made in the light of prior experience and social interactions with students. It is important to understand assessors' working conceptualisations of consultation skills and whether they could be used to develop assessment tools for undergraduate assessment. To identify any working conceptualisations that assessors use while assessing undergraduate medical students' consultation skills and develop assessment tools based on assessors' working conceptualisations and natural language for undergraduate consultation skills. In semi-structured interviews, 12 experienced assessors from a UK medical school populated a blank assessment scale with personally meaningful descriptors while describing how they made judgements of students' consultation skills (at exit standard). A two-step iterative thematic framework analysis was performed drawing on constructionism and interactionism. Five domains were found within working conceptualisations of consultation skills: Application of knowledge; Manner with patients; Getting it done; Safety; and Overall impression. Three mechanisms of judgement about student behaviour were identified: observations, inferences and feelings. Assessment tools drawing on participants' conceptualisations and natural language were generated, including 'grade descriptors' for common conceptualisations in each domain by mechanism of judgement and matched to grading rubrics of Fail, Borderline, Pass, Very good. Utilising working conceptualisations to develop assessment tools is feasible and potentially useful. Work is needed to test impact on assessment quality.
Collapse
Affiliation(s)
- Catherine Hyde
- School of Medicine, Keele University, Keele, Staffordshire, ST5 5BG, UK
| | - Sarah Yardley
- School of Medicine, Keele University, Keele, Staffordshire, ST5 5BG, UK.
- Palliative Care Service, Central and North West London NHS Foundation Trust, St Pancras Hospital, 5th Floor South Wing, 4 St. Pancras Way, London, NW1 0PE, UK.
| | - Janet Lefroy
- School of Medicine, Keele University, Keele, Staffordshire, ST5 5BG, UK
| | - Simon Gay
- University of Leicester School of Medicine, Leicester, UK
| | - Robert K McKinley
- School of Medicine, Keele University, Keele, Staffordshire, ST5 5BG, UK
| |
Collapse
|
4
|
Mikkola L, Suutala E, Parviainen H. Social support in the workplace for physicians in specialization training. MEDICAL EDUCATION ONLINE 2018; 23:1435114. [PMID: 29464988 PMCID: PMC5827784 DOI: 10.1080/10872981.2018.1435114] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/30/2017] [Accepted: 01/22/2018] [Indexed: 05/30/2023]
Abstract
When becoming a specialist, learning-through-service plays a significant role. The workplace affords good opportunities for learning, but the service-learning period may also impose stress on phycisians in specialization training. In medical work, social support has proved to be a very important factor in managing stress. Social support may afford advantages also for learning and professional identity building. However, little was known about how social support is perceived by doctors in specialization training. This study aimed to understand the perceptions of physicians in specialization training regarding social support communication in their workplace during their learning-through-service period. The study was conducted qualitatively by inductively analyzing the physicians' descriptions of workplace communication. The dataset included 120 essays, 60 each from hospitals and primary healthcare centres. Physicians in specialization training explained the need of social support with the responsibilities and demands of their clinical work and the inability to control and manage their workloads. They perceived that social support works well for managing stress, but also for strengthening relational ties and one's professional identity. A leader's support was perceived as being effective, and both senior and junior colleagues were described as an important source of social support. Also co-workers, such as the individual nurse partner with whom one works, was mentioned as an important source of social support. The results of this study indicate that social support works at the relational and identity levels, which is due to the multi-functional nature of workplace communication. For example, consultation functions as situational problem-solving, but also the tone of social interaction is meaningful. Thus, strengthening one's professional identity or collegial relationships requires further attention to workplace communication. Abbreviations PiST: Physician in specialization training.
Collapse
Affiliation(s)
- Leena Mikkola
- Department of Language and Communication Studies, University of Jyvaskyla, Jyvaskyla, Finland
| | - Elina Suutala
- Faculty of Social Sciences/Health Sciences, University of Tampere, Tampere, Finland
| | - Heli Parviainen
- Faculty of Social Sciences/Health Sciences, University of Tampere, Tampere, Finland
| |
Collapse
|
5
|
Schubach F, Goos M, Fabry G, Vach W, Boeker M. Virtual patients in the acquisition of clinical reasoning skills: does presentation mode matter? A quasi-randomized controlled trial. BMC MEDICAL EDUCATION 2017; 17:165. [PMID: 28915871 PMCID: PMC5603058 DOI: 10.1186/s12909-017-1004-2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2017] [Accepted: 09/05/2017] [Indexed: 05/28/2023]
Abstract
BACKGROUND The objective of this study is to compare two different instructional methods in the curricular use of computerized virtual patients in undergraduate medical education. We aim to investigate whether using many short and focused cases - the key feature principle - is more effective for the learning of clinical reasoning skills than using few long and systematic cases. METHODS We conducted a quasi-randomized, non-blinded, controlled parallel-group intervention trial in a large medical school in Southwestern Germany. During two seminar sessions, fourth- and fifth-year medical students (n = 56) worked on the differential diagnosis of the acute abdomen. The educational tool - virtual patients - was the same, but the instructional method differed: In one trial arm, students worked on multiple short cases, with the instruction being focused only on important elements ("key feature arm", n = 30). In the other trial arm, students worked on few long cases, with the instruction being comprehensive and systematic ("systematic arm", n = 26). The overall training time was the same in both arms. The students' clinical reasoning capacity was measured by a specifically developed instrument, a script concordance test. Their motivation and the perceived effectiveness of the instruction were assessed using a structured evaluation questionnaire. RESULTS Upon completion of the script concordance test with a reference score of 80 points and a standard deviation of 5 for experts, students in the key feature arm attained a mean of 57.4 points (95% confidence interval: 50.9-63.9), and in the systematic arm, 62.7 points (57.2-68.2), with Cohen's d at 0.337. The difference is statistically non-significant (p = 0.214). In the evaluation survey, students in the key feature arm indicated that they experienced more time pressure and perceived the material as more difficult. CONCLUSIONS In this study powered for a medium effect, we could not provide empirical evidence for the hypothesis that a key feature-based instruction on multiple short cases is superior to a systematic instruction on few long cases in the curricular implementation of virtual patients. The results of the evaluation survey suggest that learners should be given enough time to work through case examples, and that caution should be taken to prevent cognitive overload.
Collapse
Affiliation(s)
- Fabian Schubach
- Institute for Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Stefan-Meier-Str. 26, 79104 Freiburg i. Br., Germany
| | - Matthias Goos
- Department of General and Visceral Surgery, Helios Klinik Müllheim, Heliosweg, 79379 Müllheim, Germany
| | - Götz Fabry
- Department of Medical Psychology and Medical Sociology, Faculty of Medicine and Medical Center - University of Freiburg, Rheinstr. 12, 79104 Freiburg i. Br., Germany
| | - Werner Vach
- Institute for Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Stefan-Meier-Str. 26, 79104 Freiburg i. Br., Germany
| | - Martin Boeker
- Institute for Medical Biometry and Statistics, Faculty of Medicine and Medical Center - University of Freiburg, Stefan-Meier-Str. 26, 79104 Freiburg i. Br., Germany
| |
Collapse
|
6
|
Bates J, Ellaway RH. Mapping the dark matter of context: a conceptual scoping review. MEDICAL EDUCATION 2016; 50:807-16. [PMID: 27402041 DOI: 10.1111/medu.13034] [Citation(s) in RCA: 84] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/26/2015] [Revised: 12/07/2015] [Accepted: 01/20/2016] [Indexed: 05/08/2023]
Abstract
CONTEXT Like dark matter, the contexts for medical education are largely invisible to those within them, although context can have profound influences on teaching, learning and practice. For something that is so intrinsic to the field of medical education, the concept of context remains troubling to scholars and those running medical education programmes. This paper reports on a critical and conceptual review of the concept of context within the medical education literature and beyond. METHODS A review was undertaken drawing on two sources: concepts of context in the medical education literature, and concepts of context across multiple academic disciplines. This body of material was iteratively, discursively and inductively synthesised. RESULTS Few of the articles from the medical education literature described or defined context directly, tending instead to focus on describing specific elements of context, such as clinical disciplines, physical settings and political pressures, that could or did influence learning outcomes. The results were framed in terms of what context 'is', how context works (in terms of context-mechanism-outcome), and how context can be represented using patterns. The authors propose a definition of context in medical education, along with the means to model, contrast and compare different contexts based on recurring patterns. CONCLUSIONS Context matters in medical education and it can, despite many challenges, be considered systematically and objectively. The findings from this study both represent a catalyst and challenge medical education researchers to look at context afresh.
Collapse
Affiliation(s)
- Joanna Bates
- Centre for Health Education Scholarship, University of British Columbia, Vancouver, British Columbia, Canada
| | - Rachel H Ellaway
- Department of Community Health Sciences, University of Calgary, Calgary, Alberta, Canada
| |
Collapse
|
7
|
Teunissen PW. Experience, trajectories, and reifications: an emerging framework of practice-based learning in healthcare workplaces. ADVANCES IN HEALTH SCIENCES EDUCATION : THEORY AND PRACTICE 2015; 20:843-56. [PMID: 25269765 DOI: 10.1007/s10459-014-9556-y] [Citation(s) in RCA: 56] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/31/2014] [Accepted: 09/22/2014] [Indexed: 05/15/2023]
Abstract
Learning by working is omnipresent in healthcare education. It enables people to learn how to perform, think, and interact in ways that work for their specific context. In this paper, I review my approach to studying this process. It centers on the question why healthcare professionals do what they do and how their actions and learning are intertwined. The aim of this paper is to illustrate what I have learned from the research I have been involved in, in such a way that it enables other researchers, educators, and clinicians to understand and study practice-based learning in healthcare workplaces. Therefore, I build on a programmatic line of research to present a framework of practice-based learning consisting of three inextricably linked levels of analysis. The first level focuses on how situations lead to personal experiences, the second level looks at strings of experiences that lead to multiple trajectories, and the third level deals with reifications arising from recurrent activities. This framework, and its interrelations and inherent tensions, helps to understand why healthcare workplaces can be both a powerful learning environment and a frustratingly hard place to change.
Collapse
Affiliation(s)
- Pim W Teunissen
- Faculty of Health Medicine and Life Sciences, School of Health Professions Education (SHE), Maastricht University, P.O. Box 616, 6200 MD, Maastricht, The Netherlands.
| |
Collapse
|
8
|
Brand PLP, Landzaat-Berghuizen MA. Differences between observers in interpreting double-blind placebo-controlled food challenges: a randomized trial. Pediatr Allergy Immunol 2014; 25:755-9. [PMID: 25403147 DOI: 10.1111/pai.12313] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 11/14/2014] [Indexed: 11/30/2022]
Abstract
BACKGROUND Interpretation of double-blind placebo-controlled food challenges (DBPCFC) can be difficult, particularly with ambiguous subjective symptoms. Early opening of the challenge key (which day is verum and which placebo) may influence the clinician's interpretation of the DBPCFC result. METHODS Fifty-one clinicians reviewing results of 19 DBPCFCs with ambiguous clinical symptoms were randomized into a key first strategy (opening the DBPCFC key before reviewing the symptoms on both challenge days and deciding on the DBPCFC result) or a symptoms first strategy (reviewing symptoms and interpreting both test days as positive or negative before opening the key and deciding on the DBPCFC result). RESULTS The proportion of DBPCFCs considered inconclusive was comparable between the two strategy groups (p = 0.791). Participants in the symptoms first group were more likely to consider a DBPCFC as positive (in 14 tests, 73.7%) than subjects in the key first group (four tests, 21.1%). The number of positive tests was higher in the symptoms first group (median 50.0%, interquartile range [IQR] 23.1-76.9%) than in the key first groups (44.0%, IQR 12.0-68.0%, p = 0.031). This was independent of the participant's profession (pediatrician or other), age, gender, or years of experience (p > 0.3). CONCLUSIONS Clinicians differ in their interpretation of DBPCFC results when symptoms are ambiguous. Opening the key of a DBPCFC before reviewing and interpreting symptoms significantly reduces the likelihood of the challenge being interpreted as positive. Guidelines for performing DBPCFCs should standardize the moment of opening the challenge key.
Collapse
Affiliation(s)
- Paul L P Brand
- Princess Amalia Children's Centre, Isala Hospital, Zwolle, The Netherlands; UMCG Postgraduate School of Medicine, University Medical Centre and University of Groningen, Groningen, The Netherlands
| | | |
Collapse
|
9
|
Cristancho SM, Bidinosti SJ, Lingard LA, Novick RJ, Ott MC, Forbes TL. What's behind the scenes? Exploring the unspoken dimensions of complex and challenging surgical situations. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2014; 89:1540-7. [PMID: 25250744 PMCID: PMC5578758 DOI: 10.1097/acm.0000000000000478] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
PURPOSE Physicians regularly encounter challenging and/or complex situations in their practices; in training settings, they must help learners understand such challenges. Context becomes a fundamental construct when seeking to understand what makes a situation challenging and how physicians respond to it; however, the question of how physicians perceive context remains largely unexplored. If the goal is to teach trainees to deal with challenging situations, the medical education community requires an understanding of what "challenging" means for those in charge of training. METHOD The authors relied on visual methods for this research. In 2013, they collected 40 snapshots (i.e., data sets) from a purposeful sample of five faculty surgeons through a combination of interviews, observations, and drawing sessions. The analytical process involved three phases: analysis of each drawing, a compare-and-contrast analysis of multiple drawings, and a team analysis conducted in collaboration with three participating surgeons. RESULTS Findings demonstrate that experts perceive the challenge of surgical situations to extend beyond their procedural dimensions to include unspoken, nonprocedural dimensions-specifically, team dynamics, trust, emotions, and external pressures. CONCLUSIONS Findings show that analysis of surgeons' drawings is an effective means of gaining insight into surgeons' perceptions. The findings refine the common belief that procedural complexity is what makes a surgery challenging for expert surgeons. Focusing exclusively on the procedure during training may put trainees at risk of missing the "big picture." Understanding the multidimensionality of medical challenges and having a language to discuss these both verbally and visually will facilitate teaching around challenging situations.
Collapse
Affiliation(s)
- Sayra M Cristancho
- Dr. Cristancho is assistant professor, Department of Surgery, and scientist, Centre for Education Research & Innovation, Western University, London, Ontario, Canada. Ms. Bidinosti is research associate, Centre for Education Research & Innovation, Western University, London, Ontario, Canada. Dr. Lingard is professor, Department of Medicine, and director and scientist, Centre for Education Research & Innovation, Western University, London, Ontario, Canada. Dr. Novick is professor, Department of Surgery, Division of Cardiac Surgery, Western University, London, Ontario, Canada. Dr. Ott is associate professor, Department of Surgery, Division of General Surgery, Western University, London, Ontario, Canada. Dr. Forbes is professor and division chair/chief, Department of Surgery, Division of Vascular Surgery, Western University, London, Ontario, Canada
| | | | | | | | | | | |
Collapse
|
10
|
Tweed MJ, Thompson-Fawcett M, Wilkinson TJ. Decision-making bias in assessment: the effect of aggregating objective information and anecdote. MEDICAL TEACHER 2013; 35:832-7. [PMID: 23808651 DOI: 10.3109/0142159x.2013.803062] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
INTRODUCTION Assessment decisions increasingly rely on synthesis of information from a variety of sources. It is known that aggregation of information to make decisions is open to a number of biases. The aim of this research was to investigate bias, accuracy and confidence of assessment decision making. METHODS The participants were consultation skills assessors. A model for incremental information was developed with participants being shown results from purposefully selected, but authentic, data from the University's final summative 10-station Objective Structured Clinical Examination (OSCE). After each piece of information, participants gave a pass-fail decision and their confidence in that choice. Following the information from 10 OSCE stations the participants were given a discordant fictional anecdote and again participants gave a pass-fail decision and their confidence. RESULTS When there is overwhelming evidence to support a pass or fail, participants were not as confident as the data would support. Participants were less confident to make a fail decision than a pass. Despite considerable evidence from multiple results some participants altered decisions based on isolated contradictory information from an anecdote. DISCUSSION These findings are significant in understanding decision-making. Given equivalent levels of evidence, decision makers are less confident to fail than pass and less robust information can undermine more robust information.
Collapse
|
11
|
Watling C, Driessen E, van der Vleuten CPM, Vanstone M, Lingard L. Music lessons: revealing medicine's learning culture through a comparison with that of music. MEDICAL EDUCATION 2013; 47:842-50. [PMID: 23837431 DOI: 10.1111/medu.12235] [Citation(s) in RCA: 48] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/25/2012] [Revised: 12/10/2012] [Accepted: 03/12/2013] [Indexed: 05/11/2023]
Abstract
CONTEXT Research on medical learning has tended to focus on the individual learner, but a sufficient understanding of the learning process requires that attention also be paid to the essential influence of the cultural context within which learning takes place. In this study, we undertook a comparative examination of two learning cultures - those of music and medicine - in order to unearth assumptions about learning that are taken for granted within the medical culture. METHODS We used a constructivist grounded theory approach to explore experiences of learning within the two cultures. We conducted nine focus groups (two with medical students, three with residents, four with music students) and four individual interviews (with one clinician-educator, one music educator and two doctor-musicians), for a total of 37 participants. Analysis occurred alongside and informed data collection. Themes were identified iteratively using constant comparisons. RESULTS Cultural perspectives diverged in terms of where learning should occur, what learning outcomes are desired, and how learning is best facilitated. Whereas medicine valued learning by doing, music valued learning by lesson. Whereas medical learners aimed for competence, music students aimed instead for ever-better performance. Whereas medical learners valued their teachers for their clinical skills more than for their teaching abilities, the opposite was true in music, in which teachers' instructional skills were paramount. Self-assessment challenged learners in both cultures, but medical learners viewed self-assessment as a skill they could develop, whereas music students recognised that external feedback would always be required. CONCLUSIONS This comparative analysis reveals that medicine and music make culturally distinct assumptions about teaching and learning. The contrasts between the two cultures illuminate potential vulnerabilities in the medical learning culture, including the risks inherent in its competence-focused approach and the constraints it places on its own teachers. By highlighting these vulnerabilities, we provide a stimulus for reimagining and renewing medicine's educational practices.
Collapse
Affiliation(s)
- Christopher Watling
- Department of Clinic Neurological Sciences, Schulich School of Medicine and Dentistry, University of Western Ontario, London, Ontario, Canada.
| | | | | | | | | |
Collapse
|
12
|
ten Cate O, Brewster D, Cruess R, Calman K, Rogers W, Supe A, Gruppen L. Research fraud and its combat: what can a journal do? MEDICAL EDUCATION 2013; 47:638-640. [PMID: 23746151 DOI: 10.1111/medu.12197] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
|
13
|
Abstract
This critical review found Dutch research to be strong at the undergraduate and residency levels and more or less absent in continuing medical education. It confirms the importance of coaching medical students, giving constructive feedback, and ensuring practice environments are conducive to learning though it has proved hard to improve them. Residents learn primarily from experiences encountered in the course of clinical work but the fine balance between delivering clinical services and learning can easily be upset by work pressure. More intervention studies are needed. Qualitative research designs need to be more methodologically sophisticated and use a wider range of data sources including direct observation, audio-diaries, and text analysis. Areas for improvement are clear but achieving results will require persistence and patience.
Collapse
Affiliation(s)
- Tim Dornan
- Department of Educational Development and Research, Maastricht University, PO Box 616, 6200 MD Maastricht, The Netherlands
| |
Collapse
|
14
|
Yardley S, Teunissen PW, Dornan T. Experiential learning: transforming theory into practice. MEDICAL TEACHER 2012; 34:161-4. [PMID: 22288996 DOI: 10.3109/0142159x.2012.643264] [Citation(s) in RCA: 145] [Impact Index Per Article: 12.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
Whilst much is debated about the importance of experiential learning in curriculum development, the concept only becomes effective if it is applied in an appropriate way. We believe that this effectiveness is directly related to a sound understanding of the theory, supporting the learning. The purpose of this article is to introduce readers to the theories underpinning experiential learning, which are then expanded further in an AMEE Guide, which considers the theoretical basis of experiential learning from a social learning, constructionist perspective and applies it to three stages of medical education: early workplace experience, clerkships and residency. This article argues for the importance and relevance of experiential learning and addresses questions that are commonly asked about it. First, we answer the questions 'what is experiential learning?' and 'how does it relate to social learning theory?' to orientate readers to the principles on which our arguments are based. Then, we consider why those ideas (theories) are relevant to educators--ranging from those with responsibilities for curriculum design to 'hands-on' teachers and workplace supervisors. The remainder of this article discusses how experiential learning theories and a socio-cultural perspective can be applied in practice. We hope that this will give readers a taste for our more detailed AMEE Guide and the further reading recommended at the end of it.
Collapse
Affiliation(s)
- Sarah Yardley
- Keele Medical School, Keele University, Staffordshire, UK.
| | | | | |
Collapse
|
15
|
Abstract
This Guide provides an overview of educational theory relevant to learning from experience. It considers experience gained in clinical workplaces from early medical student days through qualification to continuing professional development. Three key assumptions underpin the Guide: learning is 'situated'; it can be viewed either as an individual or a collective process; and the learning relevant to this Guide is triggered by authentic practice-based experiences. We first provide an overview of the guiding principles of experiential learning and significant historical contributions to its development as a theoretical perspective. We then discuss socio-cultural perspectives on experiential learning, highlighting their key tenets and drawing together common threads between theories. The second part of the Guide provides examples of learning from experience in practice to show how theoretical stances apply to clinical workplaces. Early experience, student clerkships and residency training are discussed in turn. We end with a summary of the current state of understanding.
Collapse
|
16
|
Sibbald M, Cavalcanti RB. The biasing effect of clinical history on physical examination diagnostic accuracy. MEDICAL EDUCATION 2011; 45:827-834. [PMID: 21752079 DOI: 10.1111/j.1365-2923.2011.03997.x] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/27/2023]
Abstract
CONTEXT Literature on diagnostic test interpretation has shown that access to clinical history can both enhance diagnostic accuracy and increase diagnostic error. Knowledge of clinical history has also been shown to enhance the more complex cognitive task of physical examination diagnosis, possibly by enabling early hypothesis generation. However, it is unclear whether clinicians adhere to these early hypotheses in the face of unexpected physical findings, thus resulting in diagnostic error. METHODS A sample of 180 internal medicine residents received a short clinical history and conducted a cardiac physical examination on a high-fidelity simulator. Resident Doctors (Residents) were randomised to three groups based on the physical findings in the simulator. The concordant group received physical examination findings consistent with the diagnosis that was most probable based on the clinical history. Discordant groups received findings associated with plausible alternative diagnoses which either lacked expected findings (indistinct discordant) or contained unexpected findings (distinct discordant). Physical examination diagnostic accuracy and physical examination findings were analysed. RESULTS Physical examination diagnostic accuracy varied significantly among groups (75 ± 44%, 2 ± 13% and 31 ± 47% in the concordant, indistinct discordant and distinct discordant groups, respectively (F(2,177) = 53, p < 0.0001). Of the 115 Residents who were diagnostically unsuccessful, 33% adhered to their original incorrect hypotheses. Residents verbalised an average of 12 findings (interquartile range: 10-14); 58 ± 17% were correct and the percentage of correct findings was similar in all three groups (p = 0.44). CONCLUSIONS Residents showed substantially decreased diagnostic accuracy when faced with discordant physical findings. The majority of trainees given discordant physical findings rejected their initial hypotheses, but were still diagnostically unsuccessful. These results suggest that overcoming the bias induced by a misleading clinical history may involve two independent steps: rejection of the incorrect initial hypothesis, and selection of the correct diagnosis. Educational strategies focused solely on prompting clinicians to re-examine their hypotheses may be insufficient to reduce diagnostic error.
Collapse
Affiliation(s)
- Matthew Sibbald
- Division of Cardiology, Department of Medicine, Faculty of Medicine, University of Toronto, Ontario, Canada.
| | | |
Collapse
|
17
|
Dietrich JE, Tran XG, Giardino AP. Bleeding disorder education in obstetrics and gynecology residency training: a national survey. J Pediatr Adolesc Gynecol 2011; 24:94-7. [PMID: 21190875 DOI: 10.1016/j.jpag.2010.11.005] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/14/2010] [Revised: 11/03/2010] [Accepted: 11/11/2010] [Indexed: 11/18/2022]
Abstract
STUDY OBJECTIVE The purpose of this study was to assess the educational approach to the bleeding disorder evaluation in Obstetrics and Gynecology residency training programs in the continental United States. Information was sought from chief residents regarding training experiences and fund of knowledge regarding the evaluation of menorrhagia and diagnosis of bleeding disorders during their residency. DESIGN A 24-item questionnaire was sent to the chief residents at 241 non-military Obstetrics and Gynecology residency programs. SETTING The study was conducted at Texas Children's Health Plan in Houston, Texas. PARTICIPANTS Chief residents at 241 non-military Obstetrics and Gynecology residency programs. MAIN OUTCOME MEASURES Responses to questionnaires. RESULTS The overall response rate was 30%. Residents reported training in the medical evaluation of menorrhagia during residency with a mean of 9.1 hours per year in the first year of residency and 11.1 hours/year in the 2(nd), 3(rd) and 4(th) years; 67.7% reported they viewed their training in the medical evaluation of menorrhagia and bleeding disorders as sufficient preparation for clinical practice; and over two thirds reported specific training in common bleeding disorders, such as von Willebrand disease. CONCLUSION The current state of training in the evaluation of menorrhagia and bleeding disorders appeared to be mixed regarding the evaluation of dysfunctional uterine bleeding. An area for improvement was identified to better approach best clinical practice in the evaluation of women with menorrhagia and underlying bleeding disorders, which can be guided by the thoughtful approach taken in the recent NHLBI von Willebrand disease guidelines.
Collapse
Affiliation(s)
- Jennifer E Dietrich
- Department of Obstetrics and Gynecology, Baylor College of Medicine, Texas Children's Hospital, Texas, USA
| | | | | |
Collapse
|
18
|
Sibbald M, Panisko D, Cavalcanti RB. Role of clinical context in residents' physical examination diagnostic accuracy. MEDICAL EDUCATION 2011; 45:415-21. [PMID: 21401690 DOI: 10.1111/j.1365-2923.2010.03896.x] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/16/2023]
Abstract
CONTEXT Clinical context may act as both an aid to decision making and a source of bias contributing to medical error. The effect of clinical history, a form of clinical context, on the diagnostic accuracy of the physical examination is unknown. METHODS We randomised internal medicine residents to receive either no history or a short stem suggestive of one of six cardiac valvular diagnoses prior to a 10-minute objective structured clinical examination station assessing cardiac examination skills using a high-fidelity simulator. Clinical performance and diagnostic accuracy were compared using a standardised checklist. RESULTS A total of 159 internal medicine residents were enrolled after providing informed consent. Of these, 80% arrived at the correct diagnosis, with diagnostic accuracy varying significantly by valve lesion (49-100%; p < 0.0001). Clinical context was associated with improved diagnostic accuracy compared with no history (90% versus 74%; likelihood ratio= 6.6, p < 0.0001), but was not associated with trainees' ability to identify and characterise physical findings. Among residents given clinical context, higher diagnostic accuracy was only achieved by those able to correctly predict the diagnosis from the history. CONCLUSIONS Clinical context is associated with enhanced diagnostic accuracy of common valvular lesions. However, this effect seems linked to heuristic hypothesis generation and may predispose to premature diagnostic closure, anchoring and confirmation bias.
Collapse
|
19
|
Teunissen PW. On the transfer of theory to the practice of research and education. MEDICAL EDUCATION 2010; 44:534-5. [PMID: 20604846 DOI: 10.1111/j.1365-2923.2010.03637.x] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/17/2023]
|
20
|
Cannon-Bowers JA, Bowers C, Procci K. Optimizing Learning in Surgical Simulations: Guidelines from the Science of Learning and Human Performance. Surg Clin North Am 2010; 90:583-603. [PMID: 20497828 DOI: 10.1016/j.suc.2010.02.006] [Citation(s) in RCA: 37] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Affiliation(s)
- Janis A Cannon-Bowers
- Institute for Simulation & Training, University of Central Florida, Orlando, FL 32826, USA.
| | | | | |
Collapse
|
21
|
Schout BMA, Hendrikx AJM, Scheele F, Bemelmans BLH, Scherpbier AJJA. Validation and implementation of surgical simulators: a critical review of present, past, and future. Surg Endosc 2009; 24:536-46. [PMID: 19633886 PMCID: PMC2821618 DOI: 10.1007/s00464-009-0634-9] [Citation(s) in RCA: 152] [Impact Index Per Article: 10.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2009] [Revised: 05/31/2009] [Accepted: 06/26/2009] [Indexed: 11/25/2022]
Abstract
BACKGROUND In the past 20 years the surgical simulator market has seen substantial growth. Simulators are useful for teaching surgical skills effectively and with minimal harm and discomfort to patients. Before a simulator can be integrated into an educational program, it is recommended that its validity be determined. This study aims to provide a critical review of the literature and the main experiences and efforts relating to the validation of simulators during the last two decades. METHODS Subjective and objective validity studies between 1980 and 2008 were identified by searches in Pubmed, Cochrane, and Web of Science. RESULTS Although several papers have described definitions of various subjective types of validity, the literature does not offer any general guidelines concerning methods, settings, and data interpretation. Objective validation studies on endourological simulators were mainly characterized by a large variety of methods and parameters used to assess validity and in the definition and identification of expert and novice levels of performance. CONCLUSION Validity research is hampered by a paucity of widely accepted definitions and measurement methods of validity. It would be helpful to those considering the use of simulators in training programs if there were consensus on guidelines for validating surgical simulators and the development of training programs. Before undertaking a study to validate a simulator, researchers would be well advised to conduct a training needs analysis (TNA) to evaluate the existing need for training and to determine program requirements in a training program design (TPD), methods that are also used by designers of military simulation programs. Development and validation of training models should be based on a multidisciplinary approach involving specialists (teachers), residents (learners), educationalists (teaching the teachers), and industrial designers (providers of teaching facilities). In addition to technical skills, attention should be paid to contextual, interpersonal, and task-related factors.
Collapse
Affiliation(s)
- B M A Schout
- Department of Urology, VU University Medical Centre Amsterdam, Amsterdam, The Netherlands.
| | | | | | | | | |
Collapse
|
22
|
Teunissen PW, Stapel DA, van der Vleuten C, Scherpbier A, Boor K, Scheele F. Who wants feedback? An investigation of the variables influencing residents' feedback-seeking behavior in relation to night shifts. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2009; 84:910-7. [PMID: 19550188 DOI: 10.1097/acm.0b013e3181a858ad] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/14/2023]
Abstract
PURPOSE The literature on feedback in clinical medical education has predominantly treated trainees as passive recipients. Past research has focused on how clinical supervisors can use feedback to improve a trainee's performance. On the basis of research in social and organizational psychology, the authors reconceptualized residents as active seekers of feedback. They investigated what individual and situational variables influence residents' feedback-seeking behavior on night shifts. METHOD Early in 2008, the authors sent obstetrics-gynecology residents in the Netherlands--both those in their first two years of graduate training and those gaining experience between undergraduate and graduate training--a questionnaire that assessed four predictor variables (learning and performance goal orientation, and instrumental and supportive leadership), two mediator variables (perceived feedback benefits and costs), and two outcome variables (frequency of feedback inquiry and monitoring). They used structural equation modeling software to test a hypothesized model of relationships between variables. RESULTS The response rate was 76.5%. Results showed that residents who perceive more feedback benefits report a higher frequency of feedback inquiry and monitoring. More perceived feedback costs result mainly in more feedback monitoring. Residents with a higher learning goal orientation perceive more feedback benefits and fewer costs. Residents with a higher performance goal orientation perceive more feedback costs. Supportive physicians lead residents to perceive more feedback benefits and fewer costs. CONCLUSIONS This study showed that some residents actively seek feedback. Residents' feedback-seeking behavior partially depends on attending physicians' supervisory style. Residents' goal orientations influence their perceptions of the benefits and costs of feedback-seeking.
Collapse
|