1
|
Mills LM, Boscardin C, Joyce EA, Ten Cate O, O'Sullivan PS. Emotion in remediation: A scoping review of the medical education literature. MEDICAL EDUCATION 2021; 55:1350-1362. [PMID: 34355413 DOI: 10.1111/medu.14605] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Revised: 07/28/2021] [Accepted: 07/31/2021] [Indexed: 05/15/2023]
Abstract
OBJECTIVES Remediation can be crucial and high stakes for medical learners, and experts agree it is often not optimally conducted. Research from other fields indicates that explicit incorporation of emotion improves education because of emotion's documented impacts on learning. Because this could present an important opportunity for improving remediation, we aimed to investigate how the literature on remediation interventions in medical education discusses emotion. METHODS The authors used Arksey and O'Malley's framework to conduct a scoping literature review of records describing remediation interventions in medical education, using PubMed, CINAHL Complete, ERIC, Web of Science and APA PsycInfo databases, including all English-language publications through 1 May 2020 meeting search criteria. They included publications discussing remediation interventions either empirically or theoretically, pertaining to physicians or physician trainees of any level. Two independent reviewers used a standardised data extraction form to report descriptive information; they reviewed included records for the presence of mentions of emotion, described the mentions and analysed results thematically. RESULTS Of 1644 records, 199 met inclusion criteria and were reviewed in full. Of those, 112 (56%) mentioned emotion in some way; others focused solely on cognitive aspects of remediation. The mentions of emotion fell into three themes based on when the emotion was cited as present: during regular coursework or practice, upon referral for remediation and during remediation. One-quarter of records (50) indicated potential intentional incorporation of emotion into remediation programme design, but they were non-specific as to how emotions related to the learning process itself. CONCLUSION Even though emotion is omnipresent in remediation, medical educators frequently do not factor emotion into the design of remediation approaches and rarely explicitly utilise emotion to improve the learning process. Applications from other fields may help medical educators leverage emotion to improve learning in remediation, including strategies to frame and design remediation.
Collapse
Affiliation(s)
- Lynnea M Mills
- Department of Medicine, University of California, San Francisco, San Francisco, CA, USA
| | - Christy Boscardin
- Department of Anaesthesia and Perioperative Care and Medicine, University of California, San Francisco, San Francisco, CA, USA
| | - Elizabeth A Joyce
- Department of Microbiology and Immunology, University of California, San Francisco, San Francisco, CA, USA
| | - Olle Ten Cate
- Center for Research and Development of Education, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Patricia S O'Sullivan
- Departments of Medicine and Surgery, University of California, San Francisco, San Francisco, CA, USA
| |
Collapse
|
2
|
Price T, Wong G, Withers L, Wanner A, Cleland J, Gale T, Prescott-Clements L, Archer J, Bryce M, Brennan N. Optimising the delivery of remediation programmes for doctors: A realist review. MEDICAL EDUCATION 2021; 55:995-1010. [PMID: 33772829 DOI: 10.1111/medu.14528] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/24/2020] [Revised: 03/16/2021] [Accepted: 03/19/2021] [Indexed: 05/15/2023]
Abstract
CONTEXT Medical underperformance puts patient safety at risk. Remediation, the process that seeks to 'remedy' underperformance and return a doctor to safe practice, is therefore a crucially important area of medical education. However, although remediation is used in health care systems globally, there is limited evidence for the particular models or strategies employed. The purpose of this study was to conduct a realist review to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety. METHOD We conducted a realist literature review consistent with RAMESES standards. We developed a programme theory of remediation by carrying out a systematic search of the literature and through regular engagement with a stakeholder group. We searched bibliographic databases (MEDLINE, EMBASE, PsycINFO, HMIC, CINAHL, ERIC, ASSIA and DARE) and conducted purposive supplementary searches. Relevant sections of text relating to the programme theory were extracted and synthesised using a realist logic of analysis to identify context-mechanism-outcome configurations (CMOcs). RESULTS A 141 records were included. The majority of the studies were from North America (64%). 29 CMOcs were identified. Remediation programmes are effective when a doctor's insight and motivation are developed and behaviour change reinforced. Insight can be developed by providing safe spaces, using advocacy to promote trust and framing feedback sensitively. Motivation can be enhanced by involving the doctor in remediation planning, correcting causal attribution, goal setting and destigmatising remediation. Sustained change can be achieved by practising new behaviours and skills, and through guided reflection. CONCLUSION Remediation can work when it creates environments that trigger behaviour change mechanisms. Our evidence synthesis provides detailed recommendations on tailoring implementation and design strategies to improve remediation interventions for doctors.
Collapse
Affiliation(s)
- Tristan Price
- Collaboration for the Advancement of Medical Education Research and Assessment, Faculty of Health, University of Plymouth, Plymouth, UK
| | - Geoff Wong
- Nuffield Department of Primary Care, Health Sciences, University of Oxford, Oxford, UK
| | | | - Amanda Wanner
- NIHR Collaboration for Leadership in Applied Health Research and Care South West Peninsula (PenCLAHRC), Community and Primary Care Research Group, University of Plymouth, Plymouth, UK
| | - Jennifer Cleland
- Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore City, Singapore
| | - Tom Gale
- Collaboration for the Advancement of Medical Education Research and Assessment, Faculty of Health, University of Plymouth, Plymouth, UK
| | | | - Julian Archer
- Faculty of Medicine, Nursing and Healthcare, Monash University, Melbourne, Vic., Australia
| | - Marie Bryce
- Collaboration for the Advancement of Medical Education Research and Assessment, Faculty of Health, University of Plymouth, Plymouth, UK
| | - Nicola Brennan
- Collaboration for the Advancement of Medical Education Research and Assessment, Faculty of Health, University of Plymouth, Plymouth, UK
| |
Collapse
|
3
|
Price T, Brennan N, Wong G, Withers L, Cleland J, Wanner A, Gale T, Prescott-Clements L, Archer J, Bryce M. Remediation programmes for practising doctors to restore patient safety: the RESTORE realist review. HEALTH SERVICES AND DELIVERY RESEARCH 2021. [DOI: 10.3310/hsdr09110] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Background
An underperforming doctor puts patient safety at risk. Remediation is an intervention intended to address underperformance and return a doctor to safe practice. Used in health-care systems all over the world, it has clear implications for both patient safety and doctor retention in the workforce. However, there is limited evidence underpinning remediation programmes, particularly a lack of knowledge as to why and how a remedial intervention may work to change a doctor’s practice.
Objectives
To (1) conduct a realist review of the literature to ascertain why, how, in what contexts, for whom and to what extent remediation programmes for practising doctors work to restore patient safety; and (2) provide recommendations on tailoring, implementation and design strategies to improve remediation interventions for doctors.
Design
A realist review of the literature underpinned by the Realist And MEta-narrative Evidence Syntheses: Evolving Standards quality and reporting standards.
Data sources
Searches of bibliographic databases were conducted in June 2018 using the following databases: EMBASE, MEDLINE, Cumulative Index to Nursing and Allied Health Literature, PsycINFO, Education Resources Information Center, Database of Abstracts of Reviews of Effects, Applied Social Sciences Index and Abstracts, and Health Management Information Consortium. Grey literature searches were conducted in June 2019 using the following: Google Scholar (Google Inc., Mountain View, CA, USA), OpenGrey, NHS England, North Grey Literature Collection, National Institute for Health and Care Excellence Evidence, Electronic Theses Online Service, Health Systems Evidence and Turning Research into Practice. Further relevant studies were identified via backward citation searching, searching the libraries of the core research team and through a stakeholder group.
Review methods
Realist review is a theory-orientated and explanatory approach to the synthesis of evidence that seeks to develop programme theories about how an intervention produces its effects. We developed a programme theory of remediation by convening a stakeholder group and undertaking a systematic search of the literature. We included all studies in the English language on the remediation of practising doctors, all study designs, all health-care settings and all outcome measures. We extracted relevant sections of text relating to the programme theory. Extracted data were then synthesised using a realist logic of analysis to identify context–mechanism–outcome configurations.
Results
A total of 141 records were included. Of the 141 studies included in the review, 64% related to North America and 14% were from the UK. The majority of studies (72%) were published between 2008 and 2018. A total of 33% of articles were commentaries, 30% were research papers, 25% were case studies and 12% were other types of articles. Among the research papers, 64% were quantitative, 19% were literature reviews, 14% were qualitative and 3% were mixed methods. A total of 40% of the articles were about junior doctors/residents, 31% were about practicing physicians, 17% were about a mixture of both (with some including medical students) and 12% were not applicable. A total of 40% of studies focused on remediating all areas of clinical practice, including medical knowledge, clinical skills and professionalism. A total of 27% of studies focused on professionalism only, 19% focused on knowledge and/or clinical skills and 14% did not specify. A total of 32% of studies described a remediation intervention, 16% outlined strategies for designing remediation programmes, 11% outlined remediation models and 41% were not applicable. Twenty-nine context–mechanism–outcome configurations were identified. Remediation programmes work when they develop doctors’ insight and motivation, and reinforce behaviour change. Strategies such as providing safe spaces, using advocacy to develop trust in the remediation process and carefully framing feedback create contexts in which psychological safety and professional dissonance lead to the development of insight. Involving the remediating doctor in remediation planning can provide a perceived sense of control in the process and this, alongside correcting causal attribution, goal-setting, destigmatising remediation and clarity of consequences, helps motivate doctors to change. Sustained change may be facilitated by practising new behaviours and skills and through guided reflection.
Limitations
Limitations were the low quality of included literature and limited number of UK-based studies.
Future work
Future work should use the recommendations to optimise the delivery of existing remediation programmes for doctors in the NHS.
Study registration
This study is registered as PROSPERO CRD42018088779.
Funding
This project was funded by the National Institute for Health Research (NIHR) Health Services and Delivery Research programme and will be published in full in Health Services and Delivery Research; Vol. 9, No. 11. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Tristan Price
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| | - Nicola Brennan
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| | - Geoff Wong
- Nuffield Department of Primary Care Health Sciences, University of Oxford, Oxford, UK
| | | | - Jennifer Cleland
- Medical Education Research and Scholarship Unit (MERSU), Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore
| | - Amanda Wanner
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| | - Thomas Gale
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| | | | - Julian Archer
- Medicine, Nursing and Health Sciences Education Portfolio, Monash University, Melbourne, VIC, Australia
| | - Marie Bryce
- Collaboration for the Advancement of Medical Education Research and Assessment (CAMERA), Faculty of Health, University of Plymouth, Plymouth, UK
| |
Collapse
|
4
|
Swiggart WH, Bills JL, Penberthy JK, Dewey CM, Worley LL. A Professional Development Course Improves Unprofessional Physician Behavior. Jt Comm J Qual Patient Saf 2020; 46:64-71. [DOI: 10.1016/j.jcjq.2019.11.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2019] [Revised: 11/07/2019] [Accepted: 11/11/2019] [Indexed: 10/25/2022]
|
5
|
Dapueto JJ, Viera M, Samenow C, Swiggart WH, Steiger J. A Tale of Two Countries: Innovation and Collaboration Aimed at Changing the Culture of Medicine in Uruguay. HEC Forum 2019; 30:329-339. [PMID: 29752645 DOI: 10.1007/s10730-018-9351-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
This is a case study of a program to address professionalism at the Universidad de la República in Uruguay. We describe a five-year ongoing international collaboration. Relevant characteristics of the context, the program components, activities, and results were analyzed. The expected outcomes were to introduce standards of professional practices in the curricula of medical students and residents and the implementation of a program that might lead to a significant change in the culture of medicine in the University. Traditional didactics, interactive theater, and professional development workshops, issues such as teamwork and communication, professional behavior, and the culture of medicine, and physician wellness were addressed. A total of 359 faculty members, general practitioners, stakeholders, and other healthcare professionals (nurses, psychologists, social workers) participated in the intervention. The process led to specific achievements including new content in the curricula, the use of educational innovations to address issues of professionalism, a growing institutional culture of accountability, and the establishment of new rules and regulations. The strategies and interventions followed in the case of Uruguay can serve as a model to other developing countries to promote physician professionalism, wellness, and joy.
Collapse
Affiliation(s)
- Juan J Dapueto
- Medical Psychology Department, Facultad de Medicina, Universidad de la República, Hospital de Clínicas piso15, Av. Italia 2870, 11600, Montevideo, Uruguay.
| | - Mercedes Viera
- Medical Psychology Department, Facultad de Medicina, Universidad de la República, Hospital de Clínicas piso15, Av. Italia 2870, 11600, Montevideo, Uruguay
| | - Charles Samenow
- Department of Psychiatry and Behavioral Sciences, George Washington University School of Medicine, Washington, DC, USA
| | - William H Swiggart
- Center for Professional Health, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Jeffrey Steiger
- Department of Psychiatry and Behavioral Sciences, George Washington University School of Medicine, Washington, DC, USA
| |
Collapse
|
6
|
Sokol RG, Shaughnessy AF. Making the Most of Continuing Medical Education: Evidence of Transformative Learning During a Course in Evidence-Based Medicine and Decision Making. THE JOURNAL OF CONTINUING EDUCATION IN THE HEALTH PROFESSIONS 2018; 38:102-109. [PMID: 29851715 DOI: 10.1097/ceh.0000000000000199] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
INTRODUCTION Continuing medical information courses have been criticized for not promoting behavior change among their participants. For behavior change to occur, participants often need to consciously reject previous ideas and transform their way of thinking. Transformational learning is a process that cultivates deep emotional responses and can lead to cognitive and behavioral change in learners, potentially facilitating rich learning experiences and expediting knowledge translation. We explored participants' experiences at a 2-day conference designed to support transformative learning as they encounter new concepts within Information Mastery, which challenge their previous frameworks around the topic of medical decision making. Using the lens of transformative learning theory, we asked: how does Information Mastery qualitatively promote perspective transformation and hence behavior change? METHODS We used a hermeneutic phenomenologic approach to capture the lived experience of 12 current and nine previous attendees of the "Information Mastery" course through individual interviews, focus groups, and observation. Data were thematically analyzed. RESULTS Both prevoius and current conference attendees described how the delivery of new concepts about medical decision making evoked strong emotional responses, facilitated personal transformation, and propelled expedited behavior change around epistemological, moral, and information management themes, resulting in a newfound sense of self-efficacy, confidence, and ownership in their ability to make medical decisions. DISCUSSION When the topic area holds the potential to foster a qualitative reframing of learners' guiding paradigms and worldviews, attention should be paid to supporting learners' personalized meaning-making process through transformative learning opportunities to promote translation into practice.
Collapse
Affiliation(s)
- Randi G Sokol
- Dr. Sokol: Assistant Professor of Family Medicine, Tufts Family Medicine Residency Program at Cambridge Health Alliance, Malden, MA. Dr. Shaughnessy: Professor of Family Medicine, Professor of Public Health and Community Medicine, Tufts University School of Medicine, Malden, MA
| | | |
Collapse
|
7
|
Setchell J, Nicholls DA, Gibson BE. Objecting: Multiplicity and the practice of physiotherapy. Health (London) 2017; 22:165-184. [DOI: 10.1177/1363459316688519] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Drawing from Annemarie Mol’s conceptulisation of multiplicity, we explore how health care practices enact their object(s), using physiotherapy as our example. Our concern is particularly to mobilise ways of practicing or doing physiotherapy that are largely under-theorised, unexamined or marginalised. This approach explores those actions that reside in the interstitial spaces around, beneath and beyond the limits of established practices. Using Mol’s understanding of multiplicity as a theoretical and methodological driver, we argue that physiotherapy in practice often subverts the ubiquitous reductive discourses of biomedicine. Physiotherapy thus enacts multiple objects that it then works to suppress. We argue that highlighting multiplicities opens up physiotherapy as a space which can broaden the objects of practice and resist the kinds of closure that have become emblematic of contemporary physiotherapy practice. Using an exemplar from a rehabilitation setting, we explore how physiotherapists construct their object(s) and consider how multiplicity informs an otherwise physiotherapy that has broader implications for health care and rehabilitation.
Collapse
Affiliation(s)
- Jenny Setchell
- University of Toronto, Canada; The University of Queensland, Australia
| | | | | |
Collapse
|
8
|
MacDonald K, Sciolla AF, Folsom D, Bazzo D, Searles C, Moutier C, Thomas ML, Borton K, Norcross B. Individual risk factors for physician boundary violations: the role of attachment style, childhood trauma and maladaptive beliefs. Gen Hosp Psychiatry 2015; 37:489-96. [PMID: 26554082 DOI: 10.1016/j.genhosppsych.2015.06.002] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
OBJECTIVE The assessment and remediation of boundary-challenged healthcare professionals is enhanced through examination of individual risk factors. We assessed three such factors--attachment style, childhood trauma and maladaptive beliefs--in 100 attendees (mostly physicians) of a CME professional boundaries course. We propose a theoretical model which draws a causal arc from childhood maltreatment through insecure attachment and maladaptive beliefs to elevated risk for boundary violations. METHODS We administered the Experiences in Close Relationship Questionnaire (ECR-R), Childhood Trauma Questionnaire (CTQ), and Young Schema Questionnaire (YSQ) to 100 healthcare professionals (mostly physicians) attending a CME course on professional boundaries. Experts rated participant autobiographies to determine attachment style and early adversities. Correlations and relationships among self- and expert ratings and between different risk factors were examined. RESULTS Five percent of participants reported CTQ total scores in the moderate to severe range; eleven percent reported moderate to severe emotional neglect or emotional abuse. Average attachment anxiety and attachment avoidance were low, and more than half of participants were rated “secure” by experts. Childhood maltreatment was correlated with attachment anxiety and avoidance and predicted expert-rated insecure attachment and maladaptive beliefs. CONCLUSION Our findings support a potential link between childhood adversity and boundary difficulties, partly mediated by insecure attachment and early maladaptive beliefs. Furthermore, these results suggest that boundary education programs and professional wellness programs may be enhanced with a focus on sequelae of childhood maltreatment, attachment and common maladaptive thinking patterns.
Collapse
|
9
|
Schönwetter DJ, Hamilton J, Sawatzky JAV. Exploring Professional Development Needs of Educators in the Health Sciences Professions. J Dent Educ 2015. [DOI: 10.1002/j.0022-0337.2015.79.2.tb05865.x] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Affiliation(s)
| | - Joanne Hamilton
- Medical Education; College of Medicine; Faculty of Health Sciences; University of Manitoba
| | - Jo-Ann V. Sawatzky
- Graduate Programs; College of Nursing; Faculty of Health Sciences; University of Manitoba
| |
Collapse
|
10
|
Individual risk factors for physician boundary violations: the role of attachment style, childhood trauma and maladaptive beliefs. Gen Hosp Psychiatry 2015; 37:81-8. [PMID: 25440724 DOI: 10.1016/j.genhosppsych.2014.09.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/03/2014] [Revised: 08/20/2014] [Accepted: 09/01/2014] [Indexed: 11/24/2022]
Abstract
OBJECTIVE The assessment and remediation of boundary-challenged health care professionals is enhanced through examination of individual risk factors. We assessed three such factors - attachment style, childhood trauma and maladaptive beliefs - in 100 attendees (mostly physicians) of a continuing medical education (CME) professional boundaries course. We propose a theoretical model that draws a causal arc from childhood maltreatment through insecure attachment and maladaptive beliefs to elevated risk for boundary violations. METHODS We administered the Experiences in Close Relationships Questionnaire Revised (ECR-R), Childhood Trauma Questionnaire (CTQ) and Young Schema Questionnaire (YSQ) to 100 health care professionals attending a CME course on professional boundaries. Experts rated participant autobiographies to determine attachment style and early adversities. Correlations and relationships between self-ratings and expert ratings and among different risk factors were examined. RESULTS One fifth of participants reported moderate to severe childhood abuse; sixty percent reported moderate to severe emotional neglect. Despite this, average attachment anxiety and attachment avoidance were low, and more than half of participants were rated "secure" by experts. Childhood maltreatment was correlated with attachment anxiety and avoidance and predicted expert-rated insecure attachment and maladaptive beliefs. CONCLUSIONS Our findings support a potential link between childhood adversity and boundary difficulties, partly mediated by insecure attachment and early maladaptive beliefs. Furthermore, these results suggest that boundary education programs and professional wellness programs may be enhanced with a focus on sequelae of childhood maltreatment, attachment and common maladaptive thinking patterns.
Collapse
|
11
|
Overton AR, Lowry AC. Conflict management: difficult conversations with difficult people. Clin Colon Rectal Surg 2014; 26:259-64. [PMID: 24436688 DOI: 10.1055/s-0033-1356728] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
Conflict occurs frequently in any workplace; health care is not an exception. The negative consequences include dysfunctional team work, decreased patient satisfaction, and increased employee turnover. Research demonstrates that training in conflict resolution skills can result in improved teamwork, productivity, and patient and employee satisfaction. Strategies to address a disruptive physician, a particularly difficult conflict situation in healthcare, are addressed.
Collapse
Affiliation(s)
- Amy R Overton
- Division of Health Policy and Management, Department of Health Administration, School of Public Health, University of Minnesota, Minneapolis, Minnesota
| | - Ann C Lowry
- Division of Colon and Rectal Surgery, Department of Surgery, University of Minnesota, St Paul, Minnesota
| |
Collapse
|
12
|
Park YS, Riddle J, Tekian A. Validity evidence of resident competency ratings and the identification of problem residents. MEDICAL EDUCATION 2014; 48:614-22. [PMID: 24807437 DOI: 10.1111/medu.12408] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/19/2013] [Revised: 09/13/2013] [Accepted: 11/14/2013] [Indexed: 05/25/2023]
Abstract
OBJECTIVES This study examined validity evidence of end-of-rotation evaluations used to measure progress toward mastery of core competencies in residents. In addition, this study investigated whether end-of-rotation evaluations can be used to detect problem residents during their training. METHODS Historical data for a 4-year period (2009-2012), containing 4986 observations of 291 internal medicine residents, were examined. Residents were observed and assessed by fellows, faculty members and programme directors on nine domains, including the six Accreditation Council for Graduate Medical Education core competencies, as part of their end-of-rotation evaluations. Descriptive statistics were used to collect evidence of the response process. Correlations between competencies and a generalisability study were used to examine the internal structure of the end-of-rotation evaluations. Hierarchical regression was used to estimate the increase in scores across years of training. Scores on end-of-rotation evaluations were compared with trainees identified as problem residents by programme directors. RESULTS Compared with fellows, faculty and programme directors had significantly greater variability in assigning scores across different competencies. Correlations between competencies ranged from 0.69 to 0.92. The reliability of end-of-rotation evaluations was adequate (fellows, phi coefficient [φ] = 0.68; faculty [including programme directors], φ = 0.71). Mean scores increased by 0.21 points (95% confidence interval 0.18-0.24) per postgraduate year. Mean scores were significantly correlated with classification as a problem resident (r = 0.33, p < 0.001); problem residents also had significantly lower ratings across all competencies during PGY-1 compared with all other residents. CONCLUSIONS End-of-rotation evaluations are a useful method of measuring the growth in resident performance associated with core competencies when sufficient numbers of end-of-rotation evaluation scores are used. Furthermore, end-of-rotation evaluation scores provide preliminary evidence with which to detect and predict problem residents in subsequent postgraduate training years.
Collapse
Affiliation(s)
- Yoon Soo Park
- Department of Medical Education, College of Medicine, University of Illinois at Chicago, Chicago, Illinois, USA
| | | | | |
Collapse
|
13
|
|
14
|
Finlayson AR, Dietrich MS, Neufeld R, Roback H, Martin PR. Restoring professionalism: the physician fitness-for-duty evaluation. Gen Hosp Psychiatry 2013; 35:659-63. [PMID: 23910216 PMCID: PMC3923266 DOI: 10.1016/j.genhosppsych.2013.06.009] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/08/2013] [Revised: 06/03/2013] [Accepted: 06/25/2013] [Indexed: 10/26/2022]
Abstract
OBJECTIVES We compare findings from 10 years of experience evaluating physicians referred for fitness-to-practice assessment to determine whether those referred for disruptive behavior are more or less likely to be declared fit for duty than those referred for mental health, substance abuse or sexual misconduct. METHOD Deidentified data from 381 physicians evaluated by the Vanderbilt Comprehensive Assessment Program (2001-2012) were analyzed and compared to general physician population data and also to previous reports of physician psychiatric diagnosis found by MEDLINE search. RESULTS Compared to the physicians referred for disruptive behavior (37.5% of evaluations), each of the other groups was statistically significantly less likely to be assessed as fit for practice [substance use, %: odds ratio (OR)=0.22, 95% confidence interval (CI)=0.10-0.47, P<.001; mental health, %: OR=0.14, 95% CI=0.06-0.31, P<.001; sexual boundaries, %: OR=0.27, 95% CI=0.13-0.58, P=.001]. CONCLUSIONS The number of referrals to evaluate physicians presenting with behavior alleged to be disruptive to clinical care increased following the 2008 Joint Commission guidelines that extended responsibility for professional conduct outside the profession itself to the institutions wherein physicians work. Better strategies to identify and manage disruptive physician behavior may allow those physicians to return to practice safely in the workplace.
Collapse
Affiliation(s)
- A.J. Reid Finlayson
- Corresponding author. Tel.: +1 615 322 4567; fax: +1 615 322 7526. (A.J.R. Finlayson)
| | | | | | | | | |
Collapse
|