1
|
Feldman CL, Spence NZ. Responsibilities of Medical Professionals Amidst Geopolitical Conflict. J Gen Intern Med 2025; 40:1169-1174. [PMID: 39557749 PMCID: PMC11968607 DOI: 10.1007/s11606-024-09189-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/27/2024] [Accepted: 10/29/2024] [Indexed: 11/20/2024]
Abstract
The ethical responsibilities of healthcare professionals amidst geopolitical conflict, particularly regarding their impact on patient care and healthcare delivery, present a significant challenge, especially during current strife. With the rise of national and international discord and debate, and the close relationship between war and healthcare, healthcare organizations are increasingly pressured to comment, which can reflect societal engagement, but also pose demands for maintaining professionalism. This article discusses the need for healthcare practitioners to navigate their roles in advocacy without compromising patient care, emphasizing the importance of self-reflection, adherence to ethical standards, and effective communication. We also address the implications of politicization within healthcare settings, offering strategies to uphold professional integrity and prioritize patient-centered care amidst the complexities of geopolitical tensions. While the premise of this paper was prompted by geopolitical conflict, the principles emphasized are broadly applicable to an array of controversial issues. By fostering a culture of inclusivity and respect, healthcare professionals can mitigate the risks associated with politicization and ensure a commitment to the fundamental principle of "do no harm."
Collapse
Affiliation(s)
- Cassondra L Feldman
- College of Psychology, Nova Southeastern University, Ft. Lauderdale, FL, USA.
| | - Nicole Z Spence
- Department of Anesthesiology, Boston University Chobanian and Avedisian School of Medicine, Boston, MA, USA
| |
Collapse
|
2
|
Versalle RL, Todd BR, Chen NW, Turner-Lawrence DE. Early Emergency Medicine Milestone Assessment for Predicting First-Year Resident Performance. MEDEDPORTAL : THE JOURNAL OF TEACHING AND LEARNING RESOURCES 2024; 20:11386. [PMID: 38476297 PMCID: PMC10928014 DOI: 10.15766/mep_2374-8265.11386] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Accepted: 11/28/2023] [Indexed: 03/14/2024]
Abstract
Introduction The Accreditation Council for Graduate Medical Education (ACGME) requires emergency medicine (EM) residency training programs to monitor residents' progress using standardized milestones. The first assessment of PGY 1 resident milestones occurs midway through the first year and could miss initial deficiencies. Early assessment of PGY 1 EM resident milestones has potential to identify at-risk residents prior to standard midyear evaluations. We developed an orientation syllabus for PGY 1 residents followed by a milestone assessment. Assessment scores helped predict future milestone scores and American Board of Emergency Medicine (ABEM) In-Training Examination (ITE) scores for PGY 1 residents. Methods From 2013 to 2020, we developed and implemented Milestone Evaluation Day (MED), a simulation-based day and written exam assessing PGY 1 EM residents during their first month on the 23 ACGME 1.0 milestones. MED stations included a history and physical with verbal presentation, patient simulation, vascular access, wound management, and airway management. MED, Clinical Competency Committee-generated (CCC-generated) milestone, and ABEM ITE scores were averaged and compared utilizing Pearson's correlation coefficient. Results Of 112 PGY 1 EM residents, 110 (98%) were analyzed over an 8-year period. We observed a moderate positive correlation of MED and CCC-generated milestone scores (r = .34, p < .001). There was a nonstatistically significant weak positive correlation of MED and ABEM ITE scores (r = .13, p = .17). Discussion An early assessment of EM milestones in the PGY 1 year can assist in the prediction of CCC-generated milestone scores for PGY 1 residents.
Collapse
Affiliation(s)
- Rochelle L. Versalle
- Third-Year Resident, Department of Emergency Medicine, Oakland University William Beaumont School of Medicine
| | - Brett R. Todd
- Associate Professor, Department of Emergency Medicine, Oakland University William Beaumont School of Medicine
| | - Nai-Wei Chen
- Statistician, Division of Informatics and Biostatistics, Beaumont Institute
| | - Danielle E. Turner-Lawrence
- Associate Professor, Department of Emergency Medicine, Oakland University William Beaumont School of Medicine
| |
Collapse
|
3
|
Puri A, Raghavan S, Sottile E, Singh M, Snydman LK, Donovan AK, Bonnema R, Lo MC. New ACGME Clinician Educator Milestones as a Roadmap for Faculty Development: a Position Paper from the Society of General Internal Medicine Education Committee. J Gen Intern Med 2023; 38:3053-3059. [PMID: 37407763 PMCID: PMC10593649 DOI: 10.1007/s11606-023-08272-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2023] [Accepted: 06/07/2023] [Indexed: 07/07/2023]
Abstract
Traditionally, clinician educators are tasked with the responsibility of training future physician workforce. However, there is limited identification of skills required to fulfill this responsibility and a lack of consensus on effective faculty development for career growth as a clinician educator. The newly released Accreditation Council of Graduate Medical Education (ACGME) Clinician Educator (CE) Milestones framework outlines important skills for clinician educators and provides the opportunity to create robust faculty development. In this paper, members of the Society of General Internal Medicine Education Committee discuss the importance of these CE Milestones, outline the novel themes highlighted in the project, and provide recommendations for proper application on both the individual and institutional levels to optimize faculty development. The paper discusses strategies for how to apply the CE Milestones as a tool to create a culture of professional growth and self-directed learning. Using a reflective approach, CE faculty and mentors can identify areas of proficiency and opportunities for growth, thereby creating individualized professional development plans for career success. Institutions should use aggregate CE Milestones data as a needs assessment of their faculty "population" to create targeted faculty development. Most importantly, institutions should not use CE Milestones for high-stakes assessments but rather encourage reflection by CE faculty and create subsequent robust faculty development programs. The ACGME CE Milestones present an exciting opportunity and lay an important foundation for future CE faculty development.
Collapse
Affiliation(s)
- Aditi Puri
- Loyola University Health System, MacNeal Hospital, 3722 South Harlem Avenue, Apartment LL34, Berwyn, IL, 60402, USA.
| | | | - Elisa Sottile
- Division of General Internal Medicine, Department of Medicine, University of Florida College of Medicine, Jacksonville, FL, USA
| | - Mamta Singh
- Case Western Reserve University School of Medicine and Primary Care Service, VA Northeast Ohio Health Care System, Cleveland, OH, USA
| | - Laura K Snydman
- Division of General Internal Medicine, Department of Medicine, Tufts Medical Center, Boston, MA, USA
| | - Anna K Donovan
- Division of General Internal Medicine, Department of Medicine, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA
| | - Rachel Bonnema
- Division of General Internal Medicine, Department of Medicine, University of Texas Southwestern, Dallas, TX, USA
| | - Margaret C Lo
- Division of General Internal Medicine, Department of Medicine, University of Florida College of Medicine, Malcom Randall VAMC, Gainesville, FL, USA
| |
Collapse
|
4
|
Reimagining the Clinical Competency Committee to Enhance Education and Prepare for Competency-Based Time-Variable Advancement. J Gen Intern Med 2022; 37:2280-2290. [PMID: 35445932 PMCID: PMC9021365 DOI: 10.1007/s11606-022-07515-3] [Citation(s) in RCA: 14] [Impact Index Per Article: 4.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Accepted: 03/25/2022] [Indexed: 12/01/2022]
Abstract
Assessing residents and clinical fellows is a high-stakes activity. Effective assessment is important throughout training so that identified areas of strength and weakness can guide educational planning to optimize outcomes. Assessment has historically been underemphasized although medical education oversight organizations have strengthened requirements in recent years. Growing acceptance of competency-based medical education and its logical extension to competency-based time-variable (CB-TV) graduate medical education (GME) further highlights the importance of implementing effective evidence-based approaches to assessment. The Clinical Competency Committee (CCC) has emerged as a key programmatic structure in graduate medical education. In the context of launching a multi-specialty pilot of CB-TV GME in our health system, we have examined several program's CCC processes and reviewed the relevant literature to propose enhancements to CCCs. We recommend that all CCCs fulfill three core goals, regularly applied to every GME trainee: (1) discern and describe the resident's developmental status to individualize education, (2) determine readiness for unsupervised practice, and (3) foster self-assessment ability. We integrate the literature and observations from GME program CCCs in our institutions to evaluate how current CCC processes support or undermine these goals. Obstacles and key enablers are identified. Finally, we recommend ways to achieve the stated goals, including the following: (1) assess and promote the development of competency in all trainees, not just outliers, through a shared model of assessment and competency-based advancement; (2) strengthen CCC assessment processes to determine trainee readiness for independent practice; and (3) promote trainee reflection and informed self-assessment. The importance of coaching for competency, robust workplace-based assessments, feedback, and co-production of individualized learning plans are emphasized. Individual programs and their CCCs must strengthen assessment tools and frameworks to realize the potential of competency-oriented education.
Collapse
|
5
|
Sheng WH, Ho YL, Jenq CC, Chuang CL, Chen CY, Tsai MJ, Yang YS, Wu MS, Chang SC. Longitudinal assessment of milestone development among internal medicine residents in Taiwan. J Formos Med Assoc 2022; 121:2281-2287. [PMID: 35725679 DOI: 10.1016/j.jfma.2022.05.013] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Revised: 05/26/2022] [Accepted: 05/29/2022] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND/PURPOSE The Accreditation Council for Graduate Medical Education (ACGME) milestones have been implemented in residency training worldwide. We investigated the development of individual competency in first-year residents (R1) and second-year postgraduate students (PGY2) who received internal medicine training in Taiwan. METHODS A multicenter observational cohort study was conducted to evaluate the competency-based milestone evaluation designed by the Taiwan Society of Internal Medicine in 2019. The evaluation was based on the ACGME-accredited milestone ratings. Periodic evaluation of milestone achievements of R1 and PGY2, who entered the internal medicine residency training at six medical centers, was performed. Each resident was evaluated every 3 months. RESULTS Among the 98 R1 enrolled in 2019, substantial improvement in sub-competencies, including skill in performing procedures (Patient Care 4), clinical knowledge (Medical Knowledge 1), knowledge of diagnostic testing and procedures (Medical Knowledge 2), and identify impact the cost of health care and practices cost-effective care (Systems Based Practice 3) during the two years of training. Among the 107 R1 and 46 PGY2 enrolled in 2020, no significant difference in baseline milestone ratings was observed. However, the milestone assessments of R1 in 2020 showed improvement in nearly all sub-competencies compared with the stationary status of PGY2 in 2020. CONCLUSION We demonstrate the application of ACGME-based accredited milestone ratings to target the educational goals of internal medicine residency training in Taiwan. Differences in milestone ratings between different PGY training systems exist. The long-term impact of performance among different PGY training systems requires further investigation.
Collapse
Affiliation(s)
- Wang-Huei Sheng
- Department of Internal Medicine, National Taiwan University Hospital, Taipei City, Taiwan; School of Medicine, National Taiwan University College of Medicine, Taipei City, Taiwan
| | - Yi-Lwun Ho
- Department of Internal Medicine, National Taiwan University Hospital, Taipei City, Taiwan; School of Medicine, National Taiwan University College of Medicine, Taipei City, Taiwan
| | - Chang-Chyi Jenq
- Department of Internal Medicine, Linkou Chang Gung Memorial Hospital, Taoyuan, Taiwan
| | - Chiao-Lin Chuang
- Department of Internal Medicine, Taipei Veterans General Hospital, Taipei City, Taiwan; School of Medicine, National Yang Ming Chiao Tung University College of Medicine, Taipei City, Taiwan
| | - Chiung-Yu Chen
- College of Medicine, National Cheng Kung University, Tainan, Taiwan
| | - Ming-Ju Tsai
- Department of Internal Medicine, Kaohsiung Medical University Hospital, Kaohsiung, Taiwan
| | - Yi-Sun Yang
- School of Medicine, Chung Shan Medical University, Taichung, Taiwan
| | - Ming-Shiang Wu
- Department of Internal Medicine, National Taiwan University Hospital, Taipei City, Taiwan; School of Medicine, National Taiwan University College of Medicine, Taipei City, Taiwan
| | - Shan-Chwen Chang
- Department of Internal Medicine, National Taiwan University Hospital, Taipei City, Taiwan; School of Medicine, National Taiwan University College of Medicine, Taipei City, Taiwan.
| |
Collapse
|
6
|
Ryan MS, Iobst W, Holmboe ES, Santen SA. Competency-based medical education across the continuum: How well aligned are medical school EPAs to residency milestones? MEDICAL TEACHER 2022; 44:510-518. [PMID: 34807793 DOI: 10.1080/0142159x.2021.2004303] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
INTRODUCTION Competency-based medical education (CBME) provides a framework for describing learner progression throughout training. However, specific approaches to CBME implementation vary widely across educational settings. Alignment between various methods used across the continuum is critical to support transitions and assess learner performance. The purpose of this study was to investigate alignment between CBME frameworks used in undergraduate medical education (UME) and graduate medical education (GME) settings using the US context as a model. METHOD The authors analyzed content from the core entrustable professional activities for entering residency (Core EPAs; UME model) and residency milestones (GME model). From that analysis, they performed a series of cross-walk activities to investigate alignment between frameworks. After independent review, authors discussed findings until consensus was reached. RESULTS Some alignment was found for activities associated with history taking, physical examination, differential diagnosis, patient safety, and interprofessional care; however, there were far more examples of misalignment. CONCLUSIONS These findings highlight challenges creating alignment of assessment frameworks across the continuum of training. The importance of these findings includes implications for assessment and persistence of the educational gap across UME and GME. The authors provide four next steps to improve upon the continuum of education.
Collapse
Affiliation(s)
- Michael S Ryan
- Department of Pediatrics, Virginia Commonwealth University School of Medicine, Richmond, VA, USA
| | - William Iobst
- Accreditation Council for Graduate Medical Education, Chicago, IL, USA
| | - Eric S Holmboe
- Accreditation Council for Graduate Medical Education, Chicago, IL, USA
| | - Sally A Santen
- Department of Emergency Medicine, Virginia Commonwealth University School of Medicine, Richmond, VA, USA
| |
Collapse
|
7
|
Liebowitz JE, Torralba KD, Kolfenbach J, Marston B, Dua AB, O'Rourke KS, McKown K, Battistone MJ, Valeriano-Marcet J, Edgar L, McLean S, Gouze KR, Bolster MB. Rheumatology Milestones 2.0: A Roadmap for Competency-Based Medical Training of Rheumatology Fellows in the 21st Century. Arthritis Care Res (Hoboken) 2022; 74:675-685. [PMID: 33181000 DOI: 10.1002/acr.24507] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2020] [Revised: 10/08/2020] [Accepted: 11/05/2020] [Indexed: 01/03/2023]
Abstract
OBJECTIVE Since 2014, rheumatology fellows have been assessed not only based on their ability to provide patient care and possession of medical knowledge but also on their skill in serving as patient advocates, navigators of health systems, and members of a health care team. Such assessments have been carried out through the use of competency-based milestones from the Accreditation Council of Graduate Medical Education (ACGME). However, a needs assessment has demonstrated interest in more context validity and subspecialty relevance since the development of the ACGME internal medicine (IM) subspecialty reporting milestones. The ACGME thus created a milestones working group, and the present study was undertaken to develop Rheumatology Milestones 2.0 as well as a supplemental guide to assist with implementation. METHODS The working group, consisting of 7 rheumatology program directors, 2 division directors, a community practice rheumatologist, a rheumatology fellow in training, and a public member who is a rheumatology patient, was overseen by the ACGME vice president for milestones development and met through three 12-hour, in-person meetings to compose the rheumatology specialty milestones and supplemental guide within the ACGME Milestones 2.0 project. RESULTS Informed by the needs assessment data and stakeholders, the working group revised and adapted the ACGME IM subspecialty reporting milestones to create a rheumatology-specific set of milestones and a supplemental guide for their implementation. CONCLUSION The Rheumatology Milestones 2.0 provides a specialty-specific, competency-based evaluation tool that can be used by program directors, clinical competency committees, and others to assess the competencies of rheumatology fellows during training and help measure readiness for independent practice.
Collapse
Affiliation(s)
| | | | | | | | - Anisha B Dua
- Northwestern University Feinberg School of Medicine, Chicago, Illinois
| | | | - Kevin McKown
- University of Wisconsin School of Medicine and Public Health, Madison
| | - Michael J Battistone
- University of Utah Health Sciences Center and George E. Whalen Veterans Affairs Health Sciences Center, Salt Lake City
| | | | - Laura Edgar
- Accreditation Council for Graduate Medical Education, Chicago, Illinois
| | - Sydney McLean
- Accreditation Council for Graduate Medical Education, Chicago, Illinois
| | - Karen R Gouze
- Northwestern University Feinberg School of Medicine and Ann & Robert H. Lurie Children's Hospital of Chicago, Chicago, Illinois
| | - Marcy B Bolster
- Harvard Medical School and Massachusetts General Hospital, Boston
| |
Collapse
|
8
|
Lucey CR, Davis JA, Green MM. We Have No Choice but to Transform: The Future of Medical Education After the COVID-19 Pandemic. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2022; 97:S71-S81. [PMID: 34789658 PMCID: PMC8855762 DOI: 10.1097/acm.0000000000004526] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Medical education exists to prepare the physician workforce that our nation needs, but the COVID-19 pandemic threatened to disrupt that mission. Likewise, the national increase in awareness of social justice gaps in our country pointed out significant gaps in health care, medicine, and our medical education ecosystem. Crises in all industries often present leaders with no choice but to transform-or to fail. In this perspective, the authors suggest that medical education is at such an inflection point and propose a transformational vision of the medical education ecosystem, followed by a 10-year, 10-point plan that focuses on building the workforce that will achieve that vision. Broad themes include adopting a national vision; enhancing medicine's role in social justice through broadened curricula and a focus on communities; establishing equity in learning and processes related to learning, including wellness in learners, as a baseline; and realizing the promise of competency-based, time-variable training. Ultimately, 2020 can be viewed as a strategic inflection point in medical education if those who lead and regulate it analyze and apply lessons learned from the pandemic and its associated syndemics.
Collapse
Affiliation(s)
- Catherine R. Lucey
- C.R. Lucey is professor of medicine, executive vice dean, and vice dean for education, University of California, San Francisco School of Medicine, San Francisco, California
| | - John A. Davis
- J.A. Davis is professor of medicine, associate dean for curriculum, and interim associate dean for students, University of California, San Francisco School of Medicine, San Francisco, California
| | - Marianne M. Green
- M.M. Green is Raymond H. Curry, MD Professor of Medical Education, professor of medicine, and vice dean for education, Northwestern University Feinberg School of Medicine, Chicago, Illinois
| |
Collapse
|
9
|
Ottum S, Chao C, Tamakuwala S, Dean J, Shafi A, Kramer KJ, Kaur S, Recanati MA. Can ACGME Milestones predict surgical specialty board passage: an example in Obstetrics and Gynecology. CLIN EXP OBSTET GYN 2021; 48:1048-1055. [PMID: 34720368 PMCID: PMC8555913 DOI: 10.31083/j.ceog4805168] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
Abstract
Background: Multiple tools including Accreditation Council for Graduate Medical Education (ACGME) standardized milestones can be utilized to assess trainee and residency program performance. However, little is known regarding the objective validation of these tools in predicting written board passage. Methods: In this retrospective study, data was gathered on n = 45 Wayne State University Obstetrics and Gynecology program graduates over the five-year period ending July 2018. United States Medical Licensing Examination (USMLE) scores, Council on Resident Education in Obstetrics and Gynecology (CREOG) in-training scores and ACGME milestones were used to predict American Board of Obstetrics and Gynecology (ABOG) board passage success on first attempt. Significance was set at p < 0.05. Results: Written board passage was associated with average CREOGs (p = 0.01) and milestones (p = 0.008) while USMLE1 was not significantly associated (p = 0.055). USMLE1 <217 (Positive predictive value (PPV) = 96%). CREOGs <197 (PPV = 100%) and milestones <3.25 (PPV = 100%), particularly practice-based learning and systems-based practice milestones were most strongly correlated with board failure. Using a combination of these two milestones, it is possible to correctly predict board passage using our model (PPV = 86%). Discussion: This study is the first validating the utility of milestones in a surgical specialty by demonstrating their ability to predict board passage. Residents with CREOGs or milestones below thresholds are at risk for board failure and may warrant early intervention.
Collapse
Affiliation(s)
- Sarah Ottum
- Department of Obstetrics and Gynecology, University of Cincinnati, Cincinnati, OH 45267, USA
| | - Conrad Chao
- Department of Maternal-Fetal Medicine, University of New Mexico School of Medicine, Albuquerque, NM 87131, USA
| | - Sejal Tamakuwala
- Department of Obstetrics and Gynecology, Emory University, Atlanta, GA 30322, USA
| | - Joshua Dean
- Department of Obstetrics and Gynecology, Beaumont, Royal Oak, MI 48073, USA
| | - Adib Shafi
- Department of Computer Sciences, Wayne State University, Detroit, MI 48201, USA
| | - Katherine Jennifer Kramer
- Department of Obstetrics and Gynecology, St. Vincent's Catholic Medical Centers, New York, NY 10011, USA
| | - Satinder Kaur
- Department of Obstetrics and Gynecology, Wayne State University, Detroit, MI 48201, USA
| | - Maurice-Andre Recanati
- Department of Obstetrics and Gynecology and NIH-Women's Reproductive Health Research Scholar, Wayne State University, Detroit, MI 48201, USA
| |
Collapse
|
10
|
Kinnear B, Warm EJ, Caretta-Weyer H, Holmboe ES, Turner DA, van der Vleuten C, Schumacher DJ. Entrustment Unpacked: Aligning Purposes, Stakes, and Processes to Enhance Learner Assessment. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2021; 96:S56-S63. [PMID: 34183603 DOI: 10.1097/acm.0000000000004108] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Educators use entrustment, a common framework in competency-based medical education, in multiple ways, including frontline assessment instruments, learner feedback tools, and group decision making within promotions or competence committees. Within these multiple contexts, entrustment decisions can vary in purpose (i.e., intended use), stakes (i.e., perceived risk or consequences), and process (i.e., how entrustment is rendered). Each of these characteristics can be conceptualized as having 2 distinct poles: (1) purpose has formative and summative, (2) stakes has low and high, and (3) process has ad hoc and structured. For each characteristic, entrustment decisions often do not fall squarely at one pole or the other, but rather lie somewhere along a spectrum. While distinct, these continua can, and sometimes should, influence one another, and can be manipulated to optimally integrate entrustment within a program of assessment. In this article, the authors describe each of these continua and depict how key alignments between them can help optimize value when using entrustment in programmatic assessment within competency-based medical education. As they think through these continua, the authors will begin and end with a case study to demonstrate the practical application as it might occur in the clinical learning environment.
Collapse
Affiliation(s)
- Benjamin Kinnear
- B. Kinnear is associate professor of internal medicine and pediatrics, Department of Pediatrics, University of Cincinnati College of Medicine, Cincinnati, Ohio; ORCID: https://orcid.org/0000-0003-0052-4130
| | - Eric J Warm
- E.J. Warm is professor of internal medicine and program director, Department of Internal Medicine, University of Cincinnati College of Medicine, Cincinnati, Ohio; ORCID: https://orcid.org/0000-0002-6088-2434
| | - Holly Caretta-Weyer
- H. Caretta-Weyer is assistant professor of emergency medicine, Department of Emergency Medicine, Stanford University School of Medicine, Palo Alto, California; ORCID: https://orcid.org/0000-0002-9783-5797
| | - Eric S Holmboe
- E.S. Holmboe is chief, research, milestones development and evaluation officer, Accreditation Council for Graduate Medical Education, Chicago, Illinois; ORCID: https://orcid.org/0000-0003-0108-6021
| | - David A Turner
- D.A. Turner is vice president, Competency-Based Medical Education, American Board of Pediatrics, Chapel Hill, North Carolina
| | - Cees van der Vleuten
- C. van der Vleuten is professor of education, Department of Educational Development and Research, Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, The Netherlands; ORCID: https://orcid.org/0000-0001-6802-3119
| | - Daniel J Schumacher
- D.J. Schumacher is associate professor of pediatrics, Cincinnati Children's Hospital Medical Center/University of Cincinnati College of Medicine, Cincinnati, Ohio; ORCID: https://orcid.org/0000-0001-5507-8452
| |
Collapse
|
11
|
Pirie J, St. Amant L, Glover Takahashi S. Managing residents in difficulty within CBME residency educational systems: a scoping review. BMC MEDICAL EDUCATION 2020; 20:235. [PMID: 32703231 PMCID: PMC7376876 DOI: 10.1186/s12909-020-02150-0] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/20/2020] [Accepted: 07/15/2020] [Indexed: 05/28/2023]
Abstract
BACKGROUND Best practices in managing residents in difficulty (RID) in the era of competency-based medical education (CBME) are not well described. This scoping review aimed to inventory the current literature and identify major themes in the articles that address or employ CBME as part of the identification and remediation of residents in difficulty. METHODS Articles published between 2011 to 2017 were included if they were about postgraduate medical education, RID, and offered information to inform the structure and/or processes of CBME. All three reviewers performed a primary screening, followed by a secondary screening of abstracts of the chosen articles, and then a final comprehensive sub-analysis of the 11 articles identified as using a CBME framework. RESULTS Of 165 articles initially identified, 92 qualified for secondary screening; the 63 remaining articles underwent full-text abstracting. Ten themes were identified from the content analysis with "identification of RID" (41%) and "defining and classifying deficiencies" (30%) being the most frequent. In the CBME article sub-analysis, the most frequent themes were: need to identify RID (64%), improving assessment tools (45%), and roles and responsibilities of players involved in remediation (27%). Almost half of the CBME articles were published in 2016-2017. CONCLUSIONS Although CBME programs have been implemented for many years, articles have only recently begun specifically addressing RID within a competency framework. Much work is needed to describe the sequenced progression, tailored learning experiences, and competency-focused instruction. Finally, future research should focus on the outcomes of remediation in CBME programs.
Collapse
Affiliation(s)
- Jonathan Pirie
- Department of Pediatrics, Faculty of Medicine, University of Toronto, Toronto, Canada
- Paediatric Emergency Medicine, The Hospital for Sick Children, Toronto, Canada
| | - Lisa St. Amant
- Postgraduate Medical Education, Faculty of Medicine, University of Toronto, Toronto, Canada
| | - Susan Glover Takahashi
- Department of Family and Community Medicine, Faculty of Medicine, Integrated Senior Scholar – Centre for Faculty Development and Postgraduate Medical Education, University of Toronto, Toronto, Canada
| |
Collapse
|
12
|
Utility of Residency Milestones Reported to Fellowship Directors: A National Survey of Pediatric Fellowship Program Directors. Acad Pediatr 2020; 20:696-702. [PMID: 31978601 DOI: 10.1016/j.acap.2020.01.004] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/06/2019] [Revised: 01/07/2020] [Accepted: 01/10/2020] [Indexed: 02/02/2023]
Abstract
OBJECTIVE The Accreditation Council for Graduate Medical Education recently made available final residency Milestones for first-year fellows to fellowship program directors (FPDs). Usefulness of residency Milestones for fellows is unknown. Our objective was to determine how many pediatric FPDs downloaded final residency Milestones for their first-year fellows and FPD perspectives about usefulness of residency Milestones. METHODS Mixed methods survey of pediatric FPDs, assessing FPD use of residency Milestones for first-year fellows, and FPD opinions about utility of residency Milestones for fellowship, including during fellow recruitment. Quantitative data were analyzed using descriptive statistics. Qualitative data were analyzed using content analysis. RESULTS The response rate was 67.8% (544 of 802). Only 39.3% (209 of 532) of FPDs downloaded final residency Milestones for their first-year fellows. Twenty-four percent (129 of 532) of all FPDs thought residency Milestones were useful. Forty-one percent (218 of 532) thought residency Milestones would be useful during recruitment; others believed this may harm applicants. Of FPDs that downloaded and reviewed residency Milestones, 27% (50 of 185) used them for individualized education. FPDs felt residency Milestones might allow for identification of trainee needs and baseline assessments, but thought that residency Milestones had limited usefulness during fellowship due to concerns about lack of validity evidence, relevance, and how Milestones are assessed and reported. CONCLUSIONS Most FPDs find residency Milestones to be of limited utility for their fellows and do not use residency Milestones to tailor education for their first-year fellows. Improving relevance of residency Milestones to fellowship training, validity, and how Milestones are assessed and reported may improve their usefulness for fellow training.
Collapse
|
13
|
Walsh D. Falling Into a Trap. MEDICAL SCIENCE EDUCATOR 2020; 30:995-996. [PMID: 34457758 PMCID: PMC8368676 DOI: 10.1007/s40670-020-00968-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Affiliation(s)
- David Walsh
- Medical College of Georgia at Augusta University, Augusta, GA USA
| |
Collapse
|
14
|
Weber DE, Held JD, Jandarov RA, Kelleher M, Kinnear B, Sall D, O'Toole JK. Development and Establishment of Initial Validity Evidence for a Novel Tool for Assessing Trainee Admission Notes. J Gen Intern Med 2020; 35:1078-1083. [PMID: 31993944 PMCID: PMC7174454 DOI: 10.1007/s11606-020-05669-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/19/2019] [Accepted: 01/12/2020] [Indexed: 10/25/2022]
Abstract
BACKGROUND Documentation is a key component of practice, yet few curricula have been published to teach trainees proper note construction. Additionally, a gold standard for assessing note quality does not exist, and no documentation assessment tools integrate with established competency-based frameworks. OBJECTIVE To develop and establish initial validity evidence for a novel tool that assesses key components of trainee admission notes and maps to the Accreditation Council for Graduate Medical Education (ACGME) milestone framework. DESIGN Using an iterative, consensus building process we developed the Admission Note Assessment Tool (ANAT). Pilot testing was performed with both the supervising attending and study team raters not involved in care of the patients. The finalized tool was piloted with attendings from other institutions. PARTICIPANTS Local experts participated in tool development and pilot testing. Additional attending physicians participated in pilot testing. MAIN MEASURES Content, response process, and internal structure validity evidence was gathered using Messick's framework. Inter-rater reliability was assessed using percent agreement. KEY RESULTS The final tool consists of 16 checklist items and two global assessment items. Pilot testing demonstrated rater agreement of 72% to 100% for checklist items and 63% to 70% for global assessment items. Note assessment required an average of 12.3 min (SD 3.7). The study generated validity evidence in the domains of content, response process, and internal structure for use of the tool in rating admission notes. CONCLUSIONS The ANAT assesses individual components of a note, incorporates billing criteria, targets note "bloat," allows for narrative feedback, and provides global assessments mapped to the ACGME milestone framework. The ANAT can be used to assess admission notes by any attending and at any time after note completion with minimal rater training. The ANAT allows programs to implement routine note assessment for multiple functions with the use of a single tool.
Collapse
Affiliation(s)
- Danielle E Weber
- Department of Internal Medicine, University of Cincinnati College of Medicine, University of Cincinnati Medical Center, 231 Albert Sabin Way, ML 0535, Cincinnati, OH, 45267, USA. .,Department of Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine, Cincinnati, OH, USA.
| | - Justin D Held
- Department of Internal Medicine, University of Cincinnati College of Medicine, University of Cincinnati Medical Center, 231 Albert Sabin Way, ML 0535, Cincinnati, OH, 45267, USA
| | - Roman A Jandarov
- Department of Internal Medicine, University of Cincinnati College of Medicine, University of Cincinnati Medical Center, 231 Albert Sabin Way, ML 0535, Cincinnati, OH, 45267, USA
| | - Matthew Kelleher
- Department of Internal Medicine, University of Cincinnati College of Medicine, University of Cincinnati Medical Center, 231 Albert Sabin Way, ML 0535, Cincinnati, OH, 45267, USA.,Department of Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| | - Ben Kinnear
- Department of Internal Medicine, University of Cincinnati College of Medicine, University of Cincinnati Medical Center, 231 Albert Sabin Way, ML 0535, Cincinnati, OH, 45267, USA.,Department of Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| | - Dana Sall
- Department of Internal Medicine, University of Cincinnati College of Medicine, University of Cincinnati Medical Center, 231 Albert Sabin Way, ML 0535, Cincinnati, OH, 45267, USA
| | - Jennifer K O'Toole
- Department of Internal Medicine, University of Cincinnati College of Medicine, University of Cincinnati Medical Center, 231 Albert Sabin Way, ML 0535, Cincinnati, OH, 45267, USA.,Department of Pediatrics, Cincinnati Children's Hospital Medical Center, University of Cincinnati College of Medicine, Cincinnati, OH, USA
| |
Collapse
|
15
|
Begley A, Bird A, Palermo C. Developing National Conceptual Understanding to Describe Entry-to-Practice Dietetics Competence. JOURNAL OF NUTRITION EDUCATION AND BEHAVIOR 2020; 52:351-358. [PMID: 31540864 DOI: 10.1016/j.jneb.2019.08.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2019] [Revised: 07/29/2019] [Accepted: 08/06/2019] [Indexed: 06/10/2023]
Abstract
OBJECTIVE Develop consensus on entrustable professional activities (EPAs) and milestones for students, practice educators, and academics that need shared understanding to assess entry-level competence in dietetics. DESIGN An iterative, pragmatic, 3 key-phase approach involving workshops, a consensus survey with job description and consultation. SETTING Australia. PARTICIPANTS A total of 58 academics and 43 practitioners with expertise in competency-based assessment in dietetics were purposefully selected to participate in 4 national workshops. Of those selected, 36 completed a survey that sought consensus on the EPAs and milestones drafted at the workshops (36% response rate). PHENOMENON OF INTEREST Support for competency-based assessment. ANALYSIS Level of agreement on the survey was set at ≥70%. These comments were triangulated with content analysis from 98 entry-level job descriptions. RESULTS Consensus on 4 key tasks of the profession with associated descriptions of the level of performance were included to implement a nutrition intervention; facilitate a food, nutrition, and/or lifestyle conversation; perform professional activities and projects; and work as part of a team. CONCLUSIONS AND IMPLICATIONS Identification of the key minimum tasks of a dietitian upon entry-to-practice, together with developmental descriptors of performance, provides clarity in the expected progression and end point of assessment. This resource will support competency-based assessment decisions. The international transferability of this warrants further investigation.
Collapse
Affiliation(s)
- Andrea Begley
- School of Public Health, Curtin University, Perth, Australia.
| | - Anna Bird
- School of Public Health, Curtin University, Perth, Australia
| | - Claire Palermo
- Monash Centre for Scholarship in Health Education, Monash University, Melbourne, Australia
| |
Collapse
|
16
|
Competency-based medical education for the clinician-educator: the coming of Milestones version 2. Clin Rheumatol 2020; 39:1719-1723. [PMID: 32056067 DOI: 10.1007/s10067-020-04942-7] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2019] [Revised: 12/30/2019] [Accepted: 01/10/2020] [Indexed: 10/25/2022]
Abstract
Competency-based medical education is emphasized by institutions overseeing medical school and postgraduate training worldwide. The high rate of preventable errors in medicine underscores this need. Expanding physician competency beyond the domains of patient care and medical knowledge towards goals that emphasize a more holistic view of the healthcare system is one aspect of this emphasis. The Accreditation Council on Graduate Medical Education (ACGME), which oversees postgraduate training programs in the USA, has recently expanded to oversee training programs internationally. The original ACGME Milestones effort unveiled in 2013 was met with skepticism. Nevertheless, other outcomes-based education programs worldwide, including the CanMEDS framework (Canada), Tomorrow's Doctor (UK), and Scottish Doctor (Scotland), have suggested that milestones do offer advantages. Missing from the milestone rollout, however, was collaborative buy-in from multiple stakeholders such as from clinician-educators. Consequently, Milestones version 2 is in development. Specifically, these will address the need for specialty-specific milestones, and the usage of harmonized milestones. A concise history of the push towards outcomes-based medical education is presented and contextualized for physicians who must embrace the transition from teacher-based to learner-based outcomes.
Collapse
|
17
|
Abdel-Aziz Y, Barnett WR, Altorok N, Assaly R. Additional tools to boost internal medicine residents' evaluations. INTERNATIONAL JOURNAL OF MEDICAL EDUCATION 2019; 10:43-44. [PMID: 30825870 PMCID: PMC6766399 DOI: 10.5116/ijme.5c6c.358f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/03/2018] [Accepted: 02/19/2019] [Indexed: 06/09/2023]
Affiliation(s)
| | | | - Nezam Altorok
- Internal Medicine, University of Toledo, Toledo, OH, USA
| | - Ragheb Assaly
- Internal Medicine, University of Toledo, Toledo, OH, USA
| |
Collapse
|
18
|
Lefebvre C, Hiestand B, Glass C, Masneri D, Hosmer K, Hunt M, Hartman N. Examining the Effects of Narrative Commentary on Evaluators’ Summative Assessments of Resident Performance. Eval Health Prof 2018; 43:159-161. [DOI: 10.1177/0163278718820415] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Anchor-based, end-of-shift ratings are commonly used to conduct performance assessments of resident physicians. These performance evaluations often include narrative assessments, such as solicited or “free-text” commentary. Although narrative commentary can help to create a more detailed and specific assessment of performance, there are limited data describing the effects of narrative commentary on the global assessment process. This single-group, observational study examined the effect of narrative comments on global performance assessments. A subgroup of the clinical competency committee, blinded to resident identity, assigned a single, consensus-based performance score (1–6) to each resident based solely on end-of-shift milestone scores. De-identified narrative comments from end-of-shift evaluations were then included and the process was repeated. We compared milestone-only scores to milestone plus narrative commentary scores using a nonparametric sign test. During the study period, 953 end-of-shift evaluations were submitted on 41 residents. Of these, 535 evaluations included free-text narrative comments. In 17 of the 41 observations, performance scores changed after the addition of narrative comments. In two cases, scores decreased with the addition of free-text commentary. In 15 cases, scores increased. The frequency of net positive change was significant ( p = .0023). The addition of narrative commentary to anchor-based ratings significantly influenced the global performance assessment of Emergency Medicine residents by a committee of educators. Descriptive commentary collected at the end of shift may inform more meaningful appraisal of a resident’s progress in a milestone-based paradigm. The authors recommend clinical training programs collect unstructured narrative impressions of residents’ performance from supervising faculty.
Collapse
Affiliation(s)
- Cedric Lefebvre
- Department of Emergency Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Brian Hiestand
- Department of Emergency Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Casey Glass
- Department of Emergency Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - David Masneri
- Department of Emergency Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Kathleen Hosmer
- Department of Emergency Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Meagan Hunt
- Department of Emergency Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| | - Nicholas Hartman
- Department of Emergency Medicine, Wake Forest School of Medicine, Winston-Salem, NC, USA
| |
Collapse
|
19
|
Ross S, Binczyk NM, Hamza DM, Schipper S, Humphries P, Nichols D, Donoff MG. Association of a Competency-Based Assessment System With Identification of and Support for Medical Residents in Difficulty. JAMA Netw Open 2018; 1:e184581. [PMID: 30646360 PMCID: PMC6324593 DOI: 10.1001/jamanetworkopen.2018.4581] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/05/2022] Open
Abstract
IMPORTANCE Competency-based medical education is now established in health professions training. However, critics stress that there is a lack of published outcomes for competency-based medical education or competency-based assessment tools. OBJECTIVE To determine whether competency-based assessment is associated with better identification of and support for residents in difficulty. DESIGN, SETTING, AND PARTICIPANTS This cohort study of secondary data from archived files on 458 family medicine residents (2006-2008 and 2010-2016) was conducted between July 5, 2016, and March 2, 2018, using a large, urban family medicine residency program in Canada. EXPOSURES Introduction of the Competency-Based Achievement System (CBAS). MAIN OUTCOMES AND MEASURES Proportion of residents (1) with at least 1 performance or professionalism flag, (2) receiving flags on multiple distinct rotations, (3) classified as in difficulty, and (4) with flags addressed by the residency program. RESULTS Files from 458 residents were reviewed (pre-CBAS: n = 163; 81 [49.7%] women; 90 [55.2%] aged >30 years; 105 [64.4%] Canadian medical graduates; post-CBAS: n = 295; 144 [48.8%] women; 128 [43.4%] aged >30 years; 243 [82.4%] Canadian medical graduates). A significant reduction in the proportion of residents receiving at least 1 flag during training after CBAS implementation was observed (0.38; 95% CI, 0.377-0.383), as well as a significant decrease in the numbers of distinct rotations during which residents received flags on summative assessments (0.24; 95% CI, 0.237-0.243). There was a decrease in the number of residents in difficulty after CBAS (from 0.13 [95% CI, 0.128-0.132] to 0.17 [95% CI, 0.168-0.172]) depending on the strictness of criteria defining a resident in difficulty. Furthermore, there was a significant increase in narrative documentation that a flag was discussed with the resident between the pre-CBAS and post-CBAS conditions (0.18; 95% CI, 0.178-0.183). CONCLUSIONS AND RELEVANCE The CBAS approach to assessment appeared to be associated with better identification of residents in difficulty, facilitating the program's ability to address learners' deficiencies in competence. After implementation of CBAS, residents experiencing challenges were better supported and their deficiencies did not recur on later rotations. A key argument for shifting to competency-based medical education is to change assessment approaches; these findings suggest that competency-based assessment may be useful.
Collapse
Affiliation(s)
- Shelley Ross
- Department of Family Medicine, University of Alberta, Edmonton, Alberta, Canada
| | - Natalia M. Binczyk
- Department of Family Medicine, University of Alberta, Edmonton, Alberta, Canada
| | - Deena M. Hamza
- Department of Family Medicine, University of Alberta, Edmonton, Alberta, Canada
| | - Shirley Schipper
- Department of Family Medicine, University of Alberta, Edmonton, Alberta, Canada
| | - Paul Humphries
- Department of Family Medicine, University of Alberta, Edmonton, Alberta, Canada
| | - Darren Nichols
- Department of Family Medicine, University of Alberta, Edmonton, Alberta, Canada
| | - Michel G. Donoff
- Department of Family Medicine, University of Alberta, Edmonton, Alberta, Canada
| |
Collapse
|
20
|
Krupat E. Critical Thoughts About the Core Entrustable Professional Activities in Undergraduate Medical Education. ACADEMIC MEDICINE : JOURNAL OF THE ASSOCIATION OF AMERICAN MEDICAL COLLEGES 2018; 93:371-376. [PMID: 28857790 DOI: 10.1097/acm.0000000000001865] [Citation(s) in RCA: 29] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
The Core Entrustable Professional Activities for Entering Residency (Core EPAs) have taken a strong hold on undergraduate medical education (UME). This Perspective questions their value added and considers the utility of the Core EPAs along two separate dimensions: (1) the ways they change the content and focus of the goals of UME; and (2) the extent to which entrustable professional activity (EPA)-based assessment conforms to basic principles of measurement theory as practiced in the social sciences. Concerning content and focus, the author asks whether the 13 Core EPAs frame UME too narrowly, putting competencies into the background and overlooking certain aspirational, but important and measurable, objectives of UME. The author also discusses the unevenness of EPAs in terms of their breadth and their developmental status as core activities. Regarding measurement and assessment, the author raises concerns that the EPA metric introduces layers of inference that may cause distortions and hinder accuracy and rater agreement. In addition, the use of weak anchors and multidimensional scales is also of concern. The author concludes with a proposal for reframing the Core EPAs and Accreditation Council for Graduate Medical Education competencies into broadly defined sets of behaviors, referred to as "Tasks of Medicine," and calls for the development of a systematic and longitudinal research agenda. The author asserts that "slowing down when you should" applies to medical education as well as patient care, and calls for a reevaluation of the Core EPAs before further commitment to them.
Collapse
Affiliation(s)
- Edward Krupat
- E. Krupat is associate professor, Department of Medicine, Beth Israel Deaconess Medical Center, Boston, Massachusetts. At the time of writing, the author was also director, Center for Evaluation, Harvard Medical School, Boston, Massachusetts
| |
Collapse
|