1
|
Mohanty S, Mohanty A, Cool JA, Ricotta DN. Evaluation of Outpatient Procedures Simulation Curriculum for Internal Medicine Residents. J Gen Intern Med 2025; 40:1782-1788. [PMID: 40000517 PMCID: PMC12119452 DOI: 10.1007/s11606-025-09394-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/29/2024] [Accepted: 01/17/2025] [Indexed: 02/27/2025]
Abstract
BACKGROUND Outpatient procedure training in internal medicine residency has not been shown to produce high-level outcomes such as improved volume and quality of procedures performed on real patients. OBJECTIVE The objective of this study was to improve the volume and quality of outpatient procedures performed by internal medicine residents by administering a simulation-based curricular intervention. DESIGN Validated teaching materials and local faculty input were used to design a simulation curriculum for teaching the knee joint injection/aspiration and skin abscess incision and drainage. A prospective curricular intervention was implemented for a single cohort of internal medicine interns. PARTICIPANTS All internal medicine interns at Beth Israel Deaconess Medical Center during the 2021-2022 academic year were allowed to participate in this educational intervention with no exclusion criteria. INTERVENTIONS Forty-seven interns received 30 min of simulation education for each procedure. MAIN MEASURES Primary outcomes included total number of procedures performed in clinic, volume of procedures performed by residents, percentage of total procedures performed by residents, and procedural success and complication rates before and after the curricular intervention. KEY RESULTS At 1-year post-curriculum, the total number of procedures in clinic increased by 25%. Procedures by residents increased by 110%, with joint injections/aspirations increasing by 317% and skin abscess incision and drainage increasing by 200%. Complication rates reduced from 25 to 0%, and 100% of resident-performed procedures post-curriculum were completed successfully. CONCLUSION These findings demonstrate that a novel outpatient procedures simulation curriculum can positively impact higher-level clinical practice outcomes for internal medicine residents.
Collapse
Affiliation(s)
- Sudipta Mohanty
- Beth Israel Deaconess Medical Center, Boston, MA, USA.
- Harvard Medical School, Boston, MA, USA.
- Division of General Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA.
| | - Aditya Mohanty
- Beth Israel Deaconess Medical Center, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Joséphine A Cool
- Beth Israel Deaconess Medical Center, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
| | - Daniel N Ricotta
- Beth Israel Deaconess Medical Center, Boston, MA, USA
- Harvard Medical School, Boston, MA, USA
- Shapiro Institute for Education and Research, Boston, MA, USA
| |
Collapse
|
2
|
Murray J, Ramirez-Gomez A, Cahill M, Deptola A, Diffie C, McDonnell P, Metzler JP, Olafsen NP, Zickuhr L. Workshop, Assessment, and Validity Evidence for Tools Measuring Performance of Knee and Shoulder Arthrocentesis. MEDEDPORTAL : THE JOURNAL OF TEACHING AND LEARNING RESOURCES 2023; 19:11309. [PMID: 37064429 PMCID: PMC10101652 DOI: 10.15766/mep_2374-8265.11309] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/26/2022] [Accepted: 01/02/2023] [Indexed: 06/19/2023]
Abstract
INTRODUCTION Musculoskeletal concerns are common, yet residents at our institution lacked arthrocentesis training. We created a workshop to teach residents knee and shoulder arthrocentesis, developed simulated assessment scenarios (SASs) with tools to measure procedural proficiency, and collected validity evidence. METHODS A multidisciplinary group conducted a modified Delphi to define content for the workshop, SASs, and assessment tools. We defined minimum thresholds for competence in knee and shoulder arthrocentesis using the modified borderline-group method. We implemented the workshop and SASs in 2020 and 2021 and analyzed assessment tool scoring for statistical reliability and validity. Our program evaluation included SAS performance, participants' survey responses, and change in the number of arthrocenteses performed in the internal medicine (IM) resident primary care clinic. RESULTS Sixty-one residents (53 IM, eight physical medicine and rehabilitation [PM&R]) participated. Fifty-two (85%; 46 IM, six PM&R) completed the evaluation survey. We procured data from 48 knee and 65 shoulder SASs for validity evidence. All arthrocentesis SAS performances met the proficiency standard except one resident's shoulder SAS. Validity evidence revealed strong interrater reliability (α = .82 and .77 for knee and shoulder, respectively) and strong relational validity (p < .001 for both procedures). All participants rated workshop quality and usefulness as good or very good. The number of arthrocenteses performed at our institution's primary care clinic increased. DISCUSSION We created a workshop to teach residents arthrocentesis and assessment tools with strong validity and reliability evidence. The workshop was well regarded by residents, who applied their arthrocentesis skills during patient care.
Collapse
Affiliation(s)
- Jacob Murray
- Fellow, Division of Rheumatology, Washington University School of Medicine in St. Louis
| | - Andrea Ramirez-Gomez
- Clinical Associate of Medicine, Section of Rheumatology, University of Chicago Pritzker School of Medicine
| | - Mike Cahill
- Research Scientist and Data Analyst, Center for Integrative Research on Cognition, Learning and Education, Washington University in St. Louis
| | - Amber Deptola
- Attending Physician, Internal Medicine, Norton Medical Group
| | - Colin Diffie
- Assistant Professor of Medicine, Division of Rheumatology, Washington University School of Medicine in St. Louis
| | - Peter McDonnell
- Instructor in Medicine, Division of General Medicine, Washington University School of Medicine in St. Louis
| | - John P. Metzler
- Associate Professor of Orthopedic Surgery, Division of Physical Medicine and Rehabilitation, Washington University School of Medicine in St. Louis
| | - Nathan P. Olafsen
- Assistant Professor of Orthopedic Surgery, Division of Physical Medicine and Rehabilitation, Washington University School of Medicine in St. Louis
| | - Lisa Zickuhr
- Assistant Professor of Medicine, Division of Rheumatology, Washington University School of Medicine in St. Louis
| |
Collapse
|
3
|
Mank VMF, Arter Z, Mank J, Eum KS, Roberts J. Improving Self-Confidence of Military Medical Providers With Joint Procedure Simulation: A Pilot Study. Mil Med 2023; 188:e382-e387. [PMID: 34318332 DOI: 10.1093/milmed/usab319] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 06/09/2021] [Accepted: 07/14/2021] [Indexed: 01/11/2023] Open
Abstract
INTRODUCTION Military medical providers are a unique population that encounter different environments across the world. From hospital clinics to war zones, these providers must perform procedures and rely on their training and skill to help their patients. This pilot study aimed to assess the self-confidence of military medical providers performing joint aspiration and injection before and after a simulation workshop in both clinical and austere settings. METHODS In 2016, 25 military physicians from various military facilities participated in a 1-hour knee arthrocentesis and injection and shoulder injection workshop. Education was provided on the knee and shoulder anatomy and various approaches to performing the procedures before the hands-on portion of the workshop. Surveys assessing self-reported confidence levels by performing the procedures in the clinic and austere settings were completed before and after simulation training. RESULTS The results were analyzed and grouped based on the provider experience level, simulation environment, and specific procedure performed. There was a statistical significance seen in the shoulder arthrocentesis group, which included all participating providers, with a P-value of <.01 in the clinic setting and a P-value of <.001 in the austere setting. In the knee aspiration simulation, there were also improvements in the provider confidence, but it was not statistically significant with P-values of .36 and .14 in the clinical and austere settings, respectively. CONCLUSION Simulation training can lead to increased medical provider self-confidence in performing musculoskeletal joint aspirations and injections in both clinic and austere settings. The military medicine demographics have had little research in joint injections and provider confidence to date. This pilot study was one of the first to evaluate this unique population. The methods used in this study, and the positive data collected on provider confidence, can be used in larger studies, encompassing other medical providers to increase the confidence of providers throughout various fields of medicine.
Collapse
Affiliation(s)
- Victoria M F Mank
- Department of Internal Medicine, Tripler Army Medical Center, Honolulu, HI 96859, USA
| | - Zhaohui Arter
- Department of Internal Medicine, Tripler Army Medical Center, Honolulu, HI 96859, USA
| | - Jeffrey Mank
- University of New England, Biddeford, ME 04005, USA
| | - Ki Suk Eum
- Division of Rheumatology, Scripps Green Hospital, La Jolla, CA 92037, USA
| | - Jefferson Roberts
- Department of Rheumatology, Tripler Army Medical Center, Honolulu, HI 96859, USA
| |
Collapse
|
4
|
Carstensen SMD, Velander MJ, Konge L, Østergaard M, Pfeiffer Jensen M, Just SA, Terslev L. Training and assessment of musculoskeletal ultrasound and injection skills-a systematic review. Rheumatology (Oxford) 2022; 61:3889-3901. [PMID: 35218339 DOI: 10.1093/rheumatology/keac119] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 02/17/2022] [Indexed: 11/12/2022] Open
Abstract
OBJECTIVES To examine how residents are trained and assessed in musculoskeletal ultrasound (MSUS), MSUS-guided and landmark-guided joint aspiration and injection. Additionally, to present the available assessment tools and examine their supporting validity evidence. METHODS A systematic search of PubMed, Cochrane Library, and Embase was conducted in accordance with the PRISMA guidelines and studies published from January 1, 2000 to May 31, 2021 were included. Two independent reviewers performed the search and data extraction. The studies were evaluated using the Medical Education Research Quality Instrument (MERSQI). RESULTS 9,884 articles were screened, and 43 were included; 3 were randomized studies, 21 pre- and post-test studies, 16 descriptive studies, and 3 studies developing assessment tools. The studies used various theoretical training modalities e.g. lectures, anatomical quizzes and e-learning. The practical training models varied from mannequins and cadavers to healthy volunteers and patients. The majority of studies used subjective "comfort level" as assessment, others used practical examination and/or theoretical examination. All training programs increased trainees' self-confidence, theoretical knowledge, and/or practical performance, however few used validated assessment tools to measure the effect. Only one study met the MERSQI high methodical quality cut-off score of 14. CONCLUSION The included studies were heterogeneous, and most were of poor methodological quality and not based on contemporary educational theories. This review highlights the need for educational studies using validated theoretical and practical assessment tools to ensure optimal MSUS training and assessment in rheumatology.
Collapse
Affiliation(s)
- Stine M D Carstensen
- Copenhagen Center for Arthritis Research, Center for Rheumatology and Spine Diseases, Centre for Head and Orthopaedics, Rigshospitalet Glostrup Valdemar Hansens Vej 17, Glostrup, Denmark.,Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark.,Copenhagen Academy for Medical Education and Simulation, The Capital Region of Denmark, Copenhagen, Denmark
| | - Marie Juul Velander
- Section of Rheumatology, Department of Medicine, Svendborg Hospital-OUH Baagøes Allé 15, Svendborg, Denmark
| | - Lars Konge
- Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark.,Copenhagen Academy for Medical Education and Simulation, The Capital Region of Denmark, Copenhagen, Denmark
| | - Mikkel Østergaard
- Copenhagen Center for Arthritis Research, Center for Rheumatology and Spine Diseases, Centre for Head and Orthopaedics, Rigshospitalet Glostrup Valdemar Hansens Vej 17, Glostrup, Denmark.,Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Mogens Pfeiffer Jensen
- Copenhagen Center for Arthritis Research, Center for Rheumatology and Spine Diseases, Centre for Head and Orthopaedics, Rigshospitalet Glostrup Valdemar Hansens Vej 17, Glostrup, Denmark.,Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Søren Andreas Just
- Section of Rheumatology, Department of Medicine, Svendborg Hospital-OUH Baagøes Allé 15, Svendborg, Denmark
| | - Lene Terslev
- Copenhagen Center for Arthritis Research, Center for Rheumatology and Spine Diseases, Centre for Head and Orthopaedics, Rigshospitalet Glostrup Valdemar Hansens Vej 17, Glostrup, Denmark.,Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|