Filling the void: defining invasive bedside procedural competency for internal medicine residents

The ultrasound use of simulators, current view, and perspectives: Requirements and technical aspects (WFUMB state of the art paper)

Simulation has been shown to improve clinical learning outcomes, speed up the learning process and improve learner confidence, whilst initially taking pressure off busy clinical lists. The World Federation for Ultrasound in Medicine and Biology (WFUMB) state of the art paper on the use of simulators in ultrasound education introduces ultrasound simulation, its advantages and challenges. It describes different simulator types, including low and high-fidelity simulators, the requirements and technical aspects of simulators, followed by the clinical applications of ultrasound simulation. The paper discusses the role of ultrasound simulation in ultrasound clinical training, referencing established literature. Requirements for successful ultrasound simulation acceptance into educational structures are explored. Despite being in its infancy, ultrasound simulation already offers a wide range of training opportunities and likely holds the key to a broader point of care ultrasound education for medical students, practicing doctors, and other health care professionals. Despite the drawbacks of simulation, there are also many advantages, which are expanding rapidly as the technology evolves.

A one-week internal medicine procedure rotation designed to increase procedural opportunities and competency

Background: Mounting literature describes increased procedure volume and improvement in procedural skills following implementation of procedural curricula and standardized rotations, generally requiring at least two weeks and incorporating dedicated lecture and didactic efforts. It is unknown whether shorter rotations that feature self-directed curricula can achieve similar outcomes.Methods: House staff participated in a one-week procedure rotation that coincided with preexisting non-clinical blocks ('jeopardy'). It provided an online curriculum as well as opportunities to perform procedures under interprofessional supervision. Inpatient procedure volumes were tallied before and after implementation of the rotation. During the first year of the rotation (academic year 2013-2014), house staff completed a knowledge-based quiz and a Likert-based survey (range 1-5) addressing confidence in performing procedures and satisfaction in procedural training. Results: Ninety-five of 99 house staff participated in the intervention (96% response rate). The total number of procedures performed by the Division of Hospital Medicine increased from an average of 74 per year over the four years prior to the introduction of the rotation to 291 per year during the third year of the rotation. The knowledge-based quiz score improved from a pre-intervention mean value of 50% to a post-intervention mean value of 61% (P = 0.020). Confidence in performing procedures improved from a pre-intervention mean value of 2.37 to a post-intervention mean value of 2.59 (P < 0.001). Satisfaction with procedural training improved from a pre-intervention mean value of 2.48 to a post-intervention mean value of 2.69 (P < 0.001).Conclusions: A one-week procedure rotation with a self-directed curriculum was introduced into the curriculum of an internal medicine residency program and was associated with increased procedure volume and sustained improvement in house staff knowledge, confidence, and satisfaction with procedural training.

Weekend admissions with ascites are associated with delayed paracentesis: A nationwide analysis of the 'weekend effect'

INTRODUCTION AND OBJECTIVES

Weekend admissions has previously been associated with worse outcomes in conditions requiring specialists. Our study aimed to determine in-hospital outcomes in patients with ascites admitted over the weekends versus weekdays. Time to paracentesis from admission was studied as current guidelines recommend paracentesis within 24h for all patients admitted with worsening ascites or signs and symptoms of sepsis/hepatic encephalopathy (HE).

PATIENTS

We analyzed 70 million discharges from the 2005-2014 National Inpatient Sample to include all adult patients admitted non-electively for ascites, spontaneous bacterial peritonitis (SBP), and HE with ascites with cirrhosis as a secondary diagnosis. The outcomes were in-hospital mortality, complication rates, and resource utilization. Odds ratios (OR) and means were adjusted for confounders using multivariate regression analysis models.

RESULTS

Out of the total 195,083 ascites/SBP/HE-related hospitalizations, 47,383 (24.2%) occurred on weekends. Weekend group had a higher number of patients on Medicare and had higher comorbidity burden. There was no difference in mortality rate, total complication rates, length of stay or total hospitalization charges between the patients admitted on the weekend or weekdays. However, patients admitted over the weekends were less likely to undergo paracentesis (OR 0.89) and paracentesis within 24h of admission (OR 0.71). The mean time to paracentesis was 2.96 days for weekend admissions vs. 2.73 days for weekday admissions.

CONCLUSIONS

We observed a statistically significant "weekend effect" in the duration to undergo paracentesis in patients with ascites/SBP/HE-related hospitalizations. However, it did not affect the patient's length of stay, hospitalization charges, and in-hospital mortality.

Declines in the Number of Lumbar Punctures Performed at United States Children's Hospitals, 2009-2019

OBJECTIVE

To evaluate trends in lumbar puncture (LP) performance among US children's hospitals to assess how these trends may impact pediatric resident trainee exposure to LP.

STUDY DESIGN

We quantified LPs for emergency department (ED) and inpatient encounters at 29 US children's hospitals from 2009 to 2019. LP was defined by either a LP procedure code or cerebrospinal fluid culture billing code. Temporal trends and hospital variation in LP were assessed using logistic regression analysis.

RESULTS

A total of 215 030 LPs were performed during the study period (0.8% of all encounters). Twenty six thousand and five hundred twenty three and 16 696 LPs were performed in the 2009 and 2018 academic years, respectively (overall 37.1% reduction, per-year OR, 0.935; 95% CI, 0.922-0.948; P < .001), and the rate of LP decreased from 10.9 per 1000 hospital encounters to 6.0 per 1000 hospital encounters over the same period.

CONCLUSIONS

LP rates have declined across US children's hospitals over the past decade, potentially resulting in reduced clinical exposure for pediatric resident trainees. Improved procedural simulation during residency may augment the clinical experience.

Recommendations on the Use of Ultrasound Guidance for Central and Peripheral Vascular Access in Adults: A Position Statement of the Society of Hospital Medicine

PREPROCEDURE

1)We recommend that providers should be familiar with the operation of their specific ultrasound machine prior to initiation of a vascular access procedure. 2)We recommend that providers should use a high-frequency linear transducer with a sterile sheath and sterile gel to perform vascular access procedures. 3)We recommend that providers should use two-dimensional ultrasound to evaluate for anatomical variations and absence of vascular thrombosis during preprocedural site selection. 4)We recommend that providers should evaluate the target blood vessel size and depth during preprocedural ultrasound evaluation.

TECHNIQUES

General Techniques 5) We recommend that providers should avoid using static ultrasound alone to mark the needle insertion site for vascular access procedures. 6)We recommend that providers should use real-time (dynamic), two-dimensional ultrasound guidance with a high-frequency linear transducer for central venous catheter (CVC) insertion, regardless of the provider's level of experience. 7)We suggest using either a transverse (short-axis) or longitudinal (long-axis) approach when performing real-time ultrasound-guided vascular access procedures. 8)We recommend that providers should visualize the needle tip and guidewire in the target vein prior to vessel dilatation. 9)To increase the success rate of ultrasound-guided vascular access procedures, we recommend that providers should utilize echogenic needles, plastic needle guides, and/or ultrasound beam steering when available. Central Venous Access Techniques 10) We recommend that providers should use a standardized procedure checklist that includes the use of real-time ultrasound guidance to reduce the risk of central line-associated bloodstream infection (CLABSI) from CVC insertion. 11)We recommend that providers should use real-time ultrasound guidance, combined with aseptic technique and maximal sterile barrier precautions, to reduce the incidence of infectious complications from CVC insertion. 12)We recommend that providers should use real-time ultrasound guidance for internal jugular vein catheterization, which reduces the risk of mechanical and infectious complications, the number of needle passes, and time to cannulation and increases overall procedure success rates. 13)We recommend that providers who routinely insert subclavian vein CVCs should use real-time ultrasound guidance, which has been shown to reduce the risk of mechanical complications and number of needle passes and increase overall procedure success rates compared with landmark-based techniques. 14)We recommend that providers should use real-time ultrasound guidance for femoral venous access, which has been shown to reduce the risk of arterial punctures and total procedure time and increase overall procedure success rates. Peripheral Venous Access Techniques 15) We recommend that providers should use real-time ultrasound guidance for the insertion of peripherally inserted central catheters (PICCs), which is associated with higher procedure success rates and may be more cost effective compared with landmark-based techniques. 16)We recommend that providers should use real-time ultrasound guidance for the placement of peripheral intravenous lines (PIV) in patients with difficult peripheral venous access to reduce the total procedure time, needle insertion attempts, and needle redirections. Ultrasound-guided PIV insertion is also an effective alternative to CVC insertion in patients with difficult venous access. 17)We suggest using real-time ultrasound guidance to reduce the risk of vascular, infectious, and neurological complications during PIV insertion, particularly in patients with difficult venous access. Arterial Access Techniques 18)We recommend that providers should use real-time ultrasound guidance for arterial access, which has been shown to increase first-pass success rates, reduce the time to cannulation, and reduce the risk of hematoma development compared with landmark-based techniques. 19)We recommend that providers should use real-time ultrasound guidance for femoral arterial access, which has been shown to increase first-pass success rates and reduce the risk of vascular complications. 20)We recommend that providers should use real-time ultrasound guidance for radial arterial access, which has been shown to increase first-pass success rates, reduce the time to successful cannulation, and reduce the risk of complications compared with landmark-based techniques.

POSTPROCEDURE

21) We recommend that post-procedure pneumothorax should be ruled out by the detection of bilateral lung sliding using a high-frequency linear transducer before and after insertion of internal jugular and subclavian vein CVCs. 22)We recommend that providers should use ultrasound with rapid infusion of agitated saline to visualize a right atrial swirl sign (RASS) for detecting catheter tip misplacement during CVC insertion. The use of RASS to detect the catheter tip may be considered an advanced skill that requires specific training and expertise.

TRAINING

23) To reduce the risk of mechanical and infectious complications, we recommend that novice providers should complete a systematic training program that includes a combination of simulation-based practice, supervised insertion on patients, and evaluation by an expert operator before attempting ultrasound-guided CVC insertion independently on patients. 24)We recommend that cognitive training in ultrasound-guided CVC insertion should include basic anatomy, ultrasound physics, ultrasound machine knobology, fundamentals of image acquisition and interpretation, detection and management of procedural complications, infection prevention strategies, and pathways to attain competency. 25)We recommend that trainees should demonstrate minimal competence before placing ultrasound-guided CVCs independently. A minimum number of CVC insertions may inform this determination, but a proctored assessment of competence is most important. 26)We recommend that didactic and hands-on training for trainees should coincide with anticipated times of increased performance of vascular access procedures. Refresher training sessions should be offered periodically. 27)We recommend that competency assessments should include formal evaluation of knowledge and technical skills using standardized assessment tools. 28)We recommend that competency assessments should evaluate for proficiency in the following knowledge and skills of CVC insertion: (a) Knowledge of the target vein anatomy, proper vessel identification, and recognition of anatomical variants; (b) Demonstration of CVC insertion with no technical errors based on a procedural checklist; (c) Recognition and management of acute complications, including emergency management of life-threatening complications; (d) Real-time needle tip tracking with ultrasound and cannulation on the first attempt in at least five consecutive simulation. 29)We recommend a periodic proficiency assessment of all operators should be conducted to ensure maintenance of competency.

Ultrasound-guided Bedside Core Needle Biopsy: A Hospitalist Procedure Team's Experience

Tissue pathology is integral for the diagnosis of various conditions, especially malignancy. Traditionally, biopsy procedures, including core needle biopsy (CNB), are performed by surgeons or radiologists. With the increasing utilization of point of care ultrasound (POCUS) skills and competence in bedside procedures by general internists, CNB can be safely moved to the patient's bedside with maintained accuracy and increased cost savings compared to traditional procedural methods. We aim to review the experience of our hospitalist-run medical procedure service in performing these ultrasound-guided procedures at the bedside.

Paracentesis Simulation: A Comprehensive Approach to Procedural Education

INTRODUCTION

Structured procedural education and assessment of competency are growing needs for residency and fellowship programs. Simulation is a useful way to learn, experience, and practice procedural skills with competence. Paracentesis is a common procedure encountered in internal medicine. This educational resource for paracentesis education includes didactics, cases, and assessments to address cognitive skills, a simulation experience to address psychomotor procedural skills, and an entrustment-based assessment tool.

METHODS

Prior to the simulation, learners completed preprocedural didactics and self-assessments. Utilizing a paracentesis trainer, ultrasound, and paracentesis kit, the case of a 46-year-old male with ascites in need of a paracentesis was presented. During the simulation, learners initially performed a paracentesis step by step, with assistance and feedback from the case instructor. This was immediately followed by paracentesis without assistance, where the instructor evaluated the learners with an assessment tool encompassing a procedural checklist, global skill assessment scale, and entrustment scale. Afterwards, learners completed case-based reviews and returned to the simulation lab several months later to repeat an unassisted paracentesis.

RESULTS

The curriculum was used with internal medicine and medicine-pediatric residents of all training levels. To date, over 120 residents have completed the curriculum. Residents reported an increase in self-confidence and competence using ultrasound to identify ascites and performing a paracentesis. Learners provided positive feedback.

DISCUSSION

This curriculum offers the opportunity for both cognitive and psychomotor paracentesis education in a low-risk simulation environment. The comprehensive strategy with didactics, cases, and multiple simulations is designed to promote knowledge and skill retention.

Credentialing of Hospitalists in Ultrasound-Guided Bedside Procedures: A Position Statement of the Society of Hospital Medicine

Ultrasound guidance is used increasingly to perform the following 6 bedside procedures that are core competencies of hospitalists: abdominal paracentesis, arterial catheter placement, arthrocentesis, central venous catheter placement, lumbar puncture, and thoracentesis. Yet most hospitalists have not been certified to perform these procedures, whether using ultrasound guidance or not, by specialty boards or other institutions extramural to their own hospitals. Instead, hospital privileging committees often ask hospitalist group leaders to make ad hoc intramural certification assessments as part of credentialing. Given variation in training and experience, such assessments are not straightforward "sign offs." We thus convened a panel of experts to conduct a systematic review to provide recommendations for credentialing hospitalist physicians in ultrasound guidance of these 6 bedside procedures. Pathways for initial and ongoing credentialing are proposed. A guiding principle of both is that certification assessments for basic competence are best made through direct observation of performance on actual patients.

Core Competencies or a Competent Core? A Scoping Review and Realist Synthesis of Invasive Bedside Procedural Skills Training in Internal Medicine

PURPOSE

Invasive bedside procedures are core competencies for internal medicine, yet no formal training guidelines exist. The authors conducted a scoping review and realist synthesis to characterize current training for lumbar puncture, arthrocentesis, paracentesis, thoracentesis, and central venous catheterization. They aimed to collate how educators justify using specific interventions, establish which interventions have the best evidence, and offer directions for future research and training.

METHOD

The authors systematically searched Medline, Embase, the Cochrane Library, and ERIC through April 2015. Studies were screened in three phases; all reviews were performed independently and in duplicate. The authors extracted information on learner and patient demographics, study design and methodological quality, and details of training interventions and measured outcomes. A three-step realist synthesis was performed to synthesize findings on each study's context, mechanism, and outcome, and to identify a foundational training model.

RESULTS

From an initial 6,671 studies, 149 studies were further reduced to 67 (45%) reporting sufficient information for realist synthesis. Analysis yielded four types of procedural skills training interventions. There was relative consistency across contexts and significant differences in mechanisms and outcomes across the four intervention types. The medical procedural service was identified as an adaptable foundational training model.

CONCLUSIONS

The observed heterogeneity in procedural skills training implies that programs are not consistently developing residents who are competent in core procedures. The findings suggest that researchers in education and quality improvement will need to collaborate to design training that develops a "competent core" of proceduralists using simulation and clinical rotations.

Simulation Improves Procedural Protocol Adherence During Central Venous Catheter Placement: A Randomized Controlled Trial

BACKGROUND

Simulation training may improve proficiency at and reduce complications from central venous catheter (CVC) placement, but the scope of simulation's effect remains unclear. This randomized controlled trial evaluated the effects of a pragmatic CVC simulation program on procedural protocol adherence, technical skill, and patient outcomes.

METHODS

Internal medicine interns were randomized to standard training for CVC insertion or standard training plus simulation-based mastery training. Standard training involved a lecture, a video-based online module, and instruction by the supervising physician during actual CVC insertions. Intervention-group subjects additionally underwent supervised training on a venous access simulator until they demonstrated procedural competence. Raters evaluated interns' performance during internal jugular CVC placement on actual patients in the medical intensive care unit. Generalized estimating equations were used to account for outcome clustering within trainees.

RESULTS

We observed 52 interns placing 87 CVCs. Simulation-trained interns exhibited better adherence to prescribed procedural technique than interns who received only standard training (P = 0.024). There were no significant differences detected in first-attempt or overall cannulation success rates, mean needle passes, global assessment scores, or complication rates.

CONCLUSIONS

Simulation training added to standard training improved protocol adherence during CVC insertion by novice practitioners. This study may have been too small to detect meaningful differences in venous cannulation proficiency and other clinical outcomes, highlighting the difficulty of patient-centered simulation research in settings where poor outcomes are rare. For high-performing systems, where protocol deviations may provide an important proxy for rare procedural complications, simulation may improve CVC insertion quality and safety.

Potential impact of a bedside procedure service on training procedurally competent hospitalists in a community-based residency program

BACKGROUND

The Society of Hospital Medicine has delineated procedures as one of the core competencies for hospitalists. Little is known about whether exposure to a medical procedure service (MPS) impacts the procedural certification rate in internal medicine trainees in a community hospital training program.

OBJECTIVE

To determine whether or not exposure to an MPS would impact both the number of procedures performed and the rate of resultant certifications in a community hospital internal medicine training program.

DESIGN

Retrospective review.

METHODS

Five cohorts of resident physicians and their procedure data were analyzed comparing months where residents were unexposed to the intervention (pre-MPS) to months where residents were exposed to the intervention (post-MPS). We calculated the average number of procedures performed per month for pre- versus post-MPS periods. For procedural certification, we compared two proportions: the number of certifications over the number of 6-month pre-MPS periods and the number of certifications over the number of 6-month post-MPS periods.

SETTING/SUBJECTS

The study was conducted at a community-based academic medical center. Subjects included all internal medicine residents.

RESULTS

We found a statistically significant difference between the groups, with pre-MPS groups performing 4.3 procedures per month compared with post-MPS groups performing 6.7 procedures per month (p=0.0010). For certification rates, we found statistically significant differences in several categories - overall, paracentesis, femoral central lines, and jugular central lines.

CONCLUSIONS

This study demonstrated that resident exposure to an MPS statistically significantly increased the total number of procedures performed. This study also showed that overall certification rates were statistically significantly different between the pre- and post-MPS groups for several procedures.

Developing a Tool to Assess Placement of Central Venous Catheters in Pediatrics Patients

BACKGROUND

Pediatric critical care medicine requires the acquisition of procedural skills, but to date no criteria exist for assessing trainee competence in central venous catheter (CVC) insertion.

OBJECTIVE

The goal of this study was to create and demonstrate validity evidence for a direct observation tool for assessing CVC insertion.

METHODS

Ten experts used the modified Delphi technique to create a 15-item direct observation tool to assess 5 scripted and filmed simulated scenarios of CVC placement. The scenarios were hosted on a dedicated website from March to May 2013, and respondents recruited by e-mail completed the observation tool in real time while watching the scenarios. The goal was to obtain 50 respondents and a total of 250 scenario ratings.

RESULTS

A total of 49 pediatrics intensive care faculty physicians (6.3% of 780 potential subjects) responded and generated 188 scenario observations. Of these, 150 (79.8%) were recorded from participants who scored 4 or more on the 5 scenarios. The tool correctly identified the expected reference standard in 96.8% of assessments with an interrater agreement kappa (standard error) = 0.94 (0.07) and receiver operating characteristic = 0.97 (95% CI 0.94-0.99).

CONCLUSIONS

This direct observation assessment tool for central venous catheterization demonstrates excellent performance in identifying the reference standard with a high degree of interrater reliability. These assessments support a validity construct for a pediatric critical care medicine faculty member to assess a provider placing a CVC in a pediatrics patient.

Neonatal-perinatal medicine fellow procedural experience and competency determination: results of a national survey

OBJECTIVE

Ensuring that neonatal-perinatal medicine (NPM) fellows attain competency in performing neonatal procedures is a requirement of training-competent neonatologists.

STUDY DESIGN

A survey of NPM fellows was performed to determine the procedural experience of current fellows, investigate techniques used to track procedural experience and examine the methods programs use to verify procedural competency.

RESULTS

One hundred and sixty-three fellows in 57 accredited training programs responded to the survey. Reported number of procedures provide contemporary normative data on procedural experience during training. The majority of fellows reported using an online reporting system to track experience. The most common technique to verify procedural competency was supervised practice until an arbitrary number of procedures had been performed.

CONCLUSIONS

NPM fellow procedural experience increases significantly for most, but not all, procedures duration training. We speculate that supplemental simulation training for rare neonatal procedures would help ensure the competency of graduating NPM fellows. Experience alone is insufficient to verify competency. Further work on the accurate tracking of experience and verification of procedural competency is needed.

Validation of a performance checklist for ultrasound-guided internal jugular central lines for use in procedural instruction and assessment

PURPOSE OF THE STUDY

Tools created to measure procedural competency must be tested in their intended environment against an established standard in order to be validated. We previously created a checklist for ultrasound-guided internal jugular central venous catheter (US IJ CVC) insertion using the modified Delphi method. We sought to further validate the checklist tool for use in an educational environment.

STUDY DESIGN

This is a cohort study involving 15 emergency medicine interns being evaluated on their skill in US IJ CVC placement. We compared the checklist tool with a modified version of a clinically validated global rating scale (GRS) for procedural performance.

RESULTS

The correlation between the GRS tool and the checklist tool was excellent, with a correlation coefficient (Pearson's r) of 0.90 (p<0.0001).

CONCLUSIONS

This checklist represents a useful tool for measuring procedural competency.

Video-augmented feedback for procedural performance

BACKGROUND

Resident programs must assess residents' achievement of core competencies for clinical and procedural skills.

AIMS

Video-augmented feedback may facilitate procedural skill acquisition and promote more accurate self-assessment.

METHODS

A randomized controlled study to investigate whether video-augmented verbal feedback leads to increased procedural skill and improved accuracy of self-assessment compared to verbal only feedback. Participants were evaluated during procedural training for ultrasound guided internal jugular central venous catheter (US IJ CVC) placement. All participants received feedback based on a validated 30-point checklist for US IJ CVC placement and validated 6-point procedural global rating scale.

RESULTS

Scores in both groups improved by a mean of 9.6 points (95% CI: 7.8-11.4) on the 30-point checklist, with no difference between groups in mean score improvement on the global rating scale. In regards to self-assessment, participant self-rating diverged from faculty scoring, increasingly so after receiving feedback. Residents rated highly by faculty underestimated their skill, while those rated more poorly demonstrated increasing overestimation.

CONCLUSIONS

Accuracy of self-assessment was not improved by addition of video. While feedback advanced the skill of the resident, video-augmented feedback did not enhance skill acquisition or improve accuracy of resident self-assessment compared to standard feedback.

Training using simulation in internal medicine residencies: an educational perspective

BACKGROUND

The American Board of Internal Medicine has defined through the min-CEX (Clinical Examination booklet) that a resident would need to perform anywhere from 3 to 5 procedures to be competent in a given procedure. Many faculty and residents believe that this number is too low to achieve competency.

METHODS

Although simulation has been required as part of medical training, we have reviewed a number of articles addressing competence and potentially fewer complications with improved patient safety.

RESULTS

The Accreditation Council for Graduate Medical Education has simply stated that simulation should be part of residency training. However, this has resulted in a disorganized approach among the nearly 385 internal medicine programs in the United States.

CONCLUSIONS

This article suggests a model of simulation that addresses procedures, medical codes and major medical problems that each resident achieve competence in before graduating residency. This would require minimally a doubling of the number of procedures to define competency and will do so in a far more scientific method.