An Assessment Tool for the Placement of Ultrasound-Guided Peripheral Intravenous Access

A consensus list of ultrasound competencies for graduating emergency medicine residents

Objectives

Emergency ultrasound (EUS) is a critical component of emergency medicine (EM) resident education. Currently, there is no consensus list of competencies for EUS training, and graduating residents have varying levels of skill and comfort. The objective of this study was to define a widely accepted comprehensive list of EUS competencies for graduating EM residents through a modified Delphi method.

Methods

We developed a list of EUS applications through a comprehensive literature search, the American College of Emergency Physicians list of core EUS benchmarks, and the Council of Emergency Medicine Residency-Academy of Emergency Ultrasound consensus document. We assembled a multi-institutional expert panel including 15 faculty members from diverse practice environments and geographical regions. The panel voted on the list of competencies through two rounds of a modified Delphi process using a modified Likert scale (1 = not at all important, 5 = very important) to determine levels of agreement for each application-with revisions occurring between the two rounds. High agreement for consensus was set at >80%.

Results

Fifteen of 15 panelists completed the first-round survey (100%) that included 359 topics related to EUS. After the first round, 195 applications achieved high agreement, four applications achieved medium agreement, and 164 applications achieved low agreement. After the discussion, we removed three questions and added 13 questions. Fifteen of 15 panelists completed the second round of the survey (100%) with 209 of the 369 applications achieving consensus.

Conclusion

Our final list represents expert opinion on EUS competencies for graduating EM residents. We hope to use this consensus list to implement a more consistent EUS curriculum for graduating EM residents and to standardize EUS training across EM residency programs.

Critical Appraisal of Emergency Medicine Educational Research: The Best Publications of 2016

OBJECTIVES

The objectives were to critically appraise the emergency medicine (EM) medical education literature published in 2016 and review the highest-quality quantitative and qualitative studies.

METHODS

A search of the English language literature in 2016 querying MEDLINE, Scopus, Education Resources Information Center (ERIC), and PsychInfo identified 510 papers related to medical education in EM. Two reviewers independently screened all of the publications using previously established exclusion criteria. The 25 top-scoring quantitative studies based on methodology and all six qualitative studies were scored by all reviewers using selected scoring criteria that have been adapted from previous installments. The top-scoring articles were highlighted and trends in medical education research were described.

RESULTS

Seventy-five manuscripts met inclusion criteria and were scored. Eleven quantitative and one qualitative papers were the highest scoring and are summarized in this article.

CONCLUSION

This annual critical appraisal series highlights the best EM education research articles published in 2016.

Remediation Strategies for Emergency Medicine Patient Care Milestones

Early identification and successful remediation of unachieved emergency medicine (EM) milestones are challenging for program directors. Residents who fail to achieve milestones in the expected time frame will have varied educational needs to course correct, dependent on the year of training, as well as the specific deficiencies to resolve. Experts from the Council of Residency Directors in Emergency Medicine (CORD-EM) Remediation Task Force (RTF) collaborated with the objective to create tools for identifying and remediating residents with deficiencies in patient care milestones (PCMs).

Hand motion analysis for assessment of nursing competence in ultrasound-guided peripheral intravenous catheter placement

Introduction:

Objective measures such as hand motion analysis are needed to assess competency in technical skills, including ultrasound-guided procedures. Ultrasound-guided peripheral intravenous catheter placement has many potential benefits and is a viable skill for nurses to learn. The objective of this study was to demonstrate the feasibility and validity of hand motion analysis for assessment of nursing competence in ultrasound-guided peripheral intravenous placement.

Methods:

We conducted a prospective cohort study at a tertiary children’s hospital. Participants included a convenience sample of nurses with no ultrasound-guided peripheral intravenous experience and experts in ultrasound-guided peripheral intravenous placement. Nurses completed hand motion analysis before and after participating in a simulation-based ultrasound-guided peripheral intravenous placement training program. Experts also completed hand motion analysis to provide benchmark measurements. After training, nurses performed ultrasound-guided peripheral intravenous placement in clinical practice and self-reported details of attempts.

Results:

A total of 21 nurses and 6 experts participated. Prior to the hands-on training session, experts performed significantly better in all hand motion analysis metrics and procedure time. After completion of the hands-on training session, the nurses showed significant improvement in all hand motion analysis metrics and procedure time. Few nurses achieved hand motion analysis metrics within the expert benchmark after completing the hands-on training session with the exception of angiocatheter motion smoothness. In total, 12 nurses self-reported 38 ultrasound-guided peripheral intravenous placement attempts in clinical practice with a success rate of 60.5%.

Discussion:

We demonstrated the feasibility and construct validity of hand motion analysis as an objective assessment of nurse competence in ultrasound-guided peripheral intravenous placement. Nurses demonstrated rapid skill acquisition but did not achieve expert-level proficiency.

Credentialing of Hospitalists in Ultrasound-Guided Bedside Procedures: A Position Statement of the Society of Hospital Medicine

Ultrasound guidance is used increasingly to perform the following 6 bedside procedures that are core competencies of hospitalists: abdominal paracentesis, arterial catheter placement, arthrocentesis, central venous catheter placement, lumbar puncture, and thoracentesis. Yet most hospitalists have not been certified to perform these procedures, whether using ultrasound guidance or not, by specialty boards or other institutions extramural to their own hospitals. Instead, hospital privileging committees often ask hospitalist group leaders to make ad hoc intramural certification assessments as part of credentialing. Given variation in training and experience, such assessments are not straightforward "sign offs." We thus convened a panel of experts to conduct a systematic review to provide recommendations for credentialing hospitalist physicians in ultrasound guidance of these 6 bedside procedures. Pathways for initial and ongoing credentialing are proposed. A guiding principle of both is that certification assessments for basic competence are best made through direct observation of performance on actual patients.

Validation of the Peripheral Ultrasound-guided Vascular Access Rating Scale

Evidence-based standards in proficiency are needed for ultrasound-guided peripheral intravenous access. In this study, we explored the validity of the Peripheral Ultrasound-Guided Vascular Access (P-UGVA) Rating Scale.We recruited 3 groups of physicians (5 novices, 5 intermediates, and 5 experts) of increasing proficiency in peripheral ultrasound-guided intravenous access. All participants performed 3 peripheral ultrasound-guided intravenous accesses on three different patients. Performance was video-recorded by 3 cameras and the ultrasound image. Synchronized and anonymized split-screen film clips were rated using the P-UGVA rating scale by 2 assessors, which also assessed overall performance on a 1-5 Likert-scale. Evidence of validity was explored using the contemporary validity framework by Messick (content, response process, internal structure, relations to other variables, and consequences).Content and response process was ensured in the development of the rating scale and validity study. Internal consistency of the P-UGVA rating scale was excellent and sufficient high for certification purposes (Cronbach's alpha = 0.91). Proficiency groups were successfully discriminated by the UPGIVA rating scale (P = .029, one-way ANOVA), and the P-UGVA rating scale scores also correlated strongly with the overall performance evaluations (rho = 0.87, P < .001, Pearson correlation). We calculated a pass/fail score of 29, which lead to a theoretical false positive rate of 26.5% and false negative rate of 8.5%.We present validity evidence for the P-UGVA rating scale and an evidence-based standard in proficiency for ultrasound-guided peripheral intravenous access.