Development of a multisystem point of care ultrasound skills assessment checklist

Background

Many institutions are training clinicians in point-of-care ultrasound (POCUS), but few POCUS skills checklists have been developed and validated. We developed a consensus-based multispecialty POCUS skills checklist with anchoring references for basic cardiac, lung, abdominal, and vascular ultrasound, and peripheral intravenous line (PIV) insertion.

Methods

A POCUS expert panel of 14 physicians specializing in emergency, critical care, and internal/hospital medicine participated in a modified-Delphi approach to develop a basic POCUS skills checklist by group consensus. Three rounds of voting were conducted, and consensus was defined by ≥ 80% agreement. Items achieving < 80% consensus were discussed and considered for up to two additional rounds of voting.

Results

Thirteen POCUS experts (93%) completed all three rounds of voting. Cardiac, lung, abdominal, and vascular ultrasound checklists included probe location and control, basic machine setup, image quality and optimization, and identification of anatomical structures. PIV insertion included additional items for needle tip tracking. During the first round of voting, 136 (82%) items achieved consensus, and after revision and revoting, an additional 21 items achieved consensus. A total of 153 (92%) items were included in the final checklist.

Conclusions

We have developed a consensus-based, multispecialty POCUS checklist to evaluate skills in image acquisition and anatomy identification for basic cardiac, lung, abdominal, and vascular ultrasound, and PIV insertion.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13089-022-00268-4.

Comparison of in-person versus tele-ultrasound point-of-care ultrasound training during the COVID-19 pandemic

Background

Lack of training is currently the most common barrier to implementation of point-of-care ultrasound (POCUS) use in clinical practice, and in-person POCUS continuing medical education (CME) courses have been paramount in improving this training gap. Due to travel restrictions and physical distancing requirements during the COVID-19 pandemic, most in-person POCUS training courses were cancelled. Though tele-ultrasound technology has existed for several years, use of tele-ultrasound technology to deliver hands-on training during a POCUS CME course has not been previously described.

Methods

We conducted a retrospective observational study comparing educational outcomes, course evaluations, and learner and faculty feedback from in-person versus tele-ultrasound POCUS courses. The same POCUS educational curriculum was delivered to learners by the two course formats. Data from the most recent pre-pandemic in-person course were compared to tele-ultrasound courses during the COVID-19 pandemic.

Results

Pre- and post-course knowledge test scores of learners from the in-person (n = 88) and tele-ultrasound course (n = 52) were compared. Though mean pre-course knowledge test scores were higher among learners of the tele-ultrasound versus in-person course (78% vs. 71%; p = 0.001), there was no significant difference in the post-course test scores between learners of the two course formats (89% vs. 87%; p = 0.069). Both learners and faculty rated the tele-ultrasound course highly (4.6–5.0 on a 5-point scale) for effectiveness of virtual lectures, tele-ultrasound hands-on scanning sessions, and course administration. Faculty generally expressed less satisfaction with their ability to engage with learners, troubleshoot image acquisition, and provide feedback during the tele-ultrasound course but felt learners completed the tele-ultrasound course with a better basic POCUS skillset.

Conclusions

Compared to a traditional in-person course, tele-ultrasound POCUS CME courses appeared to be as effective for improving POCUS knowledge post-course and fulfilling learning objectives. Our findings can serve as a roadmap for educators seeking guidance on development of a tele-ultrasound POCUS training course whose demand will likely persist beyond the COVID-19 pandemic.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13089-021-00242-6.