A Novel Tool for Teaching Cardiac Point-of-Care Ultrasound: An Exploratory Application of the Design-Based Research Approach

Livestreaming clinical experience to remotely located learners: A critical narrative review

CONTEXT

Medical education relies on real patient learning (RPL) to provide medical students with essential clinical experience. However, growing demand for clinical placements continues to be a challenge in providing sufficient RPL opportunities. The COVID-19 pandemic forced academic institutions to rethink the delivery of traditional clinical training and innovations in online clinical learning experiences, specifically livestreamed clinical experiences, have emerged which show promise in addressing the capacity limitations of traditional placements. Although previous reviews have explored the use of livestreamed clinical experiences during the pandemic, there is a lack of rigorous theoretical framing to support these innovations.

OBJECTIVES

The aim of this review is two-fold: to examine the effectiveness of livestreamed clinical experiences through an experience-based learning (ExBL) theory perspective and to provide practical recommendations to optimise and implement these innovations.

METHODS

A review of literature was conducted to identify journal articles published between September 2019 and January 2023 reporting on innovations relating to livestreamed clinical experiences. The search focused on undergraduate and postgraduate medical education but relevant evidence from other healthcare professions were also included due to a limited evidence base. Strengths and weaknesses were derived from the literature and analysed in relation to ExBL components.

RESULTS

Principal strengths of livestreamed clinical experiences included expanded access to RPL opportunities and medical specialties, enhanced standardisation of learning experiences and positive perceptions from students regarding convenience. Clinical educators found these innovations enabled teaching at scale. Patients did not perceive such innovations to negatively impact their standard of care. Limitations included the inability to practice physical examination skills, challenges in ensuring learner engagement and connectivity issues.

CONCLUSION

Livestreamed clinical experiences have the potential to effectively expand placement capacity and provide high-quality educational experiences for medical students. Although certain limitations exist, technological and pedagogical adaptations can help overcome these challenges. The application of theoretical frameworks to future online innovations will be fundamental to ensure effective clinical learning.

The State of Mastery Learning in Pediatric Graduate Medical Education: A Scoping Review

Objective

The aim of this study was to characterize the state of mastery learning interventions, identify gaps in current approaches, and highlight opportunities to improve the rigor of ML in pediatric graduate medical education (GME) training programs.

Methods

In October 2022, we searched Ovid, PubMed, Scopus, and ERIC. Two reviewers independently screened 165 citations and reviewed the full manuscripts of 20 studies. We developed a modified data abstraction tool based on the Recommendations for Reporting Mastery Education Research in Medicine (ReMERM) guidelines and extracted variables related to mastery learning curricular implementation and design and learner assessment.

Results

Eleven studies of ML approaches within pediatric GME were included in the full review, with over half published after 2020. ML interventions were used to teach both simple and complex tasks, often in heterogeneous learner groups. While deliberate practice and feedback were consistently reported features of ML in pediatrics, opportunities for improvement include clearly defining mastery, conducting learning over multiple sessions, presenting sufficient validity evidence for assessment tools, adhering to rigorous standard setting processes, and reporting psychometric data appropriate for ML.

Conclusion

In pediatric GME, ML approaches are in their infancy. By addressing common shortcomings in the existing literature, future efforts can improve the rigor of ML in pediatric training programs and its impact on learners and patients.

Guidelines and Recommendations for Targeted Neonatal Echocardiography and Cardiac Point-of-Care Ultrasound in the Neonatal Intensive Care Unit: An Update from the American Society of Echocardiography

Targeted neonatal echocardiography (TNE) involves the use of comprehensive echocardiography to appraise cardiovascular physiology and neonatal hemodynamics to enhance diagnostic and therapeutic precision in the neonatal intensive care unit. Since the last publication of guidelines for TNE in 2011, the field has matured through the development of formalized neonatal hemodynamics fellowships, clinical programs, and the expansion of scientific knowledge to further enhance clinical care. The most common indications for TNE include adjudication of hemodynamic significance of a patent ductus arteriosus, evaluation of acute and chronic pulmonary hypertension, evaluation of right and left ventricular systolic and/or diastolic function, and screening for pericardial effusions and/or malpositioned central catheters. Neonatal cardiac point-of-care ultrasound (cPOCUS) is a limited cardiovascular evaluation which may include line tip evaluation, identification of pericardial effusion and differentiation of hypovolemia from severe impairment in myocardial contractility in the hemodynamically unstable neonate. This document is the product of an American Society of Echocardiography task force composed of representatives from neonatology-hemodynamics, pediatric cardiology, pediatric cardiac sonography, and neonatology-cPOCUS. This document provides (1) guidance on the purpose and rationale for both TNE and cPOCUS, (2) an overview of the components of a standard TNE and cPOCUS evaluation, (3) disease and/or clinical scenario-based indications for TNE, (4) training and competency-based evaluative requirements for both TNE and cPOCUS, and (5) components of quality assurance. The writing group would like to acknowledge the contributions of Dr. Regan Giesinger who sadly passed during the final revisions phase of these guidelines. Her contributions to the field of neonatal hemodynamics were immense.

Can you teach a hands-on skill online? A scoping review of e-learning for point-of-care ultrasound in medical education

Background

There is an increasing need and interest in teaching point-of-care ultrasound (POCUS) online. The objective of this study was to systematically review the literature regarding e-learning as a method for teaching POCUS in medical education, to assess the benefits and limitations of various styles of e-learning for POCUS, and to identify gaps in the literature that could help guide future research in this field.

Methods

A literature search was conducted on three databases including MEDLINE (Ovid), EMBASE and Cochrane Central Register of Controlled Clinical Trials on October 12, 2021, retrieving a total of 1630 studies. 31 studies met the inclusion and exclusion criteria. These studies were separated into different styles of e-learning and learner outcomes were analyzed based on Kirkpatrick's hierarchy.

Results

The studies were categorized into three styles of e-learning: a) blended learning b) online-only (asynchronous or synchronous) and c) use of handheld machines or telesonography. POCUS knowledge and image interpretation were successfully taught online, however online-only learning for image acquisition was not as consistently effective. Blended learning and telesonography were beneficial for learning image acquisition skills. Generally, novice learners benefited most from e-learning.

Conclusion

E-learning for POCUS is gaining in popularity in recent years. POCUS is a complex technical skill, and depending on the individual task being taught, different styles of e-learning may be more successful. These findings can inform future POCUS educational programs.

Competency Standard Derivation for Point-of-Care Ultrasound Image Interpretation for Emergency Physicians

STUDY OBJECTIVE

Because number-based standards are increasingly controversial, the objective of this study was to derive a performance-based competency standard for the image interpretation task of point-of-care ultrasound (POCUS).

METHODS

This was a prospective study. Operating on a clinically-relevant sample of POCUS images, we adapted the Ebel standard-setting method to derive a performance benchmark in 4 diverse pediatric POCUS applications: soft tissue, lung, cardiac and focused assessment with sonography in trauma (FAST). In Phase I (difficulty calibration), cases were categorized into interpretation difficulty terciles (easy, intermediate, hard) using emergency physician-derived data. In Phase II (significance), a 4-person expert panel categorized cases as low, medium, or high clinical significance. In Phase III (standard setting), a 3x3 matrix was created, categorizing cases by difficulty and significance, and a 6-member panel determined acceptable accuracy for each of the 9 cells. An overall competency standard was derived from the weighted sum.

RESULTS

We obtained data from 379 emergency physicians resulting in 67,093 interpretations and a median of 184 (interquartile range, 154, 190) interpretations per case. There were 78 (19.5%) easy, 272 (68.0%) medium, and 50 (12.5%) hard-to-interpret cases, and 237 (59.3%) low, 65 (16.3%) medium, and 98 (24.5%) cases of high clinical significance across the 4 POCUS applications. The panel determined an overall performance-based competency score of 85.0% for lung, 89.5% for cardiac, 90.5% for soft tissue, and 92.7% for FAST.

CONCLUSION

This research provides a transparent chain of evidence that derived clinically relevant competency standards for POCUS image interpretation.

Learning Pediatric Point-of-Care Ultrasound: How Many Cases Does Mastery of Image Interpretation Take?

OBJECTIVES

Using an education and assessment tool, we examined the number of cases necessary to achieve a performance benchmark in image interpretation of pediatric soft tissue, cardiac, lung, and focused assessment with sonography for trauma (FAST) point-of-care ultrasound (POCUS) applications. We also determined interpretation difficulty scores to derive which cases provided the greatest diagnostic challenges.

METHODS

Pediatric emergency physicians participated in web-based pediatric POCUS courses sponsored by their institution as a credentialing priority. Participants deliberately practiced cases until they achieved diagnostic interpretation scores of combined 90% accuracy, sensitivity, and specificity.

RESULTS

Of the 463 who enrolled, 379 (81.9%) completed cases. The median (interquartile range) number of cases required to achieve the performance benchmark for soft tissue was 94 (68-128); cardiac, 128 (86-201); lung, 87 (25-118); and FAST, 93 (68-133) (P < 0001). Specifically, cases completed to achieve benchmark were higher for cardiac relative to other applications (P < 0.0001 for all comparisons). In soft tissue cases, a foreign body was more difficult to diagnose than cobblestoning and hypoechoic collections (P = 0.036). Poor cardiac function and abnormal ventricles were more difficult to interpret with accuracy than normal (P < 0.0001) or pericardial effusion cases (P = 0.01). The absence of lung sliding was significantly more difficult to interpret than normal lung cases (P = 0.028). The interpretation difficulty of various FAST imaging findings was not significantly different.

CONCLUSIONS

There was a significant variation in number of cases required to reach a performance benchmark. We also identified the specific applications and imaging findings that demonstrated the greatest diagnostic challenges. These data may inform future credentialing guidelines and POCUS learning interventions.