Online evaluation of fetal second-trimester four-chamber view images: a comparison of six evaluation methods

The Left Outflow Tract in Fetal Cardiac Screening Examination: Introduction of Quality Criteria Is Not Always Associated With an Improvement of Practice When Supervised by Humans

OBJECTIVES

Since 2016, the French CNEOF included the left ventricular outflow tract (LVOT) in the second and third trimester of pregnancy in addition to the four-chamber view and the parasagittal view of the right outflow tract. The objective of this study was to define quality criteria for fetal LVOT assessment and to perform a human audit of past and current practices, before and after the implementation of those quality criteria at a large scale.

METHODS

Seven quality criteria were investigated and rated from 0 to 1 during three periods of interest. Files were randomly selected from three centers, and average total and specific scores were calculated.

RESULTS

LVOT pictures were present in more than 94.3% of reports. The average quality score was 5.49/7 (95% confidence interval [CI]: 5.36-5.62), 5.91/7 (95% CI: 5.80-6.03), and 5.70/7 (95% CI: 5.58-5.82) for the three centers in the three periods of interest. There was no significant difference following the introduction of the quality criteria, 2017 versus 2020, P = .054.

CONCLUSION

Fetal LVOT images were present in most of ultrasound reports but the introduction of the proposed quality criteria under human supervision seems not associated with a significant change in practice.

Towards automated extraction of 2D standard fetal head planes from 3D ultrasound acquisitions: A clinical evaluation and quality assessment comparison

INTRODUCTION

Clinical evaluation of deep learning (DL) tools is essential to compliment technical accuracy metrics. This study assessed the image quality of standard fetal head planes automatically-extracted from three-dimensional (3D) ultrasound fetal head volumes using a customised DL-algorithm.

METHODS

Two observers retrospectively reviewed standard fetal head planes against pre-defined image quality criteria. Forty-eight images (29 transventricular, 19 transcerebellar) were selected from 91 transabdominal fetal scans (mean gestational age = 26 completed weeks, range = 20+5-32+3 weeks). Each had two-dimensional (2D) manually-acquired (2D-MA), 3D operator-selected (3D-OS) and 3D-DL automatically-acquired (3D-DL) images. The proportion of adequate images from each plane and modality, and the number of inadequate images per plane was compared for each method. Inter and intra-observer agreement of overall image quality was calculated.

RESULTS

Sixty-seven percent of 3D-OS and 3D-DL transventricular planes were adequate quality. Forty-five percent of 3D-OS and 55% of 3D-DL transcerebellar planes were adequate. Seventy-one percent of 3D-OS and 86% of 3D-DL transventricular planes failed with poor visualisation of intra-cranial structures. Eighty-six percent of 3D-OS and 80% of 3D-DL transcerebellar planes failed due to inadequate visualisation of cerebellar hemispheres. Image quality was significantly different between 2D and 3D, however, no significant difference between 3D-modalities was demonstrated (p < 0.005). Inter-observer agreement of transventricular plane adequacy was moderate for both 3D-modalities, and weak for transcerebellar planes.

CONCLUSION

The 3D-DL algorithm can automatically extract standard fetal head planes from 3D-head volumes of comparable quality to operator-selected planes. Image quality in 3D is inferior to corresponding 2D planes, likely due to limitations with 3D-technology and acquisition technique.

IMPLICATIONS FOR PRACTICE

Automated image extraction of standard planes from US-volumes could facilitate use of 3DUS in clinical practice, however image quality is dependent on the volume acquisition technique.

Physician Barriers and Facilitators for Screening for Congenital Heart Disease With Routine Obstetric Ultrasound: A National United States Survey

OBJECTIVES

Prenatal detection of congenital heart disease with obstetric screening remains at less than 50% in most population studies, far from what is thought to be achievable. We sought to identify barriers/facilitators for screening from the perspective of interpreting physicians and to understand how these barriers/facilitators may be associated with interpretation of screening images.

METHODS

Our mixed-methods studies included 4 focus groups in centers across the United States with obstetric, maternal-fetal medicine, and radiology providers who interpreted obstetric ultrasound studies. Themes around barriers/facilitators for fetal heart screening were coded from transcripts. A national Web-based survey was then conducted, which quantitatively measured reported barriers/facilitators and measured physicians' ability to interpret fetal heart-screening images. Multivariable generalized linear random-effect models assessed the association between barriers/facilitators and the accuracy of image interpretation at the image level.

RESULTS

Three main themes were identified in the focus groups: intrinsic barriers (ie, comfort with screening), external barriers (ie, lack of feedback), and organizational barriers (ie, study volumes). Among 190 physician respondents, 104 interpreted ultrasound studies. Perceptions of barriers varied by practice setting, with nontertiary providers having lower self-efficacy and perceived usefulness of cardiac screening. Facilitators associated with the odds of accurate interpretation of screening images were knowledge (odds ratio, 2.54; P = .002) and the volume of scans per week (odds ratio, 1.01 for every additional scan; P = .04).

CONCLUSIONS

Some of the main barriers to cardiac screening identified and prioritized by physicians across the United States were knowledge of screening and minimal volumes of scans. Targeting these barriers will aid in improving prenatal detection of congenital heart disease.

Barriers to Sonographer Screening for Fetal Heart Defects: A U.S. National Survey

OBJECTIVE

We surveyed obstetric sonographers, who are at the forefront of the screening process to determine how barriers to prenatal cardiac screening impacted screening abilities.

METHODS

We performed a cross-sectional national survey of obstetric sonographers in the United States using a sampling frame from American Registry of Diagnostic Medical Sonography mailing lists. The web survey measured the ability to obtain and interpret fetal heart images. Several cognitive, sociodemographic, and system-level factors were measured, including intention to perform cardiac imaging. Regression and mediation analyses determined factors associated with intention to perform and ability to obtain and interpret cardiac images. Subgroup analyses of sonographers in tertiary versus nontertiary centers were also performed.

RESULTS

Survey response rate either due to noncontact or nonresponse was 40%. Of 480 eligible sonographers, ~30% practiced in tertiary settings. Sonographers had lower intention to perform outflow views compared to 4 chambers. Higher self-efficacy and professional expectations predicted higher odds of intention to perform outflow views (OR 2.8, 95% CI 1.9-4.2 and 1.9, 95% CI 1.1-3.0, respectively). Overall accuracy of image interpretation was 65% (±14%). For the overall cohort and nontertiary subgroup, higher intention to perform outflows was associated with increased accuracy in overall image interpretation. For the tertiary subgroup, self-efficacy and feedback were strongly associated with accuracy.

CONCLUSIONS

We identified several modifiable (some heretofore unrecognized) targets to improve prenatal cardiac screening. Priorities identified by sonographers that are associated with screening success should guide future interventions.

The effect of preliminary training on quantitative evaluation of sonographer performance in the fetal morphology ultrasound examination

Introduction: The aim of this study is to provide a quantitative scoring system to assess sonographer performance by reviewing images from the fetal morphology examination.

Methods: Ten ultrasound images from patients at 18–22 weeks gestation were assessed and scored for quality according to predefined criteria. One hundred normal cases were randomly selected and 10 images from each case were analysed by four experienced reviewers. The preliminary training incorporated the first 25 cases and involved a training period for reviewers; the remaining 75 cases were allocated to post training. The scores acquired by each reviewer were statistically analysed using Pearson's and intra‐class correlations to determine the reproducibility of the results.

Results: The preliminary training results were calculated separately and compared to the post training study. The preliminary intra‐class correlation coefficient was 0.12. In the post training study the intra‐class correlation coefficient was doubled at 0.24. The greatest correlation was observed between reviewers 1 and 4 with a coefficient of 0.71. Reviewers 3 and 4 demonstrated the lowest correlation coefficient of 0.30.

Discussion: A significant increase in the intra‐class correlation coefficient indicated that training reviewers achieves more reproducible results. Suggested improvements to the study include recording fetal position, maternal BMI and assessing individual reviewer variability. An instruction manual defining each criterion might also yield better results.

Conclusion: The quantitative method used in this study assessed ultrasound images by placing a numerical value on image quality. Analysis of the preliminary training period demonstrates improved reproducibility of the results. Further investigation into the criteria is necessary to refine the quantitative method.

Online audit and feedback improve fetal second-trimester four-chamber view images: a randomised controlled trial

OBJECTIVES

We aimed to study the impact of online audit and feedback on fetal four-chamber view image quality.

METHODS

Ultrasonographers uploaded a set of four-chamber views from 10 consecutive screening examinations and a second set 3 months later. They were randomised to receive (group A) or not (group B) a feedback for their first set. The primary outcome was the difference in image mean score and in percentage of inadequate images between the first set and the second set, comparing the groups with and without feedback.

RESULTS

There were 258 ultrasonographers who completed the trial (group A: 122; group B: 136), and 5160 images were audited. In both groups, the mean score increased. In group A, it rose from 17.0 to 18.5 (p < 0.0001), and in group, B from 17.6 to 18.3 (p < 0.0001). The improvement was greater in group A than in group B (1.5 vs. 0.7, p = 0.0007). The mean percentage of inadequate images decreased in both groups. In group A, it dropped from 32% to 19% (p < 0.0001), and in group B, from 26% to 21% (p = 0.012). The decrease was greater in group A than in group B (13% vs. 5%, p = 0.007).

CONCLUSIONS

Image quality improved following online audit, the improvement being slightly greater with feedback.