Formative assessment based on an audit and feedback improves nuchal translucency ultrasound image quality

Study on the Effect of B-Ultrasound NT Scan in Early Pregnancy Combined with Serum Screening in Early and Middle Pregnancy for Down Syndrome

Objective

Down syndrome (DS), also known as trisomy 21 syndrome, is a common and most harmful congenital chromosomal genetic disease. This study is aimed at exploring the effect of B-ultrasound NT scan in early pregnancy combined with serum screening in early and middle pregnancy for Down syndrome.

Methods

A total of 168 pregnant women who were diagnosed and treated in the obstetric clinic of our hospital from January 2019 to December 2021 were selected as the research objects. B-ultrasound NT scanning and serum detection in the early and middle trimester of pregnancy were performed, respectively. The accuracy of single detection and combined detection was analyzed and compared with the results of amniotic fluid cell chromosome examination as the gold standard.

Results

There were 4 cases of DS and 165 cases of non-DS. The serum PAPP-A, AFP, and UE levels in DS group were lower than those in non-DS group. β-HCG level and NT value were higher than those in non-DS group (all p < 0.05). Among 168 pregnant women, 5 cases were diagnosed as abnormal by ultrasonography, and 1 case was diagnosed as normal. By serological test, 20 cases with high risk of DS were diagnosed in 4 cases, and 148 cases with low risk of DS were diagnosed in 2 cases. Among 168 cases examined by serology combined with ultrasound, 10 cases with high risk of DS were found, and 4 cases were diagnosed; 158 cases had low risk of DS, and 0 cases were diagnosed. The negative predictive value, specificity, and coincidence rate of DS screening by the three methods were higher, and the positive predictive value and coincidence rate of combined screening were the highest (p < 0.05). The screening risk of Down syndrome was correlated with pregnancy outcome. The abnormal pregnancy rate in high-risk group was significantly higher than that in low-risk group, and the difference was statistically significant (p < 0.05). ROC curve showed that the sensitivity, specificity, and AUC of the combined detection were greater than those of serology and NT.

Conclusion

The application of B-ultrasound NT scan in early pregnancy combined with early and mid-term serum comprehensive screening in the screening of Down's infants is helpful to improve the diagnostic coincidence rate and reduce the occurrence of misdiagnosis.

Quality-improvement program for ultrasound-based fetal anatomy screening using large-scale clinical audit

OBJECTIVE

A large-scale audit and peer review of ultrasound images may improve sonographer performance, but is rarely performed consistently as it is time-consuming and expensive. The aim of this study was to perform a large-scale audit of routine fetal anatomy scans to assess if a full clinical audit cycle can improve clinical image-acquisition standards.

METHODS

A large-scale, clinical, retrospective audit was conducted of ultrasound images obtained during all routine anomaly scans performed from 18 + 0 to 22 + 6 weeks' gestation at a UK hospital during 2013 (Cycle 1), to build a baseline understanding of the performance of sonographers. Targeted actions were undertaken in response to the findings with the aim of improving departmental performance. A second full-year audit was then performed of fetal anatomy ultrasound images obtained during the following year (Cycle 2). An independent pool of experienced sonographers used an online tool to assess all scans in terms of two parameters: scan completeness (i.e. were all images archived?) and image quality using objective scoring (i.e. were images of high quality?). Both were assessed in each audit at the departmental level and at the individual sonographer level. A random sample of 10% of scans was used to assess interobserver reproducibility.

RESULTS

In Cycle 1 of the audit, 103 501 ultrasound images from 6257 anomaly examinations performed by 22 sonographers were assessed; in Cycle 2, 153 557 images from 6406 scans performed by 25 sonographers were evaluated. The analysis was performed including the images obtained by the 20 sonographers who participated in both cycles. Departmental median scan completeness improved from 72% in the first year to 78% at the second assessment (P < 0.001); median image-quality score for all fetal views improved from 0.83 to 0.86 (P < 0.001). The improvement was greatest for those sonographers who performed poorest in the first audit; with regards to scan completeness, the poorest performing 15% of sonographers in Cycle 1 improved by more than 30 percentage points, and with regards to image quality, the poorest performing 11% in Cycle 1 showed a more than 10% improvement. Interobserver repeatability of scan completeness and image-quality scores across different fetal views were similar to those in the published literature.

CONCLUSIONS

A clinical audit and a set of targeted actions helped improve sonographer scan-acquisition completeness and scan quality. Such adherence to recommended clinical acquisition standards may increase the likelihood of correct measurement and thereby fetal growth assessment, and should allow better detection of abnormalities. As such a large-scale audit is time consuming, further advantages would be achieved if this process could be automated. © 2018 The Authors. Ultrasound in Obstetrics & Gynecology published by John Wiley & Sons Ltd on behalf of the International Society of Ultrasound in Obstetrics and Gynecology.

Sonologist's characteristics related to a higher quality in fetal nuchal translucency measured in primary antenatal care centers

OBJECTIVE

To assess the quality of nuchal translucency (NT) measurements in primary care and the sonologist's characteristics related with a higher quality.

METHODS

The median NT expressed in multiples of the median (MoM) was calculated for each sonologist of 14 participating antenatal primary care centers of the Catalan Institute of Health. A survey to the sonologists was used to establish variables related to higher-quality measurements.

RESULTS

The median NT MoM obtained in 16 448 NT measurements, performed by 102 sonologists, was 0.94 MoM. NT underestimation was observed in 46% of the sonologists. Underestimation were less frequent among professionals who performed more than 230 ultrasounds per year (26% vs 53%;p = .022), those who completed the online Fetal Medicine Foundation (FMF) course (22% vs 54%; p = .021), and those who were subject to periodic audits (24% vs 56%; p = .021). Underestimation rate decreased from 60%, to 33% and 14% with the increase of the years of experience from less than 5 years, to 6 to 15 years and more than 15 years of experience, respectively (p = .029).

CONCLUSIONS

Higher-quality measurements were demonstrated in sonologists who performed more ultrasounds per year, those with more years of scanning experience, those who completed the online FMF course, and those periodically audited.

Quality control of ultrasound for fetal biometry: results from the INTERGROWTH-21st Project

OBJECTIVE

To assess a comprehensive package of ultrasound quality control in the Fetal Growth Longitudinal Study of the INTERGROWTH-21^st Project, a large multicenter study of fetal growth.

METHODS

Quality control (QC) measures were performed for 20 313 ultrasound scan images obtained prospectively from 4321 fetuses at 14-41 weeks' gestation in eight geographical locations. At the time of each ultrasound examination, three fetal biometric variables (head circumference (HC), abdominal circumference (AC) and femur length (FL)) were measured in triplicate on separately generated images. All measurements were taken in a blinded fashion. QC had two elements: (1) qualitative QC: visual assessment by sonographers at each study site of their images based on specific criteria, with 10% of images being re-assessed at the Oxford-based Ultrasound Quality Unit (compared using an adjusted kappa statistic); and (2) quantitative QC: assessment of measurement data by comparing the first, second and third measurements (intraobserver variability), remeasurement of caliper replacement in 10% (interobserver variability), both by Bland-Altman plots and plotting frequency histograms of the SD of triplicate measurements and assessing how many were above or below 2 SD of the expected distribution. The system allowed the sonographers' performances to be monitored regularly.

RESULTS

A high level of agreement between self- and external scoring was demonstrated for all measurements (κ = 0.99 (95% CI, 0.98-0.99) for HC, 0.98 (95% CI, 0.97-0.99) for AC and 0.96 (95% CI, 0.95-0.98) for FL). Intraobserver 95% limits of agreement (LoA) of ultrasound measures for HC, AC and FL were ± 3.3%, ± 5.6% and ± 6.2%, respectively; the corresponding values for interobserver LoA were ± 4.4%, ± 6.0% and ± 5.6%. The SD distribution of triplicate measurements for all biometric variables showed excessive variability for three of 31 sonographers, allowing prompt identification and retraining.

CONCLUSIONS

Qualitative and quantitative QC monitoring was feasible and highly reproducible in a large multicenter research study, which facilitated the production of high-quality ultrasound images. We recommend that the QC system we developed is implemented in future research studies and clinical practice. Copyright © 2017 ISUOG. Published by John Wiley & Sons Ltd.

Impact of a shift in nuchal translucency measurements on the detection rate of first-trimester Down syndrome screening: A population-based study

OBJECTIVE

To assess the distribution of nuchal translucency (NT) measurements following a national policy without credentialing and its impact on first-trimester Down syndrome screening (DSS) detection rate.

METHOD

All first-trimester DSS data recorded in France (2010-2014) were collected by the laboratories in charge via an Internet database (https://www.bionuqual.org/echo.php). There was no minimal requirement for image quality to allow sonographers to enter the screening process. A subgroup of DSS with complete DS follow-up corresponded to 1614 sonographers. Based on the distribution of maternal age, DS detection rate was calculated and split as a function of the distribution of NT multiple of the median (MoM).

RESULTS

Four thousand nine hundred forty-three sonographers performed 2,337,372 NT measurements. Median NT expressed in MoM was 0.83. Screenings with complete follow-up consisted of 197,417 screenings, in which DSS detection rates were respectively 70.4%, 70.9%, 79.4%, 87.7%, and 79.5% for the following median NT MoM ranges: <0.7, 0.70 to 0.79, 0.80 to 0.89, 0.90 to 0.99, and >0.99 (trend χ = 12.21; P = .0158).

CONCLUSION

In France, following a policy of quality assessment without standardized credentialing, the distribution of NT measurements did not fit the expected distribution. Down syndrome detection rate was 10% lower in screenings by sonographers with a median NT < 0.80 MoM.

Impact of Including or Removing Nuchal Translucency Measurement on the Detection and False-Positive Rates of First-Trimester Down Syndrome Screening

INTRODUCTION

First-trimester Down syndrome (DS) screening combining maternal age, serum markers (pregnancy-associated plasma protein-A and beta-human chorionic gonadotropin) and nuchal translucency (NT) gives an 85% detection rate for a 5% false-positive rate. These results largely depend on quality assessment of biochemical markers and of NT. In routine practice, despite an ultrasound quality control organization, NT images can be considered inadequate. The aim of the study was to evaluate the consequences for risk calculation when NT measurement is not taken into account.

MATERIAL AND METHOD

Comparison of detection and false-positive rates of first-trimester DS screening (PerkinElmer, Turku, Finland), with and without NT, based on a retrospective study of 117,126 patients including 274 trisomy 21-affected fetuses. NT was measured by more than 3,000 certified sonographers.

RESULTS

There was no significant difference in detection rates between the two strategies including or excluding NT measurement (86.7 vs. 81.8%). However, there was a significant difference in the false-positive rates (2.23 vs. 9.97%, p < 0.001).

DISCUSSION

Sonographers should be aware that removing NT from combined first-trimester screening would result in a 5-fold increase in false-positive rate to maintain the expected detection rates. This should be an incentive for maintaining quality in NT measurement.

Computer-supported feedback message tailoring: theory-informed adaptation of clinical audit and feedback for learning and behavior change

Background

Evidence shows that clinical audit and feedback can significantly improve compliance with desired practice, but it is unclear when and how it is effective. Audit and feedback is likely to be more effective when feedback messages can influence barriers to behavior change, but barriers to change differ across individual health-care providers, stemming from differences in providers’ individual characteristics.

Discussion

The purpose of this article is to invite debate and direct research attention towards a novel audit and feedback component that could enable interventions to adapt to barriers to behavior change for individual health-care providers: computer-supported tailoring of feedback messages. We argue that, by leveraging available clinical data, theory-informed knowledge about behavior change, and the knowledge of clinical supervisors or peers who deliver feedback messages, a software application that supports feedback message tailoring could improve feedback message relevance for barriers to behavior change, thereby increasing the effectiveness of audit and feedback interventions. We describe a prototype system that supports the provision of tailored feedback messages by generating a menu of graphical and textual messages with associated descriptions of targeted barriers to behavior change. Supervisors could use the menu to select messages based on their awareness of each feedback recipient’s specific barriers to behavior change. We anticipate that such a system, if designed appropriately, could guide supervisors towards giving more effective feedback for health-care providers.

Summary

A foundation of evidence and knowledge in related health research domains supports the development of feedback message tailoring systems for clinical audit and feedback. Creating and evaluating computer-supported feedback tailoring tools is a promising approach to improving the effectiveness of clinical audit and feedback.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-014-0203-z) contains supplementary material, which is available to authorized users.