First-trimester trisomy screening: nuchal translucency measurement training and quality assurance to correct and unify technique

Organ-specific learning curves of sonographers performing first-trimester anatomical screening and impact of score-based evaluation on ultrasound image quality

INTRODUCTION

First-trimester anatomical screening (FTAS) by ultrasound has been introduced in many countries as screening for aneuploidies, but also as early screening for fetal structural abnormalities. While a lot of emphasis has been put on the detection rates of FTAS, little is known about the performance of quality control programs and the sonographers' learning curve for FTAS. The aims of the study were to evaluate the performance of a score-based quality control system for the FTAS and to assess the learning curves of sonographers by evaluating the images of the anatomical planes that were part of the FTAS protocol.

METHODS

Between 2012-2015, pregnant women opting for the combined test in the North-Netherlands were also invited to participate in a prospective cohort study extending the ultrasound investigation to include a first-trimester ultrasound performed according to a protocol. All anatomical planes included in the protocol were documented by pictures stored for each examination in logbooks. The logbooks of six sonographers were independently assessed by two fetal medicine experts. For each sonographer, logbooks of examination 25-50-75 and 100 plus four additional randomly selected logbooks were scored for correct visualization of 12 organ-system planes. A plane specific score of at least 70% was considered sufficient. The intra-class correlation coefficient (ICC), was used to measure inter-assessor agreement for the cut-off scores. Organ-specific learning curves were defined by single-cumulative sum (CUSUM) analysis.

RESULTS

Sixty-four logbooks were assessed. Mean duration of the scan was 22 ± 6 minutes and mean gestational age was 12+6 weeks. In total 57% of the logbooks graded as sufficient. Most sufficient scores were obtained for the fetal skull (88%) and brain (70%), while the lowest scores were for the face (29%) and spine (38%). Five sonographers showed a learning curve for the skull and the stomach, four for the brain and limbs, three for the bladder and kidneys, two for the diaphragm and abdominal wall and one for the heart and spine and none for the face and neck.

CONCLUSION

Learning curves for FTAS differ per organ system and per sonographer. Although score-based evaluation can validly assess image quality, more dynamic approaches may better reflect clinical performance.

United States' experience in nuchal translucency measurement: variation according to provider characteristics in over five million ultrasound examinations

OBJECTIVE

The Nuchal Translucency Quality Review (NTQR) program has provided standardized education, credentialing and epidemiological monitoring of nuchal translucency (NT) measurements since 2005. Our aim was to review the effect on NT measurement of provider characteristics since the program's inception.

METHODS

We evaluated the distribution of NT measurements performed between January 2005 and December 2019, for each of the three primary performance indicators of NT measurement (NT median multiples of the median (MoM), SD of log₁₀ NT MoM and slope of NT with respect to crown-rump length (CRL)) for all providers within the NTQR program with more than 30 paired NT/CRL results. Provider characteristics explored as potential sources of variability included: number of NT ultrasound examinations performed annually (annual scan volume of the provider), duration of participation in the NTQR program, initial credentialing by an alternative pathway, provider type (physician vs sonographer) and number of NT-credentialed providers within the practice (size of practice). Each of these provider characteristics was evaluated for its effect on NT median MoM and geometric mean of the NT median MoM weighted for the number of ultrasound scans, and multiple regression was performed across all variables to control for potential confounders.

RESULTS

Of 5 216 663 NT measurements from 9340 providers at 3319 sites, the majority (75%) of providers had an NT median MoM within the acceptable range of 0.9-1.1 and 85.5% had NT median MoM not statistically significantly outside this range. Provider characteristics associated with measurement within the expected range of performance included higher volume of NT scans performed annually, practice at a site with larger numbers of other NT-credentialed providers, longer duration of participation in the NTQR program and alternative initial credentialing pathway.

CONCLUSIONS

Annual scan volume, duration of participation in the NTQR program, alternative initial credentialing pathway and number of other NT-credentialed providers within the practice are all associated with outcome metrics indicating quality of performance. It is critical that providers participate in ongoing quality assessment of NT measurement to maintain consistency and precision. Ongoing assessment programs with continuous feedback and education are necessary to maintain quality care. © 2021 International Society of Ultrasound in Obstetrics and Gynecology.

Real-time quality control of nuchal translucency measurements using the exponentially weighted moving average chart

OBJECTIVE

The establishment of ongoing audits for first-trimester nuchal translucency (NT) measurements is of paramount importance. The exponentially weighted moving average (EWMA) chart has been published as an efficient tool for NT quality control with the advantages of being suitable for real-time long-term monitoring. This study aimed to assess the efficacy of real-time NT quality control using EWMA charts.

MATERIALS AND METHODS

This was an ongoing prospective study conducted from January 2011 to December 2017 at the Centre for Fetal Medicine Gennet in Prague. The quality of NT measurements was assessed using the NT retrospective distribution parameters and EWMA charts, and the results were presented to the sonographers during collective meetings.

RESULTS

Overall, 28,928 NT measurements obtained from six sonographers were eligible for the study. Looking at individual EWMA charts, we observed four main outcomes. First, there was a clear improvement in the performance of sonographers with initially poor performances. Second, the performance of sonographers with an initially satisfactory quality was maintained. Third, there was an observed deterioration of the performance without the audits. Last, the sonographers appreciated an unequivocal and straightforward graphical presentation of EWMA curves.

CONCLUSION

EWMA proved to be an efficient and suitable tool for real-time monitoring of NT quality and led to an overall improvement of the sonographers' performance.

Quality control of ultrasonography markers for Down's syndrome screening: a retrospective study by the laboratory

OBJECTIVES

Quality control of ultrasonography markers is necessary to ensure greater efficacy of prenatal aneuploidy screening. The aim of this study was to assess the quality of the crown-rump length (CRL) and nuchal translucence (NT) measurement accuracy by the laboratory according to quality indicators.

METHODS

Retrospective observational study on 4,908 single-foetus pregnant women who underwent prenatal aneuploidy screening in the first trimester of pregnancy. Euploid foetuses with CRL between 45 and 84 mm were included, while those with NT≥3.5 mm were excluded. CRL measurement was considered to be accurate if the median multiples of the median (MoM) for pregnancy-associated plasma protein A (PAPP-A) was between 0.90 and 1.10. Fifteen sonographers participated in the study, six of whom comprised the control group. Systematic error for a sonographer was considered when CRL measurement was greater than ±2 mm with respect to the control group. Quality for NT was assured by means of the WHIRI method and each sonographer cumulative sum control chart (CUSUM).

RESULTS

For CRL accuracy, five sonographers underestimated the measurements, while another four overestimated them, with no statistical differences. For smaller sized foetuses, all sonographers met the established specifications. Regarding NT control, three sonographers did not meet the quality criteria for the median MoM. All sonographers met the specifications for the logarithmic standard deviation of the NT MoM levels. Thirteen sonographers met the CUSUM specifications.

CONCLUSIONS

Evaluation of a quality control of ultrasonography parameters by laboratory professionals is necessary to avoid under- or overestimation tendencies for CRL and NT measurements. CUSUM is a useful tool for the immediate correction of errors in NT measurements.

Impact of Increased Nuchal Translucency Values on Pregnancy Outcomes: A Tertiary Center Experience

We evaluated the association of nuchal translucency (NT) values above 99th percentile with perinatal outcomes. Materials and methods: Singleton pregnancies with NT values above 99th percentile were investigated. Pregnancies were divided into 3 groups: group 1, NT = 2.6-<3.5 mm; group 2, NT = 3.5-4.5 mm; and group 3, NT > 4.5 mm. Demographic features, clinical characteristics, structural/chromosomal anomaly rates and perinatal outcomes were compared. Results: Normal ultrasonographic anatomy was found in 47.5%, 7.7%, and 14.3% of groups 1, 2, and 3, respectively (p = 0.006). Group 3 had the lowest normal karyotype rate (44.6%) (p = 0.005). Higher frequencies for both miscarriage and pregnancy termination were observed in group 3 compared to group 1 (8.9% vs. 4.9% and 66.1% vs. 32.7%, respectively) (p = 0.02). The lowest rate of normal postnatal anatomic findings was found in group 3 (10.7%) (p = 0.01). Conclusion: NT values above 99th percentile for gestational age seem to be associated with increased rates of chromosomal/structural abnormalities and adverse perinatal outcomes.

Quality control of fetal biometric evaluation and Doppler ultrasound

In recent years quality control in obstetric ultrasound has become recommended and an essential component of obstetric scanning. This is to minimize the inaccuracy and variability related to fetal measurements, to provide an effective quality assurance system to sonographers to certify their practice and decrease the impact of medical litigations. For a quality control system in obstetric ultrasound to be useful clinically, multiple strategies need to be employed: certified training, practical standardization exercise, image storing, qualitative and quantitative quality control. Qualitative quality control consists of the evaluation of images obtained for fetal biometry and Doppler scans using an objective score against predefined criteria. Quantitative quality control consists of analyzing quantitatively the performance of a sonographer and the impact on measurements values. Quantitative analysis could be performed either using estimates of intraobserver or interobserver reproducibility of plane acquisition and caliper placements.

[The left outflow tract: Normal features]

Congenital heart disease remains an important cause of perinatal morbidity and mortality. Screening for these is based on a good knowledge of normal fetal heart anatomy and ultrasound views to be performed. After recommending the use of the four chambers and the right outflow tract views in 2005, CNEOF proposes recently adding the left outflow tract assessment. The use of this one should sensitize the operator to the notion of sweeping essential to obtain all these views and make it possible to improve the detection of the conal VSD and conotruncal pathologies.

No. 261-Prenatal Screening for Fetal Aneuploidy in Singleton Pregnancies

OBJECTIVE

To develop a Canadian consensus document on maternal screening for fetal aneuploidy (e.g., Down syndrome and trisomy 18) in singleton pregnancies.

OPTIONS

Pregnancy screening for fetal aneuploidy started in the mid 1960s, using maternal age as the screening test. New developments in maternal serum and ultrasound screening have made it possible to offer all pregnant patients a non-invasive screening test to assess their risk of having a fetus with aneuploidy to determine whether invasive prenatal diagnostic testing is necessary. This document reviews the options available for non-invasive screening and makes recommendations for Canadian patients and health care workers.

OUTCOMES

To offer non-invasive screening for fetal aneuploidy (trisomy 13, 18, 21) to all pregnant women. Invasive prenatal diagnosis would be offered to women who screen above a set risk cut-off level on non-invasive screening or to pregnant women whose personal, obstetrical, or family history places them at increased risk. Currently available non-invasive screening options include maternal age combined with one of the following: (1) first trimester screening (nuchal translucency, maternal age, and maternal serum biochemical markers), (2) second trimester serum screening (maternal age and maternal serum biochemical markers), or (3) 2-step integrated screening, which includes first and second trimester serum screening with or without nuchal translucency (integrated prenatal screen, serum integrated prenatal screening, contingent, and sequential). These options are reviewed, and recommendations are made.

EVIDENCE

Studies published between 1982 and 2009 were retrieved through searches of PubMed or Medline and CINAHL and the Cochrane Library, using appropriate controlled vocabulary and key words (aneuploidy, Down syndrome, trisomy, prenatal screening, genetic health risk, genetic health surveillance, prenatal diagnosis). Results were restricted to systematic reviews, randomized controlled trials, and relevant observational studies. There were no language restrictions. Searches were updated on a regular basis and incorporated in the guideline to August 2010. Grey (unpublished) literature was identified through searching the websites of health technology assessment and health technology assessment- related agencies, clinical practice guideline collections, clinical trial registries, and national and international medical specialty societies. The previous Society of Obstetricians and Gynaecologists of Canada guidelines regarding prenatal screening were also reviewed in developing this clinical practice guideline.

VALUES

The quality of evidence was rated using the criteria described in the Report of the Canadian Task Force on Preventive Health Care.

BENEFITS, HARMS, AND COSTS

This guideline is intended to reduce the number of prenatal invasive procedures done when maternal age is the only indication. This will have the benefit of reducing the numbers of normal pregnancies lost because of complications of invasive procedures. Any screening test has an inherent false- positive rate, which may result in undue anxiety. It is not possible at this time to undertake a detailed cost-benefit analysis of the implementation of this guideline, since this would require health surveillance and research and health resources not presently available; however, these factors need to be evaluated in a prospective approach by provincial and territorial initiatives.

RECOMMENDATIONS

Sonologist's characteristics related to a higher quality in fetal nuchal translucency measured in primary antenatal care centers

OBJECTIVE

To assess the quality of nuchal translucency (NT) measurements in primary care and the sonologist's characteristics related with a higher quality.

METHODS

The median NT expressed in multiples of the median (MoM) was calculated for each sonologist of 14 participating antenatal primary care centers of the Catalan Institute of Health. A survey to the sonologists was used to establish variables related to higher-quality measurements.

RESULTS

The median NT MoM obtained in 16 448 NT measurements, performed by 102 sonologists, was 0.94 MoM. NT underestimation was observed in 46% of the sonologists. Underestimation were less frequent among professionals who performed more than 230 ultrasounds per year (26% vs 53%;p = .022), those who completed the online Fetal Medicine Foundation (FMF) course (22% vs 54%; p = .021), and those who were subject to periodic audits (24% vs 56%; p = .021). Underestimation rate decreased from 60%, to 33% and 14% with the increase of the years of experience from less than 5 years, to 6 to 15 years and more than 15 years of experience, respectively (p = .029).

CONCLUSIONS

Higher-quality measurements were demonstrated in sonologists who performed more ultrasounds per year, those with more years of scanning experience, those who completed the online FMF course, and those periodically audited.

Down's syndrome screening at 11-14 weeks' gestation using prenasal thickness and nasal bone length

PURPOSE

To perform a multicenter prospective study of ultrasound prenasal thickness (PT), and nasal bone length (NBL) measurement at 11-14 weeks' gestation.

METHODS

Ultrasound PT and NBL determination was performed in 504 normal fetuses and 17 fetuses with Down's syndrome (DS). Measurements were made from mid-sagittal 2D images acquired using a standardized technique during nuchal translucency (NT) examination. PT and NBL values were expressed in multiples of the gestation-specific normal median (MoM) and as the PT/NBL ratio. Information on PT and NBL MoMs was also combined using logistic regression. Results were classified as positive according to whether they were greater than the normal 95th centile for PT, PT/NBL and the DS risk from logistic regression equation or below the 5th centile for NBL.

RESULTS

The median value in DS cases and unaffected controls were: PT 1.26 and 0.996 MoM; and NBL 0.596 and 0.993 MoM. The proportion of DS fetuses with positive results was 41% for PT, 65% for NBL, and 82% for both the PT/NBL ratio and DS risk from the logistic regression equation. PT/NBL levels did not vary according to gestational age.

CONCLUSION

The PT/NBL ratio is a valuable first trimester DS screening marker that can be easily determined concomitant with the NT measurement.

Quality assessment of uterine artery Doppler measurement in first-trimester combined screening for pre-eclampsia

OBJECTIVE

To assess the quality of mean uterine artery (UtA) pulsatility index (PI) measurement in a first-trimester pre-eclampsia screening program.

METHODS

Consecutive women with a singleton pregnancy attending first-trimester screening for fetal chromosomal abnormalities also had combined screening for pre-eclampsia based on the Fetal Medicine Foundation (FMF) algorithm, at a large practice in Sydney, Australia, from May 2014 to February 2017. Distributions of mean UtA-PI multiples of the median (MoM) on a logarithmic scale were plotted in relation to the normal median with 95% CI for each operator and for each month. Central tendency and dispersion and cumulative sum charts were produced. Mean UtA-PI MoM values between 0.95 and 1.05 were considered ideal and those between 0.90 and 1.10 were considered acceptable. The screen-positive rates for preterm pre-eclampsia in different groups of sonographers according to their mean log₁₀ UtA-PI MoM were calculated and compared using the chi-square test.

RESULTS

A total of 21 010 women attended for first-trimester ultrasound and had screening for pre-eclampsia. The overall median UtA-PI MoM was 1.042 (interquartile range (IQR), 0.85-1.26). Of 46 sonographers, 42 (91.3%) performed more than 50 examinations and, of those, 41 (97.6%) measured UtA-PI within the acceptable range. Sonographers measuring UtA-PI MoM on average below 0.95 and those measuring it above 1.05 had, respectively, lower and higher screen-positive rates when compared with those with measurements within the 0.95-1.05 UtA-PI MoM interval (7.2% and 13.2% vs 11.2%, respectively, P < 0.001).

CONCLUSION

UtA Doppler is measured well among trained operators when following an established protocol. While slight variations are expected, systematic error in this measurement impacts on the screen-positive rate. Therefore, a quality control process should be in place and retraining of staff may be required. Copyright © 2018 ISUOG. Published by John Wiley & Sons Ltd.

Image-scoring system for umbilical and uterine artery pulsed-wave Doppler ultrasound measurement

OBJECTIVES

To develop an objective image-scoring system for pulsed-wave Doppler measurement of maternal uterine and fetal umbilical arteries, and evaluate how this compares with subjective assessment.

METHODS

As an extension to the INTERGROWTH-21^st Project, we developed a scoring system based on six predefined criteria for uterine and umbilical artery pulsed-wave Doppler measurements. Objective evaluation using the scoring system was compared with subjective assessment which consisted of classifying an image as simply acceptable or unacceptable. Based on sample size estimation, a total of 120 umbilical and uterine artery Doppler images were selected randomly from the INTERGROWTH-21^st image database. Two independent reviewers evaluated all images in a blinded fashion, both subjectively and using the six-point scoring system. Percentage agreement and kappa statistic were compared between the two methods.

RESULTS

The overall agreement between reviewers was higher for objective assessment using the scoring system (agreement, 85%; adjusted kappa, 0.70) than for subjective assessment (agreement, 70%; adjusted kappa, 0.47). For the six components of the scoring system, the level of agreement (adjusted kappa) was 0.97 for anatomical site, 0.88 for sweep speed, 0.77 for magnification, 0.68 for velocity scale, 0.68 for image clarity and 0.65 for angle of insonation.

CONCLUSION

In quality assessment of umbilical and uterine artery pulsed-wave Doppler measurements, our proposed objective six-point image-scoring system is associated with greater reproducibility than is subjective assessment. We recommend this as the preferred method for quality control, auditing and teaching. Copyright © 2018 ISUOG. Published by John Wiley & Sons Ltd.

Reference centile charts of first-trimester aneuploidy screening & Doppler parameters for Indian population

Background & objectives:

The risk estimation for foetal aneuploidies in the first trimester of pregnancy uses reference curves based on western data. The objective of this study was to construct the reference curves of first-trimester foetal aneuploidy screening parameters for the Indian women.

Methods:

Cross-sectional data were obtained from 1204 singleton pregnancies between the crown-rump length (CRL) of 40-84 mm. Linear regression models were constructed; the mean, median and standard deviation were derived as a function of CRL.

Results:

The mean value of CRL was 61.3 mm. The regression analysis showed a significant correlation between all variables and CRL (P<0.001). There was a positive correlation of CRL with nuchal translucency (NT) (y=0.010x+0.629, R²=0.116) and pregnancy-associated plasma protein-A (PAPP-A) (y=0.107x−1.079, R²=0.173), whereas inverse correlation was seen with free β-human chorionic gonadotropin (β-hCG) (y=−0.409x+75.025, R²=0.018) and Doppler parameters pulsatility index (PI) (y=−0.008x+1.924 R²=0.053). The centile charts of NT, PAPP-A, free β-hCG and uterine artery (Ut A) Doppler PI were constructed.

Interpretation & conclusions:

The reference centile charts of first trimester aneuploidy screening along with Doppler parameters were derived in Indian pregnant women. These centile charts may be used as a reference for clinical use in Indian population.

An objective scoring method to evaluate image quality of middle cerebral artery Doppler

Objective: To validate an objective scoring system for middle cerebral artery (MCA) pulsed wave Doppler images.Method: From an image database of routine 36-week scans, a random sample of MCA Doppler images was selected. Two reviewers rated the images subjectively as acceptable or unacceptable. Subsequently they used an objective 6-point image scoring system and awarded one point for each of the following: (1) anatomical site, (2) magnification, (3) angle of insonation, (4) image clarity, (5) sweep speed adjustment, and (6) velocity scale and baseline adjustment. Image scores 4-6 were defined as good quality whereas 0-3 as poor. The subjective and objective agreement between the two reviewers was compared using the adjusted Kappa statistic.Results: A total of 124 images were assessed. Using objective scoring the agreement rate between reviewers increased to 91.9% (κ = 0.839) compared to subjective agreement 75.8% (κ = 0.516). The agreement for each criterion was: anatomical site 91.1% (κ = 0.823), magnification 95.2% (κ = 0.903), clarity 83.9% (κ = 0.677), angle 96.0% (κ = 0.919), sweep speed 98.4% (κ = 0.968), and velocity scale and baseline 94.4% (κ = 0.887).Conclusion: Objective assessment of MCA Doppler images using a 6-point scoring system has greater interobserver agreement than subjective assessment and could be used for MCA Doppler quality assurance.

Quality control of ultrasound for fetal biometry: results from the INTERGROWTH-21st Project

OBJECTIVE

To assess a comprehensive package of ultrasound quality control in the Fetal Growth Longitudinal Study of the INTERGROWTH-21^st Project, a large multicenter study of fetal growth.

METHODS

Quality control (QC) measures were performed for 20 313 ultrasound scan images obtained prospectively from 4321 fetuses at 14-41 weeks' gestation in eight geographical locations. At the time of each ultrasound examination, three fetal biometric variables (head circumference (HC), abdominal circumference (AC) and femur length (FL)) were measured in triplicate on separately generated images. All measurements were taken in a blinded fashion. QC had two elements: (1) qualitative QC: visual assessment by sonographers at each study site of their images based on specific criteria, with 10% of images being re-assessed at the Oxford-based Ultrasound Quality Unit (compared using an adjusted kappa statistic); and (2) quantitative QC: assessment of measurement data by comparing the first, second and third measurements (intraobserver variability), remeasurement of caliper replacement in 10% (interobserver variability), both by Bland-Altman plots and plotting frequency histograms of the SD of triplicate measurements and assessing how many were above or below 2 SD of the expected distribution. The system allowed the sonographers' performances to be monitored regularly.

RESULTS

A high level of agreement between self- and external scoring was demonstrated for all measurements (κ = 0.99 (95% CI, 0.98-0.99) for HC, 0.98 (95% CI, 0.97-0.99) for AC and 0.96 (95% CI, 0.95-0.98) for FL). Intraobserver 95% limits of agreement (LoA) of ultrasound measures for HC, AC and FL were ± 3.3%, ± 5.6% and ± 6.2%, respectively; the corresponding values for interobserver LoA were ± 4.4%, ± 6.0% and ± 5.6%. The SD distribution of triplicate measurements for all biometric variables showed excessive variability for three of 31 sonographers, allowing prompt identification and retraining.

CONCLUSIONS

Qualitative and quantitative QC monitoring was feasible and highly reproducible in a large multicenter research study, which facilitated the production of high-quality ultrasound images. We recommend that the QC system we developed is implemented in future research studies and clinical practice. Copyright © 2017 ISUOG. Published by John Wiley & Sons Ltd.

Improving precision of second-trimester biometry

OBJECTIVE

To utilise image score-based criteria for second-trimester fetal biometry as an educational tool to improve biometry quality.

METHODS

Five sonographers regularly performing obstetric ultrasound examinations were recruited for this study. Biometry images were collected from fifteen second-trimester examinations for each sonographer prior to participating in a biometry education session, and another set of biometry images were collected from fifteen second-trimester examinations following the education session. The education session was a one-hour presentation that explained image score-based criteria to evaluate and grade the quality of the bi-parietal diameter (BPD), head circumference (HC), abdominal circumference (AC), femur length (FL) and humeral length (HL) biometry parameters. Each of the five sonographers performed a total of 30 examinations (15 pre- and 15 post-education session). From these examinations, a total of 150 images were collected for each biometry parameter (75 pre- and 75 post-education). A total of 600 biometry images were evaluated. Images from both the pre- and post-education session were assessed by an obstetrician sonologist using the same image score-based criteria. Pre- and post-image scores were compared using paired t-tests.

RESULTS

Improvement in the mean image scores for all biometry parameters was observed after the education session. The difference between pre- and post-education image quality scores was significant for the AC (P = 0.01), FL (P = 0.002) and for the overall score (P = 0.001).

CONCLUSION

Implementing an image score-based criteria evaluation technique is a simple and useful method to improve fetal biometry precision.

Multidisciplinary consensus on screening for, diagnosis and management of fetal growth restriction in the Netherlands

BACKGROUND

Screening for, diagnosis and management of intrauterine growth restriction (IUGR) is often performed in multidisciplinary collaboration. However, variation in screening methods, diagnosis and management of IUGR may lead to confusion. In the Netherlands two monodisciplinary guidelines on IUGR do not fully align. To facilitate effective collaboration between different professionals in perinatal care, we undertook a Delphi study with uniform recommendations as our primary result, focusing on issues that are not aligned or for which specifications are lacking in the current guidelines.

METHODS

We conducted a Delphi study in three rounds. A purposively sampled selection of 56 panellists participated: 27 representing midwife-led care and 29 obstetrician-led care. Consensus was defined as agreement between the professional groups on the same answer and among at least 70% of the panellists within groups.

RESULTS

Per round 51 or 52 (91% - 93%) panellists responded. This has led to consensus on 27 issues, leading to four consensus based recommendations on screening for IUGR in midwife-led care and eight consensus based recommendations on diagnosis and eight on management in obstetrician-led care. The multidisciplinary project group decided on four additional recommendations as no consensus was reached by the panel. No recommendations could be made about induction of labour versus expectant monitoring, nor about the choice for a primary caesarean section.

CONCLUSIONS

We reached consensus on recommendations for care for IUGR within a multidisciplinary panel. These will be implemented in a study on the effectiveness and cost-effectiveness of routine third trimester ultrasound for monitoring fetal growth. Research is needed to evaluate the effects of implementation of these recommendations on perinatal outcomes.

TRIAL REGISTRATION

NTR4367 .

First-trimester reference centiles of fetal biometry in Indian population

AIM AND OBJECTIVE

To create crown-rump length (CRL)-based biometric chart for fetus in the first trimester among the Indian population.

MATERIAL AND METHODS

Cross-sectional data were obtained from 400 singleton pregnancies between 11 and 14 weeks gestation with a normal outcome. Linear regression models were constructed; the mean and SD were derived as a function of CRL.

RESULTS

There was a positive correlation of CRL with nuchal translucency (NT) (y = 0.0102x + 0.6307 R²=0.1177), biparietal diameter (BPD) (BPD = 0.032*CRL +0.185 R²=0.765), occipito-frontal diameter (OFD), lateral ventricular diameter (LV), abdominal circumference (AC) (AC = 0.944*CRL +9.684 R²=0.668), femur length (FL) (FL = 0.222*CRL -4.734 R²=0.661), fetal weight (FW) (FW = 1.328*CRL -10.41 R²=0.662). The regression models and centile charts of NT, BPD, OFD, LV, AC, and FW were constructed. Taking FW as the independent variable, a linear equation of BPD, AC, and FL to calculate weight was constructed.

CONCLUSIONS

The first-trimester centile charts of fetal parameters can be used as a reference for Indian population in the determination of gestational age or other adverse outcomes.

Relation between the quality of the ultrasound image acquisition and the precision of the measurement of the crown-rump length in the late first trimester: what are the consequences?

OBJECTIVE

To assess the extent to which the distribution of crown-rump length (CRL) values may be correlated with different criteria for the quality of the CRL images.

STUDY DESIGN

This is a retrospective analysis of a series of 977 CRL images, by two independent observers, for the presence or the absence of 14 quality hallmarks. Inter-observer agreement for the hallmarks was assessed by the proportion of agreement and Cohen's kappa. The association between the quantiles of the CRL distribution and the presence or absence of the 14 quality hallmarks was modeled using quantile regression.

RESULTS

The overall inter-observer agreement across the 14 hallmarks was 91.7%, kappa=0.81, 95% CI [0.80-0.82]. Distribution of CRL measurements varied considerably as a function of image quality: when the fetus was in extension, the mean CRL was +5.7mm (vs. not in extension, p<0.001), when the fetus was in flexion (vs. not), the mean CRL was -4.7mm (p<0.001) and when the image magnification was <65% (vs. >65%), the mean CRL was -4.2mm (p<0.001). There was a global trend to over-estimate the CRL for the higher deciles and to under-estimate the CRL for the lower deciles when the sagittal quality hallmarks were absent. No significant impact on CRL distribution was observed in association with the precise placement of the calipers nor with the horizontal orientation of the fetus.

CONCLUSION

Distribution of CRL measurements was influenced by the quality of CRL images. In particular, inadequate position of the fetus (flexion/extension) and insufficient image magnification were associated with systematic changes in the values of CRL. Our results show that as the quality of CRL images decreases, the associated variations in the distribution of CRL can have an impact on the chromosomal risk assessment and may lead to inappropriate obstetrical decisions.

Adverse fetal outcome: is first trimester ultrasound and Doppler better predictor than biomarkers?

AIMS AND OBJECTIVES

To evaluate the predictive value of first trimester biomarkers and ultrasound in determining adverse fetal outcomes in a low risk Asian population.

MATERIAL AND METHOD

All low risk, singleton pregnancies between 11 and 14 weeks gestation underwent ultrasound with uterine artery Doppler along with PAPP-A and free β-hCG estimation, and were followed till delivery to observe the outcome. The adverse fetal outcomes detected were structural anomaly, aneuploidy, intrauterine growth restriction, preterm birth and stillbirth (SB).

RESULTS

Out of 3500 women screened, 417 cases had adverse fetal outcome in the absence of maternal complication, 2151 had normal outcome. Major structural anomaly was detected in first trimester in 17/28 (60.7%) cases. The most important markers for adverse fetal outcome were increased uterine artery pulsatility index (UPI) (p = 0.028, OR 1.5, 95% CI: 1.05-2.38, AUC 0.56) for IUGR, nuchal translucency (p = 0.001, OR 1.7, 95% CI: 1.11-2.77, AUC 0.60) for major anomaly and low PAPP-A (p = 0.017, OR -0.075, 95% CI: 0.87-0.98, AUC 0.621) for SB.

CONCLUSION

UPI, NT and PAPP-A in the first trimester are significant markers of adverse fetal outcome, although the sensitivity and specificity are not high they have a high negative predictive value.

Nuchal Translucency Quality Review (NTQR) program: first one and half million results

OBJECTIVE

To evaluate the performance of first-trimester nuchal translucency (NT) measurement by providers (physician-sonologists and sonographers) within the Nuchal Translucency Quality Review (NTQR) program.

METHODS

After training and credentialing providers, the NTQR monitored performance of NT measurement by the extent to which an individual's median multiple of the normal median (MoM) for crown-rump length (CRL) was within the range 0.9-1.1 MoM of a published normal median curve. The SD of log10 MoM and regression slope of NT on CRL were also evaluated. We report the distribution between providers of these performance indicators and evaluate potential sources of variation.

RESULTS

Among the first 1.5 million scans in the NTQR program, performed between 2005 and 2011, there were 1 485 944 with CRL in the range 41-84 mm, from 4710 providers at 2150 ultrasound units. Among the 3463 providers with at least 30 scans in total, the median of the providers' median NT-MoMs was 0.913. Only 1901 (55%) had a median NT-MoM within the expected range; there were 89 above 1.1 MoM, 1046 at 0.8-0.9 MoM, 344 at 0.7-0.8 MoM and 83 below 0.7 MoM. There was a small increase in the median NT-MoM according to providers' length of time in the NTQR program and number of scans entered annually. On average, physician-sonologists had a higher median NT-MoM than did sonographers, as did those already credentialed before joining the program. The median provider SD was 0.093 and the median slope was 13.5%. SD correlated negatively with the median NT-MoM (r = -0.34) and positively with the slope (r = 0.22).

CONCLUSION

Even with extensive training, credentialing and monitoring, there remains considerable variability between NT providers. There was a general tendency towards under-measurement of NT compared with expected values, although more experienced providers had performance closer to that expected.

Image-scoring system for crown-rump length measurement

OBJECTIVE

To develop and evaluate an objective image-scoring system for crown-rump length (CRL) measurements and to determine how this compares with subjective assessment.

METHODS

A total of 125 CRL ultrasound images were selected from the database of the International Fetal and Newborn Growth Consortium for the 21(st) Century study group. Two reviewers, who were blinded to the operators' and to each others' results, evaluated all images both subjectively and objectively. Subjective evaluation consisted of rating an image as acceptable or unacceptable, while objective evaluation was based on six criteria. Reviewer differences for both the subjective and objective evaluations were compared using percentage of agreement and adjusted kappa values.

RESULTS

The distribution of individual scores and differences between subjective and objective evaluation for the two reviewers was similar. Overall agreement between the reviewers was higher for objective evaluation (95.2%; adjusted κ, 0.904), than for subjective evaluation (77.6%; adjusted κ, 0.552). There was a high level of agreement for horizontal position (κ = 0.951), magnification (κ = 0.919), visualization of crown and rump (κ = 0.806) and caliper placement (κ = 0.756), while agreement for mid-sagittal section (κ = 0.629) and neutral position (κ = 0.565) were moderate and poor, respectively.

CONCLUSION

The proposed six-point scoring system for CRL image rating is more reproducible than is subjective evaluation and should be considered as a method of quality assessment and audit.

Quality of first-trimester measurement of crown-rump length

OBJECTIVE

The purpose of this study was to evaluate the quality of crown-rump length (CRL) measurements in scans judged to be of high quality for the measurement of the nuchal translucency.

STUDY DESIGN

We analyzed prospective data on 68,250 scans by 1913 sonographers that were collected by the French College of Fetal Echography (CFEF) national practice assessment program for the first-trimester scan. The scans were evaluated according to the CFEF image scoring method (CFEF-ISM), which includes items to measure the quality of the scan for both nuchal translucency and the CRL measurements. The scans were classified into 4 quality groups with the use of the full CFEF-ISM score and then a shortened version of the CFEF-ISM that excluded the item on quality of CRL measurement. The proportion of scans with an inaccurate CRL measurement was compared across the different quality groups.

RESULTS

Overall, 21.67% of scans were of insufficient quality for CRL measurement. Among 23,764 "excellent" scans according to the full CFEF-ISM, 965 scans (4.06%) had insufficient CRL quality vs 9.24% of scans with "excellent" quality on the short CFEF-ISM (relative risk, 2.27; 95% confidence interval, 2.11-2.44; P < .001).

CONCLUSION

High scores of the quality of nuchal translucency measurement do not guarantee accurate measurement of crown-rump length. Specific measures are needed to evaluate and to improve the quality of the measurement of crown-lump length.

Prenatal screening and diagnosis of aneuploidy in multiple pregnancies

Prenatal screening for aneuploidy has changed significantly over the last 30 years, from being age-based to maternal serum and ultrasound based techniques. Multiple pregnancies present particular challenges with regards to screening as serum-based screening techniques are influenced by all feti while ultrasound-based techniques can be fetus specific. Tests currently available tend to not perform as well in multiple compared to singleton pregnancies. Considerations must be given to these variations when discussing and performing screening for aneuploidy in this situation. Prenatal invasive diagnosis techniques in multiple pregnancies bring their own challenges from a technical and counselling point of view, in particular with regards to sampling error, mapping and assignment of results and management of abnormal results. This review addresses these particular challenges and provides information to facilitate care.

Formative assessment based on an audit and feedback improves nuchal translucency ultrasound image quality

OBJECTIVES

The purpose of this work was to study the impact of an audit and feedback on the quality of routine first-trimester nuchal transparency ultrasound images.

METHODS

Eighty-eight sonographers were each sent 2 different series of 30 consecutive nuchal translucency images at a mean interval of 3 months to a dedicated, protected server for remote double-blind independent analysis based on the new Collège Français d'Echographie Foetale/Centre National de la Recherche Scientifique image-scoring method (https://www.cfef.org/evaluation/ISMCFEFCNRS.pdf). The sonographers were classified as low (score below the median) or high (score above the median) scorers for each series. Before their second evaluation, 73 of the 88 sonographers received a feedback report on their first series of images, whereas the other 15 participants received no feedback. The baseline characteristics of the participants who did and did not receive feedback were comparable.

RESULTS

Participants who received feedback increased their average score significantly, from a mean ± SD of 11.1 ± 1.3 to 13.4 ± 1.4 among low scorers (P < .00001) and from 15.1 ± 1.2 to 16.0 ± 1.4 among high scorers (P < .001), whereas no significant change was seen among participants who received no feedback (low scorers, 10.9 ± 1.5 to 12.1 ± 2.0; P = .11; high scorers, 14.7 ± 1.3 to 14.6 ± 1.3; P = .99). The proportion of satisfactory images increased by 48% among low scorers who received feedback.

CONCLUSIONS

Formative assessment based on a moderately intensive audit and feedback is feasible and effective for improving the quality of routine first-trimester nuchal transparency ultrasound images.

Impact of nuchal translucency credentialing by the FMF, the NTQR or both on screening distributions and performance

OBJECTIVE

In the USA, both The Fetal Medicine Foundation (FMF) and the Nuchal Translucency Quality Review Program (NTQR) have operated education, review and credentialing for physicians and sonographers for the measurement of nuchal translucency (NT). We sought to assess differences in the distribution of NT measurements based upon the system from which the operator obtained their education, review and credentialing.

METHODS

398 311 NT measurements by 1541 sonographers who had performed ≥ 50 exams from July 2008 to June 2010 were grouped by organization. Differences between grouped measurements were assessed using analysis of variance of log(10) NT multiples of the median (MoM), with sonographer and organization as factors.

RESULTS

MoM values were significantly lower (P ≤ 0.001) and SD was significantly higher (P < 0.001) for the NTQR group compared with the FMF group or those sonographers credentialed by both. The percentage of individuals with negative bias ≥ 10% was greater for the NTQR group (P < 0.001). The difference was less but still significant (P = 0.009) when bias was adjusted for by the overall median for the organization.

CONCLUSIONS

Although NT MoM measurements were significantly lower and had a wider variance when obtained by the NTQR group, our data cannot distinguish between bias in training or the attributes of the participating sonographers in each program. With these large numbers, it is unlikely that patient characteristics could explain the discrepancy in distributions. Ongoing efforts to monitor sonographer performance with remediation for poor performers may reduce discrepancies between organizations.

Analysis of quality of nuchal translucency measurements: its role in prenatal diagnosis

Objective. Quantitative analysis of the quality of nuchal translucency (NT) measurements. Methods. First-trimester combined screening for Down syndrome was performed to all pregnant women attended in our Department from October 2003 to November 2009. NT was measured according to the Fetal Medicine Foundation (FMF) criteria by 20 trained obstetricians. The performance of NT measurements was retrospectively analyzed with regard to several quality control standards. Accuracy according to experience, professional profile, crown rump length (CRL) values, and FMF certification was statistically tested. Results. A total of 14978 NT measurements were assessed. (1) The mean operator-specific median NT-MoM values was 0,98. (2) Mean percentage of cases >95th and <5th centiles were 5,0% and 4,2%, respectively. (3) Logarithmic mean and SD of the NT MoM values were 0,00 and 0,13, respectively. (4) The DR for trisomy 21 at screening time was 90,7% for a FPR of 6,7% for standard screening strategy. (5) According to Cumulative SUM (CUSUM) figures, the performance was more acceptable in FMF-certified operators. Conclusion. Overall, quality standards show optimal NT measurements in our unit. Operator experience, a dedicated profile to fetal medicine, CRL over 60 mm, and FMF certification have a significant positive impact on the quality standards.

Standardization of fetal ultrasound biometry measurements: improving the quality and consistency of measurements

OBJECTIVE

To assess whether a standardization exercise prior to commencing a fetal growth study involving multiple sonographers can reduce interobserver variation.

METHODS

In preparation for an international study assessing fetal growth, nine experienced sonographers from eight countries participated in a standardization exercise consisting of theoretical and practical sessions. Each performed a set of seven standard fetal measurements on pregnant volunteers at 20-37 weeks' gestation, and these were repeated by the lead sonographer; all measurements were taken in a blinded fashion. After this the sonographers had hands-on practice and feedback sessions on other volunteers. This process was repeated three times. Measurement differences between sonographers and the lead sonographer, expressed as a gestational-age-specific Z-score, between the first and third scans were compared using the Wilcoxon signed ranks test, and variance was assessed using Pitman's test. Interobserver agreement was also assessed using the intraclass correlation coefficient (ICC), and all images were scored for quality in a blinded fashion.

RESULTS

At baseline the level of agreement and image scoring were high. A significant reduction in the differences between sonographers and the lead sonographer were seen for fetal biometry overall (head circumference, abdominal circumference and femur length) between the first and third scans (median Z-scores, 0.46 and 0.24; P = 0.005), and a reduction in the variance was also observed (P < 0.001). The ICCs for measurement pairs for every fetal measurement showed a clear trend of increasing ICC (better agreement) with consecutive training scan sessions, although no improvement in image scores was seen.

CONCLUSION

Even for experienced sonographers, a standardization exercise before starting a study of fetal biometry can improve consistency of measurements. This could be of relevance for studies assessing fetal growth in multicenter sites.

Prenatal screening for fetal aneuploidy in singleton pregnancies

OBJECTIVE

To develop a Canadian consensus document on maternal screening for fetal aneuploidy (e.g., Down syndrome and trisomy 18) in singleton pregnancies.

OPTIONS

Pregnancy screening for fetal aneuploidy started in the mid 1960s, using maternal age as the screening test. New developments in maternal serum and ultrasound screening have made it possible to offer all pregnant patients a non-invasive screening test to assess their risk of having a fetus with aneuploidy to determine whether invasive prenatal diagnostic testing is necessary. This document reviews the options available for non-invasive screening and makes recommendations for Canadian patients and health care workers.

OUTCOMES

To offer non-invasive screening for fetal aneuploidy (trisomy 13, 18, 21) to all pregnant women. Invasive prenatal diagnosis would be offered to women who screen above a set risk cut-off level on non-invasive screening or to pregnant women whose personal, obstetrical, or family history places them at increased risk. Currently available non-invasive screening options include maternal age combined with one of the following: (1) first trimester screening (nuchal translucency, maternal age, and maternal serum biochemical markers), (2) second trimester serum screening (maternal age and maternal serum biochemical markers), or (3) 2-step integrated screening, which includes first and second trimester serum screening with or without nuchal translucency (integrated prenatal screen, serum integrated prenatal screening, contingent, and sequential). These options are reviewed, and recommendations are made.

EVIDENCE

Studies published between 1982 and 2009 were retrieved through searches of PubMed or Medline and CINAHL and the Cochrane Library, using appropriate controlled vocabulary and key words (aneuploidy, Down syndrome, trisomy, prenatal screening, genetic health risk, genetic health surveillance, prenatal diagnosis). Results were restricted to systematic reviews, randomized controlled trials, and relevant observational studies. There were no language restrictions. Searches were updated on a regular basis and incorporated in the guideline to August 2010. Grey (unpublished) literature was identified through searching the websites of health technology assessment and health technology assessment-related agencies, clinical practice guideline collections, clinical trial registries, and national and international medical specialty societies. The previous Society of Obstetricians and Gynaecologists of Canada guidelines regarding prenatal screening were also reviewed in developing this clinical practice guideline.

VALUES

The quality of evidence was rated using the criteria described in the Report of the Canadian Task Force on Preventive Health Care.

BENEFITS, HARMS, AND COSTS

This guideline is intended to reduce the number of prenatal invasive procedures done when maternal age is the only indication. This will have the benefit of reducing the numbers of normal pregnancies lost because of complications of invasive procedures. Any screening test has an inherent false-positive rate, which may result in undue anxiety. It is not possible at this time to undertake a detailed cost-benefit analysis of the implementation of this guideline, since this would require health surveillance and research and health resources not presently available; however, these factors need to be evaluated in a prospective approach by provincial and territorial initiatives. RECOMMENDATIONS 1. All pregnant women in Canada, regardless of age, should be offered, through an informed counselling process, the option of a prenatal screening test for the most common clinically significant fetal aneuploidies in addition to a second trimester ultrasound for dating, assessment of fetal anatomy, and detection of multiples. (I-A) 2. Counselling must be non-directive and must respect a woman's right to accept or decline any or all of the testing or options offered at any point in the process. (III-A) 3. Maternal age alone is a poor minimum standard for prenatal screening for aneuploidy, and it should not be used a basis for recommending invasive testing when non-invasive prenatal screening for aneuploidy is available. (II-2A) 4. Invasive prenatal diagnosis for cytogenetic analysis should not be performed without multiple marker screening results except for women who are at increased risk of fetal aneuploidy (a) because of ultrasound findings, (b) because the pregnancy was conceived by in vitro fertilization with intracytoplasmic sperm injection, or (c) because the woman or her partner has a history of a previous child or fetus with a chromosomal abnormality or is a carrier of a chromosome rearrangement that increases the risk of having a fetus with a chromosomal abnormality. (II-2E) 5. At minimum, any prenatal screen offered to Canadian women who present for care in the first trimester should have a detection rate of 75% with no more than a 3% false-positive rate. The performance of the screen should be substantiated by annual audit. (III-B) 6. The minimum standard for women presenting in the second trimester should be a screen that has a detection rate of 75% with no more than a 5% false-positive rate. The performance of the screen should be substantiated by annual audit. (III-B) 7. First trimester nuchal translucency should be interpreted for risk assessment only when measured by sonographers or sonologists trained and accredited for this service and when there is ongoing quality assurance (II-2A), and it should not be offered as a screen without biochemical markers in singleton pregnancies. (I-E) 8. Evaluation of the fetal nasal bone in the first trimester should not be incorporated as a screen unless it is performed by sonographers or sonologists trained and accredited for this service and there is ongoing quality assurance. (II-2E) 9. For women who undertake first trimester screening, second trimester serum alpha fetoprotein screening and/or ultrasound examination is recommended to screen for open neural tube defects. (II-1A) 10. Timely referral and access is critical for women and should be facilitated to ensure women are able to undergo the type of screening test they have chosen as first trimester screening. The first steps of integrated screening (with or without nuchal translucency), contingent, or sequential screening are performed in an early and relatively narrow time window. (II-1A) 11. Ultrasound dating should be performed if menstrual or conception dating is unreliable. For any abnormal serum screen calculated on the basis of menstrual dating, an ultrasound should be done to confirm gestational age. (II-1A) 12. The presence or absence of soft markers or anomalies in the 18- to 20-week ultrasound can be used to modify the a priori risk of aneuploidy established by age or prior screening. (II-2B) 13. Information such as gestational dating, maternal weight, ethnicity, insulin-dependent diabetes mellitus, and use of assisted reproduction technologies should be provided to the laboratory to improve accuracy of testing. (II-2A) 14. Health care providers should be aware of the screening modalities available in their province or territory. (III-B) 15. A reliable system needs to be in place ensuring timely reporting of results. (III-C) 16. Screening programs should be implemented with resources that support audited screening and diagnostic laboratory services, ultrasound, genetic counselling services, patient and health care provider education, and high quality diagnostic testing, as well as resources for administration, annual clinical audit, and data management. In addition, there must be the flexibility and funding to adjust the program to new technology and protocols. (II-3B).

Evaluation of an objective method of image assessment for first-trimester nasal bone

OBJECTIVE

To evaluate the degree of agreement in first-trimester nasal bone assessment in a group of sonographers before and after training, using a semi-quantitative scoring system.

METHODS

Four sonographers who routinely perform first-trimester screening were first shown 46 images from both normal and trisomy 21 pregnancies. For each image, they were asked to score from 0 (disagree) to 3 (agree) on five different criteria that were deemed important in nasal-bone assessment, including image size, plane and visibility of nasal bone. A training program was then conducted, and a repeat exercise was carried out using the same 46 images. Finally, in a third exercise, images from 42 patients were presented, some having more than one image. The sonographers were required to give one overall nasal-bone score for each patient. In each exercise interobserver agreement was evaluated by intraclass correlation coefficient (ICC).

RESULTS

Before training, the sonographers agreed reasonably well on the five proposed criteria (ICC, 0.752), with some disagreement on their perceived image quality. The training program further improved the agreement (ICC, 0.790), particularly on whether the nasal bone was the biggest and brightest echogenic component. Agreement was excellent when they were asked to give one overall score on the nasal bone based on multiple images from one patient (ICC, 0.929).

CONCLUSION

The proposed scoring system can be used to improve consistency and reliability in first-trimester nasal-bone assessment.

Impact of bias in serum free beta-human chorionic gonadotropin and pregnancy-associated plasma protein-A multiples of the median levels on first-trimester screening for trisomy 21

OBJECTIVE

To examine the effect of bias in median multiples of the median (MoM) levels of pregnancy-associated plasma protein-A (PAPP-A) and free beta-human chorionic gonadotropin (β-hCG) on first-trimester combined screening for trisomy 21.

METHODS

The effects of deviations in the MoM levels of free β-hCG and PAPP-A were investigated by simulating nuchal translucency (NT) at 12 weeks and MoM values for PAPP-A and free β-hCG for 500 000 euploid and 500 000 trisomy 21 pregnancies at 9 and at 12 weeks of gestation. Likelihoods were calculated using the mixture model for NT and the standard Gaussian model for log MoM PAPP-A and free β-hCG values. Deviations in MoM marker levels were simulated by applying percentage changes of 5% to 20% to MoM values. Detection and false-positive rates were calculated with and without adjustments of the maternal serum marker levels by taking the proportion of euploid and aneuploid cases above given thresholds for each maternal age and then taking a weighted average with respect to the maternal age distribution.

RESULTS

With median MoM levels on target, the modeled detection and false-positive rates in combined screening for trisomy 21 at 12 weeks of gestation with a fixed risk cut-off of 1 in 100 were 85% and 2.5%, respectively. For median MoM levels of free β-hCG and PAPP-A between 0.8 and 1.2 MoM, detection rates ranged from 77% to 91%, with corresponding false-positive rates ranging from 1.0% to 6.1%.

CONCLUSION

In first-trimester screening for trisomy 21, biases in the serum marker MoM levels of 10% can increase false-positive rates by over 50%, whilst biases of 20% can more than double false-positive rates.

Likelihood ratio-based quality control for nuchal translucency measurements at 11-14 weeks of gestation

OBJECTIVE

To develop a quantitative quality control process of nuchal translucency (NT) measurement at 11-14 weeks of gestation based on the mixture model, characterized by analysis of the corresponding distribution of the likelihood ratio (LR).

METHODS

Based on the published mixture model for NT measurement in the first trimester, we simulated the expected distribution of NT and the corresponding LR. This approach was then tested for the quality control of 15 048 NT measurements performed by four operators trained and certified by The Fetal Medicine Foundation. The new quality control approach based on LR was compared with existing processes based on NT plots, multiples of the median (MoMs) and analysis of the 95(th) centile.

RESULTS

Each operator contributed 2176-4730 examinations. Median, 5(th) and 95(th) centile of NT values ranged from 1.4 to 1.6, 1.0 to 1.0 and 2.2 to 2.6 mm, respectively. Median of NT-MoM values ranged from 0.83 to 0.95. Analysis of the distribution of NT measurements confirmed departure from the assumptions of the delta-NT and NT-MoM models. Analysis of LR distributions demonstrated a significant difference between observed and expected distributions for all operators (P < 10(-4) ).

CONCLUSION

An LR-based quality control process is feasible at 11-14 weeks of gestation. Because it is more sensitive to measurement bias around the critical area of the 95(th) centile, its use should be encouraged.

Reducing inter-rater variability in the assessment of nuchal translucency image quality

INTRODUCTION

Standardization of first-trimester nuchal translucency (NT) image acquisition is crucial to the success of screening for Down syndrome. Rigorous audit of operator performance and constructive feedback from assessors maintain standards. This process relies on good inter-rater agreement on image assessment. We describe the Australian approach to NT image assessment and evaluate the impact of a targeted intervention on inter-rater agreement.

METHODS

Between 2002 and 2008 a group of experienced practitioners met nine times to compare their assessment of a series of NT images. Each assessor had previously scored the images according to a system described in 2002. Inter-rater agreement was evaluated before and after an intervention where the assessors were required to refer to a detailed resource manual designed to reduce the subjectivity inherent in image assessment.

RESULTS

There was a statistical improvement in inter-rater agreement for all elements of image assessment (original scores and individual component scores) after the intervention, apart from horizontal fetal position. However, even after the intervention, inter-rater agreement levels generally remained moderate (kappa range: 0.14-0.58).

CONCLUSIONS

This study has shown that provision of detailed resource documentation to experienced assessors can significantly improve inter-rater agreement in all facets of NT image assessment. It also highlights areas of image assessment that require critical review. It is recommended that all audit bodies regularly review their inter-rater agreement to ensure consistent feedback to operators who submit images for expert peer review.