Standardization of fetal ultrasound biometry measurements: improving the quality and consistency of measurements

Image-scoring system for crown-rump length measurement

OBJECTIVE

To develop and evaluate an objective image-scoring system for crown-rump length (CRL) measurements and to determine how this compares with subjective assessment.

METHODS

A total of 125 CRL ultrasound images were selected from the database of the International Fetal and Newborn Growth Consortium for the 21(st) Century study group. Two reviewers, who were blinded to the operators' and to each others' results, evaluated all images both subjectively and objectively. Subjective evaluation consisted of rating an image as acceptable or unacceptable, while objective evaluation was based on six criteria. Reviewer differences for both the subjective and objective evaluations were compared using percentage of agreement and adjusted kappa values.

RESULTS

The distribution of individual scores and differences between subjective and objective evaluation for the two reviewers was similar. Overall agreement between the reviewers was higher for objective evaluation (95.2%; adjusted κ, 0.904), than for subjective evaluation (77.6%; adjusted κ, 0.552). There was a high level of agreement for horizontal position (κ = 0.951), magnification (κ = 0.919), visualization of crown and rump (κ = 0.806) and caliper placement (κ = 0.756), while agreement for mid-sagittal section (κ = 0.629) and neutral position (κ = 0.565) were moderate and poor, respectively.

CONCLUSION

The proposed six-point scoring system for CRL image rating is more reproducible than is subjective evaluation and should be considered as a method of quality assessment and audit.

International standards for early fetal size and pregnancy dating based on ultrasound measurement of crown-rump length in the first trimester of pregnancy

OBJECTIVES

There are no international standards for relating fetal crown-rump length (CRL) to gestational age (GA), and most existing charts have considerable methodological limitations. The INTERGROWTH-21(st) Project aimed to produce the first international standards for early fetal size and ultrasound dating of pregnancy based on CRL measurement.

METHODS

Urban areas in eight geographically diverse countries that met strict eligibility criteria were selected for the prospective, population-based recruitment, between 9 + 0 and 13 + 6 weeks' gestation, of healthy well-nourished women with singleton pregnancies at low risk of fetal growth impairment. GA was calculated on the basis of a certain last menstrual period, regular menstrual cycle and lack of hormonal medication or breastfeeding in the preceding 2 months. CRL was measured using strict protocols and quality-control measures. All women were followed up throughout pregnancy until delivery and hospital discharge. Cases of neonatal and fetal death, severe pregnancy complications and congenital abnormalities were excluded from the study.

RESULTS

A total of 4607 women were enrolled in the Fetal Growth Longitudinal Study, one of the three main components of the INTERGROWTH-21(st) Project, of whom 4321 had a live singleton birth in the absence of severe maternal conditions or congenital abnormalities detected by ultrasound or at birth. The CRL was measured in 56 women at < 9 + 0 weeks' gestation; these were excluded, resulting in 4265 women who contributed data to the final analysis. The mean CRL and SD increased with GA almost linearly, and their relationship to GA is given by the following two equations (in which GA is in days and CRL in mm): mean CRL = -50.6562 + (0.815118 × GA) + (0.00535302 × GA(2) ); and SD of CRL = -2.21626 + (0.0984894 × GA). GA estimation is carried out according to the two equations: GA = 40.9041 + (3.21585 × CRL(0.5) ) + (0.348956 × CRL); and SD of GA = 2.39102 + (0.0193474 × CRL).

CONCLUSIONS

We have produced international prescriptive standards for early fetal linear size and ultrasound dating of pregnancy in the first trimester that can be used throughout the world.

International standards for fetal growth based on serial ultrasound measurements: the Fetal Growth Longitudinal Study of the INTERGROWTH-21st Project

BACKGROUND

In 2006, WHO produced international growth standards for infants and children up to age 5 years on the basis of recommendations from a WHO expert committee. Using the same methods and conceptual approach, the Fetal Growth Longitudinal Study (FGLS), part of the INTERGROWTH-21(st) Project, aimed to develop international growth and size standards for fetuses.

METHODS

The multicentre, population-based FGLS assessed fetal growth in geographically defined urban populations in eight countries, in which most of the health and nutritional needs of mothers were met and adequate antenatal care was provided. We used ultrasound to take fetal anthropometric measurements prospectively from 14 weeks and 0 days of gestation until birth in a cohort of women with adequate health and nutritional status who were at low risk of intrauterine growth restriction. All women had a reliable estimate of gestational age confirmed by ultrasound measurement of fetal crown-rump length in the first trimester. The five primary ultrasound measures of fetal growth--head circumference, biparietal diameter, occipitofrontal diameter, abdominal circumference, and femur length--were obtained every 5 weeks (within 1 week either side) from 14 weeks to 42 weeks of gestation. The best fitting curves for the five measures were selected using second-degree fractional polynomials and further modelled in a multilevel framework to account for the longitudinal design of the study.

FINDINGS

We screened 13,108 women commencing antenatal care at less than 14 weeks and 0 days of gestation, of whom 4607 (35%) were eligible. 4321 (94%) eligible women had pregnancies without major complications and delivered live singletons without congenital malformations (the analysis population). We documented very low maternal and perinatal mortality and morbidity, confirming that the participants were at low risk of adverse outcomes. For each of the five fetal growth measures, the mean differences between the observed and smoothed centiles for the 3rd, 50th, and 97th centiles, respectively, were small: 2·25 mm (SD 3·0), 0·02 mm (3·0), and -2·69 mm (3·2) for head circumference; 0·83 mm (0·9), -0·05 mm (0·8), and -0·84 mm (1·0) for biparietal diameter; 0·63 mm (1·2), 0·04 mm (1·1), and -1·05 mm (1·3) for occipitofrontal diameter; 2·99 mm (3·1), 0·25 mm (3·2), and -4·22 mm (3·7) for abdominal circumference; and 0·62 mm (0·8), 0·03 mm (0·8), and -0·65 mm (0·8) for femur length. We calculated the 3rd, 5th 10th, 50th, 90th, 95th and 97th centile curves according to gestational age for these ultrasound measures, representing the international standards for fetal growth.

INTERPRETATION

We recommend these international fetal growth standards for the clinical interpretation of routinely taken ultrasound measurements and for comparisons across populations.

FUNDING

Bill & Melinda Gates Foundation.

Intraobserver variability in fibroid size measurements: estimated effects on assessing fibroid growth

OBJECTIVES

To evaluate intraobserver variability of fibroid sonographic measurements and apply this factor to fibroid growth assessment.

METHODS

Study participants were African American women aged 23 to 34 years who had never had a diagnosis of uterine fibroids. All participants underwent transvaginal sonography to screen for the presence of previously undiagnosed fibroids (≥0.5 cm in diameter). The diameters of up to 6 fibroids were measured in 3 perpendicular planes at 3 separate times during the examinations by experienced sonographers. Intraobserver variability as measured by the coefficient of variation (CV) for fibroid diameter and volume was calculated for each fibroid, and factors associated with the CV were assessed by regression models. The impact of variability on growth assessment was determined.

RESULTS

Ninety-six of 300 women screened were found to have at least 1 fibroid, yielding a total of 174 fibroids for this analysis. The mean CV for the 3 measurements of fibroid maximum diameter was 5.9%. The mean CV for fibroid volume was 12.7%. Fibroid size contributed significantly to intraobserver variability (P = .04), with greater variability for smaller fibroids. Fibroid type (submucosal, intramural, or subserosal) was not important. Fibroids from the same woman tended to have similar measurement variability when assessed for volume but not for maximum diameter. Calculations showed that when following up fibroids, as much as a 20% increase in diameter could be due to measurement error, not "true growth."

CONCLUSIONS

A small fibroid must have a greater change in size than a large fibroid to conclude that it is growing, but even for small fibroids an increase in diameter of greater than 20% is likely to indicate true growth, not measurement variability.

WHO multicentre study for the development of growth standards from fetal life to childhood: the fetal component

Background

In 2006 WHO presented the infant and child growth charts suggested for universal application. However, major determinants for perinatal outcomes and postnatal growth are laid down during antenatal development. Accordingly, monitoring fetal growth in utero by ultrasonography is important both for clinical and scientific reasons. The currently used fetal growth references are derived mainly from North American and European population and may be inappropriate for international use, given possible variances in the growth rates of fetuses from different ethnic population groups. WHO has, therefore, made it a high priority to establish charts of optimal fetal growth that can be recommended worldwide.

Methods

This is a multi-national study for the development of fetal growth standards for international application by assessing fetal growth in populations of different ethnic and geographic backgrounds. The study will select pregnant women of high-middle socioeconomic status with no obvious environmental constraints on growth (adequate nutritional status, non-smoking), and normal pregnancy history with no complications likely to affect fetal growth. The study will be conducted in centres from ten developing and industrialized countries: Argentina, Brazil, Democratic Republic of Congo, Denmark, Egypt, France, Germany, India, Norway, and Thailand. At each centre, 140 pregnant women will be recruited between 8 + 0 and 12 + 6 weeks of gestation. Subsequently, visits for fetal biometry will be scheduled at 14, 18, 24, 28, 32, 36, and 40 weeks (+/− 1 week) to be performed by trained ultrasonographers.

The main outcome of the proposed study will be the development of fetal growth standards (either global or population specific) for international applications.

Discussion

The data from this study will be incorporated into obstetric practice and national health policies at country level in coordination with the activities presently conducted by WHO to implement the use of the Child Growth Standards.

Optimal caliper placement: manual vs automated methods

OBJECTIVE

To examine the inter- and intra-operator repeatability of manual placement of callipers in the assessment of basic biometric measurements and to compare the results to an automated calliper placement system.

METHODS

Stored ultrasound images of 95 normal fetuses between 19 and 25 weeks' gestation were used. Five operators (two experts, one resident and two students) were asked to measure the BPD, OFD and FL two times manually and automatically. For each operator, intra-operator repeatability of the manual and automated measurements was assessed by within operator standard deviation. For the assessment of the interoperator repeatability, the mean of the four manual measurements by the two experts was used as the gold standard.The relative bias of the manual measurement of the three non-expert operators and the operator-independent automated measurement were compared with the gold standard measurement by means and 95% confidence interval.

RESULTS

In 88.4% of the 95 cases, the automated measurement algorithm was able to obtain appropriate measurements of the BPD, OFD, AC and FL. Within operator standard deviations of the manual measurements ranged between 0.15 and 1.56, irrespective of the experience of the operator.Using the automated biometric measurement system, there was no difference between the measurements of each operator. As far as the inter-operator repeatability is concerned, the difference between the manual measurements of the two students, the resident, and the gold standard was between -0.10 and 2.53 mm. The automated measurements tended to be closer to the gold standard but did not reach statistical significance.

CONCLUSION

In about 90% of the cases, it was possible to obtain basic biometric measurements with an automated system. The use of automated measurements resulted in a significant improvement of the intra-operator but not of the inter-operator repeatability, but measurements were not significantly closer to the gold standard of expert examiners.

The effect of preliminary training on quantitative evaluation of sonographer performance in the fetal morphology ultrasound examination

Introduction: The aim of this study is to provide a quantitative scoring system to assess sonographer performance by reviewing images from the fetal morphology examination.

Methods: Ten ultrasound images from patients at 18–22 weeks gestation were assessed and scored for quality according to predefined criteria. One hundred normal cases were randomly selected and 10 images from each case were analysed by four experienced reviewers. The preliminary training incorporated the first 25 cases and involved a training period for reviewers; the remaining 75 cases were allocated to post training. The scores acquired by each reviewer were statistically analysed using Pearson's and intra‐class correlations to determine the reproducibility of the results.

Results: The preliminary training results were calculated separately and compared to the post training study. The preliminary intra‐class correlation coefficient was 0.12. In the post training study the intra‐class correlation coefficient was doubled at 0.24. The greatest correlation was observed between reviewers 1 and 4 with a coefficient of 0.71. Reviewers 3 and 4 demonstrated the lowest correlation coefficient of 0.30.

Discussion: A significant increase in the intra‐class correlation coefficient indicated that training reviewers achieves more reproducible results. Suggested improvements to the study include recording fetal position, maternal BMI and assessing individual reviewer variability. An instruction manual defining each criterion might also yield better results.

Conclusion: The quantitative method used in this study assessed ultrasound images by placing a numerical value on image quality. Analysis of the preliminary training period demonstrates improved reproducibility of the results. Further investigation into the criteria is necessary to refine the quantitative method.

Standardisation and quality control of ultrasound measurements taken in the INTERGROWTH-21st Project

Meticulous standardisation and ongoing monitoring of adherence to measurement protocols during data collection are essential to ensure consistency and to minimise systematic error in multicentre studies. Strict ultrasound fetal biometric measurement protocols are used in the INTERGROWTH-21(st) Project so that data of the highest quality from different centres can be compared and potentially pooled. A central Ultrasound Quality Unit (USQU) has been set up to oversee this process. After initial training and standardisation, the USQU monitors the performance of all ultrasonographers involved in the project by continuously assessing the quality of the images and the consistency of the measurements produced. Ultrasonographers are identified when they exceed preset maximum allowable differences. Corrective action is then taken in the form of retraining or simply advice regarding changes in practice. This paper describes the procedures used, which can form a model for research settings involving ultrasound measurements.

Systematic review of methodology used in ultrasound studies aimed at creating charts of fetal size

BACKGROUND

Reliable ultrasound charts are necessary for the prenatal assessment of fetal size, yet there is a wide variation of methodologies for the creation of such charts.

OBJECTIVE

To evaluate the methodological quality of studies of fetal biometry using a set of predefined quality criteria of study design, statistical analysis and reporting methods.

SEARCH STRATEGY

Electronic searches in MEDLINE, EMBASE and CINAHL, and references of retrieved articles.

SELECTION CRITERIA

Observational studies whose primary aim was to create ultrasound size charts for bi-parietal diameter, head circumference, abdominal circumference and femur length in fetuses from singleton pregnancies.

DATA COLLECTION AND ANALYSIS

Studies were scored against a predefined set of independently agreed methodological criteria and an overall quality score was given to each study. Multiple regression analysis between quality scores and study characteristics was performed.

MAIN RESULTS

Eighty-three studies met the inclusion criteria. The highest potential for bias was noted in the following fields: 'Inclusion/exclusion criteria', as none of the studies defined a rigorous set of antenatal or fetal conditions which should be excluded from analysis; 'Ultrasound quality control measures', as no study demonstrated a comprehensive quality assurance strategy; and 'Sample size calculation', which was apparent in six studies only. On multiple regression analysis, there was a positive correlation between quality scores and year of publication: quality has improved with time, yet considerable heterogeneity in study methodology is still observed today.

CONCLUSIONS

There is considerable methodological heterogeneity in studies of fetal biometry. Standardisation of methodologies is necessary in order to make correct interpretations and comparisons between different charts. A checklist of recommended methodologies is proposed.