Systematic approach to a channelized Hotelling model observer implementation for a physical phantom containing mass-like lesions: Application to digital breast tomosynthesis

A strategy for achieving optimisation of radiological protection in digital radiology proposed by ICRP

Radiology is now predominantly a digital medium and this has extended the flexibility, efficiency and application of medical imaging. Achieving the full benefit of digital radiology requires images to be of sufficient quality to make a reliable diagnosis for each patient, while minimising risks from radiation exposure, and so involves a careful balance between competing objectives. When an optimisation programme is undertaken, a knowledge of patient doses from surveys can be valuable in identifying areas needing attention. However, any dose reduction measures must not degrade image quality to the extent that it is inadequate for the clinical purpose. The move to digital imaging has enabled versatile image acquisition and presentation, including multi-modality display and quantitative assessment, with post-processing options that adjust for optimal viewing. This means that the appearance of an image is unlikely to give any indication when the dose is higher than necessary. Moreover, options to improve performance of imaging equipment add to its complexity, so operators require extensive training to be able to achieve this. Optimisation is a continuous rather than single stage process that requires regular monitoring, review, and analysis of performance feeding into improvement and development of imaging protocols. The ICRP is in the process of publishing two reports about optimisation in digital radiology. The first report sets out components needed to ensure that a radiology service can carry optimisation through. It describes how imaging professionals should work together as a team and explains the benefits of having appropriate methodologies to monitor performance, together with the knowledge and expertise required to use them effectively. It emphasises the need for development of organisational processes that ensure tasks are carried out. The second ICRP report deals with practical requirements for optimisation of different digital radiology modalities, and builds on information provided in earlier modality specific ICRP publications.

Model-based deep CNN-regularized reconstruction for digital breast tomosynthesis with a task-based CNN image assessment approach

Objective. Digital breast tomosynthesis (DBT) is a quasi-three-dimensional breast imaging modality that improves breast cancer screening and diagnosis because it reduces fibroglandular tissue overlap compared with 2D mammography. However, DBT suffers from noise and blur problems that can lower the detectability of subtle signs of cancers such as microcalcifications (MCs). Our goal is to improve the image quality of DBT in terms of image noise and MC conspicuity.Approach. We proposed a model-based deep convolutional neural network (deep CNN or DCNN) regularized reconstruction (MDR) for DBT. It combined a model-based iterative reconstruction (MBIR) method that models the detector blur and correlated noise of the DBT system and the learning-based DCNN denoiser using the regularization-by-denoising framework. To facilitate the task-based image quality assessment, we also proposed two DCNN tools for image evaluation: a noise estimator (CNN-NE) trained to estimate the root-mean-square (RMS) noise of the images, and an MC classifier (CNN-MC) as a DCNN model observer to evaluate the detectability of clustered MCs in human subject DBTs.Main results. We demonstrated the efficacies of CNN-NE and CNN-MC on a set of physical phantom DBTs. The MDR method achieved low RMS noise and the highest detection area under the receiver operating characteristic curve (AUC) rankings evaluated by CNN-NE and CNN-MC among the reconstruction methods studied on an independent test set of human subject DBTs.Significance. The CNN-NE and CNN-MC may serve as a cost-effective surrogate for human observers to provide task-specific metrics for image quality comparisons. The proposed reconstruction method shows the promise of combining physics-based MBIR and learning-based DCNNs for DBT image reconstruction, which may potentially lead to lower dose and higher sensitivity and specificity for MC detection in breast cancer screening and diagnosis.

Technical note: Realization and uncertainty analysis for an adjustable 3D structured breast phantom in digital breast tomosynthesis

BACKGROUND

Projection imaging phantoms are often optimized for 2-dimensional image characteristics in homogeneous backgrounds. Therefore, evaluation of image quality in tomosynthesis (DBT) lacks accepted and established phantoms.

PURPOSE

We describe a 3D breast phantom with a structured, variable background. The phantom is an adaptable and advanced version of the L1 phantom by Cockmartin et al. Phantom design and its use for quality assurance measurements for DBT devices are described. Four phantoms were compared to assess the objectivity.

METHODS

The container size was increased to a diameter of 24 cm and a total height of 53.5 mm. Spiculated masses were replaced by five additional non-spiculated masses for higher granularity in threshold diameter resolution. These patterns are adjustable to the imaging device. The masses were printed in one session with a base layer using two-component 3D printing. New materials compared to the L1 phantom improved the attenuation difference between the lesion models and the background. Four phantoms were built and intra-human observer, inter-human observer and inter-phantom variations were determined. The latter assess the reproducibility of the phantom production. Coefficients of variance (V) were calculated for all three variations.

RESULTS

The difference of the attenuation coefficients between the lesion models and the background was 0.20 cm-1 (with W/Al at 32 kV, equivalent to 19-20 keV effective energy) compared to 0.21 cm-1 for 50/50 glandular/adipose breast tissue and cancerous lesions. PMMA equivalent thickness of the phantom was 47.0 mm for the Siemens Mammomat Revelation. For the masses, theV i n t r a $V_{intra}$ for the intra-observer variation was 0.248, the averaged inter-observer variation,V ¯ i n t e r $\overline{V}_{inter}$ was 0.383.V p h a n t o m $V_{phantom}$ for phantom variance was 0.321. For the micro-calcifications,V i n t r a $V_{intra}$ was 0.0429,V ¯ i n t e r = $\overline{V}_{inter}=$ 0.0731 andV p h a n t o m = $V_{phantom}=$ 0.0759.

CONCLUSIONS

Position, orientation and shape of the masses are reproducible and attenuation differences appropriate. The phantom presented proved to be a candidate test object for quality control.

Performance evaluation of digital breast tomosynthesis systems: physical methods and experimental data

Digital breast tomosynthesis (DBT) has become a well-established breast imaging technique, whose performance has been investigated in many clinical studies, including a number of prospective clinical trials. Results from these studies generally point to non-inferiority in terms of microcalcification detection and superior mass-lesion detection for DBT imaging compared to digital mammography (DM). This modality has become an essential tool in the clinic for assessment and ad-hoc screening but is not yet implemented in most breast screening programmes at a state or national level. While evidence on the clinical utility of DBT has been accumulating, there has also been progress in the development of methods for technical performance assessment and quality control of these imaging systems. DBT is a relatively complicated ‘pseudo-3D’ modality whose technical assessment poses a number of difficulties. This paper reviews methods for the technical performance assessment of DBT devices, starting at the component level in part one and leading up to discussion of system evaluation with physical test objects in part two. We provide some historical and basic theoretical perspective, often starting from methods developed for DM imaging. Data from a multi-vendor comparison are also included, acquired under the medical physics quality control protocol developed by EUREF and currently being consolidated by a European Federation of Organisations for Medical Physics working group. These data and associated methods can serve as a reference for the development of reference data and provide some context for clinical studies.

PERFORMANCE COMPARISON OF SYSTEMS WITH FULL-FIELD DIGITAL MAMMOGRAPHY, DIGITAL BREAST TOMOSYNTHESIS AND CONTRAST-ENHANCED SPECTRAL MAMMOGRAPHY

The purpose is to compare full-field digital mammography (FFDM), digital breast tomosynthesis (DBT) and contrast-enhanced spectral mammography (CESM) technologies on three mammography systems in terms of image quality and patient dose. Two Senographe Essential with DBT and CESM (denoted S1 and S2) and one Selenia Dimensions (S3) with FFDM and DBT were considered. Dosimetry methods recommended in the European protocol were used. Image quality was tested with CDMAM in FFDM and DBT and with ideal observer method in FFDM. Mean values of mean glandular dose (MGD) from whole patient samples on S1, S2 and S3 were as follows: FFDM 1.65, 1.84 and 2.23 mGy; DBT 2.03, 1.96 and 2.87 mGy; CESM 2.65 and 3.16 mGy, respectively. S3 exhibited better low-contrast detectability for the smallest sized discs of CDMAM and ideal observer in FFDM, and for the largest sized discs in DBT, at similar dose levels.

The regression detectability index RDI for mammography images of breast phantoms with calcification-like objects and anatomical background

Currently, quality assurance measurements in mammography are performed on unprocessed images. For diagnosis, however, radiologists are provided with processed images. This image processing is optimised for images of human anatomy and therefore does not always perform satisfactorily with technical phantoms. To overcome this problem, it may be possible to use anthropomorphic phantoms reflecting the anatomic structure of the human breast in place of technical phantoms when carrying out task-specific quality assessment using model observers. However, the use of model observers is hampered by the fact that a large number of images needs to be acquired. A recently published novel observer called the regression detectability index (RDI) needs significantly fewer images, but requires the background of the images to be flat. Therefore, to be able to apply the RDI to images of anthropomorphic phantoms, the anatomic background needs to be removed. For this, a procedure in which the anatomical structures are fitted by thin plate spline (TPS) interpolation has been developed. When the object to be detected is small, such as a calcification-like lesion, it is shown that the anatomic background can be removed successfully by subtracting the TPS interpolation, which makes the background-free image accessible to the RDI. We have compared the detectability obtained by the RDI with TPS background subtraction to results of the channelized Hotelling observer (CHO) and human observers. With the RDI, results for the detectabilityd'can be obtained using 75% fewer images compared to the CHO, while the same uncertainty ofd'is achieved. Furthermore, the correlation ofd'(RDI) with the results of human observers is at least as good as that ofd'(CHO) with human observers.

On the relevance of modulation transfer function measurements in digital mammography quality control

Purpose: The relevance of presampling modulation transfer function (MTF) measurements in digital mammography (DM) quality control (QC) is examined. Two studies are presented: a case study on the impact of a reduction in MTF on the technical image quality score and analysis of the robustness of routine QC MTF measurements. Approach: In the first study, two needle computed radiography (CR) plates with identical sensitivities were used with differences in the 50% point of the MTF ( f MTF 0.5 ) larger than the limiting value in the European guidelines ( > 10 % change between successive measurements). Technical image quality was assessed via threshold gold thickness of the CDMAM phantom and threshold microcalcification diameter of the L1 structured phantom. For the second study, presampling MTF results from 595 half-yearly QC tests of 55 DM systems (16 types, six manufacturers) were analyzed for changes from the baseline value and changes in f MTF 0.5 between successive tests. Results: A reduction of 20% in f MTF 0.5 of the two CR plates was observed. There was a tendency to a lower score for task-based metrics, but none were significant. Averaging over 55 systems, the absolute relative change in f MTF 0.5 between consecutive tests (with 95% confidence interval) was 3% (2.5% to 3.4%). Analysis of the maximum relative change from baseline revealed changes of up to - 10 % for one a-Se based system and - 15 % for a group of CsI-based systems. Conclusions: A limit of 10% is a relevant action level for investigation. If exceeded, then the impact on performance has to be verified with extra metrics.

Human observer performance on in-plane digital breast tomosynthesis images: Effects of reconstruction filters and data acquisition angles on signal detection

For digital breast tomosynthesis (DBT) systems, we investigate the effects of the reconstruction filters for different data acquisition angles on signal detection. We simulated a breast phantom with a 30% volume glandular fraction (VGF) of breast anatomy using the power law spectrum and modeled the breast mass as a spherical object with a 1 mm diameter. Projection data were acquired using two different data acquisition angles and numbers of projection view pairs, and in-plane breast images were reconstructed using the Feldkamp-Davis-Kress (FDK) algorithm with three different reconstruction filter schemes. To measure the ability to detect a signal, we conducted the human observer study with a binary detection task and compared the signal detectability of human to that of channelized Hotelling observer (CHO) with Laguerre-Gauss (LG) channels and dense difference-of-Gaussian (D-DOG) channels. We also measured the contrast-to-noise ratio (CNR), signal power spectrum (SPS), and β values of the anatomical noise power spectrum (NPS) to show the association between human observer performance and these traditional metrics. Our results show that using a slice thickness (ST) filter degraded the signal detection performance of human observers at the same data acquisition angle. This could be predicted by D-DOG CHO with internal noise, but the correlation between the traditional metrics and signal detectability was not observed in this work.

Model and human observer reproducibility for detection of microcalcification clusters in digital breast tomosynthesis images of three-dimensionally structured test object

We compare the reproducibility of the human observers and a channelized Hotelling observer (CHO), when reading digital breast tomosynthesis (DBT) images of a physical phantom containing a breast simulating structured background and calcification clusters at three dose levels. The phantom is scanned 217 times on a Siemens Inspiration DBT system. Volumes of interest, with and without the calcification targets, are extracted and the human observers' percentage of correct (PC) scores is evaluated using a four-alternative forced choice method. A two-layer CHO is developed using the human observer results. The first layer consists of a localizing CHO that identifies the most conspicuous calcifications using two Laguerre-Gauss channels. Then a CHO with eight Gabor channels estimates the PC score for the calcification cluster. Observer reproducibility is estimated by bootstrapping, and the standard deviation (SD) is used as a figure of merit. The CHO closely approximated the human observer results for all the three dose levels with a correlation of > 0.97 . For the larger calcification cluster sizes, both observers have similar reproducibility, whereas the CHO is more reproducible for the smaller calcifications, with a maximum of 5.5 SD against 13.1 SD for the human observers. The developed CHO is a good candidate for automated reading of the calcification clusters of the structured phantom, with better reproducibility than the human readers for small calcifications.