Design and application of a structured phantom for detection performance comparison between breast tomosynthesis and digital mammography

Tailoring the Mass Density of 3D Printing Materials for Accurate X-ray Imaging Simulation by Controlled Underfilling for Radiographic Phantoms

Additive manufacturing and 3D printing allow for the design and rapid production of radiographic phantoms for X-ray imaging, including CT. These are used for numerous purposes, such as patient simulation, optimization of imaging procedures and dose levels, system evaluation and quality assurance. However, standard 3D printing polymers do not mimic X-ray attenuation properties of tissues like soft, adipose, lung or bone tissue, and standard materials like liquid water. The mass density of printing polymers-especially important in CT-is often inappropriate, i.e., mostly too high. Different methods can be applied to reduce mass density. This work examines reducing density by controlled underfilling either realized by using 3D printing materials expanded through foaming during heating in the printing process, or reducing polymer flow to introduce microscopic air-filled voids. The achievable density reduction depends on the base polymer used. When using foaming materials, density is controlled by the extrusion temperature, and ranges from 33 to 47% of the base polymer used, corresponding to a range of -650 to -394 HU in CT with 120 kV. Standard filaments (Nylon, modified PLA and modified ABS) allowed density reductions by 20 to 25%, covering HU values in CT from -260 to 77 (Nylon), -230 to -20 (ABS) and -81 to 143 (PLA). A standard chalk-filled PLA filament allowed reproduction of bone tissue in a wide range of bone mineral content resulting in CT numbers from 57 to 460 HU. Controlled underfilling allowed the production of radiographic phantom materials with continuously adjustable attenuation in a limited but appropriate range, allowing for the reproduction of X-ray attenuation properties of water, adipose, soft, lung, and bone tissue in an accurate, predictable and reproducible manner.

A spiculated mass target model for clinical image quality control in digital mammography

OBJECTIVES

Quality assurance of breast imaging has a long history of using test objects to optimize and follow up imaging devices. In particular, the evaluation of new techniques benefits from suitable test objects. The applicability of a phantom consisting of spiculated masses to assess image quality and its dependence on dose in flat field digital mammography (FFDM) and digital breast tomosynthesis systems (DBT) is investigated.

METHODS

Two spiculated masses in five different sizes each were created from a database of clinical tumour models. The masses were produced using 3D printing and embedded into a cuboid phantom. Image quality is determined by the number of spicules identified by human observers.

RESULTS

The results suggest that the effect of dose on spicule detection is limited especially in cases with smaller objects and probably hidden by the inter-reader variability. Here, an average relative inter-reader variation of the counted number of 31% was found (maximum 83%). The mean relative intra-reader variability was found to be 17%. In DBT, sufficiently good results were obtained only for the largest masses.

CONCLUSIONS

It is possible to integrate spiculated masses into a cuboid phantom. It is easy to print and should allow a direct and prompt evaluation of the quality status of the device by counting visible spicules. Human readout presented the major uncertainty in this study, indicating that automated readout may improve the reproducibility and consistency of the results considerably.

ADVANCES IN KNOWLEDGE

A cuboid phantom including clinical objects as spiculated lesion models for visual assessing the image quality in FFDM and DBT was developed and is introduced in this work. The evaluation of image quality works best with the two larger masses with 21 spicules.

Task-based detectability in anatomical background in digital mammography, digital breast tomosynthesis and synthetic mammography

Objective.Determining the detectability of targets for the different imaging modalities in mammography in the presence of anatomical background noise is challenging. This work proposes a method to compare the image quality and detectability of targets in digital mammography (DM), digital breast tomosynthesis (DBT) and synthetic mammography.Approach. The low-frequency structured noise produced by a water phantom with acrylic spheres was used to simulate anatomical background noise for the different types of images. A method was developed to apply the non-prewhitening observer model with eye filter (NPWE) in these conditions. A homogeneous poly(methyl) methacrylate phantom with a 0.2 mm thick aluminium disc was used to calculate 2D in-plane modulation transfer function (MTF), noise power spectrum (NPS), noise equivalent quanta, and system detective quantum efficiency for 30, 50 and 70 mm thicknesses. The in-depth MTFs of DBT volumes were determined using a thin tungsten wire. The MTF, system NPS and anatomical NPS were used in the NPWE model to calculate the threshold gold thickness of the gold discs contained in the CDMAM phantom, which was taken as reference. Main results.The correspondence between the NPWE model and the CDMAM phantom (linear Pearson correlation 0.980) yielded a threshold detectability index that was used to determine the threshold diameter of spherical microcalcifications and masses. DBT imaging improved the detection of masses, which depended mostly on the reduction of anatomical background noise. Conversely, DM images yielded the best detection of microcalcifications.Significance.The method presented in this study was able to quantify image quality and object detectability for the different imaging modalities and levels of anatomical background noise.

Power-law spectrum-based objective function to train a generative adversarial network with transfer learning for the synthetic breast CT image

Objective.This paper proposes a new objective function to improve the quality of synthesized breast CT images generated by the GAN and compares the GAN performances on transfer learning datasets from different image domains.Approach.The proposed objective function, named beta loss function, is based on the fact that x-ray-based breast images follow the power-law spectrum. Accordingly, the exponent of the power-law spectrum (beta value) for breast CT images is approximately two. The beta loss function is defined in terms of L1 distance between the beta value of synthetic images and validation samples. To compare the GAN performances for transfer learning datasets from different image domains, ImageNet and anatomical noise images are used in the transfer learning dataset. We employ styleGAN2 as the backbone network and add the proposed beta loss function. The patient-derived breast CT dataset is used as the training and validation dataset; 7355 and 212 images are used for network training and validation, respectively. We use the beta value evaluation and Fréchet inception distance (FID) score for quantitative evaluation.Main results.For qualitative assessment, we attempt to replicate the images from the validation dataset using the trained GAN. Our results show that the proposed beta loss function achieves a more similar beta value to real images and a lower FID score. Moreover, we observe that the GAN pretrained with anatomical noise images achieves better equality than ImageNet for beta value evaluation and FID score. Finally, the beta loss function with anatomical noise as the transfer learning dataset achieves the lowest FID score.Significance.Overall, the GAN using the proposed beta loss function with anatomical noise images as the transfer learning dataset provides the lowest FID score among all tested cases. Hence, this work has implications for developing GAN-based breast image synthesis methods for medical imaging applications.

A cadaveric breast cancer tissue phantom for phase-contrast X-ray imaging applications

BACKGROUND

As mammography X-ray imaging technologies advance and provide elevated contrast in soft tissues, a need has developed for reliable imaging phantoms for use in system design and component calibration. In advanced imaging modalities such as refraction-based methods, it is critical that developed phantoms capture the biological details seen in clinical precancerous and cancerous cases while minimizing artifacts that may be caused due to phantom production. This work presents the fabrication of a breast tissue imaging phantom from cadaveric breast tissue suitable for use in both transmission and refraction-enhanced imaging systems.

METHODS

Human cancer cell tumors were grown orthotopically in nude athymic mice and implanted into the fixed tissue while maintaining the native tumor/adipose tissue interface.

RESULTS

The resulting human-murine tissue hybrid phantom was mounted on a clear acrylic housing for absorption and refraction X-ray imaging. Digital breast tomosynthesis was also performed.

CONCLUSION

Both attenuation-based imaging and refraction-based imaging of the phantom are presented to confirm the suitability of this phantom's use in both imaging modalities.

Technical note: Realization and uncertainty analysis for an adjustable 3D structured breast phantom in digital breast tomosynthesis

BACKGROUND

Projection imaging phantoms are often optimized for 2-dimensional image characteristics in homogeneous backgrounds. Therefore, evaluation of image quality in tomosynthesis (DBT) lacks accepted and established phantoms.

PURPOSE

We describe a 3D breast phantom with a structured, variable background. The phantom is an adaptable and advanced version of the L1 phantom by Cockmartin et al. Phantom design and its use for quality assurance measurements for DBT devices are described. Four phantoms were compared to assess the objectivity.

METHODS

The container size was increased to a diameter of 24 cm and a total height of 53.5 mm. Spiculated masses were replaced by five additional non-spiculated masses for higher granularity in threshold diameter resolution. These patterns are adjustable to the imaging device. The masses were printed in one session with a base layer using two-component 3D printing. New materials compared to the L1 phantom improved the attenuation difference between the lesion models and the background. Four phantoms were built and intra-human observer, inter-human observer and inter-phantom variations were determined. The latter assess the reproducibility of the phantom production. Coefficients of variance (V) were calculated for all three variations.

RESULTS

The difference of the attenuation coefficients between the lesion models and the background was 0.20 cm-1 (with W/Al at 32 kV, equivalent to 19-20 keV effective energy) compared to 0.21 cm-1 for 50/50 glandular/adipose breast tissue and cancerous lesions. PMMA equivalent thickness of the phantom was 47.0 mm for the Siemens Mammomat Revelation. For the masses, theV i n t r a $V_{intra}$ for the intra-observer variation was 0.248, the averaged inter-observer variation,V ¯ i n t e r $\overline{V}_{inter}$ was 0.383.V p h a n t o m $V_{phantom}$ for phantom variance was 0.321. For the micro-calcifications,V i n t r a $V_{intra}$ was 0.0429,V ¯ i n t e r = $\overline{V}_{inter}=$ 0.0731 andV p h a n t o m = $V_{phantom}=$ 0.0759.

CONCLUSIONS

Position, orientation and shape of the masses are reproducible and attenuation differences appropriate. The phantom presented proved to be a candidate test object for quality control.

A Novel Method to Model Image Creation Based on Mammographic Sensors Performance Parameters: A Theoretical Study

BACKGROUND

Mammographic digital imaging is based on X-ray sensors with solid image quality characteristics. These primarily include (a) a response curve that yields high contrast and image latitude, (b) a frequency response given by the Modulation Transfer Function (MTF), which enables small detail imaging and (c) the Normalize Noise Power Spectrum (NNPS) that shows the extent of the noise effect on image clarity.

METHODS

In this work, a methodological approach is introduced and described for creating digital phantom images based on the measured image quality properties of the sensor. For this purpose, a mathematical phantom, simulating breast tissue and lesions of blood, adipose, muscle, Ca and Ca(50%)-P(50%) was created by considering the corresponding X-ray attenuation coefficients. The simulated irradiation conditions of the phantom used four mammographic spectra assuming exponential attenuation. Published data regarding noise and blur of a commercial RadEye HR CMOS imaging sensor were used as input data for the resulting images.

RESULTS

It was found that the Ca and Ca(50%)-P(50%) lesions were visible in all exposure conditions. In addition, the W/Rh spectrum at 28 kVp provided more detailed images than the corresponding Mo/Mo spectrum.

CONCLUSIONS

The presented methodology can act complementarily to image quality measurements, leading to initial optimization of the X-ray exposure parameters per clinical condition.

Performance evaluation of digital breast tomosynthesis systems: physical methods and experimental data

Digital breast tomosynthesis (DBT) has become a well-established breast imaging technique, whose performance has been investigated in many clinical studies, including a number of prospective clinical trials. Results from these studies generally point to non-inferiority in terms of microcalcification detection and superior mass-lesion detection for DBT imaging compared to digital mammography (DM). This modality has become an essential tool in the clinic for assessment and ad-hoc screening but is not yet implemented in most breast screening programmes at a state or national level. While evidence on the clinical utility of DBT has been accumulating, there has also been progress in the development of methods for technical performance assessment and quality control of these imaging systems. DBT is a relatively complicated ‘pseudo-3D’ modality whose technical assessment poses a number of difficulties. This paper reviews methods for the technical performance assessment of DBT devices, starting at the component level in part one and leading up to discussion of system evaluation with physical test objects in part two. We provide some historical and basic theoretical perspective, often starting from methods developed for DM imaging. Data from a multi-vendor comparison are also included, acquired under the medical physics quality control protocol developed by EUREF and currently being consolidated by a European Federation of Organisations for Medical Physics working group. These data and associated methods can serve as a reference for the development of reference data and provide some context for clinical studies.

X-ray attenuation of bone, soft and adipose tissue in CT from 70 to 140 kV and comparison with 3D printable additive manufacturing materials

Additive manufacturing and 3D printing are widely used in medical imaging to produce phantoms for image quality optimization, imaging protocol definition, comparison of image quality between different imaging systems, dosimetry, and quality control. Anthropomorphic phantoms mimic tissues and contrasts in real patients with regard to X-ray attenuation, as well as dependence on X-ray spectra. If used with different X-ray energies, or to optimize the spectrum for a certain procedure, the energy dependence of the attenuation must replicate the corresponding energy dependence of the tissues mimicked, or at least be similar. In the latter case the materials’ Hounsfield values need to be known exactly to allow to correct contrast and contrast to noise ratios accordingly for different beam energies. Fresh bovine and porcine tissues including soft and adipose tissues, and hard tissues from soft spongious bone to cortical bone were scanned at different energies, and reference values of attenuation in Hounsfield units (HU) determined. Mathematical model equations describing CT number dependence on kV for bones of arbitrary density, and for adipose tissues are derived. These data can be used to select appropriate phantom constituents, compare CT values with arbitrary phantom materials, and calculate correction factors for phantoms consisting of materials with an energy dependence different to the tissues. Using data on a wide number of additive manufacturing and 3D printing materials, CT numbers and their energy dependence were compared to those of the tissues. Two commercially available printing filaments containing calcium carbonate powder imitate bone tissues with high accuracy at all kV values. Average adipose tissue can be duplicated by several off-the-shelf printing polymers. Since suitable printing materials typically exhibit a too high density for the desired attenuation of especially soft tissues, controlled density reduction by underfilling might improve tissue equivalence.

Classification of X-Ray Attenuation Properties of Additive Manufacturing and 3D Printing Materials Using Computed Tomography From 70 to 140 kVp

Additive manufacturing and 3D printing is particularly useful in the production of phantoms for medical imaging applications including determination and optimization of (diagnostic) image quality and dosimetry. Additive manufacturing allows the leap from simple slab and stylized to (pseudo)-anthropomorphic phantoms. This necessitates the use of materials with x-ray attenuation as close as possible to that of the tissues or organs mimicked. X-ray attenuation properties including their energy dependence were determined for 35 printing materials comprising photocured resins and thermoplastic polymers. Prior to measuring x-ray attenuation in CT from 70 to 140 kVp, printing parameters were thoroughly optimized to ensure maximum density avoiding too low attenuation due to microscopic or macroscopic voids. These optimized parameters are made available. CT scanning was performed in a water filled phantom to guarantee defined scan conditions and accurate HU value determination. The spectrum of HU values covered by polymers printed using fused deposition modeling reached from −258 to +1,063 at 120 kVp (−197 to +1,804 at 70 kVp, to −266 to +985 at 140 kVp, respectively). Photocured resins covered 43 to 175 HU at 120 kVp (16–156 at 70, and 57–178 at 140 kVp). At 120 kVp, ASA mimics water almost perfectly (+2 HU). HIPS (−40 HU) is found close to adipose tissue. In all photocurable resins, and 17 printing filaments HU values decreased with increasing beam hardness contrary to soft tissues except adipose tissue making it difficult to mimic water or average soft tissue in phantoms correctly over a range of energies with one single printing material. Filled filaments provided both, the HU range, and an appropriate energy dependence mimicking bone tissues. A filled material with almost constant HU values was identified potentially allowing mimicking soft tissues by reducing density using controlled under-filling. The measurements performed in this study can be used to design phantoms with a wide range of x-ray contrasts, and energy dependence of these contrasts by combining appropriate materials. Data provided on the energy dependence can also be used to correct contrast or contrast to noise ratios from phantom measurements to real tissue contrasts or CNRs.

Effect of glandularity on the detection of simulated cancers in planar, tomosynthesis, and synthetic 2D imaging of the breast using a hybrid virtual clinical trial

PURPOSE

The purpose of this study was to measure the threshold diameter of calcifications and masses for 2D imaging, digital breast tomosynthesis (DBT), and synthetic 2D images, for a range of breast glandularities. This study shows the limits of detection for each of the technologies and the strengths and weaknesses of each in terms of visualizing the radiological features of small cancers.

METHODS

Mathematical voxel breast phantoms with glandularities by volume of 9%, 18%, and 30% with a thickness of 53 mm were created. Simulated ill-defined masses and calcification clusters with a range of diameters were inserted into some of these breast models. The imaging characteristics of a Siemens Inspiration X-ray system were measured for a 29 kV, tungsten/rhodium anode/filter combination. Ray tracing through the breast models was undertaken to create simulated 2D and DBT projection images. These were then modified to adjust the image sharpness, and to add scatter and noise. The mean glandular doses for the images were 1.43, 1.47, and 1.47 mGy for 2D and 1.92, 1.97, and 1.98 mGy for DBT for the three glandularities. The resultant images were processed to create 2D, DBT planes and synthetic 2D images. Patches of the images with or without a simulated lesion were extracted, and used in a four-alternative forced choice study to measure the threshold diameters for each imaging mode, lesion type, and glandularity. The study was undertaken by six physicists.

RESULTS

The threshold diameters of the lesions were 6.2, 4.9, and 6.7 mm (masses) and 225, 370, and 399 μm, (calcifications) for 2D, DBT, and synthetic 2D, respectively, for a breast glandularity of 18%. The threshold diameter of ill-defined masses is significantly smaller for DBT than for both 2D (p≤0.006) and synthetic 2D (p≤0.012) for all glandularities. Glandularity has a significant effect on the threshold diameter of masses, even for DBT where there is reduced background structure in the images. The calcification threshold diameters for 2D images were significantly smaller than for DBT and synthetic 2D for all glandularities. There were few significant differences for the threshold diameter of calcifications between glandularities, indicating that the background structure has little effect on the detection of calcifications. We measured larger but nonsignificant differences in the threshold diameters for synthetic 2D imaging than for 2D imaging for masses in the 9% (p = 0.059) and 18% (p = 0.19) glandularities. The threshold diameters for synthetic 2D imaging were larger than for 2D imaging for calcifications (p < 0.001) for all glandularities.

CONCLUSIONS

We have shown that glandularity has only a small effect on the detection of calcifications, but the threshold diameter of masses was significantly larger for higher glandularity for all of the modalities tested. We measured nonsignificantly larger threshold diameters for synthetic 2D imaging than for 2D imaging for masses at the 9% (p = 0.059) and 18% (p = 0.19) glandularities and significantly larger diameters for calcifications (p < 0.001) for all glandularities. The lesions simulated were very subtle and further work is required to examine the clinical effect of not seeing the smallest calcifications in clusters.

The impact on lesion detection via a multi-vendor study: A phantom-based comparison of digital mammography, digital breast tomosynthesis, and synthetic mammography

PURPOSE

The aim of this study is to perform a test object-based comparison of the imaging performance of digital mammography (DM), digital breast tomosynthesis (DBT), and synthetic mammography (SM).

METHODS

Two test objects were used, the CDMAM and the L1-structured phantom. Small-detail detectability was assessed using CDMAM and the microcalcification simulating specks in the L1-structured background. Detection of spiculated and non-spiculated mass-like objects was assessed using the L1 phantom. Six different systems were included: Amulet Innovality (Fujifilm), Senographe Pristina (GEHC), 3Dimensions (Hologic), Giotto Class (IMS), Clarity 2D/3D (Planmed), and Mammomat Revelation (Siemens). Images were acquired under automatic exposure control (AEC) and at adjusted levels of AEC/2 and 2 × AEC level. Threshold gold thickness (T_tr ) was established for the 0.13-mm-diameter CDMAM discs. Threshold diameters for the calcifications (d_{tr_c} ), the spiculated masses (d_{tr_sm} ), and for the non-spiculated masses (d_{tr_nsm} ) were established. The threshold condition was defined as the thickness or diameter for a 62.5% correct score.

RESULTS

T_tr for DM was generally superior to DBT, which in turn was superior to SM, but for most systems, these differences between modes were not significant. For L1, no significant differences in d_{tr_c} were found between DM and DBT. The increase in d_{tr_c} from DM to SM at AEC dose was 1%, 19%, 11%, 14%, 46%, and 27% for the Fujifilm, GEHC, Hologic, IMS, Planmed, and Siemens, respectively, indicating significantly poorer performance for all vendors except for Fujifilm, Hologic, and IMS. For both mass types, DBT performed better than SM, while SM showed no significant difference with DM (except for Fujifilm spiculated masses). The dose had an impact on small-detail detectability for both phantoms but did not influence the detection of either mass type.

CONCLUSIONS

Both phantoms indicated potentially reduced small-detail detectability for SM versus DM and DBT and should therefore not be used in stand-alone mode. The L1 phantom demonstrated no significant difference in microcalcification detection between DM and DBT and also demonstrated the superiority of DBT, compared to DM for mass detection, for all six systems.

[Assessment of imaging performance of digital breast tomosynthesis based on systematic simulation]

OBJECTIVE

To assess the imaging performance of digital breast tomography (DBT) based on systematic simulation.

OBJECTIVE

The raw measurements of physical phantoms at a variety of radiation dose levels and clinical patients at the normal radiation dose were acquired from a clinical DBT system for low-dose simulation and reconstruction using 3 reconstruction algorithms, namely Feldkamp-Davis-Kress (FDK), simultaneous algebraic reconstruction technique (SART) and adaptive steepest-descent projection onto convex sets with total-variation constraint (ASDPOCS-TV) algorithms. The image quality was compared across different radiation dose levels and reconstruction algorithms in terms of signal-to-noise ratio (SNR), peak signal-to-noise ratio (PSNR), noise-power spectrum (NPS), artifact spread function (ASF) and full width at half maximum (FWHM) of ASF indexes.

OBJECTIVE

The reliability of low-dose DBT simulation strategy was verified by the experiment. Within a suitable range of dose levels, increasing the doses resulted in reduced high-frequency noise component and significantly increased SNR (P < 0.05). But when the value of exposure was below 40 mAs, the images acquired at different dose levels had similar representation. The performance of the 3 reconstruction algorithms varied for different anatomical structures, and the image quality of ASDPOCS-TV algorithm was generally superior to SART and FDK algorithms with less through-plane artifacts and noise.

OBJECTIVE

The quality of DBT images is significantly affected by both radiation dose and reconstruction algorithms. A tradeoff of the parameters, the overall image quality and the clinical needs for diagnostic purposes should be considered to achieve the optimal imaging performance on a given clinical task.

On the relevance of modulation transfer function measurements in digital mammography quality control

Purpose: The relevance of presampling modulation transfer function (MTF) measurements in digital mammography (DM) quality control (QC) is examined. Two studies are presented: a case study on the impact of a reduction in MTF on the technical image quality score and analysis of the robustness of routine QC MTF measurements. Approach: In the first study, two needle computed radiography (CR) plates with identical sensitivities were used with differences in the 50% point of the MTF ( f MTF 0.5 ) larger than the limiting value in the European guidelines ( > 10 % change between successive measurements). Technical image quality was assessed via threshold gold thickness of the CDMAM phantom and threshold microcalcification diameter of the L1 structured phantom. For the second study, presampling MTF results from 595 half-yearly QC tests of 55 DM systems (16 types, six manufacturers) were analyzed for changes from the baseline value and changes in f MTF 0.5 between successive tests. Results: A reduction of 20% in f MTF 0.5 of the two CR plates was observed. There was a tendency to a lower score for task-based metrics, but none were significant. Averaging over 55 systems, the absolute relative change in f MTF 0.5 between consecutive tests (with 95% confidence interval) was 3% (2.5% to 3.4%). Analysis of the maximum relative change from baseline revealed changes of up to - 10 % for one a-Se based system and - 15 % for a group of CsI-based systems. Conclusions: A limit of 10% is a relevant action level for investigation. If exceeded, then the impact on performance has to be verified with extra metrics.

Rapid measurement of the low contrast detectability of CT scanners

PURPOSE

Low contrast detectability (LCD) is a metric of fundamental importance in computed tomography (CT) imaging. In spite of this, its measurement is challenging in the context of nonlinear data processing. We introduce a new framework for objectively characterizing LCD with a single scan of a special-purpose phantom and automated analysis software. The output of the analysis software is a "machine LCD" metric which is more representative of LCD than contrast-noise ratio (CNR). It is not intended to replace human observer or model observer studies.

METHODS

Following preliminary simulations, we fabricated a phantom containing hundreds of low-contrast beads. These beads are acrylic spheres (1.6 mm, net contrast ~10 HU) suspended and randomly dispersed in a background matrix of nylon pellets and isoattenuating saline. The task was to search for and localize the beads. A modified matched filter was used to automatically scan the reconstruction and select candidate bead localizations of varying confidence. These were compared to bead locations as determined from a high-dose reference scan to produce free-response ROC curves. We compared iterative reconstruction (IR) and filtered backpropagation (FBP) at multiple dose levels between 40 and 240 mAs. The scans at 60, 120, and 180 mAs were performed three times each to estimate uncertainty.

RESULTS

Experimental scans demonstrated the feasibility of our technique. Our metric for machine LCD was the area under the exponential transform of the FROC curve (AUC). AUC increased monotonically from 0.21 at 40 mAs to 0.84 at 240 mAs. The sample standard deviation of AUC was approximately 0.02. This measurement uncertainty in AUC corresponded to a change in tube current of 4% to 8%. Surprisingly, we found that AUCs for IR were slightly worse than AUCs for FBP. While the phantom was sufficient for these experiments, it contained small air bubbles and alternative fabrication methods will be necessary for widespread utilization.

CONCLUSIONS

It is feasible to measure machine LCD using a search task on a phantom with hundreds of beads and to obtain tight error bars using only a single scan. Our method could facilitate routine quality assurance or possibly enable comparisons between different protocols and scanners.

Assessment of task-based performance from five clinical DBT systems using an anthropomorphic breast phantom

PURPOSE

Digital breast tomosynthesis (DBT) is a limited-angle tomographic breast imaging modality that can be used for breast cancer screening in conjunction with full-field digital mammography (FFDM) or synthetic mammography (SM). Currently, there are five commercial DBT systems that have been approved by the U.S. FDA for breast cancer screening, all varying greatly in design and imaging protocol. Because the systems are different in technical specifications, there is a need for a quantitative approach for assessing them. In this study, the DBT systems are assessed using a novel methodology with an inkjet-printed anthropomorphic phantom and four alternative forced choice (4AFC) study scheme.

METHOD

A breast phantom was fabricated using inkjet printing and parchment paper. The phantom contained 5-mm spiculated masses fabricated with potassium iodide (KI)-doped ink and microcalcifications (MCs) made with calcium hydroxyapatite. Images of the phantom were acquired on all five systems with DBT, FFDM, and SM modalities where available using beam settings under automatic exposure control. A 4AFC study was conducted to assess reader performance with each signal under each modality. Statistical analysis was performed on the data to determine proportion correct (PC), standard deviations, and levels of significance.

RESULTS

For masses, overall detection was highest with DBT. The difference in PC was statistically significant between DBT and SM for most systems. A relationship was observed between increasing PC and greater gantry span. For MCs, performance was highest with DBT and FFDM compared to SM. The difference between PC of DBT and PC of SM was statistically significant for all manufacturers.

CONCLUSIONS

This methodology represents a novel approach for evaluating systems. This study is the first of its kind to use an inkjet-printed anthropomorphic phantom with realistic signals to assess performance of clinical DBT imaging systems.

Verification of the accuracy of a hybrid breast imaging simulation framework for virtual clinical trial applications

Purpose: The impact of system parameters on signal detectability can be studied with simulation platforms. We describe the steps taken to verify and confirm the accuracy of a local platform developed for the use in virtual clinical trials. Approach: The platform simulates specific targets into existing two-dimensional full-field digital mammography and digital breast tomosynthesis images acquired on a Siemens Inspiration system. There are three steps: (1) creation of voxel models or analytical objects; (2) generation of a realistic object template with accurate resolution, scatter, and noise properties; and (3) insertion and reconstruction. Four objects were simulated: a 0.5-mm aluminium (Al) sphere and a 0.2-mm-thick Al sheet in a PMMA stack, a 0.8-mm steel edge and a three-dimensional mass model in a structured background phantom. Simulated results were compared to acquired data. Results: Peak contrast and signal difference-to-noise ratio (SDNR) were in close agreement ( < 5 % error) for both sphere and sheet. The similarity of pixel value profiles for sphere and sheet in the x y direction and the artifact spread function for real and simulated spheres confirmed accurate geometric modeling. Absolute and relative average deviation between modulation transfer function measured from a real and simulated edges showed accurate sharpness modelling for spatial frequencies up to the Nyquist frequency. Real and simulated objects could not be differentiated visually. Conclusions: The results indicate that this simulation framework is a strong candidate for use in virtual clinical studies.

In-plane image quality and NPWE detectability index in digital breast tomosynthesis

A rigorous 2D analysis of signal and noise transfer applied to reconstructed planes in digital breast tomosynthesis (DBT) is necessary for system characterization and optimization. This work proposes a method for assessing technical image quality and system detective quantum efficiency (DQE_sys) for reconstructed planes in DBT. Measurements of 2D in-plane modulation transfer function (MTF) and noise power spectrum (NPS) were made on five DBT systems using different acquisition parameters, reconstruction algorithms and plane spacing. This work develops the noise equivalent quanta (NEQ), DQE_sys and detectability index (d') calculated using a non-prewhitening model observer with eye filter (NPWE) for reconstructed DBT planes. The images required for this implementation were acquired using a homogeneous test object of thickness 40 mm poly(methyl) methacrylate plus 0.5 mm Al; 2D MTF was calculated from an Al disc of thickness 0.2 mm and diameter 50 mm positioned within the phantom. The radiant contrast of the MTF disc and the air kerma at the system input were used as normalization factors. The NPWE detectability index was then compared to the in-plane contrast-detail (c-d) threshold measured using the CDMAM phantom. The MTF and NPS measured on the different systems showed a strong anisotropy, consistent with the cascaded models developed in the literature for DBT. Detectability indices calculated from the measured MTF and NPS successfully predicted changes in c-d detectability for details between 0.1 mm and 2.0 mm, for DBT plane spacings between 0.5 mm and 10 mm, and for air kerma values at the system input between 157 µGy and 1170 μGy. The linear Pearson correlation between the detectability index and threshold gold thickness of the CDMAM phantom was -0.996. The method implements a parametric means of assessing the technical image quality of reconstructed DBT planes, providing valuable information for optimization of DBT systems.

Breast phantoms for 2D digital mammography with realistic anatomical structures and attenuation characteristics based on clinical images using 3D printing

The aim of this work was to develop a production process for breast phantoms for 2D digital mammography (DM) with realistic anatomical structures and attenuation characteristics based on clinical images using 3D printing. The presented production process is based on PolyJet 3D printing technology using a polypropylene like printing material. First, an attenuation calibration function for this material and the achievable lateral resolution of the printing process of about 200 µm was determined. Subsequently, to generate the digital 3D model of the breast phantom, the pixel intensities of the unprocessed clinical image that are related to the attenuation along the z-axis of the breast, were converted to corresponding phantom heights using the calibration function. To validate the process, an image of the 3D printed breast phantom was acquired on the full field digital mammography (FFDM) system used for calibration and compared with the clinical image in terms of anatomical structures and associated attenuation characteristics. The exposure parameters and image impression of the phantom were evaluated using five other FFDM systems of different manufacturers and types. Results demonstrated that the anatomical structures in the images and the attenuation characteristics of a female breast and the derived phantom agreed on the FFDM system used for calibration. The automatic exposure control segmentation, the automatically selected exposure parameters and the image postprocessing of the clinical and phantom image indicated a high level of conformity. As shown, the phantom is also suitable for other FFDM systems. In conclusion, an approach to produce anthropomorphic breast phantoms for DM offering realistic anatomical structures and attenuation characteristics based on clinical images was successfully developed. As shown, the phantom realistically simulated the original female breast. Therefore, it is expected that such phantoms are promising to support bridging the gap between physical-technical and diagnostic image quality assessment. In addition, they enable a variety of practical and scientific applications for which present technical phantoms are not suitable.

Objective assessment of task performance: a comparison of two FFDM detectors using an anthropomorphic breast phantom

Current digital mammography systems primarily employ one of two types of detectors: indirect conversion, typically using a cesium-iodine scintillator integrated with an amorphous silicon photodiode matrix, or direct conversion, using a photoconductive layer of amorphous selenium (a-Se) combined with thin-film transistor array. The goal of this study was to evaluate a methodology for objectively assessing image quality to compare human observer task performance in detecting microcalcification clusters and extended mass-like lesions achieved with different detector types. The proposed assessment methodology uses a novel anthropomorphic breast phantom fabricated with ink-jet printing. In addition to human observer detection performance, standard linear metrics such as modulation transfer function, noise power spectrum, and detective quantum efficiency (DQE) were also measured to assess image quality. An Analogic Anrad AXS-2430 a-Se detector used in a commercial FFDM/DBT system and a Teledyne Dalsa Xineos-2329 with CMOS pixel readout were evaluated and compared. The DQE of each detector was similar over a range of exposures. Similar task performance in detecting microcalcifications and masses was observed between the two detectors over a range of clinically applicable dose levels, with some perplexing differences in the detection of microcalcifications at the lowest dose measurement. The evaluation approach presented seems promising as a new technique for objective assessment of breast imaging technology.

Impact of using the new American College of Radiology digital mammography phantom on quality survey in modern digital mammography systems: Evidence from nationwide surveys in Taiwan

OBJECTIVE

The purpose of this study was to investigate the impact of the new American College of Radiology (ACR) digital mammography (DM) phantom in evaluating phantom image quality (IQ) and average glandular dose (AGD) in a nationwide survey on DM systems.

METHODS

On-site surveys of 239 DM units were conducted in 2017 and 2018, and comparisons were made between ACR screen-film mammography (SFM) phantom and DM phantom for accessing phantom IQ and AGD. The phantom IQ was assessed using the weighted phantom score, considering the size of each detail.

RESULTS

When switching from SFM phantom to DM phantom, no significant difference was found in AGD (p = 0.06). The mean weighted phantom score was significantly higher for DM phantom than for SFM phantom in terms of fibers and specks, and so was the total weighted phantom score (DM phantom vs. SFM phantom: 8.61 ± 1.04 vs. 8.23 ± 0.77, p < 0.0001). The phantom IQ is thus more precise and can detect small differences when using DM phantom and investigating DM systems, especially for specks and fibers. However, the overall passing rate was lower for DM phantom (84.1%) than for SFM phantom (91.2%). This can be explained by the lower passing rate for mass (84.5%) with the DM phantom.

CONCLUSION

The ACR DM phantom provides better discernment to assess specks and fibers in DM systems. This study may serve as a reference for implementing a DM quality control program and when conducting large-scale surveys with the new DM phantom in the digital era.

Model and human observer reproducibility for detection of microcalcification clusters in digital breast tomosynthesis images of three-dimensionally structured test object

We compare the reproducibility of the human observers and a channelized Hotelling observer (CHO), when reading digital breast tomosynthesis (DBT) images of a physical phantom containing a breast simulating structured background and calcification clusters at three dose levels. The phantom is scanned 217 times on a Siemens Inspiration DBT system. Volumes of interest, with and without the calcification targets, are extracted and the human observers' percentage of correct (PC) scores is evaluated using a four-alternative forced choice method. A two-layer CHO is developed using the human observer results. The first layer consists of a localizing CHO that identifies the most conspicuous calcifications using two Laguerre-Gauss channels. Then a CHO with eight Gabor channels estimates the PC score for the calcification cluster. Observer reproducibility is estimated by bootstrapping, and the standard deviation (SD) is used as a figure of merit. The CHO closely approximated the human observer results for all the three dose levels with a correlation of > 0.97 . For the larger calcification cluster sizes, both observers have similar reproducibility, whereas the CHO is more reproducible for the smaller calcifications, with a maximum of 5.5 SD against 13.1 SD for the human observers. The developed CHO is a good candidate for automated reading of the calcification clusters of the structured phantom, with better reproducibility than the human readers for small calcifications.

Three-dimensionally-printed anthropomorphic physical phantom for mammography and digital breast tomosynthesis with custom materials, lesions, and uniform quality control region

Anthropomorphic breast phantoms mimic patient anatomy in order to evaluate clinical mammography and digital breast tomosynthesis system performance. Our goal is to create a modular phantom with an anthropomorphic region to allow for improved lesion and calcification detection as well as a uniform region to evaluate standard quality control (QC) metrics. Previous versions of this phantom used commercial photopolymer inkjet three-dimensional printers to recreate breast anatomy using four surfaces that were fabricated with commercial materials spanning only a limited breast density range of 36% to 64%. We use modified printers to create voxelized, dithered breast phantoms with continuous gradations between glandular and adipose tissues. Moreover, the new phantom replicates the low-end density (representing adipose tissue) using third party material, Jf Flexible, and increases the high-end density to the density of glandular tissue and beyond by either doping Jf Flexible with salts and nanoparticles or using a new commercial resin, VeroPureWhite. An insert design is utilized to add masses, calcifications, and iodinated objects into the phantom for increased utility. The uniform chest wall region provides a space for traditional QC objects such as line pair patterns for measuring resolution and scale bars for measuring printer linearity. Incorporating these distinct design modules enables us to create an improved, complete breast phantom to better evaluate clinical mammography systems for lesion and calcification detection and standard QC performance evaluation.

The threshold detectable mass diameter for 2D-mammography and digital breast tomosynthesis

Digital breast tomosynthesis (DBT) is currently under consideration for replacement of, or combined use with 2D-mammography in national breast screening programmes. To investigate the potential benefits that DBT can bring to screening, the threshold detectable lesion diameters were measured for different forms of DBT in comparison to 2D-mammography. The aim of this study was to compare the threshold detectable mass diameters obtained with narrow angle (15°/15 projections) and wide angle (50°/25 projections) DBT in comparison to 2D-mammography. Simulated images of 60 mm thick compressed breasts were produced with and without masses using a set of validated image modelling tools for 2D-mammography and DBT. Image processing and reconstruction were performed using commercial software. A series of 4-alternative forced choice (4AFC) experiments was conducted for signal detection with the masses as targets. The threshold detectable mass diameter was found for each imaging modality with a mean glandular dose of 2.5 mGy. The resulting values of the threshold diameter for 2D-mammography (10.2 ± 1.4 mm) were found to be larger (p < 0.001) than those for narrow angle DBT (6.0 ± 1.1 mm) and wide angle DBT (5.6 ± 1.2 mm). There was no significant difference between the threshold diameters for wide and narrow angle DBT. Implications for the introduction of DBT alone or in combination with 2D-mammography in breast cancer screening are discussed.

A comparative study of physical image quality in digital and synthetic mammography from commercially available mammography systems

We present a comparison between full field digital mammography and synthetic mammography, performed on several mammography systems from four different manufacturers. The analysis is carried out on both the digital and synthetic images of two commercially available mammography phantoms, and focuses on a set of objective metrics that encode the geometrical appearance of imaging features of diagnostic interest. In particular, we measured sizes and contrasts of several clusters of microcalcification specks, shapes and contrasts of circular masses, and the power spectrum of background regions mimicking the heterogeneous texture of the breast parenchyma. Despite the potential issues of tomosynthesis in terms of image blurring, the synthetic images do not highlight any globally significant differences in the rendering of the details of interest, when compared to the original digital mammograms: relative contrasts are generally preserved, as well as the geometry of broad structures. We conclude that, as far as the considered objective metrics are concerned, the image quality of synthetic mammography does not exhibit significant differences with respect to the one of full field digital mammography, for all the considered systems.

Characterization and validation of the thorax phantom Lungman for dose assessment in chest radiography optimization studies

This work concerns the validation of the Kyoto-Kagaku thorax anthropomorphic phantom Lungman for use in chest radiography optimization. The equivalence in terms of polymethyl methacrylate (PMMA) was established for the lung and mediastinum regions of the phantom. Patient chest examination data acquired under automatic exposure control were collated over a 2-year period for a standard x-ray room. Parameters surveyed included exposure index, air kerma area product, and exposure time, which were compared with Lungman values. Finally, a voxel model was developed by segmenting computed tomography images of the phantom and implemented in PENELOPE/penEasy Monte Carlo code to compare phantom tissue-equivalent materials with materials from ICRP Publication 89 in terms of organ dose. PMMA equivalence varied depending on tube voltage, from 9.5 to 10.0 cm and from 13.5 to 13.7 cm, for the lungs and mediastinum regions, respectively. For the survey, close agreement was found between the phantom and the patients' median values (deviations lay between 8% and 14%). Differences in lung doses, an important organ for optimization in chest radiography, were below 13% when comparing the use of phantom tissue-equivalent materials versus ICRP materials. The study confirms the value of the Lungman for chest optimization studies.