1
|
Hyun D, Kim GB, Bottenus N, Dahl JJ. Ultrasound Lesion Detectability as a Distance Between Probability Measures. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2022; 69:732-743. [PMID: 34941507 PMCID: PMC8906175 DOI: 10.1109/tuffc.2021.3138058] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Lesion detectability (LD) quantifies how easily a lesion or target can be distinguished from the background. LD is commonly used to assess the performance of new ultrasound imaging methods. The contrast-to-noise ratio (CNR) is the most popular measure of LD; however, recent work has exposed its vulnerability to manipulations of dynamic range. The generalized CNR (gCNR) has been proposed as a robust histogram-based alternative that is invariant to such manipulations. Here, we identify key shortcomings of CNR and strengths of gCNR as LD metrics for modern beamformers. Using the measure theory, we pose LD as a distance between empirical probability measures (i.e., histograms) and prove that: 1) gCNR is equal to the total variation distance between probability measures and 2) gCNR is one minus the error rate of the ideal observer. We then explore several consequences of measure-theoretic LD in simulation studies. We find that histogram distances depend on bin selection that LD must be considered in the context of spatial resolution and that many histogram distances are invariant under measure-preserving isomorphisms of the sample space (e.g., dynamic range transformations). Finally, we provide a mathematical interpretation for why quantitative values such as contrast ratio (CR), CNR, and signal-to-noise ratio should not be compared between images with different dynamic ranges or underlying units and demonstrate how histogram matching can be used to reenable such quantitative comparisons.
Collapse
|
2
|
Abadi E, Segars WP, Tsui BMW, Kinahan PE, Bottenus N, Frangi AF, Maidment A, Lo J, Samei E. Virtual clinical trials in medical imaging: a review. J Med Imaging (Bellingham) 2020; 7:042805. [PMID: 32313817 PMCID: PMC7148435 DOI: 10.1117/1.jmi.7.4.042805] [Citation(s) in RCA: 95] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2019] [Accepted: 03/23/2020] [Indexed: 12/13/2022] Open
Abstract
The accelerating complexity and variety of medical imaging devices and methods have outpaced the ability to evaluate and optimize their design and clinical use. This is a significant and increasing challenge for both scientific investigations and clinical applications. Evaluations would ideally be done using clinical imaging trials. These experiments, however, are often not practical due to ethical limitations, expense, time requirements, or lack of ground truth. Virtual clinical trials (VCTs) (also known as in silico imaging trials or virtual imaging trials) offer an alternative means to efficiently evaluate medical imaging technologies virtually. They do so by simulating the patients, imaging systems, and interpreters. The field of VCTs has been constantly advanced over the past decades in multiple areas. We summarize the major developments and current status of the field of VCTs in medical imaging. We review the core components of a VCT: computational phantoms, simulators of different imaging modalities, and interpretation models. We also highlight some of the applications of VCTs across various imaging modalities.
Collapse
Affiliation(s)
- Ehsan Abadi
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - William P. Segars
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - Benjamin M. W. Tsui
- Johns Hopkins University, Department of Radiology, Baltimore, Maryland, United States
| | - Paul E. Kinahan
- University of Washington, Department of Radiology, Seattle, Washington, United States
| | - Nick Bottenus
- Duke University, Department of Biomedical Engineering, Durham, North Carolina, United States
- University of Colorado Boulder, Department of Mechanical Engineering, Boulder, Colorado, United States
| | - Alejandro F. Frangi
- University of Leeds, School of Computing, Leeds, United Kingdom
- University of Leeds, School of Medicine, Leeds, United Kingdom
| | - Andrew Maidment
- University of Pennsylvania, Department of Radiology, Philadelphia, Pennsylvania, United States
| | - Joseph Lo
- Duke University, Department of Radiology, Durham, North Carolina, United States
| | - Ehsan Samei
- Duke University, Department of Radiology, Durham, North Carolina, United States
| |
Collapse
|
3
|
Zhu Y, Han A, O'Brien WD, Oelze ML, Insana MF. Limitations on estimation of effective scatterer diameters. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2017; 142:3677. [PMID: 29289076 PMCID: PMC5736397 DOI: 10.1121/1.5017602] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/09/2017] [Revised: 11/17/2017] [Accepted: 11/23/2017] [Indexed: 06/01/2023]
Abstract
The influence of spatial diversity in acoustic scattering properties on estimates of the effective scatterer diameter (ESD) applied to soft biological tissues is investigated. This study is based on two-dimensional simulations of scattering media, beginning with random distributions of simple disk structures where all scattering features are known exactly. It concludes with an analysis of histology maps from healthy and fatty rabbit liver. Further, the liver histology is decomposed using an orthonormal basis to separate acoustic scattering at various spatial scales and observe how it influences ESD estimates. Overall, the goal is to quantitatively interpret ESD results for diagnostic assessments despite wide variations in tissue scatterer properties.
Collapse
Affiliation(s)
- Yang Zhu
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1304 West Springfield Avenue, Urbana, Illinois 61801, USA
| | - Aiguo Han
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, 306 North Wright Street, Urbana, Illinois 61801, USA
| | - William D O'Brien
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, 306 North Wright Street, Urbana, Illinois 61801, USA
| | - Michael L Oelze
- Department of Electrical and Computer Engineering, University of Illinois at Urbana-Champaign, 306 North Wright Street, Urbana, Illinois 61801, USA
| | - Michael F Insana
- Department of Bioengineering, University of Illinois at Urbana-Champaign, 1304 West Springfield Avenue, Urbana, Illinois 61801, USA
| |
Collapse
|
4
|
Nguyen NQ, Prager RW, Insana MF. Improvements to ultrasonic beamformer design and implementation derived from the task-based analytical framework. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2017; 141:4427. [PMID: 28679242 DOI: 10.1121/1.4985187] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The task-based framework, previously developed for beamformer comparison [Nguyen, Prager, and Insana, J. Acoust. Soc. Am. 140, 1048-1059 (2016)], is extended to design a new beamformer with potential applications in breast cancer diagnosis. The beamformer is based on a better approximation of the Bayesian strategy. It is a combination of the Wiener-filtered beamformer and an iterative process that adapts the generated image to specific features of the object. Through numerical studies, the new method is shown to outperform other beamformers drawn from the framework, but at an increase in computational cost. It requires a preprocessing step where the scattering field is segmented into regions with distinct statistical properties. Segmentation errors become a major limitation to the beamformer performance. All the beamformers under investigation are tested using data obtained from an instrumented ultrasound machine. They are implemented using a new time delay calculation, recently developed in the pixel-based beamforming studies presented here, which helps to overcome the challenge posed by the shift-variant nature of the imaging system. The efficacy of each beamformer is evaluated based on the quality of generated images in the context of the task-based framework. The in vitro results confirm the conclusions drawn from the simulations.
Collapse
Affiliation(s)
- Nghia Q Nguyen
- Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, United Kingdom
| | - Richard W Prager
- Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, United Kingdom
| | - Michael F Insana
- Department of Bioengineering and Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
| |
Collapse
|
5
|
Nguyen NQ, Prager RW. Minimum Variance Approaches to Ultrasound Pixel-Based Beamforming. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:374-384. [PMID: 27654321 DOI: 10.1109/tmi.2016.2609889] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
We analyze the principles underlying minimum variance distortionless response (MVDR) beamforming in order to integrate it into a pixel-based algorithm. There is a challenge posed by the low echo signal-to-noise ratio (eSNR) when calculating beamformer contributions at pixels far away from the beam centreline. Together with the well-known scarcity of samples for covariance matrix estimation, this reduces the beamformer performance and degrades the image quality. To address this challenge, we implement the MVDR algorithm in two different ways. First, we develop the conventional minimum variance pixel-based (MVPB) beamformer that performs the MVDR after the pixel-based superposition step. This involves a combination of methods in the literature, extended over multiple transmits to increase the eSNR. Then we propose the coherent MVPB beamformer, where the MVDR is applied to data within individual transmits. Based on pressure field analysis, we develop new algorithms to improve the data alignment and matrix estimation, and hence overcome the low-eSNR issue. The methods are demonstrated on data acquired with an ultrasound open platform. The results show the coherent MVPB beamformer substantially outperforms the conventional MVPB in a series of experiments, including phantom and in vivo studies. Compared to the unified pixel-based beamformer, the newest delay-and-sum algorithm in [1], the coherent MVPB performs well on regions that conform to the diffuse scattering assumptions on which the minimum variance principles are based. It produces less good results for parts of the image that are dominated by specular reflections.
Collapse
|
6
|
Kim M, Abbey CK, Insana MF. Efficiency of U.S. Tissue Perfusion Estimators. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2016; 63:1131-1139. [PMID: 27244733 DOI: 10.1109/tuffc.2016.2571979] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
We measure the detection and discrimination efficiencies of conventional power-Doppler estimation of perfusion without contrast enhancement. The measurements are made in a phantom with known blood-mimicking fluid flow rates in the presence of clutter and noise. Efficiency is measured by comparing functions of the areas under the receiver operating characteristic curve for Doppler estimators with those of the ideal discriminator, for which we estimate the temporal covariance matrix from echo data. Principal-component analysis is examined as a technique for increasing the accuracy of covariance matrices estimated from echo data. We find that Doppler estimators are <50% efficient at directed perfusion detection between 0.1 and 2.0 mL/min per 2 cm(2) flow area. The efficiency was 20%-40% for the task of discriminating between two perfusion rates in the same range. We conclude that there are reasons to search for more efficient perfusion estimators, one that incorporates covariance matrix information that could significantly enhance the utility of Doppler ultrasound without contrast enhancement.
Collapse
|
7
|
Nguyen NQ, Prager RW, Insana MF. A task-based analytical framework for ultrasonic beamformer comparison. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2016; 140:1048. [PMID: 27586736 DOI: 10.1121/1.4960607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
A task-based approach is employed to develop an analytical framework for ultrasound beamformer design and evaluation. In this approach, a Bayesian ideal-observer provides an idealized starting point and a way to measure information loss in practical beamformer designs. Different approximations of this ideal strategy are shown to lead to popular beamformers in the literature, including the matched filter, minimum variance (MV), and Wiener filter (WF) beamformers. Analysis of the approximations indicates that the WF beamformer should outperform the MV approach, especially in low echo signal-to-noise conditions. The beamformers are applied to five typical tasks from the BIRADS lexicon. Their performance is evaluated based on ability to discriminate idealized malignant and benign features. The numerical results show the advantages of the WF over the MV technique in general; although performance varies predictably in some contrast-limited tasks because of the model modifications required for the MV algorithm to avoid ill-conditioning.
Collapse
Affiliation(s)
- Nghia Q Nguyen
- Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, United Kingdom
| | - Richard W Prager
- Department of Engineering, University of Cambridge, Cambridge CB2 1PZ, United Kingdom
| | - Michael F Insana
- Department of Bioengineering and Beckman Institute, University of Illinois at Urbana-Champaign, Urbana, Illinois 61801, USA
| |
Collapse
|
8
|
Kupinski MK, Clarkson E. Method for optimizing channelized quadratic observers for binary classification of large-dimensional image datasets. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2015; 32:549-65. [PMID: 26366764 PMCID: PMC4667371 DOI: 10.1364/josaa.32.000549] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
We present a new method for computing optimized channels for channelized quadratic observers (CQO) that is feasible for high-dimensional image data. The method for calculating channels is applicable in general and optimal for Gaussian distributed image data. Gradient-based algorithms for determining the channels are presented for five different information-based figures of merit (FOMs). Analytic solutions for the optimum channels for each of the five FOMs are derived for the case of equal mean data for both classes. The optimum channels for three of the FOMs under the equal mean condition are shown to be the same. This result is critical since some of the FOMs are much easier to compute. Implementing the CQO requires a set of channels and the first- and second-order statistics of channelized image data from both classes. The dimensionality reduction from M measurements to L channels is a critical advantage of CQO since estimating image statistics from channelized data requires smaller sample sizes and inverting a smaller covariance matrix is easier. In a simulation study we compare the performance of ideal and Hotelling observers to CQO. The optimal CQO channels are calculated using both eigenanalysis and a new gradient-based algorithm for maximizing Jeffrey's divergence (J). Optimal channel selection without eigenanalysis makes the J-CQO on large-dimensional image data feasible.
Collapse
Affiliation(s)
- M. K. Kupinski
- College of Optical Sciences, University of Arizona, Tucson, Arizona 85721, USA
- Department of Medical Imaging, University of Arizona, Tucson, Arizona 85721, USA
- Corresponding author:
| | - E. Clarkson
- College of Optical Sciences, University of Arizona, Tucson, Arizona 85721, USA
- Department of Medical Imaging, University of Arizona, Tucson, Arizona 85721, USA
| |
Collapse
|
9
|
Nguyen NQ, Abbey CK, Insana MF. Objective assessment of sonographic: quality II acquisition information spectrum. IEEE TRANSACTIONS ON MEDICAL IMAGING 2013; 32:691-698. [PMID: 23221818 DOI: 10.1109/tmi.2012.2231963] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
This paper describes a task-based, information-theoretic approach to the assessment of image quality in diagnostic sonography. We expand the Kullback-Leibler divergence metric J, which quantifies the diagnostic information contained within recorded radio-frequency echo signals, into a spatial-frequency integral comprised of two spectral components: one describes patient features for low-contrast diagnostic tasks and the other describes instrumentation properties. The latter quantity is the acquisition information spectrum (AIS), which measures the density of object information that an imaging system is able to transfer to the echo data at each spatial frequency. AIS is derived based on unique properties of acoustic scattering in tissues that generate object contrast. Predictions made by the J integral expression were validated through Monte Carlo studies using echo-signal data from simulated lesions. Our analysis predicts the diagnostic performance of any sonographic system at specific diagnostic tasks based on engineering properties of the instrument that constitute image quality.
Collapse
Affiliation(s)
- Nghia Q Nguyen
- Earth and Environmental Sciences Division, Los Alamos National Laboratory, Los Alamos, NM 87545, USA.
| | | | | |
Collapse
|