Investigation of Physical Phenomena Underlying Temporal-Enhanced Ultrasound as a New Diagnostic Imaging Technique: Theory and Simulations

A Review of Quantitative Ultrasound-Based Approaches to Thermometry and Ablation Zone Identification Over the Past Decade

Percutaneous thermal therapy is an important clinical treatment method for some solid tumors. It is critical to use effective image visualization techniques to monitor the therapy process in real time because precise control of the therapeutic zone directly affects the prognosis of tumor treatment. Ultrasound is used in thermal therapy monitoring because of its real-time, non-invasive, non-ionizing radiation, and low-cost characteristics. This paper presents a review of nine quantitative ultrasound-based methods for thermal therapy monitoring and their advances over the last decade since 2011. These methods were analyzed and compared with respect to two applications: ultrasonic thermometry and ablation zone identification. The advantages and limitations of these methods were compared and discussed, and future developments were suggested.

Artificial Intelligence in Quantitative Ultrasound Imaging: A Survey

Quantitative ultrasound (QUS) imaging is a safe, reliable, inexpensive, and real-time technique to extract physically descriptive parameters for assessing pathologies. Compared with other major imaging modalities such as computed tomography and magnetic resonance imaging, QUS suffers from several major drawbacks: poor image quality and inter- and intra-observer variability. Therefore, there is a great need to develop automated methods to improve the image quality of QUS. In recent years, there has been increasing interest in artificial intelligence (AI) applications in medical imaging, and a large number of research studies in AI in QUS have been conducted. The purpose of this review is to describe and categorize recent research into AI applications in QUS. We first introduce the AI workflow and then discuss the various AI applications in QUS. Finally, challenges and future potential AI applications in QUS are discussed.

Towards targeted ultrasound-guided prostate biopsy by incorporating model and label uncertainty in cancer detection

PURPOSE

Systematic prostate biopsy is widely used for cancer diagnosis. The procedure is blind to underlying prostate tissue micro-structure; hence, it can lead to a high rate of false negatives. Development of a machine-learning model that can reliably identify suspicious cancer regions is highly desirable. However, the models proposed to-date do not consider the uncertainty present in their output or the data to benefit clinical decision making for targeting biopsy.

METHODS

We propose a deep network for improved detection of prostate cancer in systematic biopsy considering both the label and model uncertainty. The architecture of our model is based on U-Net, trained with temporal enhanced ultrasound (TeUS) data. We estimate cancer detection uncertainty using test-time augmentation and test-time dropout. We then use uncertainty metrics to report the cancer probability for regions with high confidence to help the clinical decision making during the biopsy procedure.

RESULTS

Experiments for prostate cancer classification includes data from 183 prostate biopsy cores of 41 patients. We achieve an area under the curve, sensitivity, specificity and balanced accuracy of 0.79, 0.78, 0.71 and 0.75, respectively.

CONCLUSION

Our key contribution is to automatically estimate model and label uncertainty towards enabling targeted ultrasound-guided prostate biopsy. We anticipate that such information about uncertainty can decrease the number of unnecessary biopsy with a higher rate of cancer yield.

Design of an Ultrasound-Navigated Prostate Cancer Biopsy System for Nationwide Implementation in Senegal

This paper presents the design of NaviPBx, an ultrasound-navigated prostate cancer biopsy system. NaviPBx is designed to support an affordable and sustainable national healthcare program in Senegal. It uses spatiotemporal navigation and multiparametric transrectal ultrasound to guide biopsies. NaviPBx integrates concepts and methods that have been independently validated previously in clinical feasibility studies and deploys them together in a practical prostate cancer biopsy system. NaviPBx is based entirely on free open-source software and will be shared as a free open-source program with no restriction on its use. NaviPBx is set to be deployed and sustained nationwide through the Senegalese Military Health Service. This paper reports on the results of the design process of NaviPBx. Our approach concentrates on "frugal technology", intended to be affordable for low-middle income (LMIC) countries. Our project promises the wide-scale application of prostate biopsy and will foster time-efficient development and programmatic implementation of ultrasound-guided diagnostic and therapeutic interventions in Senegal and beyond.

Stochastic Sequential Modeling: Toward Improved Prostate Cancer Diagnosis Through Temporal-Ultrasound

Prostate cancer (PCa) is a common, serious form of cancer in men that is still prevalent despite ongoing developments in diagnostic oncology. Current detection methods lead to high rates of inaccurate diagnosis. We present a method to directly model and exploit temporal aspects of temporal enhanced ultrasound (TeUS) for tissue characterization, which improves malignancy prediction. We employ a probabilistic-temporal framework, namely, hidden Markov models (HMMs), for modeling TeUS data obtained from PCa patients. We distinguish malignant from benign tissue by comparing the respective log-likelihood estimates generated by the HMMs. We analyze 1100 TeUS signals acquired from 12 patients. Our results show improved malignancy identification compared to previous results, demonstrating over 85% accuracy and AUC of 0.95. Incorporating temporal information directly into the models leads to improved tissue differentiation in PCa. We expect our method to generalize and be applied to other types of cancer in which temporal-ultrasound can be recorded.

Soft Tissue Characterization with Temporal Enhanced Ultrasound through Periodic Manipulation of Point Spread Function: A Feasibility Study

Temporal enhanced ultrasound (TeUS) is a tissue characterization approach based on analysis of a temporal series of US data. Previously we demonstrated that intrinsic or external micro-motions of scatterers in the tissue contribute towards the tissue classification properties of TeUS. This property is beneficial to detect early stage cancer, for example, where changes in nuclei configuration (scatteres) dominate tissue properties. In this study, we propose an analytical derivation and experiments to acquire TeUS through manipulation of US imaging parameters, which may be simpler to translate to clinical applications. The feasibility of the proposed method is demonstrated on tissue-mimicking phantoms. Using an autoencoder classifier, we are able to classify phantoms of varying elasticities and scattering sizes.

Multiple instance learning combined with label invariant synthetic data for guiding systematic prostate biopsy: a feasibility study

PURPOSE

Ultrasound imaging is routinely used in prostate biopsy, which involves obtaining prostate tissue samples using a systematic, yet, non-targeted approach. This approach is blinded to individual patient intraprostatic pathology, and unfortunately, has a high rate of false negatives.

METHODS

In this paper, we propose a deep network for improved detection of prostate cancer in systematic biopsy. We address several challenges associated with training such network: (1) Statistical labels: Since biopsy core's pathology report only represents a statistical distribution of cancer within the core, we use multiple instance learning (MIL) networks to enable learning from ultrasound image regions associated with those data; (2) Limited labels: The number of biopsy cores are limited to at most 12 per patient. As a result, the number of samples available for training a deep network is limited. We alleviate this issue by effectively combining Independent Conditional Variational Auto Encoders (ICVAE) with MIL. We train ICVAE to learn label-invariant features of RF data, which is subsequently used to generate synthetic data for improved training of the MIL network.

RESULTS

Our in vivo study includes data from 339 prostate biopsy cores of 70 patients. We achieve an area under the curve, sensitivity, specificity, and balanced accuracy of 0.68, 0.77, 0.55 and 0.66, respectively.

CONCLUSION

The proposed approach is generic and can be applied to several other scenarios where unlabeled data and noisy labels in training samples are present.

4D cardiac electromechanical activation imaging

Cardiac abnormalities, a major cause of morbidity and mortality, affect millions of people worldwide. Despite the urgent clinical need for early diagnosis, there is currently no noninvasive technique that can infer to the electrical function of the whole heart in 3D and thereby localize abnormalities at the point of care. Here we present a new method for noninvasive 4D mapping of the cardiac electromechanical activity in a single heartbeat for heart disease characterization such as arrhythmia and infarction. Our novel technique captures the 3D activation wave of the heart in vivo using high volume-rate (500 volumes per second) ultrasound with a 32 × 32 matrix array. Electromechanical activation maps are first presented in a normal and infarcted cardiac model in silico and in canine heart during pacing and re-entrant ventricular tachycardia in vivo. Noninvasive 4D electromechanical activation mapping in a healthy volunteer and a heart failure patient are also determined. The technique described herein allows for direct, simultaneous and noninvasive visualization of electromechanical activation in 3D, which provides complementary information on myocardial viability and/or abnormality to clinical imaging.

Deep neural maps for unsupervised visualization of high-grade cancer in prostate biopsies

Prostate cancer (PCa) is the most frequent noncutaneous cancer in men. Early detection of PCa is essential for clinical decision making, and reducing metastasis and mortality rates. The current approach for PCa diagnosis is histopathologic analysis of core biopsies taken under transrectal ultrasound guidance (TRUS-guided). Both TRUS-guided systematic biopsy and MR-TRUS-guided fusion biopsy have limitations in accurately identifying PCa, intraoperatively. There is a need to augment this process by visualizing highly probable areas of PCa. Temporal enhanced ultrasound (TeUS) has emerged as a promising modality for PCa detection. Prior work focused on supervised classification of PCa verified by gold standard pathology. Pathology labels are noisy, and data from an entire core have a single label even when significantly heterogeneous. Additionally, supervised methods are limited by data from cores with known pathology, and a significant portion of prostate data is discarded without being used. We provide an end-to-end unsupervised solution to map PCa distribution from TeUS data using an innovative representation learning method, deep neural maps. TeUS data are transformed to a topologically arranged hyper-lattice, where similar samples are closer together in the lattice. Therefore, similar regions of malignant and benign tissue in the prostate are clustered together. Our proposed method increases the number of training samples by several orders of magnitude. Data from biopsy cores with known labels are used to associate the clusters with PCa. Cancer probability maps generated using the unsupervised clustering of TeUS data help intuitively visualize the distribution of abnormal tissue for augmenting TRUS-guided biopsies.

Deep Recurrent Neural Networks for Prostate Cancer Detection: Analysis of Temporal Enhanced Ultrasound

Temporal enhanced ultrasound (TeUS), comprising the analysis of variations in backscattered signals from a tissue over a sequence of ultrasound frames, has been previously proposed as a new paradigm for tissue characterization. In this paper, we propose to use deep recurrent neural networks (RNN) to explicitly model the temporal information in TeUS. By investigating several RNN models, we demonstrate that long short-term memory (LSTM) networks achieve the highest accuracy in separating cancer from benign tissue in the prostate. We also present algorithms for in-depth analysis of LSTM networks. Our in vivo study includes data from 255 prostate biopsy cores of 157 patients. We achieve area under the curve, sensitivity, specificity, and accuracy of 0.96, 0.76, 0.98, and 0.93, respectively. Our result suggests that temporal modeling of TeUS using RNN can significantly improve cancer detection accuracy over previously presented works.