Tissue classification using ultrasound-induced variations in acoustic backscattering features

Correlations between B-mode ultrasound image texture features and tissue temperatures in hyperthermia

PURPOSE

The noninvasive monitoring of mild hyperthermia or thermal ablation is important to guarantee therapeutic safety and efficacy. The potential of ultrasound B-mode image texture features in monitoring temperature or coagulation zones studied in this article.

MATERIALS AND METHODS

The experiments carried out on eighteen in vitro porcine liver samples heated from 20°C to 60°C in the water bath. The ultrasound radiofrequency signal at different temperature collected to reconstruct B-mode ultrasound images. The texture features based on gray level histogram (GLH), gray level co-occurrence matrix (GLCM), and gray level-gradient co-occurrence matrix (GGCM) extracted, respectively. Accordingly, we analyze the correlations between these texture features and temperature based on the experiment results.

RESULTS

The results showed that five texture feature parameters closely related to temperature, including mean gray scale of GLH, homogeneity of GLCM, hybrid entropy, inverse difference moment, and correlation of GGCM. Some of these feature parameters have correlation coefficients larger than 0.9 within the temperature range of 20°C to 60°C.

CONCLUSIONS

The above-mentioned five feature parameters expected to apply for noninvasive monitoring of MH or TA.

Toward development of PreVoid alerting system for nocturnal enuresis patients: A fuzzy-based approach for determining the level of liquid encased in urinary bladder

Preventive and accurate assessment of bladder voiding dysfunctions necessitates measuring the amount of liquid encapsulated within urinary bladder walls in a non-invasive and real-time manner. The real-time monitoring of urine levels helps patients with urological disorders such as Nocturnal Enuresis (NE) by preventing the occurrence of enuresis via a pre-void stage alerting system. Although some advances have been achieved toward developing a non-invasive approach for determining the amount of accumulated urine inside the bladder, there is still a lack of an easy-to-implement technique which is suitable to embed in a wearable pre-warning device. This study aims to develop a machine-learning empowered technique to quantify to what extent an individual's bladder is filled by observing the filling-voiding pattern of a patient over a training period. In this experiment, a pulse-echo sonar element is used to generate ultrasound pulses while the probe surface is positioned perpendicular to the bladder's position. From the reflected echoes, four features which show sufficient sensitiveness and therefore could be modulated noticeably by different levels of liquid encased in the bladder, are extracted. The extracted features are then fed into a novel intelligent decision support system- known as FECOC - which is based on hybridization of fuzzy inference systems (FIS) and error correcting output codes (ECOC). The proposed scheme tends to achieve better results when examined in real case studies.

Early differentiating between the chemotherapy responders and nonresponders: preliminary results with ultrasonic spectrum analysis of the RF time series in preclinical breast cancer models

Background

This study was aimed to assess whether ultrasonic spectrum analysis of radiofrequency (RF) time series using a clinical ultrasound system allows for early differentiating between the chemotherapy responders and nonresponders in human breast cancer xenografts that imitate clinical responding and nonresponding tumors.

Methods

Clinically responding (n = 20; MCF-7) and nonresponding (n = 20; MBA-MD-231) breast cancer xenografts were established in 40 nude mice. Ten mice from each group received either chemotherapy (adriamycin, 4 mg/kg) or saline as controls. Each tumor was imaged longitudinally with a clinical ultrasound scanner at baseline (day 0) and subsequently on days 2, 4, 6, 8 and 12 following treatment, and the corresponding RF time-series data were collected. Changes in six RF time-series parameters (slope, intercept, S1, S2, S3 and S4) were compared with the measurement of the tumor cell density, and their differential performances of the treatment response were analyzed.

Results

Adriamycin significantly inhibited tumor growth and decreased the cancer cell density in responders (P < 0.001) but not in nonresponders (P > 0.05). Fold changes of slope were significantly increased in responders two days after adriamycin treatment (P = 0.002), but not in nonresponders (P > 0.05). Early changes in slope on day 2 could differentiate the treatment response in 100% of both responders (95% CI, 62.9–100.0%) and nonresponders (95% CI, 88.4–100%).

Conclusions

Ultrasonic RF time series allowed for the monitoring of the tumor response to chemotherapy and could further serve as biomarkers for early differentiating between the treatment responders and nonresponders.

Electronic supplementary material

The online version of this article (10.1186/s40644-019-0248-y) contains supplementary material, which is available to authorized users.

Deep Recurrent Neural Networks for Prostate Cancer Detection: Analysis of Temporal Enhanced Ultrasound

Temporal enhanced ultrasound (TeUS), comprising the analysis of variations in backscattered signals from a tissue over a sequence of ultrasound frames, has been previously proposed as a new paradigm for tissue characterization. In this paper, we propose to use deep recurrent neural networks (RNN) to explicitly model the temporal information in TeUS. By investigating several RNN models, we demonstrate that long short-term memory (LSTM) networks achieve the highest accuracy in separating cancer from benign tissue in the prostate. We also present algorithms for in-depth analysis of LSTM networks. Our in vivo study includes data from 255 prostate biopsy cores of 157 patients. We achieve area under the curve, sensitivity, specificity, and accuracy of 0.96, 0.76, 0.98, and 0.93, respectively. Our result suggests that temporal modeling of TeUS using RNN can significantly improve cancer detection accuracy over previously presented works.

Toward a real-time system for temporal enhanced ultrasound-guided prostate biopsy

PURPOSE

We have previously proposed temporal enhanced ultrasound (TeUS) as a new paradigm for tissue characterization. TeUS is based on analyzing a sequence of ultrasound data with deep learning and has been demonstrated to be successful for detection of cancer in ultrasound-guided prostate biopsy. Our aim is to enable the dissemination of this technology to the community for large-scale clinical validation.

METHODS

In this paper, we present a unified software framework demonstrating near-real-time analysis of ultrasound data stream using a deep learning solution. The system integrates ultrasound imaging hardware, visualization and a deep learning back-end to build an accessible, flexible and robust platform. A client-server approach is used in order to run computationally expensive algorithms in parallel. We demonstrate the efficacy of the framework using two applications as case studies. First, we show that prostate cancer detection using near-real-time analysis of RF and B-mode TeUS data and deep learning is feasible. Second, we present real-time segmentation of ultrasound prostate data using an integrated deep learning solution.

RESULTS

The system is evaluated for cancer detection accuracy on ultrasound data obtained from a large clinical study with 255 biopsy cores from 157 subjects. It is further assessed with an independent dataset with 21 biopsy targets from six subjects. In the first study, we achieve area under the curve, sensitivity, specificity and accuracy of 0.94, 0.77, 0.94 and 0.92, respectively, for the detection of prostate cancer. In the second study, we achieve an AUC of 0.85.

CONCLUSION

Our results suggest that TeUS-guided biopsy can be potentially effective for the detection of prostate cancer.

Investigation of Physical Phenomena Underlying Temporal-Enhanced Ultrasound as a New Diagnostic Imaging Technique: Theory and Simulations

Temporal-enhanced ultrasound (TeUS) is a novel noninvasive imaging paradigm that captures information from a temporal sequence of backscattered US radio frequency data obtained from a fixed tissue location. This technology has been shown to be effective for classification of various in vivo and ex vivo tissue types including prostate cancer from benign tissue. Our previous studies have indicated two primary phenomena that influence TeUS: 1) changes in tissue temperature due to acoustic absorption and 2) micro vibrations of tissue due to physiological vibration. In this paper, first, a theoretical formulation for TeUS is presented. Next, a series of simulations are carried out to investigate micro vibration as a source of tissue characterizing information in TeUS. The simulations include finite element modeling of micro vibration in synthetic phantoms, followed by US image generation during TeUS imaging. The simulations are performed on two media, a sparse array of scatterers and a medium with pathology mimicking scatterers that match nuclei distribution extracted from a prostate digital pathology data set. Statistical analysis of the simulated TeUS data shows its ability to accurately classify tissue types. Our experiments suggest that TeUS can capture the microstructural differences, including scatterer density, in tissues as they react to micro vibrations.

Ultrasonic RF time series for early assessment of the tumor response to chemotherapy

Ultrasound radio-frequency (RF) time series have been shown to carry tissue typing information. To evaluate the potential of RF time series for early prediction of tumor response to chemotherapy, 50MCF-7 breast cancer-bearing nude mice were randomized to receive cisplatin and paclitaxel (treatment group; n = 26) or sterile saline (control group; n = 24). Sequential ultrasound imaging was performed on days 0, 3, 6, and 8 of treatment to simultaneously collect B-mode images and RF data. Six RF time series features, slope, intercept, S1, S2, S3, and S4, were extracted during RF data analysis and contrasted with microstructural tumor changes on histopathology. Chemotherapy administration reduced tumor growth relative to control on days 6 and 8. Compared with day 0, intercept, S1, and S2 were increased while slope was decreased on days 3, 6, and 8 in the treatment group. Compared with the control group, intercept, S1, S2, S3, and S4 were increased, and slope was decreased, on days 3, 6, and 8 in the treatment group. Tumor cell density decreased significantly in the latter on day 3. We conclude that ultrasonic RF time series analysis provides a simple way to noninvasively assess the early tumor response to chemotherapy.

Detection and grading of prostate cancer using temporal enhanced ultrasound: combining deep neural networks and tissue mimicking simulations

PURPOSE  : Temporal Enhanced Ultrasound (TeUS) has been proposed as a new paradigm for tissue characterization based on a sequence of ultrasound radio frequency (RF) data. We previously used TeUS to successfully address the problem of prostate cancer detection in the fusion biopsies. METHODS  : In this paper, we use TeUS to address the problem of grading prostate cancer in a clinical study of 197 biopsy cores from 132 patients. Our method involves capturing high-level latent features of TeUS with a deep learning approach followed by distribution learning to cluster aggressive cancer in a biopsy core. In this hypothesis-generating study, we utilize deep learning based feature visualization as a means to obtain insight into the physical phenomenon governing the interaction of temporal ultrasound with tissue. RESULTS  : Based on the evidence derived from our feature visualization, and the structure of tissue from digital pathology, we build a simulation framework for studying the physical phenomenon underlying TeUS-based tissue characterization. CONCLUSION  : Results from simulation and feature visualization corroborated with the hypothesis that micro-vibrations of tissue microstructure, captured by low-frequency spectral features of TeUS, can be used for detection of prostate cancer.

Transfer learning from RF to B-mode temporal enhanced ultrasound features for prostate cancer detection

PURPOSE

We present a method for prostate cancer (PCa) detection using temporal enhanced ultrasound (TeUS) data obtained either from radiofrequency (RF) ultrasound signals or B-mode images.

METHODS

For the first time, we demonstrate that by applying domain adaptation and transfer learning methods, a tissue classification model trained on TeUS RF data (source domain) can be deployed for classification using TeUS B-mode data alone (target domain), where both data are obtained on the same ultrasound scanner. This is a critical step for clinical translation of tissue classification techniques that primarily rely on accessing RF data, since this imaging modality is not readily available on all commercial scanners in clinics. Proof of concept is provided for in vivo characterization of PCa using TeUS B-mode data, where different nonlinear processing filters in the pipeline of the RF to B-mode conversion result in a distribution shift between the two domains.

RESULTS

Our in vivo study includes data obtained in MRI-guided targeted procedure for prostate biopsy. We achieve comparable area under the curve using TeUS RF and B-mode data for medium to large cancer tumor sizes in biopsy cores (>4 mm).

CONCLUSION

Our result suggests that the proposed adaptation technique is successful in reducing the divergence between TeUS RF and B-mode data.

Feasibility of Using Ultrasonic Nakagami Imaging for Monitoring Microwave-Induced Thermal Lesion in Ex Vivo Porcine Liver

The feasibility of using ultrasonic Nakagami imaging to evaluate thermal lesions induced by microwave ablation (MWA) in ex vivo porcine liver was explored. Dynamic changes in echo amplitudes and Nakagami parameters in the region of the MWA-induced thermal lesion, as well as the contrast-to-noise ratio (CNR) between the MWA-induced thermal lesion and the surrounding normal tissue, were calculated simultaneously during the MWA procedure. After MWA exposure, a bright hyper-echoic region appeared in ultrasonic B-mode and Nakagami parameter images as an indicator of the thermal lesion. Mean values of the Nakagami parameter in the thermal lesion region increased to 0.58, 0.71 and 0.91 after 1, 3 and 5 min of MVA. There were no significant differences in envelope amplitudes in the thermal lesion region among ultrasonic B-mode images obtained after different durations of MWA. Unlike ultrasonic B-mode images, Nakagami images were less affected by the shadow effect in monitoring of MWA exposure, and a fairly complete hyper-echoic region was observed in the Nakagami image. The mean value of the Nakagami parameter increased from approximately 0.47 to 0.82 during MWA exposure. At the end of the postablation stage, the mean value of the Nakagami parameter decreased to 0.55 and was higher than that before MWA exposure. CNR values calculated for Nakagami parameter images increased from 0.13 to approximately 0.61 during MWA and then decreased to 0.26 at the end of the post-ablation stage. The corresponding CNR values calculated for ultrasonic B-mode images were 0.24, 0.42 and 0.17. This preliminary study on ex vivo porcine liver suggested that Nakagami imaging have potential use in evaluating the formation of MWA-induced thermal lesions. Further in vivo studies are needed to evaluate the potential application.

Detection of prostate cancer using temporal sequences of ultrasound data: a large clinical feasibility study

PURPOSE

This paper presents the results of a large study involving fusion prostate biopsies to demonstrate that temporal ultrasound can be used to accurately classify tissue labels identified in multi-parametric magnetic resonance imaging (mp-MRI) as suspicious for cancer.

METHODS

We use deep learning to analyze temporal ultrasound data obtained from 255 cancer foci identified in mp-MRI. Each target is sampled in axial and sagittal planes. A deep belief network is trained to automatically learn the high-level latent features of temporal ultrasound data. A support vector machine classifier is then applied to differentiate cancerous versus benign tissue, verified by histopathology. Data from 32 targets are used for the training, while the remaining 223 targets are used for testing.

RESULTS

Our results indicate that the distance between the biopsy target and the prostate boundary, and the agreement between axial and sagittal histopathology of each target impact the classification accuracy. In 84 test cores that are 5 mm or farther to the prostate boundary, and have consistent pathology outcomes in axial and sagittal biopsy planes, we achieve an area under the curve of 0.80. In contrast, all of these targets were labeled as moderately suspicious in mp-MR.

CONCLUSION

Using temporal ultrasound data in a fusion prostate biopsy study, we achieved a high classification accuracy specifically for moderately scored mp-MRI targets. These targets are clinically common and contribute to the high false-positive rates associated with mp-MRI for prostate cancer detection. Temporal ultrasound data combined with mp-MRI have the potential to reduce the number of unnecessary biopsies in fusion biopsy settings.

Computer-Aided Prostate Cancer Detection Using Ultrasound RF Time Series: In Vivo Feasibility Study

This paper presents the results of a computer-aided intervention solution to demonstrate the application of RF time series for characterization of prostate cancer, in vivo.

METHODS

We pre-process RF time series features extracted from 14 patients using hierarchical clustering to remove possible outliers. Then, we demonstrate that the mean central frequency and wavelet features extracted from a group of patients can be used to build a nonlinear classifier which can be applied successfully to differentiate between cancerous and normal tissue regions of an unseen patient.

RESULTS

In a cross-validation strategy, we show an average area under receiver operating characteristic curve (AUC) of 0.93 and classification accuracy of 80%. To validate our results, we present a detailed ultrasound to histology registration framework.

CONCLUSION

Ultrasound RF time series results in differentiation of cancerous and normal tissue with high AUC.

Pairwise Latent Semantic Association for Similarity Computation in Medical Imaging

Retrieving medical images that present similar diseases is an active research area for diagnostics and therapy. However, it can be problematic given the visual variations between anatomical structures. In this paper, we propose a new feature extraction method for similarity computation in medical imaging. Instead of the low-level visual appearance, we design a CCA-PairLDA feature representation method to capture the similarity between images with high-level semantics. First, we extract the PairLDA topics to represent an image as a mixture of latent semantic topics in an image pair context. Second, we generate a CCA-correlation model to represent the semantic association between an image pair for similarity computation. While PairLDA adjusts the latent topics for all image pairs, CCA-correlation helps to associate an individual image pair. In this way, the semantic descriptions of an image pair are closely correlated, and naturally correspond to similarity computation between images. We evaluated our method on two public medical imaging datasets for image retrieval and showed improved performance.

Augmenting MRI-transrectal ultrasound-guided prostate biopsy with temporal ultrasound data: a clinical feasibility study

PURPOSE

In recent years, fusion of multi-parametric MRI (mp-MRI) with transrectal ultrasound (TRUS)-guided biopsy has enabled targeted prostate biopsy with improved cancer yield. Target identification is solely based on information from mp-MRI, which is subsequently transferred to the subject coordinates through an image registration approach. mp-MRI has shown to be highly sensitive to detect higher-grade prostate cancer, but suffers from a high rate of false positives for lower-grade cancer, leading to unnecessary biopsies. This paper utilizes a machine-learning framework to further improve the sensitivity of targeted biopsy through analyzing temporal ultrasound data backscattered from the prostate tissue.

METHODS

Temporal ultrasound data were acquired during targeted fusion prostate biopsy from suspicious cancer foci identified in mp-MRI. Several spectral features, representing the signature of backscattered signal from the tissue, were extracted from the temporal ultrasound data. A supervised support vector machine classification model was trained to relate the features to the result of histopathology analysis of biopsy cores obtained from cancer foci. The model was used to predict the label of biopsy cores for mp-MRI-identified targets in an independent group of subjects.

RESULTS

Training of the classier was performed on data obtained from 35 biopsy cores. A fivefold cross-validation strategy was utilized to examine the consistency of the selected features from temporal ultrasound data, where we achieved the classification accuracy and area under receiver operating characteristic curve of 94 % and 0.98, respectively. Subsequently, an independent group of 25 biopsy cores was used for validation of the model, in which mp-MRI had identified suspicious cancer foci. Using the trained model, we predicted the tissue pathology using temporal ultrasound data: 16 out of 17 benign cores, as well as all three higher-grade cancer cores, were correctly identified.

CONCLUSION

The results show that temporal analysis of ultrasound data is potentially an effective approach to complement mp-MRI-TRUS-guided prostate cancer biopsy, specially to reduce the number of unnecessary biopsies and to reliably identify higher-grade cancers.

Thermometry and ablation monitoring with ultrasound

In this review we present the current status of ultrasound thermometry and ablation monitoring, with emphasis on the diverse approaches published in the literature and with an eye on which methods are closest to clinical reality. It is hoped that this review will serve as a guide to the expansion of sonographic methods for treatment monitoring and thermometry since the last brief review in 2007.

Ultrasound-Based Characterization of Prostate Cancer Using Joint Independent Component Analysis

OBJECTIVE

This paper presents the results of a new approach for selection of RF time series features based on joint independent component analysis for in vivo characterization of prostate cancer.

METHODS

We project three sets of RF time series features extracted from the spectrum, fractal dimension, and the wavelet transform of the ultrasound RF data on a space spanned by five joint independent components. Then, we demonstrate that the obtained mixing coefficients from a group of patients can be used to train a classifier, which can be applied to characterize cancerous regions of a test patient.

RESULTS

In a leave-one-patient-out cross validation, an area under receiver operating characteristic curve of 0.93 and classification accuracy of 84% are achieved.

CONCLUSION

Ultrasound RF time series can be used to accurately characterize prostate cancer, in vivo without the need for exhaustive search in the feature space.

SIGNIFICANCE

We use joint independent component analysis for systematic fusion of multiple sets of RF time series features, within a machine learning framework, to characterize PCa in an in vivo study.

Ultrasound RF time series for classification of breast lesions

This work reports the use of ultrasound radio frequency (RF) time series analysis as a method for ultrasound-based classification of malignant breast lesions. The RF time series method is versatile and requires only a few seconds of raw ultrasound data with no need for additional instrumentation. Using the RF time series features, and a machine learning framework, we have generated malignancy maps, from the estimated cancer likelihood, for decision support in biopsy recommendation. These maps depict the likelihood of malignancy for regions of size 1 mm(2) within the suspicious lesions. We report an area under receiver operating characteristics curve of 0.86 (95% confidence interval [CI]: 0.84%-0.90%) using support vector machines and 0.81 (95% CI: 0.78-0.85) using Random Forests classification algorithms, on 22 subjects with leave-one-subject-out cross-validation. Changing the classification method yielded consistent results which indicates the robustness of this tissue typing method. The findings of this report suggest that ultrasound RF time series, along with the developed machine learning framework, can help in differentiating malignant from benign breast lesions, subsequently reducing the number of unnecessary biopsies after mammography screening.

Ultrasonic evaluation of microwave-induced thermal lesions based on wavelet analysis of mean scatterer spacing

The microwave ablation has become an important manner for tumor treatment. In this paper, we proposed a new method for evaluation of microwave-induced thermal lesions using the wavelet analysis of the mean scatterer spacing (MSS). First, the ultrasonic radiofrequency (RF) data of normal and coagulated porcine liver tissues was collected through the temperature-controlled water bath heating experiments. The convex array ultrasound probe with a center frequency of 3.5 MHz was used. Second, the wavelet analysis was used to compute the MSS of normal and coagulated porcine liver tissues, respectively. Finally, the microwave-induced thermal lesions were detected based on the differences in the MSS between normal tissues and thermal lesions. Eighteen cases of microwave ablation experiments and 20 cases of water bath heating experiments were conducted on fresh porcine liver samples. The MSS of normal porcine liver tissues was 1.15±0.12 mm, and the MSS of coagulated porcine liver tissues was 0.93±0.07 mm. Six cases of thermal lesions were compared between the MSS-detected area and the caliper-measured area, and the MSS-detected area had an error of (13.55±5.29) %. The experimental results indicated that the proposed method could be used in preliminary detection and evaluation of microwave-induced thermal lesions.