1
|
Ren J, Li J, Liu C, Chen S, Liang L, Liu Y. Deep Learning With Physics-Embedded Neural Network for Full Waveform Ultrasonic Brain Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2024; 43:2332-2346. [PMID: 38329866 DOI: 10.1109/tmi.2024.3363144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/10/2024]
Abstract
The convenience, safety, and affordability of ultrasound imaging make it a vital non-invasive diagnostic technique for examining soft tissues. However, significant differences in acoustic impedance between the skull and soft tissues hinder the successful application of traditional ultrasound for brain imaging. In this study, we propose a physics-embedded neural network with deep learning based full waveform inversion (PEN-FWI), which can achieve reliable quantitative imaging of brain tissues. The network consists of two fundamental components: forward convolutional neural network (FCNN) and inversion sub-neural network (ISNN). The FCNN explores the nonlinear mapping relationship between the brain model and the wavefield, replacing the tedious wavefield calculation process based on the finite difference method. The ISNN implements the mapping from the wavefield to the model. PEN-FWI includes three iterative steps, each embedding the F CNN into the ISNN, ultimately achieving tomography from wavefield to brain models. Simulation and laboratory tests indicate that PEN-FWI can produce high-quality imaging of the skull and soft tissues, even starting from a homogeneous water model. PEN-FWI can achieve excellent imaging of clot models with constant uniform distribution of velocity, randomly Gaussian distribution of velocity, and irregularly shaped randomly distributed velocity. Robust differentiation can also be achieved for brain slices of various tissues and skulls, resulting in high-quality imaging. The imaging time for a horizontal cross-sectional imag e of the brain is only 1.13 seconds. This algorithm can effectively promote ultrasound-based brain tomography and provide feasible solutions in other fields.
Collapse
|
2
|
Boquet-Pujadas A, Olivo-Marin JC. Reformulating Optical Flow to Solve Image-Based Inverse Problems and Quantify Uncertainty. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2023; 45:6125-6141. [PMID: 36040935 DOI: 10.1109/tpami.2022.3202855] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
From meteorology to medical imaging and cell mechanics, many scientific domains use inverse problems (IPs) to extract physical measurements from image movement. To this end, motion estimation methods such as optical flow (OF) pre-process images into motion data to feed the IP, which then inverts for the measurements through a physical model. However, this combined OFIP pipeline exacerbates the ill-posedness inherent to each technique, propagating errors and preventing uncertainty quantification. We introduce a Bayesian PDE-constrained framework that transforms visual information directly into physical measurements in the context of probability distributions. The posterior mean is a constrained IP that tracks brightness while satisfying the physical model, thereby translating the aperture problem from the motion to the underlying physics; whereas the posterior covariance derives measurement error out of image noise. As we illustrate with traction force microscopy, our approach offers several advantages: more accurate reconstructions; unprecedented flexibility in experiment design (e.g., arbitrary boundary conditions); and the exclusivity of measurement error, central to empirical science, yet still unavailable under the OFIP strategy.
Collapse
|
3
|
Dufresne S, Richard C, Dieumegard A, Orfila L, Delpon G, Chiavassa S, Martin B, Rouvière L, Escoffre JM, Oujagir E, Denis de Senneville B, Bouakaz A, Rioux-Leclercq N, Potiron V, Rébillard A. Voluntary Wheel Running Does Not Enhance Radiotherapy Efficiency in a Preclinical Model of Prostate Cancer: The Importance of Physical Activity Modalities? Cancers (Basel) 2021; 13:cancers13215402. [PMID: 34771565 PMCID: PMC8582584 DOI: 10.3390/cancers13215402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2021] [Revised: 10/21/2021] [Accepted: 10/21/2021] [Indexed: 11/16/2022] Open
Abstract
Physical activity is increasingly recognized as a strategy able to improve cancer patient outcome, and its potential to enhance treatment response is promising, despite being unclear. In our study we used a preclinical model of prostate cancer to investigate whether voluntary wheel running (VWR) could improve tumor perfusion and enhance radiotherapy (RT) efficiency. Nude athymic mice were injected with PC-3 cancer cells and either remained inactive or were housed with running wheels. Apparent microbubble transport was enhanced with VWR, which we hypothesized could improve the RT response. When repeating the experiments and adding RT, however, we observed that VWR did not influence RT efficiency. These findings contrasted with previous results and prompted us to evaluate if the lack of effects observed on tumor growth could be attributable to the physical activity modality used. Using PC-3 and PPC-1 xenografts, we randomized mice to either inactive controls, VWR, or treadmill running (TR). In both models, TR (but not VWR) slowed down tumor growth, suggesting that the anti-cancer effects of physical activity are dependent on its modalities. Providing a better understanding of which activity type should be recommended to cancer patients thus appears essential to improve treatment outcomes.
Collapse
Affiliation(s)
- Suzanne Dufresne
- Movement, Sport and Health Sciences Laboratory (M2S)-EA7470, University of Rennes, F-35000 Rennes, France; (S.D.); (C.R.); (A.D.); (L.O.); (B.M.)
| | - Cindy Richard
- Movement, Sport and Health Sciences Laboratory (M2S)-EA7470, University of Rennes, F-35000 Rennes, France; (S.D.); (C.R.); (A.D.); (L.O.); (B.M.)
| | - Arthur Dieumegard
- Movement, Sport and Health Sciences Laboratory (M2S)-EA7470, University of Rennes, F-35000 Rennes, France; (S.D.); (C.R.); (A.D.); (L.O.); (B.M.)
| | - Luz Orfila
- Movement, Sport and Health Sciences Laboratory (M2S)-EA7470, University of Rennes, F-35000 Rennes, France; (S.D.); (C.R.); (A.D.); (L.O.); (B.M.)
| | - Gregory Delpon
- Centre René Gauducheau, Institut de Cancérologie de l’Ouest, F-44805 Saint Herblain, France; (G.D.); (S.C.)
| | - Sophie Chiavassa
- Centre René Gauducheau, Institut de Cancérologie de l’Ouest, F-44805 Saint Herblain, France; (G.D.); (S.C.)
| | - Brice Martin
- Movement, Sport and Health Sciences Laboratory (M2S)-EA7470, University of Rennes, F-35000 Rennes, France; (S.D.); (C.R.); (A.D.); (L.O.); (B.M.)
| | - Laurent Rouvière
- IRMAR-UMR CNRS 6625, University of Rennes, F-35000 Rennes, France; (L.R.); (V.P.)
| | - Jean-Michel Escoffre
- UMR 1253, iBrain, INSERM, Université de Tours, F-37032 Tours, France; (J.-M.E.); (E.O.); (A.B.)
| | - Edward Oujagir
- UMR 1253, iBrain, INSERM, Université de Tours, F-37032 Tours, France; (J.-M.E.); (E.O.); (A.B.)
| | | | - Ayache Bouakaz
- UMR 1253, iBrain, INSERM, Université de Tours, F-37032 Tours, France; (J.-M.E.); (E.O.); (A.B.)
| | - Nathalie Rioux-Leclercq
- Department of Pathological Anatomy and Cytology, Université Rennes 1, F-35000 Rennes, France;
| | - Vincent Potiron
- IRMAR-UMR CNRS 6625, University of Rennes, F-35000 Rennes, France; (L.R.); (V.P.)
- LaBCT, CRCINA INSERM U1232, Université de Nantes, Université d’Angers, F-44000 Nantes, France
| | - Amélie Rébillard
- Movement, Sport and Health Sciences Laboratory (M2S)-EA7470, University of Rennes, F-35000 Rennes, France; (S.D.); (C.R.); (A.D.); (L.O.); (B.M.)
- Institut Universitaire de France (IUF), F-75231 Paris, France
- Correspondence: ; Tel.: +33-29-009-1587
| |
Collapse
|
4
|
Solomon O, Cohen R, Zhang Y, Yang Y, He Q, Luo J, van Sloun RJG, Eldar YC. Deep Unfolded Robust PCA With Application to Clutter Suppression in Ultrasound. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1051-1063. [PMID: 31535987 DOI: 10.1109/tmi.2019.2941271] [Citation(s) in RCA: 38] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Contrast enhanced ultrasound is a radiation-free imaging modality which uses encapsulated gas microbubbles for improved visualization of the vascular bed deep within the tissue. It has recently been used to enable imaging with unprecedented subwavelength spatial resolution by relying on super-resolution techniques. A typical preprocessing step in super-resolution ultrasound is to separate the microbubble signal from the cluttering tissue signal. This step has a crucial impact on the final image quality. Here, we propose a new approach to clutter removal based on robust principle component analysis (PCA) and deep learning. We begin by modeling the acquired contrast enhanced ultrasound signal as a combination of low rank and sparse components. This model is used in robust PCA and was previously suggested in the context of ultrasound Doppler processing and dynamic magnetic resonance imaging. We then illustrate that an iterative algorithm based on this model exhibits improved separation of microbubble signal from the tissue signal over commonly practiced methods. Next, we apply the concept of deep unfolding to suggest a deep network architecture tailored to our clutter filtering problem which exhibits improved convergence speed and accuracy with respect to its iterative counterpart. We compare the performance of the suggested deep network on both simulations and in-vivo rat brain scans, with a commonly practiced deep-network architecture and with the fast iterative shrinkage algorithm. We show that our architecture exhibits better image quality and contrast.
Collapse
|
5
|
Turco S, Frinking P, Wildeboer R, Arditi M, Wijkstra H, Lindner JR, Mischi M. Contrast-Enhanced Ultrasound Quantification: From Kinetic Modeling to Machine Learning. ULTRASOUND IN MEDICINE & BIOLOGY 2020; 46:518-543. [PMID: 31924424 DOI: 10.1016/j.ultrasmedbio.2019.11.008] [Citation(s) in RCA: 24] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2019] [Revised: 11/13/2019] [Accepted: 11/14/2019] [Indexed: 05/14/2023]
Abstract
Ultrasound contrast agents (UCAs) have opened up immense diagnostic possibilities by combined use of indicator dilution principles and dynamic contrast-enhanced ultrasound (DCE-US) imaging. UCAs are microbubbles encapsulated in a biocompatible shell. With a rheology comparable to that of red blood cells, UCAs provide an intravascular indicator for functional imaging of the (micro)vasculature by quantitative DCE-US. Several models of the UCA intravascular kinetics have been proposed to provide functional quantitative maps, aiding diagnosis of different pathological conditions. This article is a comprehensive review of the available methods for quantitative DCE-US imaging based on temporal, spatial and spatiotemporal analysis of the UCA kinetics. The recent introduction of novel UCAs that are targeted to specific vascular receptors has advanced DCE-US to a molecular imaging modality. In parallel, new kinetic models of increased complexity have been developed. The extraction of multiple quantitative maps, reflecting complementary variables of the underlying physiological processes, requires an integrative approach to their interpretation. A probabilistic framework based on emerging machine-learning methods represents nowadays the ultimate approach, improving the diagnostic accuracy of DCE-US imaging by optimal combination of the extracted complementary information. The current value and future perspective of all these advances are critically discussed.
Collapse
Affiliation(s)
- Simona Turco
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands.
| | | | - Rogier Wildeboer
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Marcel Arditi
- École polytechnique fédérale de Lausanne, Lausanne, Switzerland
| | - Hessel Wijkstra
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands; Amsterdam University Medical Center, Amsterdam, The Netherlands
| | - Jonathan R Lindner
- Knight Cardiovascular Center, Oregon Health & Science University, Portland, Oregon, USA
| | - Massimo Mischi
- Department of Electrical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| |
Collapse
|
6
|
Denis de Senneville B, Frulio N, Laumonier H, Salut C, Lafitte L, Trillaud H. Liver contrast-enhanced sonography: computer-assisted differentiation between focal nodular hyperplasia and inflammatory hepatocellular adenoma by reference to microbubble transport patterns. Eur Radiol 2020; 30:2995-3003. [PMID: 32002637 DOI: 10.1007/s00330-019-06566-1] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Revised: 10/21/2019] [Accepted: 10/30/2019] [Indexed: 01/17/2023]
Abstract
OBJECTIVE A new computer tool is proposed to distinguish between focal nodular hyperplasia (FNH) and an inflammatory hepatocellular adenoma (I-HCA) using contrast-enhanced ultrasound (CEUS). The new method was compared with the usual qualitative analysis. METHODS The proposed tool embeds an "optical flow" algorithm, designed to mimic the human visual perception of object transport in image series, to quantitatively analyse apparent microbubble transport parameters visible on CEUS. Qualitative (visual) and quantitative (computer-assisted) CEUS data were compared in a cohort of adult patients with either FNH or I-HCA based on pathological and radiological results. For quantitative analysis, several computer-assisted classification models were tested and subjected to cross-validation. The accuracies, area under the receiver-operating characteristic curve (AUROC), sensitivity and specificity, positive predictive values (PPVs), negative predictive values (NPVs), false predictive rate (FPRs) and false negative rate (FNRs) were recorded. RESULTS Forty-six patients with FNH (n = 29) or I-HCA (n = 17) with 47 tumours (one patient with 2 I-HCA) were analysed. The qualitative diagnostic parameters were accuracy = 93.6%, AUROC = 0.94, sensitivity = 94.4%, specificity = 93.1%, PPV = 89.5%, NPV = 96.4%, FPR = 6.9% and FNR = 5.6%. The quantitative diagnostic parameters were accuracy = 95.9%, AUROC = 0.97, sensitivity = 93.4%, specificity = 97.6%, PPV = 95.3%, NPV = 96.7%, FPR = 2.4% and FNR = 6.6%. CONCLUSIONS Microbubble transport patterns evident on CEUS are valuable diagnostic indicators. Machine-learning algorithms analysing such data facilitate the diagnosis of FNH and I-HCA tumours. KEY POINTS • Distinguishing between focal nodular hyperplasia and an inflammatory hepatocellular adenoma using dynamic contrast-enhanced ultrasound is sometimes difficult. • Microbubble transport patterns evident on contrast-enhanced sonography are valuable diagnostic indicators. • Machine-learning algorithms analysing microbubble transport patterns facilitate the diagnosis of FNH and I-HCA.
Collapse
Affiliation(s)
- Baudouin Denis de Senneville
- Institut de Mathématiques de Bordeaux (IMB), UMR 5251 CNRS/Université de Bordeaux, 351 cours de la Libération, F-33405, Talence, France.
| | - Nora Frulio
- CHU de Bordeaux, Service d'imagerie diagnostique et Interventionnelle Magellan/Saint André, F-33000, Bordeaux, France
| | - Hervé Laumonier
- CHU de Bordeaux, Service d'imagerie diagnostique et Interventionnelle Magellan/Saint André, F-33000, Bordeaux, France
| | - Cécile Salut
- CHU de Bordeaux, Service d'imagerie diagnostique et Interventionnelle Magellan/Saint André, F-33000, Bordeaux, France
| | - Luc Lafitte
- Institut de Mathématiques de Bordeaux (IMB), UMR 5251 CNRS/Université de Bordeaux, 351 cours de la Libération, F-33405, Talence, France
| | - Hervé Trillaud
- CHU de Bordeaux, Service d'imagerie diagnostique et Interventionnelle Magellan/Saint André, F-33000, Bordeaux, France.,EA IMOTION (Imagerie moléculaire et thérapies innovantes en oncologie), Université de Bordeaux, F-33000, Bordeaux, France
| |
Collapse
|
7
|
Solomon O, van Sloun RJG, Wijkstra H, Mischi M, Eldar YC. Exploiting Flow Dynamics for Superresolution in Contrast-Enhanced Ultrasound. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2019; 66:1573-1586. [PMID: 31265391 DOI: 10.1109/tuffc.2019.2926062] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Ultrasound (US) localization microscopy offers new radiation-free diagnostic tools for vascular imaging deep within the tissue. Sequential localization of echoes returned from inert microbubbles (MBs) with low concentration within the bloodstream reveals the vasculature with capillary resolution. Despite its high spatial resolution, low MB concentrations dictate the acquisition of tens of thousands of images, over the course of several seconds to tens of seconds, to produce a single superresolved image. Such long acquisition times and stringent constraints on MB concentration are undesirable in many clinical scenarios. To address these restrictions, sparsity-based approaches have recently been developed. These methods reduce the total acquisition time dramatically, while maintaining good spatial resolution in settings with considerable MB overlap. Here, we further improve the spatial resolution and visual vascular reconstruction quality of sparsity-based superresolution US imaging from low-frame rate acquisitions, by exploiting the inherent flow of MBs and utilize their motion kinematics. We also provide quantitative measurements of MB velocities and show that our approach achieves higher MB recall rate than the state-of-the-art techniques, while increasing contrast agents concentration. Our method relies on simultaneous tracking and sparsity-based detection of individual MBs in a frame-by-frame manner, and as such, may be suitable for real-time implementation. The effectiveness of the proposed approach is demonstrated on both simulations and an in vivo contrast-enhanced human prostate scan, acquired with a clinically approved scanner operating at a 10-Hz frame rate.
Collapse
|
8
|
Lawrence DJ, Huda K, Bayer CL. Longitudinal characterization of local perfusion of the rat placenta using contrast-enhanced ultrasound imaging. Interface Focus 2019; 9:20190024. [PMID: 31485312 DOI: 10.1098/rsfs.2019.0024] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/28/2019] [Indexed: 01/04/2023] Open
Abstract
The placenta performs many physiological functions critical for development. Insufficient placental perfusion, due to improper vascular remodelling, has been linked to many pregnancy-related diseases. To study longitudinal in vivo placental perfusion, we have implemented a pixel-wise time-intensity curve (TIC) analysis of contrast-enhanced ultrasound (CEUS) images. CEUS images were acquired of pregnant Sprague Dawley rats after bolus injections of gas-filled microbubble contrast agents. Conventionally, perfusion can be quantified using a TIC of contrast enhancement in an averaged region of interest. However, the placenta has a complex structure and flow profile, which is insufficiently described using the conventional technique. In this work, we apply curve fitting in each pixel of the CEUS image series in order to quantify haemodynamic parameters in the placenta and surrounding tissue. The methods quantified an increase in mean placental blood volume and relative blood flow from gestational day (GD) 14 to GD18, while the mean transit time of the microbubbles decreased, demonstrating an overall rise in placental perfusion during gestation. The variance of all three parameters increased during gestation, showing that regional differences in perfusion are observable using the pixel-wise TIC approach. Additionally, the high-resolution parametric images show distinct regions of high blood flow developing during late gestation. The developed methods could be applied to assess placental vascular remodelling during the treatment of the pathologies of pregnancy.
Collapse
Affiliation(s)
- Dylan J Lawrence
- Department of Biomedical Engineering, Tulane University, 500 Lindy Boggs Center, New Orleans, LA 70118, USA
| | - Kristie Huda
- Department of Biomedical Engineering, Tulane University, 500 Lindy Boggs Center, New Orleans, LA 70118, USA
| | - Carolyn L Bayer
- Department of Biomedical Engineering, Tulane University, 500 Lindy Boggs Center, New Orleans, LA 70118, USA
| |
Collapse
|