Three-dimensional quantitative photoacoustic tomography using an adjoint radiance Monte Carlo model and gradient descent

Deep learning acceleration of iterative model-based light fluence correction for photoacoustic tomography

Photoacoustic tomography (PAT) is a promising imaging technique that can visualize the distribution of chromophores within biological tissue. However, the accuracy of PAT imaging is compromised by light fluence (LF), which hinders the quantification of light absorbers. Currently, model-based iterative methods are used for LF correction, but they require extensive computational resources due to repeated LF estimation based on differential light transport models. To improve LF correction efficiency, we propose to use Fourier neural operator (FNO), a neural network specially designed for estimating partial differential equations, to learn the forward projection of light transport in PAT. Trained using paired finite-element-based LF simulation data, our FNO model replaces the traditional computational heavy LF estimator during iterative correction, such that the correction procedure is considerably accelerated. Simulation and experimental results demonstrate that our method achieves comparable LF correction quality to traditional iterative methods while reducing the correction time by over 30 times.

Single-stage approach for estimating optical parameters in spectral quantitative photoacoustic tomography

In quantitative photoacoustic tomography, the optical parameters of a target, most importantly the concentrations of chromophores such as deoxygenated and oxygenated hemoglobin, are estimated from photoacoustic data measured on the boundary of the target. In this work, a numerical approximation of a forward model for spectral quantitative photoacoustic tomography is constructed by utilizing the diffusion approximation for light propagation, the acoustic wave equation for ultrasound propagation, and spectral models of optical absorption and scattering to describe the wavelength dependence of the optical parameters. The related inverse problem is approached in the framework of Bayesian inverse problems. Concentrations of four chromophores (deoxygenated and oxygenated hemoglobin, water, and lipid), two scattering parameters (reference scattering and scattering power), and the Grüneisen parameter are estimated in a single-stage from photoacoustic data. The methodology is evaluated using numerical simulations in different full-view and limited-view imaging settings. The results show that, utilizing spectral data and models, the spectral optical parameters and the Grüneisen parameter can be simultaneously estimated. Furthermore, the approach can also be utilized in limited-view imaging situations.

Quantitative photoacoustic tomography: modeling and inverse problems

Significance

Quantitative photoacoustic tomography (QPAT) exploits the photoacoustic effect with the aim of estimating images of clinically relevant quantities related to the tissue's optical absorption. The technique has two aspects: an acoustic part, where the initial acoustic pressure distribution is estimated from measured photoacoustic time-series, and an optical part, where the distributions of the optical parameters are estimated from the initial pressure.

Aim

Our study is focused on the optical part. In particular, computational modeling of light propagation (forward problem) and numerical solution methodologies of the image reconstruction (inverse problem) are discussed.

Approach

The commonly used mathematical models of how light and sound propagate in biological tissue are reviewed. A short overview of how the acoustic inverse problem is usually treated is given. The optical inverse problem and methods for its solution are reviewed. In addition, some limitations of real-life measurements and their effect on the inverse problems are discussed.

Results

An overview of QPAT with a focus on the optical part was given. Computational modeling and inverse problems of QPAT were addressed, and some key challenges were discussed. Furthermore, the developments for tackling these problems were reviewed. Although modeling of light transport is well-understood and there is a well-developed framework of inverse mathematics for approaching the inverse problem of QPAT, there are still challenges in taking these methodologies to practice.

Conclusions

Modeling and inverse problems of QPAT together were discussed. The scope was limited to the optical part, and the acoustic aspects were discussed only to the extent that they relate to the optical aspect.

Pixel-wise reconstruction of tissue absorption coefficients in photoacoustic tomography using a non-segmentation iterative method

In Photoacoustic Tomography (PAT), the acquired image represents a light energy deposition map of the imaging object. For quantitative imaging, the PAT image is converted into an absorption coefficient ( μ a ) map by dividing the light fluence (LF). Previous methods usually assume a uniform tissue μ a distribution, and consequently degrade the LF correction results. Here, we propose a simple method to reconstruct the pixel-wise μ a map. Our method is based on a non-segmentation-based iterative algorithm, which alternately optimizes the LF distribution and the μ a map. Using simulation data, as well as phantom and animal data, we implemented our algorithm and compared it to segmentation-based correction methods. The results show that our method can obtain accurate estimation of the LF distribution and therefore improve the image quality and feature visibility of the μ a map. Our method may facilitate efficient calculation of the concentration distributions of endogenous and exogenous agents in vivo.

Spectral crosstalk in photoacoustic computed tomography

Multispectral photoacoustic (PA) imaging faces two major challenges: the spectral coloring effect, which has been studied extensively as an optical inversion problem, and the spectral crosstalk, which is basically a result of non-ideal acoustic inversion. So far, there is no systematic work to analyze the spectral crosstalk because acoustic inversion and spectroscopic measurement are always treated as decoupled. In this work, we theorize and demonstrate through a series of simulations and experiments how imperfect acoustic inversion induces inaccurate PA spectrum measurement. We provide detailed analysis to elucidate how different factors, including limited bandwidth, limited view, light attenuation, out-of-plane signal, and image reconstruction schemes, conspire to render the measured PA spectrum inaccurate. We found that the model-based reconstruction outperforms universal back-projection in suppressing the spectral crosstalk in some cases.

Adaptive stochastic Gauss-Newton method with optical Monte Carlo for quantitative photoacoustic tomography

SIGNIFICANCE

The image reconstruction problem in quantitative photoacoustic tomography (QPAT) is an ill-posed inverse problem. Monte Carlo method for light transport can be utilized in solving this image reconstruction problem.

AIM

The aim was to develop an adaptive image reconstruction method where the number of photon packets in Monte Carlo simulation is varied to achieve a sufficient accuracy with reduced computational burden.

APPROACH

The image reconstruction problem was formulated as a minimization problem. An adaptive stochastic Gauss-Newton (A-SGN) method combined with Monte Carlo method for light transport was developed. In the algorithm, the number of photon packets used on Gauss-Newton (GN) iteration was varied utilizing a so-called norm test.

RESULTS

The approach was evaluated with numerical simulations. With the proposed approach, the number of photon packets needed for solving the inverse problem was significantly smaller than in a conventional approach where the number of photon packets was fixed for each GN iteration.

CONCLUSIONS

The A-SGN method with a norm test can be utilized in QPAT to provide accurate and computationally efficient solutions.

Quantitative Photoacoustic Reconstruction of the Optical Properties of Intervertebral Discs Using a Gradient Descent Scheme

The intervertebral discs (IVD) are among the essential organs of the human body, ensuring the mobility of the spine. These organs possess a high proportion of water. However, as the discs age, this content decreases, which can potentially lead to various diseases called degenerative disc diseases. This water content is therefore an important indicator of the well-being of the disc. In this paper, we propose photoacoustic imaging as a means of probing a disc and quantitatively recovering its molecular composition, which should allow concluding on its state. An adjoint-assisted gradient descent scheme is implemented to recover the optical absorption coefficient in the disc, from which, if spectroscopic measurements are performed, the molecular composition can be deduced. The algorithm was tested on synthetic measurements. A realistic numerical phantom was built from magnetic resonance imaging of an actual IVD of a pig. A simplified experiment, with a single laser source, was performed. Results show the feasibility of using photoacoustics imaging to probe IVDs. The influences of exact and approximate formulations of the gradient are studied. The impact of noise on the reconstructions is also evaluated.

Nonlinear iterative perturbation scheme with simplified spherical harmonics (SP3 ) light propagation model for quantitative photoacoustic tomography

When using quantitative photoacoustic tomography (q-PAT) reconstruction to recover the optical absorption coefficients of tissue, the commonly used diffusion equation has several limitations in the case of the objects that have small geometries and high-absorption or low-scattering areas. Furthermore, the conventional perturbation reconstruction strategy is unsatisfactory when the target tissue containing large heterogeneous features. We herein present a modified q-PAT implementation that employs the higher-order photon migration model achieving the tradeoff between mathematical rigidity and computational efficiency. Besides, a nonlinear iterative method is proposed to obtain the perturbations of optical absorption considering the updating of the sensitivity matrix in calculating the fluence perturbations. Consequently, the distribution of tissue optical properties can be recovered in a robust way even if the targets with high absorption are included. The proposed approach has been validated by simulation, phantom and in vivo experiments, exhibiting promising performances in image fidelity and quantitative feasibility for practical applications.

Real-time interleaved spectroscopic photoacoustic and ultrasound (PAUS) scanning with simultaneous fluence compensation and motion correction

For over two decades photoacoustic imaging has been tested clinically, but successful human trials have been limited. To enable quantitative clinical spectroscopy, the fundamental issues of wavelength-dependent fluence variations and inter-wavelength motion must be overcome. Here we propose a real-time, spectroscopic photoacoustic/ultrasound (PAUS) imaging approach using a compact, 1-kHz rate wavelength-tunable laser. Instead of illuminating tissue over a large area, the fiber-optic delivery system surrounding an US array sequentially scans a narrow laser beam, with partial PA image reconstruction for each laser pulse. The final image is then formed by coherently summing partial images. This scheme enables (i) automatic compensation for wavelength-dependent fluence variations in spectroscopic PA imaging and (ii) motion correction of spectroscopic PA frames using US speckle tracking in real-time systems. The 50-Hz video rate PAUS system is demonstrated in vivo using a murine model of labelled drug delivery.

Perturbation Monte Carlo Method for Quantitative Photoacoustic Tomography

Quantitative photoacoustic tomography aims at estimating optical parameters from photoacoustic images that are formed utilizing the photoacoustic effect caused by the absorption of an externally introduced light pulse. This optical parameter estimation is an ill-posed inverse problem, and thus it is sensitive to measurement and modeling errors. In this work, we propose a novel way to solve the inverse problem of quantitative photoacoustic tomography based on the perturbation Monte Carlo method. Monte Carlo method for light propagation is a stochastic approach for simulating photon trajectories in a medium with scattering particles. It is widely accepted as an accurate method to simulate light propagation in tissues. Furthermore, it is numerically robust and easy to implement. Perturbation Monte Carlo maintains this robustness and enables forming gradients for the solution of the inverse problem. We validate the method and apply it in the framework of Bayesian inverse problems. The simulations show that the perturbation Monte Carlo method can be used to estimate spatial distributions of both absorption and scattering parameters simultaneously. These estimates are qualitatively good and quantitatively accurate also in parameter scales that are realistic for biological tissues.

Correction of wavelength-dependent laser fluence in swept-beam spectroscopic photoacoustic imaging with a hand-held probe

Recently, we demonstrated an integrated photoacoustic (PA) and ultrasound (PAUS) system using a kHz-rate wavelength-tunable laser and a swept-beam delivery approach. It irradiates a medium using a narrow laser beam swept at high repetition rate (∼1 kHz) over the desired imaging area, in contrast to the conventional PA approach using broad-beam illumination at a low repetition rate (10-50 Hz). Here, we present a method to correct the wavelength-dependent fluence distribution and demonstrate its performance in phantom studies using a conventional limited view/bandwidth hand-held US probe. We adopted analytic fluence models, extending diffusion theory for the case of a pencil beam obliquely incident on an optically homogenous turbid medium, and developed a robust method to estimate fluence attenuation in the medium using PA measurements acquired from multiple fiber-irradiation positions swept at a kHz rate. We conducted comprehensive simulation tests and phantom studies using well-known contrast-agents to validate the reliability of the fluence model and its spectral corrections.

Evaluation of Fluence Correction Algorithms in Multispectral Photoacoustic Imaging

Multispectral photoacoustic imaging (MPAI) is a promising emerging diagnostic technology, but fluence artifacts can degrade device performance. Our goal was to develop well-validated phantom-based test methods for evaluating and comparing MPAI fluence correction algorithms, including a heuristic diffusion approximation, Monte Carlo simulations, and an algorithm we developed based on novel application of the diffusion dipole model (DDM). Phantoms simulated a range of breast-mimicking optical properties and contained channels filled with chromophore solutions (ink, hemoglobin, or copper sulfate) or connected to a previously developed blood flow circuit providing tunable oxygen saturation (SO₂). The DDM algorithm achieved similar spectral recovery and SO₂ measurement accuracy to Monte Carlo-based corrections with lower computational cost, potentially providing an accurate, real-time correction approach. Algorithms were sensitive to optical property uncertainty, but error was minimized by matching phantom albedo. The developed test methods may provide a foundation for standardized assessment of MPAI fluence correction algorithm performance.

Efficient inversion strategies for estimating optical properties with Monte Carlo radiative transport models

SIGNIFICANCE

Indirect imaging problems in biomedical optics generally require repeated evaluation of forward models of radiative transport, for which Monte Carlo is accurate yet computationally costly. We develop an approach to reduce this bottleneck, which has significant implications for quantitative tomographic imaging in a variety of medical and industrial applications.

AIM

Our aim is to enable computationally efficient image reconstruction in (hybrid) diffuse optical modalities using stochastic forward models.

APPROACH

Using Monte Carlo, we compute a fully stochastic gradient of an objective function for a given imaging problem. Leveraging techniques from the machine learning community, we then adaptively control the accuracy of this gradient throughout the iterative inversion scheme to substantially reduce computational resources at each step.

RESULTS

For example problems of quantitative photoacoustic tomography and ultrasound-modulated optical tomography, we demonstrate that solutions are attainable using a total computational expense that is comparable to (or less than) that which is required for a single high-accuracy forward run of the same Monte Carlo model.

CONCLUSIONS

This approach demonstrates significant computational savings when approaching the full nonlinear inverse problem of optical property estimation using stochastic methods.

Toward accurate quantitative photoacoustic imaging: learning vascular blood oxygen saturation in three dimensions

SIGNIFICANCE

Two-dimensional (2-D) fully convolutional neural networks have been shown capable of producing maps of sO2 from 2-D simulated images of simple tissue models. However, their potential to produce accurate estimates in vivo is uncertain as they are limited by the 2-D nature of the training data when the problem is inherently three-dimensional (3-D), and they have not been tested with realistic images.

AIM

To demonstrate the capability of deep neural networks to process whole 3-D images and output 3-D maps of vascular sO2 from realistic tissue models/images.

APPROACH

Two separate fully convolutional neural networks were trained to produce 3-D maps of vascular blood oxygen saturation and vessel positions from multiwavelength simulated images of tissue models.

RESULTS

The mean of the absolute difference between the true mean vessel sO2 and the network output for 40 examples was 4.4% and the standard deviation was 4.5%.

CONCLUSIONS

3-D fully convolutional networks were shown capable of producing accurate sO2 maps using the full extent of spatial information contained within 3-D images generated under conditions mimicking real imaging scenarios. We demonstrate that networks can cope with some of the confounding effects present in real images such as limited-view artifacts and have the potential to produce accurate estimates in vivo.

One-step fluorescence photoacoustic tomography with the optical radiative transfer model

We present adjoint-based Jacobian as well as gradient evaluations and corresponding reconstruction schemes to solve the fully nonlinear, optical radiative transfer modeled one-step fluorescence photoacoustic tomographic (FPAT) problem, which aims to reconstruct the map of absorption coefficient of the exogenous fluorophore from boundary photoacoustic data. The radiative transport equation (RTE) and frequency-domain photoacoustic equation have been employed to model light and photoacoustic wave propagation, respectively. Levenberg-Marquardt and Broyden-Fletcher-Goldfarb-Shanno reconstruction schemes have been used corresponding to the evaluated Jacobians and gradients, respectively. Numerical reconstructions obtained from the two schemes have been validated for scattering-dominant as well as nonscattering-dominant media in 2D. To the best of our knowledge, these are the first one-step FPAT reconstruction results in literature based on the optical RTE model.

Gradient-based one-step fluorescence photoacoustic tomography

We propose a gradient-based scheme to solve the fluorescence photoacoustic tomographic (FPAT) problem in a fully nonlinear one-step setting, which aims to reconstruct the map of the absorption coefficient of an exogenous fluorophore from boundary photoacoustic pressure data. Adjoint-based gradient evaluation is presented for the FPAT problem in a frequency-domain photoacoustic equation setting. Numerical validations of the resulting Broyden-Fletcher-Goldfarb-Shanno (BFGS) reconstruction scheme are carried out in two dimensions for full- as well as limited-data test cases, and the results are compared with existing Jacobian-based one-step FPAT reconstructions. The reasonably comparable results of the one-step gradient- and Jacobian-based FPAT reconstruction schemes, coupled with the significant computational savings of the former, potentially set up the one-step gradient-based schemes as an advantageous method of choice for FPAT reconstructions. Further reconstruction studies carried out using quantitative photoacoustic tomography (QPAT)-based chromophore reconstructions as inputs to the FPAT inversions show a robustness of fluorophore absorption coefficient reconstructions to the QPAT-obtained inputs.

Reliability assessment for blood oxygen saturation levels measured with optoacoustic imaging

SIGNIFICANCE

Quantitative optoacoustic (OA) imaging has the potential to provide blood oxygen saturation (SO2) estimates due to the proportionality between the measured signal and the blood's absorption coefficient. However, due to the wavelength-dependent attenuation of light in tissue, a spectral correction of the OA signals is required, and a prime challenge is the validation of both the optical characterization of the tissue and the SO2.

AIM

We propose to assess the reliability of SO2 levels retrieved from spectral fitting by measuring the similarity of OA spectra to the fitted blood absorption spectra.

APPROACH

We introduce a metric that quantifies the trends of blood spectra by assigning a pair of spectral slopes to each spectrum. The applicability of the metric is illustrated with in vivo measurements on a human forearm.

RESULTS

We show that physiologically sound SO2 values do not necessarily imply a successful spectral correction and demonstrate how the metric can be used to distinguish SO2 values that are trustworthy from unreliable ones.

CONCLUSIONS

The metric is independent of the methods used for the OA data acquisition, image reconstruction, and spectral correction, thus it can be readily combined with existing approaches, in order to monitor the accuracy of quantitative OA imaging.

Quantitative PA tomography of high resolution 3-D images: Experimental validation in a tissue phantom

Quantitative photoacoustic tomography aims to recover the spatial distribution of absolute chromophore concentrations and their ratios from deep tissue, high-resolution images. In this study, a model-based inversion scheme based on a Monte-Carlo light transport model is experimentally validated on 3-D multispectral images of a tissue phantom acquired using an all-optical scanner with a planar detection geometry. A calibrated absorber allowed scaling of the measured data during the inversion, while an acoustic correction method was employed to compensate the effects of limited view detection. Chromophore- and fluence-dependent step sizes and Adam optimization were implemented to achieve rapid convergence. High resolution 3-D maps of absolute concentrations and their ratios were recovered with high accuracy. Potential applications of this method include quantitative functional and molecular photoacoustic tomography of deep tissue in preclinical and clinical studies.