Three dimensional photoacoustic tomography in Bayesian framework

Deep learning framework for three-dimensional surface reconstruction of object of interest in photoacoustic tomography

Photoacoustic tomography (PAT) is a non-ionizing hybrid imaging technology of clinical importance that combines the high contrast of optical imaging with the high penetration of ultrasonic imaging. Two-dimensional (2D) tomographic images can only provide the cross-sectional structure of the imaging target rather than its overall spatial morphology. This work proposes a deep learning framework for reconstructing three-dimensional (3D) surface of an object of interest from a series of 2D images. It achieves end-to-end mapping from a series of 2D images to a 3D image, visually displaying the overall morphology of the object. The framework consists of four modules: segmentation module, point cloud generation module, point cloud completion module, and mesh conversion module, which respectively implement the tasks of segmenting a region of interest, generating a sparse point cloud, completing sparse point cloud and reconstructing 3D surface. The network model is trained on simulation data sets and verified on simulation, phantom, and in vivo data sets. The results showed superior 3D reconstruction performance both visually and on the basis of quantitative evaluation metrics compared to the state-of-the-art non-learning and learning approaches. This method potentially enables high-precision 3D surface reconstruction from the tomographic images output by the preclinical PAT system without changing the imaging system. It provides a general deep learning scheme for 3D reconstruction from tomographic scanning data.

Assembly of fluorophore J-aggregates with nanospacer onto mesoporous nanoparticles for enhanced photoacoustic imaging

Many fluorophores, such as indocyanine green (ICG), have poor photostability and low photothermal efficiency hindering their wide application in photoacoustic (PA) tomography. In the present study, a supramolecular assembly approach was used to develop the hybrid nanoparticles (Hy NPs) of ICG and porous silicon (PSi) as a novel contrast agent for PA tomography. ICG was assembled on the PSi NPs to form J-aggregates within 30 min. The Hy NPs presented a red-shifted absorption, improved photothermal stability, and enhanced PA performance. Furthermore, 1-dodecene (DOC) was assembled into the NPs as a 'nanospacer', which enhanced non-radiative decay for increased thermal release. Compared to the Hy NPs, adding DOC into the Hy NPs (DOC-Hy) increased the PA signal by 83%. Finally, the DOC-Hy was detectable in PA tomography at 1.5 cm depth in tissue phantom even though its concentration was as low as 6.25 µg/mL, indicating the potential for deep tissue PA imaging.

Photoacoustic computed tomography for functional human brain imaging [Invited]

The successes of magnetic resonance imaging and modern optical imaging of human brain function have stimulated the development of complementary modalities that offer molecular specificity, fine spatiotemporal resolution, and sufficient penetration simultaneously. By virtue of its rich optical contrast, acoustic resolution, and imaging depth far beyond the optical transport mean free path (∼1 mm in biological tissues), photoacoustic computed tomography (PACT) offers a promising complementary modality. In this article, PACT for functional human brain imaging is reviewed in its hardware, reconstruction algorithms, in vivo demonstration, and potential roadmap.

Computationally Efficient Forward Operator for Photoacoustic Tomography Based on Coordinate Transformations

Photoacoustic tomography (PAT) is an imaging modality that utilizes the photoacoustic effect. In PAT, a photoacoustic image is computed from measured data by modeling ultrasound propagation in the imaged domain and solving an inverse problem utilizing a discrete forward operator. However, in realistic measurement geometries with several ultrasound transducers and relatively large imaging volume, an explicit formation and use of the forward operator can be computationally prohibitively expensive. In this work, we propose a transformation-based approach for efficient modeling of photoacoustic signals and reconstruction of photoacoustic images. In the approach, the forward operator is constructed for a reference ultrasound transducer and expanded into a general measurement geometry using transformations that map the formulated forward operator in local coordinates to the global coordinates of the measurement geometry. The inverse problem is solved using a Bayesian framework. The approach is evaluated with numerical simulations and experimental data. The results show that the proposed approach produces accurate 3-D photoacoustic images with a significantly reduced computational cost both in memory requirements and time. In the studied cases, depending on the computational factors, such as discretization, over the 30-fold reduction in memory consumption was achieved without a reduction in image quality compared to a conventional approach.

Non-local means improves total-variation constrained photoacoustic image reconstruction

Photoacoustic/Optoacoustic tomography aims to reconstruct maps of the initial pressure rise induced by the absorption of light pulses in tissue. This reconstruction is an ill-conditioned and under-determined problem, when the data acquisition protocol involves limited detection positions. The aim of the work is to develop an inversion method which integrates denoising procedure within the iterative model-based reconstruction to improve quantitative performance of optoacoustic imaging. Among the model-based schemes, total-variation (TV) constrained reconstruction scheme is a popular approach. In this work, a two-step approach was proposed for improving the TV constrained optoacoustic inversion by adding a non-local means based filtering step within each TV iteration. Compared to TV-based reconstruction, inclusion of this non-local means step resulted in signal-to-noise ratio improvement of 2.5 dB in the reconstructed optoacoustic images.

Model-based Bayesian analysis in acoustics-A tutorial

Bayesian analysis has been increasingly applied in many acoustical applications. In these applications, prediction models are often involved to better understand the process under investigation by purposely learning from the experimental observations. When involving the model-based data analysis within a Bayesian framework, issues related to incorporating the experimental data and assigning probabilities into the inferential learning procedure need fundamental consideration. This paper introduces Bayesian probability theory on a tutorial level, including fundamental rules for manipulating the probabilities, and the principle of maximum entropy for assignment of necessary probabilities prior to the data analysis. This paper also employs a number of examples recently published in this journal to explain detailed steps on how to apply the model-based Bayesian inference to solving acoustical problems.

Modeling of Errors Due to Uncertainties in Ultrasound Sensor Locations in Photoacoustic Tomography

Photoacoustic tomography is an imaging modality based on the photoacoustic effect caused by the absorption of an externally introduced light pulse. In the inverse problem of photoacoustic tomography, the initial pressure generated through the photoacoustic effect is estimated from a measured photoacoustic time-series utilizing a forward model for ultrasound propagation. Due to the ill-posedness of the inverse problem, errors in the forward model or measurements can result in significant errors in the solution of the inverse problem. In this work, we study modeling of errors caused by uncertainties in ultrasound sensor locations in photoacoustic tomography using a Bayesian framework. The approach is evaluated with simulated and experimental data. The results indicate that the inverse problem of photoacoustic tomography is sensitive even to small uncertainties in sensor locations. Furthermore, these uncertainties can lead to significant errors in the estimates and reduction of the quality of the photoacoustic images. In this work, we show that the errors due to uncertainties in ultrasound sensor locations can be modeled and compensated using Bayesian approximation error modeling.

Modelling of errors due to speed of sound variations in photoacoustic tomography using a Bayesian framework

Inverse problem of estimating initial pressure in photoacoustic tomography is ill-posed and thus sensitive to errors in modelling and measurements. In practical experiments, accurate knowledge of the speed of sound of the imaged target is commonly not available, and therefore an approximate speed of sound is used in the computational model. This can result in errors in the solution of the inverse problem that can appear as artefacts in the reconstructed images. In this paper, the inverse problem of photoacoustic tomography is approached in a Bayesian framework. Errors due to uncertainties in the speed of sound are modelled using Bayesian approximation error modelling. Estimation of the initial pressure distribution together with information on the reliability of these estimates are considered. The approach was studied using numerical simulations. The results show that uncertainties in the speed of sound can cause significant errors in the solution of the inverse problem. However, modelling of these uncertainties improves the accuracy of the solution.

Image Reconstruction with Reliability Assessment in Quantitative Photoacoustic Tomography

Quantitative photoacoustic tomography is a novel imaging method which aims to reconstruct optical parameters of an imaged target based on initial pressure distribution, which can be obtained from ultrasound measurements. In this paper, a method for reconstructing the optical parameters in a Bayesian framework is presented. In addition, evaluating the credibility of the estimates is studied. Furthermore, a Bayesian approximation error method is utilized to compensate the modeling errors caused by coarse discretization of the forward model. The reconstruction method and the reliability of the credibility estimates are investigated with two-dimensional numerical simulations. The results suggest that the Bayesian approach can be used to obtain accurate estimates of the optical parameters and the credibility estimates of these parameters. Furthermore, the Bayesian approximation error method can be used to compensate for the modeling errors caused by a coarse discretization, which can be used to reduce the computational costs of the reconstruction procedure. In addition, taking the modeling errors into account can increase the reliability of the credibility estimates.