Stabilizing deep tomographic reconstruction: Part B. Convergence analysis and adversarial attacks

Image-spectral decomposition extended-learning assisted by sparsity for multi-energy computed tomography reconstruction

Background

Multi-energy computed tomography (CT) provides multiple channel-wise reconstructed images, and they can be used for material identification and k-edge imaging. Nonetheless, the projection datasets are frequently corrupted by various noises (e.g., electronic, Poisson) in the acquisition process, resulting in lower signal-noise-ratio (SNR) measurements. Multi-energy CT images have local sparsity, nonlocal self-similarity in spatial dimension, and correlation in spectral dimension.

Methods

In this paper, we propose an image-spectral decomposition extended-learning assisted by sparsity (IDEAS) method to fully exploit these intrinsic priors for multi-energy CT image reconstruction. Particularly, a nonlocal low-rank Tucker decomposition (TD) is employed to utilize the correlation and nonlocal self-similarity priors. Moreover, considering the advantages of multi-task tensor dictionary learning (TDL) in sparse representation, an adaptive spatial dictionary and an adaptive spectral dictionary are trained during the iterative reconstruction process. Furthermore, a weighted total variation (TV) regularization term is employed to encourage local sparsity.

Results

Numerical simulation, physical phantom, and preclinical mouse experiments are performed to validate the proposed IDEAS algorithm. Specifically, in the simulation experiments, the proposed IDEAS reconstructed high-quality images that are very close to the references. For example, the root mean square error (RMSE) of IDEAS image in energy bin 1 is as low as 0.0672, while the RMSE of other methods are higher than 0.0843. Besides, the structural similarity (SSIM) of IDEAS reconstructed image in energy bin 1 is greater than 0.98. For material decomposition, the RMSE of IDEAS bone component is as low as 0.0152, and other methods are higher than 0.0199. In addition, the computational cost of IDEAS is as low as 98.8 s for one iteration, and the competing tensor decomposition method is higher than 327 s.

Conclusions

To further improve the quality of the reconstructed multi-energy CT images, multiple prior regularizations are introduced to the multi-energy CT reconstructed model, leading to an IDEAS method. Both qualitative and quantitative evaluation of our results confirm the outstanding performance of the proposed algorithm compared to the state-of-the-arts.

Low-dose spectral reconstruction with global, local, and nonlocal priors based on subspace decomposition

Background

Multienergy computed tomography (MECT) is a promising imaging modality for material decomposition, lesion detection, and other clinical applications. However, there is an urgent need to design efficient and accurate algorithms to solve the inverse problems related to spectral reconstruction and improve image quality, especially under low-dose and incomplete datasets. The key issue for MECT reconstruction is how to efficiently describe the interchannel and intrachannel priors in multichannel images.

Methods

In this model, in order to correlate the similarities of interchannel images and regularize the multichannel images, the global, local, and nonlocal priors are jointly integrated into the low-dose MECT reconstruction model. First, the subspace decomposition method first employs the global low-rankness to map the original MECT images to the low-dimensional eigenimages. Then, nonlocal self-similarity of the eigenimages is cascaded into the optimization model. Additionally, the L0 quasi-norm on gradient images is incorporated into the proposed method to further enhance the local sparsity of intrachannel images. The alternating direction method is applied to solve the optimization model in an iterative scheme.

Results

Simulation, preclinical, and real datasets were applied to validate the effectiveness of the proposed method. From the simulation dataset, the new method was found to reduce the root-mean-square error (RMSE) by 42.31% compared with the latest research fourth-order nonlocal tensor decomposition MECT reconstruction (FONT-SIR) method under 160 projection views. The calculation time of an iteration for the proposed method was 23.07% of the FONT-SIR method. The results of material decomposition in real mouse data further confirmed the accuracy of the proposed method for different materials.

Conclusions

We developed a method in which the global, local, and nonlocal priors are jointly used to develop the reconstruction model for low-dose MECT, where the global low-rankness and nonlocal prior are cascaded by subspace decomposition and block-matching, and the L0 sparsity is applied to express the local prior. The results of the experiments demonstrate that the proposed method based on subspace improves computational efficiency and has advantages in noise suppression and structure preservation over competing algorithms.

Development of metaverse for intelligent healthcare

The metaverse integrates physical and virtual realities, enabling humans and their avatars to interact in an environment supported by technologies such as high-speed internet, virtual reality, augmented reality, mixed and extended reality, blockchain, digital twins and artificial intelligence (AI), all enriched by effectively unlimited data. The metaverse recently emerged as social media and entertainment platforms, but extension to healthcare could have a profound impact on clinical practice and human health. As a group of academic, industrial, clinical and regulatory researchers, we identify unique opportunities for metaverse approaches in the healthcare domain. A metaverse of 'medical technology and AI' (MeTAI) can facilitate the development, prototyping, evaluation, regulation, translation and refinement of AI-based medical practice, especially medical imaging-guided diagnosis and therapy. Here, we present metaverse use cases, including virtual comparative scanning, raw data sharing, augmented regulatory science and metaversed medical intervention. We discuss relevant issues on the ecosystem of the MeTAI metaverse including privacy, security and disparity. We also identify specific action items for coordinated efforts to build the MeTAI metaverse for improved healthcare quality, accessibility, cost-effectiveness and patient satisfaction.

Stabilizing deep tomographic reconstruction: Part A. Hybrid framework and experimental results

A recent PNAS paper reveals that several popular deep reconstruction networks are unstable. Specifically, three kinds of instabilities were reported: (1) strong image artefacts from tiny perturbations, (2) small features missed in a deeply reconstructed image, and (3) decreased imaging performance with increased input data. Here, we propose an analytic compressed iterative deep (ACID) framework to address this challenge. ACID synergizes a deep network trained on big data, kernel awareness from compressed sensing (CS)-inspired processing, and iterative refinement to minimize the data residual relative to real measurement. Our study demonstrates that the ACID reconstruction is accurate, is stable, and sheds light on the converging mechanism of the ACID iteration under a bounded relative error norm assumption. ACID not only stabilizes an unstable deep reconstruction network but also is resilient against adversarial attacks to the whole ACID workflow, being superior to classic sparsity-regularized reconstruction and eliminating the three kinds of instabilities.