1
|
Shan S, Zhang C, Cheng M, Qi Y, Yu D, Wildgruber M, Ma X. SPFS: SNR peak-based frequency selection method to alleviate resolution degradation in MPI real-time imaging. Phys Med Biol 2024; 69:115028. [PMID: 38593815 DOI: 10.1088/1361-6560/ad3c90] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2023] [Accepted: 04/09/2024] [Indexed: 04/11/2024]
Abstract
Objective. The primary objective of this study is to address the reconstruction time challenge in magnetic particle imaging (MPI) by introducing a novel approach named SNR-peak-based frequency selection (SPFS). The focus is on improving spatial resolution without compromising reconstruction speed, thereby enhancing the clinical potential of MPI for real-time imaging.Approach. To overcome the trade-off between reconstruction time and spatial resolution in MPI, the researchers propose SPFS as an innovative frequency selection method. Unlike conventional SNR-based selection, SPFS prioritizes frequencies with signal-to-noise ratio (SNR) peaks that capture crucial system matrix information. This adaptability to varying quantities of selected frequencies enhances versatility in the reconstruction process. The study compares the spatial resolution of MPI reconstruction using both SNR-based and SPFS frequency selection methods, utilizing simulated and real device data.Main results.The research findings demonstrate that the SPFS approach substantially improves image resolution in MPI, especially when dealing with a limited number of frequency components. By focusing on SNR peaks associated with critical system matrix information, SPFS mitigates the spatial resolution degradation observed in conventional SNR-based selection methods. The study validates the effectiveness of SPFS through the assessment of MPI reconstruction spatial resolution using both simulated and real device data, highlighting its potential to address a critical limitation in the field.Significance.The introduction of SPFS represents a significant breakthrough in MPI technology. The method not only accelerates reconstruction time but also enhances spatial resolution, thus expanding the clinical potential of MPI for various applications. The improved real-time imaging capabilities of MPI, facilitated by SPFS, hold promise for advancements in drug delivery, plaque assessment, tumor treatment, cerebral perfusion evaluation, immunotherapy guidance, andin vivocell tracking.
Collapse
Affiliation(s)
- Shihao Shan
- School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, People's Republic of China
| | - Chenglong Zhang
- School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, People's Republic of China
| | - Min Cheng
- Xintai hospital of traditional Chinese medicine, Tai'an, Shandong, People's Republic of China
| | - Yafei Qi
- Department of Radiology, Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong 250012, People's Republic of China
| | - Dexin Yu
- Department of Radiology, Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan, Shandong 250012, People's Republic of China
| | - Moritz Wildgruber
- Department of Radiology, University Hospital, LMU Munich, Munich D-81337, Germany
| | - Xiaopeng Ma
- School of Control Science and Engineering, Shandong University, Jinan, Shandong 250061, People's Republic of China
| |
Collapse
|
2
|
Gungor A, Askin B, Soydan DA, Saritas EU, Top CB, Cukur T. TranSMS: Transformers for Super-Resolution Calibration in Magnetic Particle Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2022; 41:3562-3574. [PMID: 35816533 DOI: 10.1109/tmi.2022.3189693] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
Magnetic particle imaging (MPI) offers exceptional contrast for magnetic nanoparticles (MNP) at high spatio-temporal resolution. A common procedure in MPI starts with a calibration scan to measure the system matrix (SM), which is then used to set up an inverse problem to reconstruct images of the MNP distribution during subsequent scans. This calibration enables the reconstruction to sensitively account for various system imperfections. Yet time-consuming SM measurements have to be repeated under notable changes in system properties. Here, we introduce a novel deep learning approach for accelerated MPI calibration based on Transformers for SM super-resolution (TranSMS). Low-resolution SM measurements are performed using large MNP samples for improved signal-to-noise ratio efficiency, and the high-resolution SM is super-resolved via model-based deep learning. TranSMS leverages a vision transformer module to capture contextual relationships in low-resolution input images, a dense convolutional module for localizing high-resolution image features, and a data-consistency module to ensure measurement fidelity. Demonstrations on simulated and experimental data indicate that TranSMS significantly improves SM recovery and MPI reconstruction for up to 64-fold acceleration in two-dimensional imaging.
Collapse
|
3
|
Yin L, Li W, Du Y, Wang K, Liu Z, Hui H, Tian J. Recent developments of the reconstruction in magnetic particle imaging. Vis Comput Ind Biomed Art 2022; 5:24. [PMID: 36180612 PMCID: PMC9525566 DOI: 10.1186/s42492-022-00120-5] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2022] [Accepted: 08/16/2022] [Indexed: 11/07/2022] Open
Abstract
Magnetic particle imaging (MPI) is an emerging molecular imaging technique with high sensitivity and temporal-spatial resolution. Image reconstruction is an important research topic in MPI, which converts an induced voltage signal into the image of superparamagnetic iron oxide particles concentration distribution. MPI reconstruction primarily involves system matrix- and x-space-based methods. In this review, we provide a detailed overview of the research status and future research trends of these two methods. In addition, we review the application of deep learning methods in MPI reconstruction and the current open sources of MPI. Finally, research opinions on MPI reconstruction are presented. We hope this review promotes the use of MPI in clinical applications.
Collapse
Affiliation(s)
- Lin Yin
- grid.429126.a0000 0004 0644 477XCAS Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190 China ,Beijing Key Laboratory of Molecular Imaging, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Wei Li
- grid.258164.c0000 0004 1790 3548Medical Imaging Center, the First Affiliated Hospital, Jinan University, Guangdong, 510632 China
| | - Yang Du
- grid.429126.a0000 0004 0644 477XCAS Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190 China ,Beijing Key Laboratory of Molecular Imaging, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Kun Wang
- grid.429126.a0000 0004 0644 477XCAS Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190 China ,Beijing Key Laboratory of Molecular Imaging, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Zhenyu Liu
- grid.429126.a0000 0004 0644 477XCAS Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190 China ,Beijing Key Laboratory of Molecular Imaging, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Hui Hui
- grid.429126.a0000 0004 0644 477XCAS Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190 China ,Beijing Key Laboratory of Molecular Imaging, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419University of Chinese Academy of Sciences, Beijing, 100049 China
| | - Jie Tian
- grid.429126.a0000 0004 0644 477XCAS Key Laboratory of Molecular Imaging, the State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, 100190 China ,Beijing Key Laboratory of Molecular Imaging, Beijing, 100190 China ,grid.410726.60000 0004 1797 8419University of Chinese Academy of Sciences, Beijing, 100049 China ,grid.64939.310000 0000 9999 1211Beijing Advanced Innovation Center for Big Data-Based Precision Medicine, School of Medicine, Beihang University, Beijing, 100083 China
| |
Collapse
|
4
|
Simulation of reconstruction based on the system matrix for magnetic particle imaging. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103171] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/20/2022]
|
5
|
Research of magnetic particle imaging reconstruction based on the elastic net regularization. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102823] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
6
|
The Reconstruction of Magnetic Particle Imaging: Current Approaches Based on the System Matrix. Diagnostics (Basel) 2021; 11:diagnostics11050773. [PMID: 33925830 PMCID: PMC8146641 DOI: 10.3390/diagnostics11050773] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Revised: 04/20/2021] [Accepted: 04/22/2021] [Indexed: 12/20/2022] Open
Abstract
Magnetic particle imaging (MPI) is a novel non-invasive molecular imaging technology that images the distribution of superparamagnetic iron oxide nanoparticles (SPIONs). It is not affected by imaging depth, with high sensitivity, high resolution, and no radiation. The MPI reconstruction with high precision and high quality is of enormous practical importance, and many studies have been conducted to improve the reconstruction accuracy and quality. MPI reconstruction based on the system matrix (SM) is an important part of MPI reconstruction. In this review, the principle of MPI, current construction methods of SM and the theory of SM-based MPI are discussed. For SM-based approaches, MPI reconstruction mainly has the following problems: the reconstruction problem is an inverse and ill-posed problem, the complex background signals seriously affect the reconstruction results, the field of view cannot cover the entire object, and the available 3D datasets are of relatively large volume. In this review, we compared and grouped different studies on the above issues, including SM-based MPI reconstruction based on the state-of-the-art Tikhonov regularization, SM-based MPI reconstruction based on the improved methods, SM-based MPI reconstruction methods to subtract the background signal, SM-based MPI reconstruction approaches to expand the spatial coverage, and matrix transformations to accelerate SM-based MPI reconstruction. In addition, the current phantoms and performance indicators used for SM-based reconstruction are listed. Finally, certain research suggestions for MPI reconstruction are proposed, expecting that this review will provide a certain reference for researchers in MPI reconstruction and will promote the future applications of MPI in clinical medicine.
Collapse
|
7
|
Abstract
The electrocardiogram (ECG) is widely used for the diagnosis of heart diseases. However, ECG signals are easily contaminated by different noises. This paper presents efficient denoising and compressed sensing (CS) schemes for ECG signals based on basis pursuit (BP). In the process of signal denoising and reconstruction, the low-pass filtering method and alternating direction method of multipliers (ADMM) optimization algorithm are used. This method introduces dual variables, adds a secondary penalty term, and reduces constraint conditions through alternate optimization to optimize the original variable and the dual variable at the same time. This algorithm is able to remove both baseline wander and Gaussian white noise. The effectiveness of the algorithm is validated through the records of the MIT-BIH arrhythmia database. The simulations show that the proposed ADMM-based method performs better in ECG denoising. Furthermore, this algorithm keeps the details of the ECG signal in reconstruction and achieves higher signal-to-noise ratio (SNR) and smaller mean square error (MSE).
Collapse
|
8
|
Loewke NO, Qiu Z, Mandella MJ, Ertsey R, Loewke A, Gunaydin LA, Rosenthal EL, Contag CH, Solgaard O. Software-Based Phase Control, Video-Rate Imaging, and Real-Time Mosaicing With a Lissajous-Scanned Confocal Microscope. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1127-1137. [PMID: 31567074 PMCID: PMC8837204 DOI: 10.1109/tmi.2019.2942552] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
We present software-based methods for automatic phase control and for mosaicing high-speed, Lissajous-scanned images. To achieve imaging speeds fast enough for mosaicing, we first increase the image update rate tenfold from 3 to 30 Hz, then vertically interpolate each sparse image in real-time to eliminate fixed pattern noise. We validate our methods by imaging fluorescent beads and automatically maintaining phase control over the course of one hour. We then image fixed mouse brain tissues at varying update rates and compare the resulting mosaics. Using reconstructed image data as feedback for phase control eliminates the need for phase sensors and feedback controllers, enabling long-term imaging experiments without additional hardware. Mosaicing subsampled images results in video-rate imaging speeds, nearly fully recovered spatial resolution, and millimeter-scale fields of view.
Collapse
|
9
|
Ozaslan AA, Alacaoglu A, Demirel OB, Çukur T, Saritas EU. Fully automated gridding reconstruction for non-Cartesian x-space magnetic particle imaging. Phys Med Biol 2019; 64:165018. [PMID: 31342922 DOI: 10.1088/1361-6560/ab3525] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Magnetic particle imaging (MPI) is a fast emerging biomedical imaging modality that exploits the nonlinear response of superparamagnetic iron oxide (SPIO) nanoparticles to image their spatial distribution. Previously, various scanning trajectories were analyzed for the system function reconstruction (SFR) approach, providing important insight regarding their image quality performances. While Cartesian trajectories remain the most popular choice for x-space-based reconstruction, recent work suggests that non-Cartesian trajectories such as the Lissajous trajectory may prove beneficial for improving image quality. In this work, we propose a generalized reconstruction scheme for x-space MPI that can be used in conjunction with any scanning trajectory. The proposed technique automatically tunes the reconstruction parameters from the scanning trajectory, and does not induce any additional blurring. To demonstrate the proposed technique, we utilize five different trajectories with varying density levels. Comparison to alternative reconstruction methods show significant improvement in image quality achieved by the proposed technique. Among the tested trajectories, the Lissajous and bidirectional Cartesian trajectories prove more favorable for x-space MPI, and the resolution of the images from these two trajectories can further be improved via deblurring. The proposed fully automated gridding reconstruction can be utilized with these trajectories to improve the image quality in x-space MPI.
Collapse
Affiliation(s)
- A A Ozaslan
- Department of Electrical and Electronics Engineering, Bilkent University, Ankara, Turkey. National Magnetic Resonance Research Center (UMRAM), Bilkent University, Ankara, Turkey
| | | | | | | | | |
Collapse
|
10
|
Szwargulski P, Moddel M, Gdaniec N, Knopp T. Efficient Joint Image Reconstruction of Multi-Patch Data Reusing a Single System Matrix in Magnetic Particle Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:932-944. [PMID: 30334751 DOI: 10.1109/tmi.2018.2875829] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Due to peripheral nerve stimulation, the magnetic particle imaging (MPI) method is limited in the maximum applicable excitation-field amplitude. This in turn leads to a limitation of the size of the covered field of view (FoV) to few millimeters. In order to still capture a larger FoV, MPI is capable to rapidly acquire volumes in a multi-patch fashion. To this end, the small excitation volume is shifted through space using the magnetic focus fields. Recently, it has been shown that the individual patches are preferably reconstructed in a joint fashion by solving a single linear system of equations taking the coupling between individual patches into account. While this improves the image quality, it is computationally and memory demanding since the size of the linear system increases in the best case quadratically with the number of patches. In this paper, we will develop a reconstruction algorithm for MPI multi-patch data exploiting the sparsity of the joint system matrix. A highly efficient implicit matrix format allows for rapid on-the-fly calculations of linear algebra operations involving the system matrix. Using this approach, the computational effort can be reduced to a linear dependence on the number of used patches. The algorithm is validated on 3-D multi-patch phantom data sets and shown to reconstruct large data sets with 15 patches in less than 22 s.
Collapse
|
11
|
Muslu Y, Utkur M, Demirel OB, Saritas EU. Calibration-Free Relaxation-Based Multi-Color Magnetic Particle Imaging. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:1920-1931. [PMID: 29993774 DOI: 10.1109/tmi.2018.2818261] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
Magnetic particle imaging (MPI) is a novel imaging modality with important potential applications, such as angiography, stem cell tracking, and cancer imaging. Recently, there have been efforts to increase the functionality of MPI via multi-color imaging methods that can distinguish the responses of different nanoparticles, or nanoparticles in different environmental conditions. The proposed techniques typically rely on extensive calibrations that capture the differences in the harmonic responses of the nanoparticles. In this paper, we propose a method to directly estimate the relaxation time constant of the nanoparticles from the MPI signal, which is then used to generate a multi-color relaxation map. The technique is based on the underlying mirror symmetry of the adiabatic MPI signal when the same region is scanned back and forth. We validate the proposed method via simulations, and via experiments on our in-house magnetic particle spectrometer setup at 10.8 kHz and our in-house MPI scanner at 9.7 kHz. Our results show that nanoparticles can be successfully distinguished with the proposed technique, without any calibration or prior knowledge about the nanoparticles.
Collapse
|
12
|
Knopp T, Gdaniec N, Möddel M. Magnetic particle imaging: from proof of principle to preclinical applications. Phys Med Biol 2017; 62:R124-R178. [PMID: 28398219 DOI: 10.1088/1361-6560/aa6c99] [Citation(s) in RCA: 66] [Impact Index Per Article: 9.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Tomographic imaging has become a mandatory tool for the diagnosis of a majority of diseases in clinical routine. Since each method has its pros and cons, a variety of them is regularly used in clinics to satisfy all application needs. Magnetic particle imaging (MPI) is a relatively new tomographic imaging technique that images magnetic nanoparticles with a high spatiotemporal resolution in a quantitative way, and in turn is highly suited for vascular and targeted imaging. MPI was introduced in 2005 and now enters the preclinical research phase, where medical researchers get access to this new technology and exploit its potential under physiological conditions. Within this paper, we review the development of MPI since its introduction in 2005. Besides an in-depth description of the basic principles, we provide detailed discussions on imaging sequences, reconstruction algorithms, scanner instrumentation and potential medical applications.
Collapse
Affiliation(s)
- T Knopp
- Section for Biomedical Imaging, University Medical Center Hamburg-Eppendorf, Martinistraße, Hamburg, Germany. Institute for Biomedical Imaging, Hamburg University of Technology, Schwarzenbergstraße, Hamburg, Germany
| | | | | |
Collapse
|
13
|
Werner F, Gdaniec N, Knopp T. First experimental comparison between the Cartesian and the Lissajous trajectory for magnetic particle imaging. Phys Med Biol 2017; 62:3407-3421. [DOI: 10.1088/1361-6560/aa6177] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|