1
|
Deng Z, Zhang W, Chen K, Zhou Y, Tian J, Quan G, Zhao J. TT U-Net: Temporal Transformer U-Net for Motion Artifact Reduction Using PAD (Pseudo All-Phase Clinical-Dataset) in Cardiac CT. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:3805-3816. [PMID: 37651491 DOI: 10.1109/tmi.2023.3310933] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Abstract
Involuntary motion of the heart remains a challenge for cardiac computed tomography (CT) imaging. Although the electrocardiogram (ECG) gating strategy is widely adopted to perform CT scans at the quasi-quiescent cardiac phase, motion-induced artifacts are still unavoidable for patients with high heart rates or irregular rhythms. Dynamic cardiac CT, which provides functional information of the heart, suffers even more severe motion artifacts. In this paper, we develop a deep learning based framework for motion artifact reduction in dynamic cardiac CT. First, we build a PAD (Pseudo All-phase clinical-Dataset) based on a whole-heart motion model and single-phase cardiac CT images. This dataset provides dynamic CT images with realistic-looking motion artifacts that help to develop data-driven approaches. Second, we formulate the problem of motion artifact reduction as a video deblurring task according to its dynamic nature. A novel TT U-Net (Temporal Transformer U-Net) is proposed to excavate the spatiotemporal features for better motion artifact reduction. The self-attention mechanism along the temporal dimension effectively encodes motion information and thus aids image recovery. Experiments show that the TT U-Net trained on the proposed PAD performs well on clinical CT scans, which substantiates the effectiveness and fine generalization ability of our method. The source code, trained models, and dynamic demo will be available at https://github.com/ivy9092111111/TT-U-Net.
Collapse
|
2
|
Liu X, Li S, Wang B, Xu L, Gao Z, Yang G. Motion estimation based on projective information disentanglement for 3D reconstruction of rotational coronary angiography. Comput Biol Med 2023; 157:106743. [PMID: 36934532 DOI: 10.1016/j.compbiomed.2023.106743] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Revised: 02/01/2023] [Accepted: 03/03/2023] [Indexed: 03/13/2023]
Abstract
The 2D projection space-based motion compensation reconstruction (2D-MCR) is a kind of representative method for 3D reconstruction of rotational coronary angiography owing to its high efficiency. However, due to the lack of accurate motion estimation of the overlapping projection pixels, existing 2D-MCR methods may still have a certain level of under-sampling artifacts or lose accuracy for cases with strong cardiac motion. To overcome this, in this study, we proposed a motion estimation approach based on projective information disentanglement (PID-ME) for 3D reconstruction of rotational coronary angiography. The reconstruction method adopts the framework of 2D-MCR, which is referred to as 2D-PID-MCR. The PID-ME consists of two parts: generation of the reference projection sequence based on the fast simplified distance driven projector (FSDDP) algorithm, motion estimation and correction based on the projective average minimal distance measure (PAMD) model. The FSDDP algorithm generates the reference projection sequence faster and accelerates the whole reconstruction greatly. The PAMD model can disentangle the projection information effectively and estimate the motion of both overlapping and non-overlapping projection pixels accurately. The main contribution of this study is the construction of 2D-PID-MCR to overcome the inherent limitations of the existing 2D-MCR method. Simulated and clinical experiments show that the PID-ME, consisting of FSDDP and PAMD, can estimate the motion of the projection sequence data accurately and efficiently. Our 2D-PID-MCR method outperforms the state-of-the-art approaches in terms of accuracy and real-time performance.
Collapse
Affiliation(s)
- Xiujian Liu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| | - Si Li
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| | - Bin Wang
- Department of Cardiology, the First Affiliated Hospital of Shantou University Medical College, Shantou, China; The Clinical Research Center of the First Affiliated Hospital of Shantou University Medical College, Shantou, China
| | - Lin Xu
- General Hospital of the Southern Theatre Command, PLA and The First School of Clinical Medicine, Southern Medical University, Guangzhou, China.
| | - Zhifan Gao
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China.
| | - Guang Yang
- National Heart and Lung Institute, Imperial College London, London, UK; Cardiovascular Research Centre, Royal Brompton Hospital, London, UK
| |
Collapse
|
3
|
Zeng D, Zeng C, Zeng Z, Li S, Deng Z, Chen S, Bian Z, Ma J. Basis and current state of computed tomography perfusion imaging: a review. Phys Med Biol 2022; 67. [PMID: 35926503 DOI: 10.1088/1361-6560/ac8717] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2021] [Accepted: 08/04/2022] [Indexed: 12/30/2022]
Abstract
Computed tomography perfusion (CTP) is a functional imaging that allows for providing capillary-level hemodynamics information of the desired tissue in clinics. In this paper, we aim to offer insight into CTP imaging which covers the basics and current state of CTP imaging, then summarize the technical applications in the CTP imaging as well as the future technological potential. At first, we focus on the fundamentals of CTP imaging including systematically summarized CTP image acquisition and hemodynamic parameter map estimation techniques. A short assessment is presented to outline the clinical applications with CTP imaging, and then a review of radiation dose effect of the CTP imaging on the different applications is presented. We present a categorized methodology review on known and potential solvable challenges of radiation dose reduction in CTP imaging. To evaluate the quality of CTP images, we list various standardized performance metrics. Moreover, we present a review on the determination of infarct and penumbra. Finally, we reveal the popularity and future trend of CTP imaging.
Collapse
Affiliation(s)
- Dong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Cuidie Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhixiong Zeng
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Sui Li
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhen Deng
- Department of Neurology, Nanfang Hospital, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Sijin Chen
- Department of Medical Imaging Center, Nanfang Hospital, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Zhaoying Bian
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| | - Jianhua Ma
- School of Biomedical Engineering, Southern Medical University, Guangdong 510515, China; and Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology, Southern Medical University, Guangdong 510515, People's Republic of China
| |
Collapse
|
4
|
Lee D, Choi J, Kim H, Cho M, Lee KY. Validation of a novel cardiac motion correction algorithm for x-ray computed tomography: From phantom experiments to initial clinical experience. PLoS One 2020; 15:e0239511. [PMID: 32997677 PMCID: PMC7526935 DOI: 10.1371/journal.pone.0239511] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2019] [Accepted: 09/08/2020] [Indexed: 11/19/2022] Open
Abstract
A novel cardiac motion correction algorithm has been introduced recently. Unlike other segmentation-based approaches it is fully automatic and capable of correcting motion artifacts of myocardial wall and other moving structures as well as coronary arteries of the heart. In addition, it requires raw data of only less than a single rotation for motion estimation and correction, which is a significant advantage from the perspective of x-ray exposure and workflow. The aim of this study is to explore the capability of the proposed method through phantoms and in-vivo experiments. Motion correction of coronary arteries and other heart structures including myocardial wall is the main focus of the evaluation. First, we provide a brief introduction to the concept of the motion correction algorithm. Next we address the procedure of our studies using an XCAT phantom and commercially available physical phantoms. Results of XCAT phantom demonstrate that our solution significantly improves the structural similarity of coronary arteries compared to FBP (proposed: 0.94, FBP: 0.77, p<0.001). Besides, it provides significantly lower root mean square error (proposed: 20.27, FBP: 25.33, p = 0.01) of the whole heart image. Mocomo phantom study shows that the proposed method improves the visualization of coronary arteries estimated based on motion score (1: worst, 5: best) from two experienced radiologists (proposed: 3.5, FBP: 2.1, p<0.001). The results of these phantom studies reveal that the proposed has a great potential in handling motion artifacts of other heart structures as well as coronary arteries. Finally, we provide the results of in-vivo animal and human studies. The 3D and 4D heart images show a consistently superior performance in the visualization of coronary arteries along with myocardial wall and other cardiothoracic structures. Based on these findings of our studies, we are of the opinion that our solution has a considerable potential to improve temporal resolution of cardiac CT imaging. This would open the door to innovations in structural or functional diagnosis of the heart.
Collapse
Affiliation(s)
- Duhgoon Lee
- Advanced R&D Team, Health and Medical Equipment Business, Samsung Electronics, Suwon-si, Gyeonggi-do, Korea
| | - Jiyoung Choi
- Advanced R&D Team, Health and Medical Equipment Business, Samsung Electronics, Suwon-si, Gyeonggi-do, Korea
| | - Hyesun Kim
- Advanced R&D Team, Health and Medical Equipment Business, Samsung Electronics, Suwon-si, Gyeonggi-do, Korea
| | - Minkook Cho
- Advanced R&D Team, Health and Medical Equipment Business, Samsung Electronics, Suwon-si, Gyeonggi-do, Korea
| | - Kyoung-Yong Lee
- Advanced R&D Team, Health and Medical Equipment Business, Samsung Electronics, Suwon-si, Gyeonggi-do, Korea
- * E-mail:
| |
Collapse
|
5
|
Jang S, Kim S, Kim M, Son K, Lee KY, Ra JB. Head Motion Correction Based on Filtered Backprojection in Helical CT Scanning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2020; 39:1636-1645. [PMID: 31751270 DOI: 10.1109/tmi.2019.2953974] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Head motion may unexpectedly occur during a CT scan. It thereby results in motion artifacts in a reconstructed image and may lead to a false diagnosis or a failure of diagnosis. To alleviate this motion problem, as a hardware approach, increasing the gantry rotation speed or using an immobilization device is usually considered. These approaches, however, cannot completely resolve the motion problem. Hence, motion estimation (ME) and compensation for it have been explored as a software approach instead. In this paper, adopting the latter approach, we propose a head motion correction algorithm in helical CT scanning, based on filtered backprojection (FBP). For the motion correction, we first introduce a new motion-compensated (MC) reconstruction scheme based on FBP, which is applicable to helical scanning. We then estimate the head motion parameters by using an iterative nonlinear optimization algorithm, or the L-BFGS. Note here that an objective function for the optimization is defined on reconstructed images in each iteration, which are obtained by using the proposed MC reconstruction scheme. Using the estimated motion parameters, we then obtain the final MC reconstructed image. Using numerical and physical phantom datasets along with simulated head motions, we demonstrate that the proposed algorithm can provide significantly improved quality to MC reconstructed images by alleviating motion artifacts.
Collapse
|
6
|
Kim S, Ra JB. Dynamic focal plane estimation for dental panoramic radiography. Med Phys 2019; 46:4907-4917. [PMID: 31520417 DOI: 10.1002/mp.13823] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2019] [Revised: 09/02/2019] [Accepted: 09/03/2019] [Indexed: 11/10/2022] Open
Abstract
PURPOSE The digital panoramic radiography is widely used in dental clinics and provides the anatomical information of the intraoral structure along the predefined arc-shaped path. Since the intraoral structure varies depending on the patient, however, it is nearly impossible to design a common and static focal path or plane fitted to the dentition of all patients. In response, we introduce an imaging algorithm for digital panoramic radiography that can provide a focused panoramic radiographic image for all patients, by automatically estimating the best focal plane for each patient. METHODS The aim of this study is to improve the image quality of dental panoramic radiography based on a three-dimensional (3D) dynamic focal plane. The plane is newly introduced to represent the arbitrary 3D intraoral structure of each patient. The proposed algorithm consists of three steps: preprocessing, focal plane estimation, and image reconstruction. We first perform preprocessing to improve the accuracy of focal plane estimation. The 3D dynamic focal plane is then estimated by adjusting the position of the image plane so that object boundaries in the neighboring projection data are aligned or focused on the plane. Finally, a panoramic radiographic image is reconstructed using the estimated dynamic focal plane. RESULTS The proposed algorithm is evaluated using a numerical phantom dataset and four clinical human datasets. In order to examine the image quality improvement owing to the proposed algorithm, we generate panoramic radiographic images based on a conventional static focal plane and estimated 3D dynamic focal planes, respectively. Experimental results show that the image quality is dramatically improved for all datasets using the 3D dynamic focal planes that are estimated from the proposed algorithm. CONCLUSIONS We propose an imaging algorithm for digital panoramic radiography that provides improved image quality by estimating dynamic focal planes fitted to each individual patient's intraoral structure.
Collapse
Affiliation(s)
- Seungeon Kim
- School of Electrical Engineering, KAIST, Daejeon, Republic of Korea
| | - Jong Beom Ra
- School of Electrical Engineering, KAIST, Daejeon, Republic of Korea
| |
Collapse
|
7
|
Khalil A, Ng SC, Liew YM, Lai KW. An Overview on Image Registration Techniques for Cardiac Diagnosis and Treatment. Cardiol Res Pract 2018; 2018:1437125. [PMID: 30159169 PMCID: PMC6109558 DOI: 10.1155/2018/1437125] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/08/2018] [Revised: 07/05/2018] [Accepted: 07/17/2018] [Indexed: 12/13/2022] Open
Abstract
Image registration has been used for a wide variety of tasks within cardiovascular imaging. This study aims to provide an overview of the existing image registration methods to assist researchers and impart valuable resource for studying the existing methods or developing new methods and evaluation strategies for cardiac image registration. For the cardiac diagnosis and treatment strategy, image registration and fusion can provide complementary information to the physician by using the integrated image from these two modalities. This review also contains a description of various imaging techniques to provide an appreciation of the problems associated with implementing image registration, particularly for cardiac pathology intervention and treatments.
Collapse
Affiliation(s)
- Azira Khalil
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 50603 Kuala Lumpur, Malaysia
- Faculty of Science and Technology, Islamic Science University of Malaysia, 71800 Nilai, Negeri Sembilan, Malaysia
| | - Siew-Cheok Ng
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 50603 Kuala Lumpur, Malaysia
| | - Yih Miin Liew
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 50603 Kuala Lumpur, Malaysia
| | - Khin Wee Lai
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, 50603 Kuala Lumpur, Malaysia
| |
Collapse
|
8
|
Kim S, Chang Y, Ra JB. Cardiac Motion Correction for Helical CT Scan With an Ordinary Pitch. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:1587-1596. [PMID: 29969409 DOI: 10.1109/tmi.2018.2817594] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Cardiac X-ray computed tomography (CT) imaging is still challenging due to the cardiac motion during CT scanning, which leads to the presence of motion artifacts in the reconstructed image. In response, many cardiac X-ray CT imaging algorithms have been proposed, based on motion estimation (ME) and motion compensation (MC), to improve the image quality by alleviating the motion artifacts in the reconstructed image. However, these ME/MC algorithms are mainly based on an axial scan or a low-pitch helical scan. In this paper, we propose a ME/MC-based cardiac imaging algorithm for the data set acquired from a helical scan with an ordinary pitch of around 1.0 so as to obtain the whole cardiac image within a single scan of short time without ECG gating. In the proposed algorithm, a sequence of partial angle reconstructed (PAR) images is generated by using consecutive parts of the sinogram, each of which has a small angular span. Subsequently, an initial 4-D motion vector field (MVF) is obtained using multiple pairs of conjugate PAR images. The 4-D MVF is then refined based on an image quality metric so as to improve the quality of the motion-compensated image. Finally, a time-resolved cardiac image is obtained by performing motion-compensated image reconstruction by using the refined 4-D MVF. Using digital XCAT phantom data sets and a human data set commonly obtained via a helical scan with a pitch of 1.0, we demonstrate that the proposed algorithm significantly improves the image quality by alleviating motion artifacts.
Collapse
|
9
|
Jang S, Kim S, Kim M, Ra JB. Head motion correction based on filtered backprojection for x-ray CT imaging. Med Phys 2017; 45:589-604. [DOI: 10.1002/mp.12705] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2017] [Revised: 11/07/2017] [Accepted: 11/22/2017] [Indexed: 11/08/2022] Open
Affiliation(s)
- Seokhwan Jang
- School of Electrical Engineering; KAIST; Daejeon Republic of Korea
| | - Seungeon Kim
- School of Electrical Engineering; KAIST; Daejeon Republic of Korea
| | - Mina Kim
- School of Electrical Engineering; KAIST; Daejeon Republic of Korea
| | - Jong Beom Ra
- School of Electrical Engineering; KAIST; Daejeon Republic of Korea
| |
Collapse
|