1
|
Dong W, Zhang Y, Hu L, Liu S, Tian C. Image restoration for ring-array photoacoustic tomography based on an attention mechanism driven conditional generative adversarial network. PHOTOACOUSTICS 2025; 43:100714. [PMID: 40255318 PMCID: PMC12008638 DOI: 10.1016/j.pacs.2025.100714] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/03/2025] [Revised: 03/09/2025] [Accepted: 03/16/2025] [Indexed: 04/22/2025]
Abstract
Ring-Array photoacoustic tomography (PAT) systems have shown great promise in non-invasive biomedical imaging. However, images produced by these systems often suffer from quality degradation due to non-ideal imaging conditions, with common issues including blurring and streak artifacts. To address these challenges, we propose an image restoration method based on a conditional generative adversarial network (CGAN) framework. Our approach integrates a hybrid spatial and channel attention mechanism within a Residual Shifted Window Transformer Module (RSTM) to enhance the generator's performance. Additionally, we have developed a comprehensive loss function to balance pixel-level accuracy, detail preservation, and perceptual quality. We further incorporate a gamma correction module to enhance the contrast of the network's output. Experimental results on both simulated and in vivo data demonstrate that our method significantly improves resolution and restores overall image quality.
Collapse
Affiliation(s)
- Wende Dong
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
| | - Yanli Zhang
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
| | - Luqi Hu
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China
| | - Songde Liu
- School of Engineering Science, University of Science and Technology of China, Hefei, Anhui 230026, China
- Department of Anesthesiology, the First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui 230001, China
| | - Chao Tian
- School of Engineering Science, University of Science and Technology of China, Hefei, Anhui 230026, China
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, Anhui 230088, China
- Department of Anesthesiology, the First Affiliated Hospital of USTC, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui 230001, China
- Anhui Province Key Laboratory of Biomedical Imaging and Intelligent Processing, Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei 230088, China
| |
Collapse
|
2
|
Dong W, Zhu C, Xie D, Zhang Y, Tao S, Tian C. Image restoration for ring-array photoacoustic tomography system based on blind spatially rotational deconvolution. PHOTOACOUSTICS 2024; 38:100607. [PMID: 38665365 PMCID: PMC11044036 DOI: 10.1016/j.pacs.2024.100607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/29/2023] [Revised: 03/17/2024] [Accepted: 04/09/2024] [Indexed: 04/28/2024]
Abstract
Ring-array photoacoustic tomography (PAT) system has been widely used in noninvasive biomedical imaging. However, the reconstructed image usually suffers from spatially rotational blur and streak artifacts due to the non-ideal imaging conditions. To improve the reconstructed image towards higher quality, we propose a concept of spatially rotational convolution to formulate the image blur process, then we build a regularized restoration problem model accordingly and design an alternating minimization algorithm which is called blind spatially rotational deconvolution to achieve the restored image. Besides, we also present an image preprocessing method based on the proposed algorithm to remove the streak artifacts. We take experiments on phantoms and in vivo biological tissues for evaluation, the results show that our approach can significantly enhance the resolution of the image obtained from ring-array PAT system and remove the streak artifacts effectively.
Collapse
Affiliation(s)
- Wende Dong
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 211106, China
- Key Laboratory of Space Photoelectric Detection and Perception (Nanjing University of Aeronautics and Astronautics), Ministry of Industry and Information Technology, Nanjing, Jiangsu 211106, China
| | - Chenlong Zhu
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 211106, China
- Key Laboratory of Space Photoelectric Detection and Perception (Nanjing University of Aeronautics and Astronautics), Ministry of Industry and Information Technology, Nanjing, Jiangsu 211106, China
| | - Dan Xie
- School of Engineering Science, University of Science and Technology of China, Hefei, Anhui 230026, China
| | - Yanli Zhang
- College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, Jiangsu 211106, China
- Key Laboratory of Space Photoelectric Detection and Perception (Nanjing University of Aeronautics and Astronautics), Ministry of Industry and Information Technology, Nanjing, Jiangsu 211106, China
| | - Shuyin Tao
- School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China
| | - Chao Tian
- School of Engineering Science, University of Science and Technology of China, Hefei, Anhui 230026, China
- Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, Anhui 230088, China
- Anhui Province Key Laboratory of Biomedical Imaging and Intelligent Processing, Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, Anhui 230088, China
| |
Collapse
|
3
|
Luo J, Qiu S, Jiang Y, Cheng K, Ye H, Zhang M. A Contribution Algorithm from LDRI to HDRI. INT J PATTERN RECOGN 2019. [DOI: 10.1142/s0218001420590259] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
High dynamic range image (HDRI) which is combined with low dynamic range image (LDRI) needs to be mapped to a low dynamic area to display. In the process of mapping, it is impossible to determine the contribution of low dynamic image sequences in the display images, so that it results in a problem that the low dynamic images cannot be accurately selected. In this paper, for the first time, a contribution algorithm from LDRI to HDRI according to the corresponding response curve of the camera is proposed.
Collapse
Affiliation(s)
- Junsong Luo
- College of Information Science & Technology, Chengdu University of Technology, Chengdu 610059, P. R. China
| | - Shi Qiu
- Key Laboratory of Spectral Imaging Technology CAS, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, P. R. China
| | - Yizhang Jiang
- School of Digital Media, Jiangnan University, Wuxi 214122, P. R. China
| | - Keyang Cheng
- School of Computer Science and Communication Engineering, Jiangsu University Zhenjiang 212000, P. R. China
| | - Huping Ye
- State Key Laboratory of Resources and Environmental Information System, Institute of Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, Beijing 100101, P. R. China
| | - Mingjin Zhang
- The State Key Laboratory of Integrated Services Networks, School of Telecommunications Engineering, Xidian University, Xi’an 710071, P. R. China
| |
Collapse
|
4
|
Punnappurath A, Rajagopalan AN. Recognizing blurred, nonfrontal, illumination, and expression variant partially occluded faces. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2016; 33:1887-1900. [PMID: 27607514 DOI: 10.1364/josaa.33.001887] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The focus of this paper is on the problem of recognizing faces across space-varying motion blur, changes in pose, illumination, and expression, as well as partial occlusion, when only a single image per subject is available in the gallery. We show how the blur, incurred due to relative motion between the camera and the subject during exposure, can be estimated from the alpha matte of pixels that straddle the boundary between the face and the background. We also devise a strategy to automatically generate the trimap required for matte estimation. Having computed the motion via the matte of the probe, we account for pose variations by synthesizing from the intensity image of the frontal gallery a face image that matches the pose of the probe. To handle illumination, expression variations, and partial occlusion, we model the probe as a linear combination of nine blurred illumination basis images in the synthesized nonfrontal pose, plus a sparse occlusion. We also advocate a recognition metric that capitalizes on the sparsity of the occluded pixels. The performance of our method is extensively validated on synthetic as well as real face data.
Collapse
|