1
|
Tao S, Tian Z, Bai L, Xu Y, Kuang C, Liu X. Phase retrieval for X-ray differential phase contrast radiography with knowledge transfer learning from virtual differential absorption model. Comput Biol Med 2024; 168:107711. [PMID: 37995534 DOI: 10.1016/j.compbiomed.2023.107711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/03/2023] [Revised: 10/31/2023] [Accepted: 11/15/2023] [Indexed: 11/25/2023]
Abstract
Grating-based X-ray phase contrast radiography and computed tomography (CT) are promising modalities for future medical applications. However, the ill-posed phase retrieval problem in X-ray phase contrast imaging has hindered its use for quantitative analysis in biomedical imaging. Deep learning has been proved as an effective tool for image retrieval. However, in practical grating-based X-ray phase contrast imaging system, acquiring the ground truth of phase to form image pairs is challenging, which poses a great obstacle for using deep leaning methods. Transfer learning is widely used to address the problem with knowledge inheritance from similar tasks. In the present research, we propose a virtual differential absorption model and generate a training dataset with differential absorption images and absorption images. The knowledge learned from the training is transferred to phase retrieval with transfer learning techniques. Numerical simulations and experiments both demonstrate its feasibility. Image quality of retrieved phase radiograph and phase CT slices is improved when compared with representative phase retrieval methods. We conclude that this method is helpful in both X-ray 2D and 3D imaging and may find its applications in X-ray phase contrast radiography and X-ray phase CT.
Collapse
Affiliation(s)
- Siwei Tao
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Zonghan Tian
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Ling Bai
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China
| | - Yueshu Xu
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China; State Key Laboratory of Extreme Photonics and Instrumentation, ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, 315100, China
| | - Cuifang Kuang
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China; State Key Laboratory of Extreme Photonics and Instrumentation, ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, 315100, China; Collaborative Innovation Center of Extreme Optics, Shanxi University, Taiyuan, 030006, China.
| | - Xu Liu
- State Key Laboratory of Extreme Photonics and Instrumentation, College of Optical Science and Engineering, Zhejiang University, Hangzhou, 310027, China; State Key Laboratory of Extreme Photonics and Instrumentation, ZJU-Hangzhou Global Scientific and Technological Innovation Center, Zhejiang University, Hangzhou, 315100, China; Ningbo Research Institute, Zhejiang University, Ningbo, 315100, China.
| |
Collapse
|
2
|
Li J, Chen S, Ratner D, Blu T, Pianetta P, Liu Y. Nanoscale chemical imaging with structured X-ray illumination. Proc Natl Acad Sci U S A 2023; 120:e2314542120. [PMID: 38015849 PMCID: PMC10710092 DOI: 10.1073/pnas.2314542120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2023] [Accepted: 10/23/2023] [Indexed: 11/30/2023] Open
Abstract
High-resolution imaging with compositional and chemical sensitivity is crucial for a wide range of scientific and engineering disciplines. Although synchrotron X-ray imaging through spectromicroscopy has been tremendously successful and broadly applied, it encounters challenges in achieving enhanced detection sensitivity, satisfactory spatial resolution, and high experimental throughput simultaneously. In this work, based on structured illumination, we develop a single-pixel X-ray imaging approach coupled with a generative image reconstruction model for mapping the compositional heterogeneity with nanoscale resolvability. This method integrates a full-field transmission X-ray microscope with an X-ray fluorescence detector and eliminates the need for nanoscale X-ray focusing and raster scanning. We experimentally demonstrate the effectiveness of our approach by imaging a battery sample composed of mixed cathode materials and successfully retrieving the compositional variations of the imaged cathode particles. Bridging the gap between structural and chemical characterizations using X-rays, this technique opens up vast opportunities in the fields of biology, environmental, and materials science, especially for radiation-sensitive samples.
Collapse
Affiliation(s)
- Jizhou Li
- Stanford Synchrotron Radiation Lightsource, SLAC National Accelerator Laboratory, Menlo Park, CA94025
- School of Data Science, City University of Hong Kong, Hong Kong, China
| | - Si Chen
- X-ray Science Division, Argonne National Laboratory, Lemont, IL60439
| | - Daniel Ratner
- Machine Learning Initiative, SLAC National Accelerator Laboratory, Menlo Park, CA94025
| | - Thierry Blu
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Piero Pianetta
- Stanford Synchrotron Radiation Lightsource, SLAC National Accelerator Laboratory, Menlo Park, CA94025
| | - Yijin Liu
- Walker Department of Mechanical Engineering, The University of Texas at Austin, Austin, TX78705
| |
Collapse
|
3
|
Lin Q, Wu Z, Zan G, Huang M, Dang Z, Tian L, Guan Y, Liu G, Lu Y, Tian Y. High energy x-ray Talbot-Lau interferometer employing a microarray anode-structured target source to extend the field of view. Phys Med Biol 2023; 68:21NT01. [PMID: 37813100 DOI: 10.1088/1361-6560/ad0196] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2023] [Accepted: 10/09/2023] [Indexed: 10/11/2023]
Abstract
Objective. High energy and large field of view (FOV) phase contrast imaging is crucial for biological and even medical applications. Although some works have devoted to achieving a large FOV at high energy through bending gratings and so on, which would be extremely challenging in medical high energy imaging.Approach.We analyze the angular shadowing effect of planar gratings in high-energy x-ray Talbot-Lau interferometer (XTLI). Then we design and develop an inverse XTLI coupled with a microarray anode-structured target source to extend the FOV at high energy.Main results.Our experimental results demonstrate the benefit of the source in the inverse XTLI and a large FOV of 106.6 mm in the horizontal direction is achieved at 40 keV. Based on this system, experiments of a mouse demonstrate the potential advantage of phase contrast mode in imaging lung tissue.Significance.We extend the FOV in a compact XTLI using a microarray anode-structured target source coupled with an inverse geometry, which eliminates grating G0 and relaxes the fabrication difficulty of G2. We believe the established design idea and imaging system would facilitate the wide applications of XTLI in high energy phase contrast imaging.
Collapse
Affiliation(s)
- Qisi Lin
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei, People's Republic of China
| | - Zhao Wu
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei, People's Republic of China
| | - Guibin Zan
- Sigray Inc., CA, United States of America
| | - Meng Huang
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei, People's Republic of China
- Ultrasonic Department, The First Affiliated Hospital of Anhui Medical University, Hefei, People's Republic of China
| | - Zheng Dang
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei, People's Republic of China
| | - Lijiao Tian
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei, People's Republic of China
| | - Yong Guan
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei, People's Republic of China
| | - Gang Liu
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei, People's Republic of China
| | - Yalin Lu
- Hefei National Laboratory for Physical Sciences at the Microscale, University of Science and Technology of China, Hefei, People's Republic of China
| | - Yangchao Tian
- National Synchrotron Radiation Laboratory, University of Science and Technology of China, Hefei, People's Republic of China
| |
Collapse
|
4
|
Polikarpov M, Vila-Comamala J, Wang Z, Pereira A, van Gogh S, Gasser C, Jefimovs K, Romano L, Varga Z, Lång K, Schmeltz M, Tessarini S, Rawlik M, Jermann E, Lewis S, Yun W, Stampanoni M. Towards virtual histology with X-ray grating interferometry. Sci Rep 2023; 13:9049. [PMID: 37270642 DOI: 10.1038/s41598-023-35854-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Accepted: 05/24/2023] [Indexed: 06/05/2023] Open
Abstract
Breast cancer is the most common type of cancer worldwide. Diagnosing breast cancer relies on clinical examination, imaging and biopsy. A core-needle biopsy enables a morphological and biochemical characterization of the cancer and is considered the gold standard for breast cancer diagnosis. A histopathological examination uses high-resolution microscopes with outstanding contrast in the 2D plane, but the spatial resolution in the third, Z-direction, is reduced. In the present paper, we propose two high-resolution table-top systems for phase-contrast X-ray tomography of soft-tissue samples. The first system implements a classical Talbot-Lau interferometer and allows to perform ex-vivo imaging of human breast samples with a voxel size of 5.57 μm. The second system with a comparable voxel size relies on a Sigray MAAST X-ray source with structured anode. For the first time, we demonstrate the applicability of the latter to perform X-ray imaging of human breast specimens with ductal carcinoma in-situ. We assessed image quality of both setups and compared it to histology. We showed that both setups made it possible to target internal features of breast specimens with better resolution and contrast than previously achieved, demonstrating that grating-based phase-contrast X-ray CT could be a complementary tool for clinical histopathology.
Collapse
Affiliation(s)
- M Polikarpov
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland.
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland.
| | - J Vila-Comamala
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
| | - Z Wang
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland
- Department of Engineering Physics, Tsinghua University, Haidian District, Beijing, 100080, China
| | - A Pereira
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland
| | - S van Gogh
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland
| | - C Gasser
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland
| | - K Jefimovs
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
| | - L Romano
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland
| | - Z Varga
- Department of Pathology and Molecular Pathology, University Hospital Zürich, 8091, Zurich, Switzerland
| | - K Lång
- Department of Diagnostic Radiology, Translational Medicine, Lund University, Lund, Sweden
- Unilabs Mammography Unit, Skåne University Hospital, Malmö, Sweden
| | - M Schmeltz
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
| | - S Tessarini
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland
| | - M Rawlik
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland
| | | | - S Lewis
- Sigray Inc., Concord, CA, 94520, USA
| | - W Yun
- Sigray Inc., Concord, CA, 94520, USA
| | - M Stampanoni
- Swiss Light Source, Paul Scherrer Institut, 5232, Villigen-PSI, Switzerland
- Institute for Biomedical Engineering, ETH Zurich, 8092, Zurich, Switzerland
| |
Collapse
|
5
|
Viermetz M, Gustschin N, Schmid C, Haeusele J, Gleich B, Renger B, Koehler T, Pfeiffer F. Initial Characterization of Dark-Field CT on a Clinical Gantry. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:1035-1045. [PMID: 36395124 DOI: 10.1109/tmi.2022.3222839] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
X-ray computed tomography (CT) is an important non-destructive imaging technique, particularly in clinical diagnostics. Even with the latest innovations like dual-energy and photon-counting CT, the image contrast is solely generated from attenuation in the tissue. An extension - fully compatible with these novelties - is dark-field CT, which retrieves an additional, so-called dark-field contrast. Unlike the attenuation channel, the dark-field channel is sensitive to tissue microstructure and porosity below the resolution of the imaging system, which allows additional insights into the health of the lung tissue or the structure of calcifications. The potential clinical value has been demonstrated in several preclinical studies and recently also in radiography patient studies. Just recently the first dark-field CT for the human body was established at the Technical University of Munich and in this paper, we discuss the performance of this prototype. We evaluate the interferometer components and the imposed challenges that the integration into the CT gantry brings by comparing the results to simulations and measurements at a laboratory setup. The influence of the clinical X-ray source on the Talbot-Lau interferometer and the impact of vibrations, which are immanent on the clinical CT gantry, are analyzed in detail to reveal their characteristic frequencies and origin. A beam hardening correction is introduced as an important step to adapt to the poly-chromatic spectrum and make quantitative dark-field imaging possible. We close with an analysis of the image resolution and the applied patient dose, and conclude that the performance is sufficient to suggest initial patient studies using the presented dark-field CT system.
Collapse
|
6
|
Liu H, Liu M, Jiang X, Luo J, Song Y, Chu X, Zan G. Multimodal Image Fusion for X-ray Grating Interferometry. SENSORS (BASEL, SWITZERLAND) 2023; 23:3115. [PMID: 36991826 PMCID: PMC10053574 DOI: 10.3390/s23063115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Revised: 03/11/2023] [Accepted: 03/13/2023] [Indexed: 06/19/2023]
Abstract
X-ray grating interferometry (XGI) can provide multiple image modalities. It does so by utilizing three different contrast mechanisms-attenuation, refraction (differential phase-shift), and scattering (dark-field)-in a single dataset. Combining all three imaging modalities could create new opportunities for the characterization of material structure features that conventional attenuation-based methods are unable probe. In this study, we proposed an image fusion scheme based on the non-subsampled contourlet transform and spiking cortical model (NSCT-SCM) to combine the tri-contrast images retrieved from XGI. It incorporated three main steps: (i) image denoising based on Wiener filtering, (ii) the NSCT-SCM tri-contrast fusion algorithm, and (iii) image enhancement using contrast-limited adaptive histogram equalization, adaptive sharpening, and gamma correction. The tri-contrast images of the frog toes were used to validate the proposed approach. Moreover, the proposed method was compared with three other image fusion methods by several figures of merit. The experimental evaluation results highlighted the efficiency and robustness of the proposed scheme, with less noise, higher contrast, more information, and better details.
Collapse
Affiliation(s)
- Haoran Liu
- School of Data Science and Artificial Intelligence, Wenzhou University of Technology, Wenzhou 325000, China
- State Key Laboratory of Geohazard Prevention and Geoenvironment Protection, Chengdu University of Technology, Chengdu 610059, China
| | - Mingzhe Liu
- School of Data Science and Artificial Intelligence, Wenzhou University of Technology, Wenzhou 325000, China
- State Key Laboratory of Geohazard Prevention and Geoenvironment Protection, Chengdu University of Technology, Chengdu 610059, China
| | - Xin Jiang
- School of Data Science and Artificial Intelligence, Wenzhou University of Technology, Wenzhou 325000, China
| | - Jinglei Luo
- The Engineering & Technical College of Chengdu University of Technology, Leshan 614000, China
| | - Yuming Song
- The Engineering & Technical College of Chengdu University of Technology, Leshan 614000, China
| | - Xingyue Chu
- The Engineering & Technical College of Chengdu University of Technology, Leshan 614000, China
| | | |
Collapse
|
7
|
Schmid C, Viermetz M, Gustschin N, Noichl W, Haeusele J, Lasser T, Koehler T, Pfeiffer F. Modeling Vibrations of a Tiled Talbot-Lau Interferometer on a Clinical CT. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:774-784. [PMID: 36301786 DOI: 10.1109/tmi.2022.3217662] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
X-ray computed tomography (CT) is an invaluable imaging technique for non-invasive medical diagnosis. However, for soft tissue in the human body the difference in attenuation is inherently small. Grating-based X-ray phase-contrast is a relatively novel imaging method which detects additional interaction mechanisms between photons and matter, namely refraction and small-angle scattering, to generate additional images with different contrast. The experimental setup involves a Talbot-Lau interferometer whose susceptibility to mechanical vibrations hindered acquisition schemes suitable for clinical routine in the past. We present a processing pipeline to identify spatially and temporally variable fluctuations occurring in an interferometer installed on a continuously rotating clinical CT gantry. The correlations of the vibrations in the modular grating setup are exploited to identify a small number of relevant fluctuation modes, allowing for a sample reconstruction free of vibration artifacts.
Collapse
|
8
|
Quantitative, in situ visualization of intracellular insulin vesicles in pancreatic beta cells. Proc Natl Acad Sci U S A 2022; 119:e2202695119. [PMID: 35921440 PMCID: PMC9371705 DOI: 10.1073/pnas.2202695119] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023] Open
Abstract
Characterizing relationships between Zn2+, insulin, and insulin vesicles is of vital importance to the study of pancreatic beta cells. However, the precise content of Zn2+ and the specific location of insulin inside insulin vesicles are not clear, which hinders a thorough understanding of the insulin secretion process and diseases caused by blood sugar dysregulation. Here, we demonstrated the colocalization of Zn2+ and insulin in both single extracellular insulin vesicles and pancreatic beta cells by using an X-ray scanning coherent diffraction imaging (ptychography) technique. We also analyzed the elemental Zn2+ and Ca2+ contents of insulin vesicles using electron microscopy and energy dispersive spectroscopy (EDS) mapping. We found that the presence of Zn2+ is an important characteristic that can be used to distinguish insulin vesicles from other types of vesicles in pancreatic beta cells and that the content of Zn2+ is proportional to the size of insulin vesicles. By using dual-energy contrast X-ray microscopy and scanning transmission X-ray microscopy (STXM) image stacks, we observed that insulin accumulates in the off-center position of extracellular insulin vesicles. Furthermore, the spatial distribution of insulin vesicles and their colocalization with other organelles inside pancreatic beta cells were demonstrated using three-dimensional (3D) imaging by combining X-ray ptychography and an equally sloped tomography (EST) algorithm. This study describes a powerful method to univocally describe the location and quantitative analysis of intracellular insulin, which will be of great significance to the study of diabetes and other blood sugar diseases.
Collapse
|
9
|
Abstract
Lithium-ion battery (LIB) is a broadly adopted technology for energy storage. With increasing demands to improve the rate capability, cyclability, energy density, safety, and cost efficiency, it is crucial to establish an in-depth understanding of the detailed structural evolution and cell-degradation mechanisms during battery operation. Here, we present a laboratory-based high-resolution and high-throughput X-ray micro-computed laminography approach, which is capable of in situ visualizing of an industry-relevant lithium-ion (Li-ion) pouch cell with superior detection fidelity, resolution, and reliability. This technique enables imaging of the pouch cell at a spatial resolution of 0.5 μm in a laboratory system and permits the identification of submicron features within cathode and anode electrodes. We also demonstrate direct visualization of the lithium plating in the imaged pouch cell, which is an important phenomenon relevant to battery fast charging and low-temperature cycling. Our development presents an avenue toward a thorough understanding of the correlation among multiscale structures, chemomechanical degradation, and electrochemical behavior of industry-scale battery pouch cells.
Collapse
|