1
|
Li J, Bai L, Chen Y, Cao J, Zhu J, Zhi W, Cheng Q. Detecting Collagen by Machine Learning Improved Photoacoustic Spectral Analysis for Breast Cancer Diagnostics: Feasibility Studies With Murine Models. JOURNAL OF BIOPHOTONICS 2025; 18:e202400371. [PMID: 39600191 DOI: 10.1002/jbio.202400371] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/14/2024] [Revised: 10/05/2024] [Accepted: 11/05/2024] [Indexed: 11/29/2024]
Abstract
Collagen, a key structural component of the extracellular matrix, undergoes significant remodeling during carcinogenesis. However, the important role of collagen levels in breast cancer diagnostics still lacks effective in vivo detection techniques to provide a deeper understanding. This study presents photoacoustic spectral analysis improved by machine learning as a promising non-invasive diagnostic method, focusing on exploring collagen as a salient biomarker. Murine model experiments revealed more profound associations of collagen with other cancer components than in normal tissues. Moreover, an optimal set of feature wavelengths was identified by a genetic algorithm for enhanced diagnostic performance, among which 75% were from collagen-dominated absorption wavebands. Using optimal spectra, the diagnostic algorithm achieved 72% accuracy, 66% sensitivity, and 78% specificity, surpassing full-range spectra by 6%, 4%, and 8%, respectively. The proposed photoacoustic methods examine the feasibility of offering valuable biochemical insights into existing techniques, showing great potential for early-stage cancer detection.
Collapse
Affiliation(s)
- Jiayan Li
- Institute of Acoustics, School of Physics Science and Engineering, Tongji University, Shanghai, People's Republic of China
| | - Lu Bai
- Department of Ultrasonography, Fudan University Shanghai Cancer Center, Shanghai Medical College, Fudan University, Shanghai, People's Republic of China
| | - Yingna Chen
- Institute of Acoustics, School of Physics Science and Engineering, Tongji University, Shanghai, People's Republic of China
| | - Junmei Cao
- Institute of Acoustics, School of Physics Science and Engineering, Tongji University, Shanghai, People's Republic of China
| | - Jingtao Zhu
- School of Physics Science and Engineering, Tongji University, Shanghai, People's Republic of China
| | - Wenxiang Zhi
- Department of Ultrasonography, Fudan University Shanghai Cancer Center, Shanghai Medical College, Fudan University, Shanghai, People's Republic of China
| | - Qian Cheng
- Institute of Acoustics, School of Physics Science and Engineering, Tongji University, Shanghai, People's Republic of China
- National Key Laboratory of Autonomous Intelligent Unmanned Systems, Shanghai, People's Republic of China
- Frontiers Science Center for Intelligent Autonomous Systems, Ministry of Education, Shanghai, People's Republic of China
| |
Collapse
|
2
|
Yang Y, Shen H, Chen K, Li X. From pixels to patients: the evolution and future of deep learning in cancer diagnostics. Trends Mol Med 2024:S1471-4914(24)00310-1. [PMID: 39665958 DOI: 10.1016/j.molmed.2024.11.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2024] [Revised: 10/15/2024] [Accepted: 11/14/2024] [Indexed: 12/13/2024]
Abstract
Deep learning has revolutionized cancer diagnostics, shifting from pixel-based image analysis to more comprehensive, patient-centric care. This opinion article explores recent advancements in neural network architectures, highlighting their evolution in biomedical research and their impact on medical imaging interpretation and multimodal data integration. We emphasize the need for domain-specific artificial intelligence (AI) systems capable of handling complex clinical tasks, advocating for the development of multimodal large language models that can integrate diverse data sources. These models have the potential to significantly enhance the precision and efficiency of cancer diagnostics, transforming AI from a supplementary tool into a core component of clinical decision-making, ultimately improving patient outcomes and advancing cancer care.
Collapse
Affiliation(s)
- Yichen Yang
- Tianjin Cancer Institute, Tianjin's Clinical Research Center for Cancer, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy of Tianjin, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China
| | - Hongru Shen
- Tianjin Cancer Institute, Tianjin's Clinical Research Center for Cancer, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy of Tianjin, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China
| | - Kexin Chen
- Department of Epidemiology and Biostatistics, Key Laboratory of Molecular Cancer Epidemiology of Tianjin, Key Laboratory of Prevention and Control of Human Major Diseases in Ministry of Education, Tianjin's Clinical Research Center for Cancer, National Clinical Research Center for Cancer, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China.
| | - Xiangchun Li
- Tianjin Cancer Institute, Tianjin's Clinical Research Center for Cancer, National Clinical Research Center for Cancer, Key Laboratory of Cancer Prevention and Therapy of Tianjin, Tianjin Medical University Cancer Institute and Hospital, Tianjin Medical University, Tianjin, China.
| |
Collapse
|
3
|
Mo S, Luo H, Wang M, Li G, Kong Y, Tian H, Wu H, Tang S, Pan Y, Wang Y, Xu J, Huang Z, Dong F. Machine learning radiomics based on intra and peri tumor PA/US images distinguish between luminal and non-luminal tumors in breast cancers. PHOTOACOUSTICS 2024; 40:100653. [PMID: 39399393 PMCID: PMC11467668 DOI: 10.1016/j.pacs.2024.100653] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/14/2024] [Revised: 09/06/2024] [Accepted: 09/20/2024] [Indexed: 10/15/2024]
Abstract
PURPOSE This study aimed to evaluate a radiomics model using Photoacoustic/ultrasound (PA/US) imaging at intra and peri-tumoral area to differentiate Luminal and non-Luminal breast cancer (BC) and to determine the optimal peritumoral area for accurate classification. MATERIALS AND METHODS From February 2022 to April 2024, this study continuously collected 322 patients at Shenzhen People's Hospital, using standardized conditions for PA/US imaging of BC. Regions of interest were delineated using ITK-SNAP, with peritumoral regions of 2 mm, 4 mm, and 6 mm automatically expanded using code from the Pyradiomic package. Feature extraction was subsequently performed using Pyradiomics. The study employed Z-score normalization, Spearman correlation for feature correlation, and LASSO regression for feature selection, validated through 10-fold cross-validation. The radiomics model integrated intra and peri-tumoral area, evaluated by receiver operating characteristic curve(ROC), Calibration and Decision Curve Analysis(DCA). RESULTS We extracted and selected features from intratumoral and peritumoral PA/US images regions at 2 mm, 4 mm, and 6 mm. The comprehensive radiomics model, integrating these regions, demonstrated enhanced diagnostic performance, especially the 4 mm model which showed the highest area under the curve(AUC):0.898(0.78-1.00) and comparably high accuracy (0.900) and sensitivity (0.937). This model outperformed the standalone clinical model and combined clinical-radiomics model in distinguishing between Luminal and non-Luminal BC, as evidenced in the test set results. CONCLUSION This study developed a radiomics model integrating intratumoral and peritumoral at 4 mm region PA/US model, enhancing the differentiation of Luminal from non-Luminal BC. It demonstrated the diagnostic utility of peritumoral characteristics, reducing the need for invasive biopsies and aiding chemotherapy planning, while emphasizing the importance of optimizing tumor surrounding size for improved model accuracy.
Collapse
Affiliation(s)
- Sijie Mo
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Hui Luo
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Mengyun Wang
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Guoqiu Li
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Yao Kong
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Hongtian Tian
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Huaiyu Wu
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Shuzhen Tang
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Yinhao Pan
- Mindray Bio-Medical Electronics Co.,Ltd., ShenZhen 518057,China
| | - Youping Wang
- Department of Clinical and Research, Shenzhen Mindray Bio-medical Electronics Co., Ltd., Shenzhen, China
| | - Jinfeng Xu
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Zhibin Huang
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
| | - Fajin Dong
- Department of Ultrasound, The Second Clinical Medical College, Jinan University, Guangdong 518020, China
- Department of Ultrasound, Shenzhen People’s Hospital, Guangdong 518020, China
- Department of Ultrasound, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, Guangdong 518020, China
| |
Collapse
|
4
|
Farajollahi A, Baharvand M. Advancements in photoacoustic imaging for cancer diagnosis and treatment. Int J Pharm 2024; 665:124736. [PMID: 39326479 DOI: 10.1016/j.ijpharm.2024.124736] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2024] [Revised: 09/10/2024] [Accepted: 09/19/2024] [Indexed: 09/28/2024]
Abstract
Photoacoustic imaging provides in vivo morphological and functional information about tumors within surrounding tissue. By integrating ultrasound guidance, this technique enables precise localization and characterization of tumors. Moreover, the introduction of targeted contrast agents has further expanded the capabilities of photoacoustic imaging in the realm of in vivo molecular imaging. These contrast agents facilitate enhanced molecular and cellular characterization of cancer, enabling detailed insights into the disease. This review aims to provide a concise summary of the extensive research conducted in the field of Photoacoustic imaging for cancer management. It encompasses the development of the technology, its applications in clinical settings, and the advancements made in molecular imaging. By consolidating and synthesizing the existing knowledge, this review contributes to a better understanding of the potential of photoacoustic imaging in cancer care. In conclusion, photoacoustic imaging has emerged as a non-ionizing and noninvasive modality with the ability to visualize tissue's optical absorption properties while maintaining ultrasound's spatial resolution. Its integration with targeted contrast agents has enhanced molecular and cellular characterization of cancer. This review serves as a succinct overview of the extensive research conducted in the field, shedding light on the potential of photoacoustic imaging in the management of cancer.
Collapse
Affiliation(s)
| | - Mohammad Baharvand
- Department of Mechanical Engineering, Islamic Azad University, Tehran, Iran
| |
Collapse
|
5
|
Ozcan BB, Wanniarachchi H, Mason RP, Dogan BE. Current status of optoacoustic breast imaging and future trends in clinical application: is it ready for prime time? Eur Radiol 2024; 34:6092-6107. [PMID: 38308678 PMCID: PMC11297194 DOI: 10.1007/s00330-024-10600-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Revised: 12/07/2023] [Accepted: 12/26/2023] [Indexed: 02/05/2024]
Abstract
Optoacoustic imaging (OAI) is an emerging field with increasing applications in patients and exploratory clinical trials for breast cancer. Optoacoustic imaging (or photoacoustic imaging) employs non-ionizing, laser light to create thermoelastic expansion in tissues and detect the resulting ultrasonic emission. By combining high optical contrast capabilities with the high spatial resolution and anatomic detail of grayscale ultrasound, OAI offers unique opportunities for visualizing biological function of tissues in vivo. Over the past decade, human breast applications of OAI, including benign/malignant mass differentiation, distinguishing cancer molecular subtype, and predicting metastatic potential, have significantly increased. We discuss the current state of optoacoustic breast imaging, as well as future opportunities and clinical application trends. CLINICAL RELEVANCE STATEMENT: Optoacoustic imaging is a novel breast imaging technique that enables the assessment of breast cancer lesions and tumor biology without the risk of ionizing radiation exposure, intravenous contrast, or radionuclide injection. KEY POINTS: • Optoacoustic imaging (OAI) is a safe, non-invasive imaging technique with thriving research and high potential clinical impact. • OAI has been considered a complementary tool to current standard breast imaging techniques. • OAI combines parametric maps of molecules that absorb light and scatter acoustic waves (like hemoglobin, melanin, lipids, and water) with anatomical images, facilitating scalable and real-time molecular evaluation of tissues.
Collapse
Affiliation(s)
- B Bersu Ozcan
- Department of Radiology, University of Texas Southwestern Medical Center, 5323 Harry Hines Boulevard MC 8896, Dallas, TX, 75390-8896, USA.
| | - Hashini Wanniarachchi
- Department of Radiology, University of Texas Southwestern Medical Center, 5323 Harry Hines Boulevard MC 8896, Dallas, TX, 75390-8896, USA
| | - Ralph P Mason
- Department of Radiology, University of Texas Southwestern Medical Center, 5323 Harry Hines Boulevard MC 8896, Dallas, TX, 75390-8896, USA
| | - Basak E Dogan
- Department of Radiology, University of Texas Southwestern Medical Center, 5323 Harry Hines Boulevard MC 8896, Dallas, TX, 75390-8896, USA
| |
Collapse
|
6
|
Wang Z, Yang F, Zhang W, Xiong K, Yang S. Towards in vivo photoacoustic human imaging: Shining a new light on clinical diagnostics. FUNDAMENTAL RESEARCH 2024; 4:1314-1330. [PMID: 39431136 PMCID: PMC11489505 DOI: 10.1016/j.fmre.2023.01.008] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Revised: 12/14/2022] [Accepted: 01/12/2023] [Indexed: 02/16/2023] Open
Abstract
Multiscale visualization of human anatomical structures is revolutionizing clinical diagnosis and treatment. As one of the most promising clinical diagnostic techniques, photoacoustic imaging (PAI), or optoacoustic imaging, bridges the spatial-resolution gap between pure optical and ultrasonic imaging techniques, by the modes of optical illumination and acoustic detection. PAI can non-invasively capture multiple optical contrasts from the endogenous agents such as oxygenated/deoxygenated hemoglobin, lipid and melanin or a variety of exogenous specific biomarkers to reveal anatomy, function, and molecular for biological tissues in vivo, showing significant potential in clinical diagnostics. In 2001, the worldwide first clinical prototype of the photoacoustic system was used to screen breast cancer in vivo, which opened the prelude to photoacoustic clinical diagnostics. Over the past two decades, PAI has achieved monumental discoveries and applications in human imaging. Progress towards preclinical/clinical applications includes breast, skin, lymphatics, bowel, thyroid, ovarian, prostate, and brain imaging, etc., and there is no doubt that PAI is opening new avenues to realize early diagnosis and precise treatment of human diseases. In this review, the breakthrough researches and key applications of photoacoustic human imaging in vivo are emphatically summarized, which demonstrates the technical superiorities and emerging applications of photoacoustic human imaging in clinical diagnostics, providing clinical translational orientations for the photoacoustic community and clinicians. The perspectives on potential improvements of photoacoustic human imaging are finally highlighted.
Collapse
Affiliation(s)
- Zhiyang Wang
- MOE Key Laboratory of Laser Life Science & Institute of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
| | - Fei Yang
- MOE Key Laboratory of Laser Life Science & Institute of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
| | - Wuyu Zhang
- MOE Key Laboratory of Laser Life Science & Institute of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
| | - Kedi Xiong
- MOE Key Laboratory of Laser Life Science & Institute of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
| | - Sihua Yang
- MOE Key Laboratory of Laser Life Science & Institute of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
- Guangdong Provincial Key Laboratory of Laser Life Science, College of Biophotonics, School of Optoelectronic Science and Engineering, South China Normal University, Guangzhou 510631, China
| |
Collapse
|
7
|
Chen J, Yin Y, Li G, Tian H, Ding Z, Mo S, Xu J, Huang Z, Dong F. Integrated nomogram to predict HER2 expression in breast tumor: Clinical, Ultrasound, and Photoacoustic imaging approaches. Eur J Cancer 2024; 209:114259. [PMID: 39111206 DOI: 10.1016/j.ejca.2024.114259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2024] [Revised: 07/11/2024] [Accepted: 07/22/2024] [Indexed: 08/25/2024]
Abstract
BACKGROUND HER2 is a key biomarker for breast cancer treatment and prognosis. Traditional assessment methods like immunohistochemistry (IHC) and fluorescence in situ hybridization (FISH) are effective but costly and time-consuming. Our model incorporates these methods alongside photoacoustic imaging to enhance diagnostic accuracy and provide more comprehensive clinical insights. MATERIALS AND METHODS A total of 301 breast tumors were included in this study, divided into HER2-positive (3+ or 2+ with gene amplification) and HER2-negative (below 3+ and 2+ without gene amplification) groups. Samples were split into training and validation sets in a 7:3 ratio. Statistical analyses involved t-tests, chi-square tests, and rank-sum tests. Predictive factors were identified using univariate and multivariate logistic regression, leading to the creation of three models: ModA (clinical factors only), ModB (clinical plus ultrasound factors), and ModC (clinical, ultrasound, and photoacoustic imaging-derived oxygen saturation (SO2)). RESULTS The area under the curve (AUC) for ModA was 0.756 (95 % CI: 0.69-0.82), ModB increased to 0.866 (95 % CI: 0.82-0.91), and ModC showed the highest performance with an AUC of 0.877 (95 % CI: 0.83-0.92). These results indicate that the comprehensive model combining clinical, ultrasound, and photoacoustic imaging data (ModC) performed best in predicting HER2 expression. CONCLUSION The findings suggest that integrating clinical, ultrasound, and photoacoustic imaging data significantly enhances the accuracy of predicting HER2 expression. For personalised breast cancer treatment, the integrated model could provide a comprehensive and reproducible decision support tool.
Collapse
Affiliation(s)
- Jing Chen
- Ultrasound Department, Shenzhen Peoples Hospital, Shenzhen 518020, China; Ultrasound Department, The Second Clinical Medical College, Jinan University, Shenzhen, 518020, China; Ultrasound Department, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, China
| | - Yunqing Yin
- The Second Clinical Medical College, Jinan University, Shenzhen 518020, China
| | - Guoqiu Li
- Ultrasound Department, The Second Clinical Medical College, Jinan University, Shenzhen, 518020, China
| | - Hongtian Tian
- Ultrasound Department, Shenzhen Peoples Hospital, Shenzhen 518020, China; Ultrasound Department, The Second Clinical Medical College, Jinan University, Shenzhen, 518020, China; Ultrasound Department, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, China
| | - Zhimin Ding
- Ultrasound Department, Shenzhen Peoples Hospital, Shenzhen 518020, China; Ultrasound Department, The Second Clinical Medical College, Jinan University, Shenzhen, 518020, China; Ultrasound Department, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, China
| | - Sijie Mo
- Ultrasound Department, The Second Clinical Medical College, Jinan University, Shenzhen, 518020, China
| | - Jinfeng Xu
- Ultrasound Department, Shenzhen Peoples Hospital, Shenzhen 518020, China; Ultrasound Department, The Second Clinical Medical College, Jinan University, Shenzhen, 518020, China; Ultrasound Department, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, China.
| | - Zhibin Huang
- Ultrasound Department, Shenzhen Peoples Hospital, Shenzhen 518020, China; Ultrasound Department, The Second Clinical Medical College, Jinan University, Shenzhen, 518020, China.
| | - Fajin Dong
- Ultrasound Department, Shenzhen Peoples Hospital, Shenzhen 518020, China; Ultrasound Department, The Second Clinical Medical College, Jinan University, Shenzhen, 518020, China; Ultrasound Department, The First Affiliated Hospital, Southern University of Science and Technology, Shenzhen, 518020, China.
| |
Collapse
|
8
|
Li G, Huang Z, Tian H, Wu H, Zheng J, Wang M, Mo S, Chen Z, Xu J, Dong F. Deep learning combined with attention mechanisms to assist radiologists in enhancing breast cancer diagnosis: a study on photoacoustic imaging. BIOMEDICAL OPTICS EXPRESS 2024; 15:4689-4704. [PMID: 39346992 PMCID: PMC11427196 DOI: 10.1364/boe.530249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/16/2024] [Revised: 07/10/2024] [Accepted: 07/10/2024] [Indexed: 10/01/2024]
Abstract
Accurate prediction of breast cancer (BC) is essential for effective treatment planning and improving patient outcomes. This study proposes a novel deep learning (DL) approach using photoacoustic (PA) imaging to enhance BC prediction accuracy. We enrolled 334 patients with breast lesions from Shenzhen People's Hospital between January 2022 and January 2024. Our method employs a ResNet50-based model combined with attention mechanisms to analyze photoacoustic ultrasound (PA-US) images. Experiments demonstrated that the PAUS-ResAM50 model achieved superior performance, with an AUC of 0.917 (95% CI: 0.884 -0.951), sensitivity of 0.750, accuracy of 0.854, and specificity of 0.920 in the training set. In the testing set, the model maintained high performance with an AUC of 0.870 (95% CI: 0.778-0.962), sensitivity of 0.786, specificity of 0.872, and accuracy of 0.836. Our model significantly outperformed other models, including PAUS-ResNet50, BMUS-ResAM50, and BMUS-ResNet50, as validated by the DeLong test (p < 0.05 for all comparisons). Additionally, the PAUS-ResAM50 model improved radiologists' diagnostic specificity without reducing sensitivity, highlighting its potential for clinical application. In conclusion, the PAUS-ResAM50 model demonstrates substantial promise for optimizing BC diagnosis and aiding radiologists in early detection of BC.
Collapse
Affiliation(s)
- Guoqiu Li
- Department of Ultrasound, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen 518020, Guangdong, China
| | - Zhibin Huang
- Department of Ultrasound, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen 518020, Guangdong, China
| | - Hongtian Tian
- Department of Ultrasound, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen 518020, Guangdong, China
| | - Huaiyu Wu
- Department of Ultrasound, Shenzhen People's Hospital, Shenzhen 518020, Guangdong, China
| | - Jing Zheng
- Department of Ultrasound, Shenzhen People's Hospital, Shenzhen 518020, Guangdong, China
| | - Mengyun Wang
- Department of Ultrasound, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen 518020, Guangdong, China
| | - Sijie Mo
- Department of Ultrasound, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen 518020, Guangdong, China
| | - Zhijie Chen
- Ultrasound imaging system development department, Shenzhen Mindray Bio-Medical Electronics Co., Ltd. Shenzhen, Guangdong, China
| | - Jinfeng Xu
- Department of Ultrasound, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen 518020, Guangdong, China
- Department of Ultrasound, Shenzhen People's Hospital, Shenzhen 518020, Guangdong, China
| | - Fajin Dong
- Department of Ultrasound, The Second Clinical Medical College, Jinan University (Shenzhen People's Hospital), Shenzhen 518020, Guangdong, China
- Department of Ultrasound, Shenzhen People's Hospital, Shenzhen 518020, Guangdong, China
- Department of Ultrasound, Shenzhen People's Hospital, Longhua Branch, Shenzhen 518020, Guangdong, China
| |
Collapse
|
9
|
Zhang S, Miao J, Li LS. Challenges and advances in two-dimensional photoacoustic computed tomography: a review. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:070901. [PMID: 39006312 PMCID: PMC11245175 DOI: 10.1117/1.jbo.29.7.070901] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 06/18/2024] [Accepted: 06/19/2024] [Indexed: 07/16/2024]
Abstract
Significance Photoacoustic computed tomography (PACT), a hybrid imaging modality combining optical excitation with acoustic detection, has rapidly emerged as a prominent biomedical imaging technique. Aim We review the challenges and advances of PACT, including (1) limited view, (2) anisotropy resolution, (3) spatial aliasing, (4) acoustic heterogeneity (speed of sound mismatch), and (5) fluence correction of spectral unmixing. Approach We performed a comprehensive literature review to summarize the key challenges in PACT toward practical applications and discuss various solutions. Results There is a wide range of contributions from both industry and academic spaces. Various approaches, including emerging deep learning methods, are proposed to improve the performance of PACT further. Conclusions We outline contemporary technologies aimed at tackling the challenges in PACT applications.
Collapse
Affiliation(s)
- Shunyao Zhang
- Rice University, Department of Electrical and Computer Engineering, Houston, Texas, United States
| | - Jingyi Miao
- Rice University, Department of Electrical and Computer Engineering, Houston, Texas, United States
| | - Lei S. Li
- Rice University, Department of Electrical and Computer Engineering, Houston, Texas, United States
| |
Collapse
|
10
|
Li Y, Gröhl J, Haney B, Caranovic M, Lorenz-Meyer E, Papatheodorou N, Kempf J, Regensburger AP, Nedoschill E, Buehler A, Siebenlist G, Lang W, Uder M, Neurath MF, Waldner M, Knieling F, Rother U. Teachability of multispectral optoacoustic tomography. JOURNAL OF BIOPHOTONICS 2024; 17:e202400106. [PMID: 38719459 DOI: 10.1002/jbio.202400106] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/18/2024] [Revised: 04/12/2024] [Accepted: 04/19/2024] [Indexed: 07/13/2024]
Abstract
To date, the appropriate training required for the reproducible operation of multispectral optoacoustic tomography (MSOT) is poorly discussed. Therefore, the aim of this study was to assess the teachability of MSOT imaging. Five operators (two experienced and three inexperienced) performed repositioning imaging experiments. The inexperienced received the following introductions: personal supervision, video meeting, or printed introduction. The task was to image the exact same position on the calf muscle for seven times on five volunteers in two rounds of investigations. In the first session, operators used ultrasound guidance during measurements while using only photoacoustic data in the second session. The performance comparison was carried out with full-reference image quality measures to quantitatively assess the difference between repeated scans. The study demonstrates that given a personal supervision and hybrid ultrasound real-time imaging in MSOT measurements, inexperienced operators are able to achieve the same level as experienced operators in terms of repositioning accuracy.
Collapse
Affiliation(s)
- Yi Li
- Department of Vascular Surgery, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Janek Gröhl
- Cancer Research UK Cambridge Institute, University of Cambridge, Cambridge, UK
- Department of Physics, University of Cambridge, Cambridge, UK
| | - Briain Haney
- Department of Vascular Surgery, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Milenko Caranovic
- Department of Vascular Surgery, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Eva Lorenz-Meyer
- Department of Vascular Surgery, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
- Faculty of Medicine, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Nikolaos Papatheodorou
- Department of Vascular Surgery, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Julius Kempf
- Department of Vascular Surgery, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Adrian P Regensburger
- Department of Pediatrics and Adolescent Medicine, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Emmanuel Nedoschill
- Department of Pediatrics and Adolescent Medicine, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Adrian Buehler
- Department of Pediatrics and Adolescent Medicine, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Gregor Siebenlist
- Department of Pediatrics and Adolescent Medicine, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Werner Lang
- Department of Vascular Surgery, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Michael Uder
- Institute of Radiology, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Markus F Neurath
- Department of Medicine 1, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
- Deutsches Zentrum für Immuntherapie (DZI), University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
- Erlangen Graduate School in Advanced Optical Technologies (SAOT), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Maximilian Waldner
- Department of Medicine 1, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
- Deutsches Zentrum für Immuntherapie (DZI), University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
- Erlangen Graduate School in Advanced Optical Technologies (SAOT), Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Ferdinand Knieling
- Department of Pediatrics and Adolescent Medicine, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| | - Ulrich Rother
- Department of Vascular Surgery, University Hospital Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany
| |
Collapse
|
11
|
Urano M, Nagae K, Matsuda S, Matsubara K, Yagi T, Imanishi N, Aiso S, Obara H, Jinzaki M. Quantitative evaluation of lower limb varicose veins using photoacoustic imaging. J Med Ultrason (2001) 2024; 51:507-516. [PMID: 38900399 PMCID: PMC11272806 DOI: 10.1007/s10396-024-01470-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Accepted: 05/10/2024] [Indexed: 06/21/2024]
Abstract
PURPOSE Varicose veins in the lower extremities are dilated subcutaneous varicose veins with a diameter of ≥ 3 mm, caused by increased venous pressure resulting from backflow of blood due to venous valve insufficiency (Gloviczki in Handbook of venous disorders: guidelines of the American venous forum, Hodder Arnold, London, 2009). When diagnosing varicose veins, the shape and thickness of the blood vessels should be accurately visualized in three dimensions. In this study, we investigated a new method for numerical evaluation of vascular morphology related to varicose veins in the lower extremities, using a photoacoustic imaging (PAI) system, which can acquire high-resolution and three-dimensional images noninvasively. METHODS Nine patients with varicose veins participated in the study, and their images were captured using an optical camera and PAI system. We visualized the vascular structure, created a blood presence density (BPD) heat map, and examined the correlation between BPD and location of varicose veins. RESULTS The obtained photoacoustic (PA) images demonstrated the ability of this method to visualize vessels ranging from as small as 0.2 mm in diameter to large, dilated vessels in three dimensions. Furthermore, the study revealed a correlation between the high-density part of the BPD heat map generated from the PAI images and the presence of varicose veins. CONCLUSION PAI is a promising technique for noninvasive and accurate diagnosis of varicose veins in the lower extremities. By providing valuable information on the morphology and hemodynamics of the varicose veins, PAI may facilitate their early detection and treatment.
Collapse
Affiliation(s)
- Moemi Urano
- Department of Radiology, Keio University School of Medicine, Tokyo, Japan
| | | | - Sachiko Matsuda
- Department of Surgery, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | - Kentaro Matsubara
- Department of Surgery, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan
| | | | - Nobuaki Imanishi
- Department of Anatomy, Keio University School of Medicine, Tokyo, Japan
| | - Sadakazu Aiso
- Department of Anatomy, Keio University School of Medicine, Tokyo, Japan
- Luxonus Inc., Kawasaki, Kanagawa, Japan
| | - Hideaki Obara
- Department of Surgery, Keio University School of Medicine, 35 Shinanomachi, Shinjuku-ku, Tokyo, 160-8582, Japan.
| | - Masahiro Jinzaki
- Department of Radiology, Keio University School of Medicine, Tokyo, Japan
| |
Collapse
|
12
|
Eremici I, Borlea A, Dumitru C, Stoian D. Factors Associated with False Positive Breast Cancer Results in the Real-Time Sonoelastography Evaluation of Solid Breast Lesions. MEDICINA (KAUNAS, LITHUANIA) 2024; 60:1023. [PMID: 39064452 PMCID: PMC11279031 DOI: 10.3390/medicina60071023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/07/2024] [Revised: 06/07/2024] [Accepted: 06/20/2024] [Indexed: 07/28/2024]
Abstract
Background and Objectives: Breast cancer is one of the most widespread cancers among the female population around the world and is curable if diagnosed in an early stage. Consequently, breast cancer screening imaging techniques have greatly evolved and adjusted over the last decades. Alongside mammography, sonoelastography became an important tool for breast cancer detection. However, sonoelastography still has its limitations, namely, there is still a high occurrence of false positive results in the BIRADS 4 category. The aim of our study is to identify potential false positive predictors and to ascertain the factors influencing the quality of strain ultrasound elastography for the evaluation of suspicious solid breast lesions categorized as BIRADS 4B, 4C, and 5. Materials and Methods: We conducted a retrospective study in a single private medical center in Timisoara between January 2017 and January 2022 analyzing 1625 solid breast lesions by the sonoelastography strain using a standardized BIRADS-US lexicon. Results: Our study showed that most sonoelastography factors linked to incorrect and overdiagnosis were due to a nodule dimension (OR = 1.02 per unit increase), posterior acoustic shadowing (OR = 12.26), reactive adenopathy (OR = 6.35), and an increased TES score (TES3 OR = 6.60; TES4 OR = 23.02; TES5 OR = 108.24). Regarding patient characteristics, age (OR = 1.09 per unit increase), BMI, (OR = 1.09 per unit increase), and breastfeeding history (OR = 3.00) were observed to increase the likelihood of false positive results. On the other hand, the nodules less likely to be part of the false positive group exhibited the following characteristics: a regular shape (OR = 0.27), homogenous consistency (OR = 0.42), and avascularity (OR = 0.22). Conclusions: Older age, high BMI, patients with a breastfeeding history, and those who exhibit the following specific nodule characteristics were most often linked to false positive results: large tumors with posterior acoustic shadowing and high elasticity scores, accompanied by reactive adenopathy. On the other hand, homogenous, avascular nodules with regular shapes were less likely to be misdiagnosed.
Collapse
Affiliation(s)
- Ivana Eremici
- PhD School, Victor Babes University of Medicine and Pharmacy, 300041 Timisoara, Romania
| | - Andreea Borlea
- Department of Internal Medicine II, Victor Babes University of Medicine and Pharmacy, 300041 Timisoara, Romania
| | - Catalin Dumitru
- Obstetrics and Gynecology Department, Victor Babes University of Medicine and Pharmacy, 300041 Timisoara, Romania
| | - Dana Stoian
- Department of Internal Medicine II, Victor Babes University of Medicine and Pharmacy, 300041 Timisoara, Romania
| |
Collapse
|
13
|
Yu Y, Feng T, Qiu H, Gu Y, Chen Q, Zuo C, Ma H. Simultaneous photoacoustic and ultrasound imaging: A review. ULTRASONICS 2024; 139:107277. [PMID: 38460216 DOI: 10.1016/j.ultras.2024.107277] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Revised: 01/09/2024] [Accepted: 02/26/2024] [Indexed: 03/11/2024]
Abstract
Photoacoustic imaging (PAI) is an emerging biomedical imaging technique that combines the advantages of optical and ultrasound imaging, enabling the generation of images with both optical resolution and acoustic penetration depth. By leveraging similar signal acquisition and processing methods, the integration of photoacoustic and ultrasound imaging has introduced a novel hybrid imaging modality suitable for clinical applications. Photoacoustic-ultrasound imaging allows for non-invasive, high-resolution, and deep-penetrating imaging, providing a wealth of image information. In recent years, with the deepening research and the expanding biomedical application scenarios of photoacoustic-ultrasound bimodal systems, the immense potential of photoacoustic-ultrasound bimodal imaging in basic research and clinical applications has been demonstrated, with some research achievements already commercialized. In this review, we introduce the principles, technical advantages, and biomedical applications of photoacoustic-ultrasound bimodal imaging techniques, specifically focusing on tomographic, microscopic, and endoscopic imaging modalities. Furthermore, we discuss the future directions of photoacoustic-ultrasound bimodal imaging technology.
Collapse
Affiliation(s)
- Yinshi Yu
- Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094, China; Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210019, China; Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing, Jiangsu Province 210094, China
| | - Ting Feng
- Academy for Engineering & Technology, Fudan University, Shanghai 200433,China.
| | - Haixia Qiu
- First Medical Center of PLA General Hospital, Beijing, China
| | - Ying Gu
- First Medical Center of PLA General Hospital, Beijing, China
| | - Qian Chen
- Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094, China; Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210019, China; Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing, Jiangsu Province 210094, China
| | - Chao Zuo
- Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094, China; Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210019, China; Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing, Jiangsu Province 210094, China.
| | - Haigang Ma
- Smart Computational Imaging Laboratory (SCILab), School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210094, China; Smart Computational Imaging Research Institute (SCIRI) of Nanjing University of Science and Technology, Nanjing, Jiangsu Province 210019, China; Jiangsu Key Laboratory of Spectral Imaging & Intelligent Sense, Nanjing, Jiangsu Province 210094, China.
| |
Collapse
|
14
|
Nyayapathi N, Zheng E, Zhou Q, Doyley M, Xia J. Dual-modal Photoacoustic and Ultrasound Imaging: from preclinical to clinical applications. FRONTIERS IN PHOTONICS 2024; 5:1359784. [PMID: 39185248 PMCID: PMC11343488 DOI: 10.3389/fphot.2024.1359784] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/27/2024]
Abstract
Photoacoustic imaging is a novel biomedical imaging modality that has emerged over the recent decades. Due to the conversion of optical energy into the acoustic wave, photoacoustic imaging offers high-resolution imaging in depth beyond the optical diffusion limit. Photoacoustic imaging is frequently used in conjunction with ultrasound as a hybrid modality. The combination enables the acquisition of both optical and acoustic contrasts of tissue, providing functional, structural, molecular, and vascular information within the same field of view. In this review, we first described the principles of various photoacoustic and ultrasound imaging techniques and then classified the dual-modal imaging systems based on their preclinical and clinical imaging applications. The advantages of dual-modal imaging were thoroughly analyzed. Finally, the review ends with a critical discussion of existing developments and a look toward the future.
Collapse
Affiliation(s)
- Nikhila Nyayapathi
- Electrical and Computer Engineering, University of Rochester, Rochester, New York, 14627
| | - Emily Zheng
- Department of Biomedical Engineering, University at Buffalo, Buffalo, New York, 14226
| | - Qifa Zhou
- Department of Biomedical Engineering, University of Southern California, Los Angeles, CA 90007
| | - Marvin Doyley
- Electrical and Computer Engineering, University of Rochester, Rochester, New York, 14627
| | - Jun Xia
- Department of Biomedical Engineering, University at Buffalo, Buffalo, New York, 14226
| |
Collapse
|
15
|
Rajora AK, Ahire ED, Rajora M, Singh S, Bhattacharya J, Zhang H. Emergence and impact of theranostic-nanoformulation of triple therapeutics for combination cancer therapy. SMART MEDICINE 2024; 3:e20230035. [PMID: 39188518 PMCID: PMC11235932 DOI: 10.1002/smmd.20230035] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 11/30/2023] [Indexed: 08/28/2024]
Abstract
Cancer remains a major global health threat necessitating the multipronged approaches for its prevention and management. Traditional approaches in the form of chemotherapy, surgery, and radiotherapy are often encountered with poor patient outcomes evidenced by high mortality and morbidity, compelling the need for precision medicine for cancer patients to enable personalized and targeted cancer treatment. There has been an emergence of smart multimodal theranostic nanoformulation for triple combination cancer therapy in the last few years, which dramatically enhances the overall safety of the nanoformulation for in vivo and potential clinical applications with minimal toxicity. However, it is imperative to gain insight into the limitations of this system in terms of clinical translation, cost-effectiveness, accessibility, and multidisciplinary collaboration. This review paper aims to highlight and compare the impact of the recent theranostic nanoformulations of triple therapeutics in a single nanocarrier for effective management of cancer and provide a new dimension for diagnostic and treatment simultaneously.
Collapse
Affiliation(s)
- Amit Kumar Rajora
- NanoBiotechnology LabSchool of BiotechnologyJawaharlal Nehru UniversityNew DelhiIndia
| | - Eknath D. Ahire
- Department of Pharmaceutics, Mumbai Educational Trust (MET), Institute of PharmacyAffiliated to Savitribai Phule, Pune UniversityNashikMaharashtraIndia
| | - Manju Rajora
- College of NursingAll India Institute of Medical SciencesNew DelhiIndia
| | - Sukhvir Singh
- Radiological Physics and Internal Dosimetry (RAPID) GroupInstitute of Nuclear Medicine and Allied SciencesDefense Research & Development Organization, Ministry of DefenseTimarpurDelhiIndia
| | - Jaydeep Bhattacharya
- NanoBiotechnology LabSchool of BiotechnologyJawaharlal Nehru UniversityNew DelhiIndia
| | - Hongbo Zhang
- Pharmaceutical Sciences LaboratoryFaculty of Science and EngineeringÅbo Akademi UniversityTurkuFinland
- Turku Bioscience CenterUniversity of Turku and Åbo Akademi UniversityTurkuFinland
| |
Collapse
|
16
|
Oh D, Kim H, Sung M, Kim C. Video-rate endocavity photoacoustic/harmonic ultrasound imaging with miniaturized light delivery. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11528. [PMID: 38505737 PMCID: PMC10949014 DOI: 10.1117/1.jbo.29.s1.s11528] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 02/02/2024] [Accepted: 02/28/2024] [Indexed: 03/21/2024]
Abstract
Significance Endocavity ultrasound (US) imaging is a frequently employed diagnostic technique in gynecology and urology for the assessment of male and female genital diseases that present challenges for conventional transabdominal imaging. The integration of photoacoustic (PA) imaging with clinical US imaging has displayed promising outcomes in clinical research. Nonetheless, its application has been constrained due to size limitations, restricting it to spatially confined locations such as vaginal or rectal canals. Aim This study presents the development of a video-rate (20 Hz) endocavity PA/harmonic US imaging (EPAUSI) system. Approach The approach incorporates a commercially available endocavity US probe with a miniaturized laser delivery unit, comprised of a single large-core fiber and a line beamshaping engineered diffuser. The system facilitates real-time image display and subsequent processing, including angular energy density correction and spectral unmixing, in offline mode. Results The spatial resolutions of the concurrently acquired PA and harmonic US images were measured at 318 μ m and 291 μ m in the radial direction, respectively, and 1.22 deg and 1.50 deg in the angular direction, respectively. Furthermore, the system demonstrated its capability in multispectral PA imaging by successfully distinguishing two clinical dyes in a tissue-mimicking phantom. Its rapid temporal resolution enabled the capture of kinetic dye perfusion into an ex vivo porcine ovary through the depth of porcine uterine tissue. EPAUSI proved its clinical viability by detecting pulsating hemodynamics in the male rat's prostate in vivo and accurately classifying human blood vessels into arteries and veins based on sO 2 measurements. Conclusions Our proposed EPAUSI system holds the potential to unveil previously overlooked indicators of vascular alterations in genital cancers or endometriosis, addressing pressing requirements in the fields of gynecology and urology.
Collapse
Affiliation(s)
- Donghyeon Oh
- Pohang University of Science and Technology, Medical Device Innovation Center, Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Pohang, Republic of Korea
| | - Hyunhee Kim
- Pohang University of Science and Technology, Medical Device Innovation Center, Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Pohang, Republic of Korea
| | - Minsik Sung
- Pohang University of Science and Technology, Medical Device Innovation Center, Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Pohang, Republic of Korea
| | - Chulhong Kim
- Pohang University of Science and Technology, Medical Device Innovation Center, Departments of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, Medical Science and Engineering, Pohang, Republic of Korea
| |
Collapse
|
17
|
De Santi B, Kim L, Bulthuis RFG, Lucka F, Manohar S. Automated three-dimensional image registration for longitudinal photoacoustic imaging. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11515. [PMID: 38223681 PMCID: PMC10787589 DOI: 10.1117/1.jbo.29.s1.s11515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Revised: 12/05/2023] [Accepted: 12/15/2023] [Indexed: 01/16/2024]
Abstract
Significance Photoacoustic tomography (PAT) has great potential in monitoring disease progression and treatment response in breast cancer. However, due to variations in breast repositioning, there is a chance of geometric misalignment between images. Further, poor repositioning can affect light fluence distribution and imaging field-of-view, making images different from one another. The net effect is that it becomes challenging to distinguish between image changes due to repositioning effects and those due to true biological variations. Aim The aim is to develop a three-dimensional image registration framework for geometrically aligning repeated PAT volumetric images, which are potentially affected by repositioning effects such as misalignment, changed radiant exposure conditions, and different fields-of-view. Approach The proposed framework involves the use of a coordinate-based neural network to represent the displacement field between pairs of PAT volumetric images. A loss function based on normalized cross correlation and Frangi vesselness feature extraction at multiple scales was implemented. We refer to our image registration framework as MUVINN-reg, which stands for multiscale vesselness-based image registration using neural networks. The approach was tested on a longitudinal dataset of healthy volunteer breast PAT images acquired with the hybrid photoacoustic-ultrasound Photoacoustic Mammoscope 3 imaging system. The registration performance was also tested under unfavorable repositioning conditions such as intentional mispositioning, and variation in breast-supporting cup size between measurements. Results A total of 13 pairs of repeated PAT scans were included in this study. MUVINN-reg showed excellent performance in co-registering each pair of images. The proposed framework was shown to be robust to image intensity shifts and field-of-view changes. Furthermore, MUVINN-reg could align vessels at imaging depths greater than 4 cm. Conclusions The proposed framework will enable the use of PAT for quantitative and reproducible monitoring of disease progression and treatment response.
Collapse
Affiliation(s)
- Bruno De Santi
- University of Twente, TechMed Centre, Multi-Modality Medical Imaging Group, Enschede, The Netherlands
| | - Lucia Kim
- University of Twente, TechMed Centre, Multi-Modality Medical Imaging Group, Enschede, The Netherlands
| | - Rianne F. G. Bulthuis
- University of Twente, TechMed Centre, Multi-Modality Medical Imaging Group, Enschede, The Netherlands
- Medisch Spectrum Hospital, Department of Radiology, Enschede, The Netherlands
| | - Felix Lucka
- Centrum Wiskunde en Informatica (CWI), Amsterdam, The Netherlands
| | - Srirang Manohar
- University of Twente, TechMed Centre, Multi-Modality Medical Imaging Group, Enschede, The Netherlands
| |
Collapse
|
18
|
Cam RM, Wang C, Thompson W, Ermilov SA, Anastasio MA, Villa U. Spatiotemporal image reconstruction to enable high-frame-rate dynamic photoacoustic tomography with rotating-gantry volumetric imagers. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11516. [PMID: 38249994 PMCID: PMC10798269 DOI: 10.1117/1.jbo.29.s1.s11516] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/30/2023] [Revised: 11/22/2023] [Accepted: 12/20/2023] [Indexed: 01/23/2024]
Abstract
Significance Dynamic photoacoustic computed tomography (PACT) is a valuable imaging technique for monitoring physiological processes. However, current dynamic PACT imaging techniques are often limited to two-dimensional spatial imaging. Although volumetric PACT imagers are commercially available, these systems typically employ a rotating measurement gantry in which the tomographic data are sequentially acquired as opposed to being acquired simultaneously at all views. Because the dynamic object varies during the data-acquisition process, the sequential data-acquisition process poses substantial challenges to image reconstruction associated with data incompleteness. The proposed image reconstruction method is highly significant in that it will address these challenges and enable volumetric dynamic PACT imaging with existing preclinical imagers. Aim The aim of this study is to develop a spatiotemporal image reconstruction (STIR) method for dynamic PACT that can be applied to commercially available volumetric PACT imagers that employ a sequential scanning strategy. The proposed reconstruction method aims to overcome the challenges caused by the limited number of tomographic measurements acquired per frame. Approach A low-rank matrix estimation-based STIR (LRME-STIR) method is proposed to enable dynamic volumetric PACT. The LRME-STIR method leverages the spatiotemporal redundancies in the dynamic object to accurately reconstruct a four-dimensional (4D) spatiotemporal image. Results The conducted numerical studies substantiate the LRME-STIR method's efficacy in reconstructing 4D dynamic images from tomographic measurements acquired with a rotating measurement gantry. The experimental study demonstrates the method's ability to faithfully recover the flow of a contrast agent with a frame rate of 10 frames per second, even when only a single tomographic measurement per frame is available. Conclusions The proposed LRME-STIR method offers a promising solution to the challenges faced by enabling 4D dynamic imaging using commercially available volumetric PACT imagers. By enabling accurate STIRs, this method has the potential to significantly advance preclinical research and facilitate the monitoring of critical physiological biomarkers.
Collapse
Affiliation(s)
- Refik Mert Cam
- University of Illinois Urbana-Champaign, Department of Electrical and Computer Engineering, Urbana, Illinois, United States
| | - Chao Wang
- National University of Singapore, Department of Statistics and Data Science, Singapore
| | | | | | - Mark A. Anastasio
- University of Illinois Urbana-Champaign, Department of Bioengineering, Urbana, Illinois, United States
| | - Umberto Villa
- The University of Texas at Austin, Oden Institute for Computational Engineering and Sciences, Austin, Texas, United States
| |
Collapse
|
19
|
Liu H, Wang M, Ji F, Jiang Y, Yang M. Mini review of photoacoustic clinical imaging: a noninvasive tool for disease diagnosis and treatment evaluation. JOURNAL OF BIOMEDICAL OPTICS 2024; 29:S11522. [PMID: 38230369 PMCID: PMC10790789 DOI: 10.1117/1.jbo.29.s1.s11522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Revised: 12/05/2023] [Accepted: 12/14/2023] [Indexed: 01/18/2024]
Abstract
Significance Photoacoustic (PA) imaging is an imaging modality that integrates anatomical, functional, metabolic, and histologic insights. It has been a hot topic of medical research and draws extensive attention. Aim This review aims to explore the applications of PA clinical imaging in human diseases, highlighting recent advancements. Approach A systemic survey of the literature concerning the clinical utility of PA imaging was conducted, with a particular focus on its application in tumors, autoimmune diseases, inflammatory conditions, and endocrine disorders. Results PA imaging is emerging as a valuable tool for human disease investigation. Information provided by PA imaging can be used for diagnosis, grading, and prognosis in multiple types of tumors including breast tumors, ovarian neoplasms, thyroid nodules, and cutaneous malignancies. PA imaging facilitates the monitoring of disease activity in autoimmune and inflammatory diseases such as rheumatoid arthritis, systemic sclerosis, arteritis, and inflammatory bowel disease by capturing dynamic functional alterations. Furthermore, its unique capability of visualizing vascular structure and oxygenation levels aids in assessing diabetes mellitus comorbidities and thyroid function. Conclusions Despite extant challenges, PA imaging offers a promising noninvasive tool for precision disease diagnosis, long-term evaluation, and prognosis anticipation, making it a potentially significant imaging modality for clinical practice.
Collapse
Affiliation(s)
- Huazhen Liu
- Chinese Academy of Medical Sciences and Peking Union Medical College, Peking Union Medical College Hospital, Department of Ultrasound, Beijing, China
| | - Ming Wang
- Chinese Academy of Medical Sciences and Peking Union Medical College, Peking Union Medical College Hospital, Department of Ultrasound, Beijing, China
| | - Fei Ji
- Chinese Academy of Medical Sciences and Peking Union Medical College, Peking Union Medical College Hospital, Department of Ultrasound, Beijing, China
| | - Yuxin Jiang
- Chinese Academy of Medical Sciences and Peking Union Medical College, Peking Union Medical College Hospital, Department of Ultrasound, Beijing, China
| | - Meng Yang
- Chinese Academy of Medical Sciences and Peking Union Medical College, Peking Union Medical College Hospital, Department of Ultrasound, Beijing, China
| |
Collapse
|
20
|
Riksen JJM, Nikolaev AV, van Soest G. Photoacoustic imaging on its way toward clinical utility: a tutorial review focusing on practical application in medicine. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:121205. [PMID: 37304059 PMCID: PMC10249868 DOI: 10.1117/1.jbo.28.12.121205] [Citation(s) in RCA: 22] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/16/2023] [Revised: 05/12/2023] [Accepted: 05/18/2023] [Indexed: 06/13/2023]
Abstract
Significance Photoacoustic imaging (PAI) enables the visualization of optical contrast with ultrasonic imaging. It is a field of intense research, with great promise for clinical application. Understanding the principles of PAI is important for engineering research and image interpretation. Aim In this tutorial review, we lay out the imaging physics, instrumentation requirements, standardization, and some practical examples for (junior) researchers, who have an interest in developing PAI systems and applications for clinical translation or applying PAI in clinical research. Approach We discuss PAI principles and implementation in a shared context, emphasizing technical solutions that are amenable to broad clinical deployment, considering factors such as robustness, mobility, and cost in addition to image quality and quantification. Results Photoacoustics, capitalizing on endogenous contrast or administered contrast agents that are approved for human use, yields highly informative images in clinical settings, which can support diagnosis and interventions in the future. Conclusion PAI offers unique image contrast that has been demonstrated in a broad set of clinical scenarios. The transition of PAI from a "nice-to-have" to a "need-to-have" modality will require dedicated clinical studies that evaluate therapeutic decision-making based on PAI and consideration of the actual value for patients and clinicians, compared with the associated cost.
Collapse
Affiliation(s)
- Jonas J. M. Riksen
- Erasmus University Medical Center, Department of Cardiology, Rotterdam, The Netherlands
| | - Anton V. Nikolaev
- Erasmus University Medical Center, Department of Cardiology, Rotterdam, The Netherlands
| | - Gijs van Soest
- Erasmus University Medical Center, Department of Cardiology, Rotterdam, The Netherlands
| |
Collapse
|
21
|
Sridharan B, Lim HG. Advances in photoacoustic imaging aided by nano contrast agents: special focus on role of lymphatic system imaging for cancer theranostics. J Nanobiotechnology 2023; 21:437. [PMID: 37986071 PMCID: PMC10662568 DOI: 10.1186/s12951-023-02192-8] [Citation(s) in RCA: 19] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Accepted: 11/03/2023] [Indexed: 11/22/2023] Open
Abstract
Photoacoustic imaging (PAI) is a successful clinical imaging platform for management of cancer and other health conditions that has seen significant progress in the past decade. However, clinical translation of PAI based methods are still under scrutiny as the imaging quality and clinical information derived from PA images are not on par with other imaging methods. Hence, to improve PAI, exogenous contrast agents, in the form of nanomaterials, are being used to achieve better image with less side effects, lower accumulation, and improved target specificity. Nanomedicine has become inevitable in cancer management, as it contributes at every stage from diagnosis to therapy, surgery, and even in the postoperative care and surveillance for recurrence. Nanocontrast agents for PAI have been developed and are being explored for early and improved cancer diagnosis. The systemic stability and target specificity of the nanomaterials to render its theranostic property depends on various influencing factors such as the administration route and physico-chemical responsiveness. The recent focus in PAI is on targeting the lymphatic system and nodes for cancer diagnosis, as they play a vital role in cancer progression and metastasis. This review aims to discuss the clinical advancements of PAI using nanoparticles as exogenous contrast agents for cancer theranostics with emphasis on PAI of lymphatic system for diagnosis, cancer progression, metastasis, PAI guided tumor resection, and finally PAI guided drug delivery.
Collapse
Affiliation(s)
- Badrinathan Sridharan
- Department of Biomedical Engineering, Pukyong National University, Busan, 48513, Republic of Korea
| | - Hae Gyun Lim
- Department of Biomedical Engineering, Pukyong National University, Busan, 48513, Republic of Korea.
| |
Collapse
|
22
|
Vogt WC, Wear KA, Pfefer TJ. Phantoms for evaluating the impact of skin pigmentation on photoacoustic imaging and oximetry performance. BIOMEDICAL OPTICS EXPRESS 2023; 14:5735-5748. [PMID: 38021140 PMCID: PMC10659791 DOI: 10.1364/boe.501950] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 08/25/2023] [Accepted: 09/11/2023] [Indexed: 12/01/2023]
Abstract
Recent reports have raised concerns of potential racial disparities in performance of optical oximetry technologies. To investigate how variable epidermal melanin content affects performance of photoacoustic imaging (PAI) devices, we developed plastisol phantoms combining swappable skin-mimicking layers with a breast phantom containing either India ink or blood adjusted to 50-100% SO2 using sodium dithionite. Increasing skin pigmentation decreased maximum imaging depth by up to 25%, enhanced image clutter, and increased root-mean-square error in SO2 from 8.0 to 17.6% due to signal attenuation and spectral coloring effects. This phantom tool can aid in evaluating PAI device robustness to ensure high performance in all patients.
Collapse
Affiliation(s)
- William C. Vogt
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, MD 20993, USA
| | - Keith A. Wear
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, MD 20993, USA
| | - T. Joshua Pfefer
- Center for Devices and Radiological Health, U.S. Food and Drug Administration, 10903 New Hampshire Avenue, Silver Spring, MD 20993, USA
| |
Collapse
|
23
|
Manwar R, Li X, Kratkiewicz K, Zhu D, Avanaki K. Adaptive coherent weighted averaging algorithm for enhancement of photoacoustic tomography images of brain. JOURNAL OF BIOPHOTONICS 2023; 16:e202300103. [PMID: 37468445 DOI: 10.1002/jbio.202300103] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Revised: 06/15/2023] [Accepted: 07/03/2023] [Indexed: 07/21/2023]
Abstract
One common method to improve the low signal-to-noise ratio of the photoacoustic (PA) signal generated from weak absorbers or absorbers located in deep tissue is to acquire signal multiple times from the same region and perform averaging. However, pulse-to-pulse laser fluctuations together with differences in the beam profile of the pulses create undeterministic multiple scattering processes in the tissue. This phenomenon consequently induces a spatiotemporal displacement in the PA signal samples which in turn deteriorates the effectiveness of signal averaging. Here, we present an adaptive coherent weighted averaging algorithm to adjust the locations and values of PA signal samples for more efficient signal averaging. The proposed method is evaluated in a linear array-based PA imaging setup of ex vivo sheep brain.
Collapse
Affiliation(s)
- Rayyan Manwar
- Richard and Loan Hill Department of Biomedical Engineering, University of Illinois at Chicago, Chicago, Illinois, USA
| | - Xin Li
- Department of Computer Science, Wayne State University, Detroit, Michigan, USA
| | - Karl Kratkiewicz
- Department of Biomedical Engineering, Wayne State University, Detroit, Michigan, USA
| | - Dongxiao Zhu
- Department of Computer Science, Wayne State University, Detroit, Michigan, USA
| | - Kamran Avanaki
- Richard and Loan Hill Department of Biomedical Engineering, University of Illinois at Chicago, Chicago, Illinois, USA
| |
Collapse
|
24
|
Zhang J, Wu J, Zhou XS, Shi F, Shen D. Recent advancements in artificial intelligence for breast cancer: Image augmentation, segmentation, diagnosis, and prognosis approaches. Semin Cancer Biol 2023; 96:11-25. [PMID: 37704183 DOI: 10.1016/j.semcancer.2023.09.001] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 08/03/2023] [Accepted: 09/05/2023] [Indexed: 09/15/2023]
Abstract
Breast cancer is a significant global health burden, with increasing morbidity and mortality worldwide. Early screening and accurate diagnosis are crucial for improving prognosis. Radiographic imaging modalities such as digital mammography (DM), digital breast tomosynthesis (DBT), magnetic resonance imaging (MRI), ultrasound (US), and nuclear medicine techniques, are commonly used for breast cancer assessment. And histopathology (HP) serves as the gold standard for confirming malignancy. Artificial intelligence (AI) technologies show great potential for quantitative representation of medical images to effectively assist in segmentation, diagnosis, and prognosis of breast cancer. In this review, we overview the recent advancements of AI technologies for breast cancer, including 1) improving image quality by data augmentation, 2) fast detection and segmentation of breast lesions and diagnosis of malignancy, 3) biological characterization of the cancer such as staging and subtyping by AI-based classification technologies, 4) prediction of clinical outcomes such as metastasis, treatment response, and survival by integrating multi-omics data. Then, we then summarize large-scale databases available to help train robust, generalizable, and reproducible deep learning models. Furthermore, we conclude the challenges faced by AI in real-world applications, including data curating, model interpretability, and practice regulations. Besides, we expect that clinical implementation of AI will provide important guidance for the patient-tailored management.
Collapse
Affiliation(s)
- Jiadong Zhang
- School of Biomedical Engineering, ShanghaiTech University, Shanghai, China
| | - Jiaojiao Wu
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China
| | - Xiang Sean Zhou
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China
| | - Feng Shi
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China.
| | - Dinggang Shen
- School of Biomedical Engineering, ShanghaiTech University, Shanghai, China; Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China; Shanghai Clinical Research and Trial Center, Shanghai, China.
| |
Collapse
|
25
|
Li S, Wu H, Zhang H, Zhang Z, Liu Q, Song X. Noise insensitive volumetric fusion method for enhanced photoacoustic microscopy. JOURNAL OF BIOMEDICAL OPTICS 2023; 28:106501. [PMID: 37799936 PMCID: PMC10547913 DOI: 10.1117/1.jbo.28.10.106501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/21/2023] [Revised: 09/22/2023] [Accepted: 09/25/2023] [Indexed: 10/07/2023]
Abstract
Significance Photoacoustic imaging is an emerging imaging modality that combines the high contrast of optical imaging and the high penetration of acoustic imaging. However, the strong focusing of the laser beam in optical-resolution photoacoustic microscopy (OR-PAM) leads to a limited depth-of-field (DoF). Aim Here, a volumetric photoacoustic information fusion method was proposed to achieve large volumetric photoacoustic imaging at low cost. Approach First, the initial decision map was built through the focus detection based on the proposed three-dimensional Laplacian operator. Majority filter-based consistency verification and Gaussian filter-based map smoothing were then utilized to generate the final decision map for the construction of photoacoustic imaging with extended DoF. Results The performance of the proposed method was tested to show that our method can expand the limited DoF by a factor of 1.7 without the sacrifice of lateral resolution. Four sets of multi-focus vessel data at different noise levels were fused to verify the effectiveness and robustness of the proposed method. Conclusions The proposed method can efficiently extend the DoF of OR-PAM under different noise levels.
Collapse
Affiliation(s)
- Sihang Li
- Nanchang University, School of Information Engineering, Nanchang, China
- Nanchang University, Jiluan Academy, Nanchang, China
| | - Hao Wu
- Nanchang University, Jiluan Academy, Nanchang, China
| | - Hongyu Zhang
- Nanchang University, Jiluan Academy, Nanchang, China
| | - Zhipeng Zhang
- Nanchang University, Jiluan Academy, Nanchang, China
| | - Qiugen Liu
- Nanchang University, Jiluan Academy, Nanchang, China
| | - Xianlin Song
- Nanchang University, Jiluan Academy, Nanchang, China
| |
Collapse
|
26
|
Cano C, Mohammadian Rad N, Gholampour A, van Sambeek M, Pluim J, Lopata R, Wu M. Deep learning assisted classification of spectral photoacoustic imaging of carotid plaques. PHOTOACOUSTICS 2023; 33:100544. [PMID: 37671317 PMCID: PMC10475504 DOI: 10.1016/j.pacs.2023.100544] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/17/2023] [Revised: 07/31/2023] [Accepted: 08/11/2023] [Indexed: 09/07/2023]
Abstract
Spectral photoacoustic imaging (sPAI) is an emerging modality that allows real-time, non-invasive, and radiation-free assessment of tissue, benefiting from their optical contrast. sPAI is ideal for morphology assessment in arterial plaques, where plaque composition provides relevant information on plaque progression and its vulnerability. However, since sPAI is affected by spectral coloring, general spectroscopy unmixing techniques cannot provide reliable identification of such complicated sample composition. In this study, we employ a convolutional neural network (CNN) for the classification of plaque composition using sPAI. For this study, nine carotid endarterectomy plaques were imaged and were then annotated and validated using multiple histological staining. Our results show that a CNN can effectively differentiate constituent regions within plaques without requiring fluence or spectra correction, with the potential to eventually support vulnerability assessment in plaques.
Collapse
Affiliation(s)
- Camilo Cano
- Department of Biomedical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands
| | - Nastaran Mohammadian Rad
- Department of Biomedical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands
- Department of Precision Medicine, Maastricht University, Minderbroedersberg 4-6, Maastricht, the Netherlands
| | - Amir Gholampour
- Department of Biomedical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands
| | - Marc van Sambeek
- Department of Biomedical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands
- Department of Vascular Surgery, Catharina Ziekenhuis Eindhoven, Michelangelolaan 2, State Two, the Netherlands
| | - Josien Pluim
- Department of Biomedical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands
| | - Richard Lopata
- Department of Biomedical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands
| | - Min Wu
- Department of Biomedical Engineering, Eindhoven University of Technology, De Rondom 70, Eindhoven, the Netherlands
| |
Collapse
|
27
|
Xu N, Wu D, Gao J, Jiang H, Li Q, Bao S, Luo Y, Zhou Q, Liao C, Yang J. The effect of tumor vascular remodeling and immune microenvironment activation induced by radiotherapy: quantitative evaluation with magnetic resonance/photoacoustic dual-modality imaging. Quant Imaging Med Surg 2023; 13:6555-6570. [PMID: 37869299 PMCID: PMC10585512 DOI: 10.21037/qims-23-229] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2023] [Accepted: 08/14/2023] [Indexed: 10/24/2023]
Abstract
Background Tumor radiotherapy combined with immunotherapy for solid tumors has been proposed, but tumor vascular structure abnormalities and immune microenvironment often affect the therapeutic effect of tumor, and multimodal imaging technology can provide more accurate and comprehensive information in tumor research. The purpose of this study was to evaluate the dynamic monitoring of tumor blood vessels and microenvironment induced by radiotherapy by magnetic resonance/photoacoustic (MR/PA) imaging, and to explore its application value in radiotherapy combined with immunotherapy. Methods The tumor-bearing mice were randomly allocated into six groups, which received different doses of radiation therapy (2 Gy ×14 or 8 Gy ×3) and anti-programmed death ligand-1 (PD-L1) antibody for two consecutive weeks. MR/PA imaging was used to noninvasively evaluate the response of tumor to different doses of radiotherapy, combined with histopathological techniques to observe the tumor vessels and microenvironment. Results The inhibitory effect of high-dose radiotherapy on tumors was significantly greater than that of low-dose radiotherapy, with the MR images revealing that the signal intensity decreased significantly (P<0.05). Compared with those in the other groups, the tumor vascular density decreased significantly (P<0.01), and the vascular maturity index increased significantly in the low-dose group (P<0.05). The PA images showed that the deoxyhemoglobin and total hemoglobin levels decreased and the SO2 level increased after radiation treatment (P<0.05). In addition, the high-dose group had an increased number of tumor-infiltrating lymphocytes (CD4+ T and CD8+ T cells) (P<0.01, P<0.05) and natural killer cells (P<0.001) and increased PD-L1 expression in the tumors (P<0.05). The combination of radiotherapy and immunotherapy increased the survival rate of the mice (P<0.05), and a regimen of an 8 Gy dose of radiation combined with immunotherapy inhibited tumor growth and increased the survival rate of the mice to a greater degree than the 2 Gy radiation dose with immunotherapy combination (P=0.002). Conclusions Differential fractionation radiotherapy doses exert biological effects on tumor vascular and the immune microenvironment, and MR/PA can be used to evaluate tumor vascular remodeling after radiotherapy, which has certain value for the clinical applications of radiotherapy combined with immunotherapy.
Collapse
Affiliation(s)
- Nan Xu
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center, Kunming, China
| | - Dan Wu
- School of Optoelectric Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Jingyan Gao
- Department of Radiation Oncology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center, Kunming, China
| | - Huabei Jiang
- Department of Medical Engineering, University of South Florida, Tampa, USA
| | - Qinqing Li
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center, Kunming, China
| | - Shasha Bao
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center, Kunming, China
| | - Yueyuan Luo
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center, Kunming, China
| | - Qiuyue Zhou
- School of Optoelectric Engineering, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Chengde Liao
- Department of Radiology, Kunming Yan’an Hospital (Yan’an Hospital Affiliated to Kunming Medical University), Kunming, China
| | - Jun Yang
- Department of Radiology, The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital/Center, Kunming, China
| |
Collapse
|
28
|
Assi H, Cao R, Castelino M, Cox B, Gilbert FJ, Gröhl J, Gurusamy K, Hacker L, Ivory AM, Joseph J, Knieling F, Leahy MJ, Lilaj L, Manohar S, Meglinski I, Moran C, Murray A, Oraevsky AA, Pagel MD, Pramanik M, Raymond J, Singh MKA, Vogt WC, Wang L, Yang S, Members of IPASC, Bohndiek SE. A review of a strategic roadmapping exercise to advance clinical translation of photoacoustic imaging: From current barriers to future adoption. PHOTOACOUSTICS 2023; 32:100539. [PMID: 37600964 PMCID: PMC10432856 DOI: 10.1016/j.pacs.2023.100539] [Citation(s) in RCA: 18] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/20/2023] [Revised: 07/27/2023] [Accepted: 07/27/2023] [Indexed: 08/22/2023]
Abstract
Photoacoustic imaging (PAI), also referred to as optoacoustic imaging, has shown promise in early-stage clinical trials in a range of applications from inflammatory diseases to cancer. While the first PAI systems have recently received regulatory approvals, successful adoption of PAI technology into healthcare systems for clinical decision making must still overcome a range of barriers, from education and training to data acquisition and interpretation. The International Photoacoustic Standardisation Consortium (IPASC) undertook an community exercise in 2022 to identify and understand these barriers, then develop a roadmap of strategic plans to address them. Here, we outline the nature and scope of the barriers that were identified, along with short-, medium- and long-term community efforts required to overcome them, both within and beyond the IPASC group.
Collapse
Affiliation(s)
- Hisham Assi
- Department of Physics, Toronto Metropolitan University, Toronto, Canada
| | - Rui Cao
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Madhura Castelino
- Department of Rheumatology, University College London Hospital, London, UK
| | - Ben Cox
- Department of Medical Physics and Bioengineering, University College London, London, UK
| | | | - Janek Gröhl
- Department of Physics, University of Cambridge, Cambridge, UK
- CRUK Cambridge Institute, University of Cambridge, Cambridge, UK
| | - Kurinchi Gurusamy
- Department of Surgical Biotechnology, University College London, London, UK
| | - Lina Hacker
- Department of Physics, University of Cambridge, Cambridge, UK
- CRUK Cambridge Institute, University of Cambridge, Cambridge, UK
| | - Aoife M. Ivory
- Department of Medical, Marine and Nuclear Physics, National Physical Laboratory, Teddington, UK
| | - James Joseph
- School of Science and Engineering, University of Dundee, Dundee, UK
| | - Ferdinand Knieling
- Department of Pediatrics and Adolescent Medicine, University Hospital Erlangen, Friedrich-Alexander-Universität, Erlangen-Nürnberg, Germany
| | - Martin J. Leahy
- School of Natural Sciences – Physics, University of Galway, Galway, Ireland
| | | | | | - Igor Meglinski
- College of Engineering and Physical Sciences, Aston University, Birmingham, UK
| | - Carmel Moran
- Centre for Cardiovascular Science, University of Edinburgh, Edinburgh, UK
| | - Andrea Murray
- Centre for Musculoskeletal Research, University of Manchester, Manchester Academic Health Science Centre (MAHSC), Salford Care Organisation, NCA NHS Foundation Trust, UK
| | | | - Mark D. Pagel
- Department of Cancer Systems Imaging, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Manojit Pramanik
- Department of Electrical and Computer Engineering, Iowa State University, Ames, IA, USA
| | - Jason Raymond
- Department of Engineering Science, University of Oxford, UK
| | | | - William C. Vogt
- Center for Devices and Radiological Health, US Food and Drug Administration, Silver Spring, MD, USA
| | - Lihong Wang
- Caltech Optical Imaging Laboratory, Andrew and Peggy Cherng Department of Medical Engineering, Department of Electrical Engineering, California Institute of Technology, Pasadena, CA, USA
| | - Shufan Yang
- School of Computing, Edinburgh Napier University, UK
| | - Members of IPASC
- Department of Physics, University of Cambridge, Cambridge, UK
- CRUK Cambridge Institute, University of Cambridge, Cambridge, UK
| | - Sarah E. Bohndiek
- Department of Physics, University of Cambridge, Cambridge, UK
- CRUK Cambridge Institute, University of Cambridge, Cambridge, UK
| |
Collapse
|
29
|
Dantuma M, Gasteau D, Manohar S. Photoacoustic spectrum analysis for spherical target size and optical property determination: A feasibility study. PHOTOACOUSTICS 2023; 32:100534. [PMID: 37545488 PMCID: PMC10400969 DOI: 10.1016/j.pacs.2023.100534] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 07/01/2023] [Accepted: 07/14/2023] [Indexed: 08/08/2023]
Abstract
The photoacoustic signal generated by an optically absorbing target is determined by the spatial profile of absorbed optical energy within the target. The analysis of the time profile and frequency content of the signal enables the recovery of the geometry of the object, as well as information about the optical properties. The photoacoustic response of spheres with a homogeneous absorbed optical energy profile is well described, and it is known that the width of the photoacoustic pulse is determined by the diameter of the sphere and its sound speed. In practice, the optical attenuation coefficients within the sphere will result in an inwardly decaying fluence profile leading to a similarly decaying absorbed optical energy profile. Further, the optical attenuation coefficients may be inhomogeneously distributed in the sphere. The implication for both cases is that the existing model for spheres does not fully apply. In this work, we developed analytical expressions for the photoacoustic time traces and amplitude spectra generated by a sphere with absorbed optical energy only in a spherical shell, and by a sphere with an inwardly decaying optical energy profile. Numerical simulations and experiments were conducted on these two imperfect sphere types. Fitting our model to the simulated or measured spectra allowed us to test our model's ability to extract the sphere size and optical properties. We found that the radii can be recovered with high accuracy, even when the frequency response of the detector recording the photoacoustic pulse is not precisely known. The model was found to be less sensitive in recovering the optical attenuation coefficient, but it is feasible when the detector's frequency response is well known.
Collapse
|
30
|
GadAllah MT, Mohamed AENA, Hefnawy AA, Zidan HE, El-Banby GM, Mohamed Badawy S. Convolutional Neural Networks Based Classification of Segmented Breast Ultrasound Images – A Comparative Preliminary Study. 2023 INTELLIGENT METHODS, SYSTEMS, AND APPLICATIONS (IMSA) 2023. [DOI: 10.1109/imsa58542.2023.10217585] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
Affiliation(s)
| | - Abd El-Naser A. Mohamed
- Menoufia University,Faculty of Electronic Engineering,Electronics and Electrical Communications Engineering Department,Menoufia,Egypt
| | - Alaa A. Hefnawy
- Electronics Research Institute (ERI),Computers and Systems Department,Cairo,Egypt
| | - Hassan E. Zidan
- Electronics Research Institute (ERI),Computers and Systems Department,Cairo,Egypt
| | - Ghada M. El-Banby
- Menoufia University,Faculty of Electronic Engineering,Industrial Electronics and Control Engineering Department,Menoufia,Egypt
| | - Samir Mohamed Badawy
- Menoufia University,Faculty of Electronic Engineering,Industrial Electronics and Control Engineering Department,Menoufia,Egypt
| |
Collapse
|
31
|
Noltes ME, Bader M, Metman MJH, Vonk J, Steinkamp PJ, Kukačka J, Westerlaan HE, Dierckx RAJO, van Hemel BM, Brouwers AH, van Dam GM, Jüstel D, Ntziachristos V, Kruijff S. Towards in vivo characterization of thyroid nodules suspicious for malignancy using multispectral optoacoustic tomography. Eur J Nucl Med Mol Imaging 2023; 50:2736-2750. [PMID: 37039901 PMCID: PMC10317911 DOI: 10.1007/s00259-023-06189-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Accepted: 03/05/2023] [Indexed: 04/12/2023]
Abstract
PURPOSE Patient-tailored management of thyroid nodules requires improved risk of malignancy stratification by accurate preoperative nodule assessment, aiming to personalize decisions concerning diagnostics and treatment. Here, we perform an exploratory pilot study to identify possible patterns on multispectral optoacoustic tomography (MSOT) for thyroid malignancy stratification. For the first time, we directly correlate MSOT images with histopathology data on a detailed level. METHODS We use recently enhanced data processing and image reconstruction methods for MSOT to provide next-level image quality by means of improved spatial resolution and spectral contrast. We examine optoacoustic features in thyroid nodules associated with vascular patterns and correlate these directly with reference histopathology. RESULTS Our methods show the ability to resolve blood vessels with diameters of 250 μm at depths of up to 2 cm. The vessel diameters derived on MSOT showed an excellent correlation (R2-score of 0.9426) with the vessel diameters on histopathology. Subsequently, we identify features of malignancy observable in MSOT, such as intranodular microvascularity and extrathyroidal extension verified by histopathology. Despite these promising features in selected patients, we could not determine statistically relevant differences between benign and malignant thyroid nodules based on mean oxygen saturation in thyroid nodules. Thus, we illustrate general imaging artifacts of the whole field of optoacoustic imaging that reduce image fidelity and distort spectral contrast, which impedes quantification of chromophore presence based on mean concentrations. CONCLUSION We recommend examining optoacoustic features in addition to chromophore quantification to rank malignancy risk. We present optoacoustic images of thyroid nodules with the highest spatial resolution and spectral contrast to date, directly correlated to histopathology, pushing the clinical translation of MSOT.
Collapse
Affiliation(s)
- Milou E Noltes
- Department of Surgical Oncology, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands
- Department of Nuclear Medicine and Molecular Imaging, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Maximilian Bader
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Madelon J H Metman
- Department of Surgical Oncology, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands
| | - Jasper Vonk
- Department of Oral and Maxillofacial Surgery, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Pieter J Steinkamp
- Department of Surgical Oncology, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands
| | - Jan Kukačka
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
| | - Henriette E Westerlaan
- Department of Radiology, University Medical Center Groningen, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands
| | - Rudi A J O Dierckx
- Department of Nuclear Medicine and Molecular Imaging, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Bettien M van Hemel
- Department of Pathology, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands
| | - Adrienne H Brouwers
- Department of Nuclear Medicine and Molecular Imaging, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
| | - Gooitzen M van Dam
- Department of Nuclear Medicine and Molecular Imaging, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands
- AxelaRx/TRACER Europe BV, Groningen, the Netherlands
| | - Dominik Jüstel
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Institute of Computational Biology, Helmholtz Zentrum München, Neuherberg, Germany
| | - Vasilis Ntziachristos
- Chair of Biological Imaging at the Central Institute for Translational Cancer Research (TranslaTUM), School of Medicine, Technical University of Munich, Munich, Germany
- Institute of Biological and Medical Imaging, Helmholtz Zentrum München, Neuherberg, Germany
- Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich, Munich, Germany
| | - Schelto Kruijff
- Department of Surgical Oncology, University of Groningen, University Medical Center Groningen, Groningen, the Netherlands.
- Department of Nuclear Medicine and Molecular Imaging, University Medical Center Groningen, University of Groningen, Groningen, the Netherlands.
| |
Collapse
|
32
|
Liu X, Kalva SK, Lafci B, Nozdriukhin D, Deán-Ben XL, Razansky D. Full-view LED-based optoacoustic tomography. PHOTOACOUSTICS 2023; 31:100521. [PMID: 37342502 PMCID: PMC10277581 DOI: 10.1016/j.pacs.2023.100521] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Revised: 05/30/2023] [Accepted: 06/06/2023] [Indexed: 06/23/2023]
Abstract
Optoacoustic tomography is commonly performed with bulky and expensive short-pulsed solid-state lasers providing high per-pulse energies in the millijoule range. Light emitting diodes (LEDs) represent a cost-effective and portable alternative for optoacoustic signal excitation that can additionally provide excellent pulse-to-pulse stability. Herein, we introduce a full-view LED-based optoacoustic tomography (FLOAT) system for deep tissue in vivo imaging. It is based on a custom-made electronic unit driving a stacked array of LEDs, which attains 100 ns pulse width and highly stable (0.62 % standard deviation) total per-pulse energy of 0.48 mJ. The illumination source is integrated into a circular array of cylindrically-focused ultrasound detection elements to result in a full-view tomographic configuration, which plays a critical role in circumventing limited-view effects, enhancing the effective field-of-view and image quality for cross-sectional (2D) imaging. We characterized the FLOAT performance in terms of pulse width, power stability, excitation light distribution, signal-to-noise and penetration depth. FLOAT of the human finger revealed a comparable imaging performance to that achieved with the standard pulsed Nd:YAG laser. It is anticipated that this compact, affordable and versatile illumination technology will facilitate optoacoustic imaging developments in resource-limited settings for biological and clinical applications.
Collapse
Affiliation(s)
- Xiang Liu
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich CH-8057, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich CH-8093, Switzerland
| | - Sandeep Kumar Kalva
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich CH-8057, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich CH-8093, Switzerland
| | - Berkan Lafci
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich CH-8057, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich CH-8093, Switzerland
| | - Daniil Nozdriukhin
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich CH-8057, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich CH-8093, Switzerland
| | - Xosé Luís Deán-Ben
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich CH-8057, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich CH-8093, Switzerland
| | - Daniel Razansky
- Institute of Pharmacology and Toxicology and Institute for Biomedical Engineering, Faculty of Medicine, University of Zurich, Zurich CH-8057, Switzerland
- Institute for Biomedical Engineering, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich CH-8093, Switzerland
| |
Collapse
|
33
|
Imaging breast malignancies with the Twente Photoacoustic Mammoscope 2. PLoS One 2023; 18:e0281434. [PMID: 36862628 PMCID: PMC9980787 DOI: 10.1371/journal.pone.0281434] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2022] [Accepted: 01/23/2023] [Indexed: 03/03/2023] Open
Abstract
Clinical measurements on breast cancer patients were performed with a three-dimensional tomographic photoacoustic prototype imager (PAM 2). Patients with a suspicious lesion, visiting the center for breast care of a local hospital, were included in the study. The acquired photoacoustic images were compared to conventional clinical images. Of 30 scanned patients, 19 were diagnosed with one or more malignancies, of which a subset of four patients was selected for detailed analysis. Reconstructed images were processed to enhance image quality and the visibility of blood vessels. Processed photoacoustic images were compared to contrast-enhanced magnetic resonance images where available, which aided in localizing the expected tumoral region. In two cases, spotty high-intensity photoacoustic signals could be seen in the tumoral region, attributable to the tumor. One of these cases also displayed a relatively high image entropy at the tumor site, likely related to the chaotic vascular networks associated with malignancies. For the other two cases, it was not possible to identify features indicative of malignancy, because of limitations in the illumination scheme and difficulties in locating the region of interest in the photoacoustic image.
Collapse
|
34
|
Gu Y, Sun Y, Wang X, Li H, Qiu J, Lu W. Application of photoacoustic computed tomography in biomedical imaging: A literature review. Bioeng Transl Med 2023; 8:e10419. [PMID: 36925681 PMCID: PMC10013779 DOI: 10.1002/btm2.10419] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 09/11/2022] [Accepted: 09/18/2022] [Indexed: 11/06/2022] Open
Abstract
Photoacoustic computed tomography (PACT) is a hybrid imaging modality that combines optical excitation and acoustic detection techniques. It obtains high-resolution deep-tissue images based on the deep penetration of light, the anisotropy of light absorption in objects, and the photoacoustic effect. Hence, PACT shows great potential in biomedical sample imaging. Recently, due to its advantages of high sensitivity to optical absorption and wide scalability of spatial resolution with the desired imaging depth, PACT has received increasing attention in preclinical and clinical practice. To date, there has been a proliferation of PACT systems designed for specific biomedical imaging applications, from small animals to human organs, from ex vivo to in vivo real-time imaging, and from simple structural imaging to functional and molecular imaging with external contrast agents. Therefore, it is of great importance to summarize the previous applications of PACT systems in biomedical imaging and clinical practice. In this review, we searched for studies related to PACT imaging of biomedical tissues and samples over the past two decades; divided the studies into two categories, PACT imaging of preclinical animals and PACT imaging of human organs and body parts; and discussed the significance of the studies. Finally, we pointed out the future directions of PACT in biomedical applications. With the development of exogenous contrast agents and advances of imaging technique, in the future, PACT will enable biomedical imaging from organs to whole bodies, from superficial vasculature to internal organs, from anatomy to functions, and will play an increasingly important role in biomedical research and clinical practice.
Collapse
Affiliation(s)
- Yanru Gu
- Department of RadiologyThe Second Affiliated Hospital of Shandong First Medical UniversityTaianChina
- Department of RadiologyShandong First Medical University and Shandong Academy of Medical SciencesTaianChina
| | - Yuanyuan Sun
- Department of RadiologyShandong First Medical University and Shandong Academy of Medical SciencesTaianChina
| | - Xiao Wang
- College of Ocean Science and EngineeringShandong University of Science and TechnologyQingdaoChina
| | - Hongyu Li
- College of Ocean Science and EngineeringShandong University of Science and TechnologyQingdaoChina
| | - Jianfeng Qiu
- Department of RadiologyShandong First Medical University and Shandong Academy of Medical SciencesTaianChina
| | - Weizhao Lu
- Department of RadiologyThe Second Affiliated Hospital of Shandong First Medical UniversityTaianChina
- Department of RadiologyShandong First Medical University and Shandong Academy of Medical SciencesTaianChina
| |
Collapse
|
35
|
Godefroy G, Arnal B, Bossy E. Full-visibility 3D imaging of oxygenation and blood flow by simultaneous multispectral photoacoustic fluctuation imaging (MS-PAFI) and ultrasound Doppler. Sci Rep 2023; 13:2961. [PMID: 36806304 PMCID: PMC9941110 DOI: 10.1038/s41598-023-29177-9] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2022] [Accepted: 01/31/2023] [Indexed: 02/22/2023] Open
Abstract
We present a method and setup that provide complementary three-dimensional (3D) images of blood oxygenation (via quantitative photoacoustic imaging) and blood flow dynamics (via ultrasound Doppler). The proposed approach is label-free and exploits blood-induced fluctuations, and is implemented on a sparse array with only 256 elements, driven with a commercially available ultrasound electronics. We first implement 3D photoacoustic fluctuation imaging (PAFI) to image chicken embryo, and obtain full-visibility images of the vascular morphology. We obtain simultaneously 3D ultrasound power Doppler with a comparable image quality. We then introduce multispectral photoacoustic fluctuation imaging (MS-PAFI), and demonstrate that it can provide quantitative measurements of the absorbed optical energy density with full visibility and enhanced contrast, as compared to conventional delay-and-sum multispectral photoacoustic imaging. We finally showcase the synergy and complementarity between MS-PAFI, which provides 3D quantitative oxygenation (SO[Formula: see text]) imaging, and 3D ultrasound Doppler, which provides quantitative information on blood flow dynamics. MS-PAFI represents a promising alternative to model-based inversions with the advantage of resolving all the visibility artefacts without prior and regularization, by use of a straightforward processing scheme.
Collapse
Affiliation(s)
- Guillaume Godefroy
- grid.462689.70000 0000 9272 9931Univ. Grenoble Alpes, LIPhy, CNRS, Grenoble, 38000 France
| | - Bastien Arnal
- grid.462689.70000 0000 9272 9931Univ. Grenoble Alpes, LIPhy, CNRS, Grenoble, 38000 France
| | - Emmanuel Bossy
- Univ. Grenoble Alpes, LIPhy, CNRS, Grenoble, 38000, France.
| |
Collapse
|
36
|
Tang Y, Tang S, Huang C, Klippel P, Ma C, Caso N, Chen S, Jing Y, Yao J. High-fidelity deep functional photoacoustic tomography enhanced by virtual point sources. PHOTOACOUSTICS 2023; 29:100450. [PMID: 36685991 PMCID: PMC9852650 DOI: 10.1016/j.pacs.2023.100450] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 12/19/2022] [Accepted: 01/04/2023] [Indexed: 06/17/2023]
Abstract
Photoacoustic tomography (PAT), a hybrid imaging modality that acoustically detects the optical absorption contrast, is a promising technology for imaging hemodynamic functions in deep tissues far beyond the traditional optical microscopy. However, the most clinically compatible PAT often suffers from the poor image fidelity, mostly due to the limited detection view of the linear ultrasound transducer array. PAT can be improved by employing highly-absorbing contrast agents such as droplets and nanoparticles, which, however, have low clinical translation potential due to safety concerns and regulatory hurdles imposed by these agents. In this work, we have developed a new methodology that can fundamentally improve PAT's image fidelity without hampering any of its functional capability or clinical translation potential. By using clinically-approved microbubbles as virtual point sources that strongly and isotropically scatter the local pressure waves generated by surrounding hemoglobin, we can overcome the limited-detection-view problem and achieve high-fidelity functional PAT in deep tissues, a technology referred to as virtual-point-source PAT (VPS-PAT). We have thoroughly investigated the working principle of VPS-PAT by numerical simulations and in vitro phantom experiments, clearly showing the signal origin of VPSs and the resultant superior image fidelity over traditional PAT. We have also demonstrated in vivo applications of VPT-PAT for functional small-animal studies with physiological challenges. We expect that VPS-PAT can find broad applications in biomedical research and accelerated translation to clinical impact.
Collapse
Affiliation(s)
- Yuqi Tang
- Photoacoustic Imaging Lab, Department of Biomedical Engineering, Duke University, Durham, NC, the United States of America
| | - Shanshan Tang
- Ultrasound Imaging Lab, Department of Biomedical Engineering, Mayo Clinic, Rochester, MN, the United States of America
| | - Chengwu Huang
- Ultrasound Imaging Lab, Department of Biomedical Engineering, Mayo Clinic, Rochester, MN, the United States of America
| | - Paul Klippel
- Graduate Program in Acoustic and Department of Biomedical Engineering, Pennsylvania State University, University Park, PA, the United States of America
| | - Chenshuo Ma
- Photoacoustic Imaging Lab, Department of Biomedical Engineering, Duke University, Durham, NC, the United States of America
| | - Nathan Caso
- Graduate Program in Acoustic and Department of Biomedical Engineering, Pennsylvania State University, University Park, PA, the United States of America
| | - Shigao Chen
- Ultrasound Imaging Lab, Department of Biomedical Engineering, Mayo Clinic, Rochester, MN, the United States of America
| | - Yun Jing
- Graduate Program in Acoustic and Department of Biomedical Engineering, Pennsylvania State University, University Park, PA, the United States of America
| | - Junjie Yao
- Photoacoustic Imaging Lab, Department of Biomedical Engineering, Duke University, Durham, NC, the United States of America
| |
Collapse
|
37
|
Choi W, Park B, Choi S, Oh D, Kim J, Kim C. Recent Advances in Contrast-Enhanced Photoacoustic Imaging: Overcoming the Physical and Practical Challenges. Chem Rev 2023. [PMID: 36642892 DOI: 10.1021/acs.chemrev.2c00627] [Citation(s) in RCA: 58] [Impact Index Per Article: 29.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Abstract
For decades now, photoacoustic imaging (PAI) has been investigated to realize its potential as a niche biomedical imaging modality. Despite its highly desirable optical contrast and ultrasonic spatiotemporal resolution, PAI is challenged by such physical limitations as a low signal-to-noise ratio (SNR), diminished image contrast due to strong optical attenuation, and a lower-bound on spatial resolution in deep tissue. In addition, contrast-enhanced PAI has faced practical limitations such as insufficient cell-specific targeting due to low delivery efficiency and difficulties in developing clinically translatable agents. Identifying these limitations is essential to the continuing expansion of the field, and substantial advances in developing contrast-enhancing agents, complemented by high-performance image acquisition systems, have synergistically dealt with the challenges of conventional PAI. This review covers the past four years of research on pushing the physical and practical challenges of PAI in terms of SNR/contrast, spatial resolution, targeted delivery, and clinical application. Promising strategies for dealing with each challenge are reviewed in detail, and future research directions for next generation contrast-enhanced PAI are discussed.
Collapse
Affiliation(s)
- Wonseok Choi
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Byullee Park
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Seongwook Choi
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Donghyeon Oh
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Jongbeom Kim
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| | - Chulhong Kim
- Department of Electrical Engineering, Convergence IT Engineering, Mechanical Engineering, and Medical Science and Engineering, Graduate School of Artificial Intelligence, and Medical Device Innovation Center, Pohang University of Science and Technology, 77 Cheongam-Ro, Nam-Gu, Pohang37673, Republic of Korea
| |
Collapse
|
38
|
Ruiter NV, Zapf M, Hopp T, Gemmeke H. Ultrasound Tomography. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2023; 1403:171-200. [PMID: 37495919 DOI: 10.1007/978-3-031-21987-0_9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/28/2023]
Abstract
Ultrasound tomography (USCT) is a promising imaging modality, mainly aiming at early diagnosis of breast cancer. It provides three-dimensional, reproducible images of higher quality than conventional ultrasound methods and additionally offers quantitative information on tissue properties. This chapter provides an introduction to the background and history of USCT, followed by an overview of image reconstruction algorithms and system design. It concludes with a discussion of current and future applications as well as limitations and their potential solutions.
Collapse
Affiliation(s)
- Nicole V Ruiter
- Institute for Data Processing and Electronics, Karlsruhe Institute of Technology, Karlsruhe, Germany.
| | - Michael Zapf
- Institute for Data Processing and Electronics, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Torsten Hopp
- Institute for Data Processing and Electronics, Karlsruhe Institute of Technology, Karlsruhe, Germany
| | - Hartmut Gemmeke
- Institute for Data Processing and Electronics, Karlsruhe Institute of Technology, Karlsruhe, Germany
| |
Collapse
|
39
|
Yoo J, Oh D, Kim C, Kim HH, Um JY. Switchable preamplifier for dual modal photoacoustic and ultrasound imaging. BIOMEDICAL OPTICS EXPRESS 2023; 14:89-105. [PMID: 36698663 PMCID: PMC9842014 DOI: 10.1364/boe.476453] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 11/27/2022] [Accepted: 11/30/2022] [Indexed: 06/17/2023]
Abstract
Photoacoustic (PA) imaging is a high-fidelity biomedical imaging technique based on the principle of molecular-specific optical absorption of biological tissue constitute. Because PA imaging shares the same basic principle as that of ultrasound (US) imaging, the use of PA/US dual-modal imaging can be achieved using a single system. However, because PA imaging is limited to a shallower depth than US imaging due to the optical extinction in biological tissue, the PA signal yields a lower signal-to-noise ratio (SNR) than US images. To selectively amplify the PA signal, we propose a switchable preamplifier for acoustic-resolution PA microscopy implemented on an application-specific integrated circuit. Using the preamplifier, we measured the increments in the SNR with both carbon lead and wire phantoms. Furthermore, in vivo whole-body PA/US imaging of a mouse with a preamplifier showed enhancement of SNR in deep tissues, unveiling deeply located organs and vascular networks. By selectively amplifying the PA signal range to a level similar to that of the US signal without contrast agent administration, our switchable amplifier strengthens the mutual complement between PA/US imaging. PA/US imaging is impending toward clinical translation, and we anticipate that this study will help mitigate the imbalance of image depth between the two imaging modalities.
Collapse
Affiliation(s)
- Jinhee Yoo
- School of Interdisciplinary Bioscience and
Bioengineering, Pohang University of Science and Technology, Pohang 37673, Republic of
Korea
- Contributed equally
| | - Donghyeon Oh
- Department of Convergence IT Engineering, Pohang University of Science and Technology, Pohang 37673, Republic of
Korea
- Contributed equally
| | - Chulhong Kim
- School of Interdisciplinary Bioscience and
Bioengineering, Pohang University of Science and Technology, Pohang 37673, Republic of
Korea
- Department of Convergence IT Engineering, Pohang University of Science and Technology, Pohang 37673, Republic of
Korea
- Department of Electrical Engineering, Pohang University of Science and Technology, Pohang 37673, Republic of
Korea
| | - Hyung Ham Kim
- School of Interdisciplinary Bioscience and
Bioengineering, Pohang University of Science and Technology, Pohang 37673, Republic of
Korea
- Department of Convergence IT Engineering, Pohang University of Science and Technology, Pohang 37673, Republic of
Korea
- Department of Electrical Engineering, Pohang University of Science and Technology, Pohang 37673, Republic of
Korea
- Equal contribution
| | - Ji-Yong Um
- Department of Medical IT
Convergence Engineering, Kumoh National Institute of
Technology, Gumi 39253, Republic
of Korea
- Equal contribution
| |
Collapse
|
40
|
Barbosa RCS, Mendes PM. A Comprehensive Review on Photoacoustic-Based Devices for Biomedical Applications. SENSORS (BASEL, SWITZERLAND) 2022; 22:9541. [PMID: 36502258 PMCID: PMC9736954 DOI: 10.3390/s22239541] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/17/2022] [Revised: 12/02/2022] [Accepted: 12/03/2022] [Indexed: 06/17/2023]
Abstract
The photoacoustic effect is an emerging technology that has sparked significant interest in the research field since an acoustic wave can be produced simply by the incidence of light on a material or tissue. This phenomenon has been extensively investigated, not only to perform photoacoustic imaging but also to develop highly miniaturized ultrasound probes that can provide biologically meaningful information. Therefore, this review aims to outline the materials and their fabrication process that can be employed as photoacoustic targets, both biological and non-biological, and report the main components' features to achieve a certain performance. When designing a device, it is of utmost importance to model it at an early stage for a deeper understanding and to ease the optimization process. As such, throughout this article, the different methods already implemented to model the photoacoustic effect are introduced, as well as the advantages and drawbacks inherent in each approach. However, some remaining challenges are still faced when developing such a system regarding its fabrication, modeling, and characterization, which are also discussed.
Collapse
|
41
|
Wen Y, Guo D, Zhang J, Liu X, Liu T, Li L, Jiang S, Wu D, Jiang H. Clinical photoacoustic/ultrasound dual-modal imaging: Current status and future trends. Front Physiol 2022; 13:1036621. [PMID: 36388111 PMCID: PMC9651137 DOI: 10.3389/fphys.2022.1036621] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2022] [Accepted: 10/05/2022] [Indexed: 08/24/2023] Open
Abstract
Photoacoustic tomography (PAT) is an emerging biomedical imaging modality that combines optical and ultrasonic imaging, providing overlapping fields of view. This hybrid approach allows for a natural integration of PAT and ultrasound (US) imaging in a single platform. Due to the similarities in signal acquisition and processing, the combination of PAT and US imaging creates a new hybrid imaging for novel clinical applications. Over the recent years, particular attention is paid to the development of PAT/US dual-modal systems highlighting mutual benefits in clinical cases, with an aim of substantially improving the specificity and sensitivity for diagnosis of diseases. The demonstrated feasibility and accuracy in these efforts open an avenue of translating PAT/US imaging to practical clinical applications. In this review, the current PAT/US dual-modal imaging systems are discussed in detail, and their promising clinical applications are presented and compared systematically. Finally, this review describes the potential impacts of these combined systems in the coming future.
Collapse
Affiliation(s)
- Yanting Wen
- Department of Ultrasound Imaging, The Fifth People’s Hospital of Chengdu, Chengdu, China
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Dan Guo
- Department of Ultrasound Imaging, The Fifth People’s Hospital of Chengdu, Chengdu, China
| | - Jing Zhang
- Department of Ultrasound Imaging, The Fifth People’s Hospital of Chengdu, Chengdu, China
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Xiaotian Liu
- Department of Ultrasound Imaging, The Fifth People’s Hospital of Chengdu, Chengdu, China
| | - Ting Liu
- Department of Ultrasound Imaging, The Fifth People’s Hospital of Chengdu, Chengdu, China
| | - Lu Li
- Department of Ultrasound Imaging, The Fifth People’s Hospital of Chengdu, Chengdu, China
| | - Shixie Jiang
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Stanford, CA, United States
| | - Dan Wu
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing, China
| | - Huabei Jiang
- Department of Medical Engineering, University of South Florida, Tampa, FL, United States
| |
Collapse
|
42
|
Mulani S, Paul S, Singh MS. Higher-order correlation based real-time beamforming in photoacoustic imaging. JOURNAL OF THE OPTICAL SOCIETY OF AMERICA. A, OPTICS, IMAGE SCIENCE, AND VISION 2022; 39:1805-1814. [PMID: 36215552 DOI: 10.1364/josaa.461323] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/15/2022] [Accepted: 08/20/2022] [Indexed: 06/16/2023]
Abstract
Although a delay-and-sum (DAS) beamformer is best suited for real-time photoacoustic (PA) image formation, the reconstructed images are often afflicted by noises, sidelobes, and other intense artifacts due to inaccurate assumptions in PA signal correlation. The present work aims to develop a reconstruction method that reduces the occurrence of sidelobes and artifacts and thus improves the reconstructed image quality or imaging performance. This beamformer is fundamentally based on higher-order signal correlation wherein a higher number of delayed PA signals-compared to conventional delay-multiply-and-sum (DMAS)-are combined and summed up. The proposed technique provides significant improvements in resolution, contrast, and signal-to-noise ratio (SNR) compared to traditional beamformers. For real-time implementation, the proposed algorithms were simplified, and their computational complexities were shrunk to the order of DAS [O(N)]. A GPU based study was also performed to validate the real-time capability of the proposed beamformers. For validation studies, both numerical simulation and experiments were conducted. Quantitative evaluation studies involving SNR, contrast ratio, generalized contrast-to-noise ratio, and FWHM demonstrate that the proposed higher-order DMAS beamformer is superior in PA image reconstruction. Conclusively, the proposed beamformer uniquely facilitates real-time PA image reconstruction with an achievable frame rate close to DAS and DMAS but with better imaging performance, which holds promise for real-time PA imaging and its clinical applications.
Collapse
|
43
|
Liu S, Zhang R, Han T, Pan Y, Zhang G, Long X, Zhao C, Wang M, Li X, Yang F, Sang Y, Zhu L, He X, Li J, Zhang Y, Li C, Jiang Y, Yang M. Validation of photoacoustic/ultrasound dual imaging in evaluating blood oxygen saturation. BIOMEDICAL OPTICS EXPRESS 2022; 13:5551-5570. [PMID: 36425613 PMCID: PMC9664893 DOI: 10.1364/boe.469747] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 09/16/2022] [Accepted: 09/16/2022] [Indexed: 06/16/2023]
Abstract
Photoacoustic imaging (PAI) was performed to evaluate oxygen saturation (sO2) of blood-mimicking phantoms, femoral arteries in beagles, and radial arteries in humans at various sO2 plateaus. The accuracy (root mean square error, RMSE) of PAI sO2 compared with reference sO2 was calculated. In blood-mimicking phantoms, PAI achieved an accuracy of 1.49% and a mean absolute error (MAE) of 1.09% within 25 mm depth, and good linearity (R = 0.968; p < 0.001) was obtained between PAI sO2 and reference sO2. In canine femoral arteries, PAI achieved an accuracy of 2.16% and an MAE of 1.58% within 8 mm depth (R = 0.965; p < 0.001). In human radial arteries, PAI achieved an accuracy of 3.97% and an MAE of 3.28% in depth from 4 to 14 mm (R = 0.892; p < 0.001). For PAI sO2 evaluation at different depths in healthy volunteers, the RMSE accuracy of PAI sO2 increased from 2.66% to 24.96% with depth increasing from 4 to 14 mm. Through the multiscale method, we confirmed the feasibility of the hand-held photoacoustic/ultrasound (PA/US) in evaluating sO2. These results demonstrate the potential clinical value of PAI in evaluating blood sO2. Consequently, protocols for verifying the feasibility of medical devices based on PAI may be established.
Collapse
Affiliation(s)
- Sirui Liu
- Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- The authors contributed equally to this manuscript
| | - Rui Zhang
- Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
- The authors contributed equally to this manuscript
| | - Tao Han
- Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, China
| | - Yinhao Pan
- Mindray Bio-Medical Electronics Co., Ltd., Shenzhen, China
| | - Guangjie Zhang
- Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, China
| | - Xing Long
- Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, China
| | - Chenyang Zhao
- Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
| | - Ming Wang
- Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
| | - Xuelan Li
- Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
| | - Fang Yang
- Mindray Bio-Medical Electronics Co., Ltd., Shenzhen, China
| | - Yuchao Sang
- Mindray Bio-Medical Electronics Co., Ltd., Shenzhen, China
| | - Lei Zhu
- Mindray Bio-Medical Electronics Co., Ltd., Shenzhen, China
| | - Xujin He
- Mindray Bio-Medical Electronics Co., Ltd., Shenzhen, China
| | - Jianchu Li
- Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
| | - Yewei Zhang
- Hepatopancreatobiliary Center, The Second Affiliated Hospital of Nanjing Medical University, Nanjing, China
| | - Changhui Li
- Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, China
| | - Yuxin Jiang
- Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
| | - Meng Yang
- Department of Ultrasound, State Key Laboratory of Complex Severe and Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Science and Peking Union Medical College, Beijing, China
| |
Collapse
|
44
|
Blanco-Angulo C, Martínez-Lozano A, Gutiérrez-Mazón R, Juan CG, García-Martínez H, Arias-Rodríguez J, Sabater-Navarro JM, Ávila-Navarro E. Non-Invasive Microwave-Based Imaging System for Early Detection of Breast Tumours. BIOSENSORS 2022; 12:bios12090752. [PMID: 36140137 PMCID: PMC9496561 DOI: 10.3390/bios12090752] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/14/2022] [Revised: 09/06/2022] [Accepted: 09/08/2022] [Indexed: 11/16/2022]
Abstract
This work introduces a microwave-based system able to detect tumours in breast phantoms in a non-invasive way. The data acquisition system is composed of a hardware system which involves high-frequency components (antennas, switches and cables), a microcontroller, a vector network analyser used as measurement instrument and a computer devoted to the control and automation of the operation of the system. Concerning the software system, the computer runs a Python script which is in charge of mastering and automatising all the required stages for the data acquisition, from initialisation of the hardware system to performing and saving the measurements. We also report on the design of the high-performance broadband antenna used to carry out the measurements, as well as on the algorithm employed to build the final medical images, based on an adapted version of the so-called Improved Delay-and-Sum (IDAS) algorithm improved by a Hamming window filter and averaging preprocessing. The calibration and start-up of the system are also described. The experimental validation includes the use of different tumour models with different dielectric properties inside the breast phantom. The results show promising tumour detection capabilities, even when there is low dielectric contrast between the tumoural and healthy tissues, as is the usual case for dense breasts in young women.
Collapse
Affiliation(s)
- Carolina Blanco-Angulo
- Department of Materials Science, Optics and Electronic Technology, Miguel Hernández University of Elche, 03202 Elche, Spain
| | - Andrea Martínez-Lozano
- Department of Materials Science, Optics and Electronic Technology, Miguel Hernández University of Elche, 03202 Elche, Spain
| | - Roberto Gutiérrez-Mazón
- Department of Communications Engineering, Miguel Hernández University of Elche, 03202 Elche, Spain
| | - Carlos G. Juan
- Neuroengineering Biomedical Research Group, Institute of Bioengineering, Miguel Hernández University of Elche, 03202 Elche, Spain
- Medical Robotics Research Group, University of Málaga, 29071 Málaga, Spain
- Correspondence:
| | - Héctor García-Martínez
- Department of Materials Science, Optics and Electronic Technology, Miguel Hernández University of Elche, 03202 Elche, Spain
| | - Julia Arias-Rodríguez
- Department of Materials Science, Optics and Electronic Technology, Miguel Hernández University of Elche, 03202 Elche, Spain
| | - José M. Sabater-Navarro
- Neuroengineering Biomedical Research Group, Institute of Bioengineering, Miguel Hernández University of Elche, 03202 Elche, Spain
| | - Ernesto Ávila-Navarro
- Department of Materials Science, Optics and Electronic Technology, Miguel Hernández University of Elche, 03202 Elche, Spain
| |
Collapse
|
45
|
Zeng Y, Dou T, Ma L, Ma J. Biomedical Photoacoustic Imaging for Molecular Detection and Disease Diagnosis: "Always-On" and "Turn-On" Probes. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2022; 9:e2202384. [PMID: 35773244 PMCID: PMC9443455 DOI: 10.1002/advs.202202384] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Revised: 05/25/2022] [Indexed: 05/05/2023]
Abstract
Photoacoustic (PA) imaging is a nonionizing, noninvasive imaging technique that combines optical and ultrasonic imaging modalities to provide images with excellent contrast, spatial resolution, and penetration depth. Exogenous PA contrast agents are created to increase the sensitivity and specificity of PA imaging and to offer diagnostic information for illnesses. The existing PA contrast agents are categorized into two groups in this review: "always-on" and "turn-on," based on their ability to be triggered by target molecules. The present state of these probes, their merits and limitations, and their future development, is explored.
Collapse
Affiliation(s)
- Yun Zeng
- School of Life Science and Technology, Xidian University and Engineering Research Center of Molecular and Neuro Imaging, Ministry of Education, Xi'an, Shaanxi Province, 710126, P. R. China
- International Joint Research Center for Advanced Medical Imaging and Intelligent Diagnosis and Treatment and Xi'an Key Laboratory of Intelligent Sensing and Regulation of trans-Scale Life Information, School of Life Science and Technology, Xidian University, Xi'an, Shaanxi Province, 7100126, P. R. China
| | - Taotao Dou
- Neurosurgery Department, Ninth Affiliated Hospital of Medical College of Xi'an Jiaotong University, Xi'an, Shaanxi Province, 710054, P. R. China
| | - Lei Ma
- Vascular Intervention Department, Ninth Affiliated Hospital of Medical College of Xi'an Jiaotong University, Xi'an, Shaanxi Province, 710054, P. R. China
| | - Jingwen Ma
- Radiology Department, CT and MRI Room, Ninth Affiliated Hospital of Medical College of Xi'an Jiaotong University, Xi'an, Shaanxi Province, 710054, P. R. China
| |
Collapse
|
46
|
Abeyakoon O, Woitek R, Wallis M, Moyle P, Morscher S, Dahlhaus N, Ford S, Burton N, Manavaki R, Mendichovszky I, Joseph J, Quiros-Gonzalez I, Bohndiek S, Gilbert F. An optoacoustic imaging feature set to characterise blood vessels surrounding benign and malignant breast lesions. PHOTOACOUSTICS 2022; 27:100383. [PMID: 36068806 PMCID: PMC9441264 DOI: 10.1016/j.pacs.2022.100383] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Revised: 03/21/2022] [Accepted: 07/01/2022] [Indexed: 06/15/2023]
Abstract
Combining optoacoustic (OA) imaging with ultrasound (US) enables visualisation of functional blood vasculature in breast lesions by OA to be overlaid with the morphological information of US. Here, we develop a simple OA feature set to differentiate benign and malignant breast lesions. 94 female patients with benign, indeterminate or suspicious lesions were recruited and underwent OA-US. An OA-US imaging feature set was developed using images from the first 38 patients, which contained 14 malignant and 8 benign solid lesions. Two independent radiologists blindly scored the OA-US images of a further 56 patients, which included 31 malignant and 13 benign solid lesions, with a sensitivity of 96.8% and specificity of 84.6%. Our findings indicate that OA-US can reveal vascular patterns of breast lesions that indicate malignancy using a simple feature set based on single wavelength OA data, which is therefore amenable to application in low resource settings for breast cancer management.
Collapse
Affiliation(s)
- O. Abeyakoon
- Department of Radiology, University of Cambridge, Cambridge Biomedical Campus, Hills Road, Cambridge CB2 0QQ, UK
| | - R. Woitek
- Department of Radiology, University of Cambridge, Cambridge Biomedical Campus, Hills Road, Cambridge CB2 0QQ, UK
| | - M.G. Wallis
- Cambridge Breast Unit, Cambridge University Hospitals NHS Foundation Trust, Cambridge CB2 0QQ, UK
| | - P.L. Moyle
- Cambridge Breast Unit, Cambridge University Hospitals NHS Foundation Trust, Cambridge CB2 0QQ, UK
| | - S. Morscher
- iThera Medical GmbH, Zielstattstrasse 13, Munich 81379, Germany
| | - N. Dahlhaus
- iThera Medical GmbH, Zielstattstrasse 13, Munich 81379, Germany
| | - S.J. Ford
- iThera Medical GmbH, Zielstattstrasse 13, Munich 81379, Germany
| | - N.C. Burton
- iThera Medical GmbH, Zielstattstrasse 13, Munich 81379, Germany
| | - R. Manavaki
- Department of Radiology, University of Cambridge, Cambridge Biomedical Campus, Hills Road, Cambridge CB2 0QQ, UK
| | - I.A. Mendichovszky
- Department of Nuclear Medicine, Cambridge University Hospitals Foundation Trust, Cambridge CB2 0QQ, UK
| | - J. Joseph
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge CB2 0RE, UK
| | - I. Quiros-Gonzalez
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge CB2 0RE, UK
| | - S.E. Bohndiek
- Department of Physics, University of Cambridge, JJ Thomson Avenue, Cambridge CB3 0HE, UK
- Cancer Research UK Cambridge Institute, University of Cambridge, Robinson Way, Cambridge CB2 0RE, UK
| | - F.J. Gilbert
- Department of Radiology, University of Cambridge, Cambridge Biomedical Campus, Hills Road, Cambridge CB2 0QQ, UK
| |
Collapse
|
47
|
Understanding Breast Cancers through Spatial and High-Resolution Visualization Using Imaging Technologies. Cancers (Basel) 2022; 14:cancers14174080. [PMID: 36077616 PMCID: PMC9454728 DOI: 10.3390/cancers14174080] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2022] [Revised: 08/12/2022] [Accepted: 08/18/2022] [Indexed: 11/17/2022] Open
Abstract
Breast cancer is the most common cancer affecting women worldwide. Although many analyses and treatments have traditionally targeted the breast cancer cells themselves, recent studies have focused on investigating entire cancer tissues, including breast cancer cells. To understand the structure of breast cancer tissues, including breast cancer cells, it is necessary to investigate the three-dimensional location of the cells and/or proteins comprising the tissues and to clarify the relationship between the three-dimensional structure and malignant transformation or metastasis of breast cancers. In this review, we aim to summarize the methods for analyzing the three-dimensional structure of breast cancer tissue, paying particular attention to the recent technological advances in the combination of the tissue-clearing method and optical three-dimensional imaging. We also aimed to identify the latest methods for exploring the relationship between the three-dimensional cell arrangement in breast cancer tissues and the gene expression of each cell. Finally, we aimed to describe the three-dimensional imaging features of breast cancer tissues using noninvasive photoacoustic imaging methods.
Collapse
|
48
|
Taylor-Williams M, Spicer G, Bale G, Bohndiek SE. Noninvasive hemoglobin sensing and imaging: optical tools for disease diagnosis. JOURNAL OF BIOMEDICAL OPTICS 2022; 27:JBO-220074VR. [PMID: 35922891 PMCID: PMC9346606 DOI: 10.1117/1.jbo.27.8.080901] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/06/2022] [Accepted: 06/27/2022] [Indexed: 05/08/2023]
Abstract
SIGNIFICANCE Measurement and imaging of hemoglobin oxygenation are used extensively in the detection and diagnosis of disease; however, the applied instruments vary widely in their depth of imaging, spatiotemporal resolution, sensitivity, accuracy, complexity, physical size, and cost. The wide variation in available instrumentation can make it challenging for end users to select the appropriate tools for their application and to understand the relative limitations of different methods. AIM We aim to provide a systematic overview of the field of hemoglobin imaging and sensing. APPROACH We reviewed the sensing and imaging methods used to analyze hemoglobin oxygenation, including pulse oximetry, spectral reflectance imaging, diffuse optical imaging, spectroscopic optical coherence tomography, photoacoustic imaging, and diffuse correlation spectroscopy. RESULTS We compared and contrasted the ability of different methods to determine hemoglobin biomarkers such as oxygenation while considering factors that influence their practical application. CONCLUSIONS We highlight key limitations in the current state-of-the-art and make suggestions for routes to advance the clinical use and interpretation of hemoglobin oxygenation information.
Collapse
Affiliation(s)
- Michaela Taylor-Williams
- University of Cambridge, Department of Physics, Cavendish Laboratory, Cambridge, United Kingdom, United Kingdom
- University of Cambridge, Cancer Research UK Cambridge Institute, Cambridge, United Kingdom, United Kingdom
| | - Graham Spicer
- University of Cambridge, Department of Physics, Cavendish Laboratory, Cambridge, United Kingdom, United Kingdom
- University of Cambridge, Cancer Research UK Cambridge Institute, Cambridge, United Kingdom, United Kingdom
| | - Gemma Bale
- University of Cambridge, Department of Physics, Cavendish Laboratory, Cambridge, United Kingdom, United Kingdom
- University of Cambridge, Electrical Division, Department of Engineering, Cambridge, United Kingdom, United Kingdom
| | - Sarah E Bohndiek
- University of Cambridge, Department of Physics, Cavendish Laboratory, Cambridge, United Kingdom, United Kingdom
- University of Cambridge, Cancer Research UK Cambridge Institute, Cambridge, United Kingdom, United Kingdom
| |
Collapse
|
49
|
Zheng E, Zhang H, Hu W, Doyley MM, Xia J. Volumetric tri-modal imaging with combined photoacoustic, ultrasound, and shear wave elastography. JOURNAL OF APPLIED PHYSICS 2022; 132:034902. [PMID: 35855685 PMCID: PMC9288268 DOI: 10.1063/5.0093619] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/29/2022] [Accepted: 06/24/2022] [Indexed: 06/15/2023]
Abstract
Photoacoustic imaging is a hybrid imaging approach that combines the advantages of optical and ultrasonic imaging in one modality. However, for comprehensive tissue characterization, optical contrast alone is not always sufficient. In this study, we combined photoacoustic imaging with high-resolution ultrasound and shear wave elastography. The multi-modal system can calculate optical absorption, acoustic reflection, and stiffness volumetrically. We constructed a multi-modal phantom with contrast for each imaging modality to test the system's performance. Experimental results indicate that the system successfully visualizes the embedded structures. We envision that the system will lead to more comprehensive tissue characterization for cancer screening and diagnosis.
Collapse
Affiliation(s)
- Emily Zheng
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York 14260, USA
| | - Huijuan Zhang
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York 14260, USA
| | - Wentao Hu
- Department of Electrical and Computer Engineering, Rochester Center for Biomedical Ultrasound, University of Rochester, Rochester, New York 14627, USA
| | - Marvin M. Doyley
- Department of Electrical and Computer Engineering, Rochester Center for Biomedical Ultrasound, University of Rochester, Rochester, New York 14627, USA
| | - Jun Xia
- Department of Biomedical Engineering, University at Buffalo, The State University of New York, Buffalo, New York 14260, USA
| |
Collapse
|
50
|
Jiang D, Xu Y, Lan H, Shen Y, Zhang Y, Gao F, Liu L, Gao F. Size-adjustable ring-shape photoacoustic tomography imager in vivo. JOURNAL OF BIOPHOTONICS 2022; 15:e202200070. [PMID: 35389530 DOI: 10.1002/jbio.202200070] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Revised: 03/28/2022] [Accepted: 04/01/2022] [Indexed: 06/14/2023]
Abstract
Photoacoustic tomography (PAT) has become a novel biomedical imaging modality for scientific research and clinical diagnosis. It combines the advantages of spectroscopic optical absorption contrast and acoustic resolution with deep penetration. In this article, an imaging size-adjustable PAT system is proposed for potential clinical applications such as breast cancer detection and screening, which can adapt to imaging targets with various sizes. Comparing with the conventional PAT setup with a fixed radius ring shape ultrasound transducer (UT) array, the proposed system is more flexible for imaging diverse size targets based on sectorial ultrasound transducer arrays (SUTAs). Four SUTAs form a 128-channel UT array for photoacoustic detection, where each SUTA has 32 elements. Such four SUTAs are controlled by four stepper motors, respectively, and can change their distribution layout position to adapt for various imaging applications. In this proposed system, the radius of the imaging region of interest (ROI) can be adjusted from 50 to 100 mm, which is much more flexible than the conventional PAT system with a full ring UT array. The simulation experiments using the MATLAB k-wave toolbox demonstrate the feasibility of the proposed system. To further validate the proposed system, imaging of pencil leads made phantom, ex-vivo pork breast with indocyanine green (ICG) injected, and in-vivo human wrist, finger and ankle are conducted to prove its feasibility for potential clinical applications.
Collapse
Affiliation(s)
- Daohuai Jiang
- Hybrid Imaging System Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
- Chinese Academy of Sciences, Shanghai Institute of Microsystem and Information Technology, Shanghai, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Yifei Xu
- Hybrid Imaging System Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Hengrong Lan
- Hybrid Imaging System Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
- Chinese Academy of Sciences, Shanghai Institute of Microsystem and Information Technology, Shanghai, China
- University of Chinese Academy of Sciences, Beijing, China
| | - Yuting Shen
- Hybrid Imaging System Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Yifan Zhang
- Hybrid Imaging System Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Feng Gao
- Hybrid Imaging System Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
| | - Li Liu
- Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Fei Gao
- Hybrid Imaging System Laboratory, School of Information Science and Technology, ShanghaiTech University, Shanghai, China
- Shanghai Engineering Research Center of Energy Efficient and Custom AI IC, Shanghai, China
| |
Collapse
|