1
|
Xu C, Wu X, Wang B, Chen J, Gao Z, Liu X, Zhang H. Accurate segmentation of liver tumor from multi-modality non-contrast images using a dual-stream multi-level fusion framework. Comput Med Imaging Graph 2024; 116:102414. [PMID: 38981250 DOI: 10.1016/j.compmedimag.2024.102414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 05/10/2024] [Accepted: 06/28/2024] [Indexed: 07/11/2024]
Abstract
The use of multi-modality non-contrast images (i.e., T1FS, T2FS and DWI) for segmenting liver tumors provides a solution by eliminating the use of contrast agents and is crucial for clinical diagnosis. However, this remains a challenging task to discover the most useful information to fuse multi-modality images for accurate segmentation due to inter-modal interference. In this paper, we propose a dual-stream multi-level fusion framework (DM-FF) to, for the first time, accurately segment liver tumors from non-contrast multi-modality images directly. Our DM-FF first designs an attention-based encoder-decoder to effectively extract multi-level feature maps corresponding to a specified representation of each modality. Then, DM-FF creates two types of fusion modules, in which a module fuses learned features to obtain a shared representation across multi-modality images to exploit commonalities and improve the performance, and a module fuses the decision evidence of segment to discover differences between modalities to prevent interference caused by modality's conflict. By integrating these three components, DM-FF enables multi-modality non-contrast images to cooperate with each other and enables an accurate segmentation. Evaluation on 250 patients including different types of tumors from two MRI scanners, DM-FF achieves a Dice of 81.20%, and improves performance (Dice by at least 11%) when comparing the eight state-of-the-art segmentation architectures. The results indicate that our DM-FF significantly promotes the development and deployment of non-contrast liver tumor technology.
Collapse
Affiliation(s)
- Chenchu Xu
- Artificial Intelligence Institute, Anhui University, Hefei, China; Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China
| | - Xue Wu
- Artificial Intelligence Institute, Anhui University, Hefei, China
| | - Boyan Wang
- Department of Computer Science and Technology, Tsinghua University, Beijing, China.
| | - Jie Chen
- Artificial Intelligence Institute, Anhui University, Hefei, China
| | - Zhifan Gao
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| | - Xiujian Liu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China.
| | - Heye Zhang
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| |
Collapse
|
2
|
Xu B, Dong SY, Bai XL, Song TQ, Zhang BH, Zhou LD, Chen YJ, Zeng ZM, Wang K, Zhao HT, Lu N, Zhang W, Li XB, Zheng SS, Long G, Yang YC, Huang HS, Huang LQ, Wang YC, Liang F, Zhu XD, Huang C, Shen YH, Zhou J, Zeng MS, Fan J, Rao SX, Sun HC. Tumor Radiomic Features on Pretreatment MRI to Predict Response to Lenvatinib plus an Anti-PD-1 Antibody in Advanced Hepatocellular Carcinoma: A Multicenter Study. Liver Cancer 2023; 12:262-276. [PMID: 37601982 PMCID: PMC10433098 DOI: 10.1159/000528034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/16/2022] [Accepted: 10/02/2022] [Indexed: 08/22/2023] Open
Abstract
Introduction Lenvatinib plus an anti-PD-1 antibody has shown promising antitumor effects in patients with advanced hepatocellular carcinoma (HCC), but with clinical benefit limited to a subset of patients. We developed and validated a radiomic-based model to predict objective response to this combination therapy in advanced HCC patients. Methods Patients (N = 170) who received first-line combination therapy with lenvatinib plus an anti-PD-1 antibody were retrospectively enrolled from 9 Chinese centers; 124 and 46 into the training and validation cohorts, respectively. Radiomic features were extracted from pretreatment contrast-enhanced MRI. After feature selection, clinicopathologic, radiomic, and clinicopathologic-radiomic models were built using a neural network. The performance of models, incremental predictive value of radiomic features compared with clinicopathologic features and relationship between radiomic features and survivals were assessed. Results The clinicopathologic model modestly predicted objective response with an AUC of 0.748 (95% CI: 0.656-0.840) and 0.702 (95% CI: 0.547-0.884) in the training and validation cohorts, respectively. The radiomic model predicted response with an AUC of 0.886 (95% CI: 0.815-0.957) and 0.820 (95% CI: 0.648-0.984), respectively, with good calibration and clinical utility. The incremental predictive value of radiomic features to clinicopathologic features was confirmed with a net reclassification index of 47.9% (p < 0.001) and 41.5% (p = 0.025) in the training and validation cohorts, respectively. Furthermore, radiomic features were associated with overall survival and progression-free survival both in the training and validation cohorts, but modified albumin-bilirubin grade and neutrophil-to-lymphocyte ratio were not. Conclusion Radiomic features extracted from pretreatment MRI can predict individualized objective response to combination therapy with lenvatinib plus an anti-PD-1 antibody in patients with unresectable or advanced HCC, provide incremental predictive value over clinicopathologic features, and are associated with overall survival and progression-free survival after initiation of this combination regimen.
Collapse
Affiliation(s)
- Bin Xu
- Department of Liver Surgery and Transplantation, Liver Cancer Institute and Zhongshan Hospital, Fudan University, Shanghai, China
| | - San-Yuan Dong
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai Institute of Medical Imaging, Shanghai, China
| | - Xue-Li Bai
- Department of Hepatobiliary and Pancreatic Surgery, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Tian-Qiang Song
- Department of Hepatobiliary, National Clinical Research Center of Cancer, Oncology Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute and Hospital, Tianjin, China
| | - Bo-Heng Zhang
- Department of Hepatic Oncology, Xiamen Branch, Zhongshan Hospital, Fudan University, Xiamen, China
| | - Le-Du Zhou
- Department of General Surgery, Xiangya Hospital, Central South University, Changsha, China
| | - Yong-Jun Chen
- Department of Hepatobiliary Surgery, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Zhi-Ming Zeng
- Department of Medical Oncology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Kui Wang
- Department of Hepatic Surgery II, Eastern Hepatobiliary Surgery Hospital, Navy Medical University, Shanghai, China
| | - Hai-Tao Zhao
- Department of Liver Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Na Lu
- Department of Hepatobiliary and Pancreatic Surgery, The First Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, China
| | - Wei Zhang
- Department of Hepatobiliary, National Clinical Research Center of Cancer, Oncology Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute and Hospital, Tianjin, China
| | - Xu-Bin Li
- Department of Radiology, National Clinical Research Center of Cancer, Tianjin Medical University Cancer Institute and Hospital, Tianjin, China
| | - Su-Su Zheng
- Department of Hepatic Oncology, Xiamen Branch, Zhongshan Hospital, Fudan University, Xiamen, China
| | - Guo Long
- Department of General Surgery, Xiangya Hospital, Central South University, Changsha, China
| | - Yu-Chen Yang
- Department of Hepatobiliary Surgery, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Hua-Sheng Huang
- Department of Medical Oncology, The First Affiliated Hospital of Guangxi Medical University, Nanning, China
| | - Lan-Qing Huang
- Department of Hepatic Surgery II, Eastern Hepatobiliary Surgery Hospital, Navy Medical University, Shanghai, China
| | - Yun-Chao Wang
- Department of Liver Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Fei Liang
- Department of Biostatistics, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Xiao-Dong Zhu
- Department of Liver Surgery and Transplantation, Liver Cancer Institute and Zhongshan Hospital, Fudan University, Shanghai, China
| | - Cheng Huang
- Department of Liver Surgery and Transplantation, Liver Cancer Institute and Zhongshan Hospital, Fudan University, Shanghai, China
| | - Ying-Hao Shen
- Department of Liver Surgery and Transplantation, Liver Cancer Institute and Zhongshan Hospital, Fudan University, Shanghai, China
| | - Jian Zhou
- Department of Liver Surgery and Transplantation, Liver Cancer Institute and Zhongshan Hospital, Fudan University, Shanghai, China
| | - Meng-Su Zeng
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai Institute of Medical Imaging, Shanghai, China
| | - Jia Fan
- Department of Liver Surgery and Transplantation, Liver Cancer Institute and Zhongshan Hospital, Fudan University, Shanghai, China
| | - Sheng-Xiang Rao
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai Institute of Medical Imaging, Shanghai, China
| | - Hui-Chuan Sun
- Department of Liver Surgery and Transplantation, Liver Cancer Institute and Zhongshan Hospital, Fudan University, Shanghai, China
| |
Collapse
|
3
|
Chae YJ, Heo H, Woo CW, Kim ST, Kwon JI, Choi MY, Sung YS, Kim KW, Kim JK, Choi Y, Woo DC. Preclinical Long-term Magnetic Resonance Imaging Study of Silymarin Liver-protective Effects. J Clin Transl Hepatol 2022; 10:1167-1175. [PMID: 36381105 PMCID: PMC9634766 DOI: 10.14218/jcth.2021.00499] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 02/09/2022] [Accepted: 03/17/2022] [Indexed: 12/04/2022] Open
Abstract
BACKGROUND AND AIMS Efficacy evaluations with preclinical magnetic resonance imaging (MRI) are uncommon, but MRI in the preclinical phase of drug development provides information that is useful for longitudinal monitoring. The study aim was to monitor the protective effectiveness of silymarin with multiparameter MRI and biomarkers in a thioacetamide (TAA)-induced model of liver injury in rats. Correlation analysis was conducted to assess compare the monitoring of liver function by MRI and biomarkers. METHODS TAA was injected three times a week for 8 weeks to generate a disease model (TAA group). In the TAA and silymarin-treated (TAA-SY) groups, silymarin was administered three times weekly from week 4. MR images were acquired at 0, 2, 4, 6, and 8 weeks in the control, TAA, and TAA-SY groups. RESULTS The area under the curve to maximum time (AUCtmax) and T2* values of the TAA group decreased over the study period, but the serological markers of liver abnormality increased significantly more than those in the control group. In the TAA-SY group, MRI and serological biomarkers indicated attenuation of liver function as in the TAA group. However, pattern changes were observed from week 6 to comparable levels in the control group with silymarin treatment. Negative correlations between either AUCtmax or T2* values and the serological biomarkers were observed. CONCLUSIONS Silymarin had hepatoprotective effects on TAA-induced liver injury and demonstrated the usefulness of multiparametric MRI to evaluate efficacy in preclinical studies of liver drug development.
Collapse
Affiliation(s)
- Yeon Ji Chae
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Hwon Heo
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Chul-Woong Woo
- Convergence Medicine Research Center, Asan Institute for Life Sciences, Asan Medical Center, Seoul, Republic of Korea
| | - Sang-Tae Kim
- Convergence Medicine Research Center, Asan Institute for Life Sciences, Asan Medical Center, Seoul, Republic of Korea
| | - Jae-Im Kwon
- Convergence Medicine Research Center, Asan Institute for Life Sciences, Asan Medical Center, Seoul, Republic of Korea
| | - Monica Young Choi
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Yu Sub Sung
- Clinical Research Center, Asan Medical Center, Seoul, Republic of Korea
| | - Kyung Won Kim
- Department of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Jeong Kon Kim
- Department of Radiology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Yoonseok Choi
- Medical Research Institute, Gangneung Asan Hospital, Gangneung-si, Gangwon-do, Republic of Korea
- Correspondence to: Dong Cheol Woo, Convergence Medicine Research Center, Asan Institute for Life Sciences, Asan Medical Center 88, Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea. ORCID: https://orcid.org/0000-0001-8202-015X. Tel: +82-2-3010-4155, Fax: +82-10-5559-7102, E-mail: ; Yoonseok Choi, Medical Research Institute, Gangneung Asan Hospital, University of Ulsan College of Medicine 38, Bangdong-gil, Sacheon-myeon, Gangneung-si, Gangwon-do 25440, Korea. ORCID: https://orcid.org/0000-0002-8478-2999. Tel: +82-33-610-4799, Fax: +82-33-610-3089, E-mail:
| | - Dong-Cheol Woo
- Department of Convergence Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
- Convergence Medicine Research Center, Asan Institute for Life Sciences, Asan Medical Center, Seoul, Republic of Korea
- Correspondence to: Dong Cheol Woo, Convergence Medicine Research Center, Asan Institute for Life Sciences, Asan Medical Center 88, Olympic-ro 43-gil, Songpa-gu, Seoul 05505, Korea. ORCID: https://orcid.org/0000-0001-8202-015X. Tel: +82-2-3010-4155, Fax: +82-10-5559-7102, E-mail: ; Yoonseok Choi, Medical Research Institute, Gangneung Asan Hospital, University of Ulsan College of Medicine 38, Bangdong-gil, Sacheon-myeon, Gangneung-si, Gangwon-do 25440, Korea. ORCID: https://orcid.org/0000-0002-8478-2999. Tel: +82-33-610-4799, Fax: +82-33-610-3089, E-mail:
| |
Collapse
|