1
|
Messaoudi H, Abbas M, Badic B, Ben Salem D, Belaid A, Conze PH. Automatic future remnant segmentation in liver resection planning. Int J Comput Assist Radiol Surg 2025; 20:837-845. [PMID: 39961898 DOI: 10.1007/s11548-025-03331-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2024] [Accepted: 01/25/2025] [Indexed: 05/07/2025]
Abstract
PURPOSE Liver resection is a complex procedure requiring precise removal of tumors while preserving viable tissue. This study proposes a novel approach for automated liver resection planning, using segmentations of the liver, vessels, and tumors from CT scans to predict the future liver remnant (FLR), aiming to improve pre-operative planning accuracy and patient outcomes. METHODS This study evaluates deep convolutional and Transformer-based networks under various computational setups. Using different combinations of anatomical and pathological delineation masks, we assess the contribution of each structure. The method is initially tested with ground-truth masks for feasibility and later validated with predicted masks from a deep learning model. RESULTS The experimental results highlight the crucial importance of incorporating anatomical and pathological masks for accurate FLR delineation. Among the tested configurations, the best performing model achieves an average Dice score of approximately 0.86, aligning closely with the inter-observer variability reported in the literature. Additionally, the model achieves an average symmetric surface distance of 0.95 mm, demonstrating its precision in capturing fine-grained structural details critical for pre-operative planning. CONCLUSION This study highlights the potential for fully-automated FLR segmentation pipelines in liver pre-operative planning. Our approach holds promise for developing a solution to reduce the time and variability associated with manual delineation. Such method can provide better decision-making in liver resection planning by providing accurate and consistent segmentation results. Future studies should explore its seamless integration into clinical workflows.
Collapse
Affiliation(s)
- Hicham Messaoudi
- Laboratory of Medical Informatics, University of Bejaia, Bejaia, Algeria.
- LaTIM UMR 1101, Inserm, Brest, France.
- University of Western Brittany, Brest, France.
| | - Marwan Abbas
- LaTIM UMR 1101, Inserm, Brest, France
- University of Western Brittany, Brest, France
| | - Bogdan Badic
- LaTIM UMR 1101, Inserm, Brest, France
- University of Western Brittany, Brest, France
- University Hospital of Brest, Brest, France
| | - Douraied Ben Salem
- LaTIM UMR 1101, Inserm, Brest, France
- University of Western Brittany, Brest, France
- University Hospital of Brest, Brest, France
| | - Ahror Belaid
- Laboratory of Medical Informatics, University of Bejaia, Bejaia, Algeria
- Data Science & Applications Research Unit, CERIST, Bejaia, Algeria
| | | |
Collapse
|
2
|
Han X, Yang D, Su Y, Wang Q, Li M, Du N, Jiang J, Tian X, Liu J, Jia J, Yang Z, Zhao X, Ma H. Identification of abdominal MRI features associated with histopathological severity and treatment response in autoimmune hepatitis. Eur Radiol 2025:10.1007/s00330-025-11578-1. [PMID: 40278875 DOI: 10.1007/s00330-025-11578-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2024] [Revised: 02/16/2025] [Accepted: 03/13/2025] [Indexed: 04/26/2025]
Abstract
To identify abdominal contrast magnetic resonance imaging (MRI) features associated with histopathological severity, and treatment response in autoimmune hepatitis (AIH). PATIENTS AND METHODS AIH patients who had abdominal contrast MRI within 3 months of liver biopsy were retrospectively enrolled. Histopathological severity, liver volume, MRI features, laboratory tests, and treatment response were collected. MRI and serum models were constructed through stepwise univariate and multivariate logistic regression for diagnosing severe histopathology and predicting insufficient response (IR). RESULTS One hundred AIH patients were included (median age: 57.0 years, 79.0% female). For diagnosing severe portal inflammation, reticular fibrosis and volume ratio of segment V-VIII to total liver (SV-SVIII/TLV) achieved an area under the receiver operating characteristic curve (AUROC) of 0.765 (95% CI 0.670-0.860). Severe confluent necrosis was modeled using hepatic fissure widening, reticular fibrosis, and volume ratio of segment I-III to segments IV-VIII, achieving an AUROC of 0.796 (95% CI 0.708-0.885). Severe histological activity was modeled using ascites, and SV-SVIII/TLV achieved an AUROC of 0.748 (95% CI 0.649-0.847). To diagnose cirrhosis, ascites, reticular fibrosis, and the volume ratio of segment I to the total liver were employed, yielding an AUROC of 0.833 (95% CI 0.716-0.949); IR (transaminases and/or immunoglobulin G remaining unnormal after 6 months of immunosuppressive treatment) was modeled using ascites, gallbladder wall edema, and transient hepatic attenuation difference, achieving an AUROC of 0.796 (95% CI 0.691-0.902). CONCLUSION The MRI models demonstrated relatively good performance in evaluating histopathological severity and treatment response. Combining MRI and serum models could enhance diagnostic and prognostic efficacy. KEY POINTS Question Abdominal contrast MRI may help clinicians better evaluate the histopathological severity and treatment response of autoimmune hepatitis (AIH), but there is currently limited research. Findings Models based on MRI features perform well in diagnosing severe portal inflammation, confluent necrosis, histological activity, and cirrhosis, as well as predicting insufficient response. Clinical relevance Abdominal contrast MRI, combined with serological parameters, provides a new and stronger noninvasive method for clinically assessing AIH progression and treatment.
Collapse
Affiliation(s)
- Xiao Han
- Liver Research Center, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Dawei Yang
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Yu Su
- Liver Research Center, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Qianyi Wang
- Liver Research Center, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Min Li
- Department of Clinical Epidemiology and Evidence Base Medicine Unit, National Clinical Research Center for Digestive Diseases, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Nianhao Du
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Jiahui Jiang
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Xin Tian
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Jimin Liu
- Department of Pathology and Molecular Medicine, Faculty of Health Sciences, McMaster University, Hamilton, Canada
| | - Jidong Jia
- Liver Research Center, Beijing Friendship Hospital, Capital Medical University, Beijing, China
| | - Zhenghan Yang
- Department of Radiology, Beijing Friendship Hospital, Capital Medical University, Beijing, China.
| | - Xinyan Zhao
- Liver Research Center, Beijing Friendship Hospital, Capital Medical University, Beijing, China.
| | - Hong Ma
- Liver Research Center, Beijing Friendship Hospital, Capital Medical University, Beijing, China.
| |
Collapse
|
3
|
Yang TS, Gong XH, Wang L, Zhang S, Shi YP, Ren HN, Yan YQ, Zhu L, Lv L, Dai YM, Qian LJ, Xu JR, Zhou Y. Comparison of automated with manual 3D qEASL assessment based on MR imaging in hepatocellular carcinoma treated with conventional TACE. Abdom Radiol (NY) 2025; 50:1180-1188. [PMID: 39297930 DOI: 10.1007/s00261-024-04571-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2024] [Revised: 09/01/2024] [Accepted: 09/04/2024] [Indexed: 09/21/2024]
Affiliation(s)
- Tian Shu Yang
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
| | - Xu Hua Gong
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
| | - Li Wang
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
| | - Shan Zhang
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
| | - Yao Ping Shi
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
- Interventional Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
| | - Hai Nan Ren
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
| | - Yun Qi Yan
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
| | - Li Zhu
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China
| | - Lei Lv
- ShuKun (Beijing) Technology Co. Ltd, Beijing, China
| | | | - Li Jun Qian
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China.
| | - Jian Rong Xu
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China.
| | - Yan Zhou
- Diagnostic Radiology, Renji Hospital, Shanghai Jiao Tong University, School of Medicine, Shanghai, China.
| |
Collapse
|
4
|
Wei H, Zheng T, Zhang X, Zheng C, Jiang D, Wu Y, Lee JM, Bashir MR, Lerner E, Liu R, Wu B, Guo H, Chen Y, Yang T, Gong X, Jiang H, Song B. Deep learning-based 3D quantitative total tumor burden predicts early recurrence of BCLC A and B HCC after resection. Eur Radiol 2025; 35:127-139. [PMID: 39028376 PMCID: PMC11632001 DOI: 10.1007/s00330-024-10941-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Revised: 05/15/2024] [Accepted: 06/16/2024] [Indexed: 07/20/2024]
Abstract
OBJECTIVES This study aimed to evaluate the potential of deep learning (DL)-assisted automated three-dimensional quantitative tumor burden at MRI to predict postoperative early recurrence (ER) of hepatocellular carcinoma (HCC). MATERIALS AND METHODS This was a single-center retrospective study enrolling patients who underwent resection for BCLC A and B HCC and preoperative contrast-enhanced MRI. Quantitative total tumor volume (cm3) and total tumor burden (TTB, %) were obtained using a DL automated segmentation tool. Radiologists' visual assessment was used to ensure the quality control of automated segmentation. The prognostic value of clinicopathological variables and tumor burden-related parameters for ER was determined by Cox regression analyses. RESULTS A total of 592 patients were included, with 525 and 67 patients assigned to BCLC A and B, respectively (2-year ER rate: 30.0% vs. 45.3%; hazard ratio (HR) = 1.8; p = 0.007). TTB was the most important predictor of ER (HR = 2.2; p < 0.001). Using 6.84% as the threshold of TTB, two ER risk strata were obtained in overall (p < 0.001), BCLC A (p < 0.001), and BCLC B (p = 0.027) patients, respectively. The BCLC B low-TTB patients had a similar risk for ER to BCLC A patients and thus were reassigned to a BCLC An stage; whilst the BCLC B high-TTB patients remained in a BCLC Bn stage. The 2-year ER rate was 30.5% for BCLC An patients vs. 58.1% for BCLC Bn patients (HR = 2.8; p < 0.001). CONCLUSIONS TTB determined by DL-based automated segmentation at MRI was a predictive biomarker for postoperative ER and facilitated refined subcategorization of patients within BCLC stages A and B. CLINICAL RELEVANCE STATEMENT Total tumor burden derived by deep learning-based automated segmentation at MRI may serve as an imaging biomarker for predicting early recurrence, thereby improving subclassification of Barcelona Clinic Liver Cancer A and B hepatocellular carcinoma patients after hepatectomy. KEY POINTS Total tumor burden (TTB) is important for Barcelona Clinic Liver Cancer (BCLC) staging, but is heterogenous. TTB derived by deep learning-based automated segmentation was predictive of postoperative early recurrence. Incorporating TTB into the BCLC algorithm resulted in successful subcategorization of BCLC A and B patients.
Collapse
Affiliation(s)
- Hong Wei
- Department of Radiology, Functional, and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, China
- Department of Radiology, Seoul National University Hospital, Seoul, 03080, Republic of Korea
| | - Tianying Zheng
- Department of Radiology, Functional, and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, China
| | | | - Chao Zheng
- Shukun Technology Co., Ltd, Beijing, 100102, China
| | - Difei Jiang
- Shukun Technology Co., Ltd, Beijing, 100102, China
| | - Yuanan Wu
- Big Data Research Center, University of Electronic Science and Technology of China, Chengdu, Sichuan, 610000, China
| | - Jeong Min Lee
- Department of Radiology, Seoul National University Hospital, Seoul, 03080, Republic of Korea
- Department of Radiology, Seoul National University College of Medicine, Seoul, 03080, Republic of Korea
| | - Mustafa R Bashir
- Department of Radiology, Duke University Medical Center, Durham, NC, 27710, USA
- Center for Advanced Magnetic Resonance in Medicine, Duke University Medical Center, Durham, NC, 27705, USA
- Division of Gastroenterology, Department of Medicine, Duke University Medical Center, Durham, NC, 27710, USA
| | - Emily Lerner
- Department of Radiology, Duke University Medical Center, Durham, NC, 27710, USA
| | - Rongbo Liu
- Department of Radiology, Functional, and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, China
| | - Botong Wu
- Center for Biomedical Imaging Research, Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100102, China
| | - Hua Guo
- Center for Biomedical Imaging Research, Department of Biomedical Engineering, School of Medicine, Tsinghua University, Beijing, 100102, China
| | - Yidi Chen
- Department of Radiology, Functional, and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, China
| | - Ting Yang
- Department of Radiology, Functional, and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, China
| | - Xiaoling Gong
- Department of Radiology, Functional, and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, China
| | - Hanyu Jiang
- Department of Radiology, Functional, and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, China.
| | - Bin Song
- Department of Radiology, Functional, and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, Sichuan, 610041, China.
- Department of Radiology, Sanya People's Hospital, Sanya, Hainan, 572000, China.
| |
Collapse
|
5
|
Dai H, Xiao Y, Fu C, Grimm R, von Busch H, Stieltjes B, Choi MH, Xu Z, Chabin G, Yang C, Zeng M. Deep Learning-Based Approach for Identifying and Measuring Focal Liver Lesions on Contrast-Enhanced MRI. J Magn Reson Imaging 2025; 61:111-120. [PMID: 38826142 DOI: 10.1002/jmri.29404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 04/12/2024] [Accepted: 04/12/2024] [Indexed: 06/04/2024] Open
Abstract
BACKGROUND The number of focal liver lesions (FLLs) detected by imaging has increased worldwide, highlighting the need to develop a robust, objective system for automatically detecting FLLs. PURPOSE To assess the performance of the deep learning-based artificial intelligence (AI) software in identifying and measuring lesions on contrast-enhanced magnetic resonance imaging (MRI) images in patients with FLLs. STUDY TYPE Retrospective. SUBJECTS 395 patients with 1149 FLLs. FIELD STRENGTH/SEQUENCE The 1.5 T and 3 T scanners, including T1-, T2-, diffusion-weighted imaging, in/out-phase imaging, and dynamic contrast-enhanced imaging. ASSESSMENT The diagnostic performance of AI, radiologist, and their combination was compared. Using 20 mm as the cut-off value, the lesions were divided into two groups, and then divided into four subgroups: <10, 10-20, 20-40, and ≥40 mm, to evaluate the sensitivity of radiologists and AI in the detection of lesions of different sizes. We compared the pathologic sizes of 122 surgically resected lesions with measurements obtained using AI and those made by radiologists. STATISTICAL TESTS McNemar test, Bland-Altman analyses, Friedman test, Pearson's chi-squared test, Fisher's exact test, Dice coefficient, and intraclass correlation coefficients. A P-value <0.05 was considered statistically significant. RESULTS The average Dice coefficient of AI in segmentation of liver lesions was 0.62. The combination of AI and radiologist outperformed the radiologist alone, with a significantly higher detection rate (0.894 vs. 0.825) and sensitivity (0.883 vs. 0.806). The AI showed significantly sensitivity than radiologists in detecting all lesions <20 mm (0.848 vs. 0.788). Both AI and radiologists achieved excellent detection performance for lesions ≥20 mm (0.867 vs. 0.881, P = 0.671). A remarkable agreement existed in the average tumor sizes among the three measurements (P = 0.174). DATA CONCLUSION AI software based on deep learning exhibited practical value in automatically identifying and measuring liver lesions. LEVEL OF EVIDENCE: 4 TECHNICAL EFFICACY Stage 2.
Collapse
Affiliation(s)
- Haoran Dai
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Yuyao Xiao
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Caixia Fu
- MR Application Development, Siemens Shenzhen Magnetic Resonance Ltd., Shenzhen, China
| | - Robert Grimm
- MR Predevelopment, Siemens Healthineers AG, Erlangen, Germany
| | - Heinrich von Busch
- Innovation Owner Artificial Intelligence for Oncology, Siemens Healthineers AG, Erlangen, Germany
| | | | - Moon Hyung Choi
- Eunpyeong St. Mary's Hospital, The Catholic University of Korea, Seoul, Republic of Korea
| | - Zhoubing Xu
- Technology Excellence, Digital Technology and Innovation, Siemens Healthineers, Princeton, New Jersey, USA
| | - Guillaume Chabin
- Technology Excellence, Digital Technology and Innovation, Siemens Healthecare SAS, Paris, France
| | - Chun Yang
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, China
| | - Mengsu Zeng
- Department of Radiology, Zhongshan Hospital, Fudan University, Shanghai, China
- Shanghai Institute of Medical Imaging, Shanghai, China
- Department of Cancer Center, Zhongshan Hospital, Fudan University, Shanghai, China
| |
Collapse
|
6
|
Miao D, Zhao Y, Ren X, Dou M, Yao Y, Xu Y, Cui Y, Liu A. A Multi-Task Based Deep Learning Framework With Landmark Detection for MRI Couinaud Segmentation. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2024; 12:697-710. [PMID: 39559826 PMCID: PMC11573409 DOI: 10.1109/jtehm.2024.3491612] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Revised: 06/26/2024] [Accepted: 10/28/2024] [Indexed: 11/20/2024]
Abstract
To achieve precise Couinaud liver segmentation in preoperative planning for hepatic surgery, accommodating the complex anatomy and significant variations, optimizing surgical approaches, reducing postoperative complications, and preserving liver function.This research presents a novel approach to automating liver segmentation by identifying seven key anatomical landmarks using portal venous phase images from contrast-enhanced magnetic resonance imaging (CE-MRI). By employing a multi-task learning framework, we synchronized the detection of these landmarks with the segmentation process, resulting in accurate and robust delineation of the Couinaud segments.To comprehensively validate our model, we included multiple patient types in our test set-those with normal livers, diffuse liver diseases, and localized liver lesions-under varied imaging conditions, including two field strengths, two devices, and two contrast agents. Our model achieved an average Dice Similarity Coefficient (DSC) of 85.29%, surpassing the next best-performing models by 3.12%.Our research presents a pioneering automated approach for segmenting Couinaud segments using CE-MRI. By correlating landmark detection with segmentation, we enhance surgical planning precision. This method promises improved clinical outcomes by accurately adapting to anatomical variability and reducing potential postoperative complications.Clinical impact: The application of this technique in clinical settings is poised to enhance the precision of liver surgical planning. This could lead to more tailored surgical interventions, minimization of operative risks, and preservation of healthy liver tissue, culminating in improved patient outcomes and potentially lowering the incidence of postoperative complications.Clinical and Translational Impact Statement: This research offers a novel automated liver segmentation technique, enhancing preoperative planning and potentially reducing complications, which may translate into better postoperative outcomes in hepatic surgery.
Collapse
Affiliation(s)
- Dong Miao
- Chengdu Institute of Computer Application, Chinese Academy of SciencesBeijing100045China
- School of Computer Science and TechnologyUniversity of Chinese Academy of SciencesBeijing101408China
| | - Ying Zhao
- Department of RadiologyThe First Affiliated Hospital of Dalian Medical UniversityDalian116014China
- Dalian Engineering Research Center for Artificial Intelligence in Medical ImagingDalian116011China
| | - Xue Ren
- Department of RadiologyThe First Affiliated Hospital of Dalian Medical UniversityDalian116014China
- Dalian Engineering Research Center for Artificial Intelligence in Medical ImagingDalian116011China
| | - Meng Dou
- Chengdu Institute of Computer Application, Chinese Academy of SciencesBeijing100045China
- School of Computer Science and TechnologyUniversity of Chinese Academy of SciencesBeijing101408China
| | - Yu Yao
- Chengdu Institute of Computer Application, Chinese Academy of SciencesBeijing100045China
- School of Computer Science and TechnologyUniversity of Chinese Academy of SciencesBeijing101408China
| | - Yiran Xu
- School of Medical ImagingDalian Medical UniversityDalian116041China
| | - Yingchao Cui
- School of Medical ImagingDalian Medical UniversityDalian116041China
| | - Ailian Liu
- Department of RadiologyThe First Affiliated Hospital of Dalian Medical UniversityDalian116014China
- Dalian Engineering Research Center for Artificial Intelligence in Medical ImagingDalian116011China
| |
Collapse
|
7
|
Li C, Wang Y, Bai R, Zhao Z, Li W, Zhang Q, Zhang C, Yang W, Liu Q, Su N, Lu Y, Yin X, Wang F, Gu C, Yang A, Luo B, Zhou M, Shen L, Pan C, Wang Z, Wu Q, Yin J, Hou Y, Shi Y. Development of fully automated models for staging liver fibrosis using non-contrast MRI and artificial intelligence: a retrospective multicenter study. EClinicalMedicine 2024; 77:102881. [PMID: 39498462 PMCID: PMC11532432 DOI: 10.1016/j.eclinm.2024.102881] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/22/2024] [Revised: 09/25/2024] [Accepted: 09/27/2024] [Indexed: 11/07/2024] Open
Abstract
Background Accurate staging of liver fibrosis (LF) is essential for clinical management in chronic liver disease. While non-contrast MRI (NC-MRI) yields valuable information for liver assessment, its effectiveness in predicting LF remains underexplored. This study aimed to develop and validate artificial intelligence (AI)-powered models utilizing NC-MRI for staging LF. Methods A total of 1726 patients from Shengjing Hospital of China Medical University, registered between October 2003 and October 2022, were retrospectively collected, and divided into development (n = 1208) and internal test (n = 518) cohorts. An external test cohort consisting of 337 individuals from six centers, registered between June 2015 and November 2022, were also included. All participants underwent NC-MRI (T1-weighted imaging, T1WI; and T2-fat-suppressed imaging, T2FS) and liver biopsies. Two classification models (CMs), named T1 and T2FS, were trained on respective image types using 3D contextual transformer networks and evaluated on both test cohorts. Additionally, three CMs-Clinic, Image, and Fusion-were developed using clinical features, T1 and T2FS scores, and their integration via logistic regression. Classification effectiveness of CMs was assessed using the area under the receiver operating characteristic curve (AUC). A comparison was conducted between the optimal models (OMs) with highest AUC and other methods (transient elastography, five serum biomarkers, and six radiologists). Findings Fusion models (i.e., OM) yielded the highest AUC among the CMs, achieving AUCs of 0.810 for significant fibrosis, 0.881 for advanced fibrosis, and 0.918 for cirrhosis in the internal test cohort, and 0.808, 0.868, and 0.925, respectively, in the external test cohort. The OMs demonstrated superior performance in AUC, significantly surpassing transient elastography (only for staging ≥ F2 and ≥ F3 grades), serum biomarkers, and three junior radiologists for staging LF. Radiologists, with the aid of the OMs, can achieve a higher AUC in LF assessment. Interpretation AI-powered models utilizing NC-MRI, including T1WI and T2FS, accurately stage LF. Funding National Natural Science Foundation of China (No. 82071885); General Program of the Liaoning Provincial Department of Education (LJKMZ20221160); Liaoning Province Science and Technology Joint Plan (2023JH2/101700127); the Leading Young Talent Program of Xingliao Yingcai in Liaoning Province (XLYC2203037).
Collapse
Affiliation(s)
- Chunli Li
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Yuan Wang
- Department of Radiology, Cancer Hospital of China Medical University, Liaoning Cancer Hospital & Institute, Shenyang, Liaoning, China
| | - Ruobing Bai
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Zhiyong Zhao
- Department of Medical Imaging, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China
| | - Wenjuan Li
- Department of Radiology, Yantai Yuhuangding Hospital, Qingdao University, Yantai, Shandong, China
| | - Qianqian Zhang
- Department of Radiology, Yantai Yuhuangding Hospital, Qingdao University, Yantai, Shandong, China
| | - Chaoya Zhang
- Department of Radiology, Hubei Cancer Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, Hubei, China
| | - Wei Yang
- Department of Radiology, Cancer Hospital of China Medical University, Liaoning Cancer Hospital & Institute, Shenyang, Liaoning, China
| | - Qi Liu
- Department of Radiology, The Second Affiliated Hospital of Baotou Medical College, Baotou, Neimenggu, China
| | - Na Su
- Department of Radiology, The Sixth People's Hospital of Shenyang, Shenyang, Liaoning, China
| | - Yueyue Lu
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Xiaoli Yin
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Fan Wang
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Chengli Gu
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Aoran Yang
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Baihe Luo
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Minghui Zhou
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Liuhanxu Shen
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Chen Pan
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Zhiying Wang
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Qijun Wu
- Department of Clinical Epidemiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Jiandong Yin
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Yang Hou
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| | - Yu Shi
- Department of Radiology, Shengjing Hospital of China Medical University, Shenyang, Liaoning, China
| |
Collapse
|
8
|
Wang L, Fatemi M, Alizad A. Artificial intelligence techniques in liver cancer. Front Oncol 2024; 14:1415859. [PMID: 39290245 PMCID: PMC11405163 DOI: 10.3389/fonc.2024.1415859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Accepted: 08/15/2024] [Indexed: 09/19/2024] Open
Abstract
Hepatocellular Carcinoma (HCC), the most common primary liver cancer, is a significant contributor to worldwide cancer-related deaths. Various medical imaging techniques, including computed tomography, magnetic resonance imaging, and ultrasound, play a crucial role in accurately evaluating HCC and formulating effective treatment plans. Artificial Intelligence (AI) technologies have demonstrated potential in supporting physicians by providing more accurate and consistent medical diagnoses. Recent advancements have led to the development of AI-based multi-modal prediction systems. These systems integrate medical imaging with other modalities, such as electronic health record reports and clinical parameters, to enhance the accuracy of predicting biological characteristics and prognosis, including those associated with HCC. These multi-modal prediction systems pave the way for predicting the response to transarterial chemoembolization and microvascular invasion treatments and can assist clinicians in identifying the optimal patients with HCC who could benefit from interventional therapy. This paper provides an overview of the latest AI-based medical imaging models developed for diagnosing and predicting HCC. It also explores the challenges and potential future directions related to the clinical application of AI techniques.
Collapse
Affiliation(s)
- Lulu Wang
- Department of Engineering, School of Technology, Reykjavık University, Reykjavík, Iceland
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| |
Collapse
|
9
|
Takenaga T, Hanaoka S, Nomura Y, Nakao T, Shibata H, Miki S, Yoshikawa T, Hayashi N, Abe O. Development and evaluation of an integrated liver nodule diagnostic method by combining the liver segment division and lesion localization/classification models for enhanced focal liver lesion detection. Radiol Phys Technol 2024; 17:103-111. [PMID: 37917288 DOI: 10.1007/s12194-023-00753-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Revised: 10/02/2023] [Accepted: 10/10/2023] [Indexed: 11/04/2023]
Abstract
The purpose of the study was to develop a liver nodule diagnostic method that accurately localizes and classifies focal liver lesions and identifies the specific liver segments in which they reside by integrating a liver segment division algorithm using a four-dimensional (4D) fully convolutional residual network (FC-ResNet) with a localization and classification model. We retrospectively collected data and divided 106 gadolinium-ethoxybenzyl-diethylenetriamine pentaacetic acid-enhanced magnetic resonance examinations into Case-sets 1, 2, and 3. A liver segment division algorithm was developed using a 4D FC-ResNet and trained with semi-automatically created silver-standard annotations; performance was evaluated using manually created gold-standard annotations by calculating the Dice scores for each liver segment. The performance of the liver nodule diagnostic method was assessed by comparing the results with those of the original radiology reports. The mean Dice score between the output of the liver segment division model and the gold standard was 0.643 for Case-set 2 (normal liver contours) and 0.534 for Case-set 1 (deformed liver contours). Among the 64 lesions in Case-set 3, the diagnostic method localized 37 lesions, classified 33 lesions, and identified the liver segments for 30 lesions. A total of 28 lesions were true positives, matching the original radiology reports. The liver nodule diagnostic method, which integrates a liver segment division algorithm with a lesion localization and classification model, exhibits great potential for localizing and classifying focal liver lesions and identifying the liver segments in which they reside. Further improvements and validation using larger sample sizes will enhance its performance and clinical applicability.
Collapse
Affiliation(s)
- Tomomi Takenaga
- Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan.
| | - Shouhei Hanaoka
- Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan
| | - Yukihiro Nomura
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan
- Center for Frontier Medical Engineering, Chiba University, 1-33 Yayoi-Cho, Inage-Ku, Chiba, Japan
| | - Takahiro Nakao
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan
| | - Hisaichi Shibata
- Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan
| | - Soichiro Miki
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan
| | - Takeharu Yoshikawa
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan
| | - Naoto Hayashi
- Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan
| | - Osamu Abe
- Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, Japan
| |
Collapse
|
10
|
Zbinden L, Catucci D, Suter Y, Hulbert L, Berzigotti A, Brönnimann M, Ebner L, Christe A, Obmann VC, Sznitman R, Huber AT. Automated liver segmental volume ratio quantification on non-contrast T1-Vibe Dixon liver MRI using deep learning. Eur J Radiol 2023; 167:111047. [PMID: 37690351 DOI: 10.1016/j.ejrad.2023.111047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2023] [Revised: 07/29/2023] [Accepted: 08/13/2023] [Indexed: 09/12/2023]
Abstract
PURPOSE To evaluate the effectiveness of automated liver segmental volume quantification and calculation of the liver segmental volume ratio (LSVR) on a non-contrast T1-vibe Dixon liver MRI sequence using a deep learning segmentation pipeline. METHOD A dataset of 200 liver MRI with a non-contrast 3 mm T1-vibe Dixon sequence was manually labeledslice-by-sliceby an expert for Couinaud liver segments, while portal and hepatic veins were labeled separately. A convolutional neural networkwas trainedusing 170 liver MRI for training and 30 for evaluation. Liver segmental volumes without liver vessels were retrieved and LSVR was calculated as the liver segmental volumes I-III divided by the liver segmental volumes IV-VIII. LSVR was compared with the expert manual LSVR calculation and the LSVR calculated on CT scans in 30 patients with CT and MRI within 6 months. RESULTS Theconvolutional neural networkclassified the Couinaud segments I-VIII with an average Dice score of 0.770 ± 0.03, ranging between 0.726 ± 0.13 (segment IVb) and 0.810 ± 0.09 (segment V). The calculated mean LSVR with liver MRI unseen by the model was 0.32 ± 0.14, as compared with manually quantified LSVR of 0.33 ± 0.15, resulting in a mean absolute error (MAE) of 0.02. A comparable LSVR of 0.35 ± 0.14 with a MAE of 0.04 resulted with the LSRV retrieved from the CT scans. The automated LSVR showed significant correlation with the manual MRI LSVR (Spearman r = 0.97, p < 0.001) and CT LSVR (Spearman r = 0.95, p < 0.001). CONCLUSIONS A convolutional neural network allowed for accurate automated liver segmental volume quantification and calculation of LSVR based on a non-contrast T1-vibe Dixon sequence.
Collapse
Affiliation(s)
- Lukas Zbinden
- ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland; Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, Bern, Switzerland
| | - Damiano Catucci
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, Bern, Switzerland; Graduate School for Health Sciences, University of Bern, Switzerland
| | - Yannick Suter
- ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland
| | - Leona Hulbert
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, Bern, Switzerland
| | - Annalisa Berzigotti
- Hepatology, Department of Visceral Surgery and Medicine, Inselspital, Bern University Hospital, Bern, Switzerland
| | - Michael Brönnimann
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, Bern, Switzerland
| | - Lukas Ebner
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, Bern, Switzerland
| | - Andreas Christe
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, Bern, Switzerland
| | - Verena Carola Obmann
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, Bern, Switzerland
| | - Raphael Sznitman
- ARTORG Center for Biomedical Engineering Research, University of Bern, Bern, Switzerland
| | - Adrian Thomas Huber
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, Bern, Switzerland.
| |
Collapse
|
11
|
Song G, Xie Z, Wang H, Li S, Yao D, Chen S, Shi Y. Segmentation of Portal Vein in Multiphase CTA Image Based on Unsupervised Domain Transfer and Pseudo Label. Diagnostics (Basel) 2023; 13:2250. [PMID: 37443644 DOI: 10.3390/diagnostics13132250] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Revised: 06/27/2023] [Accepted: 06/29/2023] [Indexed: 07/15/2023] Open
Abstract
BACKGROUND Clinically, physicians diagnose portal vein diseases on abdominal CT angiography (CTA) images scanned in the hepatic arterial phase (H-phase), portal vein phase (P-phase) and equilibrium phase (E-phase) simultaneously. However, existing studies typically segment the portal vein on P-phase images without considering other phase images. METHOD We propose a method for segmenting portal veins on multiphase images based on unsupervised domain transfer and pseudo labels by using annotated P-phase images. Firstly, unsupervised domain transfer is performed to make the H-phase and E-phase images of the same patient approach the P-phase image in style, reducing the image differences caused by contrast media. Secondly, the H-phase (or E-phase) image and its style transferred image are input into the segmentation module together with the P-phase image. Under the constraints of pseudo labels, accurate prediction results are obtained. RESULTS This method was evaluated on the multiphase CTA images of 169 patients. The portal vein segmented from the H-phase and E-phase images achieved DSC values of 0.76 and 0.86 and Jaccard values of 0.61 and 0.76, respectively. CONCLUSION The method can automatically segment the portal vein on H-phase and E-phase images when only the portal vein on the P-phase CTA image is annotated, which greatly assists in clinical diagnosis.
Collapse
Affiliation(s)
- Genshen Song
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai 200032, China
- Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai 200032, China
| | - Ziyue Xie
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai 200032, China
- Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai 200032, China
| | - Haoran Wang
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai 200032, China
- Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai 200032, China
| | - Shiman Li
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai 200032, China
- Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai 200032, China
| | - Demin Yao
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai 200032, China
- Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai 200032, China
| | - Shiyao Chen
- Department of Gastroenterology and Hepatology, Zhongshan Hospital, Fudan University, Shanghai 200032, China
| | - Yonghong Shi
- Digital Medical Research Center, School of Basic Medical Sciences, Fudan University, Shanghai 200032, China
- Shanghai Key Laboratory of Medical Imaging Computing and Computer Assisted Intervention, Shanghai 200032, China
- Academy for Engineering & Technology, Fudan University, Shanghai 200433, China
| |
Collapse
|
12
|
Tian Y, Qin W, Xue F, Lambo R, Yue M, Diao S, Yu L, Xie Y, Cao H, Li S. ARR-GCN: Anatomy-Relation Reasoning Graph Convolutional Network for Automatic Fine-Grained Segmentation of Organ's Surgical Anatomy. IEEE J Biomed Health Inform 2023; 27:3258-3269. [PMID: 37099476 DOI: 10.1109/jbhi.2023.3270664] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/27/2023]
Abstract
Anatomical resection (AR) based on anatomical sub-regions is a promising method of precise surgical resection, which has been proven to improve long-term survival by reducing local recurrence. The fine-grained segmentation of an organ's surgical anatomy (FGS-OSA), i.e., segmenting an organ into multiple anatomic regions, is critical for localizing tumors in AR surgical planning. However, automatically obtaining FGS-OSA results in computer-aided methods faces the challenges of appearance ambiguities among sub-regions (i.e., inter-sub-region appearance ambiguities) caused by similar HU distributions in different sub-regions of an organ's surgical anatomy, invisible boundaries, and similarities between anatomical landmarks and other anatomical information. In this paper, we propose a novel fine-grained segmentation framework termed the "anatomic relation reasoning graph convolutional network" (ARR-GCN), which incorporates prior anatomic relations into the framework learning. In ARR-GCN, a graph is constructed based on the sub-regions to model the class and their relations. Further, to obtain discriminative initial node representations of graph space, a sub-region center module is designed. Most importantly, to explicitly learn the anatomic relations, the prior anatomic-relations among the sub-regions are encoded in the form of an adjacency matrix and embedded into the intermediate node representations to guide framework learning. The ARR-GCN was validated on two FGS-OSA tasks: i) liver segments segmentation, and ii) lung lobes segmentation. Experimental results on both tasks outperformed other state-of-the-art segmentation methods and yielded promising performances by ARR-GCN for suppressing ambiguities among sub-regions.
Collapse
|
13
|
Pomohaci MD, Grasu MC, Dumitru RL, Toma M, Lupescu IG. Liver Transplant in Patients with Hepatocarcinoma: Imaging Guidelines and Future Perspectives Using Artificial Intelligence. Diagnostics (Basel) 2023; 13:diagnostics13091663. [PMID: 37175054 PMCID: PMC10178485 DOI: 10.3390/diagnostics13091663] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Revised: 04/26/2023] [Accepted: 05/05/2023] [Indexed: 05/15/2023] Open
Abstract
Hepatocellular carcinoma is the most common primary malignant hepatic tumor and occurs most often in the setting of chronic liver disease. Liver transplantation is a curative treatment option and is an ideal solution because it solves the chronic underlying liver disorder while removing the malignant lesion. However, due to organ shortages, this treatment can only be applied to carefully selected patients according to clinical guidelines. Artificial intelligence is an emerging technology with multiple applications in medicine with a predilection for domains that work with medical imaging, like radiology. With the help of these technologies, laborious tasks can be automated, and new lesion imaging criteria can be developed based on pixel-level analysis. Our objectives are to review the developing AI applications that could be implemented to better stratify liver transplant candidates. The papers analysed applied AI for liver segmentation, evaluation of steatosis, sarcopenia assessment, lesion detection, segmentation, and characterization. A liver transplant is an optimal treatment for patients with hepatocellular carcinoma in the setting of chronic liver disease. Furthermore, AI could provide solutions for improving the management of liver transplant candidates to improve survival.
Collapse
Affiliation(s)
- Mihai Dan Pomohaci
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania
- Department of Radiology, The University of Medicine and Pharmacy "Carol Davila", 050474 Bucharest, Romania
| | - Mugur Cristian Grasu
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania
- Department of Radiology, The University of Medicine and Pharmacy "Carol Davila", 050474 Bucharest, Romania
| | - Radu Lucian Dumitru
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania
- Department of Radiology, The University of Medicine and Pharmacy "Carol Davila", 050474 Bucharest, Romania
| | - Mihai Toma
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania
- Department of Radiology, The University of Medicine and Pharmacy "Carol Davila", 050474 Bucharest, Romania
| | - Ioana Gabriela Lupescu
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania
- Department of Radiology, The University of Medicine and Pharmacy "Carol Davila", 050474 Bucharest, Romania
| |
Collapse
|
14
|
Veiga-Canuto D, Cerdà-Alberich L, Jiménez-Pastor A, Carot Sierra JM, Gomis-Maya A, Sangüesa-Nebot C, Fernández-Patón M, Martínez de las Heras B, Taschner-Mandl S, Düster V, Pötschger U, Simon T, Neri E, Alberich-Bayarri Á, Cañete A, Hero B, Ladenstein R, Martí-Bonmatí L. Independent Validation of a Deep Learning nnU-Net Tool for Neuroblastoma Detection and Segmentation in MR Images. Cancers (Basel) 2023; 15:cancers15051622. [PMID: 36900410 PMCID: PMC10000775 DOI: 10.3390/cancers15051622] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2023] [Revised: 02/22/2023] [Accepted: 03/05/2023] [Indexed: 03/08/2023] Open
Abstract
OBJECTIVES To externally validate and assess the accuracy of a previously trained fully automatic nnU-Net CNN algorithm to identify and segment primary neuroblastoma tumors in MR images in a large children cohort. METHODS An international multicenter, multivendor imaging repository of patients with neuroblastic tumors was used to validate the performance of a trained Machine Learning (ML) tool to identify and delineate primary neuroblastoma tumors. The dataset was heterogeneous and completely independent from the one used to train and tune the model, consisting of 300 children with neuroblastic tumors having 535 MR T2-weighted sequences (486 sequences at diagnosis and 49 after finalization of the first phase of chemotherapy). The automatic segmentation algorithm was based on a nnU-Net architecture developed within the PRIMAGE project. For comparison, the segmentation masks were manually edited by an expert radiologist, and the time for the manual editing was recorded. Different overlaps and spatial metrics were calculated to compare both masks. RESULTS The median Dice Similarity Coefficient (DSC) was high 0.997; 0.944-1.000 (median; Q1-Q3). In 18 MR sequences (6%), the net was not able neither to identify nor segment the tumor. No differences were found regarding the MR magnetic field, type of T2 sequence, or tumor location. No significant differences in the performance of the net were found in patients with an MR performed after chemotherapy. The time for visual inspection of the generated masks was 7.9 ± 7.5 (mean ± Standard Deviation (SD)) seconds. Those cases where manual editing was needed (136 masks) required 124 ± 120 s. CONCLUSIONS The automatic CNN was able to locate and segment the primary tumor on the T2-weighted images in 94% of cases. There was an extremely high agreement between the automatic tool and the manually edited masks. This is the first study to validate an automatic segmentation model for neuroblastic tumor identification and segmentation with body MR images. The semi-automatic approach with minor manual editing of the deep learning segmentation increases the radiologist's confidence in the solution with a minor workload for the radiologist.
Collapse
Affiliation(s)
- Diana Veiga-Canuto
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
- Área Clínica de Imagen Médica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
- Correspondence: (D.V.-C.); (L.M.-B.)
| | - Leonor Cerdà-Alberich
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Ana Jiménez-Pastor
- Quantitative Imaging Biomarkers in Medicine, QUIBIM SL, 46026 Valencia, Spain
| | - José Miguel Carot Sierra
- Departamento de Estadística e Investigación Operativa Aplicadas y Calidad, Universitat Politècnica de València, Camí de Vera s/n, 46022 Valencia, Spain
| | - Armando Gomis-Maya
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Cinta Sangüesa-Nebot
- Área Clínica de Imagen Médica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Matías Fernández-Patón
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Blanca Martínez de las Heras
- Unidad de Oncohematología Pediátrica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Sabine Taschner-Mandl
- St. Anna Children’s Cancer Research Institute, Zimmermannplatz 10, 1090 Vienna, Austria
| | - Vanessa Düster
- St. Anna Children’s Cancer Research Institute, Zimmermannplatz 10, 1090 Vienna, Austria
| | - Ulrike Pötschger
- St. Anna Children’s Cancer Research Institute, Zimmermannplatz 10, 1090 Vienna, Austria
| | - Thorsten Simon
- Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical Faculty, University of Cologne, 50937 Cologne, Germany
| | - Emanuele Neri
- Academic Radiology, Department of Translational Research, University of Pisa, Via Roma, 67, 56126 Pisa, Italy
| | | | - Adela Cañete
- Unidad de Oncohematología Pediátrica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
| | - Barbara Hero
- Department of Pediatric Oncology and Hematology, University Children’s Hospital of Cologne, Medical Faculty, University of Cologne, 50937 Cologne, Germany
| | - Ruth Ladenstein
- St. Anna Children’s Cancer Research Institute, Zimmermannplatz 10, 1090 Vienna, Austria
| | - Luis Martí-Bonmatí
- Grupo de Investigación Biomédica en Imagen, Instituto de Investigación Sanitaria La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
- Área Clínica de Imagen Médica, Hospital Universitario y Politécnico La Fe, Avenida Fernando Abril Martorell, 106 Torre A 7planta, 46026 Valencia, Spain
- Correspondence: (D.V.-C.); (L.M.-B.)
| |
Collapse
|
15
|
An efficient classification of cirrhosis liver disease using hybrid convolutional neural network-capsule network. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
16
|
Segmentation of Pancreatic Subregions in Computed Tomography Images. J Imaging 2022; 8:jimaging8070195. [PMID: 35877639 PMCID: PMC9317715 DOI: 10.3390/jimaging8070195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2022] [Revised: 07/02/2022] [Accepted: 07/07/2022] [Indexed: 11/16/2022] Open
Abstract
The accurate segmentation of pancreatic subregions (head, body, and tail) in CT images provides an opportunity to examine the local morphological and textural changes in the pancreas. Quantifying such changes aids in understanding the spatial heterogeneity of the pancreas and assists in the diagnosis and treatment planning of pancreatic cancer. Manual outlining of pancreatic subregions is tedious, time-consuming, and prone to subjective inconsistency. This paper presents a multistage anatomy-guided framework for accurate and automatic 3D segmentation of pancreatic subregions in CT images. Using the delineated pancreas, two soft-label maps were estimated for subregional segmentation—one by training a fully supervised naïve Bayes model that considers the length and volumetric proportions of each subregional structure based on their anatomical arrangement, and the other by using the conventional deep learning U-Net architecture for 3D segmentation. The U-Net model then estimates the joint probability of the two maps and performs optimal segmentation of subregions. Model performance was assessed using three datasets of contrast-enhanced abdominal CT scans: one public NIH dataset of the healthy pancreas, and two datasets D1 and D2 (one for each of pre-cancerous and cancerous pancreas). The model demonstrated excellent performance during the multifold cross-validation using the NIH dataset, and external validation using D1 and D2. To the best of our knowledge, this is the first automated model for the segmentation of pancreatic subregions in CT images. A dataset consisting of reference anatomical labels for subregions in all images of the NIH dataset is also established.
Collapse
|
17
|
Chen CI, Lu NH, Huang YH, Liu KY, Hsu SY, Matsushima A, Wang YM, Chen TB. Segmentation of liver tumors with abdominal computed tomography using fully convolutional networks. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2022; 30:953-966. [PMID: 35754254 DOI: 10.3233/xst-221194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
BACKGROUND Dividing liver organs or lesions depicting on computed tomography (CT) images could be applied to help tumor staging and treatment. However, most existing image segmentation technologies use manual or semi-automatic analysis, making the analysis process costly and time-consuming. OBJECTIVE This research aims to develop and apply a deep learning network architecture to segment liver tumors automatically after fine tuning parameters. METHODS AND MATERIALS The medical imaging is obtained from the International Symposium on Biomedical Imaging (ISBI), which includes 3D abdominal CT scans of 131 patients diagnosed with liver tumors. From these CT scans, there are 7,190 2D CT images along with the labeled binary images. The labeled binary images are regarded as gold standard for evaluation of the segmented results by FCN (Fully Convolutional Network). The backbones of FCN are extracted from Xception, InceptionresNetv2, MobileNetv2, ResNet18, ResNet50 in this study. Meanwhile, the parameters including optimizers (SGDM and ADAM), size of epoch, and size of batch are investigated. CT images are randomly divided into training and testing sets using a ratio of 9:1. Several evaluation indices including Global Accuracy, Mean Accuracy, Mean IoU (Intersection over Union), Weighted IoU and Mean BF Score are applied to evaluate tumor segmentation results in the testing images. RESULTS The Global Accuracy, Mean Accuracy, Mean IoU, Weighted IoU, and Mean BF Scores are 0.999, 0.969, 0.954, 0.998, 0.962 using ResNet50 in FCN with optimizer SGDM, batch size 12, and epoch 9. It is important to fine tuning the parameters in FCN model. Top 20 FNC models enable to achieve higher tumor segmentation accuracy with Mean IoU over 0.900. The occurred frequency of InceptionresNetv2, MobileNetv2, ResNet18, ResNet50, and Xception are 9, 6, 3, 5, and 2 times. Therefore, the InceptionresNetv2 has higher performance than others. CONCLUSIONS This study develop and test an automated liver tumor segmentation model based on FCN. Study results demonstrate that many deep learning models including InceptionresNetv2, MobileNetv2, ResNet18, ResNet50, and Xception have high potential to segment liver tumors from CT images with accuracy exceeding 90%. However, it is still difficult to accurately segment tiny and small size tumors by FCN models.
Collapse
Affiliation(s)
- Chih-I Chen
- Division of Colon and Rectal Surgery, Department of Surgery, E-DA Hospital, Kaohsiung City, Taiwan
- Division of General Medicine Surgery, Department of Surgery, E-DA Hospital, Kaohsiung City, Taiwan
- School of Medicine, College of Medicine, I-Shou University, Kaohsiung City, Taiwan
- Department of Information Engineering, I-Shou University, Kaohsiung City, Taiwan
- The School of Chinese Medicine for Post Baccalaureate, I-Shou University, Kaohsiung City, Taiwan
| | - Nan-Han Lu
- Department of Pharmacy, Tajen University, Pingtung City, Taiwan
- Department of Radiology, E-DA Hospital, I-Shou University, Kaohsiung City, Taiwan
- Department of Medical Imaging and Radiological Science, I-Shou University, Kaohsiung City, Taiwan
| | - Yung-Hui Huang
- Department of Medical Imaging and Radiological Science, I-Shou University, Kaohsiung City, Taiwan
| | - Kuo-Ying Liu
- Department of Radiology, E-DA Hospital, I-Shou University, Kaohsiung City, Taiwan
| | - Shih-Yen Hsu
- Department of Information Engineering, I-Shou University, Kaohsiung City, Taiwan
| | - Akari Matsushima
- Department of Radiological Technology Faculty of Medical Technology, Teikyo University, Tokyo, Japan
| | - Yi-Ming Wang
- Department of Information Engineering, I-Shou University, Kaohsiung City, Taiwan
- Department of Critical Care Medicine, E-DA hospital, I-Shou University, Kaohsiung City, Taiwan
| | - Tai-Been Chen
- Department of Medical Imaging and Radiological Science, I-Shou University, Kaohsiung City, Taiwan
- Institute of Statistics, National Yang Ming Chiao Tung University, Hsinchu, Taiwan
| |
Collapse
|