1
|
Yasaka K, Kawamura M, Sonoda Y, Kubo T, Kiryu S, Abe O. Large multimodality model fine-tuned for detecting breast and esophageal carcinomas on CT: a preliminary study. Jpn J Radiol 2025; 43:779-786. [PMID: 39668277 PMCID: PMC12052878 DOI: 10.1007/s11604-024-01718-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2024] [Accepted: 12/02/2024] [Indexed: 12/14/2024]
Abstract
PURPOSE This study aimed to develop a large multimodality model (LMM) that can detect breast and esophageal carcinomas on chest contrast-enhanced CT. MATERIALS AND METHODS In this retrospective study, CT images of 401 (age, 62.9 ± 12.9 years; 169 males), 51 (age, 65.5 ± 11.6 years; 23 males), and 120 (age, 64.6 ± 14.2 years; 60 males) patients were used in the training, validation, and test phases. The numbers of CT images with breast carcinoma, esophageal carcinoma, and no lesion were 927, 2180, and 2087; 80, 233, and 270; and 184, 246, and 6919 for the training, validation, and test datasets, respectively. The LMM was fine-tuned using CT images as input and text data ("suspicious of breast carcinoma"/ "suspicious of esophageal carcinoma"/ "no lesion") as reference data on a desktop computer equipped with a single graphic processing unit. Because of the random nature of the training process, supervised learning was performed 10 times. The performance of the best performing model on the validation dataset was further tested using the time-independent test dataset. The detection performance was evaluated by calculating the area under the receiver operating characteristic curve (AUC). RESULTS The sensitivities of the fine-tuned LMM for detecting breast and esophageal carcinomas in the test dataset were 0.929 and 0.951, respectively. The diagnostic performance of the fine-tuned LMM for detecting breast and esophageal carcinomas was high, with AUCs of 0.890 (95%CI 0.871-0.909) and 0.880 (95%CI 0.865-0.894), respectively. CONCLUSIONS The fine-tuned LMM could detect both breast and esophageal carcinomas on chest contrast-enhanced CT with high diagnostic performance. Usefulness of large multimodality models in chest cancer imaging has not been assessed so far. The fine-tuned large multimodality model could detect breast and esophageal carcinomas with high diagnostic performance (area under the receiver operating characteristic curve of 0.890 and 0.880, respectively).
Collapse
Affiliation(s)
- Koichiro Yasaka
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan.
| | - Motohide Kawamura
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Yuki Sonoda
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Takatoshi Kubo
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Shigeru Kiryu
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda, Narita, Chiba, 286-0124, Japan
| | - Osamu Abe
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| |
Collapse
|
2
|
Liu Y, Gao Z, Shi N, Wu F, Shi Y, Chen Q, Zhuang X. MERIT: Multi-view evidential learning for reliable and interpretable liver fibrosis staging. Med Image Anal 2025; 102:103507. [PMID: 40022854 DOI: 10.1016/j.media.2025.103507] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2024] [Revised: 12/30/2024] [Accepted: 02/11/2025] [Indexed: 03/04/2025]
Abstract
Accurate staging of liver fibrosis from magnetic resonance imaging (MRI) is crucial in clinical practice. While conventional methods often focus on a specific sub-region, multi-view learning captures more information by analyzing multiple patches simultaneously. However, previous multi-view approaches could not typically calculate uncertainty by nature, and they generally integrate features from different views in a black-box fashion, hence compromising reliability as well as interpretability of the resulting models. In this work, we propose a new multi-view method based on evidential learning, referred to as MERIT, which tackles the two challenges in a unified framework. MERIT enables uncertainty quantification of the predictions to enhance reliability, and employs a logic-based combination rule to improve interpretability. Specifically, MERIT models the prediction from each sub-view as an opinion with quantified uncertainty under the guidance of the subjective logic theory. Furthermore, a distribution-aware base rate is introduced to enhance performance, particularly in scenarios involving class distribution shifts. Finally, MERIT adopts a feature-specific combination rule to explicitly fuse multi-view predictions, thereby enhancing interpretability. Results have showcased the effectiveness of the proposed MERIT, highlighting the reliability and offering both ad-hoc and post-hoc interpretability. They also illustrate that MERIT can elucidate the significance of each view in the decision-making process for liver fibrosis staging. Our code will be released via https://github.com/HenryLau7/MERIT.
Collapse
Affiliation(s)
- Yuanye Liu
- School of Data Science, Fudan University, Shanghai, 200433, China
| | - Zheyao Gao
- School of Data Science, Fudan University, Shanghai, 200433, China
| | - Nannan Shi
- Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, 201508, China
| | - Fuping Wu
- Nuffield Department of Population Health, University of Oxford, Oxford, UK
| | - Yuxin Shi
- Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, 201508, China
| | - Qingchao Chen
- National Institute of Health Data Science, Peking University, Beijing, 100191, China; Institute of Medical Technology, Peking University, Beijing, 100191, China; State Key Laboratory of General Artificial Intelligence, Peking University, Beijing, 100191, China
| | - Xiahai Zhuang
- School of Data Science, Fudan University, Shanghai, 200433, China.
| |
Collapse
|
3
|
Yin C, Zhang H, Du J, Zhu Y, Zhu H, Yue H. Artificial intelligence in imaging for liver disease diagnosis. Front Med (Lausanne) 2025; 12:1591523. [PMID: 40351457 PMCID: PMC12062035 DOI: 10.3389/fmed.2025.1591523] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2025] [Accepted: 04/08/2025] [Indexed: 05/14/2025] Open
Abstract
Liver diseases, including hepatitis, non-alcoholic fatty liver disease (NAFLD), cirrhosis, and hepatocellular carcinoma (HCC), remain a major global health concern, with early and accurate diagnosis being essential for effective management. Imaging modalities such as ultrasound (US), computed tomography (CT), and magnetic resonance imaging (MRI) play a crucial role in non-invasive diagnosis, but their sensitivity and diagnostic accuracy can be limited. Recent advancements in artificial intelligence (AI) have improved imaging-based liver disease assessment by enhancing pattern recognition, automating fibrosis and steatosis quantification, and aiding in HCC detection. AI-driven imaging techniques have shown promise in fibrosis staging through US, CT, MRI, and elastography, reducing the reliance on invasive liver biopsy. For liver steatosis, AI-assisted imaging methods have improved sensitivity and grading consistency, while in HCC detection and characterization, AI models have enhanced lesion identification, classification, and risk stratification across imaging modalities. The growing integration of AI into liver imaging is reshaping diagnostic workflows and has the potential to improve accuracy, efficiency, and clinical decision-making. This review provides an overview of AI applications in liver imaging, focusing on their clinical utility and implications for the future of liver disease diagnosis.
Collapse
Affiliation(s)
- Chenglong Yin
- Department of Gastroenterology, Affiliated Hospital 6 of Nantong University, Yancheng Third People's Hospital, Yancheng, Jiangsu, China
- Affiliated Yancheng Hospital, School of Medicine, Southeast University, Yancheng, Jiangsu, China
| | | | - Jin Du
- Affiliated Yancheng Hospital, School of Medicine, Southeast University, Yancheng, Jiangsu, China
- Department of Science and Education, Affiliated Hospital 6 of Nantong University, Yancheng Third People's Hospital, Yancheng, Jiangsu, China
| | - Yingling Zhu
- Affiliated Yancheng Hospital, School of Medicine, Southeast University, Yancheng, Jiangsu, China
- Department of Science and Education, Affiliated Hospital 6 of Nantong University, Yancheng Third People's Hospital, Yancheng, Jiangsu, China
| | - Hua Zhu
- Department of Gastroenterology, Affiliated Hospital 6 of Nantong University, Yancheng Third People's Hospital, Yancheng, Jiangsu, China
- Affiliated Yancheng Hospital, School of Medicine, Southeast University, Yancheng, Jiangsu, China
| | - Hongqin Yue
- Department of Gastroenterology, Affiliated Hospital 6 of Nantong University, Yancheng Third People's Hospital, Yancheng, Jiangsu, China
- Affiliated Yancheng Hospital, School of Medicine, Southeast University, Yancheng, Jiangsu, China
| |
Collapse
|
4
|
Zheng S, Ma W, Mu L, He K, Cao J, So TY, Zhang L, Li M, Zhai Y, Liu F, Guo S, Yin L, Zhao L, Wang L, Lee HH, Jiang W, Niu J, Gao P, Dou Q, Zhang H. CT-based artificial intelligence system complementing deep learning model and radiologist for liver fibrosis staging. iScience 2025; 28:112224. [PMID: 40248124 PMCID: PMC12005311 DOI: 10.1016/j.isci.2025.112224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2024] [Revised: 12/29/2024] [Accepted: 03/12/2025] [Indexed: 04/19/2025] Open
Abstract
Noninvasive methods for liver fibrosis staging are urgently needed due to its significance in predicting significant morbidity and mortality. In this study, we developed an automated DL-based segmentation and classification model (Model-C). Test-time adaptation was used to address data distribution shifts. We then established a deep learning-radiologist complementarity decision system (DRCDS) via a decision model determining whether to adopt Model-C's diagnosis or defer to radiologists. Model-C (AUCs of 0.89-0.92) outperformed models based on liver (AUCs: 0.84-0.90) or spleen (AUCs: 0.69-0.70). With test-time adaptation, the Obuchowski index values of Model-C in three external sets improved from 0.81, 0.73, and 0.73 to 0.85, 0.85, and 0.81. DRCDS performed slightly better than Model-C or senior radiologists, with 73.7%-92.0% of cases adopting Model-C's diagnosis. In conclusion, DRCDS could diagnose liver fibrosis with high accuracy. Additionally, we provided solutions to model generalization and human-machine complementarity issues in multi-classification problems.
Collapse
Affiliation(s)
- Shuang Zheng
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| | - Wenao Ma
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Lin Mu
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| | - Kan He
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| | - Jianfeng Cao
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Tiffany Y. So
- Department of Imaging and Interventional Radiology, Prince of Wales Hospital, Hong Kong, China
| | - Lei Zhang
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| | - Mingyang Li
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| | - Yanan Zhai
- Department of Radiology, The First Hospital of Lanzhou University, The First Clinical Medical College of Lanzhou University, Intelligent Imaging Medical Engineering Research Center of Gansu Province, Radiological Clinical Medicine Research Center of Gansu Province, Lanzhou, China
| | - Feng Liu
- The First Clinical Medical College of Lanzhou University, Lanzhou, China
| | - Shunlin Guo
- Department of Radiology, The First Hospital of Lanzhou University, The First Clinical Medical College of Lanzhou University, Intelligent Imaging Medical Engineering Research Center of Gansu Province, Radiological Clinical Medicine Research Center of Gansu Province, Lanzhou, China
| | - Longlin Yin
- Department of Radiology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Liming Zhao
- Department of Radiology, Sichuan Academy of Medical Sciences & Sichuan Provincial People’s Hospital, Chengdu, China
| | - Lei Wang
- Department of Imaging and Interventional Radiology, Prince of Wales Hospital, Hong Kong, China
| | - Heather H.C. Lee
- Department of Diagnostic Radiology, Princess Margaret Hospital, Hong Kong, China
| | - Wei Jiang
- National Health Commission Capacity Building and Continuing Education Center, Department of Big Data, Beijing, China
| | - Junqi Niu
- Department of Hepatology, The First Hospital of Jilin University, Changchun, China
| | - Pujun Gao
- Department of Hepatology, The First Hospital of Jilin University, Changchun, China
| | - Qi Dou
- Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong, China
| | - Huimao Zhang
- Department of Radiology, The First Hospital of Jilin University, Changchun, China
| |
Collapse
|
5
|
Hatamoto D, Yamakawa M, Shiina T. Improving ultrasound image classification accuracy of liver tumors using deep learning model with hepatitis virus infection information. J Med Ultrason (2001) 2025:10.1007/s10396-025-01528-1. [PMID: 40205118 DOI: 10.1007/s10396-025-01528-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2024] [Accepted: 02/04/2025] [Indexed: 04/11/2025]
Abstract
PURPOSE In recent years, computer-aided diagnosis (CAD) using deep learning methods for medical images has been studied. Although studies have been conducted to classify ultrasound images of tumors of the liver into four categories (liver cysts (Cyst), liver hemangiomas (Hemangioma), hepatocellular carcinoma (HCC), and metastatic liver cancer (Meta)), no studies with additional information for deep learning have been reported. Therefore, we attempted to improve the classification accuracy of ultrasound images of hepatic tumors by adding hepatitis virus infection information to deep learning. METHODS Four combinations of hepatitis virus infection information were assigned to each image, plus or minus HBs antigen and plus or minus HCV antibody, and the classification accuracy was compared before and after the information was input and weighted to fully connected layers. RESULTS With the addition of hepatitis virus infection information, accuracy changed from 0.574 to 0.643. The F1-Score for Cyst, Hemangioma, HCC, and Meta changed from 0.87 to 0.88, 0.55 to 0.57, 0.46 to 0.59, and 0.54 to 0.62, respectively, remaining the same for Hemangioma but increasing for the rest. CONCLUSION Learning hepatitis virus infection information showed the highest increase in the F1-Score for HCC, resulting in improved classification accuracy of ultrasound images of hepatic tumors.
Collapse
Affiliation(s)
- Daisuke Hatamoto
- Graduate School of Medicine, Kyoto University, 53 Shogoin Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8397, Japan.
| | - Makoto Yamakawa
- Graduate School of Medicine, Kyoto University, 53 Shogoin Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8397, Japan
- SIT Research Laboratories, Shibaura Institute of Technology, Tokyo, Japan
| | - Tsuyoshi Shiina
- Graduate School of Medicine, Kyoto University, 53 Shogoin Kawahara-Cho, Sakyo-Ku, Kyoto, 606-8397, Japan
- SIT Research Laboratories, Shibaura Institute of Technology, Tokyo, Japan
| |
Collapse
|
6
|
Pomohaci MD, Grasu MC, Băicoianu-Nițescu AŞ, Enache RM, Lupescu IG. Systematic Review: AI Applications in Liver Imaging with a Focus on Segmentation and Detection. Life (Basel) 2025; 15:258. [PMID: 40003667 PMCID: PMC11856300 DOI: 10.3390/life15020258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/29/2024] [Revised: 02/02/2025] [Accepted: 02/05/2025] [Indexed: 02/27/2025] Open
Abstract
The liver is a frequent focus in radiology due to its diverse pathology, and artificial intelligence (AI) could improve diagnosis and management. This systematic review aimed to assess and categorize research studies on AI applications in liver radiology from 2018 to 2024, classifying them according to areas of interest (AOIs), AI task and imaging modality used. We excluded reviews and non-liver and non-radiology studies. Using the PRISMA guidelines, we identified 6680 articles from the PubMed/Medline, Scopus and Web of Science databases; 1232 were found to be eligible. A further analysis of a subgroup of 329 studies focused on detection and/or segmentation tasks was performed. Liver lesions were the main AOI and CT was the most popular modality, while classification was the predominant AI task. Most detection and/or segmentation studies (48.02%) used only public datasets, and 27.65% used only one public dataset. Code sharing was practiced by 10.94% of these articles. This review highlights the predominance of classification tasks, especially applied to liver lesion imaging, most often using CT imaging. Detection and/or segmentation tasks relied mostly on public datasets, while external testing and code sharing were lacking. Future research should explore multi-task models and improve dataset availability to enhance AI's clinical impact in liver imaging.
Collapse
Affiliation(s)
- Mihai Dan Pomohaci
- Department 8: Radiology, Discipline of Radiology, Medical Imaging and Interventional Radiology I, University of Medicine and Pharmacy “Carol Davila”, 050474 Bucharest, Romania; (M.D.P.); (A.-Ș.B.-N.)
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania;
| | - Mugur Cristian Grasu
- Department 8: Radiology, Discipline of Radiology, Medical Imaging and Interventional Radiology I, University of Medicine and Pharmacy “Carol Davila”, 050474 Bucharest, Romania; (M.D.P.); (A.-Ș.B.-N.)
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania;
| | - Alexandru-Ştefan Băicoianu-Nițescu
- Department 8: Radiology, Discipline of Radiology, Medical Imaging and Interventional Radiology I, University of Medicine and Pharmacy “Carol Davila”, 050474 Bucharest, Romania; (M.D.P.); (A.-Ș.B.-N.)
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania;
| | - Robert Mihai Enache
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania;
| | - Ioana Gabriela Lupescu
- Department 8: Radiology, Discipline of Radiology, Medical Imaging and Interventional Radiology I, University of Medicine and Pharmacy “Carol Davila”, 050474 Bucharest, Romania; (M.D.P.); (A.-Ș.B.-N.)
- Department of Radiology and Medical Imaging, Fundeni Clinical Institute, 022328 Bucharest, Romania;
| |
Collapse
|
7
|
Wu B, Huang Z, Liang J, Yang H, Wang W, Huang S, Chen L, Huang Q. GLCV-NET: An automatic diagnosis system for advanced liver fibrosis using global-local cross view in B-mode ultrasound images. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 257:108440. [PMID: 39378633 DOI: 10.1016/j.cmpb.2024.108440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/28/2024] [Revised: 09/12/2024] [Accepted: 09/22/2024] [Indexed: 10/10/2024]
Abstract
BACKGROUND AND OBJECTIVE Advanced liver fibrosis is a critical stage in the evaluation of chronic liver disease (CLD), holding clinical significance in the development of treatment strategies and estimating the disease progression. METHODS This paper proposes an innovative Global-Local Cross-View Network (GLCV-Net) for the automatic diagnosis of advanced liver fibrosis from ultrasound (US) B-mode images. The proposed method consists of three main components: 1. A Segmentation-enhanced Global Hybrid Feature Extractor for segmenting the liver parenchyma and extracting global features; 2. A Heatmap-weighted Local Feature Extractor for selecting candidate regions and automatically identifying suspicious areas to construct local features; 3. A Scale-adaptive Fusion Module to balance the contributions of global and local scales in evaluating advanced liver fibrosis. RESULTS The predictive performance of the model was validated on an internal dataset of 1003 chronic liver disease (CLD) patients and an external dataset of 46 CLD patients, both subjected to liver fibrosis staging through pathological assessment. On the internal dataset, GLCV-Net achieved 86.9% accuracy, 85.0% recall, 85.4% precision, and 85.2% F1-score. Further validation on the external dataset confirmed its robustness, with scores of 86.1% in accuracy, 83.1% in recall, 80.8% in precision, and 81.9% in F1-score. CONCLUSION These results underscore the GLCV-Net's potential as a promising approach for non-invasively and accurately diagnosing advanced liver fibrosis in CLD patients, breaking through the limitations of traditional methods by integrating global and local information of liver fibrosis, significantly enhancing diagnostic accuracy.
Collapse
Affiliation(s)
- Bianzhe Wu
- School of Electronic and Information Engineering, South China University of Technology, 510640, China
| | - ZeRong Huang
- Department of Ultrasound, State Key Laboratory of Oncology in South China, Collaborative Innovation Center of Cancer Medicine, Sun Yat-Sen University Cancer Center, Guangzhou 510060, China; Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou 510080, China
| | - Jinglin Liang
- School of Electronic and Information Engineering, South China University of Technology, 510640, China
| | - Hong Yang
- Department of Medical Ultrasound, the First Affiliated Hospital of Guangxi Medical University, Nanning 530021, China
| | - Wei Wang
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou 510080, China
| | - Shuangping Huang
- School of Electronic and Information Engineering, South China University of Technology, 510640, China; Pazhou Laboratory, China.
| | - LiDa Chen
- Department of Medical Ultrasonics, Institute of Diagnostic and Interventional Ultrasound, The First Affiliated Hospital of Sun Yat-sen University, Guangzhou 510080, China.
| | - Qinghua Huang
- School of Artificial Intelligence, Optics and Electronics (iOPEN), Northwestern Polytechnical University, Xi'an 710072, China
| |
Collapse
|
8
|
Wang J, Tang S, Wu J, Xu S, Sun Q, Zhou Z, Xu X, Liu Y, Liu Q, Mao Y, He J, Zhang X, Yin Y. Radiomic Features at Contrast-Enhanced CT Predict Virus-Driven Liver Fibrosis: A Multi-Institutional Study. Clin Transl Gastroenterol 2024; 15:e1. [PMID: 38801182 PMCID: PMC11500785 DOI: 10.14309/ctg.0000000000000712] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/13/2023] [Accepted: 04/30/2024] [Indexed: 05/29/2024] Open
Abstract
INTRODUCTION Liver fibrosis is a major cause of morbidity and mortality among in patients with chronic hepatitis. Radiomics, particularly of the spleen, may improve diagnostic accuracy and treatment strategies. External validations are necessary to ensure reliability and generalizability. METHODS In this retrospective study, we developed 3 radiomics models using contrast-enhanced computed tomography scans from 167 patients with liver fibrosis (training group) between January 2020 and December 2021. Radiomic features were extracted from arterial venous, portal venous, and equilibrium phase images. Recursive feature selection random forest and the least absolute shrinkage and selection operator logistic regression were used for feature selection and dimensionality reduction. Performance was assessed by area under the curve, C-index, calibration plots, and decision curve analysis. External validation was performed on 114 patients from 2 institutions. RESULTS Twenty-five radiomic features were significantly associated with fibrosis stage, with 80% of the top 10 features originating from portal venous phase spleen images. The radiomics models showed good performance in the validation cohort (C-indices 0.723-0.808) and excellent calibration. Decision curve analysis indicated clinical benefits, with machine learning-based radiomics models (Random Forest score and support vector machine based radiomics score) providing more significant advantages. DISCUSSION Radiomic features offer significant benefits over existing serum indices for staging virus-driven liver fibrosis, underscoring the value of radiomics in enhancing diagnostic accuracy. Specifically, radiomics analysis of the spleen presents additional noninvasive options for assessing fibrosis, highlighting its potential in improving patient management and outcomes.
Collapse
Affiliation(s)
- Jincheng Wang
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
- Graduate School of Medical Science and Engineering, Hokkaido University, Sapporo, Japan
| | - Shengnan Tang
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Jin Wu
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Shanshan Xu
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
- Department of PET/CT Center, Jiangsu Cancer Hospital, The Affiliated Cancer Hospital of Nanjing Medical University, Jiangsu Institute of Cancer Research, Nanjing, China
| | - Qikai Sun
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Zheyu Zhou
- Department of General Surgery, Nanjing Drum Tower Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College, Graduate School of Peking Union Medical College, Nanjing, China
| | - Xiaoliang Xu
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yang Liu
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Qiaoyu Liu
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| | - Yingfan Mao
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Jian He
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Xudong Zhang
- Department of Hepato-biliary-pancreatic Surgery, The Affiliated Changzhou No. 2 People’s Hospital of Nanjing Medical University, Changzhou, China
| | - Yin Yin
- Department of General Surgery, The First Affiliated Hospital of Anhui Medical University, Hefei, China
| |
Collapse
|
9
|
Zhao H, Zhang X, Gao Y, Wang L, Xiao L, Liu S, Huang B, Li Z. Diagnostic performance of EfficientNetV2-S method for staging liver fibrosis based on multiparametric MRI. Heliyon 2024; 10:e35115. [PMID: 39165928 PMCID: PMC11334657 DOI: 10.1016/j.heliyon.2024.e35115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2023] [Revised: 07/19/2024] [Accepted: 07/23/2024] [Indexed: 08/22/2024] Open
Abstract
Problem Previous studies had confirmed that some deep learning models had high diagnostic performance in staging liver fibrosis. However, training efficiency of models predicting liver fibrosis need to be improved to achieve rapid diagnosis and precision medicine. Aim The deep learning framework of EfficientNetV2-S was noted because of its faster training speed and better parameter efficiency compared with other models. Our study sought to develop noninvasive predictive models based on EfficientNetV2-S framework for staging liver fibrosis. Methods Patients with chronic liver disease who underwent multi-parametric abdominal MRI were included in the retrospective study. Data augmentation methods including horizontal flip, vertical flip, perspective transformation and edge enhancement were applied to multi-parametric MR images to solve the data imbalance between different liver fibrosis groups. The EfficientNetV2-S models were used for the prediction of liver fibrosis stages F1-2, F1-3, F3, F4 and F3-4. We evaluated the diagnostic performance of our models in training, validation, and test sets by using receiver operating characteristic curve (ROC) analysis. Results The total training time of EfficientNetV2-S was about 6 h. For differentiating of F1-2 vs F3, the accuracy, sensitivity and specificity of EfficientNetV2-S model were 96.2 %, 96.4 % and 96.0 % in the test set. The AUC in test set was 0.559. The accuracy, sensitivity and specificity were 82.1 %, 74.5 % and 89.6 % in the test set by using EfficientNetV2-S model to differentiate F1-2 vs F3-4, and the AUC in test set were 0.763. For differentiating F1-3 vs F4, the accuracy, sensitivity and specificity of EfficientNetV2-S model were 71.5 %, 73.4 % and 69.5 % in the test set. The AUC was 0.553 in test set. For differentiating F1-2 vs F4, the accuracy, sensitivity and specificity of our model were 84.3 %, 80.2 % and 88.3 % in the test set, and the AUC was 0.715, respectively. For differentiating F3 vs F4, the accuracy, sensitivity and specificity of EfficientNetV2-S model were 92.5 %, 89.1 % and 95.6 % in the test set, and the AUC was 0.696 in the test set. Conclusions The EfficientNetV2-S models based on multi-parametric MRI had the feasibility for staging of liver fibrosis because they showed high training speed and diagnostic performance in our study.
Collapse
Affiliation(s)
- Haichen Zhao
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Xiaoya Zhang
- College of Computer Science and Technology of Qingdao University, Qingdao, China
| | - Yuanxiang Gao
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Lili Wang
- Department of Pathology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Longyang Xiao
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Shunli Liu
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Baoxiang Huang
- College of Computer Science and Technology of Qingdao University, Qingdao, China
| | - Zhiming Li
- Department of Radiology, The Affiliated Hospital of Qingdao University, Qingdao, China
| |
Collapse
|
10
|
Huang W, Peng Y, Kang L. Advancements of non‐invasive imaging technologies for the diagnosis and staging of liver fibrosis: Present and future. VIEW 2024; 5. [DOI: 10.1002/viw.20240010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2024] [Accepted: 06/28/2024] [Indexed: 01/04/2025] Open
Abstract
AbstractLiver fibrosis is a reparative response triggered by liver injury. Non‐invasive assessment and staging of liver fibrosis in patients with chronic liver disease are of paramount importance, as treatment strategies and prognoses depend significantly on the degree of fibrosis. Although liver fibrosis has traditionally been staged through invasive liver biopsy, this method is prone to sampling errors, particularly when biopsy sizes are inadequate. Consequently, there is an urgent clinical need for an alternative to biopsy, one that ensures precise, sensitive, and non‐invasive diagnosis and staging of liver fibrosis. Non‐invasive imaging assessments have assumed a pivotal role in clinical practice, enjoying growing popularity and acceptance due to their potential for diagnosing, staging, and monitoring liver fibrosis. In this comprehensive review, we first delved into the current landscape of non‐invasive imaging technologies, assessing their accuracy and the transformative impact they have had on the diagnosis and management of liver fibrosis in both clinical practice and animal models. Additionally, we provided an in‐depth exploration of recent advancements in ultrasound imaging, computed tomography imaging, magnetic resonance imaging, nuclear medicine imaging, radiomics, and artificial intelligence within the field of liver fibrosis research. We summarized the key concepts, advantages, limitations, and diagnostic performance of each technique. Finally, we discussed the challenges associated with clinical implementation and offer our perspective on advancing the field, hoping to provide alternative directions for the future research.
Collapse
Affiliation(s)
- Wenpeng Huang
- Department of Nuclear Medicine Peking University First Hospital Beijing China
| | - Yushuo Peng
- Department of Nuclear Medicine Peking University First Hospital Beijing China
| | - Lei Kang
- Department of Nuclear Medicine Peking University First Hospital Beijing China
| |
Collapse
|
11
|
Chang Z, Peng CH, Chen KJ, Xu GK. Enhancing liver fibrosis diagnosis and treatment assessment: a novel biomechanical markers-based machine learning approach. Phys Med Biol 2024; 69:115046. [PMID: 38749471 DOI: 10.1088/1361-6560/ad4c4e] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/16/2024] [Accepted: 05/15/2024] [Indexed: 05/31/2024]
Abstract
Accurate diagnosis and treatment assessment of liver fibrosis face significant challenges, including inherent limitations in current techniques like sampling errors and inter-observer variability. Addressing this, our study introduces a novel machine learning (ML) framework, which integrates light gradient boosting machine and multivariate imputation by chained equations to enhance liver status assessment using biomechanical markers. Building upon our previously established multiscale mechanical characteristics in fibrotic and treated livers, this framework employs Gaussian Bayesian optimization for post-imputation, significantly improving classification performance. Our findings indicate a marked increase in the precision of liver fibrosis diagnosis and provide a novel, quantitative approach for assessing fibrosis treatment. This innovative combination of multiscale biomechanical markers with advanced ML algorithms represents a transformative step in liver disease diagnostics and treatment evaluation, with potential implications for other areas in medical diagnostics.
Collapse
Affiliation(s)
- Zhuo Chang
- Laboratory for Multiscale Mechanics and Medical Science, Department of Engineering Mechanics, SVL, School of Aerospace Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China
| | - Chen-Hao Peng
- Department of Biomedical Imaging and Radiological Science, China Medical University, Taichung 41170, Taiwan, R.O.C
| | - Kai-Jung Chen
- Department of Mechanical Engineering, National Chin-Yi University of Technology, Taichung 41170, Taiwan, R.O.C
| | - Guang-Kui Xu
- Laboratory for Multiscale Mechanics and Medical Science, Department of Engineering Mechanics, SVL, School of Aerospace Engineering, Xi'an Jiaotong University, Xi'an 710049, People's Republic of China
| |
Collapse
|
12
|
Lu F, Meng Y, Song X, Li X, Liu Z, Gu C, Zheng X, Jing Y, Cai W, Pinyopornpanish K, Mancuso A, Romeiro FG, Méndez-Sánchez N, Qi X. Artificial Intelligence in Liver Diseases: Recent Advances. Adv Ther 2024; 41:967-990. [PMID: 38286960 DOI: 10.1007/s12325-024-02781-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 01/03/2024] [Indexed: 01/31/2024]
Abstract
Liver diseases cause a significant burden on public health worldwide. In spite of great advances during recent years, there are still many challenges in the diagnosis and treatment of liver diseases. During recent years, artificial intelligence (AI) has been widely used for the diagnosis, risk stratification, and prognostic prediction of various diseases based on clinical datasets and medical images. Accumulative studies have shown its performance for diagnosing patients with nonalcoholic fatty liver disease and liver fibrosis and assessing their severity, and for predicting treatment response and recurrence of hepatocellular carcinoma, outcomes of liver transplantation recipients, and risk of drug-induced liver injury. Herein, we aim to comprehensively summarize the current evidence regarding diagnostic, prognostic, and/or therapeutic role of AI in these common liver diseases.
Collapse
Affiliation(s)
- Feifei Lu
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
| | - Yao Meng
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, Dalian Medical University, Dalian, China
| | - Xiaoting Song
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, Dalian Medical University, Dalian, China
| | - Xiaotong Li
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Zhuang Liu
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Chunru Gu
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Xiaojie Zheng
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China
- Postgraduate College, China Medical University, Shenyang, China
| | - Yi Jing
- Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang, China
| | - Wei Cai
- Neusoft Research of Intelligent Healthcare Technology, Co. Ltd., Shenyang, China
| | - Kanokwan Pinyopornpanish
- Department of Internal Medicine, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand
| | - Andrea Mancuso
- Medicina Interna 1, Azienda di Rilievo Nazionale Ad Alta Specializzazione Civico-Di Cristina-Benfratelli, Palermo, Italy.
| | | | - Nahum Méndez-Sánchez
- Liver Research Unit, Medica Sur Clinic and Foundation, National Autonomous University of Mexico, Mexico City, Mexico.
| | - Xingshun Qi
- College of Medicine and Biological Information Engineering, Northeastern University, Shenyang, China.
- Liver Cirrhosis Study Group, Department of Gastroenterology, General Hospital of Northern Theater Command, No. 83 Wenhua Road, Shenyang, 110840, Liaoning Province, China.
- Postgraduate College, Dalian Medical University, Dalian, China.
- Postgraduate College, China Medical University, Shenyang, China.
| |
Collapse
|
13
|
Park HC, Joo Y, Lee OJ, Lee K, Song TK, Choi C, Choi MH, Yoon C. Automated classification of liver fibrosis stages using ultrasound imaging. BMC Med Imaging 2024; 24:36. [PMID: 38321373 PMCID: PMC10848434 DOI: 10.1186/s12880-024-01209-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Accepted: 01/21/2024] [Indexed: 02/08/2024] Open
Abstract
BACKGROUND Ultrasound imaging is the most frequently performed for the patients with chronic hepatitis or liver cirrhosis. However, ultrasound imaging is highly operator dependent and interpretation of ultrasound images is subjective, thus well-trained radiologist is required for evaluation. Automated classification of liver fibrosis could alleviate the shortage of skilled radiologist especially in low-to-middle income countries. The purposed of this study is to evaluate deep convolutional neural networks (DCNNs) for classifying the degree of liver fibrosis according to the METAVIR score using US images. METHODS We used ultrasound (US) images from two tertiary university hospitals. A total of 7920 US images from 933 patients were used for training/validation of DCNNs. All patient were underwent liver biopsy or hepatectomy, and liver fibrosis was categorized based on pathology results using the METAVIR score. Five well-established DCNNs (VGGNet, ResNet, DenseNet, EfficientNet and ViT) was implemented to predict the METAVIR score. The performance of DCNNs for five-level (F0/F1/F2/F3/F4) classification was evaluated through area under the receiver operating characteristic curve (AUC) with 95% confidential interval, accuracy, sensitivity, specificity, positive and negative likelihood ratio. RESULTS Similar mean AUC values were achieved for five models; VGGNet (0.96), ResNet (0.96), DenseNet (0.95), EfficientNet (0.96), and ViT (0.95). The same mean accuracy (0.94) and specificity values (0.96) were yielded for all models. In terms of sensitivity, EffcientNet achieved highest mean value (0.85) while the other models produced slightly lower values range from 0.82 to 0.84. CONCLUSION In this study, we demonstrated that DCNNs can classify the staging of liver fibrosis according to METAVIR score with high performance using conventional B-mode images. Among them, EfficientNET that have fewer parameters and computation cost produced highest performance. From the results, we believe that DCNNs based classification of liver fibrosis may allow fast and accurate diagnosis of liver fibrosis without needs of additional equipment for add-on test and may be powerful tool for supporting radiologists in clinical practice.
Collapse
Grants
- NTIS Number: 9991007146 the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health & Welfare, the Ministry of Food and Drug Safety
- HI21C0940110021 the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
- No. 2022-0-00101 the Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT)
- the Ministry of Science and ICT, the Ministry of Trade, Industry and Energy, the Ministry of Health & Welfare, the Ministry of Food and Drug Safety
- the Korea Health Industry Development Institute (KHIDI), funded by the Ministry of Health & Welfare, Republic of Korea
- the Institute of Information & communications Technology Planning & Evaluation (IITP) grant funded by the Korea government (MSIT)
Collapse
Affiliation(s)
- Hyun-Cheol Park
- Division of Industrial Mathematics, National Institute for Mathematical Sciences, 70, Yuseong-daero, Yuseong-gu, 34047, Daejeon, Republic of Korea
| | - YunSang Joo
- Department of Computer Engineering, Gachon University, 1342, Seongnam-daero, Sujeong-gu, 13120, Seongnam-si, Gyeonggi-do, Republic of Korea
| | - O-Joun Lee
- Department of Artificial Intelligence, The Catholic University of Korea, 43, Jibong-ro, 14662, Bucheon-si, Gyeonggi-do, Republic of Korea
| | - Kunkyu Lee
- Department of Electronic Engineering, Sogang University, 35 Baekbeom-ro, 04107, Seoul, Republic of Korea
| | - Tai-Kyong Song
- Department of Electronic Engineering, Sogang University, 35 Baekbeom-ro, 04107, Seoul, Republic of Korea
| | - Chang Choi
- Department of Computer Engineering, Gachon University, 1342, Seongnam-daero, Sujeong-gu, 13120, Seongnam-si, Gyeonggi-do, Republic of Korea
| | - Moon Hyung Choi
- Department of Radiology, College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seoul, Republic of Korea.
| | - Changhan Yoon
- Department of Biomedical Engineering, Department of Nanoscience and Engineering, Inje University, Inje-ro 197, 50834, Gimhae, Gyeongnam, Republic of Korea.
| |
Collapse
|
14
|
Okimoto N, Yasaka K, Fujita N, Watanabe Y, Kanzawa J, Abe O. Deep learning reconstruction for improving the visualization of acute brain infarct on computed tomography. Neuroradiology 2024; 66:63-71. [PMID: 37991522 PMCID: PMC10761512 DOI: 10.1007/s00234-023-03251-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 11/13/2023] [Indexed: 11/23/2023]
Abstract
PURPOSE This study aimed to investigate the impact of deep learning reconstruction (DLR) on acute infarct depiction compared with hybrid iterative reconstruction (Hybrid IR). METHODS This retrospective study included 29 (75.8 ± 13.2 years, 20 males) and 26 (64.4 ± 12.4 years, 18 males) patients with and without acute infarction, respectively. Unenhanced head CT images were reconstructed with DLR and Hybrid IR. In qualitative analyses, three readers evaluated the conspicuity of lesions based on five regions and image quality. A radiologist placed regions of interest on the lateral ventricle, putamen, and white matter in quantitative analyses, and the standard deviation of CT attenuation (i.e., quantitative image noise) was recorded. RESULTS Conspicuity of acute infarct in DLR was superior to that in Hybrid IR, and a statistically significant difference was observed for two readers (p ≤ 0.038). Conspicuity of acute infarct with time from onset to CT imaging at < 24 h in DLR was significantly improved compared with Hybrid IR for all readers (p ≤ 0.020). Image noise in DLR was significantly reduced compared with Hybrid IR with both the qualitative and quantitative analyses (p < 0.001 for all). CONCLUSION DLR in head CT helped improve acute infarct depiction, especially those with time from onset to CT imaging at < 24 h.
Collapse
Affiliation(s)
- Naomasa Okimoto
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
- Department of Radiology, Tokyo Metropolitan Bokutoh Hospital, 4-23-15 Kotobashi, Sumida-Ku, Tokyo, 130-8575, Japan
| | - Koichiro Yasaka
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan.
| | - Nana Fujita
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Yusuke Watanabe
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Jun Kanzawa
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Osamu Abe
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| |
Collapse
|
15
|
Kutaiba N, Dahan A, Goodwin M, Testro A, Egan G, Lim R. Deep Learning for Computed Tomography Assessment of Hepatic Fibrosis and Cirrhosis: A Systematic Review. MAYO CLINIC PROCEEDINGS. DIGITAL HEALTH 2023; 1:574-585. [PMID: 40206310 PMCID: PMC11975692 DOI: 10.1016/j.mcpdig.2023.08.008] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 04/11/2025]
Abstract
Studies were identified using deep learning artificial intelligence methods for the analysis of computed tomography images in the assessment of hepatic fibrosis and cirrhosis. A systematic review was conducted in line with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses of Diagnostic Test Accuracy Studies protocol to evaluate the accuracy of deep learning algorithms for this objective (PROSPERO CRD 42023366201). A literature search was conducted on Medline, Embase, Web of Science, and IEEE Xplore databases. The search was conducted with a timeline from January 1, 2000,through November 13, 2022. Our search resulted in 3877 studies for screening, which yielded 6 studies meeting our inclusion criteria. All studies were retrospective. Three studies performed internal validation, and 2 studies performed external validation. Four studies used image classification algorithms, whereas 2 studies used image segmentation algorithms to derive volumetric measurements of the liver and spleen. Accuracy of the algorithms was variable in diagnosing significant and advanced fibrosis and cirrhosis, with the area under the curve ranging from 0.63 to 0.97. Deep learning algorithms using computed tomography images have the potential to classify fibrosis stages. Heterogeneity in cohorts and methodologies limits the generalizability of these studies.
Collapse
Affiliation(s)
- Numan Kutaiba
- Department of Radiology, Austin Health, Heidelberg VIC, Australia
- The University of Melbourne, Parkville, Australia
| | - Ariel Dahan
- Department of Radiology, Austin Health, Heidelberg VIC, Australia
| | - Mark Goodwin
- Department of Radiology, Austin Health, Heidelberg VIC, Australia
- The University of Melbourne, Parkville, Australia
| | - Adam Testro
- Department of Gastroenterology, Austin Health, Heidelberg VIC, Australia
- The University of Melbourne, Parkville, Australia
| | - Gary Egan
- Monash Biomedical Imaging, Monash University, Clayton VIC, Australia
| | - Ruth Lim
- Department of Radiology, Austin Health, Heidelberg VIC, Australia
- The University of Melbourne, Parkville, Australia
| |
Collapse
|
16
|
Zhang L, Xiao Z, Jiang W, Luo C, Ye M, Yue G, Chen Z, Ouyang S, Liu Y. Liver fibrosis MR images classification based on higher-order interaction and sample distribution rebalancing. Health Inf Sci Syst 2023; 11:51. [PMID: 37954065 PMCID: PMC10632346 DOI: 10.1007/s13755-023-00255-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Accepted: 10/17/2023] [Indexed: 11/14/2023] Open
Abstract
The fractal features of liver fibrosis MR images exhibit an irregular fragmented distribution, and the diffuse feature distribution lacks interconnectivity, result- ing in incomplete feature learning and poor recognition accuracy. In this paper, we insert recursive gated convolution into the ResNet18 network to introduce spatial information interactions during the feature learning process and extend it to higher orders using recursion. Higher-order spatial information interactions enhance the correlation between features and enable the neural network to focus more on the pixel-level dependencies, enabling a global interpretation of liver MR images. Additionally, the existence of light scattering and quantum noise during the imaging process, coupled with environmental factors such as breathing artifacts caused by long time breath holding, affects the quality of the MR images. To improve the classification performance of the neural network and better cap- ture sample features, we introduce the Adaptive Rebalance loss function and incorporate the feature paradigm as a learnable adaptive attribute into the angular margin auxiliary function. Adaptive Rebalance loss function can expand the inter-class distance and narrow the intra-class difference to further enhance discriminative ability of the model. We conduct extensive experiments on liver fibrosis MR imaging involving 209 patients. The results demonstrate an average improvement of two percent in recognition accuracy compared to ResNet18. The github is at https://github.com/XZN1233/paper.git.
Collapse
Affiliation(s)
- Ling Zhang
- School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006 Guangdong China
| | - Zhennan Xiao
- School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006 Guangdong China
| | - Wenchao Jiang
- School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006 Guangdong China
| | - Chengbin Luo
- School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006 Guangdong China
| | - Ming Ye
- School of Computer Science and Technology, Guangdong University of Technology, Guangzhou, 510006 Guangdong China
| | - Guanghui Yue
- School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University, Shenzhen, 518060 Guangdong China
| | - Zhiyuan Chen
- Department of Radiology, The Second Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, 510120 Guangdong China
| | - Shuman Ouyang
- Department of Radiology, The Second Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, 510120 Guangdong China
| | - Yupin Liu
- Department of Radiology, The Second Affiliated Hospital of Guangzhou University of Chinese Medicine, Guangzhou, 510120 Guangdong China
| |
Collapse
|
17
|
Hu N, Yan G, Tang M, Wu Y, Song F, Xia X, Chan LWC, Lei P. CT-based methods for assessment of metabolic dysfunction associated with fatty liver disease. Eur Radiol Exp 2023; 7:72. [PMID: 37985560 PMCID: PMC10661153 DOI: 10.1186/s41747-023-00387-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2023] [Accepted: 09/12/2023] [Indexed: 11/22/2023] Open
Abstract
Metabolic dysfunction-associated fatty liver disease (MAFLD), previously called metabolic nonalcoholic fatty liver disease, is the most prevalent chronic liver disease worldwide. The multi-factorial nature of MAFLD severity is delineated through an intricate composite analysis of the grade of activity in concert with the stage of fibrosis. Despite the preeminence of liver biopsy as the diagnostic and staging reference standard, its invasive nature, pronounced interobserver variability, and potential for deleterious effects (encompassing pain, infection, and even fatality) underscore the need for viable alternatives. We reviewed computed tomography (CT)-based methods for hepatic steatosis quantification (liver-to-spleen ratio; single-energy "quantitative" CT; dual-energy CT; deep learning-based methods; photon-counting CT) and hepatic fibrosis staging (morphology-based CT methods; contrast-enhanced CT biomarkers; dedicated postprocessing methods including liver surface nodularity, liver segmental volume ratio, texture analysis, deep learning methods, and radiomics). For dual-energy and photon-counting CT, the role of virtual non-contrast images and material decomposition is illustrated. For contrast-enhanced CT, normalized iodine concentration and extracellular volume fraction are explained. The applicability and salience of these approaches for clinical diagnosis and quantification of MAFLD are discussed.Relevance statementCT offers a variety of methods for the assessment of metabolic dysfunction-associated fatty liver disease by quantifying steatosis and staging fibrosis.Key points• MAFLD is the most prevalent chronic liver disease worldwide and is rapidly increasing.• Both hardware and software CT advances with high potential for MAFLD assessment have been observed in the last two decades.• Effective estimate of liver steatosis and staging of liver fibrosis can be possible through CT.
Collapse
Affiliation(s)
- Na Hu
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Gang Yan
- Department of Nuclear Medicine, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Maowen Tang
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Yuhui Wu
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Fasong Song
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Xing Xia
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China
| | - Lawrence Wing-Chi Chan
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China.
| | - Pinggui Lei
- Department of Radiology, The Affiliated Hospital of Guizhou Medical University, Guiyang, China.
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Kowloon, Hong Kong SAR, China.
| |
Collapse
|
18
|
Radiya K, Joakimsen HL, Mikalsen KØ, Aahlin EK, Lindsetmo RO, Mortensen KE. Performance and clinical applicability of machine learning in liver computed tomography imaging: a systematic review. Eur Radiol 2023; 33:6689-6717. [PMID: 37171491 PMCID: PMC10511359 DOI: 10.1007/s00330-023-09609-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 02/02/2023] [Accepted: 02/06/2023] [Indexed: 05/13/2023]
Abstract
OBJECTIVES Machine learning (ML) for medical imaging is emerging for several organs and image modalities. Our objectives were to provide clinicians with an overview of this field by answering the following questions: (1) How is ML applied in liver computed tomography (CT) imaging? (2) How well do ML systems perform in liver CT imaging? (3) What are the clinical applications of ML in liver CT imaging? METHODS A systematic review was carried out according to the guidelines from the PRISMA-P statement. The search string focused on studies containing content relating to artificial intelligence, liver, and computed tomography. RESULTS One hundred ninety-one studies were included in the study. ML was applied to CT liver imaging by image analysis without clinicians' intervention in majority of studies while in newer studies the fusion of ML method with clinical intervention have been identified. Several were documented to perform very accurately on reliable but small data. Most models identified were deep learning-based, mainly using convolutional neural networks. Potentially many clinical applications of ML to CT liver imaging have been identified through our review including liver and its lesion segmentation and classification, segmentation of vascular structure inside the liver, fibrosis and cirrhosis staging, metastasis prediction, and evaluation of chemotherapy. CONCLUSION Several studies attempted to provide transparent result of the model. To make the model convenient for a clinical application, prospective clinical validation studies are in urgent call. Computer scientists and engineers should seek to cooperate with health professionals to ensure this. KEY POINTS • ML shows great potential for CT liver image tasks such as pixel-wise segmentation and classification of liver and liver lesions, fibrosis staging, metastasis prediction, and retrieval of relevant liver lesions from similar cases of other patients. • Despite presenting the result is not standardized, many studies have attempted to provide transparent results to interpret the machine learning method performance in the literature. • Prospective studies are in urgent call for clinical validation of ML method, preferably carried out by cooperation between clinicians and computer scientists.
Collapse
Affiliation(s)
- Keyur Radiya
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway.
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway.
| | - Henrik Lykke Joakimsen
- Institute of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Centre for Clinical Artificial Intelligence (SPKI), University Hospital of North Norway, Tromso, Norway
| | - Karl Øyvind Mikalsen
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Centre for Clinical Artificial Intelligence (SPKI), University Hospital of North Norway, Tromso, Norway
- UiT Machine Learning Group, Department of Physics and Technology, UiT the Arctic University of Norway, Tromso, Norway
| | - Eirik Kjus Aahlin
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway
| | - Rolv-Ole Lindsetmo
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Head Clinic of Surgery, Oncology and Women Health, University Hospital of North Norway, Tromso, Norway
| | - Kim Erlend Mortensen
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
| |
Collapse
|
19
|
Yasaka K, Hatano S, Mizuki M, Okimoto N, Kubo T, Shibata E, Watadani T, Abe O. Effects of deep learning on radiologists' and radiology residents' performance in identifying esophageal cancer on CT. Br J Radiol 2023; 96:20220685. [PMID: 37000686 PMCID: PMC10546446 DOI: 10.1259/bjr.20220685] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2022] [Revised: 12/16/2022] [Accepted: 01/24/2023] [Indexed: 04/01/2023] Open
Abstract
OBJECTIVE To investigate the effectiveness of a deep learning model in helping radiologists or radiology residents detect esophageal cancer on contrast-enhanced CT images. METHODS This retrospective study included 250 and 25 patients with and without esophageal cancer, respectively, who underwent contrast-enhanced CT between December 2014 and May 2021 (mean age, 67.9 ± 10.3 years; 233 men). A deep learning model was developed using data from 200 and 25 patients with esophageal cancer as training and validation data sets, respectively. The model was then applied to the test data set, consisting of additional 25 and 25 patients with and without esophageal cancer, respectively. Four readers (one radiologist and three radiology residents) independently registered the likelihood of malignant lesions using a 3-point scale in the test data set. After the scorings were completed, the readers were allowed to reference to the deep learning model results and modify their scores, when necessary. RESULTS The area under the curve (AUC) of the deep learning model was 0.95 and 0.98 in the image- and patient-based analyses, respectively. By referencing to the deep learning model results, the AUCs for the readers were improved from 0.96/0.93/0.96/0.93 to 0.97/0.95/0.99/0.96 (p = 0.100/0.006/<0.001/<0.001, DeLong's test) in the image-based analysis, with statistically significant differences noted for the three less-experienced readers. Furthermore, the AUCs for the readers tended to improve from 0.98/0.96/0.98/0.94 to 1.00/1.00/1.00/1.00 (p = 0.317/0.149/0.317/0.073, DeLong's test) in the patient-based analysis. CONCLUSION The deep learning model mainly helped less-experienced readers improve their performance in detecting esophageal cancer on contrast-enhanced CT. ADVANCES IN KNOWLEDGE A deep learning model could mainly help less-experienced readers to detect esophageal cancer by improving their diagnostic confidence and diagnostic performance.
Collapse
Affiliation(s)
- Koichiro Yasaka
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Sosuke Hatano
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Masumi Mizuki
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Naomasa Okimoto
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Takatoshi Kubo
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Eisuke Shibata
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Takeyuki Watadani
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| | - Osamu Abe
- Department of Radiology, The University of Tokyo Hospital, Tokyo, Japan
| |
Collapse
|
20
|
Kamalanathan A, Muthu B, Kuniyil Kaleena P. Artificial Intelligence (AI) Game Changer in Cancer Biology. MARVELS OF ARTIFICIAL AND COMPUTATIONAL INTELLIGENCE IN LIFE SCIENCES 2023:62-87. [DOI: 10.2174/9789815136807123010009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2025]
Abstract
Healthcare is one of many industries where the most modern technologies,
such as artificial intelligence and machine learning, have shown a wide range of
applications. Cancer, one of the most prevalent non-communicable diseases in modern
times, accounts for a sizable portion of worldwide mortality. Investigations are
continuously being conducted to find ways to reduce cancer mortality and morbidity.
Artificial Intelligence (AI) is currently being used in cancer research, with promising
results. Two main features play a vital role in improving cancer prognosis: early
detection and proper diagnosis using imaging and molecular techniques. AI's use as a
tool in these sectors has demonstrated its capacity to precisely detect and diagnose,
which is one of AI's many applications in cancer research. The purpose of this chapter
is to review the literature and find AI applications in a range of cancers that are
commonly seen.
Collapse
Affiliation(s)
- Ashok Kamalanathan
- Department of Microbiology and Biotechnology, Faculty of Arts and Science, Bharath Institute
of Higher Education and Research (BIHER), Chennai- 600 073, Tamil Nadu, India
| | - Babu Muthu
- Department of Microbiology and Biotechnology, Faculty of Arts and Science, Bharath Institute
of Higher Education and Research (BIHER), Chennai- 600 073, Tamil Nadu, India
| | | |
Collapse
|
21
|
Akai H, Yasaka K, Sugawara H, Tajima T, Akahane M, Yoshioka N, Ohtomo K, Abe O, Kiryu S. Commercially Available Deep-learning-reconstruction of MR Imaging of the Knee at 1.5T Has Higher Image Quality Than Conventionally-reconstructed Imaging at 3T: A Normal Volunteer Study. Magn Reson Med Sci 2023; 22:353-360. [PMID: 35811127 PMCID: PMC10449552 DOI: 10.2463/mrms.mp.2022-0020] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2022] [Accepted: 05/22/2022] [Indexed: 11/09/2022] Open
Abstract
PURPOSE This study aimed to evaluate whether the image quality of 1.5T magnetic resonance imaging (MRI) of the knee is equal to or higher than that of 3T MRI by applying deep learning reconstruction (DLR). METHODS Proton density-weighted images of the right knee of 27 healthy volunteers were obtained by 3T and 1.5T MRI scanners using similar imaging parameters (21 for high resolution image and 6 for normal resolution image). Commercially available DLR was applied to the 1.5T images to obtain 1.5T/DLR images. The 3T and 1.5T/DLR images were compared subjectively for visibility of structures, image noise, artifacts, and overall diagnostic acceptability and objectively. One-way ANOVA and Friedman tests were used for the statistical analyses. RESULTS For the high resolution images, all of the anatomical structures, except for bone, were depicted significantly better on the 1.5T/DLR compared with 3T images. Image noise scored statistically lower and overall diagnostic acceptability scored higher on the 1.5T/DLR images. The contrast between lateral meniscus and articular cartilage of the 1.5T/DLR images was significantly higher (5.89 ± 1.30 vs. 4.34 ± 0.87, P < 0.001), and also the contrast between medial meniscus and articular cartilage of the 1.5T/DLR images was significantly higher (5.12 ± 0.93 vs. 3.87 ± 0.56, P < 0.001). Similar image quality improvement by DLR was observed for the normal resolution images. CONCLUSION The 1.5T/DLR images can achieve less noise, more precise visualization of the meniscus and ligaments, and higher overall image quality compared with the 3T images acquired using a similar protocol.
Collapse
Affiliation(s)
- Hiroyuki Akai
- Department of Radiology, Institute of Medical Science, University of Tokyo, Tokyo, Japan
- Department of Radiology, International University of Health and Welfare Narita Hospital, Narita, Chiba, Japan
| | - Koichiro Yasaka
- Department of Radiology, International University of Health and Welfare Narita Hospital, Narita, Chiba, Japan
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Haruto Sugawara
- Department of Radiology, Institute of Medical Science, University of Tokyo, Tokyo, Japan
| | - Taku Tajima
- Department of Radiology, International University of Health and Welfare Narita Hospital, Narita, Chiba, Japan
- Department of Radiology, International University of Health and Welfare Mita Hospital, Tokyo, Japan
| | - Masaaki Akahane
- Department of Radiology, International University of Health and Welfare Narita Hospital, Narita, Chiba, Japan
| | - Naoki Yoshioka
- Department of Radiology, International University of Health and Welfare Narita Hospital, Narita, Chiba, Japan
| | - Kuni Ohtomo
- Department of Radiology, International University of Health and Welfare, Ohtawara, Tochigi, Japan
| | - Osamu Abe
- Department of Radiology, Graduate School of Medicine, University of Tokyo, Tokyo, Japan
| | - Shigeru Kiryu
- Department of Radiology, International University of Health and Welfare Narita Hospital, Narita, Chiba, Japan
| |
Collapse
|
22
|
Lei P, Hu N, Wu Y, Tang M, Lin C, Kong L, Zhang L, Luo P, Chan LW. Radiobioinformatics: A novel bridge between basic research and clinical practice for clinical decision support in diffuse liver diseases. IRADIOLOGY 2023; 1:167-189. [DOI: 10.1002/ird3.24] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Accepted: 05/18/2023] [Indexed: 01/04/2025]
Abstract
AbstractThe liver is a multifaceted organ that is responsible for many critical functions encompassing amino acid, carbohydrate, and lipid metabolism, all of which make a healthy liver essential for the human body. Contemporary imaging methodologies have remarkable diagnostic accuracy in discerning focal liver lesions; however, a comprehensive understanding of diffuse liver diseases is a requisite for radiologists to accurately diagnose or predict the progression of such lesions within clinical contexts. Nonetheless, the conventional attributes of radiological features, including morphology, size, margin, density, signal intensity, and echoes, limit their clinical utility. Radiomics is a widely used approach that is characterized by the extraction of copious image features from radiographic depictions, which gives it considerable potential in addressing this limitation. It is worth noting that functional or molecular alterations occur significantly prior to the morphological shifts discernible by imaging modalities. Consequently, the explication of potential mechanisms by multiomics analyses (encompassing genomics, epigenomics, transcriptomics, proteomics, and metabolomics) is essential for investigating putative signal pathway regulations from a radiological viewpoint. In this review, we elaborate on the principal pathological categorizations of diffuse liver diseases, the evaluation of multiomics approaches pertaining to diffuse liver diseases, and the prospective value of predictive models. Accordingly, the overarching objective of this review is to scrutinize the interrelations between radiological features and bioinformatics as well as to consider the development of prediction models predicated on radiobioinformatics as integral components of clinical decision support systems for diffuse liver diseases.
Collapse
Affiliation(s)
- Pinggui Lei
- Department of Health Technology and Informatics The Hong Kong Polytechnic University Kowloon Hong Kong SAR China
- Department of Radiology The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
- School of Public Health Guizhou Medical University Guiyang Guizhou China
| | - Na Hu
- Department of Radiology The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Yuhui Wu
- Department of Radiology The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Maowen Tang
- Department of Radiology The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Chong Lin
- Department of Radiology The Affiliated Hospital of Guizhou Medical University Guiyang Guizhou China
| | - Luoyi Kong
- Department of Health Technology and Informatics The Hong Kong Polytechnic University Kowloon Hong Kong SAR China
| | - Lingfeng Zhang
- Department of Health Technology and Informatics The Hong Kong Polytechnic University Kowloon Hong Kong SAR China
| | - Peng Luo
- School of Public Health Guizhou Medical University Guiyang Guizhou China
| | - Lawrence Wing‐Chi Chan
- Department of Health Technology and Informatics The Hong Kong Polytechnic University Kowloon Hong Kong SAR China
| |
Collapse
|
23
|
Zhao D, Wang W, Tang T, Zhang YY, Yu C. Current progress in artificial intelligence-assisted medical image analysis for chronic kidney disease: A literature review. Comput Struct Biotechnol J 2023; 21:3315-3326. [PMID: 37333860 PMCID: PMC10275698 DOI: 10.1016/j.csbj.2023.05.029] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/28/2022] [Revised: 05/28/2023] [Accepted: 05/28/2023] [Indexed: 06/20/2023] Open
Abstract
Chronic kidney disease (CKD) causes irreversible damage to kidney structure and function. Arising from various etiologies, risk factors for CKD include hypertension and diabetes. With a progressively increasing global prevalence, CKD is an important public health problem worldwide. Medical imaging has become an important diagnostic tool for CKD through the non-invasive identification of macroscopic renal structural abnormalities. Artificial intelligence (AI)-assisted medical imaging techniques aid clinicians in the analysis of characteristics that cannot be easily discriminated by the naked eye, providing valuable information for the identification and management of CKD. Recent studies have demonstrated the effectiveness of AI-assisted medical image analysis as a clinical support tool using radiomics- and deep learning-based AI algorithms for improving the early detection, pathological assessment, and prognostic evaluation of various forms of CKD, including autosomal dominant polycystic kidney disease. Herein, we provide an overview of the potential roles of AI-assisted medical image analysis for the diagnosis and management of CKD.
Collapse
Affiliation(s)
- Dan Zhao
- Department of Nephrology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| | - Wei Wang
- Department of Radiology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| | - Tian Tang
- Department of Nephrology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| | - Ying-Ying Zhang
- Department of Nephrology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| | - Chen Yu
- Department of Nephrology, Tongji Hospital, School of Medicine, Tongji University, Shanghai 200065, China
| |
Collapse
|
24
|
Popa SL, Ismaiel A, Abenavoli L, Padureanu AM, Dita MO, Bolchis R, Munteanu MA, Brata VD, Pop C, Bosneag A, Dumitrascu DI, Barsan M, David L. Diagnosis of Liver Fibrosis Using Artificial Intelligence: A Systematic Review. MEDICINA (KAUNAS, LITHUANIA) 2023; 59:medicina59050992. [PMID: 37241224 DOI: 10.3390/medicina59050992] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Revised: 05/04/2023] [Accepted: 05/19/2023] [Indexed: 05/28/2023]
Abstract
Background and Objectives: The development of liver fibrosis as a consequence of continuous inflammation represents a turning point in the evolution of chronic liver diseases. The recent developments of artificial intelligence (AI) applications show a high potential for improving the accuracy of diagnosis, involving large sets of clinical data. For this reason, the aim of this systematic review is to provide a comprehensive overview of current AI applications and analyze the accuracy of these systems to perform an automated diagnosis of liver fibrosis. Materials and Methods: We searched PubMed, Cochrane Library, EMBASE, and WILEY databases using predefined keywords. Articles were screened for relevant publications about AI applications capable of diagnosing liver fibrosis. Exclusion criteria were animal studies, case reports, abstracts, letters to the editor, conference presentations, pediatric studies, studies written in languages other than English, and editorials. Results: Our search identified a total of 24 articles analyzing the automated imagistic diagnosis of liver fibrosis, out of which six studies analyze liver ultrasound images, seven studies analyze computer tomography images, five studies analyze magnetic resonance images, and six studies analyze liver biopsies. The studies included in our systematic review showed that AI-assisted non-invasive techniques performed as accurately as human experts in detecting and staging liver fibrosis. Nevertheless, the findings of these studies need to be confirmed through clinical trials to be implemented into clinical practice. Conclusions: The current systematic review provides a comprehensive analysis of the performance of AI systems in diagnosing liver fibrosis. Automatic diagnosis, staging, and risk stratification for liver fibrosis is currently possible considering the accuracy of the AI systems, which can overcome the limitations of non-invasive diagnosis methods.
Collapse
Affiliation(s)
- Stefan Lucian Popa
- 2nd Medical Department, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Abdulrahman Ismaiel
- 2nd Medical Department, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Ludovico Abenavoli
- Department of Health Sciences, University "Magna Graecia", 88100 Catanzaro, Italy
| | | | - Miruna Oana Dita
- Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Roxana Bolchis
- Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Mihai Alexandru Munteanu
- Department of Medical Disciplines, Faculty of Medicine and Pharmacy, University of Oradea, 410087 Oradea, Romania
| | - Vlad Dumitru Brata
- Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Cristina Pop
- Department of Pharmacology, Physiology, and Pathophysiology, Faculty of Pharmacy, Iuliu Hatieganu University of Medicine and Pharmacy, 400347 Cluj-Napoca, Romania
| | - Andrei Bosneag
- Faculty of Medicine, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Dinu Iuliu Dumitrascu
- Department of Anatomy, UMF "Iuliu Hatieganu" Cluj-Napoca, 400000 Cluj-Napoca, Romania
| | - Maria Barsan
- Department of Occupational Health, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| | - Liliana David
- 2nd Medical Department, "Iuliu Hatieganu" University of Medicine and Pharmacy, 400000 Cluj-Napoca, Romania
| |
Collapse
|
25
|
Okimoto N, Yasaka K, Kaiume M, Kanemaru N, Suzuki Y, Abe O. Improving detection performance of hepatocellular carcinoma and interobserver agreement for liver imaging reporting and data system on CT using deep learning reconstruction. Abdom Radiol (NY) 2023; 48:1280-1289. [PMID: 36757454 PMCID: PMC10115733 DOI: 10.1007/s00261-023-03834-z] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 01/23/2023] [Accepted: 01/24/2023] [Indexed: 02/10/2023]
Abstract
PURPOSE This study aimed to compare the hepatocellular carcinoma (HCC) detection performance, interobserver agreement for Liver Imaging Reporting and Data System (LI-RADS) categories, and image quality between deep learning reconstruction (DLR) and conventional hybrid iterative reconstruction (Hybrid IR) in CT. METHODS This retrospective study included patients who underwent abdominal dynamic contrast-enhanced CT between October 2021 and March 2022. Arterial, portal, and delayed phase images were reconstructed using DLR and Hybrid IR. Two blinded readers independently read the image sets with detecting HCCs, scoring LI-RADS, and evaluating image quality. RESULTS A total of 26 patients with HCC (mean age, 73 years ± 12.3) and 23 patients without HCC (mean age, 66 years ± 14.7) were included. The figures of merit (FOM) for the jackknife alternative free-response receiver operating characteristic analysis in detecting HCC averaged for the readers were 0.925 (reader 1, 0.937; reader 2, 0.913) in DLR and 0.878 (reader 1, 0.904; reader 2, 0.851) in Hybrid IR, and the FOM in DLR were significantly higher than that in Hybrid IR (p = 0.038). The interobserver agreement (Cohen's weighted kappa statistics) for LI-RADS categories was moderate for DLR (0.595; 95% CI, 0.585-0.605) and significantly superior to Hybrid IR (0.568; 95% CI, 0.553-0.582). According to both readers, DLR was significantly superior to Hybrid IR in terms of image quality (p ≤ 0.021). CONCLUSION DLR improved HCC detection, interobserver agreement for LI-RADS categories, and image quality in evaluations of HCC compared to Hybrid IR in abdominal dynamic contrast-enhanced CT.
Collapse
Affiliation(s)
- Naomasa Okimoto
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Koichiro Yasaka
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan.
| | - Masafumi Kaiume
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Noriko Kanemaru
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Yuichi Suzuki
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| | - Osamu Abe
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-Ku, Tokyo, 113-8655, Japan
| |
Collapse
|
26
|
Berbís MA, Paulano Godino F, Royuela del Val J, Alcalá Mata L, Luna A. Clinical impact of artificial intelligence-based solutions on imaging of the pancreas and liver. World J Gastroenterol 2023; 29:1427-1445. [PMID: 36998424 PMCID: PMC10044858 DOI: 10.3748/wjg.v29.i9.1427] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 01/13/2023] [Accepted: 02/27/2023] [Indexed: 03/07/2023] Open
Abstract
Artificial intelligence (AI) has experienced substantial progress over the last ten years in many fields of application, including healthcare. In hepatology and pancreatology, major attention to date has been paid to its application to the assisted or even automated interpretation of radiological images, where AI can generate accurate and reproducible imaging diagnosis, reducing the physicians’ workload. AI can provide automatic or semi-automatic segmentation and registration of the liver and pancreatic glands and lesions. Furthermore, using radiomics, AI can introduce new quantitative information which is not visible to the human eye to radiological reports. AI has been applied in the detection and characterization of focal lesions and diffuse diseases of the liver and pancreas, such as neoplasms, chronic hepatic disease, or acute or chronic pancreatitis, among others. These solutions have been applied to different imaging techniques commonly used to diagnose liver and pancreatic diseases, such as ultrasound, endoscopic ultrasonography, computerized tomography (CT), magnetic resonance imaging, and positron emission tomography/CT. However, AI is also applied in this context to many other relevant steps involved in a comprehensive clinical scenario to manage a gastroenterological patient. AI can also be applied to choose the most convenient test prescription, to improve image quality or accelerate its acquisition, and to predict patient prognosis and treatment response. In this review, we summarize the current evidence on the application of AI to hepatic and pancreatic radiology, not only in regard to the interpretation of images, but also to all the steps involved in the radiological workflow in a broader sense. Lastly, we discuss the challenges and future directions of the clinical application of AI methods.
Collapse
Affiliation(s)
- M Alvaro Berbís
- Department of Radiology, HT Médica, San Juan de Dios Hospital, Córdoba 14960, Spain
- Faculty of Medicine, Autonomous University of Madrid, Madrid 28049, Spain
| | | | | | - Lidia Alcalá Mata
- Department of Radiology, HT Médica, Clínica las Nieves, Jaén 23007, Spain
| | - Antonio Luna
- Department of Radiology, HT Médica, Clínica las Nieves, Jaén 23007, Spain
| |
Collapse
|
27
|
Park HJ, Kim KW, Lee SS. Artificial intelligence in radiology and its application in liver disease. ARTIFICIAL INTELLIGENCE, MACHINE LEARNING, AND DEEP LEARNING IN PRECISION MEDICINE IN LIVER DISEASES 2023:53-79. [DOI: 10.1016/b978-0-323-99136-0.00002-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|
28
|
Bitkina OV, Park J, Kim HK. Application of artificial intelligence in medical technologies: A systematic review of main trends. Digit Health 2023; 9:20552076231189331. [PMID: 37485326 PMCID: PMC10359663 DOI: 10.1177/20552076231189331] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2022] [Accepted: 06/30/2023] [Indexed: 07/25/2023] Open
Abstract
Objective Artificial intelligence (AI) has been increasingly applied in various fields of science and technology. In line with the current research, medicine involves an increasing number of artificial intelligence technologies. The introduction of rapid AI can lead to positive and negative effects. This is a multilateral analytical literature review aimed at identifying the main branches and trends in the use of using artificial intelligence in medical technologies. Methods The total number of literature sources reviewed is n = 89, and they are analyzed based on the literature reporting evidence-based guideline PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) for a systematic review. Results As a result, from the initially selected 198 references, 155 references were obtained from the databases and the remaining 43 sources were found on open internet as direct links to publications. Finally, 89 literature sources were evaluated after exclusion of unsuitable references based on the duplicated and generalized information without focusing on the users. Conclusions This article is identifying the current state of artificial intelligence in medicine and prospects for future use. The findings of this review will be useful for healthcare and AI professionals for improving the circulation and use of medical AI from design to implementation stage.
Collapse
Affiliation(s)
- Olga Vl Bitkina
- Department of Industrial and Management Engineering, Incheon National University, Incheon, Korea
| | - Jaehyun Park
- Department of Industrial and Management Engineering, Incheon National University, Incheon, Korea
| | - Hyun K. Kim
- School of Information Convergence, Kwangwoon University, Seoul, Korea
| |
Collapse
|
29
|
Kotowski K, Kucharski D, Machura B, Adamski S, Gutierrez Becker B, Krason A, Zarudzki L, Tessier J, Nalepa J. Detecting liver cirrhosis in computed tomography scans using clinically-inspired and radiomic features. Comput Biol Med 2023; 152:106378. [PMID: 36512877 DOI: 10.1016/j.compbiomed.2022.106378] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2022] [Revised: 11/21/2022] [Accepted: 11/28/2022] [Indexed: 11/30/2022]
Abstract
Hepatic cirrhosis is an increasing cause of mortality in developed countries-it is the pathological sequela of chronic liver diseases, and the final liver fibrosis stage. Since cirrhosis evolves from the asymptomatic phase, it is of paramount importance to detect it as quickly as possible, because entering the symptomatic phase commonly leads to hospitalization and can be fatal. Understanding the state of the liver based on the abdominal computed tomography (CT) scans is tedious, user-dependent and lacks reproducibility. We tackle these issues and propose an end-to-end and reproducible approach for detecting cirrhosis from CT. It benefits from the introduced clinically-inspired features that reflect the patient's characteristics which are often investigated by experienced radiologists during the screening process. Such features are coupled with the radiomic ones extracted from the liver, and from the suggested region of interest which captures the liver's boundary. The rigorous experiments, performed over two heterogeneous clinical datasets (two cohorts of 241 and 32 patients) revealed that extracting radiomic features from the liver's rectified contour is pivotal to enhance the classification abilities of the supervised learners. Also, capturing clinically-inspired image features significantly improved the performance of such models, and the proposed features were consistently selected as the important ones. Finally, we showed that selecting the most discriminative features leads to the Pareto-optimal models with enhanced feature-level interpretability, as the number of features was dramatically reduced (280×) from thousands to tens.
Collapse
Affiliation(s)
| | | | | | | | - Benjamín Gutierrez Becker
- Roche Pharma Research and Early Development, Informatics, Roche Innovation Center Basel, Basel, Switzerland
| | - Agata Krason
- Roche Pharmaceutical Research and Early Development, Early Clinical Development Oncology, Roche Innovation Center Basel, Basel, Switzerland
| | - Lukasz Zarudzki
- Department of Radiology and Diagnostic Imaging, Maria Skłodowska-Curie National Research Institute of Oncology, Gliwice Branch, Gliwice, Poland
| | - Jean Tessier
- Roche Pharmaceutical Research and Early Development, Early Clinical Development Oncology, Roche Innovation Center Basel, Basel, Switzerland
| | - Jakub Nalepa
- Graylight Imaging, Gliwice, Poland; Department of Algorithmics and Software, Silesian University of Technology, Gliwice, Poland.
| |
Collapse
|
30
|
Wang C, Zheng L, Li Y, Xia S, Lv J, Hu X, Zhan W, Yan F, Li R, Ren X. Noninvasive Assessment of Liver Fibrosis and Inflammation in Chronic Hepatitis B: A Dual-task Convolutional Neural Network (DtCNN) Model Based on Ultrasound Shear Wave Elastography. J Clin Transl Hepatol 2022; 10:1077-1085. [PMID: 36381093 PMCID: PMC9634761 DOI: 10.14218/jcth.2021.00447] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 02/22/2022] [Accepted: 03/03/2022] [Indexed: 12/04/2022] Open
Abstract
BACKGROUND AND AIMS Liver stiffness (LS) measured by shear wave elastography (SWE) is often influenced by hepatic inflammation. The aim was to develop a dual-task convolutional neural network (DtCNN) model for the simultaneous staging of liver fibrosis and inflammation activity using 2D-SWE. METHODS A total of 532 patients with chronic hepatitis B (CHB) were included to develop and validate the DtCNN model. An additional 180 consecutive patients between December 2019 and April 2021 were prospectively included for further validation. All patients underwent 2D-SWE examination and serum biomarker assessment. A DtCNN model containing two pathways for the staging of fibrosis and inflammation was used to improve the classification of significant fibrosis (≥F2), advanced fibrosis (≥F3) as well as cirrhosis (F4). RESULTS Both fibrosis and inflammation affected LS measurements by 2D-SWE. The proposed DtCNN performed the best among all the classification models for fibrosis stage [significant fibrosis AUC=0.89 (95% CI: 0.87-0.92), advanced fibrosis AUC=0.87 (95% CI: 0.84-0.90), liver cirrhosis AUC=0.85 (95% CI: 0.81-0.89)]. The DtCNN-based prediction of inflammation activity achieved AUCs of 0.82 (95% CI: 0.78-0.86) for grade ≥A1, 0.88 (95% CI: 0.85-0.90) grade ≥A2 and 0.78 (95% CI: 0.75-0.81) for grade ≥A3, which were significantly higher than the AUCs of the single-task groups. Similar findings were observed in the prospective study. CONCLUSIONS The proposed DtCNN improved diagnostic performance compared with existing fibrosis staging models by including inflammation in the model, which supports its potential clinical application.
Collapse
Affiliation(s)
- Chengyan Wang
- Human Phenome Institute, Fudan University, Shanghai, China
| | - Lili Zheng
- Ultrasound Department, Ruijin Hospital Wuxi Branch, Shanghai Jiao Tong University School of Medicine, Wuxi, Jiangsu, China
| | - Yan Li
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Shujun Xia
- Ultrasound Department, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Jun Lv
- School of Computer and Control Engineering, Yantai University, Yantai, Shandong, China
| | - Xumei Hu
- Human Phenome Institute, Fudan University, Shanghai, China
| | - Weiwei Zhan
- Ultrasound Department, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Fuhua Yan
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Ruokun Li
- Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Correspondence to: Xinping Ren, Ultrasound Department, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, 197 Ruijin 2 Road, Huangpu District, Shanghai 200020, China. ORCID: https://orcid.org/0000-0002-7999-4065. Tel: +86-18930819785, Fax: +86-31265738, E-mail: ; Ruokun Li, Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, 197 Ruijin 2 Road, Huangpu District, Shanghai 200020, Chian. ORCID: https://orcid.org/0000-0002-6929-0013. Tel: +86-18930819782, Fax: +86-31265443, E-mail:
| | - Xinping Ren
- Ultrasound Department, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
- Correspondence to: Xinping Ren, Ultrasound Department, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, 197 Ruijin 2 Road, Huangpu District, Shanghai 200020, China. ORCID: https://orcid.org/0000-0002-7999-4065. Tel: +86-18930819785, Fax: +86-31265738, E-mail: ; Ruokun Li, Department of Radiology, Ruijin Hospital, Shanghai Jiao Tong University School of Medicine, 197 Ruijin 2 Road, Huangpu District, Shanghai 200020, Chian. ORCID: https://orcid.org/0000-0002-6929-0013. Tel: +86-18930819782, Fax: +86-31265443, E-mail:
| |
Collapse
|
31
|
Yu H, Sharifai N, Jiang K, Wang F, Teodoro G, Farris AB, Kong J. Artificial intelligence based liver portal tract region identification and quantification with transplant biopsy whole-slide images. Comput Biol Med 2022; 150:106089. [PMID: 36137315 DOI: 10.1016/j.compbiomed.2022.106089] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Revised: 08/11/2022] [Accepted: 09/03/2022] [Indexed: 11/24/2022]
Abstract
Liver fibrosis staging is clinically important for liver disease progression prediction. As the portal tract fibrotic quantity and size in a liver biopsy correlate with the fibrosis stage, an accurate analysis of portal tract regions is clinically critical. Manual annotations of portal tract regions, however, are time-consuming and subject to large inter- and intra-observer variability. To address such a challenge, we develop a Multiple Up-sampling and Spatial Attention guided UNet model (MUSA-UNet) to segment liver portal tract regions in whole-slide images of liver tissue slides. To enhance the segmentation performance, we propose to use depth-wise separable convolution, the spatial attention mechanism, the residual connection, and multiple up-sampling paths in the developed model. This study includes 53 histopathology whole slide images from patients who received liver transplantation. In total, 6,012 patches derived from 30 images are used for our deep learning model training and validation. The remaining 23 whole slide images are utilized for the model testing. The average liver portal tract segmentation performance of the developed MUSA-UNet is 0.94 (Precision), 0.85 (Recall), 0.89 (F1 Score), 0.89 (Accuracy), 0.80 (Jaccard Index), and 0.91 (Fowlkes-Mallows Index), respectively. The clinical Scheuer fibrosis stage presents a strong correlation with the resulting average portal tract fibrotic area (R = 0.681, p<0.001) and portal tract percentage (R = 0.335, p = 0.02) computed from the MUSA-UNet segmentation results. In conclusion, our developed deep learning model MUSA-UNet can accurately segment portal tract regions from whole-slide images of liver tissue biopsies, presenting its promising potential to assist liver disease diagnosis in a computational manner.
Collapse
Affiliation(s)
- Hanyi Yu
- Department of Computer Science, Emory University, Atlanta, 30322, GA, USA.
| | - Nima Sharifai
- Department of Pathology, University of Maryland School of Medicine, Baltimore, 21201, MD, USA.
| | - Kun Jiang
- Department of Pathology, Moffitt Cancer Center, Tampa, 33612, FL, USA.
| | - Fusheng Wang
- Department of Computer Science and Department of Biomedical Informatics, Stony Brook University, Stony Brook, 11794, NY, USA.
| | - George Teodoro
- Department of Computer Science, Federal University of Minas Gerais, Belo Horizonte, 31270, Minas Gerais, Brazil.
| | - Alton B Farris
- Department of Pathology and Laboratory Medicine, Emory University, Atlanta, 30322, GA, USA.
| | - Jun Kong
- Department of Computer Science, Emory University, Atlanta, 30322, GA, USA; Department of Mathematics and Statistics, Georgia State University, Atlanta, 30303, GA, USA; Winship Cancer Institute, Emory University, Atlanta, 30322, GA, USA.
| |
Collapse
|
32
|
Im WH, Song JS, Jang W. Noninvasive staging of liver fibrosis: review of current quantitative CT and MRI-based techniques. Abdom Radiol (NY) 2022; 47:3051-3067. [PMID: 34228199 DOI: 10.1007/s00261-021-03181-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2021] [Revised: 06/12/2021] [Accepted: 06/14/2021] [Indexed: 01/18/2023]
Abstract
Liver fibrosis features excessive protein accumulation in the liver interstitial space resulting from repeated tissue injury due to chronic liver disease. Liver fibrosis eventually proceeds to cirrhosis and associated complications. So, early diagnosis and staging of liver fibrosis are of vital importance for clinical treatment. Liver biopsy remains the gold standard for the diagnosing and staging of fibrosis, but it is suboptimal due to various limitations. Recently, efforts have been made to migrate toward noninvasive techniques for assessing liver fibrosis. CT is relatively easy to perform, relatively standardized for different scanners, and does not require additional hardware in liver fibrosis staging. MRI is frequently performed to characterize indeterminate liver lesions. Because it does not use ionizing radiation and features high image contrast, its role has increased in the staging of liver fibrosis. More recently, several studies on liver fibrosis staging using deep learning algorithms in CT or MRI have been proposed and have shown meaningful results. In this review, we summarize the basic concept, diagnostic performance, and advantages and limitations of each technique to noninvasively stage liver fibrosis.
Collapse
Affiliation(s)
- Won Hyeong Im
- Department of Radiology, The 3rd Flying Training Wing, Sacheon, 52516, South Korea
| | - Ji Soo Song
- Department of Radiology, Jeonbuk National University Medical School and Hospital, 20 Geonji-ro, Deokjin-gu, Jeonju, 54907, Jeonbuk, South Korea.
- Research Institute of Clinical Medicine of Jeonbuk National University, Jeonju, South Korea.
- Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, South Korea.
| | - Weon Jang
- Department of Radiology, Jeonbuk National University Medical School and Hospital, 20 Geonji-ro, Deokjin-gu, Jeonju, 54907, Jeonbuk, South Korea
- Research Institute of Clinical Medicine of Jeonbuk National University, Jeonju, South Korea
- Biomedical Research Institute of Jeonbuk National University Hospital, Jeonju, South Korea
| |
Collapse
|
33
|
Cao Q, Mao Y, Qin L, Quan G, Yan F, Yang W. Improving image quality and lung nodule detection for low-dose chest CT by using generative adversarial network reconstruction. Br J Radiol 2022; 95:20210125. [PMID: 35994298 PMCID: PMC9815729 DOI: 10.1259/bjr.20210125] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2021] [Revised: 04/01/2022] [Accepted: 07/21/2022] [Indexed: 01/13/2023] Open
Abstract
OBJECTIVES To investigate the improvement of two denoising models with different learning targets (Dir and Res) of generative adversarial network (GAN) on image quality and lung nodule detectability in chest low-dose CT (LDCT). METHODS In training phase, by using LDCT images simulated from standard dose CT (SDCT) of 200 participants, Dir model was trained targeting SDCT images, while Res model targeting the residual between SDCT and LDCT images. In testing phase, a phantom and 95 chest LDCT, exclusively with training data, were included for evaluation of imaging quality and pulmonary nodules detectability. RESULTS For phantom images, structural similarity, peak signal-to-noise ratio of both Res and Dir models were higher than that of LDCT. Standard deviation of Res model was the lowest. For patient images, image noise and quality of both two models, were better than that of LDCT. Artifacts of Res model was less than that of LDCT. The diagnostic sensitivity of lung nodule by two readers for LDCT, Res and Dir model, were 72/77%, 79/83% and 72/79% respectively. CONCLUSION Two GAN denoising models, including Res and Dir trained with different targets, could effectively reduce image noise of chest LDCT. The image quality evaluation scoring and nodule detectability of Res denoising model was better than that of Dir denoising model and that of hybrid IR images. ADVANCES IN KNOWLEDGE The GAN-trained model, which learned the residual between SDCT and LDCT images, reduced image noise and increased the lung nodule detectability by radiologists on chest LDCT. This demonstrates the potential for clinical benefit.
Collapse
Affiliation(s)
- Qiqi Cao
- Department of Radiology, Ruijin Hospital affiliated to School of Medicine, Shanghai Jiao Tong University, Shanghai Jiao Tong, China
| | - Yifu Mao
- Department of CT reconstruction physics algorithm, Shanghai United Imaging Healthcare Co., Ltd, Shanghai, China
| | - Le Qin
- Department of Radiology, Ruijin Hospital affiliated to School of Medicine, Shanghai Jiao Tong University, Shanghai Jiao Tong, China
| | - Guotao Quan
- Department of CT reconstruction physics algorithm, Shanghai United Imaging Healthcare Co., Ltd, Shanghai, China
| | - Fuhua Yan
- Department of Radiology, Ruijin Hospital affiliated to School of Medicine, Shanghai Jiao Tong University, Shanghai Jiao Tong, China
| | - Wenjie Yang
- Department of Radiology, Ruijin Hospital affiliated to School of Medicine, Shanghai Jiao Tong University, Shanghai Jiao Tong, China
| |
Collapse
|
34
|
Deep learning reconstruction for the evaluation of neuroforaminal stenosis using 1.5T cervical spine MRI: comparison with 3T MRI without deep learning reconstruction. Neuroradiology 2022; 64:2077-2083. [PMID: 35918450 DOI: 10.1007/s00234-022-03024-6] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 07/23/2022] [Indexed: 10/16/2022]
Abstract
PURPOSE To compare image quality and interobserver agreement in evaluations of neuroforaminal stenosis between 1.5T cervical spine magnetic resonance imaging (MRI) with deep learning reconstruction (DLR) and 3T MRI without DLR. METHODS In this prospective study, 21 volunteers (mean age: 42.4 ± 11.9 years; 17 males) underwent cervical spine T2-weighted sagittal 1.5T and 3T MRI on the same day. The 1.5T and 3T MRI data were used to reconstruct images with (1.5T-DLR) and without (3T-nonDLR) DLR, respectively. Regions of interest were marked on the spinal cord to calculate non-uniformity (NU; standard deviation/signal intensity × 100), as an indicator of image noise. Two blinded radiologists evaluated the images in terms of the depiction of structures, artifacts, noise, overall image quality, and neuroforaminal stenosis. The NU value and the subjective image quality scores were compared between 1.5T-DLR and 3T-nonDLR using the Wilcoxon signed-rank test. Interobserver agreement in evaluations of neuroforaminal stenosis for 1.5T-DLR and 3T-nonDLR was evaluated using Cohen's weighted kappa analysis. RESULTS The NU value for 1.5T-DLR was 8.4, which was significantly better than that for 3T-nonDLR (10.3; p < 0.001). Subjective image scores were significantly better for 1.5T-DLR than 3T-nonDLR images (p < 0.037). Interobserver agreement (95% confidence intervals) in the evaluations of neuroforaminal stenosis was significantly superior for 1.5T-DLR (0.920 [0.916-0.924]) than 3T-nonDLR (0.894 [0.889-0.898]). CONCLUSION By using DLR, image quality and interobserver agreement in evaluations of neuroforaminal stenosis on 1.5T cervical spine MRI could be improved compared to 3T MRI without DLR.
Collapse
|
35
|
Tajima T, Akai H, Sugawara H, Furuta T, Yasaka K, Kunimatsu A, Yoshioka N, Akahane M, Abe O, Ohtomo K, Kiryu S. Feasibility of accelerated whole-body diffusion-weighted imaging using a deep learning-based noise-reduction technique in patients with prostate cancer. Magn Reson Imaging 2022; 92:169-179. [PMID: 35772583 DOI: 10.1016/j.mri.2022.06.014] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2022] [Revised: 06/04/2022] [Accepted: 06/23/2022] [Indexed: 11/25/2022]
Abstract
PURPOSE To assess the possibility of reducing the image acquisition time for diffusion-weighted whole-body imaging with background body signal suppression (DWIBS) by denoising with deep learning-based reconstruction (dDLR). METHODS Seventeen patients with prostate cancer who underwent DWIBS by 1.5 T magnetic resonance imaging with a number of excitations of 2 (NEX2) and 8 (NEX8) were prospectively enrolled. The NEX2 image data were processed by dDLR (dDLR-NEX2), and the NEX2, dDLR-NEX2, and NEX8 image data were analyzed. In qualitative analysis, two radiologists rated the perceived coarseness, conspicuity of metastatic lesions (lymph nodes and bone), and overall image quality. The contrast-to-noise ratios (CNRs), contrast ratios, and mean apparent diffusion coefficients (ADCs) of metastatic lesions were calculated in a quantitative analysis. RESULTS The image acquisition time of NEX2 was 2.8 times shorter than that of NEX8 (3 min 30 s vs 9 min 48 s). The perceived coarseness and overall image quality scores reported by both readers were significantly higher for dDLR-NEX2 than for NEX2 (P = 0.005-0.040). There was no significant difference between dDLR-NEX2 and NEX8 in the qualitative analysis. The CNR of bone metastasis was significantly greater for dDLR-NEX2 than for NEX2 and NEX8 (P = 0.012 for both comparisons). The contrast ratios and mean ADCs were not significantly different among the three image types. CONCLUSIONS dDLR improved the image quality of DWIBS with NEX2. In the context of lymph node and bone metastasis evaluation with DWIBS in patients with prostate cancer, dDLR-NEX2 has potential to be an alternative to NEX8 and reduce the image acquisition time.
Collapse
Affiliation(s)
- Taku Tajima
- Department of Radiology, International University of Health and Welfare Mita Hospital, 1-4-3 Mita, Minato-ku, Tokyo 108-8329, Japan; Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan
| | - Hiroyuki Akai
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan; Department of Radiology, The Institute of Medical Science, The University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo 108-8639, Japan
| | - Haruto Sugawara
- Department of Radiology, The Institute of Medical Science, The University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo 108-8639, Japan
| | - Toshihiro Furuta
- Department of Radiology, The Institute of Medical Science, The University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo 108-8639, Japan
| | - Koichiro Yasaka
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan; Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Akira Kunimatsu
- Department of Radiology, International University of Health and Welfare Mita Hospital, 1-4-3 Mita, Minato-ku, Tokyo 108-8329, Japan
| | - Naoki Yoshioka
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan
| | - Masaaki Akahane
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan
| | - Osamu Abe
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Kuni Ohtomo
- International University of Health and Welfare, 2600-1 kitakanamaru, Otawara, Tochigi 324-8501, Japan
| | - Shigeru Kiryu
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan.
| |
Collapse
|
36
|
Wang J, Tang S, Mao Y, Wu J, Xu S, Yue Q, Chen J, He J, Yin Y. Radiomics analysis of contrast-enhanced CT for staging liver fibrosis: an update for image biomarker. Hepatol Int 2022; 16:627-639. [PMID: 35347597 PMCID: PMC9174317 DOI: 10.1007/s12072-022-10326-7] [Citation(s) in RCA: 30] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/01/2021] [Accepted: 03/03/2022] [Indexed: 02/08/2023]
Abstract
BACKGROUND To establish and validate a radiomics-based model for staging liver fibrosis at contrast-enhanced CT images. MATERIALS AND METHODS This retrospective study developed two radiomics-based models (R-score: radiomics signature; R-fibrosis: integrate radiomic and serum variables) in a training cohort of 332 patients (median age, 59 years; interquartile range, 51-67 years; 256 men) with biopsy-proven liver fibrosis who underwent contrast-enhanced CT between January 2017 and December 2020. Radiomic features were extracted from non-contrast, arterial and portal phase CT images and selected using the least absolute shrinkage and selection operator (LASSO) logistic regression to differentiate stage F3-F4 from stage F0-F2. Optimal cutoffs to diagnose significant fibrosis (stage F2-F4), advanced fibrosis (stage F3-F4) and cirrhosis (stage F4) were determined by receiver operating characteristic curve analysis. Diagnostic performance was evaluated by area under the curve, Obuchowski index, calibrations and decision curve analysis. An internal validation was conducted in 111 randomly assigned patients (median age, 58 years; interquartile range, 49-66 years; 89 men). RESULTS In the validation cohort, R-score and R-fibrosis (Obuchowski index, 0.843 and 0.846, respectively) significantly outperformed aspartate transaminase-to-platelet ratio (APRI) (Obuchowski index, 0.651; p < .001) and fibrosis-4 index (FIB-4) (Obuchowski index, 0.676; p < .001) for staging liver fibrosis. Using the cutoffs, R-fibrosis and R-score had a sensitivity range of 70-87%, specificity range of 71-97%, and accuracy range of 82-86% in diagnosing significant fibrosis, advanced fibrosis and cirrhosis. CONCLUSION Radiomic analysis of contrast-enhanced CT images can reach great diagnostic performance of liver fibrosis.
Collapse
Affiliation(s)
- Jincheng Wang
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University, Nanjing, China
- Preparatory School for Chinese Students To Japan, The Training Center of Ministry of Education for Studying Overseas, Changchun, China
| | - Shengnan Tang
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
| | - Yingfan Mao
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
| | - Jin Wu
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
| | - Shanshan Xu
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China
| | - Qi Yue
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University, Nanjing, China
| | - Jun Chen
- Department of Pathology, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, Nanjing, China
| | - Jian He
- Department of Nuclear Medicine, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China.
| | - Yin Yin
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital, The Affiliated Hospital of Nanjing University Medical School, 321 Zhongshan Road, Nanjing, 210008, Jiangsu Province, China.
- Department of Hepatobiliary Surgery, Nanjing Drum Tower Hospital Clinical College of Nanjing Medical University, Nanjing, China.
| |
Collapse
|
37
|
Balachandran YL, Wang W, Yang H, Tong H, Wang L, Liu F, Chen H, Zhong K, Liu Y, Jiang X. Heterogeneous Iron Oxide/Dysprosium Oxide Nanoparticles Target Liver for Precise Magnetic Resonance Imaging of Liver Fibrosis. ACS NANO 2022; 16:5647-5659. [PMID: 35312295 DOI: 10.1021/acsnano.1c10618] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Challenges remain in precisely diagnosing the progress of liver fibrosis in a noninvasive way. We here synthesized small (4 nm) heterogeneous iron oxide/dysprosium oxide nanoparticles (IO-DyO NPs) as a contrast agent (CA) for magnetic resonance imaging (MRI) to precisely diagnose liver fibrosis in vivo at both 7.0 and 9.4 T field strength. Our IO-DyO NPs can target the liver and show an increased T2 relaxivity along with an increase of magnetic field strength. At a ultrahigh magnetic field, IO-DyO NPs can significantly improve spatial/temporal image resolution and signal-to-noise ratio of the liver and precisely distinguish the early and moderate liver fibrosis stages. Our IO-DyO NP-based MRI diagnosis can exactly match biopsy (a gold standard for liver fibrosis diagnosis in the clinic) but avoid the invasiveness of biopsy. Moreover, our IO-DyO NPs show satisfactory biosafety in vitro and in vivo. This work illustrates an advanced T2 CA used in ultrahigh-field MRI (UHFMRI) for the precise diagnosis of liver fibrosis via a noninvasive means.
Collapse
Affiliation(s)
- Yekkuni L Balachandran
- Shenzhen Key Laboratory of Smart Healthcare Engineering, Department of Biomedical Engineering, Southern University of Science and Technology, No. 1088 Xueyuan Rd, Nanshan District, Shenzhen, Guangdong 518055, China
| | - Wei Wang
- Peking University People's Hospital, Peking University Hepatology Institute, Beijing Key Laboratory of Hepatitis C and Immunotherapy for Liver Diseases, Beijing International Cooperation Base for Science and Technology on NAFLD Diagnosis, Beijing 100044, China
| | - Hongyi Yang
- High Field Magnetic Laboratory, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China
| | - Haiyang Tong
- High Field Magnetic Laboratory, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China
| | - Lulu Wang
- High Field Magnetic Laboratory, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China
| | - Feng Liu
- Peking University People's Hospital, Peking University Hepatology Institute, Beijing Key Laboratory of Hepatitis C and Immunotherapy for Liver Diseases, Beijing International Cooperation Base for Science and Technology on NAFLD Diagnosis, Beijing 100044, China
| | - Hongsong Chen
- Peking University People's Hospital, Peking University Hepatology Institute, Beijing Key Laboratory of Hepatitis C and Immunotherapy for Liver Diseases, Beijing International Cooperation Base for Science and Technology on NAFLD Diagnosis, Beijing 100044, China
| | - Kai Zhong
- High Field Magnetic Laboratory, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China
| | - Ye Liu
- Institute of Medical Biology, Chinese Academy of Medical Sciences and Peking Union Medical College, Kunming, Yunnan 650000, China
| | - Xingyu Jiang
- Shenzhen Key Laboratory of Smart Healthcare Engineering, Department of Biomedical Engineering, Southern University of Science and Technology, No. 1088 Xueyuan Rd, Nanshan District, Shenzhen, Guangdong 518055, China
| |
Collapse
|
38
|
Clinical feasibility of an abdominal thin-slice breath-hold single-shot fast spin echo sequence processed using a deep learning-based noise-reduction approach. Magn Reson Imaging 2022; 90:76-83. [DOI: 10.1016/j.mri.2022.04.005] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2022] [Revised: 03/04/2022] [Accepted: 04/26/2022] [Indexed: 11/21/2022]
|
39
|
Deep learning reconstruction for 1.5 T cervical spine MRI: effect on interobserver agreement in the evaluation of degenerative changes. Eur Radiol 2022; 32:6118-6125. [DOI: 10.1007/s00330-022-08729-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/04/2021] [Revised: 02/23/2022] [Accepted: 03/07/2022] [Indexed: 12/22/2022]
|
40
|
Taha A, Ochs V, Kayhan LN, Enodien B, Frey DM, Krähenbühl L, Taha-Mehlitz S. Advancements of Artificial Intelligence in Liver-Associated Diseases and Surgery. MEDICINA (KAUNAS, LITHUANIA) 2022; 58:medicina58040459. [PMID: 35454298 PMCID: PMC9029673 DOI: 10.3390/medicina58040459] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 03/14/2022] [Accepted: 03/18/2022] [Indexed: 02/06/2023]
Abstract
Background and Objectives: The advancement of artificial intelligence (AI) based technologies in medicine is progressing rapidly, but the majority of its real-world applications has not been implemented. The establishment of an accurate diagnosis with treatment has now transitioned into an artificial intelligence era, which has continued to provide an amplified understanding of liver cancer as a disease and helped to proceed better with the method of procurement. This article focuses on reviewing the AI in liver-associated diseases and surgical procedures, highlighting its development, use, and related counterparts. Materials and Methods: We searched for articles regarding AI in liver-related ailments and surgery, using the keywords (mentioned below) on PubMed, Google Scholar, Scopus, MEDLINE, and Cochrane Library. Choosing only the common studies suggested by these libraries, we segregated the matter based on disease. Finally, we compiled the essence of these articles under the various sub-headings. Results: After thorough review of articles, it was observed that there was a surge in the occurrence of liver-related surgeries, diagnoses, and treatments. Parallelly, advanced computer technologies governed by AI continue to prove their efficacy in the accurate screening, analysis, prediction, treatment, and recuperation of liver-related cases. Conclusions: The continual developments and high-order precision of AI is expanding its roots in all directions of applications. Despite being novel and lacking research, AI has shown its intrinsic worth for procedures in liver surgery while providing enhanced healing opportunities and personalized treatment for liver surgery patients.
Collapse
Affiliation(s)
- Anas Taha
- Department of Biomedical Engineering, Faculty of Medicine, University of Basel, 4123 Allschwil, Switzerland
- Correspondence:
| | - Vincent Ochs
- Roche Innovation Center Basel, Department of Pharma Research & Early Development, 4070 Basel, Switzerland;
| | - Leos N. Kayhan
- Department of Surgery, Canntonal Hospital Luzern, 6004 Luzern, Switzerland;
| | - Bassey Enodien
- Department of Surgery, Wetzikon Hospital, 8620 Wetzikon, Switzerland; (B.E.); (D.M.F.)
| | - Daniel M. Frey
- Department of Surgery, Wetzikon Hospital, 8620 Wetzikon, Switzerland; (B.E.); (D.M.F.)
| | | | - Stephanie Taha-Mehlitz
- Clarunis, University Centre for Gastrointestinal and Liver Diseases, St. Clara Hospital and University Hospital Basel, 4002 Basel, Switzerland;
| |
Collapse
|
41
|
Wu L, Ning B, Yang J, Chen Y, Zhang C, Yan Y. Diagnosis of Liver Cirrhosis and Liver Fibrosis by Artificial Intelligence Algorithm-Based Multislice Spiral Computed Tomography. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2022; 2022:1217003. [PMID: 35341007 PMCID: PMC8941514 DOI: 10.1155/2022/1217003] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/12/2022] [Revised: 02/19/2022] [Accepted: 02/22/2022] [Indexed: 12/12/2022]
Abstract
This research was aimed at investigating the artificial intelligence (AI) segmentation algorithm-based multislice spiral computed tomography (MSCT) in the diagnosis of liver cirrhosis and liver fibrosis. Besides, it was aimed at providing new methods for the diagnosis of liver cirrhosis and liver fibrosis. All patients were divided into the control group, mild liver fibrosis group, and significant liver fibrosis group. A total of 112 patients were included, with 40 cases in the mild liver fibrosis group, 48 cases in the significant liver fibrosis group, and 24 cases who underwent computed tomography (CT) examination in the control group. In the research, deconvolution algorithm of AI segmentation algorithm was adopted to process the images. The average hepatic arterial fraction (HAF) values of patients in the control group, mild liver fibrosis group, and severe liver fibrosis group were 17.59 ± 10.03%, 18.23 ± 5.57%, and 20.98 ± 6.63%, respectively. The average MTT values of patients in the control group, mild liver fibrosis group, and severe liver fibrosis group were 12.69 ± 1.78S, 12.53 ± 2.05S, and 12.04 ± 1.57S, respectively. The average blood flow (BF) values of patients in the control group, mild liver fibrosis group, and severe liver fibrosis group were 105.68 ± 15.57 mL 100 g-1·min-1, 116.07 ± 16.5 mL·100 g-1·min-1, and 110.39 ± 16.32 mL·100 g-1·min-1, respectively. Besides, the average blood volume (BV) values of patients in the control group, mild liver fibrosis group, and significant liver fibrosis group were 15.69 ± 4.35 mL·log-1, 16.97 ± 2.68 mL·log-1, and 16.11 ± 4.87 mL·100 g-1, respectively. According to statistics, the differences among the average HAF, MTT, BF, and BV values showed no statistical meaning. AI segmentation algorithm-based MSCT imaging could promote the diagnosis of liver cirrhosis and liver fibrosis effectively and offer new methods to clinical diagnosis of liver cirrhosis and liver fibrosis.
Collapse
Affiliation(s)
- Liexiu Wu
- Department of Infectious Disease, Baoji Central Hospital, Baoji, 721008 Shaanxi, China
| | - Bo Ning
- Department of Infectious Disease, Baoji Central Hospital, Baoji, 721008 Shaanxi, China
| | - Jianjun Yang
- Department of Infectious Disease, Baoji Central Hospital, Baoji, 721008 Shaanxi, China
| | - Yanni Chen
- Department of Immunization Plan, Disease Control and Prevention of Yulin Center, Yulin, 719000 Shaanxi, China
| | - Caihong Zhang
- Department of Health, Disease Control and Prevention of Yulin Center, Yulin, 719000 Shaanxi, China
| | - Yun Yan
- Department of Chronic Disease Control, Yulin City Center for Disease Control and Prevention, Yulin, 719000 Shaanxi, China
| |
Collapse
|
42
|
Venkatesh SK, Torbenson MS. Liver fibrosis quantification. Abdom Radiol (NY) 2022; 47:1032-1052. [PMID: 35022806 PMCID: PMC9538706 DOI: 10.1007/s00261-021-03396-y] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Revised: 12/19/2021] [Accepted: 12/20/2021] [Indexed: 12/14/2022]
Abstract
Liver fibrosis (LF) is the wound healing response to chronic liver injury. LF is the endpoint of chronic liver disease (CLD) regardless of etiology and the single most important determinant of long-term liver-related clinical outcomes. Quantification of LF is important for staging, to evaluate response to treatment and to predict outcomes. LF is traditionally staged by liver biopsy. However, liver biopsy is invasive and suffers from sampling errors when biopsy size is inadequate; therefore, non-invasive tests (NITs) have found important roles in clinical care. NITs include simple laboratory-based serum tests, panels of serum tests, and imaging biomarkers. NITs are validated against the liver biopsy and will be used in the future for evaluation of nearly all CLDs with invasive liver biopsy reserved for some cases. Both serum tests and some imaging biomarkers such as elastography are currently used clinically as surrogate markers for LF. Several other imaging biomarkers are still considered research and awaiting clinical application in the future. As the evaluation of imaging biomarkers will likely become the norm in the future, understanding pathogenesis of LF is important. Knowledge of properties measured by imaging biomarkers and its correlation with LF is important to understand the application of NITs by abdominal radiologists. In this review, we present a brief overview of pathogenesis of LF, spatiotemporal evolution of LF in different CLD, and severity assessment with liver biopsy. This will be followed by a brief discussion on properties measured by imaging biomarkers and their relationship to the LF.
Collapse
Affiliation(s)
- Sudhakar K Venkatesh
- Abdominal Imaging Division, Department of Radiology, Mayo Clinic, 200, First Street SW, Rochester, MN, 55905, USA.
| | - Michael S Torbenson
- Anatomic Pathology Division, Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
43
|
Balsano C, Alisi A, Brunetto MR, Invernizzi P, Burra P, Piscaglia F. The application of artificial intelligence in hepatology: A systematic review. Dig Liver Dis 2022; 54:299-308. [PMID: 34266794 DOI: 10.1016/j.dld.2021.06.011] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Revised: 06/04/2021] [Accepted: 06/07/2021] [Indexed: 02/06/2023]
Abstract
The integration of human and artificial intelligence (AI) in medicine has only recently begun but it has already become obvious that intelligent systems can dramatically improve the management of liver diseases. Big data made it possible to envisage transformative developments of the use of AI for diagnosing, predicting prognosis and treating liver diseases, but there is still a lot of work to do. If we want to achieve the 21st century digital revolution, there is an urgent need for specific national and international rules, and to adhere to bioethical parameters when collecting data. Avoiding misleading results is essential for the effective use of AI. A crucial question is whether it is possible to sustain, technically and morally, the process of integration between man and machine. We present a systematic review on the applications of AI to hepatology, highlighting the current challenges and crucial issues related to the use of such technologies.
Collapse
Affiliation(s)
- Clara Balsano
- Dept. of Life, Health and Environmental Sciences MESVA, University of L'Aquila, Piazza S. Salvatore Tommasi 1, 67100, Coppito, L'Aquila. Italy; Francesco Balsano Foundation, Via Giovanni Battista Martini 6, 00198, Rome, Italy.
| | - Anna Alisi
- Research Unit of Molecular Genetics of Complex Phenotypes, Bambino Gesù Children's Hospital, IRCCS, Rome, Italy
| | - Maurizia R Brunetto
- Hepatology Unit and Laboratory of Molecular Genetics and Pathology of Hepatitis Viruses, University Hospital of Pisa, Pisa, Italy
| | - Pietro Invernizzi
- Division of Gastroenterology and Center of Autoimmune Liver Diseases, Department of Medicine and Surgery, San Gerardo Hospital, University of Milano, Bicocca, Italy
| | - Patrizia Burra
- Multivisceral Transplant Unit, Department of Surgery, Oncology, Gastroenterology, Padua University Hospital, Padua, Italy
| | - Fabio Piscaglia
- Division of Internal Medicine, IRCCS Azienda Ospedaliero Universitaria di Bologna, Bologna, Italy
| |
Collapse
|
44
|
Li Q, Kang H, Zhang R, Guo Q. Non-invasive precise staging of liver fibrosis using deep residual network model based on plain CT images. Int J Comput Assist Radiol Surg 2022; 17:627-637. [PMID: 35194737 DOI: 10.1007/s11548-022-02573-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2021] [Accepted: 01/26/2022] [Indexed: 12/11/2022]
Abstract
PURPOSE The aim of this study was to explore the application of five-class deep residual network models based on plain CT images and clinical features for the precise staging of liver fibrosis. METHODS This retrospective clinical study included 347 patients who underwent liver CT, with pathological staging of liver fibrosis as the gold standard. We established three ResNet models to stage liver fibrosis. The output diagnosis labels of models were 0, 1, 2, 3 and 4, which correspond to F0, F1, F2, F3, and F4 stages. Confusion matrices were used to evaluate the performances of models to precisely stage liver fibrosis. The performance for diagnosing cirrhosis (F4), advanced fibrosis (≥ F3) and significant fibrosis (≥ F2) of models was evaluated with receiver operating characteristic (ROC) analyses. RESULTS The kappa coefficients of the five-class ResNet model (based on plain CT images), the five-class ResNet clinical model (based on clinical features), and the five-class mixed ResNet model (based on plain CT images and clinical features) for precise staging liver fibrosis were 0.566, 0.306, and 0.63, respectively. The recall rates and precision rates for F0, F1, F2, and F3 of three models were lower than 60%. The ROC AUC values of the five-class ResNet model, the five-class ResNet clinical model, and the five-class mixed ResNet model for diagnosing cirrhosis, advanced fibrosis, and significant fibrosis were 0.95, 0.88, and 0.82, 0.80, 0.72, and 0.70, 0.95, 0.90, and 0.83, respectively. CONCLUSIONS The five-class ResNet models are of high value in the diagnosis of liver cirrhosis, advanced liver fibrosis, and significant liver fibrosis. However, for the precise staging of liver fibrosis, the models cannot accurately distinguish other liver fibrosis stages except F4. Plain CT images combined with clinical features have the potential to improve the performance of the ResNet models in diagnosing liver fibrosis.
Collapse
Affiliation(s)
- Qiuju Li
- Department of Radiology, Shengjing Hospital of China Medical University, No. 36, Sanhao Street, Heping District, Shenyang, Liaoning, China
| | - Han Kang
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd., Beijing, China
| | - Rongguo Zhang
- Institute of Advanced Research, Infervision Medical Technology Co., Ltd., Beijing, China
| | - Qiyong Guo
- Department of Radiology, Shengjing Hospital of China Medical University, No. 36, Sanhao Street, Heping District, Shenyang, Liaoning, China.
| |
Collapse
|
45
|
Combining Hepatic and Splenic CT Radiomic Features Improves Radiomic Analysis Performance for Liver Fibrosis Staging. Diagnostics (Basel) 2022; 12:diagnostics12020550. [PMID: 35204639 PMCID: PMC8870954 DOI: 10.3390/diagnostics12020550] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2022] [Revised: 02/09/2022] [Accepted: 02/17/2022] [Indexed: 02/05/2023] Open
Abstract
Background: The exact focus of computed tomography (CT)-based artificial intelligence techniques when staging liver fibrosis is still not exactly known. This study aimed to determine both the added value of splenic information to hepatic information, and the correlation between important radiomic features and information exploited by deep learning models for liver fibrosis staging by CT-based radiomics. Methods: The study design is retrospective. Radiomic features were extracted from both liver and spleen on portal venous phase CT images of 252 consecutive patients with histologically proven liver fibrosis stages between 2006 and 2018. The radiomics analyses for liver fibrosis staging were done by hepatic and hepatic–splenic features, respectively. The most predictive radiomic features were automatically selected by machine learning models. Results: When using splenic–hepatic features in the CT-based radiomics analysis, the average accuracy rates for significant fibrosis, advanced fibrosis, and cirrhosis were 88%, 82%, and 86%, and area under the receiver operating characteristic curves (AUCs) were 0.92, 0.81, and 0.85. The AUC of hepatic–splenic-based radiomics analysis with the ensemble classifier was 7% larger than that of hepatic-based analysis (p < 0.05). The most important features selected by machine learning models included both hepatic and splenic features, and they were consistent with the location maps indicating the focus of deep learning when predicting liver fibrosis stage. Conclusions: Adding CT-based splenic radiomic features to hepatic radiomic features increases radiomics analysis performance for liver fibrosis staging. The most important features of the radiomics analysis were consistent with the information exploited by deep learning.
Collapse
|
46
|
Yasaka K, Akai H, Sugawara H, Tajima T, Akahane M, Yoshioka N, Kabasawa H, Miyo R, Ohtomo K, Abe O, Kiryu S. Impact of deep learning reconstruction on intracranial 1.5 T magnetic resonance angiography. Jpn J Radiol 2021; 40:476-483. [PMID: 34851499 PMCID: PMC9068615 DOI: 10.1007/s11604-021-01225-2] [Citation(s) in RCA: 32] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2021] [Accepted: 11/21/2021] [Indexed: 12/22/2022]
Abstract
Purpose The purpose of this study was to evaluate whether deep learning reconstruction (DLR) improves the image quality of intracranial magnetic resonance angiography (MRA) at 1.5 T. Materials and methods In this retrospective study, MRA images of 40 patients (21 males and 19 females; mean age, 65.8 ± 13.2 years) were reconstructed with and without the DLR technique (DLR image and non-DLR image, respectively). Quantitative image analysis was performed by placing regions of interest on the basilar artery and cerebrospinal fluid in the prepontine cistern. We calculated the signal-to-noise ratio (SNR) and contrast-to-noise ratio (CNR) for analyses of the basilar artery. Two experienced radiologists evaluated the depiction of structures (the right internal carotid artery, right ophthalmic artery, basilar artery, and right superior cerebellar artery), artifacts, subjective noise and overall image quality in a qualitative image analysis. Scores were compared in the quantitative and qualitative image analyses between the DLR and non-DLR images using Wilcoxon signed-rank tests. Results The SNR and CNR for the basilar artery were significantly higher for the DLR images than for the non-DLR images (p < 0.001). Qualitative image analysis scores (p < 0.003 and p < 0.005 for readers 1 and 2, respectively), excluding those for artifacts (p = 0.072–0.565), were also significantly higher for the DLR images than for the non-DLR images. Conclusion DLR enables the production of higher quality 1.5 T intracranial MRA images with improved visualization of arteries.
Collapse
Affiliation(s)
- Koichiro Yasaka
- Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan.,Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba, 286-8520, Japan
| | - Hiroyuki Akai
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba, 286-8520, Japan.,Department of Radiology, The Institute of Medical Science, The University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo, 108-8639, Japan
| | - Haruto Sugawara
- Department of Radiology, The Institute of Medical Science, The University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo, 108-8639, Japan
| | - Taku Tajima
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba, 286-8520, Japan.,Department of Radiology, International University of Health and Welfare Mita Hospital, 1-4-3 Mita, Minato-ku, Tokyo, 108-8329, Japan
| | - Masaaki Akahane
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba, 286-8520, Japan
| | - Naoki Yoshioka
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba, 286-8520, Japan
| | - Hiroyuki Kabasawa
- Department of Radiological Sciences, School of Health Sciences at Narita, International University of Health and Welfare, 4-3 Kozunomori, Chiba, 286-8686, Japan
| | - Rintaro Miyo
- Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Kuni Ohtomo
- International University of Health and Welfare, 2600-1 kitakanamaru, Otawara, Tochigi, 324-8501, Japan
| | - Osamu Abe
- Department of Radiology, The University of Tokyo Hospital, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8655, Japan
| | - Shigeru Kiryu
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba, 286-8520, Japan.
| |
Collapse
|
47
|
Tajima T, Akai H, Sugawara H, Yasaka K, Kunimatsu A, Yoshioka N, Akahane M, Ohtomo K, Abe O, Kiryu S. Breath-hold 3D magnetic resonance cholangiopancreatography at 1.5 T using a deep learning-based noise-reduction approach: Comparison with the conventional respiratory-triggered technique. Eur J Radiol 2021; 144:109994. [PMID: 34627106 DOI: 10.1016/j.ejrad.2021.109994] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2021] [Revised: 09/18/2021] [Accepted: 09/29/2021] [Indexed: 10/20/2022]
Abstract
OBJECTIVES To assess the image quality of conventional respiratory-triggered 3-dimentional (3D) magnetic resonance cholangiopancreatography (Resp-MRCP) and breath-hold 3D MRCP (BH-MRCP) with and without denoising procedure using deep learning-based reconstruction (dDLR) at 1.5 T. METHODS Forty-two patients underwent MRCP at 1.5 T MRI. The following imaging sequences were performed: Resp-MRCP and BH-MRCP. We applied the dDLR method to the BH-MRCP data (BH-dDLR-MRCP). As a qualitative analysis, two radiologists rated the visibility of the proximal common bile duct (CBD), pancreaticobiliary junction, distal main pancreatic duct, cystic duct, and right and left hepatic ducts. Artifacts and overall image quality were also rated. The signal-to-noise ratios (SNRs), contrast ratios, and contrast-to-noise ratios (CNRs) of the CBD images were calculated for quantitative analysis. RESULTS BH-MRCP was successfully performed in a single BH. The qualitative and quantitative measurements for BH-dDLR-MRCP were significantly higher than for BH-MRCP (P < 0.02 and P < 0.001, respectively), and the qualitative measurements for BH-dDLR-MRCP were equivalent to or higher than for Resp-MRCP (P = 0.048-1.000). The SNRs and CNRs for BH-dDLR-MRCP were significantly higher than for Resp-MRCP (P < 0.001 and P = 0.001, respectively). CONCLUSION dDLR is useful and clinically feasible for BH-MRCP at 1.5 T MRI, and enables rapid imaging without loss of image quality compared to conventional Resp-MRCP.
Collapse
Affiliation(s)
- Taku Tajima
- Department of Radiology, International University of Health and Welfare Mita Hospital, 1-4-3 Mita, Minato-ku, Tokyo 108-8329, Japan; Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan
| | - Hiroyuki Akai
- Department of Radiology, The Institute of Medical Science, The University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo 108-8639, Japan
| | - Haruto Sugawara
- Department of Radiology, The Institute of Medical Science, The University of Tokyo, 4-6-1 Shirokanedai, Minato-ku, Tokyo 108-8639, Japan
| | - Koichiro Yasaka
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Akira Kunimatsu
- Department of Radiology, International University of Health and Welfare Mita Hospital, 1-4-3 Mita, Minato-ku, Tokyo 108-8329, Japan
| | - Naoki Yoshioka
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan
| | - Masaaki Akahane
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan
| | - Kuni Ohtomo
- International University of Health and Welfare, 2600-1 kitakanamaru, Otawara, Tochigi 324-8501, Japan
| | - Osamu Abe
- Department of Radiology, Graduate School of Medicine, The University of Tokyo, 7-3-1, Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
| | - Shigeru Kiryu
- Department of Radiology, International University of Health and Welfare Narita Hospital, 852 Hatakeda Narita, Chiba 286-0124, Japan.
| |
Collapse
|
48
|
Anteby R, Klang E, Horesh N, Nachmany I, Shimon O, Barash Y, Kopylov U, Soffer S. Deep learning for noninvasive liver fibrosis classification: A systematic review. Liver Int 2021; 41:2269-2278. [PMID: 34008300 DOI: 10.1111/liv.14966] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/23/2021] [Revised: 04/23/2021] [Accepted: 05/13/2021] [Indexed: 12/17/2022]
Abstract
BACKGROUND AND AIMS While biopsy is the gold standard for liver fibrosis staging, it poses significant risks. Noninvasive assessment of liver fibrosis is a growing field. Recently, deep learning (DL) technology has revolutionized medical image analysis. This technology has the potential to enhance noninvasive fibrosis assessment. We systematically examined the application of DL in noninvasive liver fibrosis imaging. METHODS Embase, MEDLINE, Web of Science, and IEEE Xplore databases were used to identify studies that reported on the accuracy of DL for classification of liver fibrosis on noninvasive imaging. The search keywords were "liver or hepatic," "fibrosis or cirrhosis," and "neural or DL networks." Risk of bias and applicability were evaluated using the QUADAS-2 tool. RESULTS Sixteen studies were retrieved. Imaging modalities included ultrasound (n = 10), computed tomography (n = 3), and magnetic resonance imaging (n = 3). The studies analyzed a total of 40 405 radiological images from 15 853 patients. All but two of the studies were retrospective. In most studies the "ground truth" reference was the METAVIR score for pathological staging (n = 9.56%). The majority of the studies reported an accuracy >85% when compared to histopathology. Fourteen studies (87.5%) had a high risk of bias and concerns regarding applicability. CONCLUSIONS Deep learning has the potential to play an emerging role in liver fibrosis classification. Yet, it is still limited by a relatively small number of retrospective studies. Clinicians should facilitate the use of this technology by sharing databases and standardized reports. This may optimize the noninvasive evaluation of liver fibrosis on a large scale.
Collapse
Affiliation(s)
- Roi Anteby
- School of Public Health, Harvard University, Boston, MA, USA
| | - Eyal Klang
- Department of Population Health Science and Policy, Institute for Healthcare Delivery Science, New York, NY, USA.,Sackler Medical School, Tel Aviv University, Tel Aviv, Israel.,Deep Vision Lab, The Chaim Sheba Medical Center, Ramat Gan, Israel.,Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel
| | - Nir Horesh
- Sackler Medical School, Tel Aviv University, Tel Aviv, Israel.,Department of Surgery and Transplantation B, Sheba Medical Center, Tel Hashomer, Israel
| | - Ido Nachmany
- Sackler Medical School, Tel Aviv University, Tel Aviv, Israel.,Department of Surgery and Transplantation B, Sheba Medical Center, Tel Hashomer, Israel
| | - Orit Shimon
- Sackler Medical School, Tel Aviv University, Tel Aviv, Israel.,Department of Anesthesia, Rabin Medical Center, Beilinson Hospital, Petach Tikvah, Israel
| | - Yiftach Barash
- Sackler Medical School, Tel Aviv University, Tel Aviv, Israel.,Deep Vision Lab, The Chaim Sheba Medical Center, Ramat Gan, Israel.,Department of Diagnostic Imaging, Sheba Medical Center, Tel Hashomer, Israel
| | - Uri Kopylov
- Sackler Medical School, Tel Aviv University, Tel Aviv, Israel.,Department of Gastroenterology, Sheba Medical Center, Tel Hashomer, Israel
| | - Shelly Soffer
- Deep Vision Lab, The Chaim Sheba Medical Center, Ramat Gan, Israel.,Internal Medicine B, Assuta Medical Center, Ashdod, Israel.,Ben-Gurion University of the Negev, Be'er Sheva, Israel
| |
Collapse
|
49
|
Nobashi T, Zacharias C, Ellis JK, Ferri V, Koran ME, Franc BL, Iagaru A, Davidzon GA. Performance Comparison of Individual and Ensemble CNN Models for the Classification of Brain 18F-FDG-PET Scans. J Digit Imaging 2021; 33:447-455. [PMID: 31659587 DOI: 10.1007/s10278-019-00289-x] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022] Open
Abstract
The high-background glucose metabolism of normal gray matter on [18F]-fluoro-2-D-deoxyglucose (FDG) positron emission tomography (PET) of the brain results in a low signal-to-background ratio, potentially increasing the possibility of missing important findings in patients with intracranial malignancies. To explore the strategy of using a deep learning classifier to aid in distinguishing normal versus abnormal findings on PET brain images, this study evaluated the performance of a two-dimensional convolutional neural network (2D-CNN) to classify FDG PET brain scans as normal (N) or abnormal (A). METHODS Two hundred eighty-nine brain FDG-PET scans (N; n = 150, A; n = 139) resulting in a total of 68,260 images were included. Nine individual 2D-CNN models with three different window settings for axial, coronal, and sagittal axes were trained and validated. The performance of these individual and ensemble models was evaluated and compared using a test dataset. Odds ratio, Akaike's information criterion (AIC), and area under curve (AUC) on receiver-operative-characteristic curve, accuracy, and standard deviation (SD) were calculated. RESULTS An optimal window setting to classify normal and abnormal scans was different for each axis of the individual models. An ensembled model using different axes with an optimized window setting (window-triad) showed better performance than ensembled models using the same axis and different windows settings (axis-triad). Increase in odds ratio and decrease in SD were observed in both axis-triad and window-triad models compared with individual models, whereas improvements of AUC and AIC were seen in window-triad models. An overall model averaging the probabilities of all individual models showed the best accuracy of 82.0%. CONCLUSIONS Data ensemble using different window settings and axes was effective to improve 2D-CNN performance parameters for the classification of brain FDG-PET scans. If prospectively validated with a larger cohort of patients, similar models could provide decision support in a clinical setting.
Collapse
Affiliation(s)
- Tomomi Nobashi
- Division of Nuclear Medicine and Molecular Imaging, Department of Radiology, Stanford University, 300 Pasteur Drive, Office H2228, Stanford, CA, 94305, USA
| | - Claudia Zacharias
- Clinic for Nuclear Medicine, University Hospital Essen, Essen, Germany
| | - Jason K Ellis
- DimensionalMechanics Inc.®, 2821 Northup Way Suite, Bellevue, WA, #200, USA
| | - Valentina Ferri
- Division of Nuclear Medicine and Molecular Imaging, Department of Radiology, Stanford University, 300 Pasteur Drive, Office H2228, Stanford, CA, 94305, USA
| | - Mary Ellen Koran
- Division of Nuclear Medicine and Molecular Imaging, Department of Radiology, Stanford University, 300 Pasteur Drive, Office H2228, Stanford, CA, 94305, USA
| | - Benjamin L Franc
- Division of Nuclear Medicine and Molecular Imaging, Department of Radiology, Stanford University, 300 Pasteur Drive, Office H2228, Stanford, CA, 94305, USA
| | - Andrei Iagaru
- Division of Nuclear Medicine and Molecular Imaging, Department of Radiology, Stanford University, 300 Pasteur Drive, Office H2228, Stanford, CA, 94305, USA
| | - Guido A Davidzon
- Division of Nuclear Medicine and Molecular Imaging, Department of Radiology, Stanford University, 300 Pasteur Drive, Office H2228, Stanford, CA, 94305, USA.
| |
Collapse
|
50
|
Sports Action Recognition Based on GB-BP Neural Network and Big Data Analysis. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2021; 2021:1678123. [PMID: 34394333 PMCID: PMC8355973 DOI: 10.1155/2021/1678123] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/26/2021] [Accepted: 07/26/2021] [Indexed: 11/18/2022]
Abstract
In recent years, the application of the gradient boosting-back propagation (GB-BP) neural network algorithm in many industries has brought huge benefits, so how to combine the GB-BP neural network algorithm with sports has become a research hotspot. Based on this, this paper studies the application of the GB-BP neural network algorithm in wrestling, designs the sports athletes action recognition and classification model based on the GB-BP neural network algorithm, first analyzes the research status of wrestling action recognition, and then optimizes and improves the shortcomings of action recognition and big data analysis technology. The GB-BP neural network algorithm can realize the accurate recognition and classification of wrestlers' training actions and carry out big data mining analysis with known action recognition, so as to achieve accurate classification. The experimental results show that the model can play a good role in wrestling and effectively improve the efficiency of wrestlers in training.
Collapse
|