1
|
Fujii I, Matsumoto N, Ogawa M, Konishi A, Kaneko M, Watanabe Y, Masuzaki R, Kogure H, Koizumi N, Sugitani M. Artificial Intelligence and Image Analysis-Assisted Diagnosis for Fibrosis Stage of Metabolic Dysfunction-Associated Steatotic Liver Disease Using Ultrasonography: A Pilot Study. Diagnostics (Basel) 2024; 14:2585. [PMID: 39594250 PMCID: PMC11593288 DOI: 10.3390/diagnostics14222585] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2024] [Revised: 10/31/2024] [Accepted: 11/07/2024] [Indexed: 11/28/2024] Open
Abstract
BACKGROUND/OBJECTIVES Elastography increased the diagnostic accuracy of liver fibrosis. However, several challenges persist, including the widespread utilization of equipment, difficulties in measuring certain cases, and the influence of viscosity factors. A rough surface and a blunted hepatic margin have long been acknowledged as valuable characteristics indicative of hepatic fibrosis. The objective of this study was to conduct an image analysis and quantitative assessment of the contour of the sagittal section of the left lobe of the liver. METHODS Between February and October 2020, 486 consecutive outpatients underwent ultrasound examinations at our hospital. A total of 214 images were manually annotated by delineating the liver contour to create annotation images. U-Net was employed for liver segmentation, with the dataset divided into training (n = 128), testing (n = 42), and validation (n = 44) subsets. Additionally, 43 Metabolic Dysfunction Associated Steatotic Liver Disease (MASLD) cases with pathology data from between 2015 and 2020 were included. Segmentation was performed using the program developed in the first step. Subsequently, shape analysis was conducted using ImageJ. RESULTS Liver segmentation exhibited high accuracy, as indicated by Dice loss of 0.044, Intersection over Union of 0.935, and an F score of 0.966. The accuracy of the classification of the liver surface as smooth or rough via ResNet 50 was 84.6%. Image analysis showed MinFeret and Minor correlated with liver fibrosis stage (p = 0.046, 0.036, respectively). Sensitivity, specificity, and AUROC of Minor for ≥F3 were 0.571, 0.862, and 0.722, respectively, and F4 were 1, 0.600, and 0.825, respectively. CONCLUSION Deep learning segmentation of the sagittal cross-sectional contour of the left lobe of the liver demonstrated commendable accuracy. The roughness of the liver surface was correctly judged by artificial intelligence. Image analysis showed the thickness of the left lobe inversely correlated with liver fibrosis stage.
Collapse
Affiliation(s)
- Itsuki Fujii
- Department of Mechanical Engineering and Intelligent Systems, Graduate School of Informatics and Engineering, The University of Electro-Communications, Chofu 182-8585, Japan
| | - Naoki Matsumoto
- Division of Gastroenterology and Hepatology, Department of Medicine, Nihon University School of Medicine, Tokyo 173-8610, Japan; (M.O.); (Y.W.)
| | - Masahiro Ogawa
- Division of Gastroenterology and Hepatology, Department of Medicine, Nihon University School of Medicine, Tokyo 173-8610, Japan; (M.O.); (Y.W.)
| | - Aya Konishi
- Division of Gastroenterology and Hepatology, Department of Medicine, Nihon University School of Medicine, Tokyo 173-8610, Japan; (M.O.); (Y.W.)
| | - Masahiro Kaneko
- Division of Gastroenterology and Hepatology, Department of Medicine, Nihon University School of Medicine, Tokyo 173-8610, Japan; (M.O.); (Y.W.)
| | - Yukinobu Watanabe
- Division of Gastroenterology and Hepatology, Department of Medicine, Nihon University School of Medicine, Tokyo 173-8610, Japan; (M.O.); (Y.W.)
| | - Ryota Masuzaki
- Division of Gastroenterology and Hepatology, Department of Medicine, Nihon University School of Medicine, Tokyo 173-8610, Japan; (M.O.); (Y.W.)
| | - Hirofumi Kogure
- Division of Gastroenterology and Hepatology, Department of Medicine, Nihon University School of Medicine, Tokyo 173-8610, Japan; (M.O.); (Y.W.)
| | - Norihiro Koizumi
- Department of Mechanical Engineering and Intelligent Systems, Graduate School of Informatics and Engineering, The University of Electro-Communications, Chofu 182-8585, Japan
| | - Masahiko Sugitani
- Division of Pathology, Nihon University School of Medicine, Tokyo 173-8610, Japan;
| |
Collapse
|
2
|
Hirata S, Isshiki A, Tai DI, Tsui PH, Yoshida K, Yamaguchi T. Convolutional neural network classification of ultrasound images by liver fibrosis stages based on echo-envelope statistics. FRONTIERS IN PHYSICS 2023; 11. [DOI: 10.3389/fphy.2023.1164622] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/04/2024]
Abstract
Introduction: Assessing the stage of liver fibrosis during the diagnosis and follow-up of patients with diffuse liver disease is crucial. The tissue structure in the fibrotic liver is reflected in the texture and contrast of an ultrasound image, with the pixel brightness indicating the intensity of the echo envelope. Therefore, the progression of liver fibrosis can be evaluated non-invasively by analyzing ultrasound images.Methods: A convolutional-neural-network (CNN) classification of ultrasound images was applied to estimate liver fibrosis. In this study, the colorization of the ultrasound images using echo-envelope statistics that correspond to the features of the images is proposed to improve the accuracy of CNN classification. In the proposed method, the ultrasound image is modulated by the 3rd- and 4th-order moments of pixel brightness. The two modulated images and the original image were then synthesized into a color image of RGB representation.Results and Discussion: The colorized ultrasound images were classified via transfer learning of VGG-16 to evaluate the effect of colorization. Of the 80 ultrasound images with liver fibrosis stages F1–F4, 38 images were accurately classified by the CNN using the original ultrasound images, whereas 47 images were classified by the proposed method.
Collapse
|
3
|
Wang X, Song L, Zhuang Y, Han L, Chen K, Lin J, Luo Y. A Hierarchical Siamese Network for Noninvasive Staging of Liver Fibrosis Based on US Image Pairs of the Liver and Spleen. SENSORS (BASEL, SWITZERLAND) 2023; 23:5450. [PMID: 37420617 DOI: 10.3390/s23125450] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/24/2023] [Revised: 06/01/2023] [Accepted: 06/05/2023] [Indexed: 07/09/2023]
Abstract
Due to the heterogeneity of ultrasound (US) images and the indeterminate US texture of liver fibrosis (LF), automatic evaluation of LF based on US images is still challenging. Thus, this study aimed to propose a hierarchical Siamese network that combines the information from liver and spleen US images to improve the accuracy of LF grading. There were two stages in the proposed method. In stage one, a dual-channel Siamese network was trained to extract features from paired liver and spleen patches that were cropped from US images to avoid vascular interferences. Subsequently, the L1 distance was used to quantify the liver-spleen differences (LSDs). In stage two, the pretrained weights from stage one were transferred into the Siamese feature extractor of the LF staging model, and a classifier was trained using the fusion of the liver and LSD features for LF staging. This study was retrospectively conducted on US images of 286 patients with histologically proven liver fibrosis stages. Our method achieved a precision and sensitivity of 93.92% and 91.65%, respectively, for cirrhosis (S4) diagnosis, which is about 8% higher than that of the baseline model. The accuracy of the advanced fibrosis (≥S3) diagnosis and the multi-staging of fibrosis (≤S2 vs. S3 vs. S4) both improved about 5% to reach 90.40% and 83.93%, respectively. This study proposed a novel method that combined hepatic and splenic US images and improved the accuracy of LF staging, which indicates the great potential of liver-spleen texture comparison in noninvasive assessment of LF based on US images.
Collapse
Affiliation(s)
- Xue Wang
- College of Biomedical Engineering, Sichuan University, Chengdu 610065, China
| | - Ling Song
- Department of Ultrasound, West China Hospital, Sichuan University, Chengdu 610065, China
| | - Yan Zhuang
- College of Biomedical Engineering, Sichuan University, Chengdu 610065, China
| | - Lin Han
- College of Biomedical Engineering, Sichuan University, Chengdu 610065, China
| | - Ke Chen
- College of Biomedical Engineering, Sichuan University, Chengdu 610065, China
| | - Jiangli Lin
- College of Biomedical Engineering, Sichuan University, Chengdu 610065, China
| | - Yan Luo
- Department of Ultrasound, West China Hospital, Sichuan University, Chengdu 610065, China
| |
Collapse
|
4
|
Isshiki A, Tai DI, Tsui PH, Yoshida K, Yamaguchi T, Hirata S. Convolutional Neural Network Classification of Liver Fibrosis Stages Using Ultrasonic Images Colorized by Features of Echo-Envelope Statistics. LECTURE NOTES IN ELECTRICAL ENGINEERING 2023:441-451. [DOI: 10.1007/978-981-16-6775-6_36] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|
5
|
Ma L, Wang R, He Q, Huang L, Wei X, Lu X, Du Y, Luo J, Liao H. Artificial intelligence-based ultrasound imaging technologies for hepatic diseases. ILIVER 2022; 1:252-264. [DOI: 10.1016/j.iliver.2022.11.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/04/2025]
|
6
|
Guo X, Lei Y, He P, Zeng W, Yang R, Ma Y, Feng P, Lyu Q, Wang G, Shan H. An ensemble learning method based on ordinal regression for COVID-19 diagnosis from chest CT. Phys Med Biol 2021; 66. [PMID: 34715678 DOI: 10.1088/1361-6560/ac34b2] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2021] [Accepted: 10/29/2021] [Indexed: 12/16/2022]
Abstract
Coronavirus disease 2019 (COVID-19) has brought huge losses to the world, and it remains a great threat to public health. X-ray computed tomography (CT) plays a central role in the management of COVID-19. Traditional diagnosis with pulmonary CT images is time-consuming and error-prone, which could not meet the need for precise and rapid COVID-19 screening. Nowadays, deep learning (DL) has been successfully applied to CT image analysis, which assists radiologists in workflow scheduling and treatment planning for patients with COVID-19. Traditional methods use cross-entropy as the loss function with a Softmax classifier following a fully-connected layer. Most DL-based classification methods target intraclass relationships in a certain class (early, progressive, severe, or dissipative phases), ignoring the natural order of different phases of the disease progression,i.e.,from an early stage and progress to a late stage. To learn both intraclass and interclass relationships among different stages and improve the accuracy of classification, this paper proposes an ensemble learning method based on ordinal regression, which leverages the ordinal information on COVID-19 phases. The proposed method uses multi-binary, neuron stick-breaking (NSB), and soft labels (SL) techniques, and ensembles the ordinal outputs through a median selection. To evaluate our method, we collected 172 confirmed cases. In a 2-fold cross-validation experiment, the accuracy is increased by 22% compared with traditional methods when we use modified ResNet-18 as the backbone. And precision, recall, andF1-score are also improved. The experimental results show that our proposed method achieves a better classification performance than the traditional methods, which helps establish guidelines for the classification of COVID-19 chest CT images.
Collapse
Affiliation(s)
- Xiaodong Guo
- The Key Lab of Optoelectronic Technology and Systems of the Education Ministry of China, Chongqing University, Chongqing 400044, People's Republic of China.,Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180, United States of America
| | - Yiming Lei
- Shanghai Key Laboratory of Intelligent Information Processing, School of Computer Science, Fudan University, Shanghai 200433, People's Republic of China
| | - Peng He
- The Key Lab of Optoelectronic Technology and Systems of the Education Ministry of China, Chongqing University, Chongqing 400044, People's Republic of China
| | - Wenbing Zeng
- Radiology Department, Chongqing University Three Gorges Hospital, Chongqing 404000, People's Republic of China
| | - Ran Yang
- Radiology Department, Chongqing University Three Gorges Hospital, Chongqing 404000, People's Republic of China
| | - Yinjin Ma
- The Key Lab of Optoelectronic Technology and Systems of the Education Ministry of China, Chongqing University, Chongqing 400044, People's Republic of China
| | - Peng Feng
- The Key Lab of Optoelectronic Technology and Systems of the Education Ministry of China, Chongqing University, Chongqing 400044, People's Republic of China
| | - Qing Lyu
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180, United States of America
| | - Ge Wang
- Department of Biomedical Engineering, Rensselaer Polytechnic Institute, Troy, NY 12180, United States of America
| | - Hongming Shan
- Institute of Science and Technology for Brain-inspired Intelligence and MOE Frontiers Center for Brain Science, Fudan University, Shanghai 200433, People's Republic of China.,Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Ministry of Education), Fudan University, Shanghai 201210, People's Republic of China.,Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai 201210, People's Republic of China
| |
Collapse
|