1
|
Mei G, Yu J. Research on CT image segmentation and classification of liver tumors based on attention mechanism and improved U-Net model. Technol Health Care 2025:9287329251329294. [PMID: 40302502 DOI: 10.1177/09287329251329294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/02/2025]
Abstract
BackgroundLiver cancer is still one of the most common causes of death from cancer globally. The accurate segmentation of liver tumors from CT images is critical for diagnosis, treatment planning, and tracking. Conventional segmentation techniques frequently struggle to handle the intricacy of medical images, requiring the usage of sophisticated artificial intelligence (AI) methods to enhance accuracy and effectiveness.ObjectiveThe main objective of this study is to create and test an improved U-Net model (AM-UNet) that incorporates an attention mechanism to enhance the segmentation and classification accuracy of liver tumors in CT images. This method seeks to surpass previous techniques in terms of accuracy, precision, recall, and F1 score.MethodsThe dataset used includes 194 liver tumor CT scans obtained from 131 individuals for training and 70 for testing. The open-source 3DIRCAD-B dataset, which is incorporated into LiTS, contains images of both normal and pathological conditions. Preprocessing methods such as Median Filtering (MF) and Histogram Equalization (HE) were used to reduce noise and improve contrast. The AM-UNet model was then used to segment the tumors before classifying them as malignant or benign. The efficiency was assessed utilizing metrics like accuracy, precision, recall, F1-score, and ROC (Receiver Operating Characteristic).ResultsThe suggested AM-UNet model produced excellent outcomes, with a recall of 95%, accuracy of 92%, precision of 94%, and an F1-score of 93%. These metrics show that the model outperforms conventional techniques in correctly segmenting and classifying liver tumors in CT images.ConclusionThe AM-UNet model improves the segmentation and classification of liver tumors, providing substantial performance metrics over traditional methods. Its utilization can transform liver cancer diagnosis by assisting physicians in accurate tumor identification and treatment planning, resulting in improved patient results.
Collapse
Affiliation(s)
- Guang Mei
- Gongqing College of Nanchang University, Jiujiang, China
| | - Jinhua Yu
- Gongqing College of Nanchang University, Jiujiang, China
| |
Collapse
|
2
|
Bian Y, Li J, Ye C, Jia X, Yang Q. Artificial intelligence in medical imaging: From task-specific models to large-scale foundation models. Chin Med J (Engl) 2025; 138:651-663. [PMID: 40008785 PMCID: PMC11925424 DOI: 10.1097/cm9.0000000000003489] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2024] [Indexed: 02/27/2025] Open
Abstract
ABSTRACT Artificial intelligence (AI), particularly deep learning, has demonstrated remarkable performance in medical imaging across a variety of modalities, including X-ray, computed tomography (CT), magnetic resonance imaging (MRI), ultrasound, positron emission tomography (PET), and pathological imaging. However, most existing state-of-the-art AI techniques are task-specific and focus on a limited range of imaging modalities. Compared to these task-specific models, emerging foundation models represent a significant milestone in AI development. These models can learn generalized representations of medical images and apply them to downstream tasks through zero-shot or few-shot fine-tuning. Foundation models have the potential to address the comprehensive and multifactorial challenges encountered in clinical practice. This article reviews the clinical applications of both task-specific and foundation models, highlighting their differences, complementarities, and clinical relevance. We also examine their future research directions and potential challenges. Unlike the replacement relationship seen between deep learning and traditional machine learning, task-specific and foundation models are complementary, despite inherent differences. While foundation models primarily focus on segmentation and classification, task-specific models are integrated into nearly all medical image analyses. However, with further advancements, foundation models could be applied to other clinical scenarios. In conclusion, all indications suggest that task-specific and foundation models, especially the latter, have the potential to drive breakthroughs in medical imaging, from image processing to clinical workflows.
Collapse
Affiliation(s)
- Yueyan Bian
- Department of Radiology, Beijing Chaoyang Hospital, Capital Medical University, Beijing 100020, China
- Key Lab of Medical Engineering for Cardiovascular Disease, Ministry of Education, Beijing 100020, China
- Laboratory for Clinical Medicine, Capital Medical University, Beijing 100020, China
| | - Jin Li
- Department of Radiology, Beijing Chaoyang Hospital, Capital Medical University, Beijing 100020, China
- Key Lab of Medical Engineering for Cardiovascular Disease, Ministry of Education, Beijing 100020, China
- Laboratory for Clinical Medicine, Capital Medical University, Beijing 100020, China
| | - Chuyang Ye
- School of Integrated Circuits and Electronics, Beijing Institute of Technology, Beijing 100081, China
| | - Xiuqin Jia
- Department of Radiology, Beijing Chaoyang Hospital, Capital Medical University, Beijing 100020, China
- Key Lab of Medical Engineering for Cardiovascular Disease, Ministry of Education, Beijing 100020, China
- Laboratory for Clinical Medicine, Capital Medical University, Beijing 100020, China
| | - Qi Yang
- Department of Radiology, Beijing Chaoyang Hospital, Capital Medical University, Beijing 100020, China
- Key Lab of Medical Engineering for Cardiovascular Disease, Ministry of Education, Beijing 100020, China
- Laboratory for Clinical Medicine, Capital Medical University, Beijing 100020, China
| |
Collapse
|
3
|
Sattari MA, Zonouri SA, Salimi A, Izadi S, Rezaei AR, Ghezelbash Z, Hayati M, Seifi M, Ekhteraei M. Liver margin segmentation in abdominal CT images using U-Net and Detectron2: annotated dataset for deep learning models. Sci Rep 2025; 15:8721. [PMID: 40082561 PMCID: PMC11906767 DOI: 10.1038/s41598-025-92423-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2024] [Accepted: 02/27/2025] [Indexed: 03/16/2025] Open
Abstract
The segmentation of liver margins in computed tomography (CT) images presents significant challenges due to the complex anatomical variability of the liver, with critical implications for medical diagnostics and treatment planning. In this study, we leverage a substantial dataset of over 4,200 abdominal CT images, meticulously annotated by expert radiologists from Taleghani Hospital in Kermanshah, Iran. Now made available to the research community, this dataset serves as a rich resource for enhancing and validating various neural network models. We employed two advanced deep neural network models, U-Net and Detectron2, for liver segmentation tasks. In terms of the Mask Intersection over Union (Mask IoU) metric, U-Net achieved an Mask IoU of 0.903, demonstrating high efficacy in simpler cases. In contrast, Detectron2 outperformed U-Net with an Mask IoU of 0.974, particularly excelling in accurately delineating liver boundaries in complex cases where the liver appears segmented into two distinct regions within the images. This highlights Detectron2's advanced potential in handling anatomical variations that pose challenges for other models. Our findings not only provide a robust comparative analysis of these models but also establish a framework for further enhancements in medical imaging segmentation tasks. The initiative aims not just to refine liver margin detection but also to facilitate the development of automated systems for diagnosing liver diseases, with potential future applications extending these methodologies to other abdominal organs, potentially transforming the landscape of computational diagnostics in healthcare.
Collapse
Affiliation(s)
- Mohammad Amir Sattari
- Electrical Engineering Department, Faculty of Engineering, Razi University, Kermanshah, Iran
| | - Seyed Abed Zonouri
- Electrical Engineering Department, Faculty of Engineering, Razi University, Kermanshah, Iran
| | - Ali Salimi
- Department of Computer Engineering, Faculty of Engineering, Razi University, Kermanshah, Iran
| | - Saadat Izadi
- Department of Computer Engineering, Faculty of Engineering, Razi University, Kermanshah, Iran
| | - Ali Reza Rezaei
- Department of Computer Engineering, Faculty of Engineering, Razi University, Kermanshah, Iran
| | - Zahra Ghezelbash
- Radiology Department, Clinical Research Development Center, Imam Reza Hospital, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Mohsen Hayati
- Electrical Engineering Department, Faculty of Engineering, Razi University, Kermanshah, Iran.
| | - Mehrdad Seifi
- Clinical research development centre, taleghani and imam Ali hospital, Kermanshah university of medical science, Kermanshah, Iran
| | - Milad Ekhteraei
- Medical Biology Research Center, Health Technology Institute, Kermanshah University of Medical Sciences, Kermanshah, Iran
| |
Collapse
|
4
|
Chang CC, Huang KH, Lau TK, Huang CF, Wang CH. Using deep learning model integration to build a smart railway traffic safety monitoring system. Sci Rep 2025; 15:4224. [PMID: 39905256 PMCID: PMC11794453 DOI: 10.1038/s41598-025-88830-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2024] [Accepted: 01/31/2025] [Indexed: 02/06/2025] Open
Abstract
According to the importance of railway safety, it is crucial to build a smart railway traffic safety system in Taiwan, especially there are often to see related accidents. Therefore, this study aimed to build a smart railway traffic safety system using the integration of object detection, segmentation, machine learning, and notification system. First, the Mask R-CNN model was applied to automatically build the digital boundaries of railway, which achieved an average Interest of Union (IOU) of over 0.9. Then, the YOLO v3 model was applied to detect intrusions of railway, especially humans' intrusion. The above object detection model achieved an Overall accuracy (OA) of over 90% for different classes, and an OA of 95.68% for human detection. The YOLO v3 model was also able to detect intrusion within different scenarios, such as nighttime, rainy daytime, and rainy nighttime. Moreover, the XGBoost model was applied to predict the sizes of intruding objects, which has a low MAE of 0.54 cm and an R2 score of 0.997. Finally, the LINE bot was applied to notify the related operators, including the above information, such as time of intrusion, locations, classes of intruding objects, sizes and the image of intrusion. The above implementation can be helpful for railway traffic safety monitoring, which may help related accidents prevention.
Collapse
Affiliation(s)
- Chin-Chieh Chang
- National Kaohsiung University of Science and Technology, Kaohsiung City, 807618, Taiwan
| | - Kai-Hsiang Huang
- National Kaohsiung University of Science and Technology, Kaohsiung City, 807618, Taiwan.
| | - Tsz-Kin Lau
- National Kaohsiung University of Science and Technology, Kaohsiung City, 807618, Taiwan
| | - Chung-Fah Huang
- National Kaohsiung University of Science and Technology, Kaohsiung City, 807618, Taiwan.
| | - Chun-Hsiung Wang
- National Kaohsiung University of Science and Technology, Kaohsiung City, 807618, Taiwan
| |
Collapse
|
5
|
Sheela KS, Justus V, Asaad RR, Kumar RL. Enhancing liver tumor segmentation with UNet-ResNet: Leveraging ResNet's power. Technol Health Care 2025; 33:1-15. [PMID: 39240595 DOI: 10.3233/thc-230931] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/07/2024]
Abstract
BACKGROUND Liver cancer poses a significant health challenge due to its high incidence rates and complexities in detection and treatment. Accurate segmentation of liver tumors using medical imaging plays a crucial role in early diagnosis and treatment planning. OBJECTIVE This study proposes a novel approach combining U-Net and ResNet architectures with the Adam optimizer and sigmoid activation function. The method leverages ResNet's deep residual learning to address training issues in deep neural networks. At the same time, U-Net's structure facilitates capturing local and global contextual information essential for precise tumor characterization. The model aims to enhance segmentation accuracy by effectively capturing intricate tumor features and contextual details by integrating these architectures. The Adam optimizer expedites model convergence by dynamically adjusting the learning rate based on gradient statistics during training. METHODS To validate the effectiveness of the proposed approach, segmentation experiments are conducted on a diverse dataset comprising 130 CT scans of liver cancers. Furthermore, a state-of-the-art fusion strategy is introduced, combining the robust feature learning capabilities of the UNet-ResNet classifier with Snake-based Level Set Segmentation. RESULTS Experimental results demonstrate impressive performance metrics, including an accuracy of 0.98 and a minimal loss of 0.10, underscoring the efficacy of the proposed methodology in liver cancer segmentation. CONCLUSION This fusion approach effectively delineates complex and diffuse tumor shapes, significantly reducing errors.
Collapse
Affiliation(s)
- K Selva Sheela
- Department of Artificial Intelligence and Data Science, KGISL Institute of Technology, Coimbatore, India
| | - Vivek Justus
- Department of Computing Technologies, SRM Institute of Science and Technology, Chennai, India
| | | | - R Lakshmana Kumar
- Department of Artificial Intelligence and Machine Learning, Tagore Institute of Engineering and Technology, Salem, India
| |
Collapse
|
6
|
Tejaswi VSD, Rachapudi V. Computer-aided diagnosis of liver cancer with improved SegNet and deep stacking ensemble model. Comput Biol Chem 2024; 113:108243. [PMID: 39461161 DOI: 10.1016/j.compbiolchem.2024.108243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2024] [Revised: 10/03/2024] [Accepted: 10/08/2024] [Indexed: 10/29/2024]
Abstract
Liver cancer is a leading cause of cancer-related deaths, often diagnosed at advanced stages due to reliance on traditional imaging methods. Existing computer-aided diagnosis systems struggle with noise, anatomical complexity, and ineffective feature integration, leading to inaccuracies in lesion segmentation and classification. By effectively addressing these challenges, the model aims to enhance early detection and assist clinicians in making informed decisions. Ultimately, this research seeks to contribute to more efficient and accurate liver cancer diagnosis. This paper presents a novel model for liver cancer classification, called SegNet-based Liver Cancer Classification via SqueezeNet (SgN-LCC-SqN). The model effectively executes liver cancer segmentation and classification through four key steps: preprocessing, segmentation, feature extraction, and classification. During preprocessing, Quadratic Mean Estimated Wiener Filtering (QMEWF) is utilized to minimize image noise. Segmentation divides the image into segments using Enhanced Feature Pyramid SegNet (EFP-SgN), which is essential for precise diagnosis. Feature extraction encompasses color features, Local Directional Pattern Variance, and Correlation Filtering-Local Gradient Increasing Pattern (CF-LGIP) features. The extracted features are then processed through an ensemble model, Deep Convolutional, Recurrent, Long Short Term Memory with SqueezeNet (DCR-LSTM-SqN), which includes Deep Convolutional Neural Network (DCNN), Recurrent Neural Network (RNN), Long Short-Term Memory (LSTM), and Modified Loss Function in SqueezeNet (MLF-SqN) classifiers, sequentially analyzing the feature sets through DCNN, RNN, and LSTM before classification by MLF-SqN. The performance of the suggested DCR-LSTM-SqN model is evaluated over conventional methods for positive, negative and other metrics. The DCR-LSTM-SqN model consistently demonstrates superior accuracy, ranging from 0.947 to 0.984, across all training data percentages. Thus, the proposed model effectively segments liver lesions and classifies cancerous areas, demonstrating its potential as a valuable resource for clinicians to enhance the efficiency and accuracy of liver cancer diagnosis.
Collapse
Affiliation(s)
- Vinnakota Sai Durga Tejaswi
- Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Green Fields, Vaddeswaram, Andhra Pradesh 522302, India.
| | - Venubabu Rachapudi
- Department of Computer Science and Engineering, Koneru Lakshmaiah Education Foundation, Green Fields, Vaddeswaram, Andhra Pradesh 522302, India
| |
Collapse
|
7
|
Maleki F, Moy L, Forghani R, Ghosh T, Ovens K, Langer S, Rouzrokh P, Khosravi B, Ganjizadeh A, Warren D, Daneshjou R, Moassefi M, Avval AH, Sotardi S, Tenenholtz N, Kitamura F, Kline T. RIDGE: Reproducibility, Integrity, Dependability, Generalizability, and Efficiency Assessment of Medical Image Segmentation Models. JOURNAL OF IMAGING INFORMATICS IN MEDICINE 2024:10.1007/s10278-024-01282-9. [PMID: 39557736 DOI: 10.1007/s10278-024-01282-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/24/2024] [Revised: 07/03/2024] [Accepted: 07/31/2024] [Indexed: 11/20/2024]
Abstract
Deep learning techniques hold immense promise for advancing medical image analysis, particularly in tasks like image segmentation, where precise annotation of regions or volumes of interest within medical images is crucial but manually laborious and prone to interobserver and intraobserver biases. As such, deep learning approaches could provide automated solutions for such applications. However, the potential of these techniques is often undermined by challenges in reproducibility and generalizability, which are key barriers to their clinical adoption. This paper introduces the RIDGE checklist, a comprehensive framework designed to assess the Reproducibility, Integrity, Dependability, Generalizability, and Efficiency of deep learning-based medical image segmentation models. The RIDGE checklist is not just a tool for evaluation but also a guideline for researchers striving to improve the quality and transparency of their work. By adhering to the principles outlined in the RIDGE checklist, researchers can ensure that their developed segmentation models are robust, scientifically valid, and applicable in a clinical setting.
Collapse
Affiliation(s)
- Farhad Maleki
- Department of Computer Science, University of Calgary, Calgary, AB, Canada.
- Department of Diagnostic Radiology, McGill University, Montreal, QC, Canada.
- Department of Radiology, Division of Medical Physics, University of Florida, Gainesville, FL, USA.
| | - Linda Moy
- Department of Radiology, New York University Langone Health, New York, NY, USA
| | - Reza Forghani
- Department of Radiology, Division of Medical Physics, University of Florida, Gainesville, FL, USA
| | - Tapotosh Ghosh
- Department of Computer Science, University of Calgary, Calgary, AB, Canada
| | - Katie Ovens
- Department of Computer Science, University of Calgary, Calgary, AB, Canada
| | - Steve Langer
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | | | | | - Ali Ganjizadeh
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | - Daniel Warren
- Carle College of Medicine University of Illinois Urbana-Champaign, Urbana, IL, USA
| | - Roxana Daneshjou
- Department of Dermatology, Stanford School of Medicine, Stanford, CA, USA
- Department of Biomedical Data Science, Stanford School of Medicine, Stanford, CA, USA
| | - Mana Moassefi
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| | | | - Susan Sotardi
- Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, USA
| | | | | | - Timothy Kline
- Department of Radiology, Mayo Clinic, Rochester, MN, USA
| |
Collapse
|
8
|
Chiu IM, Huang TY, Ouyang D, Lin WC, Pan YJ, Lu CY, Kuo KH. PACT-3D, a deep learning algorithm for pneumoperitoneum detection in abdominal CT scans. Nat Commun 2024; 15:9660. [PMID: 39511229 PMCID: PMC11544264 DOI: 10.1038/s41467-024-54043-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2023] [Accepted: 10/29/2024] [Indexed: 11/15/2024] Open
Abstract
Delays or misdiagnoses in detecting pneumoperitoneum can significantly increase mortality and morbidity. We developed and validated a deep learning model designed to identify pneumoperitoneum in computed tomography images. The model is trained on abdominal scans from Far Eastern Memorial Hospital (January 2012-December 2021) and evaluated using a simulated test set (14,039 scans) and a prospective test set (6351 scans) collected from the same center between December 2022 and May 2023. External validation included 480 scans from Cedars-Sinai Medical Center. Overall, the model achieves a sensitivity of 0.81-0.83 and a specificity of 0.97-0.99 across retrospective, prospective, and external validation; sensitivity improves to 0.92-0.98 when cases with a small amount of free air (total volume <10 ml) are excluded. These findings suggest that the model can deliver accurate and consistent predictions for pneumoperitoneum in computed tomography scans with segmented masks, potentially accelerating diagnostic and treatment workflows in emergency care.
Collapse
Affiliation(s)
- I-Min Chiu
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
- Department of Emergency Medicine, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan.
| | - Teng-Yi Huang
- Department of Electrical Engineering, National Taiwan University of Science and Technology, Taipei, Taiwan
| | - David Ouyang
- Department of Cardiology, Smidt Heart Institute, Cedars-Sinai Medical Center, Los Angeles, CA, USA
| | - Wei-Che Lin
- Department of Diagnostic Radiology, Kaohsiung Chang Gung Memorial Hospital and Chang Gung University College of Medicine, Kaohsiung, Taiwan
- Thyroid Head and Neck Ablation Center, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan
- School of Medicine, College of Medicine, National Sun Yat-Sen University, Kaohsiung, Taiwan
| | - Yi-Ju Pan
- Department of Psychiatry, Far Eastern Memorial Hospital, Banciao, Taiwan
- Department of Chemical Engineering and Materials Science, Yuan Ze University, Taoyuan, Taiwan
| | - Chia-Yin Lu
- Department of Diagnostic Radiology, Kaohsiung Chang Gung Memorial Hospital and Chang Gung University College of Medicine, Kaohsiung, Taiwan
| | - Kuei-Hong Kuo
- Division of Medical Image, Far Eastern Memorial Hospital, Banciao, Taiwan.
- National Yang Ming Chiao Tung University School of Medicine, Taipei, Taiwan.
| |
Collapse
|
9
|
Xu Y, Quan R, Xu W, Huang Y, Chen X, Liu F. Advances in Medical Image Segmentation: A Comprehensive Review of Traditional, Deep Learning and Hybrid Approaches. Bioengineering (Basel) 2024; 11:1034. [PMID: 39451409 PMCID: PMC11505408 DOI: 10.3390/bioengineering11101034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2024] [Revised: 10/08/2024] [Accepted: 10/11/2024] [Indexed: 10/26/2024] Open
Abstract
Medical image segmentation plays a critical role in accurate diagnosis and treatment planning, enabling precise analysis across a wide range of clinical tasks. This review begins by offering a comprehensive overview of traditional segmentation techniques, including thresholding, edge-based methods, region-based approaches, clustering, and graph-based segmentation. While these methods are computationally efficient and interpretable, they often face significant challenges when applied to complex, noisy, or variable medical images. The central focus of this review is the transformative impact of deep learning on medical image segmentation. We delve into prominent deep learning architectures such as Convolutional Neural Networks (CNNs), Fully Convolutional Networks (FCNs), U-Net, Recurrent Neural Networks (RNNs), Adversarial Networks (GANs), and Autoencoders (AEs). Each architecture is analyzed in terms of its structural foundation and specific application to medical image segmentation, illustrating how these models have enhanced segmentation accuracy across various clinical contexts. Finally, the review examines the integration of deep learning with traditional segmentation methods, addressing the limitations of both approaches. These hybrid strategies offer improved segmentation performance, particularly in challenging scenarios involving weak edges, noise, or inconsistent intensities. By synthesizing recent advancements, this review provides a detailed resource for researchers and practitioners, offering valuable insights into the current landscape and future directions of medical image segmentation.
Collapse
Affiliation(s)
- Yan Xu
- School of Electrical, Electronic and Mechanical Engineering, University of Bristol, Bristol BS8 1QU, UK; (Y.X.); (R.Q.); (W.X.)
| | - Rixiang Quan
- School of Electrical, Electronic and Mechanical Engineering, University of Bristol, Bristol BS8 1QU, UK; (Y.X.); (R.Q.); (W.X.)
| | - Weiting Xu
- School of Electrical, Electronic and Mechanical Engineering, University of Bristol, Bristol BS8 1QU, UK; (Y.X.); (R.Q.); (W.X.)
| | - Yi Huang
- Bristol Medical School, University of Bristol, Bristol BS8 1UD, UK;
| | - Xiaolong Chen
- Department of Mechanical, Materials and Manufacturing Engineering, University of Nottingham, Nottingham NG7 2RD, UK;
| | - Fengyuan Liu
- School of Electrical, Electronic and Mechanical Engineering, University of Bristol, Bristol BS8 1QU, UK; (Y.X.); (R.Q.); (W.X.)
| |
Collapse
|
10
|
Delmoral JC, R S Tavares JM. Semantic Segmentation of CT Liver Structures: A Systematic Review of Recent Trends and Bibliometric Analysis : Neural Network-based Methods for Liver Semantic Segmentation. J Med Syst 2024; 48:97. [PMID: 39400739 PMCID: PMC11473507 DOI: 10.1007/s10916-024-02115-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2024] [Accepted: 10/02/2024] [Indexed: 10/15/2024]
Abstract
The use of artificial intelligence (AI) in the segmentation of liver structures in medical images has become a popular research focus in the past half-decade. The performance of AI tools in screening for this task may vary widely and has been tested in the literature in various datasets. However, no scientometric report has provided a systematic overview of this scientific area. This article presents a systematic and bibliometric review of recent advances in neuronal network modeling approaches, mainly of deep learning, to outline the multiple research directions of the field in terms of algorithmic features. Therefore, a detailed systematic review of the most relevant publications addressing fully automatic semantic segmenting liver structures in Computed Tomography (CT) images in terms of algorithm modeling objective, performance benchmark, and model complexity is provided. The review suggests that fully automatic hybrid 2D and 3D networks are the top performers in the semantic segmentation of the liver. In the case of liver tumor and vasculature segmentation, fully automatic generative approaches perform best. However, the reported performance benchmark indicates that there is still much to be improved in segmenting such small structures in high-resolution abdominal CT scans.
Collapse
Affiliation(s)
- Jessica C Delmoral
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, s/n, 4200-465, Porto, Portugal
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Departamento de Engenharia Mecânica, Faculdade de Engenharia, Universidade do Porto, Rua Dr. Roberto Frias, s/n, 4200-465, Porto, Portugal.
| |
Collapse
|
11
|
Wang L, Fatemi M, Alizad A. Artificial intelligence techniques in liver cancer. Front Oncol 2024; 14:1415859. [PMID: 39290245 PMCID: PMC11405163 DOI: 10.3389/fonc.2024.1415859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2024] [Accepted: 08/15/2024] [Indexed: 09/19/2024] Open
Abstract
Hepatocellular Carcinoma (HCC), the most common primary liver cancer, is a significant contributor to worldwide cancer-related deaths. Various medical imaging techniques, including computed tomography, magnetic resonance imaging, and ultrasound, play a crucial role in accurately evaluating HCC and formulating effective treatment plans. Artificial Intelligence (AI) technologies have demonstrated potential in supporting physicians by providing more accurate and consistent medical diagnoses. Recent advancements have led to the development of AI-based multi-modal prediction systems. These systems integrate medical imaging with other modalities, such as electronic health record reports and clinical parameters, to enhance the accuracy of predicting biological characteristics and prognosis, including those associated with HCC. These multi-modal prediction systems pave the way for predicting the response to transarterial chemoembolization and microvascular invasion treatments and can assist clinicians in identifying the optimal patients with HCC who could benefit from interventional therapy. This paper provides an overview of the latest AI-based medical imaging models developed for diagnosing and predicting HCC. It also explores the challenges and potential future directions related to the clinical application of AI techniques.
Collapse
Affiliation(s)
- Lulu Wang
- Department of Engineering, School of Technology, Reykjavık University, Reykjavík, Iceland
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | - Mostafa Fatemi
- Department of Physiology and Biomedical Engineering, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| | - Azra Alizad
- Department of Radiology, Mayo Clinic College of Medicine and Science, Rochester, MN, United States
| |
Collapse
|
12
|
Xu C, Wu X, Wang B, Chen J, Gao Z, Liu X, Zhang H. Accurate segmentation of liver tumor from multi-modality non-contrast images using a dual-stream multi-level fusion framework. Comput Med Imaging Graph 2024; 116:102414. [PMID: 38981250 DOI: 10.1016/j.compmedimag.2024.102414] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Revised: 05/10/2024] [Accepted: 06/28/2024] [Indexed: 07/11/2024]
Abstract
The use of multi-modality non-contrast images (i.e., T1FS, T2FS and DWI) for segmenting liver tumors provides a solution by eliminating the use of contrast agents and is crucial for clinical diagnosis. However, this remains a challenging task to discover the most useful information to fuse multi-modality images for accurate segmentation due to inter-modal interference. In this paper, we propose a dual-stream multi-level fusion framework (DM-FF) to, for the first time, accurately segment liver tumors from non-contrast multi-modality images directly. Our DM-FF first designs an attention-based encoder-decoder to effectively extract multi-level feature maps corresponding to a specified representation of each modality. Then, DM-FF creates two types of fusion modules, in which a module fuses learned features to obtain a shared representation across multi-modality images to exploit commonalities and improve the performance, and a module fuses the decision evidence of segment to discover differences between modalities to prevent interference caused by modality's conflict. By integrating these three components, DM-FF enables multi-modality non-contrast images to cooperate with each other and enables an accurate segmentation. Evaluation on 250 patients including different types of tumors from two MRI scanners, DM-FF achieves a Dice of 81.20%, and improves performance (Dice by at least 11%) when comparing the eight state-of-the-art segmentation architectures. The results indicate that our DM-FF significantly promotes the development and deployment of non-contrast liver tumor technology.
Collapse
Affiliation(s)
- Chenchu Xu
- Artificial Intelligence Institute, Anhui University, Hefei, China; Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China
| | - Xue Wu
- Artificial Intelligence Institute, Anhui University, Hefei, China
| | - Boyan Wang
- Department of Computer Science and Technology, Tsinghua University, Beijing, China.
| | - Jie Chen
- Artificial Intelligence Institute, Anhui University, Hefei, China
| | - Zhifan Gao
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| | - Xiujian Liu
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China.
| | - Heye Zhang
- School of Biomedical Engineering, Sun Yat-sen University, Shenzhen, China
| |
Collapse
|
13
|
Zhang B, Qiu S, Liang T. Dual Attention-Based 3D U-Net Liver Segmentation Algorithm on CT Images. Bioengineering (Basel) 2024; 11:737. [PMID: 39061819 PMCID: PMC11273630 DOI: 10.3390/bioengineering11070737] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Revised: 07/11/2024] [Accepted: 07/17/2024] [Indexed: 07/28/2024] Open
Abstract
The liver is a vital organ in the human body, and CT images can intuitively display its morphology. Physicians rely on liver CT images to observe its anatomical structure and areas of pathology, providing evidence for clinical diagnosis and treatment planning. To assist physicians in making accurate judgments, artificial intelligence techniques are adopted. Addressing the limitations of existing methods in liver CT image segmentation, such as weak contextual analysis and semantic information loss, we propose a novel Dual Attention-Based 3D U-Net liver segmentation algorithm on CT images. The innovations of our approach are summarized as follows: (1) We improve the 3D U-Net network by introducing residual connections to better capture multi-scale information and alleviate semantic information loss. (2) We propose the DA-Block encoder structure to enhance feature extraction capability. (3) We introduce the CBAM module into skip connections to optimize feature transmission in the encoder, reducing semantic gaps and achieving accurate liver segmentation. To validate the effectiveness of the algorithm, experiments were conducted on the LiTS dataset. The results showed that the Dice coefficient and HD95 index for liver images were 92.56% and 28.09 mm, respectively, representing an improvement of 0.84% and a reduction of 2.45 mm compared to 3D Res-UNet.
Collapse
Affiliation(s)
- Benyue Zhang
- Key Laboratory of Spectral Imaging Technology CAS, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China;
- School of Optoelectronics, University of Chinese Academy of Sciences, Beijing 100408, China
| | - Shi Qiu
- Key Laboratory of Spectral Imaging Technology CAS, Xi’an Institute of Optics and Precision Mechanics, Chinese Academy of Sciences, Xi’an 710119, China;
| | - Ting Liang
- Department of Radiology, The First Affiliated Hospital of Xi’an Jiaotong University, Xi’an 710119, China
| |
Collapse
|
14
|
Liu H, Zhou Y, Gou S, Luo Z. Tumor conspicuity enhancement-based segmentation model for liver tumor segmentation and RECIST diameter measurement in non-contrast CT images. Comput Biol Med 2024; 174:108420. [PMID: 38613896 DOI: 10.1016/j.compbiomed.2024.108420] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 04/04/2024] [Accepted: 04/04/2024] [Indexed: 04/15/2024]
Abstract
BACKGROUND AND OBJECTIVE Liver tumor segmentation (LiTS) accuracy on contrast-enhanced computed tomography (CECT) images is higher than that on non-contrast computed tomography (NCCT) images. However, CECT requires contrast medium and repeated scans to obtain multiphase enhanced CT images, which is time-consuming and cost-increasing. Therefore, despite the lower accuracy of LiTS on NCCT images, which still plays an irreplaceable role in some clinical settings, such as guided brachytherapy, ablation, or evaluation of patients with renal function damage. In this study, we intend to generate enhanced high-contrast pseudo-color CT (PCCT) images to improve the accuracy of LiTS and RECIST diameter measurement on NCCT images. METHODS To generate high-contrast CT liver tumor region images, an intensity-based tumor conspicuity enhancement (ITCE) model was first developed. In the ITCE model, a pseudo color conversion function from an intensity distribution of the tumor was established, and it was applied in NCCT to generate enhanced PCCT images. Additionally, we design a tumor conspicuity enhancement-based liver tumor segmentation (TCELiTS) model, which was applied to improve the segmentation of liver tumors on NCCT images. The TCELiTS model consists of three components: an image enhancement module based on the ITCE model, a segmentation module based on a deep convolutional neural network, and an attention loss module based on restricted activation. Segmentation performance was analyzed using the Dice similarity coefficient (DSC), sensitivity, specificity, and RECIST diameter error. RESULTS To develop the deep learning model, 100 patients with histopathologically confirmed liver tumors (hepatocellular carcinoma, 64 patients; hepatic hemangioma, 36 patients) were randomly divided into a training set (75 patients) and an independent test set (25 patients). Compared with existing tumor automatic segmentation networks trained on CECT images (U-Net, nnU-Net, DeepLab-V3, Modified U-Net), the DSCs achieved on the enhanced PCCT images are both improved compared with those on NCCT images. We observe improvements of 0.696-0.713, 0.715 to 0.776, 0.748 to 0.788, and 0.733 to 0.799 in U-Net, nnU-Net, DeepLab-V3, and Modified U-Net, respectively, in terms of DSC values. In addition, an observer study including 5 doctors was conducted to compare the segmentation performance of enhanced PCCT images with that of NCCT images and showed that enhanced PCCT images are more advantageous for doctors to segment tumor regions. The results showed an accuracy improvement of approximately 3%-6%, but the time required to segment a single CT image was reduced by approximately 50 %. CONCLUSIONS Experimental results show that the ITCE model can generate high-contrast enhanced PCCT images, especially in liver regions, and the TCELiTS model can improve LiTS accuracy in NCCT images.
Collapse
Affiliation(s)
- Haofeng Liu
- School of Artificial Intelligence, Xidian University, Xi'An, 710071, China
| | - Yanyan Zhou
- Department of Interventional Radiology, Tangdu Hospital, Airforce Medical University, Xi'an, 710038, China
| | - Shuiping Gou
- School of Artificial Intelligence, Xidian University, Xi'An, 710071, China
| | - Zhonghua Luo
- Department of Interventional Radiology, Tangdu Hospital, Airforce Medical University, Xi'an, 710038, China.
| |
Collapse
|
15
|
Nakao Y, Nishihara T, Sasaki R, Fukushima M, Miuma S, Miyaaki H, Akazawa Y, Nakao K. Investigation of deep learning model for predicting immune checkpoint inhibitor treatment efficacy on contrast-enhanced computed tomography images of hepatocellular carcinoma. Sci Rep 2024; 14:6576. [PMID: 38503827 PMCID: PMC10951210 DOI: 10.1038/s41598-024-57078-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Accepted: 03/14/2024] [Indexed: 03/21/2024] Open
Abstract
Although the use of immune checkpoint inhibitors (ICIs)-targeted agents for unresectable hepatocellular carcinoma (HCC) is promising, individual response variability exists. Therefore, we developed an artificial intelligence (AI)-based model to predict treatment efficacy using pre-ICIs contrast-enhanced computed tomography (CT) imaging characteristics. We evaluated the efficacy of atezolizumab and bevacizumab in 43 patients at the Nagasaki University Hospital from 2020 to 2022 using the modified Response Evaluation Criteria in Solid Tumors. A total of 197 Progressive Disease (PD), 271 Partial Response (PR), and 342 Stable Disease (SD) contrast CT images of HCC were used for training. We used ResNet-18 as the Convolutional Neural Network (CNN) model and YOLOv5, YOLOv7, YOLOv8 as the You Only Look Once (YOLO) model with precision-recall curves and class activation maps (CAMs) for diagnostic performance evaluation and model interpretation, respectively. The 3D t-distributed Stochastic Neighbor Embedding was used for image feature analysis. The YOLOv7 model demonstrated Precision 53.7%, Recall 100%, F1 score 69.8%, mAP@0.5 99.5% for PD, providing accurate and clinically versatile predictions by identifying decisive points. The ResNet-18 model had Precision 100% and Recall 100% for PD. However, the CAMs sites did not align with the tumors, suggesting the CNN model is not predicting that a given CT slice is PD, PR, or SD, but that it accurately predicts Individual Patient's CT slices. Preparing substantial training data for tumor drug effect prediction models is challenging compared to general tumor diagnosis models; hence, large-scale validation using an efficient YOLO model is warranted.
Collapse
Affiliation(s)
- Yasuhiko Nakao
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, 1-7-1 Sakamoto, Nagasaki City, Nagasaki, Japan.
| | - Takahito Nishihara
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, 1-7-1 Sakamoto, Nagasaki City, Nagasaki, Japan
- Department of Gastroenterology and Hepatology, Isahaya General Hospital, 24-1 Eishohigashimachi, Isahaya, Nagasaki, Japan
| | - Ryu Sasaki
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, 1-7-1 Sakamoto, Nagasaki City, Nagasaki, Japan
| | - Masanori Fukushima
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, 1-7-1 Sakamoto, Nagasaki City, Nagasaki, Japan
| | - Satoshi Miuma
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, 1-7-1 Sakamoto, Nagasaki City, Nagasaki, Japan
| | - Hisamitsu Miyaaki
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, 1-7-1 Sakamoto, Nagasaki City, Nagasaki, Japan
| | - Yuko Akazawa
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, 1-7-1 Sakamoto, Nagasaki City, Nagasaki, Japan
- Department of Histology and Cell Biology, Nagasaki University Graduate School of Biomedical Sciences, 1-12-4 Sakamoto, Nagasaki City, Nagasaki, Japan
| | - Kazuhiko Nakao
- Department of Gastroenterology and Hepatology, Nagasaki University Graduate School of Biomedical Sciences, 1-7-1 Sakamoto, Nagasaki City, Nagasaki, Japan
| |
Collapse
|
16
|
Tandon R, Agrawal S, Rathore NPS, Mishra AK, Jain SK. A systematic review on deep learning-based automated cancer diagnosis models. J Cell Mol Med 2024; 28:e18144. [PMID: 38426930 PMCID: PMC10906380 DOI: 10.1111/jcmm.18144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 12/08/2023] [Accepted: 01/16/2024] [Indexed: 03/02/2024] Open
Abstract
Deep learning is gaining importance due to its wide range of applications. Many researchers have utilized deep learning (DL) models for the automated diagnosis of cancer patients. This paper provides a systematic review of DL models for automated diagnosis of cancer patients. Initially, various DL models for cancer diagnosis are presented. Five major categories of cancers such as breast, lung, liver, brain and cervical cancer are considered. As these categories of cancers have a very high percentage of occurrences with high mortality rate. The comparative analysis of different types of DL models is drawn for the diagnosis of cancer at early stages by considering the latest research articles from 2016 to 2022. After comprehensive comparative analysis, it is found that most of the researchers achieved appreciable accuracy with implementation of the convolutional neural network model. These utilized the pretrained models for automated diagnosis of cancer patients. Various shortcomings with the existing DL-based automated cancer diagnosis models are also been presented. Finally, future directions are discussed to facilitate further research for automated diagnosis of cancer patients.
Collapse
Affiliation(s)
| | | | | | - Abhinava K. Mishra
- Molecular, Cellular and Developmental Biology DepartmentUniversity of California Santa BarbaraSanta BarbaraCaliforniaUSA
| | | |
Collapse
|
17
|
Zhang T, Yang F, Zhang P. Progress and clinical translation in hepatocellular carcinoma of deep learning in hepatic vascular segmentation. Digit Health 2024; 10:20552076241293498. [PMID: 39502486 PMCID: PMC11536605 DOI: 10.1177/20552076241293498] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2024] [Accepted: 10/03/2024] [Indexed: 11/08/2024] Open
Abstract
This paper reviews the advancements in deep learning for hepatic vascular segmentation and its clinical implications in the holistic management of hepatocellular carcinoma (HCC). The key to the diagnosis and treatment of HCC lies in imaging examinations, with the challenge in liver surgery being the precise assessment of Hepatic vasculature. In this regard, deep learning methods, including convolutional neural networksamong various other approaches, have significantly improved accuracy and speed. The review synthesizes findings from 30 studies, covering aspects such as network architectures, applications, supervision techniques, evaluation metrics, and motivations. Furthermore, we also examine the challenges and future prospects of deep learning technologies in enhancing the comprehensive diagnosis and treatment of HCC, discussing anticipated breakthroughs that could transform patient management. By combining clinical needs with technological advancements, deep learning is expected to make greater breakthroughs in the field of hepatic vascular segmentation, thereby providing stronger support for the diagnosis and treatment of HCC.
Collapse
Affiliation(s)
- Tianyang Zhang
- The First Hospital of Jilin University, Changchun, Jilin, China
| | - Feiyang Yang
- College of Computer Science and Technology, Jilin University, Changchun, China
| | - Ping Zhang
- The First Hospital of Jilin University, Changchun, Jilin, China
| |
Collapse
|
18
|
Han Q, Du L, Zhu L, Yu D. Review of the Application of Dual Drug Delivery Nanotheranostic Agents in the Diagnosis and Treatment of Liver Cancer. Molecules 2023; 28:7004. [PMID: 37894483 PMCID: PMC10608862 DOI: 10.3390/molecules28207004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2023] [Revised: 09/16/2023] [Accepted: 09/29/2023] [Indexed: 10/29/2023] Open
Abstract
Liver cancer has high incidence and mortality rates and its treatment generally requires the use of a combination treatment strategy. Therefore, the early detection and diagnosis of liver cancer is crucial to achieving the best treatment effect. In addition, it is imperative to explore multimodal combination therapy for liver cancer treatment and the synergistic effect of two liver cancer treatment drugs while preventing drug resistance and drug side effects to maximize the achievable therapeutic effect. Gold nanoparticles are used widely in applications related to optical imaging, CT imaging, MRI imaging, biomarkers, targeted drug therapy, etc., and serve as an advanced platform for integrated application in the nano-diagnosis and treatment of diseases. Dual-drug-delivery nano-diagnostic and therapeutic agents have drawn great interest in current times. Therefore, the present report aims to review the effectiveness of dual-drug-delivery nano-diagnostic and therapeutic agents in the field of anti-tumor therapy from the particular perspective of liver cancer diagnosis and treatment.
Collapse
Affiliation(s)
- Qinghe Han
- Radiology Department, The Second Affiliated Hospital of Jilin University, Changchun 130062, China; (Q.H.); (L.D.); (L.Z.)
| | - Lianze Du
- Radiology Department, The Second Affiliated Hospital of Jilin University, Changchun 130062, China; (Q.H.); (L.D.); (L.Z.)
| | - Lili Zhu
- Radiology Department, The Second Affiliated Hospital of Jilin University, Changchun 130062, China; (Q.H.); (L.D.); (L.Z.)
| | - Duo Yu
- Department of Radiotherapy, The Second Affiliated Hospital of Jilin University, Changchun 130062, China
| |
Collapse
|
19
|
Radiya K, Joakimsen HL, Mikalsen KØ, Aahlin EK, Lindsetmo RO, Mortensen KE. Performance and clinical applicability of machine learning in liver computed tomography imaging: a systematic review. Eur Radiol 2023; 33:6689-6717. [PMID: 37171491 PMCID: PMC10511359 DOI: 10.1007/s00330-023-09609-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Revised: 02/02/2023] [Accepted: 02/06/2023] [Indexed: 05/13/2023]
Abstract
OBJECTIVES Machine learning (ML) for medical imaging is emerging for several organs and image modalities. Our objectives were to provide clinicians with an overview of this field by answering the following questions: (1) How is ML applied in liver computed tomography (CT) imaging? (2) How well do ML systems perform in liver CT imaging? (3) What are the clinical applications of ML in liver CT imaging? METHODS A systematic review was carried out according to the guidelines from the PRISMA-P statement. The search string focused on studies containing content relating to artificial intelligence, liver, and computed tomography. RESULTS One hundred ninety-one studies were included in the study. ML was applied to CT liver imaging by image analysis without clinicians' intervention in majority of studies while in newer studies the fusion of ML method with clinical intervention have been identified. Several were documented to perform very accurately on reliable but small data. Most models identified were deep learning-based, mainly using convolutional neural networks. Potentially many clinical applications of ML to CT liver imaging have been identified through our review including liver and its lesion segmentation and classification, segmentation of vascular structure inside the liver, fibrosis and cirrhosis staging, metastasis prediction, and evaluation of chemotherapy. CONCLUSION Several studies attempted to provide transparent result of the model. To make the model convenient for a clinical application, prospective clinical validation studies are in urgent call. Computer scientists and engineers should seek to cooperate with health professionals to ensure this. KEY POINTS • ML shows great potential for CT liver image tasks such as pixel-wise segmentation and classification of liver and liver lesions, fibrosis staging, metastasis prediction, and retrieval of relevant liver lesions from similar cases of other patients. • Despite presenting the result is not standardized, many studies have attempted to provide transparent results to interpret the machine learning method performance in the literature. • Prospective studies are in urgent call for clinical validation of ML method, preferably carried out by cooperation between clinicians and computer scientists.
Collapse
Affiliation(s)
- Keyur Radiya
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway.
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway.
| | - Henrik Lykke Joakimsen
- Institute of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Centre for Clinical Artificial Intelligence (SPKI), University Hospital of North Norway, Tromso, Norway
| | - Karl Øyvind Mikalsen
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Centre for Clinical Artificial Intelligence (SPKI), University Hospital of North Norway, Tromso, Norway
- UiT Machine Learning Group, Department of Physics and Technology, UiT the Arctic University of Norway, Tromso, Norway
| | - Eirik Kjus Aahlin
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway
| | - Rolv-Ole Lindsetmo
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
- Head Clinic of Surgery, Oncology and Women Health, University Hospital of North Norway, Tromso, Norway
| | - Kim Erlend Mortensen
- Department of Gastroenterological Surgery at University Hospital of North Norway (UNN), Tromso, Norway
- Department of Clinical Medicine, UiT The Arctic University of Norway, Tromso, Norway
| |
Collapse
|
20
|
Lakshmipriya B, Pottakkat B, Ramkumar G. Deep learning techniques in liver tumour diagnosis using CT and MR imaging - A systematic review. Artif Intell Med 2023; 141:102557. [PMID: 37295904 DOI: 10.1016/j.artmed.2023.102557] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Revised: 04/15/2023] [Accepted: 04/18/2023] [Indexed: 06/12/2023]
Abstract
Deep learning has become a thriving force in the computer aided diagnosis of liver cancer, as it solves extremely complicated challenges with high accuracy over time and facilitates medical experts in their diagnostic and treatment procedures. This paper presents a comprehensive systematic review on deep learning techniques applied for various applications pertaining to liver images, challenges faced by the clinicians in liver tumour diagnosis and how deep learning bridges the gap between clinical practice and technological solutions with an in-depth summary of 113 articles. Since, deep learning is an emerging revolutionary technology, recent state-of-the-art research implemented on liver images are reviewed with more focus on classification, segmentation and clinical applications in the management of liver diseases. Additionally, similar review articles in literature are reviewed and compared. The review is concluded by presenting the contemporary trends and unaddressed research issues in the field of liver tumour diagnosis, offering directions for future research in this field.
Collapse
Affiliation(s)
- B Lakshmipriya
- Department of Surgical Gastroenterology, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India
| | - Biju Pottakkat
- Department of Surgical Gastroenterology, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India.
| | - G Ramkumar
- Department of Radio Diagnosis, Jawaharlal Institute of Postgraduate Medical Education and Research, Puducherry, India
| |
Collapse
|
21
|
Iqbal U, Imtiaz R, Saudagar AKJ, Alam KA. CRV-NET: Robust Intensity Recognition of Coronavirus in Lung Computerized Tomography Scan Images. Diagnostics (Basel) 2023; 13:diagnostics13101783. [PMID: 37238266 DOI: 10.3390/diagnostics13101783] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Revised: 05/01/2023] [Accepted: 05/10/2023] [Indexed: 05/28/2023] Open
Abstract
The early diagnosis of infectious diseases is demanded by digital healthcare systems. Currently, the detection of the new coronavirus disease (COVID-19) is a major clinical requirement. For COVID-19 detection, deep learning models are used in various studies, but the robustness is still compromised. In recent years, deep learning models have increased in popularity in almost every area, particularly in medical image processing and analysis. The visualization of the human body's internal structure is critical in medical analysis; many imaging techniques are in use to perform this job. A computerized tomography (CT) scan is one of them, and it has been generally used for the non-invasive observation of the human body. The development of an automatic segmentation method for lung CT scans showing COVID-19 can save experts time and can reduce human error. In this article, the CRV-NET is proposed for the robust detection of COVID-19 in lung CT scan images. A public dataset (SARS-CoV-2 CT Scan dataset), is used for the experimental work and customized according to the scenario of the proposed model. The proposed modified deep-learning-based U-Net model is trained on a custom dataset with 221 training images and their ground truth, which was labeled by an expert. The proposed model is tested on 100 test images, and the results show that the model segments COVID-19 with a satisfactory level of accuracy. Moreover, the comparison of the proposed CRV-NET with different state-of-the-art convolutional neural network models (CNNs), including the U-Net Model, shows better results in terms of accuracy (96.67%) and robustness (low epoch value in detection and the smallest training data size).
Collapse
Affiliation(s)
- Uzair Iqbal
- Department of Artificial Intelligence and Data Science, National University of Computer and Emerging Sciences, Islamabad Campus, Islamabad 44000, Pakistan
| | - Romil Imtiaz
- Information and Communication Engineering, Northwestern Polytechnical University, Xi'an 710072, China
| | - Abdul Khader Jilani Saudagar
- Information Systems Department, College of Computer and Information Sciences, Imam Mohammad Ibn Saud Islamic University (IMSIU), Riyadh 11432, Saudi Arabia
| | - Khubaib Amjad Alam
- Department of Software Engineering, National University of Computer and Emerging Sciences, Islamabad Campus, Islamabad 44000, Pakistan
| |
Collapse
|
22
|
ExpACVO-Hybrid Deep learning: Exponential Anti Corona Virus Optimization enabled Hybrid Deep learning for tongue image segmentation towards diabetes mellitus detection. Biomed Signal Process Control 2023; 83:104635. [PMID: 36741196 PMCID: PMC9886667 DOI: 10.1016/j.bspc.2023.104635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Revised: 12/26/2022] [Accepted: 01/25/2023] [Indexed: 02/01/2023]
Abstract
A metabolic disease known as diabetes mellitus (DM) is primarily brought on by an increase in blood sugar levels. On the other hand, DM and the complications it causes, such as diabetic Retinopathy (DR), will quickly emerge as one of the major health challenges of the twenty-first century. This indicates a huge economic burden on health-related authorities and governments. The detection of DM in the earlier stage can lead to early diagnosis and a considerable drop in mortality. Therefore, in order to detect DM at an early stage, an efficient detection system having the ability to detect DM is required. An effective classification method, named Exponential Anti Corona Virus Optimization (ExpACVO) is devised in this research work for Diabetes Mellitus (DM) detection using tongue images. Here, the UNet-Conditional Random Field-Recurrent Neural Network (UNet-CRF-RNN) is used to segment the images, and the proposed ExpACVO algorithm is used to train the UNet-CRF-RNN. Deep Q Network (DQN) classifier is used for DM detection, and the proposed ExpACVO is used for DQN training. The proposed ExpACVO algorithm is a newly created formula that combines Anti Corona Virus Optimization(ACVO) with Exponential Weighted Moving Average (EWMA). With maximum testing accuracy, sensitivity, and specificity values of 0.932, 0.950, and 0.914, respectively, the developed technique thus achieved improved performance.
Collapse
|
23
|
Berbís MA, Paulano Godino F, Royuela del Val J, Alcalá Mata L, Luna A. Clinical impact of artificial intelligence-based solutions on imaging of the pancreas and liver. World J Gastroenterol 2023; 29:1427-1445. [PMID: 36998424 PMCID: PMC10044858 DOI: 10.3748/wjg.v29.i9.1427] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/28/2022] [Revised: 01/13/2023] [Accepted: 02/27/2023] [Indexed: 03/07/2023] Open
Abstract
Artificial intelligence (AI) has experienced substantial progress over the last ten years in many fields of application, including healthcare. In hepatology and pancreatology, major attention to date has been paid to its application to the assisted or even automated interpretation of radiological images, where AI can generate accurate and reproducible imaging diagnosis, reducing the physicians’ workload. AI can provide automatic or semi-automatic segmentation and registration of the liver and pancreatic glands and lesions. Furthermore, using radiomics, AI can introduce new quantitative information which is not visible to the human eye to radiological reports. AI has been applied in the detection and characterization of focal lesions and diffuse diseases of the liver and pancreas, such as neoplasms, chronic hepatic disease, or acute or chronic pancreatitis, among others. These solutions have been applied to different imaging techniques commonly used to diagnose liver and pancreatic diseases, such as ultrasound, endoscopic ultrasonography, computerized tomography (CT), magnetic resonance imaging, and positron emission tomography/CT. However, AI is also applied in this context to many other relevant steps involved in a comprehensive clinical scenario to manage a gastroenterological patient. AI can also be applied to choose the most convenient test prescription, to improve image quality or accelerate its acquisition, and to predict patient prognosis and treatment response. In this review, we summarize the current evidence on the application of AI to hepatic and pancreatic radiology, not only in regard to the interpretation of images, but also to all the steps involved in the radiological workflow in a broader sense. Lastly, we discuss the challenges and future directions of the clinical application of AI methods.
Collapse
Affiliation(s)
- M Alvaro Berbís
- Department of Radiology, HT Médica, San Juan de Dios Hospital, Córdoba 14960, Spain
- Faculty of Medicine, Autonomous University of Madrid, Madrid 28049, Spain
| | | | | | - Lidia Alcalá Mata
- Department of Radiology, HT Médica, Clínica las Nieves, Jaén 23007, Spain
| | - Antonio Luna
- Department of Radiology, HT Médica, Clínica las Nieves, Jaén 23007, Spain
| |
Collapse
|
24
|
Deep Fuzzy SegNet-based lung nodule segmentation and optimized deep learning for lung cancer detection. Pattern Anal Appl 2023. [DOI: 10.1007/s10044-023-01135-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/25/2023]
|
25
|
An efficient classification of cirrhosis liver disease using hybrid convolutional neural network-capsule network. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.104152] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
26
|
Savjani RR, Lauria M, Bose S, Deng J, Yuan Y, Andrearczyk V. Automated Tumor Segmentation in Radiotherapy. Semin Radiat Oncol 2022; 32:319-329. [DOI: 10.1016/j.semradonc.2022.06.002] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
27
|
CEDRNN: A Convolutional Encoder-Decoder Residual Neural Network for Liver Tumour Segmentation. Neural Process Lett 2022. [DOI: 10.1007/s11063-022-10953-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/17/2022]
|
28
|
Painuli D, Bhardwaj S, Köse U. Recent advancement in cancer diagnosis using machine learning and deep learning techniques: A comprehensive review. Comput Biol Med 2022; 146:105580. [PMID: 35551012 DOI: 10.1016/j.compbiomed.2022.105580] [Citation(s) in RCA: 49] [Impact Index Per Article: 16.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2022] [Revised: 04/14/2022] [Accepted: 04/30/2022] [Indexed: 02/07/2023]
Abstract
Being a second most cause of mortality worldwide, cancer has been identified as a perilous disease for human beings, where advance stage diagnosis may not help much in safeguarding patients from mortality. Thus, efforts to provide a sustainable architecture with proven cancer prevention estimate and provision for early diagnosis of cancer is the need of hours. Advent of machine learning methods enriched cancer diagnosis area with its overwhelmed efficiency & low error-rate then humans. A significant revolution has been witnessed in the development of machine learning & deep learning assisted system for segmentation & classification of various cancers during past decade. This research paper includes a review of various types of cancer detection via different data modalities using machine learning & deep learning-based methods along with different feature extraction techniques and benchmark datasets utilized in the recent six years studies. The focus of this study is to review, analyse, classify, and address the recent development in cancer detection and diagnosis of six types of cancers i.e., breast, lung, liver, skin, brain and pancreatic cancer, using machine learning & deep learning techniques. Various state-of-the-art technique are clustered into same group and results are examined through key performance indicators like accuracy, area under the curve, precision, sensitivity, dice score on benchmark datasets and concluded with future research work challenges.
Collapse
Affiliation(s)
- Deepak Painuli
- Department of Computer Science and Engineering, Gurukula Kangri Vishwavidyalaya, Haridwar, India.
| | - Suyash Bhardwaj
- Department of Computer Science and Engineering, Gurukula Kangri Vishwavidyalaya, Haridwar, India
| | - Utku Köse
- Department of Computer Engineering, Suleyman Demirel University, Isparta, Turkey
| |
Collapse
|
29
|
Christou CD, Tsoulfas G. Role of three-dimensional printing and artificial intelligence in the management of hepatocellular carcinoma: Challenges and opportunities. World J Gastrointest Oncol 2022; 14:765-793. [PMID: 35582107 PMCID: PMC9048537 DOI: 10.4251/wjgo.v14.i4.765] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/15/2021] [Revised: 08/24/2021] [Accepted: 03/25/2022] [Indexed: 02/06/2023] Open
Abstract
Hepatocellular carcinoma (HCC) constitutes the fifth most frequent malignancy worldwide and the third most frequent cause of cancer-related deaths. Currently, treatment selection is based on the stage of the disease. Emerging fields such as three-dimensional (3D) printing, 3D bioprinting, artificial intelligence (AI), and machine learning (ML) could lead to evidence-based, individualized management of HCC. In this review, we comprehensively report the current applications of 3D printing, 3D bioprinting, and AI/ML-based models in HCC management; we outline the significant challenges to the broad use of these novel technologies in the clinical setting with the goal of identifying means to overcome them, and finally, we discuss the opportunities that arise from these applications. Notably, regarding 3D printing and bioprinting-related challenges, we elaborate on cost and cost-effectiveness, cell sourcing, cell viability, safety, accessibility, regulation, and legal and ethical concerns. Similarly, regarding AI/ML-related challenges, we elaborate on intellectual property, liability, intrinsic biases, data protection, cybersecurity, ethical challenges, and transparency. Our findings show that AI and 3D printing applications in HCC management and healthcare, in general, are steadily expanding; thus, these technologies will be integrated into the clinical setting sooner or later. Therefore, we believe that physicians need to become familiar with these technologies and prepare to engage with them constructively.
Collapse
Affiliation(s)
- Chrysanthos D Christou
- Department of Transplantation Surgery, Hippokration General Hospital, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki 54622, Greece
| | - Georgios Tsoulfas
- Department of Transplantation Surgery, Hippokration General Hospital, School of Medicine, Aristotle University of Thessaloniki, Thessaloniki 54622, Greece
| |
Collapse
|
30
|
Amin J, Anjum MA, Sharif M, Kadry S, Nadeem A, Ahmad SF. Liver Tumor Localization Based on YOLOv3 and 3D-Semantic Segmentation Using Deep Neural Networks. Diagnostics (Basel) 2022; 12:diagnostics12040823. [PMID: 35453870 PMCID: PMC9025116 DOI: 10.3390/diagnostics12040823] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Revised: 03/18/2022] [Accepted: 03/22/2022] [Indexed: 12/17/2022] Open
Abstract
Worldwide, more than 1.5 million deaths are occur due to liver cancer every year. The use of computed tomography (CT) for early detection of liver cancer could save millions of lives per year. There is also an urgent need for a computerized method to interpret, detect and analyze CT scans reliably, easily, and correctly. However, precise segmentation of minute tumors is a difficult task because of variation in the shape, intensity, size, low contrast of the tumor, and the adjacent tissues of the liver. To address these concerns, a model comprised of three parts: synthetic image generation, localization, and segmentation, is proposed. An optimized generative adversarial network (GAN) is utilized for generation of synthetic images. The generated images are localized by using the improved localization model, in which deep features are extracted from pre-trained Resnet-50 models and fed into a YOLOv3 detector as an input. The proposed modified model localizes and classifies the minute liver tumor with 0.99 mean average precision (mAp). The third part is segmentation, in which pre-trained Inceptionresnetv2 employed as a base-Network of Deeplabv3 and subsequently is trained on fine-tuned parameters with annotated ground masks. The experiments reflect that the proposed approach has achieved greater than 95% accuracy in the testing phase and it is proven that, in comparison to the recently published work in this domain, this research has localized and segmented the liver and minute liver tumor with more accuracy.
Collapse
Affiliation(s)
- Javaria Amin
- Department of Computer Science, University of Wah, Wah Cantt 47040, Pakistan;
| | | | - Muhammad Sharif
- Department of Computer Science, Comsats University Islamabad, Wah Campus, Wah Cantt 47040, Pakistan;
| | - Seifedine Kadry
- Department of Applied Data Science, Noroff University College, 4609 Kristiansand, Norway
- Correspondence:
| | - Ahmed Nadeem
- Department of Pharmacology & Toxicology, College of Pharmacy, King Saud University, P.O. Box 2455, Riyadh 11451, Saudi Arabia; (A.N.); (S.F.A.)
| | - Sheikh F. Ahmad
- Department of Pharmacology & Toxicology, College of Pharmacy, King Saud University, P.O. Box 2455, Riyadh 11451, Saudi Arabia; (A.N.); (S.F.A.)
| |
Collapse
|
31
|
A scene segmentation algorithm combining the body and the edge of the object. Inf Process Manag 2022. [DOI: 10.1016/j.ipm.2021.102840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
32
|
Li Y, Xu Z, An C, Chen H, Li X. Multi-Task Deep Learning Approach for Simultaneous Objective Response Prediction and Tumor Segmentation in HCC Patients with Transarterial Chemoembolization. J Pers Med 2022; 12:jpm12020248. [PMID: 35207736 PMCID: PMC8875107 DOI: 10.3390/jpm12020248] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2021] [Revised: 02/01/2022] [Accepted: 02/08/2022] [Indexed: 12/24/2022] Open
Abstract
This study aimed to develop a deep learning-based model to simultaneously perform the objective response (OR) and tumor segmentation for hepatocellular carcinoma (HCC) patients who underwent transarterial chemoembolization (TACE) treatment. A total of 248 patients from two hospitals were retrospectively included and divided into the training, internal validation, and external testing cohort. A network consisting of an encoder pathway, a prediction pathway, and a segmentation pathway was developed, and named multi-DL (multi-task deep learning), using contrast-enhanced CT images as input. We compared multi-DL with other deep learning-based OR prediction and tumor segmentation methods to explore the incremental value of introducing the interconnected task into a unified network. Additionally, the clinical model was developed using multivariate logistic regression to predict OR. Results showed that multi-DL could achieve the highest AUC of 0.871 in OR prediction and the highest dice coefficient of 73.6% in tumor segmentation. Furthermore, multi-DL can successfully perform the risk stratification that the low-risk and high-risk patients showed a significant difference in survival (p = 0.006). In conclusion, the proposed method may provide a useful tool for therapeutic regime selection in clinical practice.
Collapse
Affiliation(s)
- Yuze Li
- Center for Biomedical Imaging Research, School of Medicine, Tsinghua University, Beijing 100084, China; (Y.L.); (Z.X.)
| | - Ziming Xu
- Center for Biomedical Imaging Research, School of Medicine, Tsinghua University, Beijing 100084, China; (Y.L.); (Z.X.)
| | - Chao An
- Department of Minimal Invasive Intervention, Sun Yat-sen University Cancer Center, Guangzhou 510060, China;
| | - Huijun Chen
- Center for Biomedical Imaging Research, School of Medicine, Tsinghua University, Beijing 100084, China; (Y.L.); (Z.X.)
- Correspondence: (H.C.); (X.L.)
| | - Xiao Li
- Department of Interventional Therapy, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing 100021, China
- Correspondence: (H.C.); (X.L.)
| |
Collapse
|
33
|
Sahli H, Ben Slama A, Labidi S. U-Net: A valuable encoder-decoder architecture for liver tumors segmentation in CT images. JOURNAL OF X-RAY SCIENCE AND TECHNOLOGY 2022; 30:45-56. [PMID: 34806644 DOI: 10.3233/xst-210993] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
This study proposes a new predictive segmentation method for liver tumors detection using computed tomography (CT) liver images. In the medical imaging field, the exact localization of metastasis lesions after acquisition faces persistent problems both for diagnostic aid and treatment effectiveness. Therefore, the improvement in the diagnostic process is substantially crucial in order to increase the success chance of the management and the therapeutic follow-up. The proposed procedure highlights a computerized approach based on an encoder-decoder structure in order to provide volumetric analysis of pathologic tumors. Specifically, we developed an automatic algorithm for the liver tumors defect segmentation through the Seg-Net and U-Net architectures from metastasis CT images. In this study, we collected a dataset of 200 pathologically confirmed metastasis cancer cases. A total of 8,297 CT image slices of these cases were used developing and optimizing the proposed segmentation architecture. The model was trained and validated using 170 and 30 cases or 85% and 15% of the CT image data, respectively. Study results demonstrate the strength of the proposed approach that reveals the superlative segmentation performance as evaluated using following indices including F1-score = 0.9573, Recall = 0.9520, IOU = 0.9654, Binary cross entropy = 0.0032 and p-value <0.05, respectively. In comparison to state-of-the-art techniques, the proposed method yields a higher precision rate by specifying metastasis tumor position.
Collapse
Affiliation(s)
- Hanene Sahli
- Laboratory of Signal Image and Energy Mastery (SIME), LR13ES03, University of Tunis, ENSIT, 1008, Tunis, Tunisia
| | - Amine Ben Slama
- Laboratory of Biophysics and Medical Technologies, LR13ES07, University of Tunis EL Manar, ISTMT, 1006, Tunis, Tunisia
| | - Salam Labidi
- Laboratory of Biophysics and Medical Technologies, LR13ES07, University of Tunis EL Manar, ISTMT, 1006, Tunis, Tunisia
| |
Collapse
|
34
|
Segnet Network Algorithm-Based Ultrasound Images in the Diagnosis of Gallbladder Stones Complicated with Gallbladder Carcinoma and the Relationship between P16 Expression with Gallbladder Carcinoma. JOURNAL OF HEALTHCARE ENGINEERING 2022; 2021:2819986. [PMID: 34970422 PMCID: PMC8714339 DOI: 10.1155/2021/2819986] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Revised: 11/28/2021] [Accepted: 12/01/2021] [Indexed: 11/17/2022]
Abstract
The study focused on how to improve the diagnostic coincidence rate of patients with gallbladder stones and gallbladder cancer based on an optimized Segnet network algorithm and the relationship of gallbladder cancer with multiple tumor suppressor 1 (P16). 300 patients diagnosed with gallbladder cancer in the hospital were selected as the research subjects. The pyramid pooling operation was incorporated into the original Segnet network algorithm, and its performance was evaluated, factoring into the intersection of union (IoU), algorithm precision (Pre), and recall rate (Recall). After 8 hours of fasting, conventional ultrasound and contrast-enhanced ultrasound examinations were performed, and the images were evaluated by three experienced ultrasound diagnosticians. The positive signal of P16 immunohistochemical staining was brownish yellow, which was generally concentrated in the nucleus, and a small part was located in the cytoplasm. In each slice, ten visual fields were selected. Then, they were observed under a high-power mirror, and the number was counted. It was found that the optimized Segnet network algorithm increased the IoU by 7.3%, the precision by 8.2%, and the recall rate by 11.1%. The diagnostic coincidence rates of conventional ultrasound and contrast-enhanced ultrasound examinations for gallbladder cancer were 78.13% (25/32) and 87.5% (25/32), respectively. The positive expression rate of P16 in gallbladder adenocarcinoma (47.06%) was significantly lower than that of acute cholecystitis with gallbladder stones (84.38%) and gallbladder polyps (67.16%) (P < 0.05). The positive expression rate of P16 in patients with stage III and stage IV (33.33% and 40%) was significantly lower than that in patients with stages I and II (87.5% and 80%) (P < 0.05). The positive expression rate of P16 in high differentiation (86.67%) was significantly higher than that of moderate differentiation (40%) and poor differentiation (28.57%) (P < 0.05). In short, contrast-enhanced ultrasound can effectively improve the diagnostic coincidence rate of gallbladder cancer, and the expression of P16 in gallbladder cancer is closely related to tumor staging and differentiation.
Collapse
|
35
|
Ahn JC, Qureshi TA, Singal AG, Li D, Yang JD. Deep learning in hepatocellular carcinoma: Current status and future perspectives. World J Hepatol 2021; 13:2039-2051. [PMID: 35070007 PMCID: PMC8727204 DOI: 10.4254/wjh.v13.i12.2039] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 07/19/2021] [Accepted: 11/15/2021] [Indexed: 02/06/2023] Open
Abstract
Hepatocellular carcinoma (HCC) is among the leading causes of cancer incidence and death. Despite decades of research and development of new treatment options, the overall outcomes of patients with HCC continue to remain poor. There are areas of unmet need in risk prediction, early diagnosis, accurate prognostication, and individualized treatments for patients with HCC. Recent years have seen an explosive growth in the application of artificial intelligence (AI) technology in medical research, with the field of HCC being no exception. Among the various AI-based machine learning algorithms, deep learning algorithms are considered state-of-the-art techniques for handling and processing complex multimodal data ranging from routine clinical variables to high-resolution medical images. This article will provide a comprehensive review of the recently published studies that have applied deep learning for risk prediction, diagnosis, prognostication, and treatment planning for patients with HCC.
Collapse
Affiliation(s)
- Joseph C Ahn
- Gastroenterology and Hepatology, Mayo Clinic, Rochester, MN 55904, United States
| | - Touseef Ahmad Qureshi
- Biomedical Imaging Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA 90048, United States
| | - Amit G Singal
- Internal Medicine, University of Texas Southwestern Medical Center, Dallas, TX 75390, United States
| | - Debiao Li
- Biomedical Imaging Research Institute, Cedars-Sinai Medical Center, Los Angeles, CA 90048, United States
| | - Ju-Dong Yang
- Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, Los Angeles, CA 90048, United States
| |
Collapse
|
36
|
Chen X, Wei X, Tang M, Liu A, Lai C, Zhu Y, He W. Liver segmentation in CT imaging with enhanced mask region-based convolutional neural networks. ANNALS OF TRANSLATIONAL MEDICINE 2021; 9:1768. [PMID: 35071462 PMCID: PMC8756208 DOI: 10.21037/atm-21-5822] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/21/2021] [Accepted: 12/06/2021] [Indexed: 11/10/2022]
Abstract
BACKGROUND Liver segmentation in computed tomography (CT) imaging has been widely investigated as a crucial step for analyzing liver characteristics and diagnosing liver diseases. However, obtaining satisfactory liver segmentation performance is highly challenging because of the poor contrast between the liver and its surrounding organs and tissues, the high levels of CT image noise, and the wide variability in liver shapes among patients. METHODS To overcome these challenges, we propose a novel method for liver segmentation in CT image sequences. This method uses an enhanced mask region-based convolutional neural network (Mask R-CNN) with graph-cut segmentation. Specifically, the k-nearest neighbor (k-NN) algorithm is employed to cluster the target liver pixels in order to get an appropriate aspect ratio. Then, anchors are adapted to the liver size using the ratio information. Thus, high-accuracy liver localization can be achieved using the anchors and rotation-invariant object recognition. Next, a fully convolutional network (FCN) is used to segment the foreground objects, and local fine-grained liver detection is realized by pixel prediction. Finally, a whole liver mask is obtained by Mask R-CNN proposed in this paper. RESULTS We proposed a Mask R-CNN algorithm which achieved superior performance in comparison with the conventional Mask R-CNN algorithms in term of the dice similarity coefficient (DSC), and the Medical Image Computing and Computer-Assisted Intervention (MICCAI) metrics. CONCLUSIONS Our experimental results demonstrate that the improved Mask R-CNN architecture has good performance, accuracy, and robustness for liver segmentation in CT image sequences.
Collapse
Affiliation(s)
- Xiaowen Chen
- School of Medical Imaging, North Sichuan Medical College, Nanchong, China
| | - Xiaoqin Wei
- School of Medical Imaging, North Sichuan Medical College, Nanchong, China
| | - Mingyue Tang
- Department of Physics, School of Basic Medicine, North Sichuan Medical College, Nanchong, China
| | - Aimin Liu
- School of Medical Imaging, North Sichuan Medical College, Nanchong, China
| | - Ce Lai
- School of Medical Imaging, North Sichuan Medical College, Nanchong, China
| | - Yuanzhong Zhu
- School of Medical Imaging, North Sichuan Medical College, Nanchong, China
| | - Wenjing He
- School of Medical Imaging, North Sichuan Medical College, Nanchong, China
| |
Collapse
|
37
|
Kaur A, Kaur L, Singh A. GA-UNet: UNet-based framework for segmentation of 2D and 3D medical images applicable on heterogeneous datasets. Neural Comput Appl 2021. [DOI: 10.1007/s00521-021-06134-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/19/2022]
|
38
|
Multi-Resolution Image Segmentation Based on a Cascaded U-ADenseNet for the Liver and Tumors. J Pers Med 2021; 11:jpm11101044. [PMID: 34683185 PMCID: PMC8541015 DOI: 10.3390/jpm11101044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Revised: 10/15/2021] [Accepted: 10/18/2021] [Indexed: 11/17/2022] Open
Abstract
The liver is an irreplaceable organ in the human body, maintaining life activities and metabolism. Malignant tumors of the liver have a high mortality rate at present. Computer-aided segmentation of the liver and tumors has significant effects on clinical diagnosis and treatment. There are still many challenges in the segmentation of the liver and liver tumors simultaneously, such as, on the one hand, that convolutional kernels with fixed geometric structures do not match complex, irregularly shaped targets; on the other, pooling during convolution results in a loss of spatial contextual information of images. In this work, we designed a cascaded U-ADenseNet with coarse-to-fine processing for addressing the above issues of fully automatic segmentation. This work contributes multi-resolution input images and multi-layered channel attention combined with atrous spatial pyramid pooling densely connected in the fine segmentation. The proposed model was evaluated by a public dataset of the Liver Tumor Segmentation Challenge (LiTS). Our approach attained competitive liver and tumor segmentation scores that exceeded other methods across a wide range of metrics.
Collapse
|
39
|
Herrmann P, Busana M, Cressoni M, Lotz J, Moerer O, Saager L, Meissner K, Quintel M, Gattinoni L. Using Artificial Intelligence for Automatic Segmentation of CT Lung Images in Acute Respiratory Distress Syndrome. Front Physiol 2021; 12:676118. [PMID: 34594233 PMCID: PMC8476971 DOI: 10.3389/fphys.2021.676118] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2021] [Accepted: 08/17/2021] [Indexed: 01/17/2023] Open
Abstract
Knowledge of gas volume, tissue mass and recruitability measured by the quantitative CT scan analysis (CT-qa) is important when setting the mechanical ventilation in acute respiratory distress syndrome (ARDS). Yet, the manual segmentation of the lung requires a considerable workload. Our goal was to provide an automatic, clinically applicable and reliable lung segmentation procedure. Therefore, a convolutional neural network (CNN) was used to train an artificial intelligence (AI) algorithm on 15 healthy subjects (1,302 slices), 100 ARDS patients (12,279 slices), and 20 COVID-19 (1,817 slices). Eighty percent of this populations was used for training, 20% for testing. The AI and manual segmentation at slice level were compared by intersection over union (IoU). The CT-qa variables were compared by regression and Bland Altman analysis. The AI-segmentation of a single patient required 5–10 s vs. 1–2 h of the manual. At slice level, the algorithm showed on the test set an IOU across all CT slices of 91.3 ± 10.0, 85.2 ± 13.9, and 84.7 ± 14.0%, and across all lung volumes of 96.3 ± 0.6, 88.9 ± 3.1, and 86.3 ± 6.5% for normal lungs, ARDS and COVID-19, respectively, with a U-shape in the performance: better in the lung middle region, worse at the apex and base. At patient level, on the test set, the total lung volume measured by AI and manual segmentation had a R2 of 0.99 and a bias −9.8 ml [CI: +56.0/−75.7 ml]. The recruitability measured with manual and AI-segmentation, as change in non-aerated tissue fraction had a bias of +0.3% [CI: +6.2/−5.5%] and −0.5% [CI: +2.3/−3.3%] expressed as change in well-aerated tissue fraction. The AI-powered lung segmentation provided fast and clinically reliable results. It is able to segment the lungs of seriously ill ARDS patients fully automatically.
Collapse
Affiliation(s)
- Peter Herrmann
- Department of Anesthesiology, University Medical Center Göttingen, Göttingen, Germany
| | - Mattia Busana
- Department of Anesthesiology, University Medical Center Göttingen, Göttingen, Germany
| | | | - Joachim Lotz
- Institute for Diagnostic and Interventional Radiology, University Medical Center Göttingen, Göttingen, Germany
| | - Onnen Moerer
- Department of Anesthesiology, University Medical Center Göttingen, Göttingen, Germany
| | - Leif Saager
- Department of Anesthesiology, University Medical Center Göttingen, Göttingen, Germany
| | - Konrad Meissner
- Department of Anesthesiology, University Medical Center Göttingen, Göttingen, Germany
| | - Michael Quintel
- Department of Anesthesiology, University Medical Center Göttingen, Göttingen, Germany.,Department of Anesthesiology, DONAUISAR Klinikum Deggendorf, Deggendorf, Germany
| | - Luciano Gattinoni
- Department of Anesthesiology, University Medical Center Göttingen, Göttingen, Germany
| |
Collapse
|
40
|
Bakasa W, Viriri S. Pancreatic Cancer Survival Prediction: A Survey of the State-of-the-Art. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:1188414. [PMID: 34630626 PMCID: PMC8497168 DOI: 10.1155/2021/1188414] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/28/2021] [Revised: 08/24/2021] [Accepted: 09/18/2021] [Indexed: 12/22/2022]
Abstract
Cancer early detection increases the chances of survival. Some cancer types, like pancreatic cancer, are challenging to diagnose or detect early, and the stages have a fast progression rate. This paper presents the state-of-the-art techniques used in cancer survival prediction, suggesting how these techniques can be implemented in predicting the overall survival of pancreatic ductal adenocarcinoma cancer (pdac) patients. Because of bewildering and high volumes of data, the recent studies highlight the importance of machine learning (ML) algorithms like support vector machines and convolutional neural networks. Studies predict pancreatic ductal adenocarcinoma cancer (pdac) survival is within the limits of 41.7% at one year, 8.7% at three years, and 1.9% at five years. There is no significant correlation found between the disease stages and the overall survival rate. The implementation of ML algorithms can improve our understanding of cancer progression. ML methods need an appropriate level of validation to be considered in everyday clinical practice. The objective of these techniques is to perform classification, prediction, and estimation. Accurate predictions give pathologists information on the patient's state, surgical treatment to be done, optimal use of resources, individualized therapy, drugs to prescribe, and better patient management.
Collapse
Affiliation(s)
- Wilson Bakasa
- School of Mathematics, Statistics and Computer Science, University of KwaZulu-Natal, Durban, South Africa
| | - Serestina Viriri
- School of Mathematics, Statistics and Computer Science, University of KwaZulu-Natal, Durban, South Africa
| |
Collapse
|
41
|
Wang X, Wang T, Zheng Y, Yin X. Hyperspectral-attention mechanism-based improvement of radiomics prediction method for primary liver cancer. Photodiagnosis Photodyn Ther 2021; 36:102486. [PMID: 34411737 DOI: 10.1016/j.pdpdt.2021.102486] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 08/13/2021] [Indexed: 10/20/2022]
Abstract
OBJECTIVE To improve the accuracy of the prediction of primary liver cancer by radiomics employing non invasive hyperspectral imaging technology. METHODS This retrospective study was approved by the IRB committee of our institution, and the rule of informed consent was put forward. This paper analyzes the hyperspectral images (HSI) of patients with primary liver cancer and finds that the spectral reflectance curve of tumor and non-tumor locations are significantly different at different wavelengths. By using the ISODATA algorithm to predict tumor, it is found that the result is obvious. It is speculated that the use of HSI to select computed tomography (CT) images can improve the accuracy of radiomics in the prediction of primary liver cancer. Therefore, we employed HSI in combination with radiomic features to complete this task. We use the attention mechanism to concentrate computing resources into highly correlated features and use these features to predict tumor. RESULTS Using the hyperspectral-attention mechanism feature selection method, we were able to achieve an AUC of 0.96. Our study shows that HSI and radiomic features could aid in the prediction of liver cancer.
Collapse
Affiliation(s)
- Xuehu Wang
- College of Electronic and Information Engineering, Hebei University, China; Research Center of Machine Vision Engineering & Technology of Hebei Province, China; Key Laboratory of Digital Medical Engineering of Hebei Province, China.
| | - Tianqi Wang
- College of Electronic and Information Engineering, Hebei University, China; Research Center of Machine Vision Engineering & Technology of Hebei Province, China; Key Laboratory of Digital Medical Engineering of Hebei Province, China
| | - Yongchang Zheng
- Department of Liver Surgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College (CAMS & PUMC), Beijing 100010, China
| | - Xiaoping Yin
- Affiliated Hospital of Hebei University, Baoding 071000, China
| |
Collapse
|
42
|
Boundary Loss-Based 2.5D Fully Convolutional Neural Networks Approach for Segmentation: A Case Study of the Liver and Tumor on Computed Tomography. ALGORITHMS 2021. [DOI: 10.3390/a14050144] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
Image segmentation plays an important role in the field of image processing, helping to understand images and recognize objects. However, most existing methods are often unable to effectively explore the spatial information in 3D image segmentation, and they neglect the information from the contours and boundaries of the observed objects. In addition, shape boundaries can help to locate the positions of the observed objects, but most of the existing loss functions neglect the information from the boundaries. To overcome these shortcomings, this paper presents a new cascaded 2.5D fully convolutional networks (FCNs) learning framework to segment 3D medical images. A new boundary loss that incorporates distance, area, and boundary information is also proposed for the cascaded FCNs to learning more boundary and contour features from the 3D medical images. Moreover, an effective post-processing method is developed to further improve the segmentation accuracy. We verified the proposed method on LITS and 3DIRCADb datasets that include the liver and tumors. The experimental results show that the performance of the proposed method is better than existing methods with a Dice Per Case score of 74.5% for tumor segmentation, indicating the effectiveness of the proposed method.
Collapse
|
43
|
Lai CC, Wang HK, Wang FN, Peng YC, Lin TP, Peng HH, Shen SH. Autosegmentation of Prostate Zones and Cancer Regions from Biparametric Magnetic Resonance Images by Using Deep-Learning-Based Neural Networks. SENSORS 2021; 21:s21082709. [PMID: 33921451 PMCID: PMC8070192 DOI: 10.3390/s21082709] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 04/01/2021] [Accepted: 04/09/2021] [Indexed: 12/21/2022]
Abstract
The accuracy in diagnosing prostate cancer (PCa) has increased with the development of multiparametric magnetic resonance imaging (mpMRI). Biparametric magnetic resonance imaging (bpMRI) was found to have a diagnostic accuracy comparable to mpMRI in detecting PCa. However, prostate MRI assessment relies on human experts and specialized training with considerable inter-reader variability. Deep learning may be a more robust approach for prostate MRI assessment. Here we present a method for autosegmenting the prostate zone and cancer region by using SegNet, a deep convolution neural network (DCNN) model. We used PROSTATEx dataset to train the model and combined different sequences into three channels of a single image. For each subject, all slices that contained the transition zone (TZ), peripheral zone (PZ), and PCa region were selected. The datasets were produced using different combinations of images, including T2-weighted (T2W) images, diffusion-weighted images (DWI) and apparent diffusion coefficient (ADC) images. Among these groups, the T2W + DWI + ADC images exhibited the best performance with a dice similarity coefficient of 90.45% for the TZ, 70.04% for the PZ, and 52.73% for the PCa region. Image sequence analysis with a DCNN model has the potential to assist PCa diagnosis.
Collapse
Affiliation(s)
- Chih-Ching Lai
- Department of Biomedical Engineering and Environmental Sciences, National Tsing Hua University, Hsinchu 300044, Taiwan; (C.-C.L.); (F.-N.W.)
| | - Hsin-Kai Wang
- Department of Radiology, Taipei Veterans General Hospital, Taipei 112201, Taiwan;
- School of Medicine, National Yang Ming Chiao Tung University, Taipei 112304, Taiwan; (Y.-C.P.); (T.-P.L.)
| | - Fu-Nien Wang
- Department of Biomedical Engineering and Environmental Sciences, National Tsing Hua University, Hsinchu 300044, Taiwan; (C.-C.L.); (F.-N.W.)
| | - Yu-Ching Peng
- School of Medicine, National Yang Ming Chiao Tung University, Taipei 112304, Taiwan; (Y.-C.P.); (T.-P.L.)
- Department of Pathology and Laboratory Medicine, Taipei Veterans General Hospital, Taipei 112201, Taiwan
| | - Tzu-Ping Lin
- School of Medicine, National Yang Ming Chiao Tung University, Taipei 112304, Taiwan; (Y.-C.P.); (T.-P.L.)
- Department of Urology, Taipei Veterans General Hospital, Taipei 112201, Taiwan
| | - Hsu-Hsia Peng
- Department of Biomedical Engineering and Environmental Sciences, National Tsing Hua University, Hsinchu 300044, Taiwan; (C.-C.L.); (F.-N.W.)
- Correspondence: (H.-H.P.); (S.-H.S.); Tel.: +886-3-571-5131 (ext. 80189) (H.-H.P.); +886-2-28757350 (S.-H.S.)
| | - Shu-Huei Shen
- Department of Radiology, Taipei Veterans General Hospital, Taipei 112201, Taiwan;
- School of Medicine, National Yang Ming Chiao Tung University, Taipei 112304, Taiwan; (Y.-C.P.); (T.-P.L.)
- Correspondence: (H.-H.P.); (S.-H.S.); Tel.: +886-3-571-5131 (ext. 80189) (H.-H.P.); +886-2-28757350 (S.-H.S.)
| |
Collapse
|
44
|
Saood A, Hatem I. COVID-19 lung CT image segmentation using deep learning methods: U-Net versus SegNet. BMC Med Imaging 2021; 21:19. [PMID: 33557772 PMCID: PMC7870362 DOI: 10.1186/s12880-020-00529-5] [Citation(s) in RCA: 85] [Impact Index Per Article: 21.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2020] [Accepted: 11/24/2020] [Indexed: 12/21/2022] Open
Abstract
BACKGROUND Currently, there is an urgent need for efficient tools to assess the diagnosis of COVID-19 patients. In this paper, we present feasible solutions for detecting and labeling infected tissues on CT lung images of such patients. Two structurally-different deep learning techniques, SegNet and U-NET, are investigated for semantically segmenting infected tissue regions in CT lung images. METHODS We propose to use two known deep learning networks, SegNet and U-NET, for image tissue classification. SegNet is characterized as a scene segmentation network and U-NET as a medical segmentation tool. Both networks were exploited as binary segmentors to discriminate between infected and healthy lung tissue, also as multi-class segmentors to learn the infection type on the lung. Each network is trained using seventy-two data images, validated on ten images, and tested against the left eighteen images. Several statistical scores are calculated for the results and tabulated accordingly. RESULTS The results show the superior ability of SegNet in classifying infected/non-infected tissues compared to the other methods (with 0.95 mean accuracy), while the U-NET shows better results as a multi-class segmentor (with 0.91 mean accuracy). CONCLUSION Semantically segmenting CT scan images of COVID-19 patients is a crucial goal because it would not only assist in disease diagnosis, also help in quantifying the severity of the illness, and hence, prioritize the population treatment accordingly. We propose computer-based techniques that prove to be reliable as detectors for infected tissue in lung CT scans. The availability of such a method in today's pandemic would help automate, prioritize, fasten, and broaden the treatment of COVID-19 patients globally.
Collapse
Affiliation(s)
- Adnan Saood
- Mechatronics Program for the Distinguished, Tishreen University, Distinction and Creativity Agency, Latakia, Syria
| | - Iyad Hatem
- Mechatronics Program for the Distinguished, Tishreen University, Distinction and Creativity Agency, Latakia, Syria
| |
Collapse
|
45
|
Woźniak M. Advanced Computational Intelligence for Object Detection, Feature Extraction and Recognition in Smart Sensor Environments. SENSORS (BASEL, SWITZERLAND) 2020; 21:s21010045. [PMID: 33374103 PMCID: PMC7795168 DOI: 10.3390/s21010045] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/07/2020] [Accepted: 12/22/2020] [Indexed: 06/12/2023]
Abstract
The recent years have seen a vast development in various methodologies for object detection and feature extraction and recognition, both in theory and in practice [...].
Collapse
Affiliation(s)
- Marcin Woźniak
- Faculty of Applied Mathematics, Silesian University of Technology, 44-100 Gliwice, Poland
| |
Collapse
|
46
|
Nayantara PV, Kamath S, Manjunath KN, Rajagopal KV. Computer-aided diagnosis of liver lesions using CT images: A systematic review. Comput Biol Med 2020; 127:104035. [PMID: 33099219 DOI: 10.1016/j.compbiomed.2020.104035] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2020] [Revised: 10/02/2020] [Accepted: 10/02/2020] [Indexed: 01/17/2023]
Abstract
BACKGROUND Medical image processing has a strong footprint in radio diagnosis for the detection of diseases from the images. Several computer-aided systems were researched in the recent past to assist the radiologist in diagnosing liver diseases and reducing the interpretation time. The aim of this paper is to provide an overview of the state-of-the-art techniques in computer-assisted diagnosis systems to predict benign and malignant lesions using computed tomography images. METHODS The research articles published between 1998 and 2020 obtained from various standard databases were considered for preparing the review. The research papers include both conventional as well as deep learning-based systems for liver lesion diagnosis. The paper initially discusses the various hepatic lesions that are identifiable on computed tomography images, then the computer-aided diagnosis systems and their workflow. The conventional and deep learning-based systems are presented in stages wherein the various methods used for preprocessing, liver and lesion segmentation, radiological feature extraction and classification are discussed. CONCLUSION The review suggests the scope for future, work as efficient and effective segmentation methods that work well with diverse images have not been developed. Furthermore, unsupervised and semi-supervised deep learning models were not investigated for liver disease diagnosis in the reviewed papers. Other areas to be explored include image fusion and inclusion of essential clinical features along with the radiological features for better classification accuracy.
Collapse
Affiliation(s)
- P Vaidehi Nayantara
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, Karnataka, 576104, India.
| | - Surekha Kamath
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, Karnataka, 576104, India.
| | - K N Manjunath
- Department of Computer Science and Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, Karnataka, 576104, India.
| | - K V Rajagopal
- Department of Radiodiagnosis and Imaging, Kasturba Medical College, Manipal Academy of Higher Education, Manipal, Karnataka, 576104, India.
| |
Collapse
|