Automated detection and delineation of hepatocellular carcinoma on multiphasic contrast-enhanced MRI using deep learning

Leveraging radiomics and AI for precision diagnosis and prognostication of liver malignancies

Liver tumors, whether primary or metastatic, have emerged as a growing concern with substantial global health implications. Timely identification and characterization of liver tumors are pivotal factors in order to provide optimum treatment. Imaging is a crucial part of the detection of liver tumors; however, conventional imaging has shortcomings in the proper characterization of these tumors which leads to the need for tissue biopsy. Artificial intelligence (AI) and radiomics have recently emerged as investigational opportunities with the potential to enhance the detection and characterization of liver lesions. These advancements offer opportunities for better diagnostic accuracy, prognostication, and thereby improving patient care. In particular, these techniques have the potential to predict the histopathology, genotype, and immunophenotype of tumors based on imaging data, hence providing guidance for personalized treatment of such tumors. In this review, we outline the progression and potential of AI in the field of liver oncology imaging, specifically emphasizing manual radiomic techniques and deep learning-based representations. We discuss how these tools can aid in clinical decision-making challenges. These challenges encompass a broad range of tasks, from prognosticating patient outcomes, differentiating benign treatment-related factors and actual disease progression, recognizing uncommon response patterns, and even predicting the genetic and molecular characteristics of the tumors. Lastly, we discuss the pitfalls, technical limitations and future direction of these AI-based techniques.

Automatic segmentation of hepatocellular carcinoma on dynamic contrast-enhanced MRI based on deep learning

Objective. Precise hepatocellular carcinoma (HCC) detection is crucial for clinical management. While studies focus on computed tomography-based automatic algorithms, there is a rareness of research on automatic detection based on dynamic contrast enhanced (DCE) magnetic resonance imaging. This study is to develop an automatic detection and segmentation deep learning model for HCC using DCE.Approach: DCE images acquired from 2016 to 2021 were retrospectively collected. Then, 382 patients (301 male; 81 female) with 466 lesions pathologically confirmed were included and divided into an 80% training-validation set and a 20% independent test set. For external validation, 51 patients (42 male; 9 female) in another hospital from 2018 to 2021 were included. The U-net architecture was modified to accommodate multi-phasic DCE input. The model was trained with the training-validation set using five-fold cross-validation, and furtherly evaluated with the independent test set using comprehensive metrics for segmentation and detection performance. The proposed automatic segmentation model consisted of five main steps: phase registration, automatic liver region extraction using a pre-trained model, automatic HCC lesion segmentation using the multi-phasic deep learning model, ensemble of five-fold predictions, and post-processing using connected component analysis to enhance the performance to refine predictions and eliminate false positives.Main results. The proposed model achieved a mean dice similarity coefficient (DSC) of 0.81 ± 0.11, a sensitivity of 94.41 ± 15.50%, a precision of 94.19 ± 17.32%, and 0.14 ± 0.48 false positive lesions per patient in the independent test set. The model detected 88% (80/91) HCC lesions in the condition of DSC > 0.5, and the DSC per tumor was 0.80 ± 0.13. In the external set, the model detected 92% (58/62) lesions with 0.12 ± 0.33 false positives per patient, and the DSC per tumor was 0.75 ± 0.10.Significance.This study developed an automatic detection and segmentation deep learning model for HCC using DCE, which yielded promising post-processed results in accurately identifying and delineating HCC lesions.

CT and MRI of abdominal cancers: current trends and perspectives in the era of radiomics and artificial intelligence

Abdominal cancers continue to pose daily challenges to clinicians, radiologists and researchers. These challenges are faced at each stage of abdominal cancer management, including early detection, accurate characterization, precise assessment of tumor spread, preoperative planning when surgery is anticipated, prediction of tumor aggressiveness, response to therapy, and detection of recurrence. Technical advances in medical imaging, often in combination with imaging biomarkers, show great promise in addressing such challenges. Information extracted from imaging datasets owing to the application of radiomics can be used to further improve the diagnostic capabilities of imaging. However, the analysis of the huge amount of data provided by these advances is a difficult task in daily practice. Artificial intelligence has the potential to help radiologists in all these challenges. Notably, the applications of AI in the field of abdominal cancers are expanding and now include diverse approaches for cancer detection, diagnosis and classification, genomics and detection of genetic alterations, analysis of tumor microenvironment, identification of predictive biomarkers and follow-up. However, AI currently has some limitations that need further refinement for implementation in the clinical setting. This review article sums up recent advances in imaging of abdominal cancers in the field of image/data acquisition, tumor detection, tumor characterization, prognosis, and treatment response evaluation.

Improving radiomics reproducibility using deep learning-based image conversion of CT reconstruction algorithms in hepatocellular carcinoma patients

OBJECTIVES

CT reconstruction algorithms affect radiomics reproducibility. In this study, we evaluate the effect of deep learning-based image conversion on CT reconstruction algorithms.

METHODS

This study included 78 hepatocellular carcinoma (HCC) patients who underwent four-phase liver CTs comprising non-contrast, late arterial (LAP), portal venous (PVP), and delayed phase (DP), reconstructed using both filtered back projection (FBP) and advanced modeled iterative reconstruction (ADMIRE). PVP images were used to train a convolutional neural network (CNN) model to convert images from FBP to ADMIRE and vice versa. LAP, PVP, and DP images were used for validation and testing. Radiomic features were extracted for each patient with a semi-automatic segmentation tool. We used concordance correlation coefficients (CCCs) to evaluate the radiomics reproducibility for original FBP (oFBP) vs. original ADMIRE (oADMIRE), oFBP vs. converted FBP (cFBP), and oADMIRE vs. converted ADMIRE (cADMIRE).

RESULTS

In the test group including 30 patients, the CCC and proportion of reproducible features (CCC ≥ 0.85) for oFBP vs. oADMIRE were 0.65 and 32.9% (524/1595) for LAP, 0.65 and 35.9% (573/1595) for PVP, and 0.69 and 43.8% (699/1595) for DP. For oFBP vs. cFBP, the values increased to 0.92 and 83.9% (1339/1595) for LAP, 0.89 and 71.0% (1133/1595) for PVP, and 0.90 and 79.7% (1271/1595) for DP. Similarly, for oADMIRE vs. cADMIRE, the values increased to 0.87 and 68.1% (1086/1595) for LAP, 0.91 and 82.1% (1309/1595) for PVP, and 0.89 and 76.2% (1216/1595) for DP.

CONCLUSIONS

CNN-based image conversion between CT reconstruction algorithms improved the radiomics reproducibility of HCCs.

CLINICAL RELEVANCE STATEMENT

This study demonstrates that using a CNN-based image conversion technique significantly improves the reproducibility of radiomic features in HCCs, highlighting its potential for enhancing radiomics research in HCC patients.

KEY POINTS

Radiomics reproducibility of HCC was improved via CNN-based image conversion between two different CT reconstruction algorithms. This is the first clinical study to demonstrate improvements across a range of radiomic features in HCC patients. This study promotes the reproducibility and generalizability of different CT reconstruction algorithms in radiomics research.

Deep Learning Combined with Radiologist's Intervention Achieves Accurate Segmentation of Hepatocellular Carcinoma in Dual-Phase Magnetic Resonance Images

Purpose

Segmentation of hepatocellular carcinoma (HCC) is crucial; however, manual segmentation is subjective and time-consuming. Accurate and automatic lesion contouring for HCC is desirable in clinical practice. In response to this need, our study introduced a segmentation approach for HCC combining deep convolutional neural networks (DCNNs) and radiologist intervention in magnetic resonance imaging (MRI). We sought to design a segmentation method with a deep learning method that automatically segments using manual location information for moderately experienced radiologists. In addition, we verified the viability of this method to assist radiologists in accurate and fast lesion segmentation.

Method

In our study, we developed a semiautomatic approach for segmenting HCC using DCNN in conjunction with radiologist intervention in dual-phase gadolinium-ethoxybenzyl-diethylenetriamine penta-acetic acid- (Gd-EOB-DTPA-) enhanced MRI. We developed a DCNN and deep fusion network (DFN) trained on full-size images, namely, DCNN-F and DFN-F. Furthermore, DFN was applied to the image blocks containing tumor lesions that were roughly contoured by a radiologist with 10 years of experience in abdominal MRI, and this method was named DFN-R. Another radiologist with five years of experience (moderate experience) performed tumor lesion contouring for comparison with our proposed methods. The ground truth image was contoured by an experienced radiologist and reviewed by an independent experienced radiologist.

Results

The mean DSC of DCNN-F, DFN-F, and DFN-R was 0.69 ± 0.20 (median, 0.72), 0.74 ± 0.21 (median, 0.77), and 0.83 ± 0.13 (median, 0.88), respectively. The mean DSC of the segmentation by the radiologist with moderate experience was 0.79 ± 0.11 (median, 0.83), which was lower than the performance of DFN-R.

Conclusions

Deep learning using dual-phase MRI shows great potential for HCC lesion segmentation. The radiologist-aided semiautomated method (DFN-R) achieved improved performance compared to manual contouring by the radiologist with moderate experience, although the difference was not statistically significant.

Radiomics and liver: Where we are and where we are headed?

Hepatic diffuse conditions and focal liver lesions represent two of the most common scenarios to face in everyday radiological clinical practice. Thanks to the advances in technology, radiology has gained a central role in the management of patients with liver disease, especially due to its high sensitivity and specificity. Since the introduction of computed tomography (CT) and magnetic resonance imaging (MRI), radiology has been considered the non-invasive reference modality to assess and characterize liver pathologies. In recent years, clinical practice has moved forward to a quantitative approach to better evaluate and manage each patient with a more fitted approach. In this setting, radiomics has gained an important role in helping radiologists and clinicians characterize hepatic pathological entities, in managing patients, and in determining prognosis. Radiomics can extract a large amount of data from radiological images, which can be associated with different liver scenarios. Thanks to its wide applications in ultrasonography (US), CT, and MRI, different studies were focused on specific aspects related to liver diseases. Even if broadly applied, radiomics has some advantages and different pitfalls. This review aims to summarize the most important and robust studies published in the field of liver radiomics, underlying their main limitations and issues, and what they can add to the current and future clinical practice and literature.

Automated MRI liver segmentation for anatomical segmentation, liver volumetry, and the extraction of radiomics

OBJECTIVES

To develop and evaluate a deep convolutional neural network (DCNN) for automated liver segmentation, volumetry, and radiomic feature extraction on contrast-enhanced portal venous phase magnetic resonance imaging (MRI).

MATERIALS AND METHODS

This retrospective study included hepatocellular carcinoma patients from an institutional database with portal venous MRI. After manual segmentation, the data was randomly split into independent training, validation, and internal testing sets. From a collaborating institution, de-identified scans were used for external testing. The public LiverHccSeg dataset was used for further external validation. A 3D DCNN was trained to automatically segment the liver. Segmentation accuracy was quantified by the Dice similarity coefficient (DSC) with respect to manual segmentation. A Mann-Whitney U test was used to compare the internal and external test sets. Agreement of volumetry and radiomic features was assessed using the intraclass correlation coefficient (ICC).

RESULTS

In total, 470 patients met the inclusion criteria (63.9±8.2 years; 376 males) and 20 patients were used for external validation (41±12 years; 13 males). DSC segmentation accuracy of the DCNN was similarly high between the internal (0.97±0.01) and external (0.96±0.03) test sets (p=0.28) and demonstrated robust segmentation performance on public testing (0.93±0.03). Agreement of liver volumetry was satisfactory in the internal (ICC, 0.99), external (ICC, 0.97), and public (ICC, 0.85) test sets. Radiomic features demonstrated excellent agreement in the internal (mean ICC, 0.98±0.04), external (mean ICC, 0.94±0.10), and public (mean ICC, 0.91±0.09) datasets.

CONCLUSION

Automated liver segmentation yields robust and generalizable segmentation performance on MRI data and can be used for volumetry and radiomic feature extraction.

CLINICAL RELEVANCE STATEMENT

Liver volumetry, anatomic localization, and extraction of quantitative imaging biomarkers require accurate segmentation, but manual segmentation is time-consuming. A deep convolutional neural network demonstrates fast and accurate segmentation performance on T1-weighted portal venous MRI.

KEY POINTS

• This deep convolutional neural network yields robust and generalizable liver segmentation performance on internal, external, and public testing data. • Automated liver volumetry demonstrated excellent agreement with manual volumetry. • Automated liver segmentations can be used for robust and reproducible radiomic feature extraction.

Consensus report from the 10th Global Forum for Liver Magnetic Resonance Imaging: developments in HCC management

The 10th Global Forum for Liver Magnetic Resonance Imaging (MRI) was held as a virtual 2-day meeting in October 2021, attended by delegates from North and South America, Asia, Australia, and Europe. Most delegates were radiologists with experience in liver MRI, with representation also from specialists in liver surgery, oncology, and hepatology. Presentations, discussions, and working groups at the Forum focused on the following themes: • Gadoxetic acid in clinical practice: Eastern and Western perspectives on current uses and challenges in hepatocellular carcinoma (HCC) screening/surveillance, diagnosis, and management • Economics and outcomes of HCC imaging • Radiomics, artificial intelligence (AI) and deep learning (DL) applications of MRI in HCC. These themes are the subject of the current manuscript. A second manuscript discusses multidisciplinary tumor board perspectives: how to approach early-, mid-, and late-stage HCC management from the perspectives of a liver surgeon, interventional radiologist, and oncologist (Taouli et al, 2023). Delegates voted on consensus statements that were developed by working groups on these meeting themes. A consensus was considered to be reached if at least 80% of the voting delegates agreed on the statements. CLINICAL RELEVANCE STATEMENT: This review highlights the clinical applications of gadoxetic acid-enhanced MRI for liver cancer screening and diagnosis, as well as its cost-effectiveness and the applications of radiomics and AI in patients with liver cancer. KEY POINTS: • Interpretation of gadoxetic acid-enhanced MRI differs slightly between Eastern and Western guidelines, reflecting different regional requirements for sensitivity vs specificity. • Emerging data are encouraging for the cost-effectiveness of gadoxetic acid-enhanced MRI in HCC screening and diagnosis, but more studies are required. • Radiomics and artificial intelligence are likely, in the future, to contribute to the detection, staging, assessment of treatment response and prediction of prognosis of HCC-reducing the burden on radiologists and other specialists and supporting timely and targeted treatment for patients.

A deep-learning approach for segmentation of liver tumors in magnetic resonance imaging using UNet+

OBJECTIVE

Radiomic and deep learning studies based on magnetic resonance imaging (MRI) of liver tumor are gradually increasing. Manual segmentation of normal hepatic tissue and tumor exhibits limitations.

METHODS

105 patients diagnosed with hepatocellular carcinoma were retrospectively studied between Jan 2015 and Dec 2020. The patients were divided into three sets: training (n = 83), validation (n = 11), and internal testing (n = 11). Additionally, 9 cases were included from the Cancer Imaging Archive as the external test set. Using the arterial phase and T2WI sequences, expert radiologists manually delineated all images. Using deep learning, liver tumors and liver segments were automatically segmented. A preliminary liver segmentation was performed using the UNet + + network, and the segmented liver mask was re-input as the input end into the UNet + + network to segment liver tumors. The false positivity rate was reduced using a threshold value in the liver tumor segmentation. To evaluate the segmentation results, we calculated the Dice similarity coefficient (DSC), average false positivity rate (AFPR), and delineation time.

RESULTS

The average DSC of the liver in the validation and internal testing sets was 0.91 and 0.92, respectively. In the validation set, manual and automatic delineation took 182.9 and 2.2 s, respectively. On an average, manual and automatic delineation took 169.8 and 1.7 s, respectively. The average DSC of liver tumors was 0.612 and 0.687 in the validation and internal testing sets, respectively. The average time for manual and automatic delineation and AFPR in the internal testing set were 47.4 s, 2.9 s, and 1.4, respectively, and those in the external test set were 29.5 s, 4.2 s, and 1.6, respectively.

CONCLUSION

UNet + + can automatically segment normal hepatic tissue and liver tumors based on MR images. It provides a methodological basis for the automated segmentation of liver tumors, improves the delineation efficiency, and meets the requirement of extraction set analysis of further radiomics and deep learning.

Joint liver and hepatic lesion segmentation in MRI using a hybrid CNN with transformer layers

Backgound and Objective: Deep learning-based segmentation of the liver and hepatic lesions therein steadily gains relevance in clinical practice due to the increasing incidence of liver cancer each year. Whereas various network variants with overall promising results in the field of medical image segmentation have been successfully developed over the last years, almost all of them struggle with the challenge of accurately segmenting hepatic lesions in magnetic resonance imaging (MRI). This led to the idea of combining elements of convolutional and transformer-based architectures to overcome the existing limitations.

METHODS

This work presents a hybrid network called SWTR-Unet, consisting of a pretrained ResNet, transformer blocks as well as a common Unet-style decoder path. This network was primarily applied to single-modality non-contrast-enhanced liver MRI and additionally to the publicly available computed tomography (CT) data of the liver tumor segmentation (LiTS) challenge to verify the applicability on other modalities. For a broader evaluation, multiple state-of-the-art networks were implemented and applied, ensuring direct comparability. Furthermore, correlation analysis and an ablation study were carried out, to investigate various influencing factors on the segmentation accuracy of the presented method.

RESULTS

With Dice similarity scores of averaged 98±2% for liver and 81±28% lesion segmentation on the MRI dataset and 97±2% and 79±25%, respectively on the CT dataset, the proposed SWTR-Unet proved to be a precise approach for liver and hepatic lesion segmentation with state-of-the-art results for MRI and competing accuracy in CT imaging.

CONCLUSION

The achieved segmentation accuracy was found to be on par with manually performed expert segmentations as indicated by inter-observer variabilities for liver lesion segmentation. In conclusion, the presented method could save valuable time and resources in clinical practice.

Semiautomated segmentation of hepatocellular carcinoma tumors with MRI using convolutional neural networks

OBJECTIVE

To assess the performance of convolutional neural networks (CNNs) for semiautomated segmentation of hepatocellular carcinoma (HCC) tumors on MRI.

METHODS

This retrospective single-center study included 292 patients (237 M/55F, mean age 61 years) with pathologically confirmed HCC between 08/2015 and 06/2019 and who underwent MRI before surgery. The dataset was randomly divided into training (n = 195), validation (n = 66), and test sets (n = 31). Volumes of interest (VOIs) were manually placed on index lesions by 3 independent radiologists on different sequences (T2-weighted imaging [WI], T1WI pre-and post-contrast on arterial [AP], portal venous [PVP], delayed [DP, 3 min post-contrast] and hepatobiliary phases [HBP, when using gadoxetate], and diffusion-weighted imaging [DWI]). Manual segmentation was used as ground truth to train and validate a CNN-based pipeline. For semiautomated segmentation of tumors, we selected a random pixel inside the VOI, and the CNN provided two outputs: single slice and volumetric outputs. Segmentation performance and inter-observer agreement were analyzed using the 3D Dice similarity coefficient (DSC).

RESULTS

A total of 261 HCCs were segmented on the training/validation sets, and 31 on the test set. The median lesion size was 3.0 cm (IQR 2.0-5.2 cm). Mean DSC (test set) varied depending on the MRI sequence with a range between 0.442 (ADC) and 0.778 (high b-value DWI) for single-slice segmentation; and between 0.305 (ADC) and 0.667 (T1WI pre) for volumetric-segmentation. Comparison between the two models showed better performance in single-slice segmentation, with statistical significance on T2WI, T1WI-PVP, DWI, and ADC. Inter-observer reproducibility of segmentation analysis showed a mean DSC of 0.71 in lesions between 1 and 2 cm, 0.85 in lesions between 2 and 5 cm, and 0.82 in lesions > 5 cm.

CONCLUSION

CNN models have fair to good performance for semiautomated HCC segmentation, depending on the sequence and tumor size, with better performance for the single-slice approach. Refinement of volumetric approaches is needed in future studies.

KEY POINTS

• Semiautomated single-slice and volumetric segmentation using convolutional neural networks (CNNs) models provided fair to good performance for hepatocellular carcinoma segmentation on MRI. • CNN models' performance for HCC segmentation accuracy depends on the MRI sequence and tumor size, with the best results on diffusion-weighted imaging and T1-weighted imaging pre-contrast, and for larger lesions.

Liver Transplant in Patients with Hepatocarcinoma: Imaging Guidelines and Future Perspectives Using Artificial Intelligence

Hepatocellular carcinoma is the most common primary malignant hepatic tumor and occurs most often in the setting of chronic liver disease. Liver transplantation is a curative treatment option and is an ideal solution because it solves the chronic underlying liver disorder while removing the malignant lesion. However, due to organ shortages, this treatment can only be applied to carefully selected patients according to clinical guidelines. Artificial intelligence is an emerging technology with multiple applications in medicine with a predilection for domains that work with medical imaging, like radiology. With the help of these technologies, laborious tasks can be automated, and new lesion imaging criteria can be developed based on pixel-level analysis. Our objectives are to review the developing AI applications that could be implemented to better stratify liver transplant candidates. The papers analysed applied AI for liver segmentation, evaluation of steatosis, sarcopenia assessment, lesion detection, segmentation, and characterization. A liver transplant is an optimal treatment for patients with hepatocellular carcinoma in the setting of chronic liver disease. Furthermore, AI could provide solutions for improving the management of liver transplant candidates to improve survival.

Opportunities to address gaps in early detection and improve outcomes of liver cancer

Death rates from primary liver cancer (hepatocellular carcinoma [HCC]) have continued to rise in the United States over the recent decades despite the availability of an increasing range of treatment modalities, including new systemic therapies. Prognosis is strongly associated with tumor stage at diagnosis; however, most cases of HCC are diagnosed beyond an early stage. This lack of early detection has contributed to low survival rates. Professional society guidelines recommend semiannual ultrasound-based HCC screening for at-risk populations, yet HCC surveillance continues to be underused in clinical practice. On April 28, 2022, the Hepatitis B Foundation convened a workshop to discuss the most pressing challenges and barriers to early HCC detection and the need to better leverage existing and emerging tools and technologies that could improve HCC screening and early detection. In this commentary, we summarize technical, patient-level, provider-level, and system-level challenges and opportunities to improve processes and outcomes across the HCC screening continuum. We highlight promising approaches to HCC risk stratification and screening, including new biomarkers, advanced imaging incorporating artificial intelligence, and algorithms for risk stratification. Workshop participants emphasized that action to improve early detection and reduce HCC mortality is urgently needed, noting concern that many of the challenges we face today are the same or similar to those faced a decade ago and that HCC mortality rates have not meaningfully improved. Increasing the uptake of HCC screening was identified as a short-term priority while developing and validating better screening tests and risk-appropriate surveillance strategies.

Radiomics: A radiological evidence-based artificial intelligence technique to facilitate personalized precision medicine in hepatocellular carcinoma

The high postoperative recurrence rates in hepatocellular carcinoma (HCC) remain a major hurdle in its management. Appropriate staging and treatment selection may alleviate the extent of fatal recurrence. However, effective methods to preoperatively evaluate pathophysiologic and molecular characteristics of HCC are lacking. Imaging plays a central role in HCC diagnosis and stratification due to the non-invasive diagnostic criteria. Vast and crucial information is hidden within image data. Other than providing a morphological sketch for lesion diagnosis, imaging could provide new insights to describe the pathophysiological and genetic landscape of HCC. Radiomics aims to facilitate diagnosis and prognosis of HCC using artificial intelligence techniques to harness the immense information contained in medical images. Radiomics produces a set of archetypal and robust imaging features that are correlated to key pathological or molecular biomarkers to preoperatively risk-stratify HCC patients. Inferred with outcome data, comprehensive combination of radiomic, clinical and/or multi-omics data could also improve direct prediction of response to treatment and prognosis. The evolution of radiomics is changing our understanding of personalized precision medicine in HCC management. Herein, we review the key techniques and clinical applications in HCC radiomics and discuss current limitations and future opportunities to improve clinical decision making.

The Diagnostic Approach towards Combined Hepatocellular-Cholangiocarcinoma-State of the Art and Future Perspectives

Combined hepatocellular-cholangiocarcinoma (cHCC-CCA) is a rare primary liver cancer which displays clinicopathologic features of both hepatocellular (HCC) and cholangiocellular carcinoma (CCA). The similarity to HCC and CCA makes the diagnostic workup particularly challenging. Alpha-fetoprotein (AFP) and carbohydrate antigen 19-9 (CA 19-9) are blood tumour markers related with HCC and CCA, respectively. They can be used as diagnostic markers in cHCC-CCA as well, albeit with low sensitivity. The imaging features of cHCC-CCA overlap with those of HCC and CCA, dependent on the predominant histopathological component. Using the Liver Imaging and Reporting Data System (LI-RADS), as many as half of cHCC-CCAs may be falsely categorised as HCC. This is especially relevant since the diagnosis of HCC may be made without histopathological confirmation in certain cases. Thus, in instances of diagnostic uncertainty (e.g., simultaneous radiological HCC and CCA features, elevation of CA 19-9 and AFP, HCC imaging features and elevated CA 19-9, and vice versa) multiple image-guided core needle biopsies should be performed and analysed by an experienced pathologist. Recent advances in the molecular characterisation of cHCC-CCA, innovative diagnostic approaches (e.g., liquid biopsies) and methods to analyse multiple data points (e.g., clinical, radiological, laboratory, molecular, histopathological features) in an all-encompassing way (e.g., by using artificial intelligence) might help to address some of the existing diagnostic challenges.

Artificial intelligence: A review of current applications in hepatocellular carcinoma imaging

Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer and currently the third-leading cause of cancer-related death worldwide. Recently, artificial intelligence (AI) has emerged as an important tool to improve clinical management of HCC, including for diagnosis, prognostication and evaluation of treatment response. Different AI approaches, such as machine learning and deep learning, are both based on the concept of developing prediction algorithms from large amounts of data, or big data. The era of digital medicine has led to a rapidly expanding amount of routinely collected health data which can be leveraged for the development of AI models. Various studies have constructed AI models by using features extracted from ultrasound imaging, computed tomography imaging and magnetic resonance imaging. Most of these models have used convolutional neural networks. These tools have shown promising results for HCC detection, characterization of liver lesions and liver/tumor segmentation. Regarding treatment, studies have outlined a role for AI in evaluation of treatment response and improvement of pre-treatment planning. Several challenges remain to fully integrate AI models in clinical practice. Future research is still needed to robustly evaluate AI algorithms in prospective trials, and improve interpretability, generalizability and transparency. If such challenges can be overcome, AI has the potential to profoundly change the management of patients with HCC. The purpose of this review was to sum up current evidence on AI approaches using imaging for the clinical management of HCC.

Computer-aided hepatocellular carcinoma detection on the hepatobiliary phase of gadoxetic acid-enhanced magnetic resonance imaging using a convolutional neural network: Feasibility evaluation with multi-sequence data

BACKGROUND AND OBJECTIVES

Diagnosis of hepatocellular carcinoma (HCC) on liver MRI needs analysis of multi-sequence images. However, developing computer-aided detection (CAD) for every single sequence requires considerable time and labor for image segmentation. Therefore, we developed CAD for HCC on the hepatobiliary phase (HBP) of gadoxetic acid-enhanced magnetic resonance imaging (MRI) using a convolutional neural network (CNN) and evaluated its feasibility on multi-sequence, multi-unit, and multi-center data.

METHODS

Patients who underwent gadoxetic acid-enhanced MRI and surgery for HCC in Korea University Anam Hospital (KUAH) and Korea University Guro Hospital (KUGH) were reviewed. Finally, 170 nodules from 155 consecutive patients from KUAH and 28 nodules from 28 patients randomly selected from KUGH were included. Regions of interests were drawn on the whole HCC volume on HBP, T1-weighted (T1WI), T2-weighted (T2WI), and portal venous phase (PVP) images. The CAD was developed from the HBP images of KUAH using customized-nnUNet and post-processed for false-positive reduction. Internal and external validation of the CAD was performed with HBP, T1WI, T2WI, and PVP of KUAH and KUGH.

RESULTS

The figure of merit and recall of the jackknife alternative free-response receiver operating characteristic of the CAD for HBP, T1WI, T2WI, and PVP at false-positive rate 0.5 were (0.87 and 87.0), (0.73 and 73.3), (0.13 and 13.3), and (0.67 and 66.7) in KUAH and (0.86 and 86.0), (0.61 and 53.6), (0.07 and 0.07), and (0.57 and 53.6) in KUGH, respectively.

CONCLUSIONS

The CAD for HCC on gadoxetic acid-enhanced MRI developed by CNN from HBP detected HCCs feasibly on HBP, T1WI, and PVP of gadoxetic acid-enhanced MRI obtained from multiple units and centers. This result imply that the CAD developed using single MRI sequence may be applied to other similar sequences and this will reduce labor and time for CAD development in multi-sequence MRI.

Radiomics: a primer on high-throughput image phenotyping

Radiomics is a high-throughput approach to image phenotyping. It uses computer algorithms to extract and analyze a large number of quantitative features from radiological images. These radiomic features collectively describe unique patterns that can serve as digital fingerprints of disease. They may also capture imaging characteristics that are difficult or impossible to characterize by the human eye. The rapid development of this field is motivated by systems biology, facilitated by data analytics, and powered by artificial intelligence. Here, as part of Abdominal Radiology's special issue on Quantitative Imaging, we provide an introduction to the field of radiomics. The technique is formally introduced as an advanced application of data analytics, with illustrating examples in abdominal radiology. Artificial intelligence is then presented as the main driving force of radiomics, and common techniques are defined and briefly compared. The complete step-by-step process of radiomic phenotyping is then broken down into five key phases. Potential pitfalls of each phase are highlighted, and recommendations are provided to reduce sources of variation, non-reproducibility, and error associated with radiomics.

Improving automatic liver tumor segmentation in late-phase MRI using multi-model training and 3D convolutional neural networks

Automatic liver tumor segmentation can facilitate the planning of liver interventions. For diagnosis of hepatocellular carcinoma, dynamic contrast-enhanced MRI (DCE-MRI) can yield a higher sensitivity than contrast-enhanced CT. However, most studies on automatic liver lesion segmentation have focused on CT. In this study, we present a deep learning-based approach for liver tumor segmentation in the late hepatocellular phase of DCE-MRI, using an anisotropic 3D U-Net architecture and a multi-model training strategy. The 3D architecture improves the segmentation performance compared to a previous study using a 2D U-Net (mean Dice 0.70 vs. 0.65). A further significant improvement is achieved by a multi-model training approach (0.74), which is close to the inter-rater agreement (0.78). A qualitative expert rating of the automatically generated contours confirms the benefit of the multi-model training strategy, with 66 % of contours rated as good or very good, compared to only 43 % when performing a single training. The lesion detection performance with a mean F1-score of 0.59 is inferior to human raters (0.76). Overall, this study shows that correctly detected liver lesions in late-phase DCE-MRI data can be automatically segmented with high accuracy, but the detection, in particular of smaller lesions, can still be improved.

A Fast Method for Whole Liver- and Colorectal Liver Metastasis Segmentations from MRI Using 3D FCNN Networks

The liver is the most frequent organ for metastasis from colorectal cancer, one of the most common tumor types with a poor prognosis. Despite reducing surgical planning time and providing better spatial representation, current methods of 3D modeling of patient-specific liver anatomy are extremely time-consuming. The purpose of this study was to develop a deep learning model trained on an in-house dataset of 84 MRI volumes to rapidly provide fully automated whole liver and liver lesions segmentation from volumetric MRI series. A cascade approach was utilized to address the problem of class imbalance. The trained model achieved an average Dice score for whole liver segmentation of 0.944 ± 0.009 and 0.780 ± 0.119 for liver lesion segmentation. Furthermore, applying this method to a not-annotated dataset creates a complete 3D segmentation in less than 6 s per MRI volume, with a mean segmentation Dice score of 0.994 ± 0.003 for the liver and 0.709 ± 0.171 for tumors compared to manual corrections applied after the inference was achieved. Availability and integration of our method in clinical practice may improve diagnosis and treatment planning in patients with colorectal liver metastasis and open new possibilities for research into liver tumors.

Assessment of Liver Function With MRI: Where Do We Stand?

Liver disease and hepatocellular carcinoma (HCC) have become a global health burden. For this reason, the determination of liver function plays a central role in the monitoring of patients with chronic liver disease or HCC. Furthermore, assessment of liver function is important, e.g., before surgery to prevent liver failure after hepatectomy or to monitor the course of treatment. Liver function and disease severity are usually assessed clinically based on clinical symptoms, biopsy, and blood parameters. These are rather static tests that reflect the current state of the liver without considering changes in liver function. With the development of liver-specific contrast agents for MRI, noninvasive dynamic determination of liver function based on signal intensity or using T1 relaxometry has become possible. The advantage of this imaging modality is that it provides additional information about the vascular structure, anatomy, and heterogeneous distribution of liver function. In this review, we summarized and discussed the results published in recent years on this technique. Indeed, recent data show that the T1 reduction rate seems to be the most appropriate value for determining liver function by MRI. Furthermore, attention has been paid to the development of automated tools for image analysis in order to uncover the steps necessary to obtain a complete process flow from image segmentation to image registration to image analysis. In conclusion, the published data show that liver function values obtained from contrast-enhanced MRI images correlate significantly with the global liver function parameters, making it possible to obtain both functional and anatomic information with a single modality.

Role of three-dimensional printing and artificial intelligence in the management of hepatocellular carcinoma: Challenges and opportunities

Hepatocellular carcinoma (HCC) constitutes the fifth most frequent malignancy worldwide and the third most frequent cause of cancer-related deaths. Currently, treatment selection is based on the stage of the disease. Emerging fields such as three-dimensional (3D) printing, 3D bioprinting, artificial intelligence (AI), and machine learning (ML) could lead to evidence-based, individualized management of HCC. In this review, we comprehensively report the current applications of 3D printing, 3D bioprinting, and AI/ML-based models in HCC management; we outline the significant challenges to the broad use of these novel technologies in the clinical setting with the goal of identifying means to overcome them, and finally, we discuss the opportunities that arise from these applications. Notably, regarding 3D printing and bioprinting-related challenges, we elaborate on cost and cost-effectiveness, cell sourcing, cell viability, safety, accessibility, regulation, and legal and ethical concerns. Similarly, regarding AI/ML-related challenges, we elaborate on intellectual property, liability, intrinsic biases, data protection, cybersecurity, ethical challenges, and transparency. Our findings show that AI and 3D printing applications in HCC management and healthcare, in general, are steadily expanding; thus, these technologies will be integrated into the clinical setting sooner or later. Therefore, we believe that physicians need to become familiar with these technologies and prepare to engage with them constructively.

A two-stage deep learning architecture for radiographic staging of periodontal bone loss

Background

Radiographic periodontal bone loss is one of the most important basis for periodontitis staging, with problems such as limited accuracy, inconsistency, and low efficiency in imaging diagnosis. Deep learning network may be a solution to improve the accuracy and efficiency of periodontitis imaging staging diagnosis. This study aims to establish a comprehensive and accurate radiological staging model of periodontal alveolar bone loss based on panoramic images.

Methods

A total of 640 panoramic images were included, and 3 experienced periodontal physicians marked the key points needed to calculate the degree of periodontal alveolar bone loss and the specific location and shape of the alveolar bone loss. A two-stage deep learning architecture based on UNet and YOLO-v4 was proposed to localize the tooth and key points, so that the percentage of periodontal alveolar bone loss was accurately calculated and periodontitis was staged. The ability of the model to recognize these features was evaluated and compared with that of general dental practitioners.

Results

The overall classification accuracy of the model was 0.77, and the performance of the model varied for different tooth positions and categories; model classification was generally more accurate than that of general practitioners.

Conclusions

It is feasible to establish deep learning model for assessment and staging radiographic periodontal alveolar bone loss using two-stage architecture based on UNet and YOLO-v4.

Detecting acute bilirubin encephalopathy in neonates based on multimodal MRI with deep learning

BACKGROUND

Differentiating acute bilirubin encephalopathy (ABE) from non-ABE in neonates with hyperbilirubinemia (HB) from routine magnetic resonance imaging (MRI) is extremely challenging since both conditions demonstrate similar T1 hyperintensities. To this end, we investigated whether the integration of multimodal MRI from routine clinical scans with deep-learning approaches could improve diagnostic performance.

METHODS

A total of 75 neonates with ABE and 75 neonates with HB (non-ABE) were included in the study. Each patient had three types of multimodal images taken, i.e., a T1-weighted image (T1WI), a T2-weighted image (T2WI), and an apparent diffusion coefficient (ADC) map. The three types of MRI contrasts and their combination were fed into two deep convolutional neural networks (CNNs), i.e., ResNet18 and DenseNet201. The performance of CNNs was compared with a traditional statistical method named logistic regression.

RESULTS

We demonstrated that diagnostic methods with the multimodal data were better than any of the single-modal data. Both CNN models outperformed the logistic regression method. The best performance was achieved by DenseNet201 with the combination of three modalities of T1WI, T2WI, and ADC, with an accuracy of 0.929 ± 0.042 and an area under the curve (AUC) of 0.991 ± 0.007.

CONCLUSIONS

Our study demonstrated that CNN models with multimodal MRI significantly improve the accuracy of diagnosing ABE.

IMPACT

We proposed an efficient strategy of detecting ABE in neonates based on multimodal MRI with deep learning, which achieved an accuracy of 0.929 ± 0.042 and an AUC of 0.991 ± 0.007. We demonstrated the advantage of integrating multimodal MRI in detecting ABE in neonates with HB, using deep-learning models. Our strategy of diagnosing ABE using deep-learning techniques with multimodal MRI from routine clinical scans is potentially applicable to clinical practice.

Artificial intelligence in liver diseases: improving diagnostics, prognostics and response prediction

Clinical routine in hepatology involves the diagnosis and treatment of a wide spectrum of metabolic, infectious, autoimmune and neoplastic diseases. Clinicians integrate qualitative and quantitative information from multiple data sources to make a diagnosis, prognosticate the disease course, and recommend a treatment. In the last 5 years, advances in artificial intelligence (AI), particularly in deep learning, have made it possible to extract clinically relevant information from complex and diverse clinical datasets. In particular, histopathology and radiology image data contain diagnostic, prognostic and predictive information which AI can extract. Ultimately, such AI systems could be implemented in clinical routine as decision support tools. However, in the context of hepatology, this requires further large-scale clinical validation and regulatory approval. Herein, we summarise the state of the art in AI in hepatology with a particular focus on histopathology and radiology data. We present a roadmap for the further development of novel biomarkers in hepatology and outline critical obstacles which need to be overcome.

Improved performance and consistency of deep learning 3D liver segmentation with heterogeneous cancer stages in magnetic resonance imaging

PURPOSE

Accurate liver segmentation is key for volumetry assessment to guide treatment decisions. Moreover, it is an important pre-processing step for cancer detection algorithms. Liver segmentation can be especially challenging in patients with cancer-related tissue changes and shape deformation. The aim of this study was to assess the ability of state-of-the-art deep learning 3D liver segmentation algorithms to generalize across all different Barcelona Clinic Liver Cancer (BCLC) liver cancer stages.

METHODS

This retrospective study, included patients from an institutional database that had arterial-phase T1-weighted magnetic resonance images with corresponding manual liver segmentations. The data was split into 70/15/15% for training/validation/testing each proportionally equal across BCLC stages. Two 3D convolutional neural networks were trained using identical U-net-derived architectures with equal sized training datasets: one spanning all BCLC stages ("All-Stage-Net": AS-Net), and one limited to early and intermediate BCLC stages ("Early-Intermediate-Stage-Net": EIS-Net). Segmentation accuracy was evaluated by the Dice Similarity Coefficient (DSC) on a dataset spanning all BCLC stages and a Wilcoxon signed-rank test was used for pairwise comparisons.

RESULTS

219 subjects met the inclusion criteria (170 males, 49 females, 62.8±9.1 years) from all BCLC stages. Both networks were trained using 129 subjects: AS-Net training comprised 19, 74, 18, 8, and 10 BCLC 0, A, B, C, and D patients, respectively; EIS-Net training comprised 21, 86, and 22 BCLC 0, A, and B patients, respectively. DSCs (mean±SD) were 0.954±0.018 and 0.946±0.032 for AS-Net and EIS-Net (p<0.001), respectively. The AS-Net 0.956±0.014 significantly outperformed the EIS-Net 0.941±0.038 on advanced BCLC stages (p<0.001) and yielded similarly good segmentation performance on early and intermediate stages (AS-Net: 0.952±0.021; EIS-Net: 0.949±0.027; p = 0.107).

CONCLUSION

To ensure robust segmentation performance across cancer stages that is independent of liver shape deformation and tumor burden, it is critical to train deep learning models on heterogeneous imaging data spanning all BCLC stages.

Radiomics in hepatocellular carcinoma: A state-of-the-art review

Hepatocellular carcinoma (HCC) is the most common cancer and the second major contributor to cancer-related mortality. Radiomics, a burgeoning technology that can provide invisible high-dimensional quantitative and mineable data derived from routine-acquired images, has enormous potential for HCC management from diagnosis to prognosis as well as providing contributions to the rapidly developing deep learning methodology. This article aims to review the radiomics approach and its current state-of-the-art clinical application scenario in HCC. The limitations, challenges, and thoughts on future directions are also summarized.

Emerging artificial intelligence applications in liver magnetic resonance imaging

Chronic liver diseases (CLDs) are becoming increasingly more prevalent in modern society. The use of imaging techniques for early detection, such as magnetic resonance imaging (MRI), is crucial in reducing the impact of these diseases on healthcare systems. Artificial intelligence (AI) algorithms have been shown over the past decade to excel at image-based analysis tasks such as detection and segmentation. When applied to liver MRI, they have the potential to improve clinical decision making, and increase throughput by automating analyses. With Liver diseases becoming more prevalent in society, the need to implement these techniques to utilize liver MRI to its full potential, is paramount. In this review, we report on the current methods and applications of AI methods in liver MRI, with a focus on machine learning and deep learning methods. We assess four main themes of segmentation, classification, image synthesis and artefact detection, and their respective potential in liver MRI and the wider clinic. We provide a brief explanation of some of the algorithms used and explore the current challenges affecting the field. Though there are many hurdles to overcome in implementing AI methods in the clinic, we conclude that AI methods have the potential to positively aid healthcare professionals for years to come.

Progress of MRI Radiomics in Hepatocellular Carcinoma

Background

Hepatocellular carcinoma (HCC) is the sixth most common cancer in the world and the third leading cause of cancer-related death. Although the diagnostic scheme of HCC is currently undergoing refinement, the prognosis of HCC is still not satisfactory. In addition to certain factors, such as tumor size and number and vascular invasion displayed on traditional imaging, some histopathological features and gene expression parameters are also important for the prognosis of HCC patients. However, most parameters are based on postoperative pathological examinations, which cannot help with preoperative decision-making. As a new field, radiomics extracts high-throughput imaging data from different types of images to build models and predict clinical outcomes noninvasively before surgery, rendering it a powerful aid for making personalized treatment decisions preoperatively.

Objective

This study reviewed the workflow of radiomics and the research progress on magnetic resonance imaging (MRI) radiomics in the diagnosis and treatment of HCC.

Methods

A literature review was conducted by searching PubMed for search of relevant peer-reviewed articles published from May 2017 to June 2021.The search keywords included HCC, MRI, radiomics, deep learning, artificial intelligence, machine learning, neural network, texture analysis, diagnosis, histopathology, microvascular invasion, surgical resection, radiofrequency, recurrence, relapse, transarterial chemoembolization, targeted therapy, immunotherapy, therapeutic response, and prognosis.

Results

Radiomics features on MRI can be used as biomarkers to determine the differential diagnosis, histological grade, microvascular invasion status, gene expression status, local and systemic therapeutic responses, and prognosis of HCC patients.

Conclusion

Radiomics is a promising new imaging method. MRI radiomics has high application value in the diagnosis and treatment of HCC.

Deep learning applied to the imaging diagnosis of hepatocellular carcinoma

Each year, hepatocellular carcinoma is diagnosed in more than half a million people worldwide. It is the fifth most common cancer in men and the seventh most common cancer in women. Its diagnosis is currently made using imaging techniques, such as computed tomography and magnetic resonance imaging. For most cirrhotic patients, these methods are enough for diagnosis, foregoing the necessity of a liver biopsy. In order to improve outcomes and bypass obstacles, many companies and clinical centers have been trying to develop deep learning systems that could be able to diagnose and classify liver nodules in the cirrhotic liver, in which the neural networks are one of the most efficient approaches to accurately diagnose liver nodules. Despite the advances in deep learning systems for the diagnosis of imaging techniques, there are many issues that need better development in order to make such technologies more useful in daily practice.

Application of artificial intelligence in preoperative imaging of hepatocellular carcinoma: Current status and future perspectives

Hepatocellular carcinoma (HCC) is the most common primary malignant liver tumor in China. Preoperative diagnosis of HCC is challenging because of atypical imaging manifestations and the diversity of focal liver lesions. Artificial intelligence (AI), such as machine learning (ML) and deep learning, has recently gained attention for its capability to reveal quantitative information on images. Currently, AI is used throughout the entire radiomics process and plays a critical role in multiple fields of medicine. This review summarizes the applications of AI in various aspects of preoperative imaging of HCC, including segmentation, differential diagnosis, prediction of histopathology, early detection of recurrence after curative treatment, and evaluation of treatment response. We also review the limitations of previous studies and discuss future directions for diagnostic imaging of HCC.

Automatic segmentation of uterine endometrial cancer on multi-sequence MRI using a convolutional neural network

Endometrial cancer (EC) is the most common gynecological tumor in developed countries, and preoperative risk stratification is essential for personalized medicine. There have been several radiomics studies for noninvasive risk stratification of EC using MRI. Although tumor segmentation is usually necessary for these studies, manual segmentation is not only labor-intensive but may also be subjective. Therefore, our study aimed to perform the automatic segmentation of EC on MRI with a convolutional neural network. The effect of the input image sequence and batch size on the segmentation performance was also investigated. Of 200 patients with EC, 180 patients were used for training the modified U-net model; 20 patients for testing the segmentation performance and the robustness of automatically extracted radiomics features. Using multi-sequence images and larger batch size was effective for improving segmentation accuracy. The mean Dice similarity coefficient, sensitivity, and positive predictive value of our model for the test set were 0.806, 0.816, and 0.834, respectively. The robustness of automatically extracted first-order and shape-based features was high (median ICC = 0.86 and 0.96, respectively). Other high-order features presented moderate-high robustness (median ICC = 0.57–0.93). Our model could automatically segment EC on MRI and extract radiomics features with high reliability.

Multichannel three-dimensional fully convolutional residual network-based focal liver lesion detection and classification in Gd-EOB-DTPA-enhanced MRI

PURPOSE

Gadolinium ethoxybenzyl diethylenetriamine pentaacetic acid (Gd-EOB-DTPA)-enhanced magnetic resonance imaging (MRI) has high diagnostic accuracy in the detection of liver lesions. There is a demand for computer-aided detection/diagnosis software for Gd-EOB-DTPA-enhanced MRI. We propose a deep learning-based method using one three-dimensional fully convolutional residual network (3D FC-ResNet) for liver segmentation and another 3D FC-ResNet for simultaneous detection and classification of a focal liver lesion in Gd-EOB-DTPA-enhanced MRI.

METHODS

We prepared a five-phase (unenhanced, arterial, portal venous, equilibrium, and hepatobiliary phases) series as the input image sets and labeled focal liver lesion (hepatocellular carcinoma, metastasis, hemangiomas, cysts, and scars) images as the output image sets. We used 100 cases to train our model, 42 cases to determine the hyperparameters of our model, and 42 cases to evaluate our model. We evaluated our model by free-response receiver operating characteristic curve analysis and using a confusion matrix.

RESULTS

Our model simultaneously detected and classified focal liver lesions. In the test cases, the detection accuracy for whole focal liver lesions had a true-positive ratio of 0.6 at an average of 25 false positives per case. The classification accuracy was 0.790.

CONCLUSION

We proposed the simultaneous detection and classification of a focal liver lesion in Gd-EOB-DTPA-enhanced MRI using multichannel 3D FC-ResNet. Our results indicated simultaneous detection and classification are possible using a single network. It is necessary to further improve detection sensitivity to help radiologists.

An Overview of Artificial Intelligence Applications in Liver and Pancreatic Imaging

Artificial intelligence (AI) is one of the most promising fields of research in medical imaging so far. By means of specific algorithms, it can be used to help radiologists in their routine workflow. There are several papers that describe AI approaches to solve different problems in liver and pancreatic imaging. These problems may be summarized in four different categories: segmentation, quantification, characterization and image quality improvement. Segmentation is usually the first step of successive elaborations. If done manually, it is a time-consuming process. Therefore, the semi-automatic and automatic creation of a liver or a pancreatic mask may save time for other evaluations, such as quantification of various parameters, from organs volume to their textural features. The alterations of normal liver and pancreas structure may give a clue to the presence of a diffuse or focal pathology. AI can be trained to recognize these alterations and propose a diagnosis, which may then be confirmed or not by radiologists. Finally, AI may be applied in medical image reconstruction in order to increase image quality, decrease dose administration (referring to computed tomography) and reduce scan times. In this article, we report the state of the art of AI applications in these four main categories.

AI-Based Radiological Imaging for HCC: Current Status and Future of Ultrasound

Hepatocellular carcinoma (HCC) is a common cancer worldwide. Recent international guidelines request an identification of the stage and patient background/condition for an appropriate decision for the management direction. Radiomics is a technology based on the quantitative extraction of image characteristics from radiological imaging modalities. Artificial intelligence (AI) algorithms are the principal axis of the radiomics procedure and may provide various results from large data sets beyond conventional techniques. This review article focused on the application of the radiomics-related diagnosis of HCC using radiological imaging (computed tomography, magnetic resonance imaging, and ultrasound (B-mode, contrast-enhanced ultrasound, and elastography)), and discussed the current role, limitation and future of ultrasound. Although the evidence has shown the positive effect of AI-based ultrasound in the prediction of tumor characteristics and malignant potential, posttreatment response and prognosis, there are still a number of issues in the practical management of patients with HCC. It is highly expected that the wide range of applications of AI for ultrasound will support the further improvement of the diagnostic ability of HCC and provide a great benefit to the patients.