Deep learning with convolutional neural networks for identification of liver masses and hepatocellular carcinoma: A systematic review

Performance and clinical applicability of machine learning in liver computed tomography imaging: a systematic review

OBJECTIVES

Machine learning (ML) for medical imaging is emerging for several organs and image modalities. Our objectives were to provide clinicians with an overview of this field by answering the following questions: (1) How is ML applied in liver computed tomography (CT) imaging? (2) How well do ML systems perform in liver CT imaging? (3) What are the clinical applications of ML in liver CT imaging?

METHODS

A systematic review was carried out according to the guidelines from the PRISMA-P statement. The search string focused on studies containing content relating to artificial intelligence, liver, and computed tomography.

RESULTS

One hundred ninety-one studies were included in the study. ML was applied to CT liver imaging by image analysis without clinicians' intervention in majority of studies while in newer studies the fusion of ML method with clinical intervention have been identified. Several were documented to perform very accurately on reliable but small data. Most models identified were deep learning-based, mainly using convolutional neural networks. Potentially many clinical applications of ML to CT liver imaging have been identified through our review including liver and its lesion segmentation and classification, segmentation of vascular structure inside the liver, fibrosis and cirrhosis staging, metastasis prediction, and evaluation of chemotherapy.

CONCLUSION

Several studies attempted to provide transparent result of the model. To make the model convenient for a clinical application, prospective clinical validation studies are in urgent call. Computer scientists and engineers should seek to cooperate with health professionals to ensure this.

KEY POINTS

• ML shows great potential for CT liver image tasks such as pixel-wise segmentation and classification of liver and liver lesions, fibrosis staging, metastasis prediction, and retrieval of relevant liver lesions from similar cases of other patients. • Despite presenting the result is not standardized, many studies have attempted to provide transparent results to interpret the machine learning method performance in the literature. • Prospective studies are in urgent call for clinical validation of ML method, preferably carried out by cooperation between clinicians and computer scientists.

A Systematic Review and Meta-analysis of Convolutional Neural Network in the Diagnosis of Colorectal Polyps and Cancer

Convolutional neural networks are a class of deep neural networks used for different clinical purposes, including improving the detection rate of colorectal lesions. This systematic review and meta-analysis aimed to assess the performance of convolutional neural network-based models in the detection or classification of colorectal polyps and colorectal cancer. A systematic search was performed in MEDLINE, SCOPUS, Web of Science, and other related databases. The performance measures of the convolutional neural network models in the detection of colorectal polyps and colorectal cancer were calculated in the 2 scenarios of the best and worst accuracy. Stata and R software were used for conducting the meta-analysis. From 3368 searched records, 24 primary studies were included. The sensitivity and specificity of convolutional neural network models in predicting colorectal polyps in worst and best scenarios ranged from 84.7% to 91.6% and from 86.0% to 93.8%, respectively. These values in predicting colorectal cancer varied between 93.2% and 94.1% and between 94.6% and 97.7%. The positive and negative likelihood ratios varied between 6.2 and 14.5 and 0.09 and 0.17 in these scenarios, respectively, in predicting colorectal polyps, and 17.1-41.2 and 0.07-0.06 in predicting colorectal polyps. The diagnostic odds ratio and accuracy measures of convolutional neural network models in predicting colorectal polyps in worst and best scenarios ranged between 36% and 162% and between 80.5% and 88.6%, respectively. These values in predicting colorectal cancer in the worst and the best scenarios varied between 239.63% and 677.47% and between 88.2% and 96.4%. The area under the receiver operating characteristic varied between 0.92 and 0.97 in the worst and the best scenarios in colorectal polyps, respectively, and between 0.98 and 0.99 in colorectal polyps prediction. Convolutional neural network-based models showed an acceptable accuracy in detecting colorectal polyps and colorectal cancer.

A multi-modal deep neural network for multi-class liver cancer diagnosis

Liver disease is a potentially asymptomatic clinical entity that may progress to patient death. This study proposes a multi-modal deep neural network for multi-class malignant liver diagnosis. In parallel with the portal venous computed tomography (CT) scans, pathology data is utilized to prognosticate primary liver cancer variants and metastasis. The processed CT scans are fed to the deep dilated convolution neural network to explore salient features. The residual connections are further added to address vanishing gradient problems. Correspondingly, five pathological features are learned using a wide and deep network that gives a benefit of memorization with generalization. The down-scaled hierarchical features from CT scan and pathology data are concatenated to pass through fully connected layers for classification between liver cancer variants. In addition, the transfer learning of pre-trained deep dilated convolution layers assists in handling insufficient and imbalanced dataset issues. The fine-tuned network can predict three-class liver cancer variants with an average accuracy of 96.06% and an Area Under Curve (AUC) of 0.832. To the best of our knowledge, this is the first study to classify liver cancer variants by integrating pathology and image data, hence following the medical perspective of malignant liver diagnosis. The comparative analysis on the benchmark dataset shows that the proposed multi-modal neural network outperformed most of the liver diagnostic studies and is comparable to others.

Deep learning techniques in liver tumour diagnosis using CT and MR imaging - A systematic review

Deep learning has become a thriving force in the computer aided diagnosis of liver cancer, as it solves extremely complicated challenges with high accuracy over time and facilitates medical experts in their diagnostic and treatment procedures. This paper presents a comprehensive systematic review on deep learning techniques applied for various applications pertaining to liver images, challenges faced by the clinicians in liver tumour diagnosis and how deep learning bridges the gap between clinical practice and technological solutions with an in-depth summary of 113 articles. Since, deep learning is an emerging revolutionary technology, recent state-of-the-art research implemented on liver images are reviewed with more focus on classification, segmentation and clinical applications in the management of liver diseases. Additionally, similar review articles in literature are reviewed and compared. The review is concluded by presenting the contemporary trends and unaddressed research issues in the field of liver tumour diagnosis, offering directions for future research in this field.

The Importance of Animal Models in Biomedical Research: Current Insights and Applications

Animal research is considered a key element in advance of biomedical science. Although its use is controversial and raises ethical challenges, the contribution of animal models in medicine is essential for understanding the physiopathology and novel treatment alternatives for several animal and human diseases. Current pandemics’ pathology, such as the 2019 Coronavirus disease, has been studied in primate, rodent, and porcine models to recognize infection routes and develop therapeutic protocols. Worldwide issues such as diabetes, obesity, neurological disorders, pain, rehabilitation medicine, and surgical techniques require studying the process in different animal species before testing them on humans. Due to their relevance, this article aims to discuss the importance of animal models in diverse lines of biomedical research by analyzing the contributions of the various species utilized in science over the past five years about key topics concerning human and animal health.

Ensemble Learning of Multiple Models Using Deep Learning for Multiclass Classification of Ultrasound Images of Hepatic Masses

Ultrasound (US) is often used to diagnose liver masses. Ensemble learning has recently been commonly used for image classification, but its detailed methods are not fully optimized. The purpose of this study is to investigate the usefulness and comparison of some ensemble learning and ensemble pruning techniques using multiple convolutional neural network (CNN) trained models for image classification of liver masses in US images. Dataset of the US images were classified into four categories: benign liver tumor (BLT) 6320 images, liver cyst (LCY) 2320 images, metastatic liver cancer (MLC) 9720 images, primary liver cancer (PLC) 7840 images. In this study, 250 test images were randomly selected for each class, for a total of 1000 images, and the remaining images were used as the training. 16 different CNNs were used for training and testing ultrasound images. The ensemble learning used soft voting (SV), weighted average voting (WAV), weighted hard voting (WHV) and stacking (ST). All four types of ensemble learning (SV, ST, WAV, and WHV) showed higher values of accuracy than the single CNN. All four types also showed significantly higher deep learning (DL) performance than ResNeXt101 alone. For image classification of liver masses using US images, ensemble learning improved the performance of DL over a single CNN.

Artificial Intelligence in Hepatology- Ready for the Primetime

Artificial Intelligence (AI) is a mathematical process of computer mediating designing of algorithms to support human intelligence. AI in hepatology has shown tremendous promise to plan appropriate management and hence improve treatment outcomes. The field of AI is in a very early phase with limited clinical use. AI tools such as machine learning, deep learning, and 'big data' are in a continuous phase of evolution, presently being applied for clinical and basic research. In this review, we have summarized various AI applications in hepatology, the pitfalls and AI's future implications. Different AI models and algorithms are under study using clinical, laboratory, endoscopic and imaging parameters to diagnose and manage liver diseases and mass lesions. AI has helped to reduce human errors and improve treatment protocols. Further research and validation are required for future use of AI in hepatology.

The Diagnostic Approach towards Combined Hepatocellular-Cholangiocarcinoma-State of the Art and Future Perspectives

Combined hepatocellular-cholangiocarcinoma (cHCC-CCA) is a rare primary liver cancer which displays clinicopathologic features of both hepatocellular (HCC) and cholangiocellular carcinoma (CCA). The similarity to HCC and CCA makes the diagnostic workup particularly challenging. Alpha-fetoprotein (AFP) and carbohydrate antigen 19-9 (CA 19-9) are blood tumour markers related with HCC and CCA, respectively. They can be used as diagnostic markers in cHCC-CCA as well, albeit with low sensitivity. The imaging features of cHCC-CCA overlap with those of HCC and CCA, dependent on the predominant histopathological component. Using the Liver Imaging and Reporting Data System (LI-RADS), as many as half of cHCC-CCAs may be falsely categorised as HCC. This is especially relevant since the diagnosis of HCC may be made without histopathological confirmation in certain cases. Thus, in instances of diagnostic uncertainty (e.g., simultaneous radiological HCC and CCA features, elevation of CA 19-9 and AFP, HCC imaging features and elevated CA 19-9, and vice versa) multiple image-guided core needle biopsies should be performed and analysed by an experienced pathologist. Recent advances in the molecular characterisation of cHCC-CCA, innovative diagnostic approaches (e.g., liquid biopsies) and methods to analyse multiple data points (e.g., clinical, radiological, laboratory, molecular, histopathological features) in an all-encompassing way (e.g., by using artificial intelligence) might help to address some of the existing diagnostic challenges.

Deep learning-based algorithm improved radiologists' performance in bone metastases detection on CT

OBJECTIVES

To develop and evaluate a deep learning-based algorithm (DLA) for automatic detection of bone metastases on CT.

METHODS

This retrospective study included CT scans acquired at a single institution between 2009 and 2019. Positive scans with bone metastases and negative scans without bone metastasis were collected to train the DLA. Another 50 positive and 50 negative scans were collected separately from the training dataset and were divided into validation and test datasets at a 2:3 ratio. The clinical efficacy of the DLA was evaluated in an observer study with board-certified radiologists. Jackknife alternative free-response receiver operating characteristic analysis was used to evaluate observer performance.

RESULTS

A total of 269 positive scans including 1375 bone metastases and 463 negative scans were collected for the training dataset. The number of lesions identified in the validation and test datasets was 49 and 75, respectively. The DLA achieved a sensitivity of 89.8% (44 of 49) with 0.775 false positives per case for the validation dataset and 82.7% (62 of 75) with 0.617 false positives per case for the test dataset. With the DLA, the overall performance of nine radiologists with reference to the weighted alternative free-response receiver operating characteristic figure of merit improved from 0.746 to 0.899 (p < .001). Furthermore, the mean interpretation time per case decreased from 168 to 85 s (p = .004).

CONCLUSION

With the aid of the algorithm, the overall performance of radiologists in bone metastases detection improved, and the interpretation time decreased at the same time.

KEY POINTS

• A deep learning-based algorithm for automatic detection of bone metastases on CT was developed. • In the observer study, overall performance of radiologists in bone metastases detection improved significantly with the aid of the algorithm. • Radiologists' interpretation time decreased at the same time.

Role of artificial intelligence in the diagnosis and treatment of hepatocellular carcinoma

Artificial intelligence (AI) evolved many years ago, but it gained much advancement in recent years for its use in the medical domain. AI with its different subsidiaries, i.e. deep learning and machine learning, examine a large amount of data and performs an essential part in decision-making in addition to conquering the limitations related to human evaluation. Deep learning tries to imitate the functioning of the human brain. It utilizes much more data and intricate algorithms. Machine learning is AI based on automated learning. It utilizes earlier given data and uses algorithms to arrange and identify models. Globally, hepatocellular carcinoma is a major cause of illness and fatality. Although with substantial progress in the whole treatment strategy for hepatocellular carcinoma, managing it is still a major issue. AI in the area of gastroenterology, especially in hepatology, is particularly useful for various investigations of hepatocellular carcinoma because it is a commonly found tumor, and has specific radiological features that enable diagnostic procedures without the requirement of the histological study. However, interpreting and analyzing the resulting images is not always easy due to change of images throughout the disease process. Further, the prognostic process and response to the treatment process could be influenced by numerous components. Currently, AI is utilized in order to diagnose, curative and prediction goals. Future investigations are essential to prevent likely bias, which might subsequently influence the analysis of images and therefore restrict the consent and utilization of such models in medical practices. Moreover, experts are required to realize the real utility of such approaches, along with their associated potencies and constraints.

Current and emerging artificial intelligence applications for pediatric abdominal imaging

Artificial intelligence (AI) uses computers to mimic cognitive functions of the human brain, allowing inferences to be made from generally large datasets. Traditional machine learning (e.g., decision tree analysis, support vector machines) and deep learning (e.g., convolutional neural networks) are two commonly employed AI approaches both outside and within the field of medicine. Such techniques can be used to evaluate medical images for the purposes of automated detection and segmentation, classification tasks (including diagnosis, lesion or tissue characterization, and prediction), and image reconstruction. In this review article we highlight recent literature describing current and emerging AI methods applied to abdominal imaging (e.g., CT, MRI and US) and suggest potential future applications of AI in the pediatric population.

Classification of multi-differentiated liver cancer pathological images based on deep learning attention mechanism

PURPOSE

Liver cancer is one of the most common malignant tumors in the world, ranking fifth in malignant tumors. The degree of differentiation can reflect the degree of malignancy. The degree of malignancy of liver cancer can be divided into three types: poorly differentiated, moderately differentiated, and well differentiated. Diagnosis and treatment of different levels of differentiation are crucial to the survival rate and survival time of patients. As the gold standard for liver cancer diagnosis, histopathological images can accurately distinguish liver cancers of different levels of differentiation. Therefore, the study of intelligent classification of histopathological images is of great significance to patients with liver cancer. At present, the classification of histopathological images of liver cancer with different degrees of differentiation has disadvantages such as time-consuming, labor-intensive, and large manual investment. In this context, the importance of intelligent classification of histopathological images is obvious.

METHODS

Based on the development of a complete data acquisition scheme, this paper applies the SENet deep learning model to the intelligent classification of all types of differentiated liver cancer histopathological images for the first time, and compares it with the four deep learning models of VGG16, ResNet50, ResNet_CBAM, and SKNet. The evaluation indexes adopted in this paper include confusion matrix, Precision, recall, F1 Score, etc. These evaluation indexes can be used to evaluate the model in a very comprehensive and accurate way.

RESULTS

Five different deep learning classification models are applied to collect the data set and evaluate model. The experimental results show that the SENet model has achieved the best classification effect with an accuracy of 95.27%. The model also has good reliability and generalization ability. The experiment proves that the SENet deep learning model has a good application prospect in the intelligent classification of histopathological images.

CONCLUSIONS

This study also proves that deep learning has great application value in solving the time-consuming and laborious problems existing in traditional manual film reading, and it has certain practical significance for the intelligent classification research of other cancer histopathological images.

Medical deep learning-A systematic meta-review

Deep learning has remarkably impacted several different scientific disciplines over the last few years. For example, in image processing and analysis, deep learning algorithms were able to outperform other cutting-edge methods. Additionally, deep learning has delivered state-of-the-art results in tasks like autonomous driving, outclassing previous attempts. There are even instances where deep learning outperformed humans, for example with object recognition and gaming. Deep learning is also showing vast potential in the medical domain. With the collection of large quantities of patient records and data, and a trend towards personalized treatments, there is a great need for automated and reliable processing and analysis of health information. Patient data is not only collected in clinical centers, like hospitals and private practices, but also by mobile healthcare apps or online websites. The abundance of collected patient data and the recent growth in the deep learning field has resulted in a large increase in research efforts. In Q2/2020, the search engine PubMed returned already over 11,000 results for the search term 'deep learning', and around 90% of these publications are from the last three years. However, even though PubMed represents the largest search engine in the medical field, it does not cover all medical-related publications. Hence, a complete overview of the field of 'medical deep learning' is almost impossible to obtain and acquiring a full overview of medical sub-fields is becoming increasingly more difficult. Nevertheless, several review and survey articles about medical deep learning have been published within the last few years. They focus, in general, on specific medical scenarios, like the analysis of medical images containing specific pathologies. With these surveys as a foundation, the aim of this article is to provide the first high-level, systematic meta-review of medical deep learning surveys.

Image Fusion and Stylization Processing Based on Multiscale Transformation and Convolutional Neural Network

With the continuous development of imaging sensors, images contain more and more information, the images presented by different types of sensors are different, and the images obtained by the same type of sensors under different parameters or conditions are also different. Multisource image fusion technology combines images acquired by different types of sensors or the same type of sensors with different parameter settings, which makes the image information more complete, compensates for the limitations of images of the same type, and also allows you to save information about the characteristics of the original image. Multimodal image mosaic and multifocal image mosaic have been studied in detail in two directions. On the one hand, a method based on frequency domain transformation is used for multiscale image decomposition. On the other hand, image extraction with neural network-based methods is proposed. The technology of convolutional neural networks (CNNs) allows to extract richer texture features. However, when using this method for fusion, it is difficult to obtain an accurate decision map, and there are artifacts in the fusion boundary. Based on this, a multifocal fusion method based on a two-stage CNN is proposed. Train the advanced intensive network to classify input image blocks as focus, and then use the appropriate merge rules to get the ideal decision tree. In addition, several versions of the fuzzy learning set have been developed to improve network performance. Experimental results show that the frames of the first stage proposed by the algorithm make it possible to obtain an accurate decision scheme and that the frames of the second stage make it possible to eliminate the pseudo-shadow of the integration boundary.

Liver Tumor Localization Based on YOLOv3 and 3D-Semantic Segmentation Using Deep Neural Networks

Worldwide, more than 1.5 million deaths are occur due to liver cancer every year. The use of computed tomography (CT) for early detection of liver cancer could save millions of lives per year. There is also an urgent need for a computerized method to interpret, detect and analyze CT scans reliably, easily, and correctly. However, precise segmentation of minute tumors is a difficult task because of variation in the shape, intensity, size, low contrast of the tumor, and the adjacent tissues of the liver. To address these concerns, a model comprised of three parts: synthetic image generation, localization, and segmentation, is proposed. An optimized generative adversarial network (GAN) is utilized for generation of synthetic images. The generated images are localized by using the improved localization model, in which deep features are extracted from pre-trained Resnet-50 models and fed into a YOLOv3 detector as an input. The proposed modified model localizes and classifies the minute liver tumor with 0.99 mean average precision (mAp). The third part is segmentation, in which pre-trained Inceptionresnetv2 employed as a base-Network of Deeplabv3 and subsequently is trained on fine-tuned parameters with annotated ground masks. The experiments reflect that the proposed approach has achieved greater than 95% accuracy in the testing phase and it is proven that, in comparison to the recently published work in this domain, this research has localized and segmented the liver and minute liver tumor with more accuracy.

Advancements of Artificial Intelligence in Liver-Associated Diseases and Surgery

Background and Objectives: The advancement of artificial intelligence (AI) based technologies in medicine is progressing rapidly, but the majority of its real-world applications has not been implemented. The establishment of an accurate diagnosis with treatment has now transitioned into an artificial intelligence era, which has continued to provide an amplified understanding of liver cancer as a disease and helped to proceed better with the method of procurement. This article focuses on reviewing the AI in liver-associated diseases and surgical procedures, highlighting its development, use, and related counterparts. Materials and Methods: We searched for articles regarding AI in liver-related ailments and surgery, using the keywords (mentioned below) on PubMed, Google Scholar, Scopus, MEDLINE, and Cochrane Library. Choosing only the common studies suggested by these libraries, we segregated the matter based on disease. Finally, we compiled the essence of these articles under the various sub-headings. Results: After thorough review of articles, it was observed that there was a surge in the occurrence of liver-related surgeries, diagnoses, and treatments. Parallelly, advanced computer technologies governed by AI continue to prove their efficacy in the accurate screening, analysis, prediction, treatment, and recuperation of liver-related cases. Conclusions: The continual developments and high-order precision of AI is expanding its roots in all directions of applications. Despite being novel and lacking research, AI has shown its intrinsic worth for procedures in liver surgery while providing enhanced healing opportunities and personalized treatment for liver surgery patients.

Diagnostic Accuracy of Artificial Intelligence Based on Imaging Data for Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma: A Systematic Review and Meta-Analysis

Background

The presence of microvascular invasion (MVI) is considered an independent prognostic factor associated with early recurrence and poor survival in hepatocellular carcinoma (HCC) patients after resection. Artificial intelligence (AI), mainly consisting of non-deep learning algorithms (NDLAs) and deep learning algorithms (DLAs), has been widely used for MVI prediction in medical imaging.

Aim

To assess the diagnostic accuracy of AI algorithms for non-invasive, preoperative prediction of MVI based on imaging data.

Methods

Original studies reporting AI algorithms for non-invasive, preoperative prediction of MVI based on quantitative imaging data were identified in the databases PubMed, Embase, and Web of Science. The quality of the included studies was assessed using the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) scale. The pooled sensitivity, specificity, positive likelihood ratio (PLR), and negative likelihood ratio (NLR) were calculated using a random-effects model with 95% CIs. A summary receiver operating characteristic curve and the area under the curve (AUC) were generated to assess the diagnostic accuracy of the deep learning and non-deep learning models. In the non-deep learning group, we further performed meta-regression and subgroup analyses to identify the source of heterogeneity.

Results

Data from 16 included studies with 4,759 cases were available for meta-analysis. Four studies on deep learning models, 12 studies on non-deep learning models, and two studies compared the efficiency of the two types. For predictive performance of deep learning models, the pooled sensitivity, specificity, PLR, NLR, and AUC values were 0.84 [0.75–0.90], 0.84 [0.77–0.89], 5.14 [3.53–7.48], 0.2 [0.12–0.31], and 0.90 [0.87–0.93]; and for non-deep learning models, they were 0.77 [0.71–0.82], 0.77 [0.73–0.80], 3.30 [2.83–3.84], 0.30 [0.24–0.38], and 0.82 [0.79–0.85], respectively. Subgroup analyses showed a significant difference between the single tumor subgroup and the multiple tumor subgroup in the pooled sensitivity, NLR, and AUC.

Conclusion

This meta-analysis demonstrates the high diagnostic accuracy of non-deep learning and deep learning methods for MVI status prediction and their promising potential for clinical decision-making. Deep learning models perform better than non-deep learning models in terms of the accuracy of MVI prediction, methodology, and cost-effectiveness.

Systematic Review Registration

https://www.crd.york.ac.uk/PROSPERO/display_record.php? RecordID=260891, ID:CRD42021260891.

Deep Convolutional Neural Network Based Analysis of Liver Tissues Using Computed Tomography Images

Liver disease is one of the most prominent causes of the increase in the death rate worldwide. These death rates can be reduced by early liver diagnosis. Computed tomography (CT) is a method for the analysis of liver images in clinical practice. To analyze a large number of liver images, radiologists face problems that sometimes lead to the wrong classifications of liver diseases, eventually resulting in severe conditions, such as liver cancer. Thus, a machine-learning-based method is needed to classify such problems based on their texture features. This paper suggests two different kinds of algorithms to address this challenging task of liver disease classification. Our first method, which is based on conventional machine learning, uses texture features for classification. This method uses conventional machine learning through automated texture analysis and supervised machine learning methods. For this purpose, 3000 clinically verified CT image samples were obtained from 71 patients. Appropriate image classes belonging to the same disease were trained to confirm the abnormalities in liver tissues by using supervised learning methods. Our proposed method correctly quantified asymmetric patterns in CT images using machine learning. We evaluated the effectiveness of the feature vector with the K Nearest Neighbor (KNN), Naive Bayes (NB), Support Vector Machine (SVM), and Random Forest (RF) classifiers. The second algorithm proposes a semantic segmentation model for liver disease identification. Our model is based on semantic image segmentation (SIS) using a convolutional neural network (CNN). The model encodes high-density maps through a specific guided attention method. The trained model classifies CT images into five different categories of various diseases. The compelling results obtained confirm the effectiveness of the proposed model. The study concludes that abnormalities in the human liver could be discriminated and diagnosed by texture analysis techniques, which may also assist radiologists and medical physicists in predicting the severity and proliferation of abnormalities in liver diseases.

Quality assessment standards in artificial intelligence diagnostic accuracy systematic reviews: a meta-research study

Artificial intelligence (AI) centred diagnostic systems are increasingly recognised as robust solutions in healthcare delivery pathways. In turn, there has been a concurrent rise in secondary research studies regarding these technologies in order to influence key clinical and policymaking decisions. It is therefore essential that these studies accurately appraise methodological quality and risk of bias within shortlisted trials and reports. In order to assess whether this critical step is performed, we undertook a meta-research study evaluating adherence to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool within AI diagnostic accuracy systematic reviews. A literature search was conducted on all studies published from 2000 to December 2020. Of 50 included reviews, 36 performed the quality assessment, of which 27 utilised the QUADAS-2 tool. Bias was reported across all four domains of QUADAS-2. Two hundred forty-three of 423 studies (57.5%) across all systematic reviews utilising QUADAS-2 reported a high or unclear risk of bias in the patient selection domain, 110 (26%) reported a high or unclear risk of bias in the index test domain, 121 (28.6%) in the reference standard domain and 157 (37.1%) in the flow and timing domain. This study demonstrates the incomplete uptake of quality assessment tools in reviews of AI-based diagnostic accuracy studies and highlights inconsistent reporting across all domains of quality assessment. Poor standards of reporting act as barriers to clinical implementation. The creation of an AI-specific extension for quality assessment tools of diagnostic accuracy AI studies may facilitate the safe translation of AI tools into clinical practice.

Prognosis of ischemic stroke predicted by machine learning based on multi-modal MRI radiomics

OBJECTIVE

Increased risk of stroke is highly associated with psychiatric disorders. We aimed to conduct the machine learning model based on multi-modal magnetic resonance imaging (MRI) radiomics predicting the prognosis of ischemic stroke.

METHODS

This study retrospectively analyzed 148 patients with acute ischemic stroke due to anterior circulation artery occlusion. Based on the modified Rankin Scale (mRS) score, patients were divided into good (mRS ≤ 2) and poor (mRS > 2) outcome groups. Segmentation of the infarct region was performed by manually outlining a mask of the lesion on diffusion-weighted images (DWI) using MRIcron software. The apparent diffusion coefficient (ADC), fluid decay inversion recoverage (FLAIR), susceptibility weighted imaging (SWI) and T1-weighted (T1w) images were aligned to the DWI images and the radiomic features within the lesion area were extracted for each image modality. The calculations were done using pyradiomics software and a total of 4,744 stroke-related imaging features were automatically calculated. Next, feature selection based on recursive feature elimination was used for each modality and three radiomic features were extracted from each modality plus one feature from the lesion mask, for a total of 16 radiomic features. At last, five machine learning (ML) models were trained and tested to predict stroke prognosis, calculate the received operating characteristic (ROC) curves and other parameters, evaluate the performance of the models and validate their predictive efficacy by five-fold cross-validation.

RESULTS

Sixteen radiomic features were selected to construct the ML models for prognostic classification. By five-fold cross-validation, light gradient boosting machine (LightGBM) model-based muti-modal MRI radiomic features performed best in binary prognostic classification with accuracy of 0.831, sensitivity of 0.739, specificity of 0.902, F1-score of 0.788 and an area under the curve (AUC) of 0.902.

CONCLUSION

The ML models based on muti-modal MRI radiomics are of high value for predicting clinical outcomes in acute stroke patients.

Deep learning in hepatocellular carcinoma: Current status and future perspectives

Hepatocellular carcinoma (HCC) is among the leading causes of cancer incidence and death. Despite decades of research and development of new treatment options, the overall outcomes of patients with HCC continue to remain poor. There are areas of unmet need in risk prediction, early diagnosis, accurate prognostication, and individualized treatments for patients with HCC. Recent years have seen an explosive growth in the application of artificial intelligence (AI) technology in medical research, with the field of HCC being no exception. Among the various AI-based machine learning algorithms, deep learning algorithms are considered state-of-the-art techniques for handling and processing complex multimodal data ranging from routine clinical variables to high-resolution medical images. This article will provide a comprehensive review of the recently published studies that have applied deep learning for risk prediction, diagnosis, prognostication, and treatment planning for patients with HCC.

Development of a Deep Learning Model to Assist With Diagnosis of Hepatocellular Carcinoma

Background

An accurate pathological diagnosis of hepatocellular carcinoma (HCC), one of the malignant tumors with the highest mortality rate, is time-consuming and heavily reliant on the experience of a pathologist. In this report, we proposed a deep learning model that required minimal noise reduction or manual annotation by an experienced pathologist for HCC diagnosis and classification.

Methods

We collected a whole-slide image of hematoxylin and eosin-stained pathological slides from 592 HCC patients at the First Affiliated Hospital, College of Medicine, Zhejiang University between 2015 and 2020. We propose a noise-specific deep learning model. The model was trained initially with 137 cases cropped into multiple-scaled datasets. Patch screening and dynamic label smoothing strategies are adopted to handle the histopathological liver image with noise annotation from the perspective of input and output. The model was then tested in an independent cohort of 455 cases with comparable tumor types and differentiations.

Results

Exhaustive experiments demonstrated that our two-step method achieved 87.81% pixel-level accuracy and 98.77% slide-level accuracy in the test dataset. Furthermore, the generalization performance of our model was also verified using The Cancer Genome Atlas dataset, which contains 157 HCC pathological slides, and achieved an accuracy of 87.90%.

Conclusions

The noise-specific histopathological classification model of HCC based on deep learning is effective for the dataset with noisy annotation, and it significantly improved the pixel-level accuracy of the regular convolutional neural network (CNN) model. Moreover, the model also has an advantage in detecting well-differentiated HCC and microvascular invasion.

基于激活层前置压缩激励残差网络的早期胃癌筛查算法

OBJECTIVE

To propose a quick and accurate method for screening early gastric cancer based on Pre-Activation Squeeze- and-Exception ResNet (PASE-ResNet) gastroscopy images in limited labeled data sets.

METHODS

We developed an algorithm based on Pre-Activation Squeeze- and-Exception ResNet for early gastric cancer screening. To focus on the taskrelated image region and enhance the feature expression ability of model, we combined the Squeeze-and-Exception (SE) module with the residual module in PreAct-ResNet to adjust the weight of the feature channel. The strategy of local screening + global sliding window was adopted to improve the performance of early cancer screening. After data expansion, 18 400 set subgraphs were obtained, and the gastroscopy images were examined using the PASE-ResNet model by sliding window.

RESULTS

The results of experiments showed that the proposed algorithm had good performance for screening early gastric cancer with an accuracy of 98.03%, a sensitivity of 98.96% and a specificity of 96.52%.

CONCLUSION

The PASE-ResNet can achieve a high accuracy for screening early gastric cancer.

Artificial intelligence as a diagnostic aid in cross-sectional radiological imaging of the abdominopelvic cavity: a protocol for a systematic review

INTRODUCTION

The application of artificial intelligence (AI) technologies as a diagnostic aid in healthcare is increasing. Benefits include applications to improve health systems, such as rapid and accurate interpretation of medical images. This may improve the performance of diagnostic, prognostic and management decisions. While a large amount of work has been undertaken discussing the role of AI little is understood regarding the performance of such applications in the clinical setting. This systematic review aims to critically appraise the diagnostic performance of AI algorithms to identify disease from cross-sectional radiological images of the abdominopelvic cavity, to identify current limitations and inform future research.

METHODS AND ANALYSIS

A systematic search will be conducted on Medline, EMBASE and the Cochrane Central Register of Controlled Trials to identify relevant studies. Primary studies where AI-based technologies have been used as a diagnostic aid in cross-sectional radiological images of the abdominopelvic cavity will be included. Diagnostic accuracy of AI models, including reported sensitivity, specificity, predictive values, likelihood ratios and the area under the receiver operating characteristic curve will be examined and compared with standard practice. Risk of bias of included studies will be assessed using the QUADAS-2 tool. Findings will be reported according to the Synthesis Without Meta-analysis guidelines.

ETHICS AND DISSEMINATION

No ethical approval is required as primary data will not be collected. The results will inform further research studies in this field. Findings will be disseminated at relevant conferences, on social media and published in a peer-reviewed journal.

PROSPERO REGISTRATION NUMBER

CRD42021237249.

Multi-Resolution Image Segmentation Based on a Cascaded U-ADenseNet for the Liver and Tumors

The liver is an irreplaceable organ in the human body, maintaining life activities and metabolism. Malignant tumors of the liver have a high mortality rate at present. Computer-aided segmentation of the liver and tumors has significant effects on clinical diagnosis and treatment. There are still many challenges in the segmentation of the liver and liver tumors simultaneously, such as, on the one hand, that convolutional kernels with fixed geometric structures do not match complex, irregularly shaped targets; on the other, pooling during convolution results in a loss of spatial contextual information of images. In this work, we designed a cascaded U-ADenseNet with coarse-to-fine processing for addressing the above issues of fully automatic segmentation. This work contributes multi-resolution input images and multi-layered channel attention combined with atrous spatial pyramid pooling densely connected in the fine segmentation. The proposed model was evaluated by a public dataset of the Liver Tumor Segmentation Challenge (LiTS). Our approach attained competitive liver and tumor segmentation scores that exceeded other methods across a wide range of metrics.

Progress of MRI Radiomics in Hepatocellular Carcinoma

Background

Hepatocellular carcinoma (HCC) is the sixth most common cancer in the world and the third leading cause of cancer-related death. Although the diagnostic scheme of HCC is currently undergoing refinement, the prognosis of HCC is still not satisfactory. In addition to certain factors, such as tumor size and number and vascular invasion displayed on traditional imaging, some histopathological features and gene expression parameters are also important for the prognosis of HCC patients. However, most parameters are based on postoperative pathological examinations, which cannot help with preoperative decision-making. As a new field, radiomics extracts high-throughput imaging data from different types of images to build models and predict clinical outcomes noninvasively before surgery, rendering it a powerful aid for making personalized treatment decisions preoperatively.

Objective

This study reviewed the workflow of radiomics and the research progress on magnetic resonance imaging (MRI) radiomics in the diagnosis and treatment of HCC.

Methods

A literature review was conducted by searching PubMed for search of relevant peer-reviewed articles published from May 2017 to June 2021.The search keywords included HCC, MRI, radiomics, deep learning, artificial intelligence, machine learning, neural network, texture analysis, diagnosis, histopathology, microvascular invasion, surgical resection, radiofrequency, recurrence, relapse, transarterial chemoembolization, targeted therapy, immunotherapy, therapeutic response, and prognosis.

Results

Radiomics features on MRI can be used as biomarkers to determine the differential diagnosis, histological grade, microvascular invasion status, gene expression status, local and systemic therapeutic responses, and prognosis of HCC patients.

Conclusion

Radiomics is a promising new imaging method. MRI radiomics has high application value in the diagnosis and treatment of HCC.

A Systematic Review of Artificial Intelligence Techniques in Cancer Prediction and Diagnosis

Artificial intelligence has aided in the advancement of healthcare research. The availability of open-source healthcare statistics has prompted researchers to create applications that aid cancer detection and prognosis. Deep learning and machine learning models provide a reliable, rapid, and effective solution to deal with such challenging diseases in these circumstances. PRISMA guidelines had been used to select the articles published on the web of science, EBSCO, and EMBASE between 2009 and 2021. In this study, we performed an efficient search and included the research articles that employed AI-based learning approaches for cancer prediction. A total of 185 papers are considered impactful for cancer prediction using conventional machine and deep learning-based classifications. In addition, the survey also deliberated the work done by the different researchers and highlighted the limitations of the existing literature, and performed the comparison using various parameters such as prediction rate, accuracy, sensitivity, specificity, dice score, detection rate, area undercover, precision, recall, and F1-score. Five investigations have been designed, and solutions to those were explored. Although multiple techniques recommended in the literature have achieved great prediction results, still cancer mortality has not been reduced. Thus, more extensive research to deal with the challenges in the area of cancer prediction is required.

Deep learning applied to the imaging diagnosis of hepatocellular carcinoma

Each year, hepatocellular carcinoma is diagnosed in more than half a million people worldwide. It is the fifth most common cancer in men and the seventh most common cancer in women. Its diagnosis is currently made using imaging techniques, such as computed tomography and magnetic resonance imaging. For most cirrhotic patients, these methods are enough for diagnosis, foregoing the necessity of a liver biopsy. In order to improve outcomes and bypass obstacles, many companies and clinical centers have been trying to develop deep learning systems that could be able to diagnose and classify liver nodules in the cirrhotic liver, in which the neural networks are one of the most efficient approaches to accurately diagnose liver nodules. Despite the advances in deep learning systems for the diagnosis of imaging techniques, there are many issues that need better development in order to make such technologies more useful in daily practice.

Clinical application of mask region-based convolutional neural network for the automatic detection and segmentation of abnormal liver density based on hepatocellular carcinoma computed tomography datasets

The aim of the study was to use a previously proposed mask region–based convolutional neural network (Mask R-CNN) for automatic abnormal liver density detection and segmentation based on hepatocellular carcinoma (HCC) computed tomography (CT) datasets from a radiological perspective. Training and testing datasets were acquired retrospectively from two hospitals of Taiwan. The training dataset contained 10,130 images of liver tumor densities of 11,258 regions of interest (ROIs). The positive testing dataset contained 1,833 images of liver tumor densities with 1,874 ROIs, and negative testing data comprised 20,283 images without abnormal densities in liver parenchyma. The Mask R-CNN was used to generate a medical model, and areas under the curve, true positive rates, false positive rates, and Dice coefficients were evaluated. For abnormal liver CT density detection, in each image, we identified the mean area under the curve, true positive rate, and false positive rate, which were 0.9490, 91.99%, and 13.68%, respectively. For segmentation ability, the highest mean Dice coefficient obtained was 0.8041. This study trained a Mask R-CNN on various HCC images to construct a medical model that serves as an auxiliary tool for alerting radiologists to abnormal CT density in liver scans; this model can simultaneously detect liver lesions and perform automatic instance segmentation.

State of the Art in Artificial Intelligence and Radiomics in Hepatocellular Carcinoma

The most common liver malignancy is hepatocellular carcinoma (HCC), which is also associated with high mortality. Often HCC develops in a chronic liver disease setting, and early diagnosis as well as accurate screening of high-risk patients is crucial for appropriate and effective management of these patients. While imaging characteristics of HCC are well-defined in the diagnostic phase, challenging cases still occur, and current prognostic and predictive models are limited in their accuracy. Radiomics and machine learning (ML) offer new tools to address these issues and may lead to scientific breakthroughs with the potential to impact clinical practice and improve patient outcomes. In this review, we will present an overview of these technologies in the setting of HCC imaging across different modalities and a range of applications. These include lesion segmentation, diagnosis, prognostic modeling and prediction of treatment response. Finally, limitations preventing clinical application of radiomics and ML at the present time are discussed, together with necessary future developments to bring the field forward and outside of a purely academic endeavor.

Automatized Hepatic Tumor Volume Analysis of Neuroendocrine Liver Metastases by Gd-EOB MRI-A Deep-Learning Model to Support Multidisciplinary Cancer Conference Decision-Making

BACKGROUND

Rapid quantification of liver metastasis for diagnosis and follow-up is an unmet medical need in patients with secondary liver malignancies. We present a 3D-quantification model of neuroendocrine liver metastases (NELM) using gadoxetic-acid (Gd-EOB)-enhanced MRI as a useful tool for multidisciplinary cancer conferences (MCC).

METHODS

Manual 3D-segmentations of NELM and livers (149 patients in 278 Gd-EOB MRI scans) were used to train a neural network (U-Net architecture). Clinical usefulness was evaluated in another 33 patients who were discussed in our MCC and received a Gd-EOB MRI both at baseline and follow-up examination (n = 66) over 12 months. Model measurements (NELM volume; hepatic tumor load (HTL)) with corresponding absolute (ΔabsNELM; ΔabsHTL) and relative changes (ΔrelNELM; ΔrelHTL) between baseline and follow-up were compared to MCC decisions (therapy success/failure).

RESULTS

Internal validation of the model's accuracy showed a high overlap for NELM and livers (Matthew's correlation coefficient (φ): 0.76/0.95, respectively) with higher φ in larger NELM volume (φ = 0.80 vs. 0.71; p = 0.003). External validation confirmed the high accuracy for NELM (φ = 0.86) and livers (φ = 0.96). MCC decisions were significantly differentiated by all response variables (ΔabsNELM; ΔabsHTL; ΔrelNELM; ΔrelHTL) (p < 0.001). ΔrelNELM and ΔrelHTL showed optimal discrimination between therapy success or failure (AUC: 1.000; p < 0.001).

CONCLUSION

The model shows high accuracy in 3D-quantification of NELM and HTL in Gd-EOB-MRI. The model's measurements correlated well with MCC's evaluation of therapeutic response.

Can artificial intelligence overtake human intelligence on the bumpy road towards glioma therapy?

Gliomas are one of the most devastating primary brain tumors which impose significant management challenges to the clinicians. The aggressive behaviour of gliomas is mainly attributed to their rapid proliferation, unravelled genomics and the blood-brain barrier which protects the tumor cells from chemotherapeutic regimens. Suspects of brain tumors are usually assessed by magnetic resonance imaging and computed tomography. These images allow surgeons to decide on the tumor grading, intra-operative pathology, feasibility of surgery, and treatment planning. All these data are compiled manually by physicians, wherein it takes time for the validation of results and concluding the treatment modality. In this context, the arrival of artificial intelligence in this era of personalized medicine, has proven promising performance in the diagnosis and management of gliomas. Starting from grading prediction till outcome evaluation, artificial intelligence-based forefronts have revolutionized oncological research. Interestingly, this approach has also been able to precisely differentiate tumor lesion from healthy tissues. However, till date, their utility in neuro-oncological field remains limited due to the issues pertaining to their reliability and transparency. Hence, to shed novel insights on the "clinical utility of this novel approach on glioma management" and to reveal "the black-boxes that have to be solved for fruitful application of artificial intelligence in neuro-oncology research", we provide in this review, a succinct description of the potential gear of artificial intelligence-based avenues in glioma treatment and the barriers that impede their rapid implementation in neuro-oncology.

Hepatocellular Carcinoma Automatic Diagnosis within CEUS and B-Mode Ultrasound Images Using Advanced Machine Learning Methods

Hepatocellular Carcinoma (HCC) is the most common malignant liver tumor, being present in 70% of liver cancer cases. It usually evolves on the top of the cirrhotic parenchyma. The most reliable method for HCC diagnosis is the needle biopsy, which is an invasive, dangerous method. In our research, specific techniques for non-invasive, computerized HCC diagnosis are developed, by exploiting the information from ultrasound images. In this work, the possibility of performing the automatic diagnosis of HCC within B-mode ultrasound and Contrast-Enhanced Ultrasound (CEUS) images, using advanced machine learning methods based on Convolutional Neural Networks (CNN), was assessed. The recognition performance was evaluated separately on B-mode ultrasound images and on CEUS images, respectively, as well as on combined B-mode ultrasound and CEUS images. For this purpose, we considered the possibility of combining the input images directly, performing feature level fusion, then providing the resulted data at the entrances of representative CNN classifiers. In addition, several multimodal combined classifiers were experimented, resulted by the fusion, at classifier, respectively, at the decision levels of two different branches based on the same CNN architecture, as well as on different CNN architectures. Various combination methods, and also the dimensionality reduction method of Kernel Principal Component Analysis (KPCA), were involved in this process. These results were compared with those obtained on the same dataset, when employing advanced texture analysis techniques in conjunction with conventional classification methods and also with equivalent state-of-the-art approaches. An accuracy above 97% was achieved when our new methodology was applied.

Machine intelligence for precision oncology

Despite various advances in cancer research, the incidence and mortality rates of malignant diseases have remained high. Accurate risk assessment, prevention, detection, and treatment of cancer tailored to the individual are major challenges in clinical oncology. Artificial intelligence (AI), a field of applied computer science, has shown promising potential of accelerating evolution of healthcare towards precision oncology. This article focuses on highlights of the application of data-driven machine learning (ML) and deep learning (DL) in translational research for cancer diagnosis, prognosis, treatment, and clinical outcomes. ML-based algorithms in radiological and histological images have been demonstrated to improve detection and diagnosis of cancer. DL-based prediction models in molecular or multi-omics datasets of cancer for biomarkers and targets enable drug discovery and treatment. ML approaches combining radiomics with genomics and other omics data enhance the power of AI in improving diagnosis, prognostication, and treatment of cancer. Ethical and regulatory issues involving patient confidentiality and data security impose certain limitations on practical implementation of ML in clinical oncology. However, the ultimate goal of application of AI in cancer research is to develop and implement multi-modal machine intelligence for improving clinical decision on individualized management of patients.

Proteomic Profiling and Artificial Intelligence for Hepatocellular Carcinoma Translational Medicine

Hepatocellular carcinoma (HCC) is the most common primary cancer of the liver with high morbidity and mortality rates worldwide. Since 1963, when alpha-fetoprotein (AFP) was discovered as a first HCC serum biomarker, several other protein biomarkers have been identified and introduced into clinical practice. However, insufficient specificity and sensitivity of these biomarkers dictate the necessity of novel biomarker discovery. Remarkable advancements in integrated multiomics technologies for the identification of gene expression and protein or metabolite distribution patterns can facilitate rising to this challenge. Current multiomics technologies lead to the accumulation of a huge amount of data, which requires clustering and finding correlations between various datasets and developing predictive models for data filtering, pre-processing, and reducing dimensionality. Artificial intelligence (AI) technologies have an enormous potential to overcome accelerated data growth, complexity, and heterogeneity within and across data sources. Our review focuses on the recent progress in integrative proteomic profiling strategies and their usage in combination with machine learning and deep learning technologies for the discovery of novel biomarker candidates for HCC early diagnosis and prognosis. We discuss conventional and promising proteomic biomarkers of HCC such as AFP, lens culinaris agglutinin (LCA)-reactive L3 glycoform of AFP (AFP-L3), des-gamma-carboxyprothrombin (DCP), osteopontin (OPN), glypican-3 (GPC3), dickkopf-1 (DKK1), midkine (MDK), and squamous cell carcinoma antigen (SCCA) and highlight their functional significance including the involvement in cell signaling such as Wnt/β-catenin, PI3K/Akt, integrin αvβ3/NF-κB/HIF-1α, JAK/STAT3 and MAPK/ERK-mediated pathways dysregulated in HCC. We show that currently available computational platforms for big data analysis and AI technologies can both enhance proteomic profiling and improve imaging techniques to enhance the translational application of proteomics data into precision medicine.

Automated detection and delineation of hepatocellular carcinoma on multiphasic contrast-enhanced MRI using deep learning

PURPOSE

Liver Imaging Reporting and Data System (LI-RADS) uses multiphasic contrast-enhanced imaging for hepatocellular carcinoma (HCC) diagnosis. The goal of this feasibility study was to establish a proof-of-principle concept towards automating the application of LI-RADS, using a deep learning algorithm trained to segment the liver and delineate HCCs on MRI automatically.

METHODS

In this retrospective single-center study, multiphasic contrast-enhanced MRIs using T1-weighted breath-hold sequences acquired from 2010 to 2018 were used to train a deep convolutional neural network (DCNN) with a U-Net architecture. The U-Net was trained (using 70% of all data), validated (15%) and tested (15%) on 174 patients with 231 lesions. Manual 3D segmentations of the liver and HCC were ground truth. The dice similarity coefficient (DSC) was measured between manual and DCNN methods. Postprocessing using a random forest (RF) classifier employing radiomic features and thresholding (TR) of the mean neural activation was used to reduce the average false positive rate (AFPR).

RESULTS

73 and 75% of HCCs were detected on validation and test sets, respectively, using > 0.2 DSC criterion between individual lesions and their corresponding segmentations. Validation set AFPRs were 2.81, 0.77, 0.85 for U-Net, U-Net + RF, and U-Net + TR, respectively. Combining both RF and TR with the U-Net improved the AFPR to 0.62 and 0.75 for the validation and test sets, respectively. Mean DSC between automatically detected lesions using the DCNN + RF + TR and corresponding manual segmentations was 0.64/0.68 (validation/test), and 0.91/0.91 for liver segmentations.

CONCLUSION

Our DCNN approach can segment the liver and HCCs automatically. This could enable a more workflow efficient and clinically realistic implementation of LI-RADS.

Liver cancer prediction in a viral hepatitis cohort: A deep learning approach

Viral hepatitis is the primary cause of liver diseases, among which liver cancer is the leading cause of death from cancer. However, this cancer is often diagnosed in the later stages, which makes treatment difficult or even impossible. This study applied deep learning (DL) models for the early prediction of liver cancer in a hepatitis cohort. In this study, we surveyed 1 million random samples from the National Health Insurance Research Database (NHIRD) to analyze viral hepatitis patients from 2002 to 2010. Then, we used DL models to predict liver cancer cases based on the history of diseases of the hepatitis cohort. Our results revealed the annual prevalence of hepatitis in Taiwan increased from 2002 to 2010, with an average annual percentage change (AAPC) of 5.8% (95% CI: 4.2-7.4). However, young people (aged 16-30 years) exhibited a decreasing trend, with an AAPC of -5.6 (95% CI: -8.1 to -2.9). The results of applying DL models showed that the convolution neural network (CNN) model yielded the best performance in terms of predicting liver cancer cases, with an accuracy of 0.980 (AUC: 0.886). In conclusion, this study showed an increasing trend in the annual prevalence of hepatitis, but a decreasing trend in young people from 2002 to 2010 in Taiwan. The CNN model may be applied to predict liver cancer in a hepatitis cohort with high accuracy.

Prognostic role of artificial intelligence among patients with hepatocellular cancer: A systematic review

BACKGROUND

Prediction of survival after the treatment of hepatocellular carcinoma (HCC) has been widely investigated, yet remains inadequate. The application of artificial intelligence (AI) is emerging as a valid adjunct to traditional statistics due to the ability to process vast amounts of data and find hidden interconnections between variables. AI and deep learning are increasingly employed in several topics of liver cancer research, including diagnosis, pathology, and prognosis.

AIM

To assess the role of AI in the prediction of survival following HCC treatment.

METHODS

A web-based literature search was performed according to the Preferred Reporting Items for Systemic Reviews and Meta-Analysis guidelines using the keywords “artificial intelligence”, “deep learning” and “hepatocellular carcinoma” (and synonyms). The specific research question was formulated following the patient (patients with HCC), intervention (evaluation of HCC treatment using AI), comparison (evaluation without using AI), and outcome (patient death and/or tumor recurrence) structure. English language articles were retrieved, screened, and reviewed by the authors. The quality of the papers was assessed using the Risk of Bias In Non-randomized Studies of Interventions tool. Data were extracted and collected in a database.

RESULTS

Among the 598 articles screened, nine papers met the inclusion criteria, six of which had low-risk rates of bias. Eight articles were published in the last decade; all came from eastern countries. Patient sample size was extremely heterogenous (n = 11-22926). AI methodologies employed included artificial neural networks (ANN) in six studies, as well as support vector machine, artificial plant optimization, and peritumoral radiomics in the remaining three studies. All the studies testing the role of ANN compared the performance of ANN with traditional statistics. Training cohorts were used to train the neural networks that were then applied to validation cohorts. In all cases, the AI models demonstrated superior predictive performance compared with traditional statistics with significantly improved areas under the curve.

CONCLUSION

AI applied to survival prediction after HCC treatment provided enhanced accuracy compared with conventional linear systems of analysis. Improved transferability and reproducibility will facilitate the widespread use of AI methodologies.

Radiomics of Liver Metastases: A Systematic Review

Simple Summary

Patients with liver metastases can be scheduled for different therapies (e.g., chemotherapy, surgery, radiotherapy, and ablation). The choice of the most appropriate treatment should rely on adequate understanding of tumor biology and prediction of survival, but reliable biomarkers are lacking. Radiomics is an innovative approach to medical imaging: it identifies invisible-to-the-human-eye radiological patterns that can predict tumor aggressiveness and patients outcome. We reviewed the available literature to elucidate the role of radiomics in patients with liver metastases. Thirty-two papers were analyzed, mostly (56%) concerning metastases from colorectal cancer. Even if available studies are still preliminary, radiomics provided effective prediction of response to chemotherapy and of survival, allowing more accurate and earlier prediction than standard predictors. Entropy and homogeneity were the radiomic features with the strongest clinical impact. In the next few years, radiomics is expected to give a consistent contribution to the precision medicine approach to patients with liver metastases.

Abstract

Multidisciplinary management of patients with liver metastases (LM) requires a precision medicine approach, based on adequate profiling of tumor biology and robust biomarkers. Radiomics, defined as the high-throughput identification, analysis, and translational applications of radiological textural features, could fulfill this need. The present review aims to elucidate the contribution of radiomic analyses to the management of patients with LM. We performed a systematic review of the literature through the most relevant databases and web sources. English language original articles published before June 2020 and concerning radiomics of LM extracted from CT, MRI, or PET-CT were considered. Thirty-two papers were identified. Baseline higher entropy and lower homogeneity of LM were associated with better survival and higher chemotherapy response rates. A decrease in entropy and an increase in homogeneity after chemotherapy correlated with radiological tumor response. Entropy and homogeneity were also highly predictive of tumor regression grade. In comparison with RECIST criteria, radiomic features provided an earlier prediction of response to chemotherapy. Lastly, texture analyses could differentiate LM from other liver tumors. The commonest limitations of studies were small sample size, retrospective design, lack of validation datasets, and unavailability of univocal cut-off values of radiomic features. In conclusion, radiomics can potentially contribute to the precision medicine approach to patients with LM, but interdisciplinarity, standardization, and adequate software tools are needed to translate the anticipated potentialities into clinical practice.

Application of artificial intelligence in the diagnosis and treatment of hepatocellular carcinoma: A review

Although artificial intelligence (AI) was initially developed many years ago, it has experienced spectacular advances over the last 10 years for application in the field of medicine, and is now used for diagnostic, therapeutic and prognostic purposes in almost all fields. Its application in the area of hepatology is especially relevant for the study of hepatocellular carcinoma (HCC), as this is a very common tumor, with particular radiological characteristics that allow its diagnosis without the need for a histological study. However, the interpretation and analysis of the resulting images is not always easy, in addition to which the images vary during the course of the disease, and prognosis and treatment response can be conditioned by multiple factors. The vast amount of data available lend themselves to study and analysis by AI in its various branches, such as deep-learning (DL) and machine learning (ML), which play a fundamental role in decision-making as well as overcoming the constraints involved in human evaluation. ML is a form of AI based on automated learning from a set of previously provided data and training in algorithms to organize and recognize patterns. DL is a more extensive form of learning that attempts to simulate the working of the human brain, using a lot more data and more complex algorithms. This review specifies the type of AI used by the various authors. However, well-designed prospective studies are needed in order to avoid as far as possible any bias that may later affect the interpretability of the images and thereby limit the acceptance and application of these models in clinical practice. In addition, professionals now need to understand the true usefulness of these techniques, as well as their associated strengths and limitations.

Deep learning assisted differentiation of hepatocellular carcinoma from focal liver lesions: choice of four-phase and three-phase CT imaging protocol

PURPOSE

To evaluate whether a three-phase dynamic contrast-enhanced CT protocol, when combined with a deep learning model, has similar accuracy in differentiating hepatocellular carcinoma (HCC) from other focal liver lesions (FLLs) compared with a four-phase protocol.

METHODS

Three hundred and forty-two patients (mean age 49.1 ± 10.5 years, range 19-86 years, 65.8% male) scanned with a four-phase CT protocol (precontrast, arterial, portal-venous and delayed phases) were retrospectively enrolled. A total of 449 FLLs were categorized into HCC and non-HCC groups based on the best available reference standard. Three convolutional dense networks (CDNs) with the input of four-phase CT images (model A), three-phase images without portal-venous phase (model B) and three-phase images without precontrast phase (model C) were trained on 80% of lesions and evaluated in the other 20% by receiver operating characteristics (ROC) and confusion matrix analysis. The DeLong test was performed to compare the areas under the ROC curves (AUCs) of A with B, B with C, and A with C.

RESULTS

The diagnostic accuracy in differentiating HCC from other FLLs on test sets was 83.3% for model A, 81.1% for model B and 85.6% for model C, and the AUCs were 0.925, 0.862 and 0.920, respectively. The AUCs of models A and C did not differ significantly (p = 0.765), but the AUCs of models A and B (p = 0.038) and of models B and C (p = 0.028) did.

CONCLUSIONS

When combined with a CDN, a three-phase CT protocol without precontrast showed similar diagnostic accuracy as a four-phase protocol in differentiating HCC from other FLLs, suggesting that the multiphase CT protocol for HCC diagnosis might be optimized by removing the precontrast phase to reduce radiation dose.

Classification of hepatocellular carcinoma and intrahepatic cholangiocarcinoma based on multi-phase CT scans

Liver and bile duct cancers are leading causes of worldwide cancer death. The most common ones are hepatocellular carcinoma (HCC) and intrahepatic cholangiocarcinoma (ICC). Influencing factors and prognosis of HCC and ICC are different. Precise classification of these two liver cancers is essential for treatment and prevention plans. The aim of this study is to develop a machine-based method that differentiates between the two types of liver cancers from multi-phase abdominal computerized tomography (CT) scans. The proposed method consists of two major steps. In the first step, the liver is segmented from the original images using a convolutional neural network model, together with task-specific pre-processing and post-processing techniques. In the second step, by looking at the intensity histograms of the segmented images, we extract features from regions that are discriminating between HCC and ICC, and use them as an input for classification using support vector machine model. By testing on a dataset of labeled multi-phase CT scans provided by Maharaj Nakorn Chiang Mai Hospital, Thailand, we have obtained 88% in classification accuracy. Our proposed method has a great potential in helping radiologists diagnosing liver cancer.