Automated liver lesion detection in CT images based on multi-level geometric features

Improving liver lesions classification on CT/MRI images based on Hounsfield Units attenuation and deep learning

The early sign detection of liver lesions plays an extremely important role in preventing, diagnosing, and treating liver diseases. In fact, radiologists mainly consider Hounsfield Units to locate liver lesions. However, most studies focus on the analysis of unenhanced computed tomography images without considering an attenuation difference between Hounsfield Units before and after contrast injection. Therefore, the purpose of this work is to develop an improved method for the automatic detection and classification of common liver lesions based on deep learning techniques and the variations of the Hounsfield Units density on computed tomography scans. We design and implement a multi-phase classification model developed on the Faster Region-based Convolutional Neural Networks (Faster R-CNN), Region-based Fully Convolutional Networks (R-FCN), and Single Shot Detector Networks (SSD) with the transfer learning approach. The model considers the variations of the Hounsfield Unit density on computed tomography scans in four phases before and after contrast injection (plain, arterial, venous, and delay). The experiments are conducted on three common types of liver lesions including liver cysts, hemangiomas, and hepatocellular carcinoma. Experimental results show that the proposed method accurately locates and classifies common liver lesions. The liver lesions detection with Hounsfield Units gives high accuracy of 100%. Meanwhile, the lesion classification achieves an accuracy of 95.1%. The promising results show the applicability of the proposed method for automatic liver lesions detection and classification. The proposed method improves the accuracy of liver lesions detection and classification compared with some preceding methods. It is useful for practical systems to assist doctors in the diagnosis of liver lesions. In our further research, an improvement can be made with big data analysis to build real-time processing systems and we expand this study to detect lesions from all parts of the human body, not just the liver.

Deep learning-based algorithm to detect primary hepatic malignancy in multiphase CT of patients at high risk for HCC

OBJECTIVES

To develop and evaluate a deep learning-based model capable of detecting primary hepatic malignancies in multiphase CT images of patients at high risk for hepatocellular carcinoma (HCC).

METHODS

A total of 1350 multiphase CT scans of 1280 hepatic malignancies (1202 HCCs and 78 non-HCCs) in 1320 patients at high risk for HCC were retrospectively analyzed. Following the delineation of the focal hepatic lesions according to reference standards, the CT scans were categorized randomly into the training (568 scans), tuning (193 scans), and test (589 scans) sets. Multiphase CT information was subjected to multichannel integration, and livers were automatically segmented before model development. A deep learning-based model capable of detecting malignancies was developed using a mask region-based convolutional neural network. The thresholds of the prediction score and the intersection over union were determined on the tuning set corresponding to the highest sensitivity with < 5 false-positive cases per CT scan. The sensitivity and the number of false-positives of the proposed model on the test set were calculated. Potential causes of false-negatives and false-positives on the test set were analyzed.

RESULTS

This model exhibited a sensitivity of 84.8% with 4.80 false-positives per CT scan on the test set. The most frequent potential causes of false-negatives and false-positives were determined to be atypical enhancement patterns for HCC (71.7%) and registration/segmentation errors (42.7%), respectively.

CONCLUSIONS

The proposed deep learning-based model developed to automatically detect primary hepatic malignancies exhibited an 84.8% of sensitivity with 4.80 false-positives per CT scan in the test set.

KEY POINTS

• Image processing, including multichannel integration of multiphase CT and automatic liver segmentation, enabled the application of a deep learning-based model to detect primary hepatic malignancy. • Our model exhibited a sensitivity of 84.8% with a false-positive rate of 4.80 per CT scan.

Computer-aided diagnosis of liver lesions using CT images: A systematic review

BACKGROUND

Medical image processing has a strong footprint in radio diagnosis for the detection of diseases from the images. Several computer-aided systems were researched in the recent past to assist the radiologist in diagnosing liver diseases and reducing the interpretation time. The aim of this paper is to provide an overview of the state-of-the-art techniques in computer-assisted diagnosis systems to predict benign and malignant lesions using computed tomography images.

METHODS

The research articles published between 1998 and 2020 obtained from various standard databases were considered for preparing the review. The research papers include both conventional as well as deep learning-based systems for liver lesion diagnosis. The paper initially discusses the various hepatic lesions that are identifiable on computed tomography images, then the computer-aided diagnosis systems and their workflow. The conventional and deep learning-based systems are presented in stages wherein the various methods used for preprocessing, liver and lesion segmentation, radiological feature extraction and classification are discussed.

CONCLUSION

The review suggests the scope for future, work as efficient and effective segmentation methods that work well with diverse images have not been developed. Furthermore, unsupervised and semi-supervised deep learning models were not investigated for liver disease diagnosis in the reviewed papers. Other areas to be explored include image fusion and inclusion of essential clinical features along with the radiological features for better classification accuracy.

Computer-aided diagnosis of cirrhosis and hepatocellular carcinoma using multi-phase abdomen CT

PURPOSE

High mortality rate due to liver cirrhosis has been reported over the globe in the previous years. Early detection of cirrhosis may help in controlling the disease progression toward hepatocellular carcinoma (HCC). The lack of trained CT radiologists and increased patient population delays the diagnosis and further management. This study proposes a computer-aided diagnosis system for detecting cirrhosis and HCC in a very efficient and less time-consuming approach.

METHODS

Contrast-enhanced CT dataset of 40 patients (n = 40; M:F = 5:3; age = 25-55 years) with three groups of subjects: healthy (n = 14), cirrhosis (n = 12) and cirrhosis with HCC (n = 14), were retrospectively analyzed in this study. A novel method for the automatic 3D segmentation of liver using modified region-growing segmentation technique was developed and compared with the state-of-the-art deep learning-based technique. Further, histogram parameters were calculated from segmented CT liver volume for classification between healthy and diseased (cirrhosis and HCC) liver using logistic regression. Multi-phase analysis of CT images was performed to extract 24 temporal features for detecting cirrhosis and HCC liver using support vector machine (SVM).

RESULTS

The proposed method produced improved 3D segmentation with Dice coefficient 90% for healthy liver, 86% for cirrhosis and 81% for HCC subjects compared to the deep learning algorithm (healthy: 82%; cirrhosis: 78%; HCC: 70%). Standard deviation and kurtosis were found to be statistically different (p < 0.05) among healthy and diseased liver, and using logistic regression, classification accuracy obtained was 92.5%. For detecting cirrhosis and HCC liver, SVM with RBF kernel obtained highest slice-wise and patient-wise prediction accuracy of 86.9% (precision = 0.93, recall = 0.7) and 80% (precision = 0.86, recall = 0.75), respectively, than that of linear kernel (slice-wise: accuracy = 85.4%, precision = 0.92, recall = 0.67; patient-wise: accuracy = 73.33%, precision = 0.75, recall = 0.75).

CONCLUSIONS

The proposed computer-aided diagnosis system for detecting cirrhosis and hepatocellular carcinoma (HCC) showed promising results and can be used as effective screening tool in medical image analysis.

3D Liver Tumor Segmentation in CT Images Using Improved Fuzzy C-Means and Graph Cuts

Three-dimensional (3D) liver tumor segmentation from Computed Tomography (CT) images is a prerequisite for computer-aided diagnosis, treatment planning, and monitoring of liver cancer. Despite many years of research, 3D liver tumor segmentation remains a challenging task. In this paper, an efficient semiautomatic method was proposed for liver tumor segmentation in CT volumes based on improved fuzzy C-means (FCM) and graph cuts. With a single seed point, the tumor volume of interest (VOI) was extracted using confidence connected region growing algorithm to reduce computational cost. Then, initial foreground/background regions were labeled automatically, and a kernelized FCM with spatial information was incorporated in graph cuts segmentation to increase segmentation accuracy. The proposed method was evaluated on the public clinical dataset (3Dircadb), which included 15 CT volumes consisting of various sizes of liver tumors. We achieved an average volumetric overlap error (VOE) of 29.04% and Dice similarity coefficient (DICE) of 0.83, with an average processing time of 45 s per tumor. The experimental results showed that the proposed method was accurate for 3D liver tumor segmentation with a reduction of processing time.

Semantic representation of reported measurements in radiology

Background

In radiology, a vast amount of diverse data is generated, and unstructured reporting is standard. Hence, much useful information is trapped in free-text form, and often lost in translation and transmission. One relevant source of free-text data consists of reports covering the assessment of changes in tumor burden, which are needed for the evaluation of cancer treatment success. Any change of lesion size is a critical factor in follow-up examinations. It is difficult to retrieve specific information from unstructured reports and to compare them over time. Therefore, a prototype was implemented that demonstrates the structured representation of findings, allowing selective review in consecutive examinations and thus more efficient comparison over time.

Methods

We developed a semantic Model for Clinical Information (MCI) based on existing ontologies from the Open Biological and Biomedical Ontologies (OBO) library. MCI is used for the integrated representation of measured image findings and medical knowledge about the normal size of anatomical entities. An integrated view of the radiology findings is realized by a prototype implementation of a ReportViewer. Further, RECIST (Response Evaluation Criteria In Solid Tumors) guidelines are implemented by SPARQL queries on MCI. The evaluation is based on two data sets of German radiology reports: An oncologic data set consisting of 2584 reports on 377 lymphoma patients and a mixed data set consisting of 6007 reports on diverse medical and surgical patients. All measurement findings were automatically classified as abnormal/normal using formalized medical background knowledge, i.e., knowledge that has been encoded into an ontology. A radiologist evaluated 813 classifications as correct or incorrect. All unclassified findings were evaluated as incorrect.

Results

The proposed approach allows the automatic classification of findings with an accuracy of 96.4 % for oncologic reports and 92.9 % for mixed reports. The ReportViewer permits efficient comparison of measured findings from consecutive examinations. The implementation of RECIST guidelines with SPARQL enhances the quality of the selection and comparison of target lesions as well as the corresponding treatment response evaluation.

Conclusions

The developed MCI enables an accurate integrated representation of reported measurements and medical knowledge. Thus, measurements can be automatically classified and integrated in different decision processes. The structured representation is suitable for improved integration of clinical findings during decision-making. The proposed ReportViewer provides a longitudinal overview of the measurements.