Assessing PD-L1 Expression Level via Preoperative MRI in HCC Based on Integrating Deep Learning and Radiomics Features

Exploring immune checkpoint inhibitors: Focus on PD-1/PD-L1 axis and beyond

Immunotherapy emerges as a promising approach, marked by recent substantial progress in elucidating how the host immune response impacts tumor development and its sensitivity to various treatments. Immune checkpoint inhibitors have revolutionized cancer therapy by unleashing the power of the immune system to recognize and eradicate tumor cells. Among these, inhibitors targeting the programmed cell death protein 1 (PD-1) and its ligand (PD-L1) have garnered significant attention due to their remarkable clinical efficacy across various malignancies. This review delves into the mechanisms of action, clinical applications, and emerging therapeutic strategies surrounding PD-1/PD-L1 blockade. We explore the intricate interactions between PD-1/PD-L1 and other immune checkpoints, shedding light on combinatorial approaches to enhance treatment outcomes and overcome resistance mechanisms. Furthermore, we discuss the expanding landscape of immune checkpoint inhibitors beyond PD-1/PD-L1, including novel targets such as CTLA-4, LAG-3, TIM-3, and TIGIT. Through a comprehensive analysis of preclinical and clinical studies, we highlight the promise and challenges of immune checkpoint blockade in cancer immunotherapy, paving the way for future advancements in the field.

Current applications of radiomics in the assessment of tumor microenvironment of hepatocellular carcinoma

The tumor microenvironment (TME) of hepatocellular carcinoma (HCC) has garnered significant attention, especially with the rise of immunotherapy as a treatment strategy. Radiomics, an innovative technique, offers valuable insights into the intricate structure of the TME. This review highlights recent advancements in radiomics for analyzing the HCC TME, identifies key areas that warrant further research, and explores comprehensive multi-omics approaches that extend the potential of radiomics to new frontiers.

A CT-based interpretable deep learning signature for predicting PD-L1 expression in bladder cancer: a two-center study

BACKGROUND

To construct and assess a deep learning (DL) signature that employs computed tomography imaging to predict the expression status of programmed cell death ligand 1 in patients with bladder cancer (BCa).

METHODS

This retrospective study included 190 patients from two hospitals who underwent surgical removal of BCa (training set/external validation set, 127/63). We used convolutional neural network and radiomics machine learning technology to generate prediction models. We then compared the performance of the DL signature with the radiomics machine learning signature and selected the optimal signature to build a nomogram with the clinical model. Finally, the internal forecasting process of the DL signature was explained using Shapley additive explanation technology.

RESULTS

On the external validation set, the DL signature had an area under the curve of 0.857 (95% confidence interval: 0.745-0.932), and demonstrated superior prediction performance in comparison with the other models. SHAP expression images revealed that the prediction of PD-L1 expression status is mainly influenced by the tumor edge region, particularly the area close to the bladder wall.

CONCLUSIONS

The DL signature performed well in comparison with other models and proved to be a valuable, dependable, and interpretable tool for predicting programmed cell death ligand 1 expression status in patients with BCa.

Artificial intelligence applied to 'omics data in liver disease: towards a personalised approach for diagnosis, prognosis and treatment

Advancements in omics technologies and artificial intelligence (AI) methodologies are fuelling our progress towards personalised diagnosis, prognosis and treatment strategies in hepatology. This review provides a comprehensive overview of the current landscape of AI methods used for analysis of omics data in liver diseases. We present an overview of the prevalence of different omics levels across various liver diseases, as well as categorise the AI methodology used across the studies. Specifically, we highlight the predominance of transcriptomic and genomic profiling and the relatively sparse exploration of other levels such as the proteome and methylome, which represent untapped potential for novel insights. Publicly available database initiatives such as The Cancer Genome Atlas and The International Cancer Genome Consortium have paved the way for advancements in the diagnosis and treatment of hepatocellular carcinoma. However, the same availability of large omics datasets remains limited for other liver diseases. Furthermore, the application of sophisticated AI methods to handle the complexities of multiomics datasets requires substantial data to train and validate the models and faces challenges in achieving bias-free results with clinical utility. Strategies to address the paucity of data and capitalise on opportunities are discussed. Given the substantial global burden of chronic liver diseases, it is imperative that multicentre collaborations be established to generate large-scale omics data for early disease recognition and intervention. Exploring advanced AI methods is also necessary to maximise the potential of these datasets and improve early detection and personalised treatment strategies.

Radiomics predicting immunohistochemical markers in primary hepatic carcinoma: Current status and challenges

Primary hepatic carcinoma, comprising hepatocellular carcinoma (HCC), intrahepatic cholangiocarcinoma (ICC), and combined hepatocellular cholangiocarcinoma (cHCC-CCA), ranks among the most common malignancies worldwide. The heterogeneity of tumors is a primary factor impeding the efficacy of treatments for primary hepatic carcinoma. Immunohistochemical markers may play a potential role in characterizing this heterogeneity, providing significant guidance for prognostic analysis and the development of personalized treatment plans for the patients with primary hepatic carcinoma. Currently, primary hepatic carcinoma immunohistochemical analysis primarily relies on invasive techniques such as surgical pathology and tissue biopsy. Consequently, the non-invasive preoperative acquisition of primary hepatic carcinoma immunohistochemistry has emerged as a focal point of research. As an emerging non-invasive diagnostic technique, radiomics possesses the potential to extensively characterize tumor heterogeneity. It can predict immunohistochemical markers associated with hepatocellular carcinoma preoperatively, demonstrating significant auxiliary utility in clinical guidance. This article summarizes the progress in using radiomics to predict immunohistochemical markers in primary hepatic carcinoma, addresses the challenges faced in this field of study, and anticipates its future application prospects.

Prediction of PD-L1 expression in unresectable hepatocellular carcinoma with gadoxetic acid-enhanced MRI

OBJECTIVES

To develop a model to predict programmed death-ligand 1 (PD-L1) expression in unresectable hepatocellular carcinoma (HCC) based on gadoxetic acid-enhanced magnetic resonance imaging (MRI) findings and clinical characteristics.

MATERIALS AND METHODS

We enrolled patients with unresectable HCC who underwent gadoxetic acid-enhanced MRI between January 2021 and May 2023. Immunohistochemical staining of PD-L1 was performed on a biopsy specimen. Patients with a history of any prior treatment for HCC or those lacking an MRI scan within 30 days of the biopsy date were excluded. Using the clinical and MRI findings, we developed a PD-L1 prediction score using logistic regression.

RESULTS

This study included 49 patients with HCC (median age, 64 years; interquartile range, 57-73 years; 44 men). Among these, 15 (31 %) were positive for PD-L1 expression. The PD-L1 prediction score was defined as the sum of arterial phase hypoenhancement (score 1), necrosis (score 1), and AFP >4000 ng/mL (score 2). The AUC value of the PD-L1 prediction score was 0.838 (95 % confidence interval [CI], 0.715-0.962). When the PD-L1 prediction score was ≥3, the sensitivity, specificity, and positive predictive value of PD-L1 positivity were 67 %, 91 %, and 77 %, respectively.

CONCLUSION

We developed a PD-L1 prediction score for unresectable HCC with high specificity that could potentially contribute to the identification of effective candidates for immune checkpoint inhibitors.

Artificial intelligence techniques in liver cancer

Hepatocellular Carcinoma (HCC), the most common primary liver cancer, is a significant contributor to worldwide cancer-related deaths. Various medical imaging techniques, including computed tomography, magnetic resonance imaging, and ultrasound, play a crucial role in accurately evaluating HCC and formulating effective treatment plans. Artificial Intelligence (AI) technologies have demonstrated potential in supporting physicians by providing more accurate and consistent medical diagnoses. Recent advancements have led to the development of AI-based multi-modal prediction systems. These systems integrate medical imaging with other modalities, such as electronic health record reports and clinical parameters, to enhance the accuracy of predicting biological characteristics and prognosis, including those associated with HCC. These multi-modal prediction systems pave the way for predicting the response to transarterial chemoembolization and microvascular invasion treatments and can assist clinicians in identifying the optimal patients with HCC who could benefit from interventional therapy. This paper provides an overview of the latest AI-based medical imaging models developed for diagnosing and predicting HCC. It also explores the challenges and potential future directions related to the clinical application of AI techniques.

CT-based deep learning radiomics biomarker for programmed cell death ligand 1 expression in non-small cell lung cancer

BACKGROUND

Programmed cell death ligand 1 (PD-L1), as a reliable predictive biomarker, plays an important role in guiding immunotherapy of lung cancer. To investigate the value of CT-based deep learning radiomics signature to predict PD-L1 expression in non-small cell lung cancers(NSCLCs).

METHODS

259 consecutive patients with pathological confirmed NSCLCs were retrospectively collected and divided into the training cohort and validation cohort according to the chronological order. The univariate and multivariate analyses were used to build the clinical model. Radiomics and deep learning features were extracted from preoperative non-contrast CT images. After feature selection, Radiomics score (Rad-score) and deep learning radiomics score (DLR-score) were calculated through a linear combination of the selected features and their coefficients. Predictive performance for PD-L1 expression was evaluated via the area under the curve (AUC) of receiver operating characteristic, the calibration curves, and the decision curve analysis.

RESULTS

The clinical model based on Cytokeratin 19 fragment and lobulated shape obtained an AUC of 0.767(95% CI: 0.673-0.860) in the training cohort and 0.604 (95% CI:0.477-0.731) in the validation cohort. 11 radiomics features and 15 deep learning features were selected by LASSO regression. AUCs of the Rad-score were 0.849 (95%CI: 0.783-0.914) and 0.717 (95%CI: 0.607-0.826) in the training cohort and validation cohort, respectively. AUCs of DLR-score were 0.938 (95%CI: 0.899-0.977) and 0.818(95%CI:0.727-0.910) in the training cohort and validation cohort, respectively. AUCs of the DLR-score were significantly higher than those of the Rad-score and the clinical model.

CONCLUSION

The CT-based deep learning radiomics signature could achieve clinically acceptable predictive performance for PD-L1 expression, which showed potential to be a surrogate imaging biomarker or a complement of immunohistochemistry assessment.

High expression of circulating exosomal PD-L1 contributes to immune escape of hepatocellular carcinoma and immune clearance of chronic hepatitis B

OBJECTIVE

To investigate the expression of programmed death ligand-1 (PD-L1) in circulating exosomes, and to define the role of exosomal PD-L1 in promoting immune escape mechanism during chronic hepatitis B infection (CHB) and related liver diseases.

METHODS

The levels of PD-L1 expressed in exosomes were detected by ELISA. CD8+T cells were sorted and cytotoxicity test was assessed by flow cytometry. PD-L1 protein expression in hepatocellular carcinoma (HCC) and normal adjacent tissues were detected by immunohistochemistry.

RESULTS

Circulating exosomal PD-L1 levels were significantly higher in patients with CHB and HCC than in healthy controls (F =7.46, P=0.001). Levels of CD107a on CD8+T cells in patients with CHB receiving PD-L1 blocking antibody were significantly lower than in patients receiving isotype blocking antibody (t = 4.96, P < 0.01). Levels of TNF-α in cell culture supernatants of the PD-L1 blocking antibody group were significantly higher than in the isotype blocking antibody group (t =5.92, P < 0.01). Compared with patients receiving isotype blocking antibody, levels of CD107a on CD8+T cells significantly increased in patients with HCC receiving anti-PD-L1 antibody (t = 3.51, P<0.05). Compared with adjacent tissues, the levels of PD-L1 protein expression in HCC tissues were slightly higher; however, no significant difference between the two groups was observed.

CONCLUSIONS

PD-L1 blockade in exosomes might promote the cytotoxic function of CD8+T cells and inhibit immune evasion during progression of HCC. Blocking PD-L1 in exosomes reduced the cytotoxic function of CD8+T cells in patients with CHB while enhancing the production of proinflammatory cytokines.

Multiparametric MRI for characterization of the tumour microenvironment

Our understanding of tumour biology has evolved over the past decades and cancer is now viewed as a complex ecosystem with interactions between various cellular and non-cellular components within the tumour microenvironment (TME) at multiple scales. However, morphological imaging remains the mainstay of tumour staging and assessment of response to therapy, and the characterization of the TME with non-invasive imaging has not yet entered routine clinical practice. By combining multiple MRI sequences, each providing different but complementary information about the TME, multiparametric MRI (mpMRI) enables non-invasive assessment of molecular and cellular features within the TME, including their spatial and temporal heterogeneity. With an increasing number of advanced MRI techniques bridging the gap between preclinical and clinical applications, mpMRI could ultimately guide the selection of treatment approaches, precisely tailored to each individual patient, tumour and therapeutic modality. In this Review, we describe the evolving role of mpMRI in the non-invasive characterization of the TME, outline its applications for cancer detection, staging and assessment of response to therapy, and discuss considerations and challenges for its use in future medical applications, including personalized integrated diagnostics.

Prognostication of Hepatocellular Carcinoma Using Artificial Intelligence

Hepatocellular carcinoma (HCC) is a biologically heterogeneous tumor characterized by varying degrees of aggressiveness. The current treatment strategy for HCC is predominantly determined by the overall tumor burden, and does not address the diverse prognoses of patients with HCC owing to its heterogeneity. Therefore, the prognostication of HCC using imaging data is crucial for optimizing patient management. Although some radiologic features have been demonstrated to be indicative of the biologic behavior of HCC, traditional radiologic methods for HCC prognostication are based on visually-assessed prognostic findings, and are limited by subjectivity and inter-observer variability. Consequently, artificial intelligence has emerged as a promising method for image-based prognostication of HCC. Unlike traditional radiologic image analysis, artificial intelligence based on radiomics or deep learning utilizes numerous image-derived quantitative features, potentially offering an objective, detailed, and comprehensive analysis of the tumor phenotypes. Artificial intelligence, particularly radiomics has displayed potential in a variety of applications, including the prediction of microvascular invasion, recurrence risk after locoregional treatment, and response to systemic therapy. This review highlights the potential value of artificial intelligence in the prognostication of HCC as well as its limitations and future prospects.

MRI-Based Radiomics and Deep Learning in Biological Characteristics and Prognosis of Hepatocellular Carcinoma: Opportunities and Challenges

Hepatocellular carcinoma (HCC) is the fifth most common malignancy and the third leading cause of cancer-related death worldwide. HCC exhibits strong inter-tumor heterogeneity, with different biological characteristics closely associated with prognosis. In addition, patients with HCC often distribute at different stages and require diverse treatment options at each stage. Due to the variability in tumor sensitivity to different therapies, determining the optimal treatment approach can be challenging for clinicians prior to treatment. Artificial intelligence (AI) technology, including radiomics and deep learning approaches, has emerged as a unique opportunity to improve the spectrum of HCC clinical care by predicting biological characteristics and prognosis in the medical imaging field. The radiomics approach utilizes handcrafted features derived from specific mathematical formulas to construct various machine-learning models for medical applications. In terms of the deep learning approach, convolutional neural network models are developed to achieve high classification performance based on automatic feature extraction from images. Magnetic resonance imaging offers the advantage of superior tissue resolution and functional information. This comprehensive evaluation plays a vital role in the accurate assessment and effective treatment planning for HCC patients. Recent studies have applied radiomics and deep learning approaches to develop AI-enabled models to improve accuracy in predicting biological characteristics and prognosis, such as microvascular invasion and tumor recurrence. Although AI-enabled models have demonstrated promising potential in HCC with biological characteristics and prognosis prediction with high performance, one of the biggest challenges, interpretability, has hindered their implementation in clinical practice. In the future, continued research is needed to improve the interpretability of AI-enabled models, including aspects such as domain knowledge, novel algorithms, and multi-dimension data sources. Overcoming these challenges would allow AI-enabled models to significantly impact the care provided to HCC patients, ultimately leading to their deployment for clinical use. LEVEL OF EVIDENCE: 5 TECHNICAL EFFICACY: Stage 2.

Noninvasive identification of HER2-low-positive status by MRI-based deep learning radiomics predicts the disease-free survival of patients with breast cancer

OBJECTIVE

This study aimed to establish a MRI-based deep learning radiomics (DLR) signature to predict the human epidermal growth factor receptor 2 (HER2)-low-positive status and further verified the difference in prognosis by the DLR model.

METHODS

A total of 481 patients with breast cancer who underwent preoperative MRI were retrospectively recruited from two institutions. Traditional radiomics features and deep semantic segmentation feature-based radiomics (DSFR) features were extracted from segmented tumors to construct models separately. Then, the DLR model was constructed to assess the HER2 status by averaging the output probabilities of the two models. Finally, a Kaplan‒Meier survival analysis was conducted to explore the disease-free survival (DFS) in patients with HER2-low-positive status. The multivariate Cox proportional hazard model was constructed to further determine the factors associated with DFS.

RESULTS

First, the DLR model distinguished between HER2-negative and HER2-overexpressing patients with AUCs of 0.868 and 0.763 in the training and validation cohorts, respectively. Furthermore, the DLR model distinguished between HER2-low-positive and HER2-zero patients with AUCs of 0.855 and 0.750, respectively. Cox regression analysis showed that the prediction score obtained using the DLR model (HR, 0.175; p = 0.024) and lesion size (HR, 1.043; p = 0.009) were significant, independent predictors of DFS.

CONCLUSIONS

We successfully constructed a DLR model based on MRI to noninvasively evaluate the HER2 status and further revealed prospects for predicting the DFS of patients with HER2-low-positive status.

CLINICAL RELEVANCE STATEMENT

The MRI-based DLR model could noninvasively identify HER2-low-positive status, which is considered a novel prognostic predictor and therapeutic target.

KEY POINTS

• The DLR model effectively distinguished the HER2 status of breast cancer patients, especially the HER2-low-positive status. • The DLR model was better than the traditional radiomics model or DSFR model in distinguishing HER2 expression. • The prediction score obtained using the model and lesion size were significant independent predictors of DFS.

Machine Learning Combined with Radiomics Facilitating the Personal Treatment of Malignant Liver Tumors

In the realm of managing malignant liver tumors, the convergence of radiomics and machine learning has redefined the landscape of medical practice. The field of radiomics employs advanced algorithms to extract thousands of quantitative features (including intensity, texture, and structure) from medical images. Machine learning, including its subset deep learning, aids in the comprehensive analysis and integration of these features from diverse image sources. This potent synergy enables the prediction of responses of malignant liver tumors to various treatments and outcomes. In this comprehensive review, we examine the evolution of the field of radiomics and its procedural framework. Furthermore, the applications of radiomics combined with machine learning in the context of personalized treatment for malignant liver tumors are outlined in aspects of surgical therapy and non-surgical treatments such as ablation, transarterial chemoembolization, radiotherapy, and systemic therapies. Finally, we discuss the current challenges in the amalgamation of radiomics and machine learning in the study of malignant liver tumors and explore future opportunities.

A Noninvasive Approach to Evaluate Tumor Immune Microenvironment and Predict Outcomes in Hepatocellular Carcinoma

It is widely recognized that tumor immune microenvironment (TIME) plays a crucial role in tumor progression, metastasis, and therapeutic response. Despite several noninvasive strategies have emerged for cancer diagnosis and prognosis, there are still lack of effective radiomic-based model to evaluate TIME status, let alone predict clinical outcome and immune checkpoint inhibitor (ICIs) response for hepatocellular carcinoma (HCC). In this study, we developed a radiomic model to evaluate TIME status within the tumor and predict prognosis and immunotherapy response. A total of 301 patients who underwent magnetic resonance imaging (MRI) examinations were enrolled in our study. The intra-tumoral expression of 17 immune-related molecules were evaluated using co-detection by indexing (CODEX) technology, and we construct Immunoscore (IS) with the least absolute shrinkage and selection operator (LASSO) algorithm and Cox regression method to evaluate TIME. Of 6115 features extracted from MRI, five core features were filtered out, and the Radiomic Immunoscore (RIS) showed high accuracy in predicting TIME status in testing cohort (area under the curve = 0.753). More importantly, RIS model showed the capability of predicting therapeutic response to anti-programmed cell death 1 (PD-1) immunotherapy in an independent cohort with advanced HCC patients (area under the curve = 0.731). In comparison with previously radiomic-based models, our integrated RIS model exhibits not only higher accuracy in predicting prognosis but also the potential guiding significance to HCC immunotherapy.

Supplementary Information

The online version contains supplementary material available at 10.1007/s43657-023-00136-8.

Combining radiomics and deep learning features of intra-tumoral and peri-tumoral regions for the classification of breast cancer lung metastasis and primary lung cancer with low-dose CT

PURPOSE

To investigate the performance of deep learning and radiomics features of intra-tumoral region (ITR) and peri-tumoral region (PTR) in the diagnosing of breast cancer lung metastasis (BCLM) and primary lung cancer (PLC) with low-dose CT (LDCT).

METHODS

We retrospectively collected the LDCT images of 100 breast cancer patients with lung lesions, comprising 60 cases of BCLM and 40 cases of PLC. We proposed a fusion model that combined deep learning features extracted from ResNet18-based multi-input residual convolution network with traditional radiomics features. Specifically, the fusion model adopted a multi-region strategy, incorporating the aforementioned features from both the ITR and PTR. Then, we randomly divided the dataset into training and validation sets using fivefold cross-validation approach. Comprehensive comparative experiments were performed between the proposed fusion model and other eight models, including the intra-tumoral deep learning model, the intra-tumoral radiomics model, the intra-tumoral deep-learning radiomics model, the peri-tumoral deep learning model, the peri-tumoral radiomics model, the peri-tumoral deep-learning radiomics model, the multi-region radiomics model, and the multi-region deep-learning model.

RESULTS

The fusion model developed using deep-learning radiomics feature sets extracted from the ITR and PTR had the best classification performance, with the area under the curve of 0.913 (95% CI 0.840-0.960). This was significantly higher than that of the single region's radiomics model or deep learning model.

CONCLUSIONS

The combination of radiomics and deep learning features was effective in discriminating BCLM and PLC. Additionally, the analysis of the PTR can mine more comprehensive tumor information.

Radiomics models based on multisequence MRI for predicting PD-1/PD-L1 expression in hepatocellular carcinoma

The purpose of this study was to explore the effectiveness of radiomics based on multisequence MRI in predicting the expression of PD-1/PD-L1 in hepatocellular carcinoma (HCC). One hundred and eight patients with HCC who underwent contrast-enhanced MRI 2 weeks before surgical resection were enrolled in this retrospective study. Corresponding paraffin sections were collected for immunohistochemistry to detect the expression of PD-1 and PD-L1. All patients were randomly divided into a training cohort and a validation cohort at a ratio of 7:3. Univariate and multivariate analyses were used to select potential clinical characteristics related to PD-1 and PD-L1 expression. Radiomics features were extracted from the axial fat-suppression T2-weighted imaging (FS-T2WI) images and the arterial phase and portal venous phase images from the axial dynamic contrast-enhanced MRI, and the corresponding feature sets were generated. The least absolute shrinkage and selection operator (LASSO) was used to select the optimal radiomics features for analysis. Logistic regression analysis was performed to construct single-sequence and multisequence radiomics and radiomic-clinical models. The predictive performance was judged by the area under the receiver operating characteristic curve (AUC) in the training and validation cohorts. In the whole cohort, PD-1 expression was positive in 43 patients, and PD-L1 expression was positive in 34 patients. The presence of satellite nodules served as an independent predictor of PD-L1 expression. The AUC values of the FS-T2WI, arterial phase, portal venous phase and multisequence models in predicting the expression of PD-1 were 0.696, 0.843, 0.863, and 0.946 in the training group and 0.669, 0.792, 0.800 and 0.815 in the validation group, respectively. The AUC values of the FS-T2WI, arterial phase, portal venous phase, multisequence and radiomic-clinical models in predicting PD-L1 expression were 0.731, 0.800, 0.800, 0.831 and 0.898 in the training group and 0.621, 0.743, 0.771, 0.810 and 0.779 in the validation group, respectively. The combined models showed better predictive performance. The results of this study suggest that a radiomics model based on multisequence MRI has the potential to predict the preoperative expression of PD-1 and PD-L1 in HCC, which could become an imaging biomarker for immune checkpoint inhibitor (ICI)-based treatment.

Update on the Use of Artificial Intelligence in Hepatobiliary MR Imaging

The application of machine learning (ML) and deep learning (DL) in radiology has expanded exponentially. In recent years, an extremely large number of studies have reported about the hepatobiliary domain. Its applications range from differential diagnosis to the diagnosis of tumor invasion and prediction of treatment response and prognosis. Moreover, it has been utilized to improve the image quality of DL reconstruction. However, most clinicians are not familiar with ML and DL, and previous studies about these concepts are relatively challenging to understand. In this review article, we aimed to explain the concepts behind ML and DL and to summarize recent achievements in their use in the hepatobiliary region.

Radiomics: A review of current applications and possibilities in the assessment of tumor microenvironment

With the recent success in the application of immunotherapy for treating various advanced cancers, the tumor microenvironment has rapidly become an important field of research. The tumor microenvironment is complex and its characteristics strongly influence disease biology and potentially responses to systemic therapy. Accurate preoperative assessment of tumor microenvironment is of great significance for the formulation of an immunotherapy strategy and evaluation of patient prognosis. As a research hotspot in medical image analysis technology, radiomics has been applied in the auxiliary diagnosis of the tumor microenvironment. This article reviews the current status of radiomics in the elective application on tumor microenvironment and discusses potential prospects.

Hepatocellular Carcinoma Recognition from Ultrasound Images Using Combinations of Conventional and Deep Learning Techniques

Hepatocellular Carcinoma (HCC) is the most frequent malignant liver tumor and the third cause of cancer-related deaths worldwide. For many years, the golden standard for HCC diagnosis has been the needle biopsy, which is invasive and carries risks. Computerized methods are due to achieve a noninvasive, accurate HCC detection process based on medical images. We developed image analysis and recognition methods to perform automatic and computer-aided diagnosis of HCC. Conventional approaches that combined advanced texture analysis, mainly based on Generalized Co-occurrence Matrices (GCM) with traditional classifiers, as well as deep learning approaches based on Convolutional Neural Networks (CNN) and Stacked Denoising Autoencoders (SAE), were involved in our research. The best accuracy of 91% was achieved for B-mode ultrasound images through CNN by our research group. In this work, we combined the classical approaches with CNN techniques, within B-mode ultrasound images. The combination was performed at the classifier level. The CNN features obtained at the output of various convolution layers were combined with powerful textural features, then supervised classifiers were employed. The experiments were conducted on two datasets, acquired with different ultrasound machines. The best performance, above 98%, overpassed our previous results, as well as representative state-of-the-art results.

Current status and future perspectives of radiomics in hepatocellular carcinoma

Given the frequent co-existence of an aggressive tumor and underlying chronic liver disease, the management of hepatocellular carcinoma (HCC) patients requires experienced multidisciplinary team discussion. Moreover, imaging plays a key role in the diagnosis, staging, restaging, and surveillance of HCC. Currently, imaging assessment of HCC entails the assessment of qualitative characteristics which are prone to inter-reader variability. Radiomics is an emerging field that extracts high-dimensional mineable quantitative features that cannot be assessed visually with the naked eye from medical imaging. The main potential applications of radiomic models in HCC are to predict histology, response to treatment, genetic signature, recurrence, and survival. Despite the encouraging results to date, there are challenges and limitations that need to be overcome before radiomics implementation in clinical practice. The purpose of this article is to review the main concepts and challenges pertaining to radiomics, and to review recent studies and potential applications of radiomics in HCC.

Non-Invasive Biomarkers for Immunotherapy in Patients with Hepatocellular Carcinoma: Current Knowledge and Future Perspectives

Simple Summary

The search for non-invasive biomarkers is a hot topic in modern oncology, since a tissue biopsy has significant limitations in terms of cost and invasiveness. The treatment perspectives have been significantly improved after the approval of immunotherapy for patients with hepatocellular carcinoma; therefore, the quick identification of responders is crucial to define the best therapeutic strategy. In this review, the current knowledge on the available non-invasive biomarkers of the response to immunotherapy is described.

Abstract

The treatment perspectives of advanced hepatocellular carcinoma (HCC) have deeply changed after the introduction of immunotherapy. The results in responders show improved survival compared with Sorafenib, but only one-third of patients achieve a significant benefit from treatment. As the tumor microenvironment exerts a central role in shaping the response to immunotherapy, the future goal of HCC treatment should be to identify a proxy of the hepatic tissue condition that is easy to use in clinical practice. Therefore, the search for biomarkers that are accurate in predicting prognosis will be the hot topic in the therapeutic management of HCC in the near future. Understanding the mechanisms of resistance to immunotherapy may expand the patient population that will benefit from it, and help researchers to find new combination regimens to improve patients’ outcomes. In this review, we describe the current knowledge on the prognostic non-invasive biomarkers related to treatment with immune checkpoint inhibitors, focusing on serological markers and gut microbiota.

Artificial intelligence and radiomics: fundamentals, applications, and challenges in immunotherapy

Immunotherapy offers the potential for durable clinical benefit but calls into question the association between tumor size and outcome that currently forms the basis for imaging-guided treatment. Artificial intelligence (AI) and radiomics allow for discovery of novel patterns in medical images that can increase radiology’s role in management of patients with cancer, although methodological issues in the literature limit its clinical application. Using keywords related to immunotherapy and radiomics, we performed a literature review of MEDLINE, CENTRAL, and Embase from database inception through February 2022. We removed all duplicates, non-English language reports, abstracts, reviews, editorials, perspectives, case reports, book chapters, and non-relevant studies. From the remaining articles, the following information was extracted: publication information, sample size, primary tumor site, imaging modality, primary and secondary study objectives, data collection strategy (retrospective vs prospective, single center vs multicenter), radiomic signature validation strategy, signature performance, and metrics for calculation of a Radiomics Quality Score (RQS). We identified 351 studies, of which 87 were unique reports relevant to our research question. The median (IQR) of cohort sizes was 101 (57–180). Primary stated goals for radiomics model development were prognostication (n=29, 33.3%), treatment response prediction (n=24, 27.6%), and characterization of tumor phenotype (n=14, 16.1%) or immune environment (n=13, 14.9%). Most studies were retrospective (n=75, 86.2%) and recruited patients from a single center (n=57, 65.5%). For studies with available information on model testing, most (n=54, 65.9%) used a validation set or better. Performance metrics were generally highest for radiomics signatures predicting treatment response or tumor phenotype, as opposed to immune environment and overall prognosis. Out of a possible maximum of 36 points, the median (IQR) of RQS was 12 (10–16). While a rapidly increasing number of promising results offer proof of concept that AI and radiomics could drive precision medicine approaches for a wide range of indications, standardizing the data collection as well as optimizing the methodological quality and rigor are necessary before these results can be translated into clinical practice.