Development and validation of deep learning classifiers to detect Epstein-Barr virus and microsatellite instability status in gastric cancer: a retrospective multicentre cohort study

Federated attention consistent learning models for prostate cancer diagnosis and Gleason grading

Artificial intelligence (AI) holds significant promise in transforming medical imaging, enhancing diagnostics, and refining treatment strategies. However, the reliance on extensive multicenter datasets for training AI models poses challenges due to privacy concerns. Federated learning provides a solution by facilitating collaborative model training across multiple centers without sharing raw data. This study introduces a federated attention-consistent learning (FACL) framework to address challenges associated with large-scale pathological images and data heterogeneity. FACL enhances model generalization by maximizing attention consistency between local clients and the server model. To ensure privacy and validate robustness, we incorporated differential privacy by introducing noise during parameter transfer. We assessed the effectiveness of FACL in cancer diagnosis and Gleason grading tasks using 19,461 whole-slide images of prostate cancer from multiple centers. In the diagnosis task, FACL achieved an area under the curve (AUC) of 0.9718, outperforming seven centers with an average AUC of 0.9499 when categories are relatively balanced. For the Gleason grading task, FACL attained a Kappa score of 0.8463, surpassing the average Kappa score of 0.7379 from six centers. In conclusion, FACL offers a robust, accurate, and cost-effective AI training model for prostate cancer pathology while maintaining effective data safeguards.

Tribulations and future opportunities for artificial intelligence in precision medicine

Upon a diagnosis, the clinical team faces two main questions: what treatment, and at what dose? Clinical trials' results provide the basis for guidance and support for official protocols that clinicians use to base their decisions. However, individuals do not consistently demonstrate the reported response from relevant clinical trials. The decision complexity increases with combination treatments where drugs administered together can interact with each other, which is often the case. Additionally, the individual's response to the treatment varies with the changes in their condition. In practice, the drug and the dose selection depend significantly on the medical protocol and the medical team's experience. As such, the results are inherently varied and often suboptimal. Big data and Artificial Intelligence (AI) approaches have emerged as excellent decision-making tools, but multiple challenges limit their application. AI is a rapidly evolving and dynamic field with the potential to revolutionize various aspects of human life. AI has become increasingly crucial in drug discovery and development. AI enhances decision-making across different disciplines, such as medicinal chemistry, molecular and cell biology, pharmacology, pathology, and clinical practice. In addition to these, AI contributes to patient population selection and stratification. The need for AI in healthcare is evident as it aids in enhancing data accuracy and ensuring the quality care necessary for effective patient treatment. AI is pivotal in improving success rates in clinical practice. The increasing significance of AI in drug discovery, development, and clinical trials is underscored by many scientific publications. Despite the numerous advantages of AI, such as enhancing and advancing Precision Medicine (PM) and remote patient monitoring, unlocking its full potential in healthcare requires addressing fundamental concerns. These concerns include data quality, the lack of well-annotated large datasets, data privacy and safety issues, biases in AI algorithms, legal and ethical challenges, and obstacles related to cost and implementation. Nevertheless, integrating AI in clinical medicine will improve diagnostic accuracy and treatment outcomes, contribute to more efficient healthcare delivery, reduce costs, and facilitate better patient experiences, making healthcare more sustainable. This article reviews AI applications in drug development and clinical practice, making healthcare more sustainable, and highlights concerns and limitations in applying AI.

Epstein-Barr virus positive gastric cancer: the pathological basis of CT findings and radiomics models prediction

PURPOSE

To analyze the clinicopathologic information and CT imaging features of Epstein-Barr virus (EBV)-positive gastric cancer (GC) and establish CT-based radiomics models to predict the EBV status of GC.

METHODS

This retrospective study included 144 GC cases, including 48 EBV-positive cases. Pathological and immunohistochemical information was collected. CT enlarged LN and morphological characteristics were also assessed. Radiomics models were constructed to predict the EBV status, including decision tree (DT), logistic regression (LR), random forest (RF), and support vector machine (SVM).

RESULTS

T stage, Lauren classification, histological differentiation, nerve invasion, VEGFR2, E-cadherin, PD-L1, and Ki67 differed significantly between the EBV-positive and -negative groups (p = 0.015, 0.030, 0.006, 0.022, 0.028, 0.030, < 0.001, and < 0.001, respectively). CT enlarged LN and large ulceration differed significantly between the two groups (p = 0.019 and 0.043, respectively). The number of patients in the training and validation cohorts was 100 (with 33 EBV-positive cases) and 44 (with 15 EBV-positive cases). In the training cohort, the radiomics models using DT, LR, RF, and SVM yielded areas under the curve (AUCs) of 0.905, 0.771, 0.836, and 0.886, respectively. In the validation cohort, the diagnostic efficacy of radiomics models using the four classifiers were 0.737, 0.722, 0.751, and 0.713, respectively.

CONCLUSION

A significantly higher proportion of CT enlarged LN and a significantly lower proportion of large ulceration were found in EBV-positive GC. The prediction efficiency of radiomics models with different classifiers to predict EBV status in GC was good.

A systematic pan-cancer study on deep learning-based prediction of multi-omic biomarkers from routine pathology images

BACKGROUND

The objective of this comprehensive pan-cancer study is to evaluate the potential of deep learning (DL) for molecular profiling of multi-omic biomarkers directly from hematoxylin and eosin (H&E)-stained whole slide images.

METHODS

A total of 12,093 DL models predicting 4031 multi-omic biomarkers across 32 cancer types were trained and validated. The study included a broad range of genetic, transcriptomic, and proteomic biomarkers, as well as established prognostic markers, molecular subtypes, and clinical outcomes.

RESULTS

Here we show that 50% of the models achieve an area under the curve (AUC) of 0.644 or higher. The observed AUC for 25% of the models is at least 0.719 and exceeds 0.834 for the top 5%. Molecular profiling with image-based histomorphological features is generally considered feasible for most of the investigated biomarkers and across different cancer types. The performance appears to be independent of tumor purity, sample size, and class ratio (prevalence), suggesting a degree of inherent predictability in histomorphology.

CONCLUSIONS

The results demonstrate that DL holds promise to predict a wide range of biomarkers across the omics spectrum using only H&E-stained histological slides of solid tumors. This paves the way for accelerating diagnosis and developing more precise treatments for cancer patients.

Federated Learning for Decentralized Artificial Intelligence in Melanoma Diagnostics

Importance

The development of artificial intelligence (AI)-based melanoma classifiers typically calls for large, centralized datasets, requiring hospitals to give away their patient data, which raises serious privacy concerns. To address this concern, decentralized federated learning has been proposed, where classifier development is distributed across hospitals.

Objective

To investigate whether a more privacy-preserving federated learning approach can achieve comparable diagnostic performance to a classical centralized (ie, single-model) and ensemble learning approach for AI-based melanoma diagnostics.

Design, Setting, and Participants

This multicentric, single-arm diagnostic study developed a federated model for melanoma-nevus classification using histopathological whole-slide images prospectively acquired at 6 German university hospitals between April 2021 and February 2023 and benchmarked it using both a holdout and an external test dataset. Data analysis was performed from February to April 2023.

Exposures

All whole-slide images were retrospectively analyzed by an AI-based classifier without influencing routine clinical care.

Main Outcomes and Measures

The area under the receiver operating characteristic curve (AUROC) served as the primary end point for evaluating the diagnostic performance. Secondary end points included balanced accuracy, sensitivity, and specificity.

Results

The study included 1025 whole-slide images of clinically melanoma-suspicious skin lesions from 923 patients, consisting of 388 histopathologically confirmed invasive melanomas and 637 nevi. The median (range) age at diagnosis was 58 (18-95) years for the training set, 57 (18-93) years for the holdout test dataset, and 61 (18-95) years for the external test dataset; the median (range) Breslow thickness was 0.70 (0.10-34.00) mm, 0.70 (0.20-14.40) mm, and 0.80 (0.30-20.00) mm, respectively. The federated approach (0.8579; 95% CI, 0.7693-0.9299) performed significantly worse than the classical centralized approach (0.9024; 95% CI, 0.8379-0.9565) in terms of AUROC on a holdout test dataset (pairwise Wilcoxon signed-rank, P < .001) but performed significantly better (0.9126; 95% CI, 0.8810-0.9412) than the classical centralized approach (0.9045; 95% CI, 0.8701-0.9331) on an external test dataset (pairwise Wilcoxon signed-rank, P < .001). Notably, the federated approach performed significantly worse than the ensemble approach on both the holdout (0.8867; 95% CI, 0.8103-0.9481) and external test dataset (0.9227; 95% CI, 0.8941-0.9479).

Conclusions and Relevance

The findings of this diagnostic study suggest that federated learning is a viable approach for the binary classification of invasive melanomas and nevi on a clinically representative distributed dataset. Federated learning can improve privacy protection in AI-based melanoma diagnostics while simultaneously promoting collaboration across institutions and countries. Moreover, it may have the potential to be extended to other image classification tasks in digital cancer histopathology and beyond.

DeepRisk network: an AI-based tool for digital pathology signature and treatment responsiveness of gastric cancer using whole-slide images

BACKGROUND

Digital histopathology provides valuable information for clinical decision-making. We hypothesized that a deep risk network (DeepRisk) based on digital pathology signature (DPS) derived from whole-slide images could improve the prognostic value of the tumor, node, and metastasis (TNM) staging system and offer chemotherapeutic benefits for gastric cancer (GC).

METHODS

DeepRisk is a multi-scale, attention-based learning model developed on 1120 GCs in the Zhongshan dataset and validated with two external datasets. Then, we assessed its association with prognosis and treatment response. The multi-omics analysis and multiplex Immunohistochemistry were conducted to evaluate the potential pathogenesis and spatial immune contexture underlying DPS.

RESULTS

Multivariate analysis indicated that the DPS was an independent prognosticator with a better C-index (0.84 for overall survival and 0.71 for disease-free survival). Patients with low-DPS after neoadjuvant chemotherapy responded favorably to treatment. Spatial analysis indicated that exhausted immune clusters and increased infiltration of CD11b+CD11c+ immune cells were present at the invasive margin of high-DPS group. Multi-omics data from the Cancer Genome Atlas-Stomach adenocarcinoma (TCGA-STAD) hint at the relevance of DPS to myeloid derived suppressor cells infiltration and immune suppression.

CONCLUSION

DeepRisk network is a reliable tool that enhances prognostic value of TNM staging and aid in precise treatment, providing insights into the underlying pathogenic mechanisms.

Virtual biopsies: Proof of concept for a novel quantitative approach to liver biopsy adequacy and pathology education

OBJECTIVES

To quantitatively measure liver biopsy adequacy requirements and the effect of a teaching intervention that uses a virtual biopsy platform.

METHODS

A library of virtual liver biopsies was created using digital whole-slide, trichrome-stained tissue sections from liver resection material and QuPath image analysis software. Blinded participants staged fibrosis on the virtual biopsies before and after a teaching intervention.

RESULTS

This platform both modeled adequacy requirements for cirrhosis diagnosis on biopsy material and measured the effect of a teaching intervention on participant performance. Using this platform, diagnostic accuracy for cirrhosis could be modeled according to the function y = λ(1 ‒ e‒x/γ). The platform demonstrated that the relationship between biopsy size and diagnostic accuracy was statistically significant and that biopsies smaller than 6 mm long and 0.8 mm wide were insufficient to diagnosis cirrhosis. The platform also measured improvement in fibrosis staging accuracy among participants following a teaching intervention.

CONCLUSIONS

These results provide proof of concept for a virtual biopsy method by which outstanding questions in anatomic pathology can be addressed quantitatively using open source software. Future work is needed to validate these findings in clinical practice.

Artificial Intelligence-Based Tool for Tumor Detection and Quantitative Tissue Analysis in Colorectal Specimens

Digital pathology adoption allows for applying computational algorithms to routine pathology tasks. Our study aimed to develop a clinical-grade artificial intelligence (AI) tool for precise multiclass tissue segmentation in colorectal specimens (resections and biopsies) and clinically validate the tool for tumor detection in biopsy specimens. The training data set included 241 precisely manually annotated whole-slide images (WSIs) from multiple institutions. The algorithm was trained for semantic segmentation of 11 tissue classes with an additional module for biopsy WSI classification. Six case cohorts from 5 pathology departments (4 countries) were used for formal and clinical validation, digitized by 4 different scanning systems. The developed algorithm showed high precision of segmentation of different tissue classes in colorectal specimens with composite multiclass Dice score of up to 0.895 and pixel-wise tumor detection specificity and sensitivity of up to 0.958 and 0.987, respectively. In the clinical validation study on multiple external cohorts, the AI tool reached sensitivity of 1.0 and specificity of up to 0.969 for tumor detection in biopsy WSI. The AI tool analyzes most biopsy cases in less than 1 minute, allowing effective integration into clinical routine. We developed and extensively validated a highly accurate, clinical-grade tool for assistive diagnostic processing of colorectal specimens. This tool allows for quantitative deciphering of colorectal cancer tissue for development of prognostic and predictive biomarkers and personalization of oncologic care. This study is a foundation for a SemiCOL computational challenge. We open-source multiple manually annotated and weakly labeled test data sets, representing a significant contribution to the colorectal cancer computational pathology field.

Deep Learning-Based Stratification of Gastric Cancer Patients from Hematoxylin and Eosin-Stained Whole Slide Images by Predicting Molecular Features for Immunotherapy Response

Determining the molecular characteristics of cancer patients is crucial for optimal immunotherapy decisions. The aim of this study was to screen immunotherapy beneficiaries by predicting key molecular features from hematoxylin and eosin-stained images based on deep learning models. An independent data set from Asian gastric cancer patients was included for external validation. In addition, a segmentation model (Horizontal-Vertical Network) was used to quantify the cellular composition of tumor stroma. The model performance was evaluated by measuring the area under the curve (AUC). The tumor extraction model achieved an AUC of 0.9386 and 0.9062 in the internal and external test sets, respectively. The stratification model could predict the immunotherapy-sensitive subtypes (AUC range, 0.8685 to 0.9461), the genetic mutations (AUC range, 0.8283 to 0.9225), and the pathway activity (AUC range, 0.7568 to 0.8612) fairly accurately. In external validation, the prediction performance of Epstein-Barr virus and programmed cell death ligand 1 expression status achieved AUCs of 0.7906 and 0.6384, respectively. The segmentation model identified a relatively high proportion of inflammatory cells and connective cells in some immunotherapy-sensitive subtypes. The deep learning-based models potentially may serve as a valuable tool to screen for the beneficiaries of immunotherapy in gastric cancer patients.

Digital histopathological images of biopsy predict response to neoadjuvant chemotherapy for locally advanced gastric cancer

BACKGROUND

Neoadjuvant chemotherapy (NAC) has been recognized as an effective therapeutic option for locally advanced gastric cancer as it is expected to reduce tumor size, increase the resection rate, and improve overall survival. However, for patients who are not responsive to NAC, the best operation timing may be missed together with suffering from side effects. Therefore, it is paramount to differentiate potential respondents from non-respondents. Histopathological images contain rich and complex data that can be exploited to study cancers. We assessed the ability of a novel deep learning (DL)-based biomarker to predict pathological responses from images of hematoxylin and eosin (H&E)-stained tissue.

METHODS

In this multicentre observational study, H&E-stained biopsy sections of patients with gastric cancer were collected from four hospitals. All patients underwent NAC followed by gastrectomy. The Becker tumor regression grading (TRG) system was used to evaluate the pathologic chemotherapy response. Based on H&E-stained slides of biopsies, DL methods (Inception-V3, Xception, EfficientNet-B5, and ensemble CRSNet models) were employed to predict the pathological response by scoring the tumor tissue to obtain a histopathological biomarker, the chemotherapy response score (CRS). The predictive performance of the CRSNet was evaluated.

RESULTS

69,564 patches from 230 whole-slide images of 213 patients with gastric cancer were obtained in this study. Based on the F1 score and area under the curve (AUC), an optimal model was finally chosen, named the CRSNet model. Using the ensemble CRSNet model, the response score derived from H&E staining images reached an AUC of 0.936 in the internal test cohort and 0.923 in the external validation cohort for predicting pathological response. The CRS of major responders was significantly higher than that of minor responders in both internal and external test cohorts (both p < 0.001).

CONCLUSION

In this study, the proposed DL-based biomarker (CRSNet model) derived from histopathological images of the biopsy showed potential as a clinical aid for predicting the response to NAC in patients with locally advanced GC. Therefore, the CRSNet model provides a novel tool for the individualized management of locally advanced gastric cancer.

ChampKit: A framework for rapid evaluation of deep neural networks for patch-based histopathology classification

BACKGROUND AND OBJECTIVE

Histopathology is the gold standard for diagnosis of many cancers. Recent advances in computer vision, specifically deep learning, have facilitated the analysis of histopathology images for many tasks, including the detection of immune cells and microsatellite instability. However, it remains difficult to identify optimal models and training configurations for different histopathology classification tasks due to the abundance of available architectures and the lack of systematic evaluations. Our objective in this work is to present a software tool that addresses this need and enables robust, systematic evaluation of neural network models for patch classification in histology in a light-weight, easy-to-use package for both algorithm developers and biomedical researchers.

METHODS

Here we present ChampKit (Comprehensive Histopathology Assessment of Model Predictions toolKit): an extensible, fully reproducible evaluation toolkit that is a one-stop-shop to train and evaluate deep neural networks for patch classification. ChampKit curates a broad range of public datasets. It enables training and evaluation of models supported by timm directly from the command line, without the need for users to write any code. External models are enabled through a straightforward API and minimal coding. As a result, Champkit facilitates the evaluation of existing and new models and deep learning architectures on pathology datasets, making it more accessible to the broader scientific community. To demonstrate the utility of ChampKit, we establish baseline performance for a subset of possible models that could be employed with ChampKit, focusing on several popular deep learning models, namely ResNet18, ResNet50, and R26-ViT, a hybrid vision transformer. In addition, we compare each model trained either from random weight initialization or with transfer learning from ImageNet pretrained models. For ResNet18, we also consider transfer learning from a self-supervised pretrained model.

RESULTS

The main result of this paper is the ChampKit software. Using ChampKit, we were able to systemically evaluate multiple neural networks across six datasets. We observed mixed results when evaluating the benefits of pretraining versus random intialization, with no clear benefit except in the low data regime, where transfer learning was found to be beneficial. Surprisingly, we found that transfer learning from self-supervised weights rarely improved performance, which is counter to other areas of computer vision.

CONCLUSIONS

Choosing the right model for a given digital pathology dataset is nontrivial. ChampKit provides a valuable tool to fill this gap by enabling the evaluation of hundreds of existing (or user-defined) deep learning models across a variety of pathology tasks. Source code and data for the tool are freely accessible at https://github.com/SBU-BMI/champkit.

Deep learning-based subtyping of gastric cancer histology predicts clinical outcome: a multi-institutional retrospective study

INTRODUCTION

The Laurén classification is widely used for Gastric Cancer (GC) histology subtyping. However, this classification is prone to interobserver variability and its prognostic value remains controversial. Deep Learning (DL)-based assessment of hematoxylin and eosin (H&E) stained slides is a potentially useful tool to provide an additional layer of clinically relevant information, but has not been systematically assessed in GC.

OBJECTIVE

We aimed to train, test and externally validate a deep learning-based classifier for GC histology subtyping using routine H&E stained tissue sections from gastric adenocarcinomas and to assess its potential prognostic utility.

METHODS

We trained a binary classifier on intestinal and diffuse type GC whole slide images for a subset of the TCGA cohort (N = 166) using attention-based multiple instance learning. The ground truth of 166 GC was obtained by two expert pathologists. We deployed the model on two external GC patient cohorts, one from Europe (N = 322) and one from Japan (N = 243). We assessed classification performance using the Area Under the Receiver Operating Characteristic Curve (AUROC) and prognostic value (overall, cancer specific and disease free survival) of the DL-based classifier with uni- and multivariate Cox proportional hazard models and Kaplan-Meier curves with log-rank test statistics.

RESULTS

Internal validation using the TCGA GC cohort using five-fold cross-validation achieved a mean AUROC of 0.93 ± 0.07. External validation showed that the DL-based classifier can better stratify GC patients' 5-year survival compared to pathologist-based Laurén classification for all survival endpoints, despite frequently divergent model-pathologist classifications. Univariate overall survival Hazard Ratios (HRs) of pathologist-based Laurén classification (diffuse type versus intestinal type) were 1.14 (95% Confidence Interval (CI) 0.66-1.44, p-value = 0.51) and 1.23 (95% CI 0.96-1.43, p-value = 0.09) in the Japanese and European cohorts, respectively. DL-based histology classification resulted in HR of 1.46 (95% CI 1.18-1.65, p-value < 0.005) and 1.41 (95% CI 1.20-1.57, p-value < 0.005), in the Japanese and European cohorts, respectively. In diffuse type GC (as defined by the pathologist), classifying patients using the DL diffuse and intestinal classifications provided a superior survival stratification, and demonstrated statistically significant survival stratification when combined with pathologist classification for both the Asian (overall survival log-rank test p-value < 0.005, HR 1.43 (95% CI 1.05-1.66, p-value = 0.03) and European cohorts (overall survival log-rank test p-value < 0.005, HR 1.56 (95% CI 1.16-1.76, p-value < 0.005)).

CONCLUSION

Our study shows that gastric adenocarcinoma subtyping using pathologist's Laurén classification as ground truth can be performed using current state of the art DL techniques. Patient survival stratification seems to be better by DL-based histology typing compared with expert pathologist histology typing. DL-based GC histology typing has potential as an aid in subtyping. Further investigations are warranted to fully understand the underlying biological mechanisms for the improved survival stratification despite apparent imperfect classification by the DL algorithm.

Computational textural mapping harmonises sampling variation and reveals multidimensional histopathological fingerprints

BACKGROUND

Technical factors can bias H&E digital slides potentially compromising computational histopathology studies. Here, we hypothesised that sample quality and sampling variation can introduce even greater and undocumented technical fallacy.

METHODS

Using The Cancer Genome Atlas (TCGA) clear-cell renal cell carcinoma (ccRCC) as a model disease, we annotated ~78,000 image tiles and trained deep learning models to detect histological textures and lymphocyte infiltration at the tumour core and its surrounding margin and correlated these with clinical, immunological, genomic, and transcriptomic profiles.

RESULTS

The models reached 95% validation accuracy for classifying textures and 95% for lymphocyte infiltration enabling reliable profiling of ccRCC samples. We validated the lymphocyte-per-texture distributions in the Helsinki dataset (n = 64). Texture analysis indicated constitutive sampling bias by TCGA clinical centres and technically suboptimal samples. We demonstrate how computational texture mapping (CTM) can abrogate these issues by normalising textural variance. CTM-harmonised histopathological architecture resonated with both expected associations and novel molecular fingerprints. For instance, tumour fibrosis associated with histological grade, epithelial-to-mesenchymal transition, low mutation burden and metastasis.

CONCLUSIONS

This study highlights texture-based standardisation to resolve technical bias in computational histopathology and understand the molecular basis of tissue architecture. All code, data and models are released as a community resource.

Application of artificial intelligence for improving early detection and prediction of therapeutic outcomes for gastric cancer in the era of precision oncology

Gastric cancer is a leading contributor to cancer incidence and mortality globally. Recently, artificial intelligence approaches, particularly machine learning and deep learning, are rapidly reshaping the full spectrum of clinical management for gastric cancer. Machine learning is formed from computers running repeated iterative models for progressively improving performance on a particular task. Deep learning is a subtype of machine learning on the basis of multilayered neural networks inspired by the human brain. This review summarizes the application of artificial intelligence algorithms to multi-dimensional data including clinical and follow-up information, conventional images (endoscope, histopathology, and computed tomography (CT)), molecular biomarkers, etc. to improve the risk surveillance of gastric cancer with established risk factors; the accuracy of diagnosis, and survival prediction among established gastric cancer patients; and the prediction of treatment outcomes for assisting clinical decision making. Therefore, artificial intelligence makes a profound impact on almost all aspects of gastric cancer from improving diagnosis to precision medicine. Despite this, most established artificial intelligence-based models are in a research-based format and often have limited value in real-world clinical practice. With the increasing adoption of artificial intelligence in clinical use, we anticipate the arrival of artificial intelligence-powered gastric cancer care.

Artificial Intelligence in the Pathology of Gastric Cancer

Recent advances in artificial intelligence (AI) have provided novel tools for rapid and precise pathologic diagnosis. The introduction of digital pathology has enabled the acquisition of scanned slide images that are essential for the application of AI. The application of AI for improved pathologic diagnosis includes the error-free detection of potentially negligible lesions, such as a minute focus of metastatic tumor cells in lymph nodes, the accurate diagnosis of potentially controversial histologic findings, such as very well-differentiated carcinomas mimicking normal epithelial tissues, and the pathological subtyping of the cancers. Additionally, the utilization of AI algorithms enables the precise decision of the score of immunohistochemical markers for targeted therapies, such as human epidermal growth factor receptor 2 and programmed death-ligand 1. Studies have revealed that AI assistance can reduce the discordance of interpretation between pathologists and more accurately predict clinical outcomes. Several approaches have been employed to develop novel biomarkers from histologic images using AI. Moreover, AI-assisted analysis of the cancer microenvironment showed that the distribution of tumor-infiltrating lymphocytes was related to the response to the immune checkpoint inhibitor therapy, emphasizing its value as a biomarker. As numerous studies have demonstrated the significance of AI-assisted interpretation and biomarker development, the AI-based approach will advance diagnostic pathology.

Worldwide Prevalence of Epstein-Barr Virus in Patients with Burkitt Lymphoma: A Systematic Review and Meta-Analysis

Burkitt lymphoma (BL) is a form of B-cell malignancy that progresses aggressively and is most often seen in children. While Epstein-Barr virus (EBV) is a double-stranded DNA virus that has been linked to a variety of cancers, it can transform B lymphocytes into immortalized cells, as shown in BL. Therefore, the estimated prevalence of EBV in a population may assist in the prediction of whether this population has a high risk of increased BL cases. This systematic review and meta-analysis aimed to estimate the prevalence of Epstein-Barr virus in patients with Burkitt lymphoma. Using the appropriate keywords, four electronic databases were searched. The quality of the included studies was assessed using the Joanna Briggs Institute's critical appraisal tool. The results were reported as percentages with a 95% confidence interval using a random-effects model (CI). PROSPERO was used to register the protocol (CRD42022372293), and 135 studies were included. The prevalence of Epstein-Barr virus in patients with Burkitt lymphoma was 57.5% (95% CI: 51.5 to 63.4, n = 4837). The sensitivity analyses demonstrated consistent results, and 65.2% of studies were of high quality. Egger's test revealed that there was a significant publication bias. EBV was found in a significantly high proportion of BL patients (more than 50% of BL patients). This study recommends EBV testing as an alternative for predictions and the assessment of the clinical disease status of BL.

Artificial Intelligence in Clinical Oncology: From Data to Digital Pathology and Treatment

Recently, a wide spectrum of artificial intelligence (AI)-based applications in the broader categories of digital pathology, biomarker development, and treatment have been explored. In the domain of digital pathology, these have included novel analytical strategies for realizing new information derived from standard histology to guide treatment selection and biomarker development to predict treatment selection and response. In therapeutics, these have included AI-driven drug target discovery, drug design and repurposing, combination regimen optimization, modulated dosing, and beyond. Given the continued advances that are emerging, it is important to develop workflows that seamlessly combine the various segments of AI innovation to comprehensively augment the diagnostic and interventional arsenal of the clinical oncology community. To overcome challenges that remain with regard to the ideation, validation, and deployment of AI in clinical oncology, recommendations toward bringing this workflow to fruition are also provided from clinical, engineering, implementation, and health care economics considerations. Ultimately, this work proposes frameworks that can potentially integrate these domains toward the sustainable adoption of practice-changing AI by the clinical oncology community to drive improved patient outcomes.

Artificial intelligence for tumour tissue detection and histological regression grading in oesophageal adenocarcinomas: a retrospective algorithm development and validation study

BACKGROUND

Oesophageal adenocarcinoma and adenocarcinoma of the oesophagogastric junction are among the most common malignant epithelial tumours. Most patients receive neoadjuvant therapy before complete tumour resection. Histological assessment after resection includes identification of residual tumour tissue and areas of regressive tumour, data which are used to calculate a clinically relevant regression score. We developed an artificial intelligence (AI) algorithm for tumour tissue detection and tumour regression grading in surgical specimens from patients with oesophageal adenocarcinoma or adenocarcinoma of the oesophagogastric junction.

METHODS

We used one training cohort and four independent test cohorts to develop, train, and validate a deep learning tool. The material consisted of histological slides from surgically resected specimens from patients with oesophageal adenocarcinoma and adenocarcinoma of the oesophagogastric junction from three pathology institutes (two in Germany, one in Austria) and oesophageal cancer cohort of The Cancer Genome Atlas (TCGA). All slides were from neoadjuvantly treated patients except for those from the TCGA cohort, who were neoadjuvant-therapy naive. Data from training cohort and test cohort cases were extensively manually annotated for 11 tissue classes. A convolutional neural network was trained on the data using a supervised principle. First, the tool was formally validated using manually annotated test datasets. Next, tumour regression grading was assessed in a retrospective cohort of post-neoadjuvant therapy surgical specimens. The grading of the algorithm was compared with that of a group of 12 board-certified pathologists from one department. To further validate the tool, three pathologists processed whole resection cases with and without AI assistance.

FINDINGS

Of the four test cohorts, one included 22 manually annotated histological slides (n=20 patients), one included 62 sides (n=15), one included 214 slides (n=69), and the final one included 22 manually annotated histological slides (n=22). In the independent test cohorts the AI tool had high patch-level accuracy for identifying both tumour and regression tissue. When we validated the concordance of the AI tool against analyses by a group of pathologists (n=12), agreement was 63·6% (quadratic kappa 0·749; p<0·0001) at case level. The AI-based regression grading triggered true reclassification of resected tumour slides in seven cases (including six cases who had small tumour regions that were initially missed by pathologists). Use of the AI tool by three pathologists increased interobserver agreement and substantially reduced diagnostic time per case compared with working without AI assistance.

INTERPRETATION

Use of our AI tool in the diagnostics of oesophageal adenocarcinoma resection specimens by pathologists increased diagnostic accuracy, interobserver concordance, and significantly reduced assessment time. Prospective validation of the tool is required.

FUNDING

North Rhine-Westphalia state, Federal Ministry of Education and Research of Germany, and the Wilhelm Sander Foundation.

Direct prediction of Homologous Recombination Deficiency from routine histology in ten different tumor types with attention-based Multiple Instance Learning: a development and validation study

Background

Homologous Recombination Deficiency (HRD) is a pan-cancer predictive biomarker that identifies patients who benefit from therapy with PARP inhibitors (PARPi). However, testing for HRD is highly complex. Here, we investigated whether Deep Learning can predict HRD status solely based on routine Hematoxylin & Eosin (H&E) histology images in ten cancer types.

Methods

We developed a fully automated deep learning pipeline with attention-weighted multiple instance learning (attMIL) to predict HRD status from histology images. A combined genomic scar HRD score, which integrated loss of heterozygosity (LOH), telomeric allelic imbalance (TAI) and large-scale state transitions (LST) was calculated from whole genome sequencing data for n=4,565 patients from two independent cohorts. The primary statistical endpoint was the Area Under the Receiver Operating Characteristic curve (AUROC) for the prediction of genomic scar HRD with a clinically used cutoff value.

Results

We found that HRD status is predictable in tumors of the endometrium, pancreas and lung, reaching cross-validated AUROCs of 0.79, 0.58 and 0.66. Predictions generalized well to an external cohort with AUROCs of 0.93, 0.81 and 0.73 respectively. Additionally, an HRD classifier trained on breast cancer yielded an AUROC of 0.78 in internal validation and was able to predict HRD in endometrial, prostate and pancreatic cancer with AUROCs of 0.87, 0.84 and 0.67 indicating a shared HRD-like phenotype is across tumor entities.

Conclusion

In this study, we show that HRD is directly predictable from H&E slides using attMIL within and across ten different tumor types.

A noninvasive nomogram model based on CT features to predict DNA mismatch repair deficiency in gastric cancer

Objectives

DNA mismatch repair deficiency (dMMR) status has served as a positive predictive biomarker for immunotherapy and long-term prognosis in gastric cancer (GC). The aim of the present study was to develop a computed tomography (CT)-based nomogram for preoperatively predicting mismatch repair (MMR) status in GC.

Methods

Data from a total of 159 GC patients between January 2020 and July 2021 with dMMR GC (n=53) and MMR-proficient (pMMR) GC (n=106) confirmed by postoperative immunohistochemistry (IHC) staining were retrospectively analyzed. All patients underwent abdominal contrast-enhanced CT. Significant clinical and CT imaging features associated with dMMR GC were extracted through univariate and multivariate analyses. Receiver operating characteristic (ROC) curve analysis, decision curve analysis (DCA) and internal validation of the cohort data were performed.

Results

The nomogram contained four potential predictors of dMMR GC, including gender (odds ratio [OR] 9.83, 95% confidence interval [CI] 3.78-28.20, P &lt; 0.001), age (OR 3.32, 95% CI 1.36-8.50, P = 0.010), tumor size (OR 5.66, 95% CI 2.12-16.27, P &lt; 0.001) and normalized tumor enhancement ratio (NTER) (OR 0.15, 95% CI 0.06-0.38, P &lt; 0.001). Using an optimal cutoff value of 6.6 points, the nomogram provided an area under the curve (AUC) of 0.895 and an accuracy of 82.39% in predicting dMMR GC. The calibration curve demonstrated a strong consistency between the predicted risk and observed dMMR GC. The DCA justified the relatively good performance of the nomogram model.

Conclusion

The CT-based nomogram holds promise as a noninvasive, concise and accurate tool to predict MMR status in GC patients, which can assist in clinical decision-making.

Artificial intelligence and digital biomarker in precision pathology guiding immune therapy selection and precision oncology

BACKGROUND

The currently available immunotherapies already changed the strategy how many cancers are treated from first to last line. Understanding even the most complex heterogeneity in tumor tissue and mapping the spatial cartography of the tumor immunity allows the best and optimized selection of immune modulating agents to (re-)activate the patient's immune system and direct it against the individual cancer in the most effective way.

RECENT FINDINGS

Primary cancer and metastases maintain a high degree of plasticity to escape any immune surveillance and continue to evolve depending on many intrinsic and extrinsic factors In the field of immune-oncology (IO) immune modulating agents are recognized as practice changing therapeutic modalities. Recent studies have shown that an optimal and lasting efficacy of IO therapeutics depends on the understanding of the spatial communication network and functional context of immune and cancer cells within the tumor microenvironment. Artificial intelligence (AI) provides an insight into the immune-cancer-network through the visualization of very complex tumor and immune interactions in cancer tissue specimens and allows the computer-assisted development and clinical validation of such digital biomarker.

CONCLUSIONS

The successful implementation of AI-supported digital biomarker solutions guides the clinical selection of effective immune therapeutics based on the retrieval and visualization of spatial and contextual information from cancer tissue images and standardized data. As such, computational pathology (CP) turns into "precision pathology" delivering individual therapy response prediction. Precision Pathology does not only include digital and computational solutions but also high levels of standardized processes in the routine histopathology workflow and the use of mathematical tools to support clinical and diagnostic decisions as the basic principle of a "precision oncology".

Facts and Hopes on the Use of Artificial Intelligence for Predictive Immunotherapy Biomarkers in Cancer

Immunotherapy by immune checkpoint inhibitors has become a standard treatment strategy for many types of solid tumors. However, the majority of patients with cancer will not respond, and predicting response to this therapy is still a challenge. Artificial intelligence (AI) methods can extract meaningful information from complex data, such as image data. In clinical routine, radiology or histopathology images are ubiquitously available. AI has been used to predict the response to immunotherapy from radiology or histopathology images, either directly or indirectly via surrogate markers. While none of these methods are currently used in clinical routine, academic and commercial developments are pointing toward potential clinical adoption in the near future. Here, we summarize the state of the art in AI-based image biomarkers for immunotherapy response based on radiology and histopathology images. We point out limitations, caveats, and pitfalls, including biases, generalizability, and explainability, which are relevant for researchers and health care providers alike, and outline key clinical use cases of this new class of predictive biomarkers.

Artificial intelligence applicated in gastric cancer: A bibliometric and visual analysis via CiteSpace

Objective

This study aimed to analyze and visualize the current research focus, research frontiers, evolutionary processes, and trends of artificial intelligence (AI) in the field of gastric cancer using a bibliometric analysis.

Methods

The Web of Science Core Collection database was selected as the data source for this study to retrieve and obtain articles and reviews related to AI in gastric cancer. All the information extracted from the articles was imported to CiteSpace to conduct the bibliometric and knowledge map analysis, allowing us to clearly visualize the research hotspots and trends in this field.

Results

A total of 183 articles published between 2017 and 2022 were included, contributed by 201 authors from 33 countries/regions. Among them, China (47.54%), Japan (21.86%), and the USA (13.11%) have made outstanding contributions in this field, accounting fsor 82.51% of the total publications. The primary research institutions were Wuhan University, Tokyo University, and Tada Tomohiro Inst Gastroenterol and Proctol. Tada (n = 12) and Hirasawa (n = 90) were ranked first in the top 10 authors and co-cited authors, respectively. Gastrointestinal Endoscopy (21 publications; IF 2022, 9.189; Q1) was the most published journal, while Gastric Cancer (133 citations; IF 2022, 8.171; Q1) was the most co-cited journal. Nevertheless, the cooperation between different countries and institutions should be further strengthened. The most common keywords were AI, gastric cancer, and convolutional neural network. The "deep-learning algorithm" started to burst in 2020 and continues till now, which indicated that this research topic has attracted continuous attention in recent years and would be the trend of research on AI application in GC.

Conclusions

Research related to AI in gastric cancer is increasing exponentially. Current research hotspots focus on the application of AI in gastric cancer, represented by convolutional neural networks and deep learning, in diagnosis and differential diagnosis and staging. Considering the great potential and clinical application prospects, the related area of AI applications in gastric cancer will remain a research hotspot in the future.

Development and Validation of a Machine Learning Model for Detection and Classification of Tertiary Lymphoid Structures in Gastrointestinal Cancers

IMPORTANCE

Tertiary lymphoid structures (TLSs) are associated with a favorable prognosis and improved response to cancer immunotherapy. The current approach for evaluation of TLSs is limited by interobserver variability and high complexity and cost of specialized imaging techniques.

OBJECTIVE

To develop a machine learning model for automated and quantitative evaluation of TLSs based on routine histopathology images.

DESIGN, SETTING, AND PARTICIPANTS

In this multicenter, international diagnostic/prognostic study, an interpretable machine learning model was developed and validated for automated detection, enumeration, and classification of TLSs in hematoxylin-eosin-stained images. A quantitative scoring system for TLSs was proposed, and its association with survival was investigated in patients with 1 of 6 types of gastrointestinal cancers. Data analysis was performed between June 2021 and March 2022.

MAIN OUTCOMES AND MEASURES

The diagnostic accuracy for classification of TLSs into 3 maturation states and the association of TLS score with survival were investigated.

RESULTS

A total of 1924 patients with gastrointestinal cancer from 7 independent cohorts (median [IQR] age ranging from 57 [49-64] years to 68 [58-77] years; proportion by sex ranging from 214 of 409 patients who were male [52.3%] to 134 of 155 patients who were male [86.5%]). The machine learning model achieved high accuracies for detecting and classifying TLSs into 3 states (TLS1: 97.7%; 95% CI, 96.4%-99.0%; TLS2: 96.3%; 95% CI, 94.6%-98.0%; TLS3: 95.7%; 95% CI, 93.9%-97.5%). TLSs were detected in 62 of 155 esophageal cancers (40.0%) and up to 267 of 353 gastric cancers (75.6%). Across 6 cancer types, patients were stratified into 3 risk groups (higher and lower TLS score and no TLS) and survival outcomes compared between groups: higher vs lower TLS score (hazard ratio [HR]; 0.27; 95% CI, 0.18-0.41; P < .001) and lower TLS score vs no TLSs (HR, 0.65; 95% CI, 0.56-0.76; P < .001). TLS score remained an independent prognostic factor associated with survival after adjusting for clinicopathologic variables and tumor-infiltrating lymphocytes (eg, for colon cancer: HR, 0.11; 95% CI, 0.02-0.47; P = .003).

CONCLUSIONS AND RELEVANCE

In this study, an interpretable machine learning model was developed that may allow automated and accurate detection of TLSs on routine tissue slide. This model is complementary to the cancer staging system for risk stratification in gastrointestinal cancers.

Direct prediction of genetic aberrations from pathology images in gastric cancer with swarm learning

BACKGROUND

Computational pathology uses deep learning (DL) to extract biomarkers from routine pathology slides. Large multicentric datasets improve performance, but such datasets are scarce for gastric cancer. This limitation could be overcome by Swarm Learning (SL).

METHODS

Here, we report the results of a multicentric retrospective study of SL for prediction of molecular biomarkers in gastric cancer. We collected tissue samples with known microsatellite instability (MSI) and Epstein-Barr Virus (EBV) status from four patient cohorts from Switzerland, Germany, the UK and the USA, storing each dataset on a physically separate computer.

RESULTS

On an external validation cohort, the SL-based classifier reached an area under the receiver operating curve (AUROC) of 0.8092 (± 0.0132) for MSI prediction and 0.8372 (± 0.0179) for EBV prediction. The centralized model, which was trained on all datasets on a single computer, reached a similar performance.

CONCLUSIONS

Our findings demonstrate the feasibility of SL-based molecular biomarkers in gastric cancer. In the future, SL could be used for collaborative training and, thus, improve the performance of these biomarkers. This may ultimately result in clinical-grade performance and generalizability.

Direct image to subtype prediction for brain tumors using deep learning

Background

Deep Learning (DL) can predict molecular alterations of solid tumors directly from routine histopathology slides. Since the 2021 update of the World Health Organization (WHO) diagnostic criteria, the classification of brain tumors integrates both histopathological and molecular information. We hypothesize that DL can predict molecular alterations as well as WHO subtyping of brain tumors from hematoxylin and eosin-stained histopathology slides.

Methods

We used weakly supervised DL and applied it to three large cohorts of brain tumor samples, comprising N = 2845 patients.

Results

We found that the key molecular alterations for subtyping, IDH and ATRX, as well as 1p19q codeletion, were predictable from histology with an area under the receiver operating characteristic curve (AUROC) of 0.95, 0.90, and 0.80 in the training cohort, respectively. These findings were upheld in external validation cohorts with AUROCs of 0.90, 0.79, and 0.87 for prediction of IDH, ATRX, and 1p19q codeletion, respectively.

Conclusions

In the future, such DL-based implementations could ease diagnostic workflows, particularly for situations in which advanced molecular testing is not readily available.

Artificial intelligence-based multi-omics analysis fuels cancer precision medicine

With biotechnological advancements, innovative omics technologies are constantly emerging that have enabled researchers to access multi-layer information from the genome, epigenome, transcriptome, proteome, metabolome, and more. A wealth of omics technologies, including bulk and single-cell omics approaches, have empowered to characterize different molecular layers at unprecedented scale and resolution, providing a holistic view of tumor behavior. Multi-omics analysis allows systematic interrogation of various molecular information at each biological layer while posing tricky challenges regarding how to extract valuable insights from the exponentially increasing amount of multi-omics data. Therefore, efficient algorithms are needed to reduce the dimensionality of the data while simultaneously dissecting the mysteries behind the complex biological processes of cancer. Artificial intelligence has demonstrated the ability to analyze complementary multi-modal data streams within the oncology realm. The coincident development of multi-omics technologies and artificial intelligence algorithms has fuelled the development of cancer precision medicine. Here, we present state-of-the-art omics technologies and outline a roadmap of multi-omics integration analysis using an artificial intelligence strategy. The advances made using artificial intelligence-based multi-omics approaches are described, especially concerning early cancer screening, diagnosis, response assessment, and prognosis prediction. Finally, we discuss the challenges faced in multi-omics analysis, along with tentative future trends in this field. With the increasing application of artificial intelligence in multi-omics analysis, we anticipate a shifting paradigm in precision medicine becoming driven by artificial intelligence-based multi-omics technologies.

Artificial intelligence applications in predicting the behavior of gastrointestinal cancers in pathology

Recent research has provided a wealth of data supporting the application of artificial intelligence (AI)-based applications in routine pathology practice. Indeed, it is clear that these methods can significantly support an accurate and rapid diagnosis by eliminating errors, increasing reliability, and improving workflow. In addition, the effectiveness of AI in the pathological evaluation of prognostic parameters associated with behavior, course, and treatment in many types of tumors has also been noted. Regarding gastrointestinal system (GIS) cancers, the contribution of AI methods to pathological diagnosis has been investigated in many studies. On the other hand, studies focusing on AI applications in evaluating parameters to determine tumor behavior are relatively few. For this purpose, the potential of AI models has been studied over a broad spectrum, from tumor subtyping to the identification of new digital biomarkers. The capacity of AI to infer genetic alterations of cancer tissues from digital slides has been demonstrated. Although current data suggest the merit of AI-based approaches in assessing tumor behavior in GIS cancers, a wide range of challenges still need to be solved, from laboratory infrastructure to improving the robustness of algorithms, before incorporating AI applications into real-life GIS pathology practice. This review aims to present data from AI applications in evaluating pathological parameters related to the behavior of GIS cancer with an overview of the opportunities and challenges encountered in implementing AI in pathology.

An interpretable artificial intelligence system for detecting risk factors of gastroesophageal variceal bleeding

Bleeding risk factors for gastroesophageal varices (GEV) detected by endoscopy in cirrhotic patients determine the prophylactical treatment patients will undergo in the following 2 years. We propose a methodology for measuring the risk factors. We create an artificial intelligence system (ENDOANGEL-GEV) containing six models to segment GEV and to classify the grades (grades 1-3) and red color signs (RC, RC0-RC3) of varices. It also summarizes changes in the above results with region in real time. ENDOANGEL-GEV is trained using 6034 images from 1156 cirrhotic patients across three hospitals (dataset 1) and validated on multicenter datasets with 11009 images from 141 videos (dataset 2) and in a prospective study recruiting 161 cirrhotic patients from Renmin Hospital of Wuhan University (dataset 3). In dataset 1, ENDOANGEL-GEV achieves intersection over union values of 0.8087 for segmenting esophageal varices and 0.8141 for gastric varices. In dataset 2, the system maintains fairly accuracy across images from three hospitals. In dataset 3, ENDOANGEL-GEV surpasses attended endoscopists in detecting RC of GEV and classifying grades (p < 0.001). When ranking the risk of patients combined with the Child‒Pugh score, ENDOANGEL-GEV outperforms endoscopists for esophageal varices (p < 0.001) and shows comparable performance for gastric varices (p = 0.152). Compared with endoscopists, ENDOANGEL-GEV may help 12.31% (16/130) more patients receive the right intervention. We establish an interpretable system for the endoscopic diagnosis and risk stratification of GEV. It will assist in detecting the first bleeding risk factors accurately and expanding the scope of quantitative measurement of diseases.

Deep Learning-Based Prediction of Molecular Tumor Biomarkers from H&E: A Practical Review

Molecular and genomic properties are critical in selecting cancer treatments to target individual tumors, particularly for immunotherapy. However, the methods to assess such properties are expensive, time-consuming, and often not routinely performed. Applying machine learning to H&E images can provide a more cost-effective screening method. Dozens of studies over the last few years have demonstrated that a variety of molecular biomarkers can be predicted from H&E alone using the advancements of deep learning: molecular alterations, genomic subtypes, protein biomarkers, and even the presence of viruses. This article reviews the diverse applications across cancer types and the methodology to train and validate these models on whole slide images. From bottom-up to pathologist-driven to hybrid approaches, the leading trends include a variety of weakly supervised deep learning-based approaches, as well as mechanisms for training strongly supervised models in select situations. While results of these algorithms look promising, some challenges still persist, including small training sets, rigorous validation, and model explainability. Biomarker prediction models may yield a screening method to determine when to run molecular tests or an alternative when molecular tests are not possible. They also create new opportunities in quantifying intratumoral heterogeneity and predicting patient outcomes.

Deep learning model to predict Epstein-Barr virus associated gastric cancer in histology

The detection of Epstein-Barr virus (EBV) in gastric cancer patients is crucial for clinical decision making, as it is related with specific treatment responses and prognoses. Despite its importance, the limited medical resources preclude universal EBV testing. Herein, we propose a deep learning-based EBV prediction method from H&E-stained whole-slide images (WSI). Our model was developed using 319 H&E stained WSI (26 EBV positive; TCGA dataset) from the Cancer Genome Atlas, and 108 WSI (8 EBV positive; ISH dataset) from an independent institution. Our deep learning model, EBVNet consists of two sequential components: a tumor classifier and an EBV classifier. We visualized the learned representation by the classifiers using UMAP. We externally validated the model using 60 additional WSI (7 being EBV positive; HGH dataset). We compared the model's performance with those of four pathologists. EBVNet achieved an AUPRC of 0.65, whereas the four pathologists yielded a mean AUPRC of 0.41. Moreover, EBVNet achieved an negative predictive value, sensitivity, specificity, precision, and F1-score of 0.98, 0.86, 0.92, 0.60, and 0.71, respectively. Our proposed model is expected to contribute to prescreen patients for confirmatory testing, potentially to save test-related cost and labor.

Prediction of Epstein-Barr Virus Status in Gastric Cancer Biopsy Specimens Using a Deep Learning Algorithm

IMPORTANCE

Epstein-Barr virus (EBV)-associated gastric cancer (EBV-GC) is 1 of 4 molecular subtypes of GC and is confirmed by an expensive molecular test, EBV-encoded small RNA in situ hybridization. EBV-GC has 2 histologic characteristics, lymphoid stroma and lace-like tumor pattern, but projecting EBV-GC at biopsy is difficult even for experienced pathologists.

OBJECTIVE

To develop and validate a deep learning algorithm to predict EBV status from pathology images of GC biopsy.

DESIGN, SETTING, AND PARTICIPANTS

This diagnostic study developed a deep learning classifier to predict EBV-GC using image patches of tissue microarray (TMA) and whole slide images (WSIs) of GC and applied it to GC biopsy specimens from GCs diagnosed at Kangbuk Samsung Hospital between 2011 and 2020. For a quantitative evaluation and EBV-GC prediction on biopsy specimens, the area of each class and the fraction in total tissue or tumor area were calculated. Data were analyzed from March 5, 2021, to February 10, 2022.

MAIN OUTCOMES AND MEASURES

Evaluation metrics of predictive model performance were assessed on accuracy, recall, precision, F1 score, area under the receiver operating characteristic curve (AUC), and κ coefficient.

RESULTS

This study included 137 184 image patches from 16 TMAs (708 tissue cores), 24 WSIs, and 286 biopsy images of GC. The classifier was able to classify EBV-GC image patches from TMAs and WSIs with 94.70% accuracy, 0.936 recall, 0.938 precision, 0.937 F1 score, and 0.909 κ coefficient. The classifier was used for predicting and measuring the area and fraction of EBV-GC on biopsy tissue specimens. A 10% cutoff value for the predicted fraction of EBV-GC to tissue (EBV-GC/tissue area) produced the best prediction results in EBV-GC biopsy specimens and showed the highest AUC value (0.8723; 95% CI, 0.7560-0.9501). That cutoff also obtained high sensitivity (0.895) and moderate specificity (0.745) compared with experienced pathologist sensitivity (0.842) and specificity (0.854) when using the presence of lymphoid stroma and a lace-like pattern as diagnostic criteria. On prediction maps, EBV-GCs with lace-like pattern and lymphoid stroma showed the same prediction results as EBV-GC, but cases lacking these histologic features revealed heterogeneous prediction results of EBV-GC and non-EBV-GC areas.

CONCLUSIONS AND RELEVANCE

This study showed the feasibility of EBV-GC prediction using a deep learning algorithm, even in biopsy samples. Use of such an image-based classifier before a confirmatory molecular test will reduce costs and tissue waste.

Adversarial attacks and adversarial robustness in computational pathology

Artificial Intelligence (AI) can support diagnostic workflows in oncology by aiding diagnosis and providing biomarkers directly from routine pathology slides. However, AI applications are vulnerable to adversarial attacks. Hence, it is essential to quantify and mitigate this risk before widespread clinical use. Here, we show that convolutional neural networks (CNNs) are highly susceptible to white- and black-box adversarial attacks in clinically relevant weakly-supervised classification tasks. Adversarially robust training and dual batch normalization (DBN) are possible mitigation strategies but require precise knowledge of the type of attack used in the inference. We demonstrate that vision transformers (ViTs) perform equally well compared to CNNs at baseline, but are orders of magnitude more robust to white- and black-box attacks. At a mechanistic level, we show that this is associated with a more robust latent representation of clinically relevant categories in ViTs compared to CNNs. Our results are in line with previous theoretical studies and provide empirical evidence that ViTs are robust learners in computational pathology. This implies that large-scale rollout of AI models in computational pathology should rely on ViTs rather than CNN-based classifiers to provide inherent protection against perturbation of the input data, especially adversarial attacks.

Artificial Intelligence can support diagnostic workflows in oncology, but they are vulnerable to adversarial attacks. Here, the authors show that convolutional neural networks are highly susceptible to white- and black-box adversarial attacks in clinically relevant classification tasks.

Artificial intelligence in histopathology: enhancing cancer research and clinical oncology

Artificial intelligence (AI) methods have multiplied our capabilities to extract quantitative information from digital histopathology images. AI is expected to reduce workload for human experts, improve the objectivity and consistency of pathology reports, and have a clinical impact by extracting hidden information from routinely available data. Here, we describe how AI can be used to predict cancer outcome, treatment response, genetic alterations and gene expression from digitized histopathology slides. We summarize the underlying technologies and emerging approaches, noting limitations, including the need for data sharing and standards. Finally, we discuss the broader implications of AI in cancer research and oncology.

The evolving role of morphology in endometrial cancer diagnostics: From histopathology and molecular testing towards integrative data analysis by deep learning

Endometrial cancer (EC) diagnostics is evolving into a system in which molecular aspects are increasingly important. The traditional histological subtype-driven classification has shifted to a molecular-based classification that stratifies EC into DNA polymerase epsilon mutated (POLEmut), mismatch repair deficient (MMRd), and p53 abnormal (p53abn), and the remaining EC as no specific molecular profile (NSMP). The molecular EC classification has been implemented in the World Health Organization 2020 classification and the 2021 European treatment guidelines, as it serves as a better basis for patient management. As a result, the integration of the molecular class with histopathological variables has become a critical focus of recent EC research. Pathologists have observed and described several morphological characteristics in association with specific genomic alterations, but these appear insufficient to accurately classify patients according to molecular subgroups. This requires pathologists to rely on molecular ancillary tests in routine workup. In this new era, it has become increasingly challenging to assign clinically relevant weights to histological and molecular features on an individual patient basis. Deep learning (DL) technology opens new options for the integrative analysis of multi-modal image and molecular datasets with clinical outcomes. Proof-of-concept studies in other cancers showed promising accuracy in predicting molecular alterations from H&E-stained tumor slide images. This suggests that some morphological characteristics that are associated with molecular alterations could be identified in EC, too, expanding the current understanding of the molecular-driven EC classification. Here in this review, we report the morphological characteristics of the molecular EC classification currently identified in the literature. Given the new challenges in EC diagnostics, this review discusses, therefore, the potential supportive role that DL could have, by providing an outlook on all relevant studies using DL on histopathology images in various cancer types with a focus on EC. Finally, we touch upon how DL might shape the management of future EC patients.

Identification and Validation of an m6A Modification of JAK-STAT Signaling Pathway–Related Prognostic Prediction Model in Gastric Cancer

Background: Gastric cancer (GC) is one of the malignant tumors worldwide. Janus (JAK)–signal transduction and activator of transcription (STAT) signaling pathway is involved in cellular biological process and immune function. However, the association between them is still not systematically described. Therefore, in this study, we aimed to identify key genes involved in JAK-STAT signaling pathway and GC, as well as the potential mechanism.

Methods: The Cancer Genome Atlas (TCGA) database was the source of RNA-sequencing data of GC patients. Gene Expression Omnibus (GEO) database was used as the validation set. The predictive value of the JAK-STAT signaling pathway-related prognostic prediction model was examined using least absolute shrinkage and selection operator (LASSO); survival, univariate, and multivariate Cox regression analyses; and receiver operating characteristic curve (ROC) analyses to examine the predictive value of the model. Quantitative real-time polymerase chain reaction (qRT-PCR) and chi-square test were used to verify the expression of genes in the model and assess the association between the genes and clinicopathological parameters of GC patients, respectively. Then, Gene Ontology (GO), Kyoto Encyclopedia of Genes and Genomes (KEGG), gene set enrichment analysis, version 3.0 (GSEA), sequence-based RNA adenosine methylation site predictor (SRAMP) online websites, and RNA immunoprecipitation (RIP) experiments were used to predict the model-related potential pathways, m6A modifications, and the association between model genes and m6A.

Results: A four-gene prognostic model (GHR, PIM1, IFNA8, and IFNB1) was constructed, namely, riskScore. The Kaplan–Meier curves suggested that patients with high riskScore expression had a poorer prognosis than those with low riskScore expression (p = 0.006). Multivariate Cox regression analyses showed that the model could be an independent predictor (p < 0.001; HR = 3.342, 95%, CI = 1.834–6.088). The 5-year area under time-dependent ROC curve (AUC) reached 0.655. The training test set verified these results. Further analyses unveiled an enrichment of cancer-related pathways, m6A modifications, and the direct interaction between m6A and the four genes.

Conclusion: This four-gene prognostic model could be applied to predict the prognosis of GC patients and might be a promising therapeutic target in GC.

Comparative analysis of high- and low-level deep learning approaches in microsatellite instability prediction

Deep learning-based approaches in histopathology can be largely divided into two categories: a high-level approach using an end-to-end model and a low-level approach using feature extractors. Although the advantages and disadvantages of both approaches are empirically well known, there exists no scientific basis for choosing a specific approach in research, and direct comparative analysis of the two approaches has rarely been performed. Using the Cancer Genomic Atlas (TCGA)-based dataset, we compared these two different approaches in microsatellite instability (MSI) prediction and analyzed morphological image features associated with MSI. Our high-level approach was based solely on EfficientNet, while our low-level approach relied on LightGBM and multiple deep learning models trained on publicly available multiclass tissue, nuclei, and gland datasets. We compared their performance and important image features. Our high-level approach showed superior performance compared to our low-level approach. In both approaches, debris, lymphocytes, and necrotic cells were revealed as important features of MSI, which is consistent with clinical knowledge. Then, during qualitative analysis, we discovered the weaknesses of our low-level approach and demonstrated that its performance can be improved by using different image features in a complementary way. We performed our study using open-access data, and we believe this study can serve as a useful basis for discovering imaging biomarkers for clinical application.

Interpretable tumor differentiation grade and microsatellite instability recognition in gastric cancer using deep learning

Gastric cancer possesses great histological and molecular diversity, which creates obstacles for rapid and efficient diagnoses. Classic diagnoses either depend on the pathologist's judgment, which relies heavily on subjective experience, or time-consuming molecular assays for subtype diagnosis. Here, we present a deep learning (DL) system to achieve interpretable tumor differentiation grade and microsatellite instability (MSI) recognition in gastric cancer directly using hematoxylin-eosin (HE) staining whole-slide images (WSIs). WSIs from 467 patients were divided into three cohorts: the training cohort with 348 annotated WSIs, the testing cohort with 88 annotated WSIs, and the integration testing cohort with 31 original WSIs without tumor contour annotation. First, the DL models comprehensibly achieved tumor differentiation recognition with an F1 values of 0.8615 and 0.8977 for poorly differentiated adenocarcinoma (PDA) and well-differentiated adenocarcinoma (WDA) classes. Its ability to extract pathological features about the glandular structure formation, which is the key to distinguishing between PDA and WDA, increased the interpretability of the DL models. Second, the DL models achieved MSI status recognition with a patient-level accuracy of 86.36% directly from HE-stained WSIs in the testing cohort. Finally, the integrated end-to-end system achieved patient-level MSI recognition from original HE staining WSIs with an accuracy of 83.87% in the integration testing cohort with no tumor contour annotation. The proposed system, therefore, demonstrated high accuracy and interpretability, which can potentially promote the implementation of artificial intelligence healthcare.

A deep learning model and human-machine fusion for prediction of EBV-associated gastric cancer from histopathology

Epstein–Barr virus-associated gastric cancer (EBVaGC) shows a robust response to immune checkpoint inhibitors. Therefore, a cost-efficient and accessible tool is needed for discriminating EBV status in patients with gastric cancer. Here we introduce a deep convolutional neural network called EBVNet and its fusion with pathologists for predicting EBVaGC from histopathology. The EBVNet yields an averaged area under the receiver operating curve (AUROC) of 0.969 from the internal cross validation, an AUROC of 0.941 on an external dataset from multiple institutes and an AUROC of 0.895 on The Cancer Genome Atlas dataset. The human-machine fusion significantly improves the diagnostic performance of both the EBVNet and the pathologist. This finding suggests that our EBVNet could provide an innovative approach for the identification of EBVaGC and may help effectively select patients with gastric cancer for immunotherapy.

Epstein–Barr virus-associated gastric cancer shows a robust response to immune checkpoint inhibitors. Here the authors introduce a deep convolutional neural network and its fusion with pathologists for predicting it from histopathology.

The potential of artificial intelligence-based applications in kidney pathology

PURPOSE OF REVIEW

The field of pathology is currently undergoing a significant transformation from traditional glass slides to a digital format dependent on whole slide imaging. Transitioning from glass to digital has opened the field to development and application of image analysis technology, commonly deep learning methods (artificial intelligence [AI]) to assist pathologists with tissue examination. Nephropathology is poised to leverage this technology to improve precision, accuracy, and efficiency in clinical practice.

RECENT FINDINGS

Through a multidisciplinary approach, nephropathologists, and computer scientists have made significant recent advances in developing AI technology to identify histological structures within whole slide images (segmentation), quantification of histologic structures, prediction of clinical outcomes, and classifying disease. Virtual staining of tissue and automation of electron microscopy imaging are emerging applications with particular significance for nephropathology.

SUMMARY

AI applied to image analysis in nephropathology has potential to transform the field by improving diagnostic accuracy and reproducibility, efficiency, and prognostic power. Reimbursement, demonstration of clinical utility, and seamless workflow integration are essential to widespread adoption.

Swarm learning for decentralized artificial intelligence in cancer histopathology

Artificial intelligence (AI) can predict the presence of molecular alterations directly from routine histopathology slides. However, training robust AI systems requires large datasets for which data collection faces practical, ethical and legal obstacles. These obstacles could be overcome with swarm learning (SL), in which partners jointly train AI models while avoiding data transfer and monopolistic data governance. Here, we demonstrate the successful use of SL in large, multicentric datasets of gigapixel histopathology images from over 5,000 patients. We show that AI models trained using SL can predict BRAF mutational status and microsatellite instability directly from hematoxylin and eosin (H&E)-stained pathology slides of colorectal cancer. We trained AI models on three patient cohorts from Northern Ireland, Germany and the United States, and validated the prediction performance in two independent datasets from the United Kingdom. Our data show that SL-trained AI models outperform most locally trained models, and perform on par with models that are trained on the merged datasets. In addition, we show that SL-based AI models are data efficient. In the future, SL can be used to train distributed AI models for any histopathology image analysis task, eliminating the need for data transfer.

A decentralized, privacy-preserving machine learning framework used to train a clinically relevant AI system identifies actionable molecular alterations in patients with colorectal cancer by use of routine histopathology slides collected in real-world settings.

The future of artificial intelligence in digital pathology - results of a survey across stakeholder groups

AIMS

Artificial intelligence (AI) provides a powerful tool to extract information from digitized histopathology whole slide images. In the last five years, academic and commercial actors have developed new technical solutions for a diverse set of tasks, including tissue segmentation, cell detection, mutation prediction, prognostication and prediction of treatment response. In the light of limited overall resources, it is presently unclear for researchers, practitioners and policymakers which of these topics are stable enough for clinical use in the near future and which topics are still experimental, but worth investing time and effort into.

METHODS

To identify potentially promising applications of AI in pathology, we performed an anonymous online survey of 75 computational pathology domain experts from academia and industry. Participants enrolled in 2021 were queried about their subjective opinion on promising and appealing sub-fields of computational pathology with a focus on solid tumors.

RESULTS

The results of this survey indicate that the prediction of treatment response directly from routine pathology slides is regarded as the most promising future application. This item was ranked highest in the overall analysis and in sub-groups by age and professional background. Furthermore, prediction of genetic alterations, gene expression and survival directly from routine pathology images scored consistently high across subgroups.

CONCLUSIONS

Together, these data demonstrate a possible direction for the development of computational pathology systems in clinical, academic and industrial research in the near future.

Artificial intelligence for detection of microsatellite instability in colorectal cancer-a multicentric analysis of a pre-screening tool for clinical application

BACKGROUND

Microsatellite instability (MSI)/mismatch repair deficiency (dMMR) is a key genetic feature which should be tested in every patient with colorectal cancer (CRC) according to medical guidelines. Artificial intelligence (AI) methods can detect MSI/dMMR directly in routine pathology slides, but the test performance has not been systematically investigated with predefined test thresholds.

METHOD

We trained and validated AI-based MSI/dMMR detectors and evaluated predefined performance metrics using nine patient cohorts of 8343 patients across different countries and ethnicities.

RESULTS

Classifiers achieved clinical-grade performance, yielding an area under the receiver operating curve (AUROC) of up to 0.96 without using any manual annotations. Subsequently, we show that the AI system can be applied as a rule-out test: by using cohort-specific thresholds, on average 52.73% of tumors in each surgical cohort [total number of MSI/dMMR = 1020, microsatellite stable (MSS)/ proficient mismatch repair (pMMR) = 7323 patients] could be identified as MSS/pMMR with a fixed sensitivity at 95%. In an additional cohort of N = 1530 (MSI/dMMR = 211, MSS/pMMR = 1319) endoscopy biopsy samples, the system achieved an AUROC of 0.89, and the cohort-specific threshold ruled out 44.12% of tumors with a fixed sensitivity at 95%. As a more robust alternative to cohort-specific thresholds, we showed that with a fixed threshold of 0.25 for all the cohorts, we can rule-out 25.51% in surgical specimens and 6.10% in biopsies.

INTERPRETATION

When applied in a clinical setting, this means that the AI system can rule out MSI/dMMR in a quarter (with global thresholds) or half of all CRC patients (with local fine-tuning), thereby reducing cost and turnaround time for molecular profiling.

Artificial intelligence to identify genetic alterations in conventional histopathology

Precision oncology relies on the identification of targetable molecular alterations in tumor tissues. In many tumor types, a limited set of molecular tests is currently part of standard diagnostic workflows. However, universal testing for all targetable alterations, especially rare ones, is limited by the cost and availability of molecular assays. From 2017 to 2021, multiple studies have shown that artificial intelligence (AI) methods can predict the probability of specific genetic alterations directly from conventional hematoxylin and eosin (H&E) tissue slides. Although these methods are currently less accurate than gold-standard testing (e.g. immunohistochemistry, polymerase chain reaction or next-generation sequencing), they could be used as pre-screening tools to reduce the workload of genetic analyses. In this systematic literature review, we summarize the state of the art in predicting molecular alterations from H&E using AI. We found that AI methods perform reasonably well across multiple tumor types, although few algorithms have been broadly validated. In addition, we found that genetic alterations in FGFR, IDH, PIK3CA, BRAF, TP53 and DNA repair pathways are predictable from H&E in multiple tumor types, while many other genetic alterations have rarely been investigated or were only poorly predictable. Finally, we discuss the next steps for the implementation of AI-based surrogate tests in diagnostic workflows. This article is protected by copyright. All rights reserved.

ANXA2P2: A Potential Immunological and Prognostic Signature in Ovarian Serous Cystadenocarcinoma via Pan-Carcinoma Synthesis

Background

Although the effect of pseudogene ANXA2P2 on some tumors has been reported in a few literatures, the therapeutic potential and prognostic value of ANXA2P2 in ovarian serous cystadenocarcinoma (OV) have not been elucidated.

Methods

The correlation for ANXA2P2 expression patterns to prognostic characteristics, tumor immune microenvironment, immune cell infiltration level, tumor mutation burden (TMB), tumor microsatellite instability (MSI), drug sensitivity, and pathway function enrichment were investigated in pan-carcinoma via TCGA and GTEx databases. Subsequently, the role of ANXA2P2 expression levels in the pathway enrichments and prognosis prediction in OV were further explored using weighted correlation network analysis (WGCNA) analysis, gene mutation analysis, and risk-independent prognostic analysis.

Results

ANXA2P2 was frequently overexpressed in a variety of tumors compared with normal tissues. The correlation analysis for prognostic characteristics, tumor immune microenvironment, immune cell infiltration level, TMB, MSI, drug sensitivity, and pathway function enrichment revealed that ANXA2P2 expression patterns might deal a significant impact on the pathogenesis, development, and prognosis of various tumors. Then, GSVA, GSEA, WGCNA, gene mutation, and independent prognostic analysis for OV have indicated that high expression in ANXA2P2 could be mostly enriched in TNF-α signaling-via-NF-κB, epithelial-mesenchymal transition, apical junction, IL-6-JAK STAT3 signaling, etc., which were also proved to act as crucial factors on tumorigenesis, development, invasion, and metastasis. The mutation of TP53 (94%), TTN (24%), and CSMD3 (9%) in the biological process of tumor had been confirmed by relevant studies. Finally, the independent prognostic analysis demonstrated that ANXA2P2 expression in OV contributes greatly to the dependability of 3- and 5-year survival prediction.

Conclusion

In summary, our findings might provide a helpful foundation for prospective explorative researches, afford new strategies for the clinical treatment, deal prognosis prediction, and give new hope for OV patients.

Predicting Mutational Status of Driver and Suppressor Genes Directly from Histopathology With Deep Learning: A Systematic Study Across 23 Solid Tumor Types

In the last four years, advances in Deep Learning technology have enabled the inference of selected mutational alterations directly from routine histopathology slides. In particular, recent studies have shown that genetic changes in clinically relevant driver genes are reflected in the histological phenotype of solid tumors and can be inferred by analysing routine Haematoxylin and Eosin (H&E) stained tissue sections with Deep Learning. However, these studies mostly focused on selected individual genes in selected tumor types. In addition, genetic changes in solid tumors primarily act by changing signaling pathways that regulate cell behaviour. In this study, we hypothesized that Deep Learning networks can be trained to directly predict alterations of genes and pathways across a spectrum of solid tumors. We manually outlined tumor tissue in H&E-stained tissue sections from 7,829 patients with 23 different tumor types from The Cancer Genome Atlas. We then trained convolutional neural networks in an end-to-end way to detect alterations in the most clinically relevant pathways or genes, directly from histology images. Using this automatic approach, we found that alterations in 12 out of 14 clinically relevant pathways and numerous single gene alterations appear to be detectable in tissue sections, many of which have not been reported before. Interestingly, we show that the prediction performance for single gene alterations is better than that for pathway alterations. Collectively, these data demonstrate the predictability of genetic alterations directly from routine cancer histology images and show that individual genes leave a stronger morphological signature than genetic pathways.

Deep Learning based on hematoxylin-eosin staining outperforms immunohistochemistry in predicting molecular subtypes of gastric adenocarcinoma

In gastric cancer (GC), there are four molecular subclasses that indicate whether patients respond to chemotherapy or immunotherapy, according to the TCGA. In clinical practice, however, not every patient undergoes molecular testing. Many laboratories have used well-implemented in situ techniques (IHC and EBER-ISH) to determine the subclasses in their cohorts. Although multiple stains are used, we show that a staining approach is unable to correctly discriminate all subclasses. As an alternative, we trained an ensemble convolutional neuronal network using bagging that can predict the molecular subclass directly from hematoxylin-eosin histology. We also identified patients with predicted intra-tumoral heterogeneity or with features from multiple subclasses, which challenges the postulated TCGA-based decision tree for GC subtyping. In the future, Deep Learning may enable targeted testing for molecular subtypes and targeted therapy for a broader group of GC patients. This article is protected by copyright. All rights reserved.