Artificial Intelligence-based Detection of FGFR3 Mutational Status Directly from Routine Histology in Bladder Cancer: A Possible Preselection for Molecular Testing?

Artificial intelligence entering the pathology arena in oncology: current applications and future perspectives

BACKGROUND

Artificial intelligence (AI) is rapidly transforming the fields of pathology and oncology, offering novel opportunities for advancing diagnosis, prognosis, and treatment of cancer.

METHODS

Through a systematic review-based approach, the representatives from the European Society for Medical Oncology (ESMO) Precision Oncology Working Group (POWG) and international experts identified studies in pathology and oncology that applied AI-based algorithms for tumour diagnosis, molecular biomarker detection, and cancer prognosis assessment. These findings were synthesised to provide a comprehensive overview of current AI applications and future directions in cancer pathology.

RESULTS

The integration of AI tools in digital pathology is markedly improving the accuracy and efficiency of image analysis, allowing for automated tumour detection and classification, identification of prognostic molecular biomarkers, and prediction of treatment response and patient outcomes. Several barriers for the adoption of AI in clinical workflows, such as data availability, explainability, and regulatory considerations, still persist. There are currently no prognostic or predictive AI-based biomarkers supported by level IA or IB evidence. The ongoing advancements in AI algorithms, particularly foundation models, generalist models and transformer-based deep learning, offer immense promise for the future of cancer research and care. AI is also facilitating the integration of multi-omics data, leading to more precise patient stratification and personalised treatment strategies.

CONCLUSIONS

The application of AI in pathology is poised to not only enhance the accuracy and efficiency of cancer diagnosis and prognosis but also facilitate the development of personalised treatment strategies. Although barriers to implementation remain, ongoing research and development in this field coupled with addressing ethical and regulatory considerations will likely lead to a future where AI plays an integral role in cancer management and precision medicine. The continued evolution and adoption of AI in pathology and oncology are anticipated to reshape the landscape of cancer care, heralding a new era of precision medicine and improved patient outcomes.

Recent Advances in Artificial Intelligence for Precision Diagnosis and Treatment of Bladder Cancer: A Review

BACKGROUND

Bladder cancer is one of the top ten cancers globally, with its incidence steadily rising in China. Early detection and prognosis risk assessment play a crucial role in guiding subsequent treatment decisions for bladder cancer. However, traditional diagnostic methods such as bladder endoscopy, imaging, or pathology examinations heavily rely on the clinical expertise and experience of clinicians, exhibiting subjectivity and poor reproducibility.

MATERIALS AND METHODS

With the rise of artificial intelligence, novel approaches, particularly those employing deep learning technology, have shown significant advancements in clinical tasks related to bladder cancer, including tumor detection, molecular subtyping identification, tumor staging and grading, prognosis prediction, and recurrence assessment.

RESULTS

Artificial intelligence, with its robust data mining capabilities, enhances diagnostic efficiency and reproducibility when assisting clinicians in decision-making, thereby reducing the risks of misdiagnosis and underdiagnosis. This not only helps alleviate the current challenges of talent shortages and uneven distribution of medical resources but also fosters the development of precision medicine.

CONCLUSIONS

This study provides a comprehensive review of the latest research advances and prospects of artificial intelligence technology in the precise diagnosis and treatment of bladder cancer.

Predicting response to neoadjuvant chemotherapy in muscle-invasive bladder cancer via interpretable multimodal deep learning

Building accurate prediction models and identifying predictive biomarkers for treatment response in Muscle-Invasive Bladder Cancer (MIBC) are essential for improving patient survival but remain challenging due to tumor heterogeneity, despite numerous related studies. To address this unmet need, we developed an interpretable Graph-based Multimodal Late Fusion (GMLF) deep learning framework. Integrating histopathology and cell type data from standard H&E images with gene expression profiles derived from RNA sequencing from the SWOG S1314-COXEN clinical trial (ClinicalTrials.gov NCT02177695 2014-06-25), GMLF uncovered new histopathological, cellular, and molecular determinants of response to neoadjuvant chemotherapy. Specifically, we identified key gene signatures that drive the predictive power of our model, including alterations in TP63, CCL5, and DCN. Our discovery can optimize treatment strategies for patients with MIBC, e.g., improving clinical outcomes, avoiding unnecessary treatment, and ultimately, bladder preservation. Additionally, our approach could be used to uncover predictors for other cancers.

AI in Histopathology Explorer for comprehensive analysis of the evolving AI landscape in histopathology

Digital pathology and artificial intelligence (AI) hold immense transformative potential to revolutionize cancer diagnostics, treatment outcomes, and biomarker discovery. Gaining a deeper understanding of deep learning algorithm methods applied to histopathological data and evaluating their performance on different tasks is crucial for developing the next generation of AI technologies. To this end, we developed AI in Histopathology Explorer (HistoPathExplorer); an interactive dashboard with intelligent tools available at www.histopathexpo.ai . This real-time online resource enables users, including researchers, decision-makers, and various stakeholders, to assess the current landscape of AI applications for specific clinical tasks, analyze their performance, and explore the factors influencing their translation into practice. Moreover, a quality index was defined for evaluating the comprehensiveness of methodological details in published AI methods. HistoPathExplorer highlights opportunities and challenges for AI in histopathology, and offers a valuable resource for creating more effective methods and shaping strategies and guidelines for translating digital pathology applications into clinical practice.

Pathology-based deep learning features for predicting basal and luminal subtypes in bladder cancer

BACKGROUND

Bladder cancer (BLCA) exists a profound molecular diversity, with basal and luminal subtypes having different prognostic and therapeutic outcomes. Traditional methods for molecular subtyping are often time-consuming and resource-intensive. This study aims to develop machine learning models using deep learning features from hematoxylin and eosin (H&E)-stained whole-slide images (WSIs) to predict basal and luminal subtypes in BLCA.

METHODS

RNA sequencing data and clinical outcomes were downloaded from seven public BLCA databases, including TCGA, GEO datasets, and the IMvigor210C cohort, to assess the prognostic value of BLCA molecular subtypes. WSIs from TCGA were used to construct and validate the machine learning models, while WSIs from Shanghai Tenth People's Hospital (STPH) and The Affiliated Guangdong Second Provincial General Hospital of Jinan University (GD2H) were used as external validations. Deep learning models were trained to obtained tumor patches within WSIs. WSI level deep learning features were extracted from tumor patches based on the RetCCL model. Support vector machine (SVM), random forest (RF), and logistic regression (LR) were developed using these features to classify basal and luminal subtypes.

RESULTS

Kaplan-Meier survival and prognostic meta-analyses showed that basal BLCA patients had significantly worse overall survival compared to luminal BLCA patients (hazard ratio = 1.47, 95% confidence interval: 1.25-1.73, P < 0.001). The LR model based on tumor patch features selected by Resnet50 model demonstrated superior performance, achieving an area under the curve (AUC) of 0.88 in the internal validation set, and 0.81 and 0.64 in the external validation sets from STPH and GD2H, respectively. This model outperformed both junior and senior pathologists in the differentiation of basal and luminal subtypes (AUC: 0.85, accuracy: 74%, sensitivity: 66%, specificity: 82%).

CONCLUSIONS

This study showed the efficacy of machine learning models in predicting the basal and luminal subtypes of BLCA based on the extraction of deep learning features from tumor patches in H&E-stained WSIs. The performance of the LR model suggests that the integration of AI tools into the diagnostic process could significantly enhance the accuracy of molecular subtyping, thereby potentially informing personalized treatment strategies for BLCA patients.

Digital and Computational Pathology Applications in Bladder Cancer: Novel Tools Addressing Clinically Pressing Needs

Bladder cancer (BC) remains a major disease burden in terms of incidence, morbidity, mortality, and economic cost. Deciphering the intrinsic molecular subtypes and identification of key drivers of BC has yielded successful novel therapeutic strategies. Advances in computational and digital pathology are reshaping the field of anatomical pathology. This review offers an update on the most relevant computational algorithms in digital pathology that have been proposed to enhance BC management. These tools promise to enhance diagnostics, staging, and grading accuracy and streamline efficiency while advancing practice consistency. Computational applications that enable intrinsic molecular classification, predict response to neoadjuvant therapy, and identify targets of therapy are also reviewed.

AI allows pre-screening of FGFR3 mutational status using routine histology slides of muscle-invasive bladder cancer

Pathogenic activating mutations in the fibroblast growth factor receptor 3 (FGFR3) drive disease maintenance and progression in urothelial cancer. 10-15% of muscle-invasive and metastatic urothelial cancer (MIBC/mUC) are FGFR3-mutant. Selective targeting of FGFR3 hotspot mutations with tyrosine kinase inhibitors (e.g., erdafitinib) is approved for mUC and requires FGFR3 mutational testing. However, current testing assays (polymerase chain reaction or next-generation sequencing) necessitate high tissue quality, have long turnover time, and are expensive. To overcome these limitations, we develop a deep-learning model that detects FGFR3 mutations using routine hematoxylin-eosin slides. Encompassing 1222 cases, our study is a large-scale validation of a model prescreening FGFR3 mutations for MIBC and mUC patients. In this work, we demonstrate that our model achieves high sensitivity (>93%) on advanced and metastatic cases while reducing molecular testing by 40% on average, thereby offering a cost-effective and rapid pre-screening tool for identifying patients eligible for FGFR3 targeted therapies.

Impact of consensus molecular subtypes on survival with and without adjuvant chemotherapy in muscle-invasive urothelial bladder cancer

AIMS

Adjuvant chemotherapy after radical cystectomy can reduce the risk of recurrence and death in advanced muscle-invasive urothelial bladder cancer (MIBC). Molecular subtypes have been shown to be associated with survival. However, their predictive value to guide treatment decisions is controversial and data to use subtypes as guidance for adjuvant chemotherapy is sparse. We aimed to assess survival rates based on MIBC consensus molecular subtypes with and without adjuvant chemotherapy.

METHODS

Gene expression profiles of 143 patients with MIBC undergoing radical cystectomy were determined from formalin-fixed, paraffin-embedded specimen to assign consensus molecular subtypes. Expression of programmed cell death ligand-1 (PD-L1) and immune cell infiltration were determined using multiplex immunofluorescence. Matched-pair analysis was performed to evaluate the effect of adjuvant chemotherapy on overall survival (OS) for molecular subtypes applying Kaplan-Meier and Cox regression survival analyses.

RESULTS

Samples were luminal papillary: 9.1% (n=13), luminal non-specified: 6.3% (n=9), luminal unstable: 4.9% (n=7), stroma-rich: 27.9% (n=40), basal/squamous (Ba/Sq): 48.9% (n=70) and neuroendocrine-like (NE-like): 2.8% (n=4). Ba/Sq tumours had the highest concentration of PD-L1+ tumour and immune cells. Patients with luminal subtypes had better OS than those with NE-like (HR 0.2, 95% CI 0.1 to 0.7, p<0.05) and Ba/Sq (HR 0.5, 95% CI 0.2 to 0.9, p<0.05). No survival benefit with adjuvant chemotherapy was observed for luminal tumours, whereas Ba/Sq had significantly improved survival rates with adjuvant chemotherapy. Retrospective design and sample size are the main limitations.

CONCLUSION

Consensus molecular subtypes can be used to stratify patients with MIBC. Luminal tumours have the best prognosis and less benefit when receiving adjuvant chemotherapy compared with Ba/Sq tumours.

Artificial intelligence application in the diagnosis and treatment of bladder cancer: advance, challenges, and opportunities

Bladder cancer (BC) is a serious and common malignant tumor of the urinary system. Accurate and convenient diagnosis and treatment of BC is a major challenge for the medical community. Due to the limited medical resources, the existing diagnosis and treatment protocols for BC without the assistance of artificial intelligence (AI) still have certain shortcomings. In recent years, with the development of AI technologies such as deep learning and machine learning, the maturity of AI has made it more and more applied to the medical field, including improving the speed and accuracy of BC diagnosis and providing more powerful treatment options and recommendations related to prognosis. Advances in medical imaging technology and molecular-level research have also contributed to the further development of such AI applications. However, due to differences in the sources of training information and algorithm design issues, there is still room for improvement in terms of accuracy and transparency for the broader use of AI in clinical practice. With the popularization of digitization of clinical information and the proposal of new algorithms, artificial intelligence is expected to learn more effectively and analyze similar cases more accurately and reliably, promoting the development of precision medicine, reducing resource consumption, and speeding up diagnosis and treatment. This review focuses on the application of artificial intelligence in the diagnosis and treatment of BC, points out some of the challenges it faces, and looks forward to its future development.

Prediction of homologous recombination deficiency from routine histology with attention-based multiple instance learning in nine different tumor types

BACKGROUND

Homologous recombination deficiency (HRD) is recognized as a pan-cancer predictive biomarker that potentially indicates who could benefit from treatment with PARP inhibitors (PARPi). Despite its clinical significance, HRD testing is highly complex. Here, we investigated in a proof-of-concept study whether Deep Learning (DL) can predict HRD status solely based on routine hematoxylin & eosin (H&E) histology images across nine different cancer types.

METHODS

We developed a deep learning pipeline with attention-weighted multiple instance learning (attMIL) to predict HRD status from histology images. As part of our approach, we calculated a genomic scar HRD score by combining loss of heterozygosity (LOH), telomeric allelic imbalance (TAI), and large-scale state transitions (LST) from whole genome sequencing (WGS) data of n = 5209 patients across two independent cohorts. The model's effectiveness was evaluated using the area under the receiver operating characteristic curve (AUROC), focusing on its accuracy in predicting genomic HRD against a clinically recognized cutoff value.

RESULTS

Our study demonstrated the predictability of genomic HRD status in endometrial, pancreatic, and lung cancers reaching cross-validated AUROCs of 0.79, 0.58, and 0.66, respectively. These predictions generalized well to an external cohort, with AUROCs of 0.93, 0.81, and 0.73. Moreover, a breast cancer-trained image-based HRD classifier yielded an AUROC of 0.78 in the internal validation cohort and was able to predict HRD in endometrial, prostate, and pancreatic cancer with AUROCs of 0.87, 0.84, and 0.67, indicating that a shared HRD-like phenotype occurs across these tumor entities.

CONCLUSIONS

This study establishes that HRD can be directly predicted from H&E slides using attMIL, demonstrating its applicability across nine different tumor types.

Single-cell and spatial omics unravel the spatiotemporal biology of tumour border invasion and haematogenous metastasis

Solid tumours exhibit a well-defined architecture, comprising a differentiated core and a dynamic border that interfaces with the surrounding tissue. This border, characterised by distinct cellular morphology and molecular composition, serves as a critical determinant of the tumour's invasive behaviour. Notably, the invasive border of the primary tumour represents the principal site for intravasation of metastatic cells. These cells, known as circulating tumour cells (CTCs), function as 'seeds' for distant dissemination and display remarkable heterogeneity. Advancements in spatial sequencing technology are progressively unveiling the spatial biological features of tumours. However, systematic investigations specifically targeting the characteristics of the tumour border remain scarce. In this comprehensive review, we illuminate key biological insights along the tumour body-border-haematogenous metastasis axis over the past five years. We delineate the distinctive landscape of tumour invasion boundaries and delve into the intricate heterogeneity and phenotype of CTCs, which orchestrate haematogenous metastasis. These insights have the potential to explain the basis of tumour invasion and distant metastasis, offering new perspectives for the development of more complex and precise clinical interventions and treatments.

AI-driven Discovery of Morphomolecular Signatures in Toxicology

Early identification of drug toxicity is essential yet challenging in drug development. At the preclinical stage, toxicity is assessed with histopathological examination of tissue sections from animal models to detect morphological lesions. To complement this analysis, toxicogenomics is increasingly employed to understand the mechanism of action of the compound and ultimately identify lesion-specific safety biomarkers for which in vitro assays can be designed. However, existing works that aim to identify morphological correlates of expression changes rely on qualitative or semi-quantitative morphological characterization and remain limited in scale or morphological diversity. Artificial intelligence (AI) offers a promising approach for quantitatively modeling this relationship at an unprecedented scale. Here, we introduce GEESE, an AI model designed to impute morphomolecular signatures in toxicology data. Our model was trained to predict 1,536 gene targets on a cohort of 8,231 hematoxylin and eosin-stained liver sections from Rattus norvegicus across 127 preclinical toxicity studies. The model, evaluated on 2,002 tissue sections from 29 held-out studies, can yield pseudo-spatially resolved gene expression maps, which we correlate with six key drug-induced liver injuries (DILI). From the resulting 25 million lesion-expression pairs, we established quantitative relations between up and downregulated genes and lesions. Validation of these signatures against toxicogenomic databases, pathway enrichment analyses, and human hepatocyte cell lines asserted their relevance. Overall, our study introduces new methods for characterizing toxicity at an unprecedented scale and granularity, paving the way for AI-driven discovery of toxicity biomarkers.

Prediction of HER2 Status Based on Deep Learning in H&E-Stained Histopathology Images of Bladder Cancer

Epidermal growth factor receptor 2 (HER2) has been widely recognized as one of the targets for bladder cancer immunotherapy. The key to implementing personalized treatment for bladder cancer patients lies in achieving rapid and accurate diagnosis. To tackle this challenge, we have pioneered the application of deep learning techniques to predict HER2 expression status from H&E-stained pathological images of bladder cancer, bypassing the need for intricate IHC staining or high-throughput sequencing methods. Our model, when subjected to rigorous testing within the cohort from the People's Hospital of Wuhan University, which encompasses 106 cases, has exhibited commendable performance on both the validation and test datasets. Specifically, the validation set yielded an AUC of 0.92, an accuracy of 0.86, a sensitivity of 0.87, a specificity of 0.83, and an F1 score of 86.7%. The corresponding metrics for the test set were 0.88 for AUC, 0.67 for accuracy, 0.56 for sensitivity, 0.75 for specificity, and 77.8% for F1 score. Additionally, in a direct comparison with pathologists, our model demonstrated statistically superior performance, with a p-value less than 0.05, highlighting its potential as a powerful diagnostic tool.

Deep neural network for the prediction of KRAS, NRAS, and BRAF genotypes in left-sided colorectal cancer based on histopathologic images

BACKGROUND

The KRAS, NRAS, and BRAF genotypes are critical for selecting targeted therapies for patients with metastatic colorectal cancer (mCRC). Here, we aimed to develop a deep learning model that utilizes pathologic whole-slide images (WSIs) to accurately predict the status of KRAS, NRAS, and BRAFV600E.

METHODS

129 patients with left-sided colon cancer and rectal cancer from the Third Affiliated Hospital of Sun Yat-sen University were assigned to the training and testing cohorts. Utilizing three convolutional neural networks (ResNet18, ResNet50, and Inception v3), we extracted 206 pathological features from H&E-stained WSIs, serving as the foundation for constructing specific pathological models. A clinical feature model was then developed, with carcinoembryonic antigen (CEA) identified through comprehensive multiple regression analysis as the key biomarker. Subsequently, these two models were combined to create a clinical-pathological integrated model, resulting in a total of three genetic prediction models.

RESULT

103 patients were evaluated in the training cohort (1782,302 image tiles), while the remaining 26 patients were enrolled in the testing cohort (489,481 image tiles). Compared with the clinical model and the pathology model, the combined model which incorporated CEA levels and pathological signatures, showed increased predictive ability, with an area under the curve (AUC) of 0.96 in the training and an AUC of 0.83 in the testing cohort, accompanied by a high positive predictive value (PPV 0.92).

CONCLUSION

The combined model demonstrated a considerable ability to accurately predict the status of KRAS, NRAS, and BRAFV600E in patients with left-sided colorectal cancer, with potential application to assist doctors in developing targeted treatment strategies for mCRC patients, and effectively identifying mutations and eliminating the need for confirmatory genetic testing.

Applications of artificial intelligence in urologic oncology

PURPOSE

With the recent rising interest in artificial intelligence (AI) in medicine, many studies have explored the potential and usefulness of AI in urological diseases. This study aimed to comprehensively review recent applications of AI in urologic oncology.

MATERIALS AND METHODS

We searched the PubMed-MEDLINE databases for articles in English on machine learning (ML) and deep learning (DL) models related to general surgery and prostate, bladder, and kidney cancer. The search terms were a combination of keywords, including both "urology" and "artificial intelligence" with one of the following: "machine learning," "deep learning," "neural network," "renal cell carcinoma," "kidney cancer," "urothelial carcinoma," "bladder cancer," "prostate cancer," and "robotic surgery."

RESULTS

A total of 58 articles were included. The studies on prostate cancer were related to grade prediction, improved diagnosis, and predicting outcomes and recurrence. The studies on bladder cancer mainly used radiomics to identify aggressive tumors and predict treatment outcomes, recurrence, and survival rates. Most studies on the application of ML and DL in kidney cancer were focused on the differentiation of benign and malignant tumors as well as prediction of their grade and subtype. Most studies suggested that methods using AI may be better than or similar to existing traditional methods.

CONCLUSIONS

AI technology is actively being investigated in the field of urological cancers as a tool for diagnosis, prediction of prognosis, and decision-making and is expected to be applied in additional clinical areas soon. Despite technological, legal, and ethical concerns, AI will change the landscape of urological cancer management.

Bioinformatics in urology - molecular characterization of pathophysiology and response to treatment

The application of bioinformatics has revolutionized the practice of medicine in the past 20 years. From early studies that uncovered subtypes of cancer to broad efforts spearheaded by the Cancer Genome Atlas initiative, the use of bioinformatics strategies to analyse high-dimensional data has provided unprecedented insights into the molecular basis of disease. In addition to the identification of disease subtypes - which enables risk stratification - informatics analysis has facilitated the identification of novel risk factors and drivers of disease, biomarkers of progression and treatment response, as well as possibilities for drug repurposing or repositioning; moreover, bioinformatics has guided research towards precision and personalized medicine. Implementation of specific computational approaches such as artificial intelligence, machine learning and molecular subtyping has yet to become widespread in urology clinical practice for reasons of cost, disruption of clinical workflow and need for prospective validation of informatics approaches in independent patient cohorts. Solving these challenges might accelerate routine integration of bioinformatics into clinical settings.

FGFR-targeted therapeutics: clinical activity, mechanisms of resistance and new directions

Fibroblast growth factor (FGF) signalling via FGF receptors (FGFR1-4) orchestrates fetal development and contributes to tissue and whole-body homeostasis, but can also promote tumorigenesis. Various agents, including pan-FGFR inhibitors (erdafitinib and futibatinib), FGFR1/2/3 inhibitors (infigratinib and pemigatinib), as well as a range of more-specific agents, have been developed and several have entered clinical use. Erdafitinib is approved for patients with urothelial carcinoma harbouring FGFR2/3 alterations, and futibatinib and pemigatinib are approved for patients with cholangiocarcinoma harbouring FGFR2 fusions and/or rearrangements. Clinical benefit from these agents is in part limited by hyperphosphataemia owing to off-target inhibition of FGFR1 as well as the emergence of resistance mutations in FGFR genes, activation of bypass signalling pathways, concurrent TP53 alterations and possibly epithelial-mesenchymal transition-related isoform switching. The next generation of small-molecule inhibitors, such as lirafugratinib and LOXO-435, and the FGFR2-specific antibody bemarituzumab are expected to have a reduced risk of hyperphosphataemia and the ability to overcome certain resistance mutations. In this Review, we describe the development and current clinical role of FGFR inhibitors and provide perspective on future research directions including expansion of the therapeutic indications for use of FGFR inhibitors, combination of these agents with immune-checkpoint inhibitors and the application of novel technologies, such as artificial intelligence.

[Histomolecular classification of urothelial carcinoma of the urinary bladder : From histological phenotype to genotype and back]

BACKGROUND

Of all urothelial carcinomas (UCs), 25% are muscle invasive and associated with a 5-year overall survival rate of 50%. Findings regarding the molecular classification of muscle-invasive urothelial carcinomas (MIUCs) have not yet found their way into clinical practice.

OBJECTIVES

Prediction of molecular consensus subtypes in MIUCs with artificial intelligence (AI) based on histologic hematoxylin-eosin (HE) sections.

METHODS

Pathologic review and annotation of The Cancer Genome Atlas (TCGA) Bladder Cancer (BLCA) Cohort (N = 412) and the Dr. Senckenberg Institute of Pathology (SIP) BLCA Cohort (N = 181). An AI model for the prediction of molecular subtypes based on annotated histomorphology was trained.

RESULTS

For a five-fold cross-validation with TCGA cases (N = 274), an internal TCGA test set (N = 18) and an external SIP test set (N = 27), we reached mean area under the receiver operating characteristic curve (AUROC) scores of 0.73, 0.8 and 0.75 for the classification of the used molecular subtypes "luminal", "basal/squamous" and "stroma-rich". By training on correlations to individual molecular subtypes, rather than training on one subtype assignment per case, the AI prediction of subtypes could be significantly improved.

DISCUSSION

Follow-up studies with RNA extraction from various areas of AI-predicted molecular heterogeneity may improve molecular classifications and thereby AI algorithms trained on these classifications.

Encrypted federated learning for secure decentralized collaboration in cancer image analysis

Artificial intelligence (AI) has a multitude of applications in cancer research and oncology. However, the training of AI systems is impeded by the limited availability of large datasets due to data protection requirements and other regulatory obstacles. Federated and swarm learning represent possible solutions to this problem by collaboratively training AI models while avoiding data transfer. However, in these decentralized methods, weight updates are still transferred to the aggregation server for merging the models. This leaves the possibility for a breach of data privacy, for example by model inversion or membership inference attacks by untrusted servers. Somewhat-homomorphically-encrypted federated learning (SHEFL) is a solution to this problem because only encrypted weights are transferred, and model updates are performed in the encrypted space. Here, we demonstrate the first successful implementation of SHEFL in a range of clinically relevant tasks in cancer image analysis on multicentric datasets in radiology and histopathology. We show that SHEFL enables the training of AI models which outperform locally trained models and perform on par with models which are centrally trained. In the future, SHEFL can enable multiple institutions to co-train AI models without forsaking data governance and without ever transmitting any decryptable data to untrusted servers.

Artificial Intelligence Reveals Distinct Prognostic Subgroups of Muscle-Invasive Bladder Cancer on Histology Images

Muscle-invasive bladder cancer (MIBC) is a highly heterogeneous and costly disease with significant morbidity and mortality. Understanding tumor histopathology leads to tailored therapies and improved outcomes. In this study, we employed a weakly supervised learning and neural architecture search to develop a data-driven scoring system. This system aimed to capture prognostic histopathological patterns observed in H&E-stained whole-slide images. We constructed and externally validated our scoring system using multi-institutional datasets with 653 whole-slide images. Additionally, we explored the association between our scoring system, seven histopathological features, and 126 molecular signatures. Through our analysis, we identified two distinct risk groups with varying prognoses, reflecting inherent differences in histopathological and molecular subtypes. The adjusted hazard ratio for overall mortality was 1.46 (95% CI 1.05-2.02; z: 2.23; p = 0.03), thus identifying two prognostic subgroups in high-grade MIBC. Furthermore, we observed an association between our novel digital biomarker and the squamous phenotype, subtypes of miRNA, mRNA, long non-coding RNA, DNA hypomethylation, and several gene mutations, including FGFR3 in MIBC. Our findings underscore the risk of confounding bias when reducing the complex biological and clinical behavior of tumors to a single mutation. Histopathological changes can only be fully captured through comprehensive multi-omics profiles. The introduction of our scoring system has the potential to enhance daily clinical decision making for MIBC. It facilitates shared decision making by offering comprehensive and precise risk stratification, treatment planning, and cost-effective preselection for expensive molecular characterization.

HAVOC: Small-scale histomic mapping of cancer biodiversity across large tissue distances using deep neural networks

Intratumoral heterogeneity can wreak havoc on current precision medicine strategies because of challenges in sufficient sampling of geographically separated areas of biodiversity distributed across centimeter-scale tumor distances. To address this gap, we developed a deep learning pipeline that leverages histomorphologic fingerprints of tissue to create "Histomic Atlases of Variation Of Cancers" (HAVOC). Using a number of objective molecular readouts, we demonstrate that HAVOC can define regional cancer boundaries with distinct biology. Using larger tumor specimens, we show that HAVOC can map biodiversity even across multiple tissue sections. By guiding profiling of 19 partitions across six high-grade gliomas, HAVOC revealed that distinct differentiation states can often coexist and be regionally distributed within these tumors. Last, to highlight generalizability, we benchmark HAVOC on additional tumor types. Together, we establish HAVOC as a versatile tool to generate small-scale maps of tissue heterogeneity and guide regional deployment of molecular resources to relevant biodiverse niches.

Artificial Intelligence in Digital Pathology for Bladder Cancer: Hype or Hope? A Systematic Review

Bladder cancer (BC) diagnosis and prediction of prognosis are hindered by subjective pathological evaluation, which may cause misdiagnosis and under-/over-treatment. Computational pathology (CPATH) can identify clinical outcome predictors, offering an objective approach to improve prognosis. However, a systematic review of CPATH in BC literature is lacking. Therefore, we present a comprehensive overview of studies that used CPATH in BC, analyzing 33 out of 2285 identified studies. Most studies analyzed regions of interest to distinguish normal versus tumor tissue and identify tumor grade/stage and tissue types (e.g., urothelium, stroma, and muscle). The cell's nuclear area, shape irregularity, and roundness were the most promising markers to predict recurrence and survival based on selected regions of interest, with >80% accuracy. CPATH identified molecular subtypes by detecting features, e.g., papillary structures, hyperchromatic, and pleomorphic nuclei. Combining clinicopathological and image-derived features improved recurrence and survival prediction. However, due to the lack of outcome interpretability and independent test datasets, robustness and clinical applicability could not be ensured. The current literature demonstrates that CPATH holds the potential to improve BC diagnosis and prediction of prognosis. However, more robust, interpretable, accurate models and larger datasets-representative of clinical scenarios-are needed to address artificial intelligence's reliability, robustness, and black box challenge.

Standardizing analysis of intra-tumoral heterogeneity with computational pathology

Many malignant cancers like glioblastoma are highly adaptive diseases that dynamically change their regional biology to survive and thrive under diverse microenvironmental and therapeutic pressures. While the concept of intra-tumoral heterogeneity has become a major paradigm in cancer research and care, systematic approaches to assess and document bio-variation in cancer are still in their infancy. Here we discuss existing approaches and challenges to documenting intra-tumoral heterogeneity and emerging computational approaches that leverage artificial intelligence to begin to overcome these limitations. We propose how these emerging techniques can be coupled with a diversity of molecular tools to address intra-tumoral heterogeneity more systematically in research and in practice, especially across larger specimens and longitudinal analyses. Systematic documentation and characterization of heterogeneity across entire tumor specimens and their longitudinal evolution has the potential to improve our understanding and treatment of cancer.

Molecular classification of urothelial bladder carcinoma

Urothelial bladder carcinoma (UC) ranks among the top ten most commonly diagnosed cancers worldwide on an annual basis. The standardized classification system for urothelial bladder tumors is the Tumor, Node, Metastasis classification, which reflects differences between non-muscle-invasive bladder carcinoma (NMIBC) and muscle-invasive bladder carcinoma (MIBC) and it depends on the extent to which tumor has infiltrated the bladder wall and other tissues and organs. NMIBC and MIBC exhibit great intrinsic heterogeneity regarding different prognoses, survival, progression, and treatment outcomes. In recent years, studies based on mRNA expression profiling revealed the existence of biologically relevant molecular subtypes of UC, which show variant molecular features that can provide more precise stratification of UC patients. Here, we present a complex classification of UC based on mRNA expression studies and molecular subtypes of NMIBC and MIBC in detail with regard to different mRNA expression profiles, mutational signatures, and infiltration by non-tumor cells. The possible impact of molecular subtyping on treatment decisions and patients' outcomes is outlined, too.

Recent application of artificial intelligence on histopathologic image-based prediction of gene mutation in solid cancers

PURPOSE

Evaluation of genetic mutations in cancers is important because distinct mutational profiles help determine individualized drug therapy. However, molecular analyses are not routinely performed in all cancers because they are expensive, time-consuming and not universally available. Artificial intelligence (AI) has shown the potential to determine a wide range of genetic mutations on histologic image analysis. Here, we assessed the status of mutation prediction AI models on histologic images by a systematic review.

METHODS

A literature search using the MEDLINE, Embase and Cochrane databases was conducted in August 2021. The articles were shortlisted by titles and abstracts. After a full-text review, publication trends, study characteristic analysis and comparison of performance metrics were performed.

RESULTS

Twenty-four studies were found mostly from developed countries, and their number is increasing. The major targets were gastrointestinal, genitourinary, gynecological, lung and head and neck cancers. Most studies used the Cancer Genome Atlas, with a few using an in-house dataset. The area under the curve of some of the cancer driver gene mutations in particular organs was satisfactory, such as 0.92 of BRAF in thyroid cancers and 0.79 of EGFR in lung cancers, whereas the average of all gene mutations was 0.64, which is still suboptimal.

CONCLUSION

AI has the potential to predict gene mutations on histologic images with appropriate caution. Further validation with larger datasets is still required before AI models can be used in clinical practice to predict gene mutations.

Preliminary evaluation of deep learning for first-line diagnostic prediction of tumor mutational status

The detection of tumour gene mutations by DNA or RNA sequencing is crucial for the prescription of effective targeted therapies. Recent developments showed promising results for tumoral mutational status prediction using new deep learning based methods on histopathological images. However, it is still unknown whether these methods can be useful aside from sequencing methods for efficient population diagnosis. In this retrospective study, we use a standard prediction pipeline based on a convolutional neural network for the detection of cancer driver genomic alterations in The Cancer Genome Atlas (TCGA) breast (BRCA, n = 719), lung (LUAD, n = 541) and colon (COAD, n = 459) cancer datasets. We propose 3 diagnostic strategies using deep learning methods as first-line diagnostic tools. Focusing on cancer driver genes such as KRAS, EGFR or TP53, we show that these methods help reduce DNA sequencing by up to 49.9% with a high sensitivity (95%). In a context of limited resources, these methods increase sensitivity up to 69.8% at a 30% capacity of DNA sequencing tests, up to 85.1% at a 50% capacity, and up to 91.8% at a 70% capacity. These methods can also be used to prioritize patients with a positive predictive value up to 90.6% in the 10% patient most at risk of being mutated. Limitations of this study include the lack of external validation on non-TCGA data, dependence on prevalence of mutations in datasets, and use of a standard DL method on a limited dataset. Future studies using state-of-the-art methods and larger datasets are needed for better evaluation and clinical implementation.

Deep-learning model AIBISI predicts bacterial infection across cancer types based on pathological images

Microorganisms play an important role in many physiological functions. Many studies have found that bacteria also regulate cancer susceptibility and tumor progression by affecting some metabolic or immune system signaling pathways. However, current bacterial detection methods are inaccurate or inefficient. Thus, we constructed a deep neural network (AIBISI) based on hematoxylin and eosin (H&E)-stained pathology slides to predict and visualize bacterial infection. Our model performance achieved as high as 0.81 of AUC (area under the ROC curve) within cancer type. We also built a pan-cancer model to predict bacterial infection across cancer types. To facilitate clinical usage, AIBISI visualized image areas affected by possible infection. Importantly, we successfully validated our model (AUC = 0.755) in pathological images from an independent patient cohort of stomach cancer (n = 32). To our best knowledge, this is the first artificial intelligence (AI)-based model to investigate bacterial infection in pathology images and has the potential to enable fast clinical decision related to pathogens in tumors.

Self-supervised attention-based deep learning for pan-cancer mutation prediction from histopathology

The histopathological phenotype of tumors reflects the underlying genetic makeup. Deep learning can predict genetic alterations from pathology slides, but it is unclear how well these predictions generalize to external datasets. We performed a systematic study on Deep-Learning-based prediction of genetic alterations from histology, using two large datasets of multiple tumor types. We show that an analysis pipeline that integrates self-supervised feature extraction and attention-based multiple instance learning achieves a robust predictability and generalizability.

Direct prediction of Homologous Recombination Deficiency from routine histology in ten different tumor types with attention-based Multiple Instance Learning: a development and validation study

Background

Homologous Recombination Deficiency (HRD) is a pan-cancer predictive biomarker that identifies patients who benefit from therapy with PARP inhibitors (PARPi). However, testing for HRD is highly complex. Here, we investigated whether Deep Learning can predict HRD status solely based on routine Hematoxylin & Eosin (H&E) histology images in ten cancer types.

Methods

We developed a fully automated deep learning pipeline with attention-weighted multiple instance learning (attMIL) to predict HRD status from histology images. A combined genomic scar HRD score, which integrated loss of heterozygosity (LOH), telomeric allelic imbalance (TAI) and large-scale state transitions (LST) was calculated from whole genome sequencing data for n=4,565 patients from two independent cohorts. The primary statistical endpoint was the Area Under the Receiver Operating Characteristic curve (AUROC) for the prediction of genomic scar HRD with a clinically used cutoff value.

Results

We found that HRD status is predictable in tumors of the endometrium, pancreas and lung, reaching cross-validated AUROCs of 0.79, 0.58 and 0.66. Predictions generalized well to an external cohort with AUROCs of 0.93, 0.81 and 0.73 respectively. Additionally, an HRD classifier trained on breast cancer yielded an AUROC of 0.78 in internal validation and was able to predict HRD in endometrial, prostate and pancreatic cancer with AUROCs of 0.87, 0.84 and 0.67 indicating a shared HRD-like phenotype is across tumor entities.

Conclusion

In this study, we show that HRD is directly predictable from H&E slides using attMIL within and across ten different tumor types.

Spatial biology of cancer evolution

The natural history of cancers can be understood through the lens of evolution given that the driving forces of cancer development are mutation and selection of fitter clones. Cancer growth and progression are spatial processes that involve the breakdown of normal tissue organization, invasion and metastasis. For these reasons, spatial patterns are an integral part of histological tumour grading and staging as they measure the progression from normal to malignant disease. Furthermore, tumour cells are part of an ecosystem of tumour cells and their surrounding tumour microenvironment. A range of new spatial genomic, transcriptomic and proteomic technologies offers new avenues for the study of cancer evolution with great molecular and spatial detail. These methods enable precise characterizations of the tumour microenvironment, cellular interactions therein and micro-anatomical structures. In conjunction with spatial genomics, it emerges that tumours and microenvironments co-evolve, which helps explain observable patterns of heterogeneity and offers new routes for therapeutic interventions.

Deep Learning-Based Prediction of Molecular Tumor Biomarkers from H&E: A Practical Review

Molecular and genomic properties are critical in selecting cancer treatments to target individual tumors, particularly for immunotherapy. However, the methods to assess such properties are expensive, time-consuming, and often not routinely performed. Applying machine learning to H&E images can provide a more cost-effective screening method. Dozens of studies over the last few years have demonstrated that a variety of molecular biomarkers can be predicted from H&E alone using the advancements of deep learning: molecular alterations, genomic subtypes, protein biomarkers, and even the presence of viruses. This article reviews the diverse applications across cancer types and the methodology to train and validate these models on whole slide images. From bottom-up to pathologist-driven to hybrid approaches, the leading trends include a variety of weakly supervised deep learning-based approaches, as well as mechanisms for training strongly supervised models in select situations. While results of these algorithms look promising, some challenges still persist, including small training sets, rigorous validation, and model explainability. Biomarker prediction models may yield a screening method to determine when to run molecular tests or an alternative when molecular tests are not possible. They also create new opportunities in quantifying intratumoral heterogeneity and predicting patient outcomes.

Dynamic Changes in the Extracellular Matrix in Primary, Metastatic, and Recurrent Ovarian Cancers

Cancer-associated fibroblasts (CAFs) and their extracellular matrix are active participants in cancer progression. While it is known that functionally different subpopulations of CAFs co-exist in ovarian cancer, it is unclear whether certain CAF subsets are enriched during metastatic progression and/or chemotherapy. Using computational image analyses of patient-matched primary high-grade serous ovarian carcinomas, synchronous pre-chemotherapy metastases, and metachronous post-chemotherapy metastases from 42 patients, we documented the dynamic spatiotemporal changes in the extracellular matrix, fibroblasts, epithelial cells, immune cells, and CAF subsets expressing different extracellular matrix components. Among the different CAF subsets, COL11A1+ CAFs were associated with linearized collagen fibers and exhibited the greatest enrichment in pre- and post-chemotherapy metastases compared to matched primary tumors. Although pre- and post-chemotherapy metastases were associated with increased CD8+ T cell infiltration, the infiltrate was not always evenly distributed between the stroma and cancer cells, leading to an increased frequency of the immune-excluded phenotype where the majority of CD8+ T cells are present in the tumor stroma but absent from the tumor parenchyma. Overall, most of the differences in the tumor microenvironment were observed between primary tumors and metastases, while fewer differences were observed between pre- and post-treatment metastases. These data suggest that the tumor microenvironment is largely determined by the primary vs. metastatic location of the tumor while chemotherapy does not have a significant impact on the host microenvironment.

Accurate Diagnosis and Survival Prediction of Bladder Cancer Using Deep Learning on Histological Slides

(1) Background: Early diagnosis and treatment are essential to reduce the mortality rate of bladder cancer (BLCA). We aimed to develop deep learning (DL)-based weakly supervised models for the diagnosis of BLCA and prediction of overall survival (OS) in muscle-invasive bladder cancer (MIBC) patients using whole slide digitized histological images (WSIs). (2) Methods: Diagnostic and prognostic models were developed using 926 WSIs of 412 BLCA patients from The Cancer Genome Atlas cohort. We collected 250 WSIs of 150 BLCA patients from the Renmin Hospital of Wuhan University cohort for external validation of the models. Two DL models were developed: a BLCA diagnostic model (named BlcaMIL) and an MIBC prognostic model (named MibcMLP). (3) Results: The BlcaMIL model identified BLCA with accuracy 0.987 in the external validation set, comparable to that of expert uropathologists and outperforming a junior pathologist. The C-index values for the MibcMLP model on the internal and external validation sets were 0.631 and 0.622, respectively. The risk score predicted by MibcMLP was a strong predictor independent of existing clinical or histopathologic indicators, as demonstrated by univariate Cox (HR = 2.390, p < 0.0001) and multivariate Cox (HR = 2.414, p < 0.0001) analyses. The interpretability of DL models can help in the analysis of critical regions associated with tumors to enrich the information obtained from WSIs. Furthermore, the expression of six genes (ANAPC7, MAPKAPK5, COX19, LINC01106, AL161431.1 and MYO16-AS1) was significantly associated with MibcMLP-predicted risk scores, revealing possible potential biological correlations. (4) Conclusions: Our study developed DL models for accurately diagnosing BLCA and predicting OS in MIBC patients, which will help promote the precise pathological diagnosis of BLCA and risk stratification of MIBC to improve clinical treatment decisions.

Deep learning-based prediction of molecular cancer biomarkers from tissue slides: A new tool for precision oncology

Molecular tests are necessary to stratify cancer patients for targeted therapy. However, high cost and technical barriers limit the application of these tests, hindering optimal treatment. Recently, deep learning (DL) has been applied to predict molecular test results from digitized images of tissue slides. Furthermore, treatment response and prognosis can be predicted from tissue slides using DL. In this review, we summarized DL-based studies regarding the prediction of genetic mutation, microsatellite instability, tumor mutational burden, molecular subtypes, gene expression, treatment response, and prognosis directly from hematoxylin- and eosin-stained tissue slides. Although performance needs to be improved, these studies clearly demonstrated the feasibility of DL-based prediction of key molecular features in cancer tissues. With the accumulation of data and technical advances, the performance of the DL system could be improved in the near future. Therefore, we expect that DL could provide cost- and time-effective alternative tools for patient stratification in the era of precision oncology.

Artificial intelligence in histopathology: enhancing cancer research and clinical oncology

Artificial intelligence (AI) methods have multiplied our capabilities to extract quantitative information from digital histopathology images. AI is expected to reduce workload for human experts, improve the objectivity and consistency of pathology reports, and have a clinical impact by extracting hidden information from routinely available data. Here, we describe how AI can be used to predict cancer outcome, treatment response, genetic alterations and gene expression from digitized histopathology slides. We summarize the underlying technologies and emerging approaches, noting limitations, including the need for data sharing and standards. Finally, we discuss the broader implications of AI in cancer research and oncology.

Computational pathology in ovarian cancer

Histopathologic evaluations of tissue sections are key to diagnosing and managing ovarian cancer. Pathologists empirically assess and integrate visual information, such as cellular density, nuclear atypia, mitotic figures, architectural growth patterns, and higher-order patterns, to determine the tumor type and grade, which guides oncologists in selecting appropriate treatment options. Latent data embedded in pathology slides can be extracted using computational imaging. Computers can analyze digital slide images to simultaneously quantify thousands of features, some of which are visible with a manual microscope, such as nuclear size and shape, while others, such as entropy, eccentricity, and fractal dimensions, are quantitatively beyond the grasp of the human mind. Applications of artificial intelligence and machine learning tools to interpret digital image data provide new opportunities to explore and quantify the spatial organization of tissues, cells, and subcellular structures. In comparison to genomic, epigenomic, transcriptomic, and proteomic patterns, morphologic and spatial patterns are expected to be more informative as quantitative biomarkers of complex and dynamic tumor biology. As computational pathology is not limited to visual data, nuanced subvisual alterations that occur in the seemingly “normal” pre-cancer microenvironment could facilitate research in early cancer detection and prevention. Currently, efforts to maximize the utility of computational pathology are focused on integrating image data with other -omics platforms that lack spatial information, thereby providing a new way to relate the molecular, spatial, and microenvironmental characteristics of cancer. Despite a dire need for improvements in ovarian cancer prevention, early detection, and treatment, the ovarian cancer field has lagged behind other cancers in the application of computational pathology. The intent of this review is to encourage ovarian cancer research teams to apply existing and/or develop additional tools in computational pathology for ovarian cancer and actively contribute to advancing this important field.

Spatial heterogeneity and organization of tumor mutation burden with immune infiltrates within tumors based on whole slide images correlated with patient survival in bladder cancer

Background

High tumor mutation burden (TMB-H) could result in an increased number of neoepitopes from somatic mutations expressed by a patient's own tumor cell which can be recognized and targeted by neighboring tumor-infiltrating lymphocytes (TILs). Deeper understanding of spatial heterogeneity and organization of tumor cells and their neighboring immune infiltrates within tumors could provide new insights into tumor progression and treatment response.

Methods

Here we first developed computational approaches using whole slide images (WSIs) to predict bladder cancer patients' TMB status and TILs across tumor regions, and then investigate spatial heterogeneity and organization of regions harboring TMB-H tumor cells and TILs within tumors, as well as their prognostic utility. Results: In experiments using WSIs from The Cancer Genome Atlas (TCGA) bladder cancer (BLCA), our findings show that computational pathology can reliably predict patient-level TMB status and delineate spatial TMB heterogeneity and co-organization with TILs. TMB-H patients with low spatial heterogeneity enriched with high TILs show improved overall survival.

Conclusions

Computational approaches using WSIs have the potential to provide rapid and cost-effective TMB testing and TILs detection. Survival analysis illuminates potential clinical utility of spatial heterogeneity and co-organization of TMB and TILs as a prognostic biomarker in BLCA which warrants further validation in future studies.

Swarm learning for decentralized artificial intelligence in cancer histopathology

Artificial intelligence (AI) can predict the presence of molecular alterations directly from routine histopathology slides. However, training robust AI systems requires large datasets for which data collection faces practical, ethical and legal obstacles. These obstacles could be overcome with swarm learning (SL), in which partners jointly train AI models while avoiding data transfer and monopolistic data governance. Here, we demonstrate the successful use of SL in large, multicentric datasets of gigapixel histopathology images from over 5,000 patients. We show that AI models trained using SL can predict BRAF mutational status and microsatellite instability directly from hematoxylin and eosin (H&E)-stained pathology slides of colorectal cancer. We trained AI models on three patient cohorts from Northern Ireland, Germany and the United States, and validated the prediction performance in two independent datasets from the United Kingdom. Our data show that SL-trained AI models outperform most locally trained models, and perform on par with models that are trained on the merged datasets. In addition, we show that SL-based AI models are data efficient. In the future, SL can be used to train distributed AI models for any histopathology image analysis task, eliminating the need for data transfer.

A decentralized, privacy-preserving machine learning framework used to train a clinically relevant AI system identifies actionable molecular alterations in patients with colorectal cancer by use of routine histopathology slides collected in real-world settings.

A novel risk score model based on five angiogenesis-related long non-coding RNAs for bladder urothelial carcinoma

Background

Tumour angiogenesis is an independent risk factor for bladder urothelial carcinoma (BUC) progression, but viable and promising antiangiogenic targets are understudied. Emerging evidence suggests that long non-coding RNAs (lncRNAs) play prominent role in the tumour microenvironment and tumour angiogenesis.

Methods

The clinical data of BUC patients were obtained from TCGA database and clinical specimens of 138 BUC patients. Univariate and multivariate COX regression analyses were used to identify survival-related ARLNRs (sARLNRs) from The Molecular Signatures Database v4.0. Fisher’s exact probability method was used to detect the correlations between sARLNRs levels and clinicopathological characteristics. A chain of experiments including FACS, qPCR, immunohistochemistry, tube formation, migration and invasion assays, combining with co-culture models, were utilized to validate the clinical significance and angiogenetic correlation of sARLNRs.

Results

Five sARLNRs were employed to establish an angiogenesis-related risk score model, by which patients in the low-risk group obtained better overall survival than those in the high-risk group. The expression of AC005625.1 and AC008760.1 was significantly related to ECs percentage, tumour size and muscle invasion status. Besides, AC005625.1 and AC008760.1 expressed lower in BUC cell lines and tumour tissues than that in normal urothelial cells and adjacent normal tissues, with much lower levels in more advanced T stages. A prominently higher proportion of ECs was detected in tumour tissues with lower expression of AC005625.1 and AC008760.1. In the co-culture models, we found that knockdown of AC005625.1 and AC008760.1 in BUC cells increased the tube formation, migration and invasion abilities of HUVEC. The expression levels of CD31, VEGF-A, VIMENTIN and N-CADHERIN were also enhanced in HUVEC cells co-cultured with siR-AC005625.1 and siR-AC008760.1-treated T24 cells.

Conclusion

In the study, we identify five sARLNRs and validate their clinical significance, angiogenesis correlation and prognosis-predictive values in BUC. These findings may provide a new perspective and some promising antiangiogenic targets for clinical diagnosis and treatment strategies of BUC.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12935-022-02575-1.

Artificial intelligence to identify genetic alterations in conventional histopathology

Precision oncology relies on the identification of targetable molecular alterations in tumor tissues. In many tumor types, a limited set of molecular tests is currently part of standard diagnostic workflows. However, universal testing for all targetable alterations, especially rare ones, is limited by the cost and availability of molecular assays. From 2017 to 2021, multiple studies have shown that artificial intelligence (AI) methods can predict the probability of specific genetic alterations directly from conventional hematoxylin and eosin (H&E) tissue slides. Although these methods are currently less accurate than gold-standard testing (e.g. immunohistochemistry, polymerase chain reaction or next-generation sequencing), they could be used as pre-screening tools to reduce the workload of genetic analyses. In this systematic literature review, we summarize the state of the art in predicting molecular alterations from H&E using AI. We found that AI methods perform reasonably well across multiple tumor types, although few algorithms have been broadly validated. In addition, we found that genetic alterations in FGFR, IDH, PIK3CA, BRAF, TP53 and DNA repair pathways are predictable from H&E in multiple tumor types, while many other genetic alterations have rarely been investigated or were only poorly predictable. Finally, we discuss the next steps for the implementation of AI-based surrogate tests in diagnostic workflows. This article is protected by copyright. All rights reserved.

Predicting Mutational Status of Driver and Suppressor Genes Directly from Histopathology With Deep Learning: A Systematic Study Across 23 Solid Tumor Types

In the last four years, advances in Deep Learning technology have enabled the inference of selected mutational alterations directly from routine histopathology slides. In particular, recent studies have shown that genetic changes in clinically relevant driver genes are reflected in the histological phenotype of solid tumors and can be inferred by analysing routine Haematoxylin and Eosin (H&E) stained tissue sections with Deep Learning. However, these studies mostly focused on selected individual genes in selected tumor types. In addition, genetic changes in solid tumors primarily act by changing signaling pathways that regulate cell behaviour. In this study, we hypothesized that Deep Learning networks can be trained to directly predict alterations of genes and pathways across a spectrum of solid tumors. We manually outlined tumor tissue in H&E-stained tissue sections from 7,829 patients with 23 different tumor types from The Cancer Genome Atlas. We then trained convolutional neural networks in an end-to-end way to detect alterations in the most clinically relevant pathways or genes, directly from histology images. Using this automatic approach, we found that alterations in 12 out of 14 clinically relevant pathways and numerous single gene alterations appear to be detectable in tissue sections, many of which have not been reported before. Interestingly, we show that the prediction performance for single gene alterations is better than that for pathway alterations. Collectively, these data demonstrate the predictability of genetic alterations directly from routine cancer histology images and show that individual genes leave a stronger morphological signature than genetic pathways.

Machine learning provides an accurate prognostication model for refractory overactive bladder treatment response and is noninferior to human experts

OBJECTIVE

The increasing wealth of clinical data may become unmanageable for a physician to assimilate into optimal decision-making without assistance. Utilizing a novel machine learning (ML) approach, we sought to develop algorithms to predict patient outcomes following the overactive bladder treatments OnabotulinumtoxinA (OBTX-A) injection and sacral neuromodulation (SNM).

MATERIALS AND METHODS

ROSETTA datasets for overactive bladder patients randomized to OBTX-A or SNM were obtained. Novel ML algorithms, using reproducing kernel techniques were developed and tasked to predict outcomes including treatment response and decrease in urge urinary incontinence episodes in both the OBTX-A and SNM cohorts, in validation and test sets. Blinded expert urologists also predicted outcomes. Receiver operating characteristic curves were generated and AUCs calculated for comparison to lines of ignorance and the expert urologists' predictions.

RESULTS

Trained algorithms demonstrated outstanding accuracy in predicting treatment response (OBTX-A: AUC 0.95; SNM: 0.88). Algorithms accurately predicted mean decrease in urge urinary incontinence episodes (MSE < 0.15) in OBTX-A and SNM. Algorithms were superior to human experts in response prediction for OBTX-A, and noninferior to human experts in response prediction for SNM.

CONCLUSIONS

Novel ML algorithms were accurate, superior to expert urologists in predicting OBTX-A outcomes, and noninferior to expert urologists in predicting SNM outcomes. Some aspects of the physician-patient interaction are subtle and uncomputable, and thus ML may complement, but not supplant, a physician's judgment.

Deep Learning identifies inflamed fat as a risk factor for lymph node metastasis in early colorectal cancer

The spread of early-stage (T1 and T2) adenocarcinomas to loco-regional lymph nodes is a key event in disease progression of colorectal cancer (CRC). The cellular mechanisms behind this event are not completely understood and existing predictive biomarkers are imperfect. Here, we used an end-to-end Deep Learning algorithm to identify risk factors for lymph node metastasis (LNM) status in digitized histopathology slides of the primary CRC and its surrounding tissue. In two large population-based cohorts, we show that this system can predict the presence of more than one LNM in pT2 CRC patients with an area under the receiver operating curve (AUROC) of 0.733 (0.67-0.758) and patients with any LNM with an AUROC of 0.711 (0.597-0.797). Similarly, in pT1 CRC patients, the presence of more than one LNM or any LNM was predictable with an AUROC of 0.733 (0.644-0.778) and 0.567 (0.542-0.597), respectively. Based on these findings, we used the Deep Learning system to guide human pathology experts towards highly predictive regions for LNM in the whole slide images. This hybrid human observer and Deep Learning approach identified inflamed adipose tissue as the highest predictive feature for LNM presence. Our study is a first proof of concept that artificial intelligence (AI) systems may be able to discover potentially new biological mechanisms in cancer progression. Our Deep Learning algorithm is publicly available and can be used for biomarker discovery in any disease setting. This article is protected by copyright. All rights reserved.

Deep Learning of Histopathological Features for the Prediction of Tumour Molecular Genetics

Advanced diagnostics are enabling cancer treatments to become increasingly tailored to the individual through developments in immunotherapies and targeted therapies. However, long turnaround times and high costs of molecular testing hinder the widespread implementation of targeted cancer treatments. Meanwhile, gold-standard histopathological assessment carried out by a trained pathologist is widely regarded as routine and mandatory in most cancers. Recently, methods have been developed to mine hidden information from histopathological slides using deep learning applied to scanned and digitized slides; deep learning comprises a collection of computational methods which learn patterns in data in order to make predictions. Such methods have been reported to be successful in a variety of cancers for predicting the presence of biomarkers such as driver mutations, tumour mutational burden, and microsatellite instability. This information could prove valuable to pathologists and oncologists in clinical decision making for cancer treatment and triage for in-depth sequencing. In addition to identifying molecular features, deep learning has been applied to predict prognosis and treatment response in certain cancers. Despite reported successes, many challenges remain before the clinical implementation of such diagnostic strategies in the clinical setting is possible. This review aims to outline recent developments in the field of deep learning for predicting molecular genetics from histopathological slides, as well as to highlight limitations and pitfalls of working with histopathology slides in deep learning.