Multiscale deep learning framework captures systemic immune features in lymph nodes predictive of triple negative breast cancer outcome in large-scale studies

Prognostic Impact of Immunophenotypic Variation in Subcapsular Sinus Endothelium of Sentinel Lymph Nodes in Invasive Breast Carcinoma

Introduction

Several studies demonstrated the de novo formation of lymphatic vessels in tumor-draining lymph nodes (LNs), partly preceding lymphatic metastases. This "lymphovascular niche" supposedly facilitates survival of metastatic tumor cells. This study aims at evaluating the previously observed immunophenotypic variations of subcapsular endothelial cells (SECs) in a larger cohort by software-assisted image analysis.

Methods

Suitable cases with sentinel-LN (SLN) of invasive breast cancer were identified in the Institute of Pathology, corresponding data were extracted. LN of 231 patients were stained for HE, D2-40, CD31, and Prox1. QuPath software was used for assessing the immunohistochemical stained area of endothelial cells of the subcapsular sinus. The Cutoff Finder web application was used for identification of the best cutoff for continuous parameters according to overall survival (OS). Collected data were statistically evaluated for available data.

Results

A larger area of CD31-positive SEC was significantly associated with worse OS (p = 0.001), as was a higher proportion of D2-40-stained subcapsular sinus (p = 0.045). Larger area of D2-40-/CD31-/Prox1-positive SEC and higher proportion of D2-40 stained subcapsular sinus were independent marker for worse OS in multivariate analysis in the whole cohort, for D2-40- and CD31-positive SECs as well as higher proportion of D2-40-stained sinus including nodal-negative status, respectively.

Conclusion

QuPath-assisted evaluation of immunophenotypic variation in subcapsular sinus endothelium in SLN essentially confirmed and extended our previous findings. Larger positive area of D2-40- and CD31-positive SECs emerged as a strong independent negative prognostic factor, even before evident nodal metastasis. The potential function of alterations in D2-40-/CD31-expression in SECs has yet to be elucidated.

Artificial Intelligence and Breast Cancer Management: From Data to the Clinic

Breast cancer (BC) remains a significant threat to women's health worldwide. The oncology field had an exponential growth in the abundance of medical images, clinical information, and genomic data. With its continuous advancement and refinement, artificial intelligence (AI) has demonstrated exceptional capabilities in processing intricate multidimensional BC-related data. AI has proven advantageous in various facets of BC management, encompassing efficient screening and diagnosis, precise prognosis assessment, and personalized treatment planning. However, the implementation of AI into precision medicine and clinical practice presents ongoing challenges that necessitate enhanced regulation, transparency, fairness, and integration of multiple clinical pathways. In this review, we provide a comprehensive overview of the current research related to AI in BC, highlighting its extensive applications throughout the whole BC cycle management and its potential for innovative impact. Furthermore, this article emphasizes the significance of constructing patient-oriented AI algorithms. Additionally, we explore the opportunities and potential research directions within this burgeoning field.

Protocol for perfusing human axillary lymph nodes ex vivo to study structure and function in real time

Lymph nodes regulate immunity and maintain fluid balance in health and disease. Here, we present a protocol that uses normothermic perfusion to sustain patient-derived lymph nodes ex vivo for up to 24 h to study their structure and function. We describe steps for setting up both thermoregulatory and perfusion circuits, cannulating human lymph nodes, and perfusion. This protocol can be used to study how human lymph nodes change in cancer and other diseases, and/or in response to perturbations, including drugs. For complete details on the use and execution of this protocol, please refer to Barrow-McGee et al.1.

Deep learning-based multi-task prediction of response to neoadjuvant chemotherapy using multiscale whole slide images in breast cancer: A multicenter study

Objective

Early predicting response before neoadjuvant chemotherapy (NAC) is crucial for personalized treatment plans for locally advanced breast cancer patients. We aim to develop a multi-task model using multiscale whole slide images (WSIs) features to predict the response to breast cancer NAC more finely.

Methods

This work collected 1,670 whole slide images for training and validation sets, internal testing sets, external testing sets, and prospective testing sets of the weakly-supervised deep learning-based multi-task model (DLMM) in predicting treatment response and pCR to NAC. Our approach models two-by-two feature interactions across scales by employing concatenate fusion of single-scale feature representations, and controls the expressiveness of each representation via a gating-based attention mechanism.

Results

In the retrospective analysis, DLMM exhibited excellent predictive performance for the prediction of treatment response, with area under the receiver operating characteristic curves (AUCs) of 0.869 [95% confidence interval (95% CI): 0.806-0.933] in the internal testing set and 0.841 (95% CI: 0.814-0.867) in the external testing sets. For the pCR prediction task, DLMM reached AUCs of 0.865 (95% CI: 0.763-0.964) in the internal testing and 0.821 (95% CI: 0.763-0.878) in the pooled external testing set. In the prospective testing study, DLMM also demonstrated favorable predictive performance, with AUCs of 0.829 (95% CI: 0.754-0.903) and 0.821 (95% CI: 0.692-0.949) in treatment response and pCR prediction, respectively. DLMM significantly outperformed the baseline models in all testing sets (P<0.05). Heatmaps were employed to interpret the decision-making basis of the model. Furthermore, it was discovered that high DLMM scores were associated with immune-related pathways and cells in the microenvironment during biological basis exploration.

Conclusions

The DLMM represents a valuable tool that aids clinicians in selecting personalized treatment strategies for breast cancer patients.

Computational methods for metastasis detection in lymph nodes and characterization of the metastasis-free lymph node microarchitecture: A systematic-narrative hybrid review

Background

Histological examination of tumor draining lymph nodes (LNs) plays a vital role in cancer staging and prognostication. However, as soon as a LN is classed as metastasis-free, no further investigation will be performed and thus, potentially clinically relevant information detectable in tumor-free LNs is currently not captured.

Objective

To systematically study and critically assess methods for the analysis of digitized histological LN images described in published research.

Methods

A systematic search was conducted in several public databases up to December 2023 using relevant search terms. Studies using brightfield light microscopy images of hematoxylin and eosin or immunohistochemically stained LN tissue sections aiming to detect and/or segment LNs, their compartments or metastatic tumor using artificial intelligence (AI) were included. Dataset, AI methodology, cancer type, and study objective were compared between articles.

Results

A total of 7201 articles were collected and 73 articles remained for detailed analyses after article screening. Of the remaining articles, 86% aimed at LN metastasis identification, 8% aimed at LN compartment segmentation, and remaining focused on LN contouring. Furthermore, 78% of articles used patch classification and 22% used pixel segmentation models for analyses. Five out of six studies (83%) of metastasis-free LNs were performed on publicly unavailable datasets, making quantitative article comparison impossible.

Conclusions

Multi-scale models mimicking multiple microscopy zooms show promise for computational LN analysis. Large-scale datasets are needed to establish the clinical relevance of analyzing metastasis-free LN in detail. Further research is needed to identify clinically interpretable metrics for LN compartment characterization.

Deciphering cell to cell spatial relationship for pathology images using SpatialQPFs

Understanding spatial dynamics within tissue microenvironments is crucial for deciphering cellular interactions and molecular signaling in living systems. These spatial characteristics govern cell distribution, extracellular matrix components, and signaling molecules, influencing local biochemical and biophysical conditions. Despite significant progress in analyzing digital pathology images, current methods for capturing spatial relationships are limited. They often rely on specific spatial features that only partially describe the complex spatial distributions of cells and are frequently tied to particular outcomes within predefined model frameworks. Furthermore, these methods are typically limited to field of view analysis, which restricts their capacity to capture spatial patterns across whole-slide images, thereby limiting their ability to fully address the complexities of tissue architecture. To address these limitations, we present SpatialQPFs (Spatial Quantitative Pathology Features), an R package designed to extract interpretable spatial features from cell imaging data using spatial statistical methodologies. Leveraging segmented cell information, our package offers a comprehensive toolkit for applying a range of spatial statistical methods within a stochastic process framework, including analyses of point process data, areal data, and geostatistical data. By decoupling feature extraction from specific outcome models, SpatialQPFs enables thorough large-scale spatial analyses applicable across diverse clinical and biological contexts. This approach enhances the depth and accuracy of spatial insights derived from tissue data, empowering researchers to conduct comprehensive spatial analyses efficiently and reproducibly. By providing a flexible and robust framework for spatial feature extraction, SpatialQPFs facilitates advanced spatial analyses, paving the way for new discoveries in tissue biology and pathology. SpatialQPFs code and documentation are publicly available at https://github.com/Genentech/SpatialQPFs .

Automated scoring methods for quantitative interpretation of Tumour infiltrating lymphocytes (TILs) in breast cancer: a systematic review

Tumour microenvironment (TME) of breast cancer mainly comprises malignant, stromal, immune, and tumour infiltrating lymphocyte (TILs). Assessment of TILs is crucial for determining the disease's prognosis. Manual TIL assessments are hampered by multiple limitations, including low precision, poor inter-observer reproducibility, and time consumption. In response to these challenges, automated scoring emerges as a promising approach. The aim of this systematic review is to assess the evidence on the approaches and performance of automated scoring methods for TILs assessment in breast cancer. This review presents a comprehensive compilation of studies related to automated scoring of TILs, sourced from four databases (Web of Science, Scopus, Science Direct, and PubMed), employing three primary keywords (artificial intelligence, breast cancer, and tumor-infiltrating lymphocytes). The PICOS framework was employed for study eligibility, and reporting adhered to the PRISMA guidelines. The initial search yielded a total of 1910 articles. Following screening and examination, 27 studies met the inclusion criteria and data were extracted for the review. The findings indicate a concentration of studies on automated TILs assessment in developed countries, specifically the United States and the United Kingdom. From the analysis, a combination of sematic segmentation and object detection (n = 10, 37%) and convolutional neural network (CNN) (n = 11, 41%), become the most frequent automated task and ML approaches applied for model development respectively. All models developed their own ground truth datasets for training and validation, and 59% of the studies assessed the prognostic value of TILs. In conclusion, this analysis contends that automated scoring methods for TILs assessment of breast cancer show significant promise for commodification and application within clinical settings.

Deep learning applications in breast cancer histopathological imaging: diagnosis, treatment, and prognosis

Breast cancer is the most common malignant tumor among women worldwide and remains one of the leading causes of death among women. Its incidence and mortality rates are continuously rising. In recent years, with the rapid advancement of deep learning (DL) technology, DL has demonstrated significant potential in breast cancer diagnosis, prognosis evaluation, and treatment response prediction. This paper reviews relevant research progress and applies DL models to image enhancement, segmentation, and classification based on large-scale datasets from TCGA and multiple centers. We employed foundational models such as ResNet50, Transformer, and Hover-net to investigate the performance of DL models in breast cancer diagnosis, treatment, and prognosis prediction. The results indicate that DL techniques have significantly improved diagnostic accuracy and efficiency, particularly in predicting breast cancer metastasis and clinical prognosis. Furthermore, the study emphasizes the crucial role of robust databases in developing highly generalizable models. Future research will focus on addressing challenges related to data management, model interpretability, and regulatory compliance, ultimately aiming to provide more precise clinical treatment and prognostic evaluation programs for breast cancer patients.

ncRNAs and their impact on dopaminergic neurons: Autophagy pathways in Parkinson's disease

Parkinson's Disease (PD) is a complex neurological illness that causes severe motor and non-motor symptoms due to a gradual loss of dopaminergic neurons in the substantia nigra. The aetiology of PD is influenced by a variety of genetic, environmental, and cellular variables. One important aspect of this pathophysiology is autophagy, a crucial cellular homeostasis process that breaks down and recycles cytoplasmic components. Recent advances in genomic technologies have unravelled a significant impact of ncRNAs on the regulation of autophagy pathways, thereby implicating their roles in PD onset and progression. They are members of a family of RNAs that include miRNAs, circRNA and lncRNAs that have been shown to play novel pleiotropic functions in the pathogenesis of PD by modulating the expression of genes linked to autophagic activities and dopaminergic neuron survival. This review aims to integrate the current genetic paradigms with the therapeutic prospect of autophagy-associated ncRNAs in PD. By synthesizing the findings of recent genetic studies, we underscore the importance of ncRNAs in the regulation of autophagy, how they are dysregulated in PD, and how they represent novel dimensions for therapeutic intervention. The therapeutic promise of targeting ncRNAs in PD is discussed, including the barriers that need to be overcome and future directions that must be embraced to funnel these ncRNA molecules for the treatment and management of PD.

Pre-treatment peripheral blood immunophenotyping and response to neoadjuvant chemotherapy in operable breast cancer

BACKGROUND

Tumor immune infiltration and peripheral blood immune signatures have prognostic and predictive value in breast cancer. Whether distinct peripheral blood immune phenotypes are associated with response to neoadjuvant chemotherapy (NAC) remains understudied.

METHODS

Peripheral blood mononuclear cells from 126 breast cancer patients enrolled in a prospective clinical trial (NCT02022202) were analyzed using Cytometry by time-of-flight with a panel of 29 immune cell surface protein markers. Kruskal-Wallis tests or Wilcoxon rank-sum tests were used to evaluate differences in immune cell subpopulations according to breast cancer subtype and response to NAC.

RESULTS

There were 122 evaluable samples: 47 (38.5%) from patients with hormone receptor-positive, 39 (32%) triple-negative (TNBC), and 36 (29.5%) HER2-positive breast cancer. The relative abundances of pre-treatment peripheral blood T, B, myeloid, NK, and unclassified cells did not differ according to breast cancer subtype. In TNBC, higher pre-treatment myeloid cells were associated with lower pathologic complete response (pCR) rates. In hormone receptor-positive breast cancer, lower pre-treatment CD8 + naïve and CD4 + effector memory cells re-expressing CD45RA (TEMRA) T cells were associated with more extensive residual disease after NAC. In HER2 + breast cancer, the peripheral blood immune phenotype did not differ according to NAC response.

CONCLUSIONS

Pre-treatment peripheral blood immune cell populations (myeloid in TNBC; CD8 + naïve T cells and CD4 + TEMRA cells in luminal breast cancer) were associated with response to NAC in early-stage TNBC and hormone receptor-positive breast cancers, but not in HER2 + breast cancer.

TRIAL REGISTRATION

NCT02022202 . Registered 20 December 2013.

Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment

Research into the potential benefits of artificial intelligence for comprehending the intricate biology of cancer has grown as a result of the widespread use of deep learning and machine learning in the healthcare sector and the availability of highly specialized cancer datasets. Here, we review new artificial intelligence approaches and how they are being used in oncology. We describe how artificial intelligence might be used in the detection, prognosis, and administration of cancer treatments and introduce the use of the latest large language models such as ChatGPT in oncology clinics. We highlight artificial intelligence applications for omics data types, and we offer perspectives on how the various data types might be combined to create decision-support tools. We also evaluate the present constraints and challenges to applying artificial intelligence in precision oncology. Finally, we discuss how current challenges may be surmounted to make artificial intelligence useful in clinical settings in the future.

Computational pathology in cancer diagnosis, prognosis, and prediction - present day and prospects

Computational pathology refers to applying deep learning techniques and algorithms to analyse and interpret histopathology images. Advances in artificial intelligence (AI) have led to an explosion in innovation in computational pathology, ranging from the prospect of automation of routine diagnostic tasks to the discovery of new prognostic and predictive biomarkers from tissue morphology. Despite the promising potential of computational pathology, its integration in clinical settings has been limited by a range of obstacles including operational, technical, regulatory, ethical, financial, and cultural challenges. Here, we focus on the pathologists' perspective of computational pathology: we map its current translational research landscape, evaluate its clinical utility, and address the more common challenges slowing clinical adoption and implementation. We conclude by describing contemporary approaches to drive forward these techniques. © 2023 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.

Spatial analyses of immune cell infiltration in cancer: current methods and future directions: A report of the International Immuno-Oncology Biomarker Working Group on Breast Cancer

Modern histologic imaging platforms coupled with machine learning methods have provided new opportunities to map the spatial distribution of immune cells in the tumor microenvironment. However, there exists no standardized method for describing or analyzing spatial immune cell data, and most reported spatial analyses are rudimentary. In this review, we provide an overview of two approaches for reporting and analyzing spatial data (raster versus vector-based). We then provide a compendium of spatial immune cell metrics that have been reported in the literature, summarizing prognostic associations in the context of a variety of cancers. We conclude by discussing two well-described clinical biomarkers, the breast cancer stromal tumor infiltrating lymphocytes score and the colon cancer Immunoscore, and describe investigative opportunities to improve clinical utility of these spatial biomarkers. © 2023 The Pathological Society of Great Britain and Ireland.