Multiplexed 3D atlas of state transitions and immune interaction in colorectal cancer

PanIN or IPMN? Redefining Lesion Size in 3 Dimensions

Pancreatic ductal adenocarcinoma (PDAC) develops from 2 known precursor lesions: a majority (∼85%) develops from pancreatic intraepithelial neoplasia (PanIN), and a minority develops from intraductal papillary mucinous neoplasms (IPMNs). Clinical classification of PanIN and IPMN relies on a combination of low-resolution, 3-dimensional (D) imaging (computed tomography, CT), and high-resolution, 2D imaging (histology). The definitions of PanIN and IPMN currently rely heavily on size. IPMNs are defined as macroscopic: generally >1.0 cm and visible in CT, and PanINs are defined as microscopic: generally <0.5 cm and not identifiable in CT. As 2D evaluation fails to take into account 3D structures, we hypothesized that this classification would fail in evaluation of high-resolution, 3D images. To characterize the size and prevalence of PanINs in 3D, 47 thick slabs of pancreas were harvested from grossly normal areas of pancreatic resections, excluding samples from individuals with a diagnosis of an IPMN. All patients but one underwent preoperative CT scans. Through construction of cellular resolution 3D maps, we identified >1400 ductal precursor lesions that met the 2D histologic size criteria of PanINs. We show that, when 3D space is considered, 25 of these lesions can be digitally sectioned to meet the 2D histologic size criterion of IPMN. Re-evaluation of the preoperative CT images of individuals found to possess these large precursor lesions showed that nearly half are visible on imaging. These findings demonstrate that the clinical classification of PanIN and IPMN fails in evaluation of high-resolution, 3D images, emphasizing the need for re-evaluation of classification guidelines that place significant weight on 2D assessment of 3D structures.

Tumor cells impair immunological synapse formation via central nervous system-enriched metabolite

Tumors employ various strategies to evade immune surveillance. Central nervous system (CNS) has multiple features to restrain immune response. Whether tumors and CNS share similar programs of immunosuppression is elusive. Here, we analyze multi-omics data of tumors from HER2+ breast cancer patients receiving trastuzumab and anti-PD-L1 antibody and find that CNS-enriched N-acetyltransferase 8-like (NAT8L) and its metabolite N-acetylaspartate (NAA) are overexpressed in resistant tumors. In CNS, NAA is released during brain inflammation. NAT8L attenuates brain inflammation and impairs anti-tumor immunity by inhibiting cytotoxicity of natural killer (NK) cells and CD8+ T cells via NAA. NAA disrupts the formation of immunological synapse by promoting PCAF-induced acetylation of lamin A-K542, which inhibits the integration between lamin A and SUN2 and impairs polarization of lytic granules. We uncover that tumor cells mimic the anti-inflammatory mechanism of CNS to evade anti-tumor immunity and NAT8L is a potential target to enhance efficacy of anti-cancer agents.

Analysis of 3D pathology samples using weakly supervised AI

Human tissue, which is inherently three-dimensional (3D), is traditionally examined through standard-of-care histopathology as limited two-dimensional (2D) cross-sections that can insufficiently represent the tissue due to sampling bias. To holistically characterize histomorphology, 3D imaging modalities have been developed, but clinical translation is hampered by complex manual evaluation and lack of computational platforms to distill clinical insights from large, high-resolution datasets. We present TriPath, a deep-learning platform for processing tissue volumes and efficiently predicting clinical outcomes based on 3D morphological features. Recurrence risk-stratification models were trained on prostate cancer specimens imaged with open-top light-sheet microscopy or microcomputed tomography. By comprehensively capturing 3D morphologies, 3D volume-based prognostication achieves superior performance to traditional 2D slice-based approaches, including clinical/histopathological baselines from six certified genitourinary pathologists. Incorporating greater tissue volume improves prognostic performance and mitigates risk prediction variability from sampling bias, further emphasizing the value of capturing larger extents of heterogeneous morphology.

scBSP: A fast and accurate tool for identifying spatially variable genes from spatial transcriptomic data

Spatially resolved transcriptomics have enabled the inference of gene expression patterns within two and three-dimensional space, while introducing computational challenges due to growing spatial resolutions and sparse expressions. Here, we introduce scBSP, an open-source, versatile, and user-friendly package designed for identifying spatially variable genes in large-scale spatial transcriptomics. scBSP implements sparse matrix operation to significantly increase the computational efficiency in both computational time and memory usage, processing the high-definition spatial transcriptomics data for 19,950 genes on 181,367 spots within 10 seconds. Applied to diverse sequencing data and simulations, scBSP efficiently identifies spatially variable genes, demonstrating fast computational speed and consistency across various sequencing techniques and spatial resolutions for both two and three-dimensional data with up to millions of cells. On a sample with hundreds of thousands of sports, scBSP identifies SVGs accurately in seconds to on a typical desktop computer.

A general algorithm for consensus 3D cell segmentation from 2D segmented stacks

Cell segmentation is the fundamental task. Only by segmenting, can we define the quantitative spatial unit for collecting measurements to draw biological conclusions. Deep learning has revolutionized 2D cell segmentation, enabling generalized solutions across cell types and imaging modalities. This has been driven by the ease of scaling up image acquisition, annotation and computation. However 3D cell segmentation, which requires dense annotation of 2D slices still poses significant challenges. Labelling every cell in every 2D slice is prohibitive. Moreover it is ambiguous, necessitating cross-referencing with other orthoviews. Lastly, there is limited ability to unambiguously record and visualize 1000's of annotated cells. Here we develop a theory and toolbox, u-Segment3D for 2D-to-3D segmentation, compatible with any 2D segmentation method. Given optimal 2D segmentations, u-Segment3D generates the optimal 3D segmentation without data training, as demonstrated on 11 real life datasets, >70,000 cells, spanning single cells, cell aggregates and tissue.

Increased Multiplexity in Optical Tissue Clearing-Based Three-Dimensional Immunofluorescence Microscopy of the Tumor Microenvironment by Light-Emitting Diode Photobleaching

Optical tissue clearing and three-dimensional (3D) immunofluorescence (IF) microscopy is transforming imaging of the complex tumor microenvironment (TME). However, current 3D IF microscopy has restricted multiplexity; only 3 or 4 cellular and noncellular TME components can be localized in cleared tumor tissue. Here we report a light-emitting diode (LED) photobleaching method and its application for 3D multiplexed optical mapping of the TME. We built a high-power LED light irradiation device and temperature-controlled chamber for completely bleaching fluorescent signals throughout optically cleared tumor tissues without compromise of tissue and protein antigen integrity. With newly developed tissue mounting and selected region-tracking methods, we established a cyclic workflow involving IF staining, tissue clearing, 3D confocal microscopy, and LED photobleaching. By registering microscope channel images generated through 3 work cycles, we produced 8-plex image data from individual 400 μm-thick tumor macrosections that visualize various vascular, immune, and cancer cells in the same TME at tissue-wide and cellular levels in 3D. Our method was also validated for quantitative 3D spatial analysis of cellular remodeling in the TME after immunotherapy. These results demonstrate that our LED photobleaching system and its workflow offer a novel approach to increase the multiplexing power of 3D IF microscopy for studying tumor heterogeneity and response to therapy.

Single-cell Atlas of Penile Cancer Reveals TP53 Mutations as a Driver of an Aggressive Phenotype, Irrespective of Human Papillomavirus Status, and Provides Clues for Treatment Personalization

BACKGROUND AND OBJECTIVE

TP53 loss-of-function (TP53LOF) mutations might be a driver of poor prognosis and chemoresistance in both human papillomavirus (HPV)-independent (HPV-) and HPV-associated (HPV+) penile squamous cell carcinoma (PSCC). Here, we aim to describe transcriptomic differences in the PSCC microenvironment stratified by TP53LOF and HPV status.

METHODS

We used single-cell RNA sequencing (scRNA-seq) and T-cell receptor sequencing to obtain a comprehensive atlas of the cellular architecture of PSCC. TP53LOF and HPV status were determined by targeted next-generation sequencing and sequencing HPV-DNA reads. Six HPV+ TP53 wild type (WT), six HPV- TP53WT, and four TP53LOF PSCC samples and six controls were included. Immunohistochemistry and hematoxylin-eosin confirmed the morphological context of the observed signatures. Prognostic differences between patient groups were validated in 541 PSCC patients using Kaplan-Meier survival estimates.

KEY FINDINGS AND LIMITATIONS

Patients with aberrant p53 staining fare much worse than patients with either HPV- or HPV+ tumors and WT p53 expression. Using scRNA-seq, we revealed 65 cell subtypes within 83 682 cells. TP53LOF tumors exhibit a partial epithelial-to-mesenchymal transition, immune-excluded, angiogenic, and morphologically invasive environment, underlying their aggressive phenotype. HPV- TP53WT tumors show stemness and immune exhaustion. HPV+ TP53WT tumors mirror normal epithelial maturation with upregulation of antibody-drug-conjugate targets and activation of innate immunity. Inherent to the scRNA-seq analysis, low sample size is a limitation and validation of signatures in large PSCC cohorts is needed.

CONCLUSIONS AND CLINICAL IMPLICATIONS

This first scRNA-seq atlas offers unprecedented in-depth insights into PSCC biology underlying prognostic differences based on TP53 and HPV status. Our findings provide clues for testing novel biomarker-driven therapies in PSCC.

PATIENT SUMMARY

Here, we analyzed tissues of penile cancer at the level of individual cells, which helps us understand why patients who harbor a deactivating mutation in the TP53 gene do much worse than patients lacking such a mutation. Such an analysis may help us tailor future therapies based on TP53 gene mutations and human papillomavirus status of these tumors.

Charting the cellular biogeography in colitis reveals fibroblast trajectories and coordinated spatial remodeling

Gut inflammation involves contributions from immune and non-immune cells, whose interactions are shaped by the spatial organization of the healthy gut and its remodeling during inflammation. The crosstalk between fibroblasts and immune cells is an important axis in this process, but our understanding has been challenged by incomplete cell-type definition and biogeography. To address this challenge, we used multiplexed error-robust fluorescence in situ hybridization (MERFISH) to profile the expression of 940 genes in 1.35 million cells imaged across the onset and recovery from a mouse colitis model. We identified diverse cell populations, charted their spatial organization, and revealed their polarization or recruitment in inflammation. We found a staged progression of inflammation-associated tissue neighborhoods defined, in part, by multiple inflammation-associated fibroblasts, with unique expression profiles, spatial localization, cell-cell interactions, and healthy fibroblast origins. Similar signatures in ulcerative colitis suggest conserved human processes. Broadly, we provide a framework for understanding inflammation-induced remodeling in the gut and other tissues.

SpaceANOVA: Spatial Co-occurrence Analysis of Cell Types in Multiplex Imaging Data Using Point Process and Functional ANOVA

Multiplex imaging platforms have enabled the identification of the spatial organization of different types of cells in complex tissue or the tumor microenvironment. Exploring the potential variations in the spatial co-occurrence or colocalization of different cell types across distinct tissue or disease classes can provide significant pathological insights, paving the way for intervention strategies. However, the existing methods in this context either rely on stringent statistical assumptions or suffer from a lack of generalizability. We present a highly powerful method to study differential spatial co-occurrence of cell types across multiple tissue or disease groups, based on the theories of the Poisson point process and functional analysis of variance. Notably, the method accommodates multiple images per subject and addresses the problem of missing tissue regions, commonly encountered due to data-collection complexities. We demonstrate the superior statistical power and robustness of the method in comparison with existing approaches through realistic simulation studies. Furthermore, we apply the method to three real data sets on different diseases collected using different imaging platforms. In particular, one of these data sets reveals novel insights into the spatial characteristics of various types of colorectal adenoma.

The 3D Revolution in Cancer Discovery

SUMMARY

The transition from 2D to 3D spatial profiling marks a revolutionary era in cancer research, offering unprecedented potential to enhance cancer diagnosis and treatment. This commentary outlines the experimental and computational advancements and challenges in 3D spatial molecular profiling, underscoring the innovation needed in imaging tools, software, artificial intelligence, and machine learning to overcome implementation hurdles and harness the full potential of 3D analysis in the field.

Three-dimensional reconstruction of fetal rhesus macaque kidneys at single-cell resolution reveals complex inter-relation of structures

Kidneys are among the most structurally complex organs in the body. Their architecture is critical to ensure proper function and is often impacted by diseases such as diabetes and hypertension. Understanding the spatial interplay between the different structures of the nephron and renal vasculature is crucial. Recent efforts have demonstrated the value of three-dimensional (3D) imaging in revealing new insights into the various components of the kidney; however, these studies used antibodies or autofluorescence to detect structures and so were limited in their ability to compare the many subtle structures of the kidney at once. Here, through 3D reconstruction of fetal rhesus macaque kidneys at cellular resolution, we demonstrate the power of deep learning in exhaustively labelling seventeen microstructures of the kidney. Using these tissue maps, we interrogate the spatial distribution and spatial correlation of the glomeruli, renal arteries, and the nephron. This work demonstrates the power of deep learning applied to 3D tissue images to improve our ability to compare many microanatomical structures at once, paving the way for further works investigating renal pathologies.

MIM-CyCIF: masked imaging modeling for enhancing cyclic immunofluorescence (CyCIF) with panel reduction and imputation

Cyclic Immunofluorescence (CyCIF) can quantify multiple biomarkers, but panel capacity is limited by technical challenges. We propose a computational panel reduction approach that can impute the information content from 25 markers using only 9 markers, learning co-expression and morphological patterns while concurrently increasing speed and panel content and decreasing cost. We demonstrate strong correlations in predictions and generalizability across breast and colorectal cancer, illustrating applicability of our approach to diverse tissue types.

Phase II Study of Eribulin plus Pembrolizumab in Metastatic Soft-tissue Sarcomas: Clinical Outcomes and Biological Correlates

PURPOSE

Eribulin modulates the tumor-immune microenvironment via cGAS-STING signaling in preclinical models. This non-randomized phase II trial evaluated the combination of eribulin and pembrolizumab in patients with soft-tissue sarcomas (STS).

PATIENTS AND METHODS

Patients enrolled in one of three cohorts: leiomyosarcoma (LMS), liposarcomas (LPS), or other STS that may benefit from PD-1 inhibitors, including undifferentiated pleomorphic sarcoma (UPS). Eribulin was administered at 1.4 mg/m2 i.v. (days 1 and 8) with fixed-dose pembrolizumab 200 mg i.v. (day 1) of each 21-day cycle, until progression, unacceptable toxicity, or completion of 2 years of treatment. The primary endpoint was the 12-week progression-free survival rate (PFS-12) in each cohort. Secondary endpoints included the objective response rate, median PFS, safety profile, and overall survival (OS). Pretreatment and on-treatment blood specimens were evaluated in patients who achieved durable disease control (DDC) or progression within 12 weeks [early progression (EP)]. Multiplexed immunofluorescence was performed on archival LPS samples from patients with DDC or EP.

RESULTS

Fifty-seven patients enrolled (LMS, n = 19; LPS, n = 20; UPS/Other, n = 18). The PFS-12 was 36.8% (90% confidence interval: 22.5-60.4) for LMS, 69.6% (54.5-89.0) for LPS, and 52.6% (36.8-75.3) for UPS/Other cohorts. All 3 patients in the UPS/Other cohort with angiosarcoma achieved RECIST responses. Toxicity was manageable. Higher IFNα and IL4 serum levels were associated with clinical benefit. Immune aggregates expressing PD-1 and PD-L1 were observed in a patient that completed 2 years of treatment.

CONCLUSIONS

The combination of eribulin and pembrolizumab demonstrated promising activity in LPS and angiosarcoma.

Multiplexed 3D Analysis of Immune States and Niches in Human Tissue

Tissue homeostasis and the emergence of disease are controlled by changes in the proportions of resident and recruited cells, their organization into cellular neighbourhoods, and their interactions with acellular tissue components. Highly multiplexed tissue profiling (spatial omics)1 makes it possible to study this microenvironment in situ, usually in 4-5 micron thick sections (the standard histopathology format)2. Microscopy-based tissue profiling is commonly performed at a resolution sufficient to determine cell types but not to detect subtle morphological features associated with cytoskeletal reorganisation, juxtracrine signalling, or membrane trafficking3. Here we describe a high-resolution 3D imaging approach able to characterize a wide variety of organelles and structures at sub-micron scale while simultaneously quantifying millimetre-scale spatial features. This approach combines cyclic immunofluorescence (CyCIF) imaging4 of over 50 markers with confocal microscopy of archival human tissue thick enough (30-40 microns) to fully encompass two or more layers of intact cells. 3D imaging of entire cell volumes substantially improves the accuracy of cell phenotyping and allows cell proximity to be scored using plasma membrane apposition, not just nuclear position. In pre-invasive melanoma in situ5, precise phenotyping shows that adjacent melanocytic cells are plastic in state and participate in tightly localised niches of interferon signalling near sites of initial invasion into the underlying dermis. In this and metastatic melanoma, mature and precursor T cells engage in an unexpectedly diverse array of juxtracrine and membrane-membrane interactions as well as looser "neighbourhood" associations6 whose morphologies reveal functional states. These data provide new insight into the transitions occurring during early tumour formation and immunoediting and demonstrate the potential for phenotyping of tissues at a level of detail previously restricted to cultured cells and organoids.

Generative interpolation and restoration of images using deep learning for improved 3D tissue mapping

The development of novel imaging platforms has improved our ability to collect and analyze large three-dimensional (3D) biological imaging datasets. Advances in computing have led to an ability to extract complex spatial information from these data, such as the composition, morphology, and interactions of multi-cellular structures, rare events, and integration of multi-modal features combining anatomical, molecular, and transcriptomic (among other) information. Yet, the accuracy of these quantitative results is intrinsically limited by the quality of the input images, which can contain missing or damaged regions, or can be of poor resolution due to mechanical, temporal, or financial constraints. In applications ranging from intact imaging (e.g. light-sheet microscopy and magnetic resonance imaging) to sectioning based platforms (e.g. serial histology and serial section transmission electron microscopy), the quality and resolution of imaging data has become paramount. Here, we address these challenges by leveraging frame interpolation for large image motion (FILM), a generative AI model originally developed for temporal interpolation, for spatial interpolation of a range of 3D image types. Comparative analysis demonstrates the superiority of FILM over traditional linear interpolation to produce functional synthetic images, due to its ability to better preserve biological information including microanatomical features and cell counts, as well as image quality, such as contrast, variance, and luminance. FILM repairs tissue damages in images and reduces stitching artifacts. We show that FILM can decrease imaging time by synthesizing skipped images. We demonstrate the versatility of our method with a wide range of imaging modalities (histology, tissue-clearing/light-sheet microscopy, magnetic resonance imaging, serial section transmission electron microscopy), species (human, mouse), healthy and diseased tissues (pancreas, lung, brain), staining techniques (IHC, H&E), and pixel resolutions (8 nm, 2 μm, 1mm). Overall, we demonstrate the potential of generative AI in improving the resolution, throughput, and quality of biological image datasets, enabling improved 3D imaging.

SpatialCells: automated profiling of tumor microenvironments with spatially resolved multiplexed single-cell data

Cancer is a complex cellular ecosystem where malignant cells coexist and interact with immune, stromal and other cells within the tumor microenvironment (TME). Recent technological advancements in spatially resolved multiplexed imaging at single-cell resolution have led to the generation of large-scale and high-dimensional datasets from biological specimens. This underscores the necessity for automated methodologies that can effectively characterize molecular, cellular and spatial properties of TMEs for various malignancies. This study introduces SpatialCells, an open-source software package designed for region-based exploratory analysis and comprehensive characterization of TMEs using multiplexed single-cell data. The source code and tutorials are available at https://semenovlab.github.io/SpatialCells. SpatialCells efficiently streamlines the automated extraction of features from multiplexed single-cell data and can process samples containing millions of cells. Thus, SpatialCells facilitates subsequent association analyses and machine learning predictions, making it an essential tool in advancing our understanding of tumor growth, invasion and metastasis.

The multimodality cell segmentation challenge: toward universal solutions

Cell segmentation is a critical step for quantitative single-cell analysis in microscopy images. Existing cell segmentation methods are often tailored to specific modalities or require manual interventions to specify hyper-parameters in different experimental settings. Here, we present a multimodality cell segmentation benchmark, comprising more than 1,500 labeled images derived from more than 50 diverse biological experiments. The top participants developed a Transformer-based deep-learning algorithm that not only exceeds existing methods but can also be applied to diverse microscopy images across imaging platforms and tissue types without manual parameter adjustments. This benchmark and the improved algorithm offer promising avenues for more accurate and versatile cell analysis in microscopy imaging.

Quality Control for Single Cell Analysis of High-plex Tissue Profiles using CyLinter

Tumors are complex assemblies of cellular and acellular structures patterned on spatial scales from microns to centimeters. Study of these assemblies has advanced dramatically with the introduction of high-plex spatial profiling. Image-based profiling methods reveal the intensities and spatial distributions of 20-100 proteins at subcellular resolution in 103-107 cells per specimen. Despite extensive work on methods for extracting single-cell data from these images, all tissue images contain artefacts such as folds, debris, antibody aggregates, optical aberrations and image processing errors that arise from imperfections in specimen preparation, data acquisition, image assembly, and feature extraction. We show that these artefacts dramatically impact single-cell data analysis, obscuring meaningful biological interpretation. We describe an interactive quality control software tool, CyLinter, that identifies and removes data associated with imaging artefacts. CyLinter greatly improves single-cell analysis, especially for archival specimens sectioned many years prior to data collection, such as those from clinical trials.

3-Dimensional Reconstruction From Histopathological Sections: A Systematic Review

Although pathological tissue analysis is typically performed on single 2-dimensional (2D) histologic reference slides, 3-dimensional (3D) reconstruction from a sequence of histologic sections could provide novel opportunities for spatial analysis of the extracted tissue. In this review, we analyze recent works published after 2018 and report information on the extracted tissue types, the section thickness, and the number of sections used for reconstruction. By analyzing the technological requirements for 3D reconstruction, we observe that software tools exist, both free and commercial, which include the functionality to perform 3D reconstruction from a sequence of histologic images. Through the analysis of the most recent works, we provide an overview of the workflows and tools that are currently used for 3D reconstruction from histologic sections and address points for future work, such as a missing common file format or computer-aided analysis of the reconstructed model.

3DCellComposer - A Versatile Pipeline Utilizing 2D Cell Segmentation Methods for 3D Cell Segmentation

Background

Cell segmentation is crucial in bioimage informatics, as its accuracy directly impacts conclusions drawn from cellular analyses. While many approaches to 2D cell segmentation have been described, 3D cell segmentation has received much less attention. 3D segmentation faces significant challenges, including limited training data availability due to the difficulty of the task for human annotators, and inherent three-dimensional complexity. As a result, existing 3D cell segmentation methods often lack broad applicability across different imaging modalities.

Results

To address this, we developed a generalizable approach for using 2D cell segmentation methods to produce accurate 3D cell segmentations. We implemented this approach in 3DCellComposer, a versatile, open-source package that allows users to choose any existing 2D segmentation model appropriate for their tissue or cell type(s) without requiring any additional training. Importantly, we have enhanced our open source CellSegmentationEvaluator quality evaluation tool to support 3D images. It provides metrics that allow selection of the best approach for a given imaging source and modality, without the need for human annotations to assess performance. Using these metrics, we demonstrated that our approach produced high-quality 3D segmentations of tissue images, and that it could outperform an existing 3D segmentation method on the cell culture images with which it was trained.

Conclusions

3DCellComposer, when paired with well-trained 2D segmentation models, provides an important alternative to acquiring human-annotated 3D images for new sample types or imaging modalities and then training 3D segmentation models using them. It is expected to be of significant value for large scale projects such as the Human BioMolecular Atlas Program.

Multiplex protein imaging in tumour biology

Tissue imaging has become much more colourful in the past decade. Advances in both experimental and analytical methods now make it possible to image protein markers in tissue samples in high multiplex. The ability to routinely image 40-50 markers simultaneously, at single-cell or subcellular resolution, has opened up new vistas in the study of tumour biology. Cellular phenotypes, interaction, communication and spatial organization have become amenable to molecular-level analysis, and application to patient cohorts has identified clinically relevant cellular and tissue features in several cancer types. Here, we review the use of multiplex protein imaging methods to study tumour biology, discuss ongoing attempts to combine these approaches with other forms of spatial omics, and highlight challenges in the field.

Integrating single-cell multi-omics and prior biological knowledge for a functional characterization of the immune system

The immune system comprises diverse specialized cell types that cooperate to defend the host against a wide range of pathogenic threats. Recent advancements in single-cell and spatial multi-omics technologies provide rich information about the molecular state of immune cells. Here, we review how the integration of single-cell and spatial multi-omics data with prior knowledge-gathered from decades of detailed biochemical studies-allows us to obtain functional insights, focusing on gene regulatory processes and cell-cell interactions. We present diverse applications in immunology and critically assess underlying assumptions and limitations. Finally, we offer a perspective on the ongoing technological and algorithmic developments that promise to get us closer to a systemic mechanistic understanding of the immune system.

The multivisceral landscape of colorectal cancer metastasis: implications for targeted therapies

Colorectal cancer (CRC) is among the most common cancer types and the second deadliest malignancy for both sexes. Metastatic disease poses substantial therapeutic challenges, and peritoneal spread, in particular, reduces quality of life and has a dismal outcome. In this issue of the JCI, Berlin and authors have made considerable advancements in understanding the cellular and molecular composition of multivisceral CRC metastasis in a sophisticated murine orthotopic organoid model and in humans. The study provides unprecedented insights into the complex biology of the disease and points toward the development of compartmentalized immune-therapeutic strategies.

SOX17 enables immune evasion of early colorectal adenomas and cancers

A hallmark of cancer is the avoidance of immune destruction. This process has been primarily investigated in locally advanced or metastatic cancer1-3; however, much less is known about how pre-malignant or early invasive tumours evade immune detection. Here, to understand this process in early colorectal cancers (CRCs), we investigated how naive colon cancer organoids that were engineered in vitro to harbour Apc-null, KrasG12D and Trp53-null (AKP) mutations adapted to the in vivo native colonic environment. Comprehensive transcriptomic and chromatin analyses revealed that the endoderm-specifying transcription factor SOX17 became strongly upregulated in vivo. Notably, whereas SOX17 loss did not affect AKP organoid propagation in vitro, its loss markedly reduced the ability of AKP tumours to persist in vivo. The small fraction of SOX17-null tumours that grew displayed notable interferon-γ (IFNγ)-producing effector-like CD8+ T cell infiltrates in contrast to the immune-suppressive microenvironment in wild-type counterparts. Mechanistically, in both endogenous Apc-null pre-malignant adenomas and transplanted organoid-derived AKP CRCs, SOX17 suppresses the ability of tumour cells to sense and respond to IFNγ, preventing anti-tumour T cell responses. Finally, SOX17 engages a fetal intestinal programme that drives differentiation away from LGR5+ tumour cells to produce immune-evasive LGR5- tumour cells with lower expression of major histocompatibility complex class I (MHC-I). We propose that SOX17 is a transcription factor that is engaged during the early steps of colon cancer to orchestrate an immune-evasive programme that permits CRC initiation and progression.

How important is EMT for cancer metastasis?

Epithelial-to-mesenchymal transition (EMT), a biological phenomenon of cellular plasticity initially reported in embryonic development, has been increasingly recognized for its importance in cancer progression and metastasis. Despite tremendous progress being made in the past 2 decades in our understanding of the molecular mechanism and functional importance of EMT in cancer, there are several mysteries around EMT that remain unresolved. In this Unsolved Mystery, we focus on the variety of EMT types in metastasis, cooperative and collective EMT behaviors, spatiotemporal characterization of EMT, and strategies of therapeutically targeting EMT. We also highlight new technical advances that will facilitate the efforts to elucidate the unsolved mysteries of EMT in metastasis.

Unravelling the role of long non-coding RNAs in modulating the Hedgehog pathway in cancer

Cancer is a multifactorial pathological condition characterized by uncontrolled cellular proliferation, genomic instability, and evasion of regulatory mechanisms. It arises from the accumulation of genetic mutations confer selective growth advantages, leading to malignant transformation and tumor formation. The intricate interplay between LncRNAs and the Hedgehog pathway has emerged as a captivating frontier in cancer research. The Hedgehog pathway, known for its fundamental roles in embryonic development and tissue homeostasis, is frequently dysregulated in various cancers, contributing to aberrant cellular proliferation, survival, and differentiation. The Hh pathway is crucial in organizing growth and maturation processes in multicellular organisms. It plays a pivotal role in the initiation of tumors as well as in conferring resistance to conventional therapeutic approaches. The crosstalk among the Hh pathway and lncRNAs affects the expression of Hh signaling components through various transcriptional and post-transcriptional processes. Numerous pathogenic processes, including both non-malignant and malignant illnesses, have been identified to be induced by this interaction. The dysregulation of lncRNAs has been associated with the activation or inhibition of the Hh pathway, making it a potential therapeutic target against tumorigenesis. Insights into the functional significance of LncRNAs in Hedgehog pathway modulation provide promising avenues for diagnostic and therapeutic interventions. The dysregulation of LncRNAs in various cancer types underscores their potential as biomarkers for early detection and prognostication. Additionally, targeting LncRNAs associated with the Hedgehog pathway presents an innovative strategy for developing precision therapeutics to restore pathway homeostasis and impede cancer progression. This review aims to elucidate the complex regulatory network orchestrated by LncRNAs, unravelling their pivotal roles in modulating the Hedgehog pathway and influencing cancer progression.

Quantitative multiplex immunohistochemistry reveals inter-patient lymphovascular and immune heterogeneity in primary cutaneous melanoma

Introduction

Quantitative, multiplexed imaging is revealing complex spatial relationships between phenotypically diverse tumor infiltrating leukocyte populations and their prognostic implications. The underlying mechanisms and tissue structures that determine leukocyte distribution within and around tumor nests, however, remain poorly understood. While presumed players in metastatic dissemination, new preclinical data demonstrates that blood and lymphatic vessels (lymphovasculature) also dictate leukocyte trafficking within tumor microenvironments and thereby impact anti-tumor immunity. Here we interrogate these relationships in primary human cutaneous melanoma.

Methods

We established a quantitative, multiplexed imaging platform to simultaneously detect immune infiltrates and tumor-associated vessels in formalin-fixed paraffin embedded patient samples. We performed a discovery, retrospective analysis of 28 treatment-naïve, primary cutaneous melanomas.

Results

Here we find that the lymphvasculature and immune infiltrate is heterogenous across patients in treatment naïve, primary melanoma. We categorized five lymphovascular subtypes that differ by functionality and morphology and mapped their localization in and around primary tumors. Interestingly, the localization of specific vessel subtypes, but not overall vessel density, significantly associated with the presence of lymphoid aggregates, regional progression, and intratumoral T cell infiltrates.

Discussion

We describe a quantitative platform to enable simultaneous lymphovascular and immune infiltrate analysis and map their spatial relationships in primary melanoma. Our data indicate that tumor-associated vessels exist in different states and that their localization may determine potential for metastasis or immune infiltration. This platform will support future efforts to map tumor-associated lymphovascular evolution across stage, assess its prognostic value, and stratify patients for adjuvant therapy.

Mapping cancer biology in space: applications and perspectives on spatial omics for oncology

Technologies to decipher cellular biology, such as bulk sequencing technologies and single-cell sequencing technologies, have greatly assisted novel findings in tumor biology. Recent findings in tumor biology suggest that tumors construct architectures that influence the underlying cancerous mechanisms. Increasing research has reported novel techniques to map the tissue in a spatial context or targeted sampling-based characterization and has introduced such technologies to solve oncology regarding tumor heterogeneity, tumor microenvironment, and spatially located biomarkers. In this study, we address spatial technologies that can delineate the omics profile in a spatial context, novel findings discovered via spatial technologies in oncology, and suggest perspectives regarding therapeutic approaches and further technological developments.

Qualification of a multiplexed tissue imaging assay and detection of novel patterns of HER2 heterogeneity in breast cancer

Emerging data suggests that HER2 intratumoral heterogeneity (ITH) is associated with therapy resistance, highlighting the need for new strategies to assess HER2 ITH. A promising approach is leveraging multiplexed tissue analysis techniques such as cyclic immunofluorescence (CyCIF), which enable visualization and quantification of 10-60 antigens at single-cell resolution from individual tissue sections. In this study, we qualified a breast cancer-specific antibody panel, including HER2, ER, and PR, for multiplexed tissue imaging. We then compared the performance of these antibodies against established clinical standards using pixel-, cell- and tissue-level analyses, utilizing 866 tissue cores (representing 294 patients). To ensure reliability, the CyCIF antibodies were qualified against HER2 immunohistochemistry (IHC) and fluorescence in situ hybridization (FISH) data from the same samples. Our findings demonstrate the successful qualification of a breast cancer antibody panel for CyCIF, showing high concordance with established clinical antibodies. Subsequently, we employed the qualified antibodies, along with antibodies for CD45, CD68, PD-L1, p53, Ki67, pRB, and AR, to characterize 567 HER2+ invasive breast cancer samples from 189 patients. Through single-cell analysis, we identified four distinct cell clusters within HER2+ breast cancer exhibiting heterogeneous HER2 expression. Furthermore, these clusters displayed variations in ER, PR, p53, AR, and PD-L1 expression. To quantify the extent of heterogeneity, we calculated heterogeneity scores based on the diversity among these clusters. Our analysis revealed expression patterns that are relevant to breast cancer biology, with correlations to HER2 ITH and potential relevance to clinical outcomes.

Inferring super-resolution tissue architecture by integrating spatial transcriptomics with histology

Spatial transcriptomics (ST) has demonstrated enormous potential for generating intricate molecular maps of cells within tissues. Here we present iStar, a method based on hierarchical image feature extraction that integrates ST data and high-resolution histology images to predict spatial gene expression with super-resolution. Our method enhances gene expression resolution to near-single-cell levels in ST and enables gene expression prediction in tissue sections where only histology images are available.

Residency Octree: A Hybrid Approach for Scalable Web-Based Multi-Volume Rendering

We present a hybrid multi-volume rendering approach based on a novel Residency Octree that combines the advantages of out-of-core volume rendering using page tables with those of standard octrees. Octree approaches work by performing hierarchical tree traversal. However, in octree volume rendering, tree traversal and the selection of data resolution are intrinsically coupled. This makes fine-grained empty-space skipping costly. Page tables, on the other hand, allow access to any cached brick from any resolution. However, they do not offer a clear and efficient strategy for substituting missing high-resolution data with lower-resolution data. We enable flexible mixed-resolution out-of-core multi-volume rendering by decoupling the cache residency of multi-resolution data from a resolution-independent spatial subdivision determined by the tree. Instead of one-to-one node-to-brick correspondences, each residency octree node is mapped to a set of bricks from different resolution levels. This makes it possible to efficiently and adaptively choose and mix resolutions, adapt sampling rates, and compensate for cache misses. At the same time, residency octrees support fine-grained empty-space skipping, independent of the data subdivision used for caching. Finally, to facilitate collaboration and outreach, and to eliminate local data storage, our implementation is a web-based, pure client-side renderer using WebGPU and WebAssembly. Our method is faster than prior approaches and efficient for many data channels with a flexible and adaptive choice of data resolution.

Engineering the future of 3D pathology

In recent years, technological advances in tissue preparation, high-throughput volumetric microscopy, and computational infrastructure have enabled rapid developments in nondestructive 3D pathology, in which high-resolution histologic datasets are obtained from thick tissue specimens, such as whole biopsies, without the need for physical sectioning onto glass slides. While 3D pathology generates massive datasets that are attractive for automated computational analysis, there is also a desire to use 3D pathology to improve the visual assessment of tissue histology. In this perspective, we discuss and provide examples of potential advantages of 3D pathology for the visual assessment of clinical specimens and the challenges of dealing with large 3D datasets (of individual or multiple specimens) that pathologists have not been trained to interpret. We discuss the need for artificial intelligence triaging algorithms and explainable analysis methods to assist pathologists or other domain experts in the interpretation of these novel, often complex, large datasets.

Solid tumor growth depends on an intricate equilibrium of malignant cell states

Control of cell identity and number is central to tissue function, yet principles governing organization of malignant cells in tumor tissues remain poorly understood. Using mathematical modeling and candidate-based analysis, we discover primary and metastatic pancreatic ductal adenocarcinoma (PDAC) organize in a stereotypic pattern whereby PDAC cells responding to WNT signals (WNT-R) neighbor WNT-secreting cancer cells (WNT-S). Leveraging lineage-tracing, we reveal the WNT-R state is transient and gives rise to the WNT-S state that is highly stable and committed to organizing malignant tissue. We further show that a subset of WNT-S cells expressing the Notch ligand DLL1 form a functional niche for WNT-R cells. Genetic inactivation of WNT secretion or Notch pathway components, or cytoablation of the WNT-S state disrupts PDAC tissue organization, suppressing tumor growth and metastasis. This work indicates PDAC growth depends on an intricately controlled equilibrium of functionally distinct cancer cell states, uncovering a fundamental principle governing solid tumor growth and revealing new opportunities for therapeutic intervention.

Cancer-Associated Fibroblast-Like Tumor Cells Remodel the Ewing Sarcoma Tumor Microenvironment

PURPOSE

Despite limited genetic and histologic heterogeneity, Ewing sarcoma (EwS) tumor cells are transcriptionally heterogeneous and display varying degrees of mesenchymal lineage specification in vitro. In this study, we investigated if and how transcriptional heterogeneity of EwS cells contributes to heterogeneity of tumor phenotypes in vivo.

EXPERIMENTAL DESIGN

Single-cell proteogenomic-sequencing of EwS cell lines was performed and integrated with patient tumor transcriptomic data. Cell subpopulations were isolated by FACS for assessment of gene expression and phenotype. Digital spatial profiling and human whole transcriptome analysis interrogated transcriptomic heterogeneity in EwS xenografts. Tumor cell subpopulations and matrix protein deposition were evaluated in xenografts and patient tumors using multiplex immunofluorescence staining.

RESULTS

We identified CD73 as a biomarker of highly mesenchymal EwS cell subpopulations in tumor models and patient biopsies. CD73+ tumor cells displayed distinct transcriptional and phenotypic properties, including selective upregulation of genes that are repressed by EWS::FLI1, and increased migratory potential. CD73+ cells were distinguished in vitro and in vivo by increased expression of matrisomal genes and abundant deposition of extracellular matrix (ECM) proteins. In epithelial-derived malignancies, ECM is largely deposited by cancer-associated fibroblasts (CAF), and we thus labeled CD73+ EwS cells, CAF-like tumor cells. Marked heterogeneity of CD73+ EwS cell frequency and distribution was detected in tumors in situ, and CAF-like tumor cells and associated ECM were observed in peri-necrotic regions and invasive foci.

CONCLUSIONS

EwS tumor cells can adopt CAF-like properties, and these distinct cell subpopulations contribute to tumor heterogeneity by remodeling the tumor microenvironment. See related commentary by Kuo and Amatruda, p. 5002.

Heterogeneity of tertiary lymphoid structures in cancer

The success of immunotherapy approaches, such as immune checkpoint blockade and cellular immunotherapy with genetically modified lymphocytes, has firmly embedded the immune system in the roadmap for combating cancer. Unfortunately, the majority of cancer patients do not yet benefit from these therapeutic approaches, even when the prognostic relevance of the immune response in their tumor entity has been demonstrated. Therefore, there is a justified need to explore new strategies for inducing anti-tumor immunity. The recent connection between the formation of ectopic lymphoid aggregates at tumor sites and patient prognosis, along with an effective anti-tumor response, suggests that manipulating the occurrence of these tertiary lymphoid structures (TLS) may play a critical role in activating the immune system against a growing tumor. However, mechanisms governing TLS formation and a clear understanding of their substantial heterogeneity are still lacking. Here, we briefly summarize the current state of knowledge regarding the mechanisms driving TLS development, outline the impact of TLS heterogeneity on clinical outcomes in cancer patients, and discuss appropriate systems for modeling TLS heterogeneity that may help identify new strategies for inducing protective TLS formation in cancer patients.

Targeting the epigenome to reinvigorate T cells for cancer immunotherapy

Cancer immunotherapy using immune-checkpoint inhibitors (ICIs) has revolutionized the field of cancer treatment; however, ICI efficacy is constrained by progressive dysfunction of CD8+ tumor-infiltrating lymphocytes (TILs), which is termed T cell exhaustion. This process is driven by diverse extrinsic factors across heterogeneous tumor immune microenvironment (TIME). Simultaneously, tumorigenesis entails robust reshaping of the epigenetic landscape, potentially instigating T cell exhaustion. In this review, we summarize the epigenetic mechanisms governing tumor microenvironmental cues leading to T cell exhaustion, and discuss therapeutic potential of targeting epigenetic regulators for immunotherapies. Finally, we outline conceptual and technical advances in developing potential treatment paradigms involving immunostimulatory agents and epigenetic therapies.

Power-law growth models explain incidences and sizes of pancreatic cancer precursor lesions and confirm spatial genomic findings

Pancreatic ductal adenocarcinoma is a rare but lethal cancer. Recent evidence reveals that pancreatic intraepithelial neoplasms (PanINs), the microscopic precursor lesions in the pancreatic ducts that can give rise to invasive pancreatic cancer, are significantly larger and more prevalent than previously believed. Better understanding of the growth law dynamics of PanINs may improve our ability to understand how a miniscule fraction of these lesions makes the transition to invasive cancer. Here, using artificial intelligence (AI)-based three-dimensional (3D) tissue mapping method, we measured the volumes of >1,000 PanIN and found that lesion size is distributed according to a power law with a fitted exponent of -1.7 over > 3 orders of magnitude. Our data also suggest that PanIN growth is not very sensitive to the pancreatic microenvironment or an individual's age, family history, and lifestyle, and is rather shaped by general growth behavior. We analyze several models of PanIN growth and fit the predicted size distributions to the observed data. The best fitting models suggest that both intraductal spread of PanIN lesions and fusing of multiple lesions into large, highly branched structures drive PanIN growth patterns. This work lays the groundwork for future mathematical modeling efforts integrating PanIN incidence, morphology, genomic, and transcriptomic features to understand pancreas tumorigenesis, and demonstrates the utility of combining experimental measurement of human tissues with dynamic modeling for understanding cancer tumorigenesis.

Increased multiplexity in optical tissue clearing-based 3D immunofluorescence microscopy of the tumor microenvironment by LED photobleaching

Optical tissue clearing and three-dimensional (3D) immunofluorescence (IF) microscopy have been transforming imaging of the complex tumor microenvironment (TME). However, current 3D IF microscopy has restricted multiplexity; only three or four cellular and non-cellular TME components can be localized in a cleared tumor tissue. Here we report a LED photobleaching method and its application for 3D multiplexed optical mapping of the TME. We built a high-power LED light irradiation device and temperature-controlled chamber for completely bleaching fluorescent signals throughout optically cleared tumor tissues without compromise of tissue and protein antigen integrity. With newly developed tissue mounting and selected region-tracking methods, we established a cyclic workflow involving IF staining, tissue clearing, 3D confocal microscopy, and LED photobleaching. By registering microscope channel images generated through three work cycles, we produced 8-plex image data from individual 400 μm-thick tumor macrosections that visualize various vascular, immune, and cancer cells in the same TME at tissue-wide and cellular levels in 3D. Our method was also validated for quantitative 3D spatial analysis of cellular remodeling in the TME after immunotherapy. These results demonstrate that our LED photobleaching system and its workflow offer a novel approach to increase the multiplexing power of 3D IF microscopy for studying tumor heterogeneity and response to therapy.

Decoding the tumor microenvironment with spatial technologies

Visualization of the cellular heterogeneity and spatial architecture of the tumor microenvironment (TME) is becoming increasingly important to understand mechanisms of disease progression and therapeutic response. This is particularly relevant in the era of cancer immunotherapy, in which the contexture of immune cell positioning within the tumor landscape has been proven to affect efficacy. Although single-cell technologies have mostly replaced conventional approaches to analyze specific cellular subsets within tumors, those that integrate a spatial dimension are now on the rise. In this Review, we assess the strengths and limitations of emerging spatial technologies with a focus on their applications in tumor immunology, as well as forthcoming opportunities for artificial intelligence (AI) and the value of integrating multiomics datasets to achieve a holistic picture of the TME.

Cell Spotter (CSPOT): A machine-learning approach to automated cell spotting and quantification of highly multiplexed tissue images

Highly multiplexed tissue imaging and in situ spatial profiling aim to extract single-cell data from specimens containing closely packed cells of diverse morphology. This is challenging due to the difficulty of accurately assigning boundaries between cells (segmentation) and then generating per-cell staining intensities. Existing methods use gating to convert per-cell intensity data to positive and negative scores; this is a common approach in flow cytometry, but one that is problematic in imaging. In contrast, human experts identify cells in crowded environments using morphological, neighborhood, and intensity information. Here we describe a computational approach (Cell Spotter or CSPOT) that uses supervised machine learning in combination with classical segmentation to perform automated cell type calling. CSPOT is robust to artifacts that commonly afflict tissue imaging and can replace conventional gating. The end-to-end Python implementation of CSPOT can be integrated into cloud-based image processing pipelines to substantially improve the speed, accuracy, and reproducibility of single-cell spatial data.

SpatialCells: Automated Profiling of Tumor Microenvironments with Spatially Resolved Multiplexed Single-Cell Data

Background

Cancer is a complex cellular ecosystem where malignant cells coexist and interact with immune, stromal, and other cells within the tumor microenvironment. Recent technological advancements in spatially resolved multiplexed imaging at single-cell resolution have led to the generation of large-scale and high-dimensional datasets from biological specimens. This underscores the necessity for automated methodologies that can effectively characterize the molecular, cellular, and spatial properties of tumor microenvironments for various malignancies.

Results

This study introduces SpatialCells, an open-source software package designed for region-based exploratory analysis and comprehensive characterization of tumor microenvironments using multiplexed single-cell data.

Conclusions

SpatialCells efficiently streamlines the automated extraction of features from multiplexed single-cell data and can process samples containing millions of cells. Thus, SpatialCells facilitates subsequent association analyses and machine learning predictions, making it an essential tool in advancing our understanding of tumor growth, invasion, and metastasis.

Dimension-agnostic and granularity-based spatially variable gene identification using BSP

Identifying spatially variable genes (SVGs) is critical in linking molecular cell functions with tissue phenotypes. Spatially resolved transcriptomics captures cellular-level gene expression with corresponding spatial coordinates in two or three dimensions and can be used to infer SVGs effectively. However, current computational methods may not achieve reliable results and often cannot handle three-dimensional spatial transcriptomic data. Here we introduce BSP (big-small patch), a non-parametric model by comparing gene expression pattens at two spatial granularities to identify SVGs from two or three-dimensional spatial transcriptomics data in a fast and robust manner. This method has been extensively tested in simulations, demonstrating superior accuracy, robustness, and high efficiency. BSP is further validated by substantiated biological discoveries in cancer, neural science, rheumatoid arthritis, and kidney studies with various types of spatial transcriptomics technologies.

2D and 3D multiplexed subcellular profiling of nuclear instability in human cancer

Nuclear atypia, including altered nuclear size, contour, and chromatin organization, is ubiquitous in cancer cells. Atypical primary nuclei and micronuclei can rupture during interphase; however, the frequency, causes, and consequences of nuclear rupture are unknown in most cancers. We demonstrate that nuclear envelope rupture is surprisingly common in many human cancers, particularly glioblastoma. Using highly-multiplexed 2D and super-resolution 3D-imaging of glioblastoma tissues and patient-derived xenografts and cells, we link primary nuclear rupture with reduced lamin A/C and micronuclear rupture with reduced lamin B1. Moreover, ruptured glioblastoma cells activate cGAS-STING-signaling involved in innate immunity. We observe that local patterning of cell states influences tumor spatial organization and is linked to both lamin expression and rupture frequency, with neural-progenitor-cell-like states exhibiting the lowest lamin A/C levels and greatest susceptibility to primary nuclear rupture. Our study reveals that nuclear instability is a core feature of cancer, and links nuclear integrity, cell state, and immune signaling.

3D multiplexed tissue imaging reconstruction and optimized region of interest (ROI) selection through deep learning model of channels embedding

Introduction: Tissue-based sampling and diagnosis are defined as the extraction of information from certain limited spaces and its diagnostic significance of a certain object. Pathologists deal with issues related to tumor heterogeneity since analyzing a single sample does not necessarily capture a representative depiction of cancer, and a tissue biopsy usually only presents a small fraction of the tumor. Many multiplex tissue imaging platforms (MTIs) make the assumption that tissue microarrays (TMAs) containing small core samples of 2-dimensional (2D) tissue sections are a good approximation of bulk tumors although tumors are not 2D. However, emerging whole slide imaging (WSI) or 3D tumor atlases that use MTIs like cyclic immunofluorescence (CyCIF) strongly challenge this assumption. In spite of the additional insight gathered by measuring the tumor microenvironment in WSI or 3D, it can be prohibitively expensive and time-consuming to process tens or hundreds of tissue sections with CyCIF. Even when resources are not limited, the criteria for region of interest (ROI) selection in tissues for downstream analysis remain largely qualitative and subjective as stratified sampling requires the knowledge of objects and evaluates their features. Despite the fact TMAs fail to adequately approximate whole tissue features, a theoretical subsampling of tissue exists that can best represent the tumor in the whole slide image. Methods: To address these challenges, we propose deep learning approaches to learn multi-modal image translation tasks from two aspects: 1) generative modeling approach to reconstruct 3D CyCIF representation and 2) co-embedding CyCIF image and Hematoxylin and Eosin (H&E) section to learn multi-modal mappings by a cross-domain translation for minimum representative ROI selection. Results and discussion: We demonstrate that generative modeling enables a 3D virtual CyCIF reconstruction of a colorectal cancer specimen given a small subset of the imaging data at training time. By co-embedding histology and MTI features, we propose a simple convex optimization for objective ROI selection. We demonstrate the potential application of ROI selection and the efficiency of its performance with respect to cellular heterogeneity.

Be like water, my cells: cell plasticity and the art of transformation

Cellular plasticity defines the capacity of cells to adopt distinct identities during development, tissue homeostasis and regeneration. Dynamic fluctuations between different states, within or across lineages, are regulated by changes in chromatin accessibility and in gene expression. When deregulated, cellular plasticity can contribute to cancer initiation and progression. Cancer cells are remarkably plastic which contributes to phenotypic and functional heterogeneity within tumours as well as resistance to targeted therapies. It is for these reasons that the scientific community has become increasingly interested in understanding the molecular mechanisms governing cancer cell plasticity. The purpose of this mini-review is to discuss different examples of cellular plasticity associated with metaplasia and epithelial-mesenchymal transition with a focus on therapy resistance.

The seductive allure of spatial biology: accelerating new discoveries in the life sciences

Spatial biology is a rapidly developing field which enables the visualization of protein and transcriptomic data while preserving tissue context and architecture. Initially used in discovery, there is growing promise for translational and diagnostic assay developments. Immediate applications are in precision medicine, such as being able to match patients to optimal therapies through better understanding the tumor microenvironment. However, it also has ramifications for many other disciplines (e.g. immunology, cancer, infectious disease and digital pathology). With increasingly massive data sets being generated, data storage, curation, analysis and sharing require more computational approaches and artificial intelligence-powered tools to fully utilize spatial tools. Here, we discuss spatial biology as an important convergent science approach to tackling complex global challenges in areas such as health.

Neoadjuvant botensilimab plus balstilimab response pattern in locally advanced mismatch repair proficient colorectal cancer

In patients with locally advanced cancer without distant metastases, the neoadjuvant setting presents a platform to evaluate new drugs. For mismatch repair proficient/microsatellite stable (pMMR/MSS) colon and rectal cancer, immunotherapy has shown limited efficacy. Herein, we report exceptional responses observed with neoadjuvant botensilimab (BOT), an Fc-enhanced next-generation anti-CTLA-4 antibody, alongside balstilimab (BAL; an anti-PD-1 antibody) in two patients with pMMR/MSS colon and rectal cancer. The histological pattern of rapid immune response observed ("inside-out" (serosa-to-mucosa) tumor regression) has not been described previously in this setting. Spatial biology analyses (RareCyte Inc.) reveal mechanisms of actions of BOT, a novel innate-adaptive immune activator. These observations have downstream implications for clinical trial designs using neoadjuvant immunotherapy and potentially sparing patients chemotherapy.

GammaGateR: semi-automated marker gating for single-cell multiplexed imaging

Motivation

Multiplexed immunofluorescence (mIF) is an emerging assay for multichannel protein imaging that can decipher cell-level spatial features in tissues. However, existing automated cell phenotyping methods, such as clustering, face challenges in achieving consistency across experiments and often require subjective evaluation. As a result, mIF analyses often revert to marker gating based on manual thresholding of raw imaging data.

Results

To address the need for an evaluable semi-automated algorithm, we developed GammaGateR, an R package for interactive marker gating designed specifically for segmented cell-level data from mIF images. Based on a novel closed-form gamma mixture model, GammaGateR provides estimates of marker-positive cell proportions and soft clustering of marker-positive cells. The model incorporates user-specified constraints that provide a consistent but slide-specific model fit. We compared GammaGateR against the newest unsupervised approach for annotating mIF data, employing two colon datasets and one ovarian cancer dataset for the evaluation. We showed that GammaGateR produces highly similar results to a silver standard established through manual annotation. Furthermore, we demonstrated its effectiveness in identifying biological signals, achieved by mapping known spatial interactions between CD68 and MUC5AC cells in the colon and by accurately predicting survival in ovarian cancer patients using the phenotype probabilities as input for machine learning methods. GammaGateR is a highly efficient tool that can improve the replicability of marker gating results, while reducing the time of manual segmentation.

Availability and Implementation

The R package is available at https://github.com/JiangmeiRubyXiong/GammaGateR.

MIM-CyCIF: Masked Imaging Modeling for Enhancing Cyclic Immunofluorescence (CyCIF) with Panel Reduction and Imputation

CyCIF can quantify multiple biomarkers, but panel capacity is limited by technical challenges. We propose a computational panel reduction approach that can impute the information content from 25 markers using only 9 markers, learning co-expression and morphological patterns while concurrently increasing speed and panel content and decreasing cost. We demonstrate strong correlations in predictions and generalizability across breast and colorectal cancer, illustrating applicability of our approach to diverse tissue types.

Novel insights from spatial transcriptome analysis in solid tumors

Since its first application in 2016, spatial transcriptomics has become a rapidly evolving technology in recent years. Spatial transcriptomics enables transcriptomic data to be acquired from intact tissue sections and provides spatial distribution information and remedies the disadvantage of single-cell RNA sequencing (scRNA-seq), whose data lack spatially resolved information. Presently, spatial transcriptomics has been widely applied to various tissue types, especially for the study of tumor heterogeneity. In this review, we provide a summary of the research progress in utilizing spatial transcriptomics to investigate tumor heterogeneity and the microenvironment with a focus on solid tumors. We summarize the research breakthroughs in various fields and perspectives due to the application of spatial transcriptomics, including cell clustering and interaction, cellular metabolism, gene expression, immune cell programs and combination with other techniques. As a combination of multiple transcriptomics, single-cell multiomics shows its superiority and validity in single-cell analysis. We also discuss the application prospect of single-cell multiomics, and we believe that with the progress of data integration from various transcriptomics, a multilayered subcellular landscape will be revealed.