Interpretable deep learning uncovers cellular properties in label-free live cell images that are predictive of highly metastatic melanoma

Representation of high-dimensional cell morphology and morphodynamics in 2D latent space

The morphology and morphodynamics of cells as important biomarkers of the cellular state are widely appreciated in both fundamental research and clinical applications. Quantification of cell morphology often requires a large number of geometric measures that form a high-dimensional feature vector. This mathematical representation creates barriers to communicating, interpreting, and visualizing data. Here, we develop a deep learning-based algorithm to project 13-dimensional (13D) morphological feature vectors into 2-dimensional (2D) morphological latent space (MLS). We show that the projection has less than 5% information loss and separates the different migration phenotypes of metastatic breast cancer cells. Using the projection, we demonstrate the phenotype-dependent motility of breast cancer cells in the 3D extracellular matrix, and the continuous cell state change upon drug treatment. We also find that dynamics in the 2D MLS quantitatively agrees with the morphodynamics of cells in the 13D feature space, preserving the diffusive power and the Lyapunov exponent of cell shape fluctuations even though the dimensional reduction projection is highly nonlinear. Our results suggest that MLS is a powerful tool to represent and understand the cell morphology and morphodynamics.

Autonomous learning of pathologists' cancer grading rules

Deep learning (DL) algorithms have demonstrated remarkable proficiency in histopathology classification tasks, presenting an opportunity to discover disease-related features escaping visual inspection. However, the "black box" nature of DL obfuscates the basis of the classification. Here, we develop an algorithm for interpretable Deep Learning (IDL) that sheds light on the links between tissue morphology and cancer biology. We make use of a generative model trained to represent images via a combination of a semantic latent space and a noise vector to capture low level image details. We traversed the latent space so as to induce prototypical image changes associated with the disease state, which we identified via a second DL model. Applied to a dataset of clear cell renal cell carcinoma (ccRCC) tissue images the AI system pinpoints nuclear size and nucleolus density in tumor cells (but not other cell types) as the decisive features of tumor progression from grade 1 to grade 4 - mirroring the rules that have been used for decades in the clinic and are taught in textbooks. Moreover, the AI system posits a decrease in vasculature with increasing grade. While the association has been illustrated by some previous reports, the correlation is not part of currently implemented grading systems. These results indicate the potential of IDL to autonomously formalize the connection between the histopathological presentation of a disease and the underlying tissue architectural drivers.

Automated prediction of fibroblast phenotypes using mathematical descriptors of cellular features

Fibrosis is caused by pathological activation of resident fibroblasts to myofibroblasts that leads to aberrant tissue stiffening and diminished function of affected organs with limited pharmacological interventions. Despite the prevalence of myofibroblasts in fibrotic tissue, existing methods to grade fibroblast phenotypes are typically subjective and qualitative, yet important for screening of new therapeutics. Here, we develop mathematical descriptors of cell morphology and intracellular structures to identify quantitative and interpretable cell features that capture the fibroblast-to-myofibroblast phenotypic transition in immunostained images. We train and validate models on features extracted from over 3000 primary heart valve interstitial cells and test their predictive performance on cells treated with the small molecule drugs 5-azacytidine and bisperoxovanadium (HOpic), which inhibited and promoted myofibroblast activation, respectively. Collectively, this work introduces an analytical framework that unveils key features associated with distinct fibroblast phenotypes via quantitative image analysis and is broadly applicable for high-throughput screening assays of candidate treatments for fibrotic diseases.

Deep learning-based image classification reveals heterogeneous execution of cell death fates during viral infection

Cell fate decisions, such as proliferation, differentiation, and death, are driven by complex molecular interactions and signaling cascades. While significant progress has been made in understanding the molecular determinants of these processes, historically, cell fate transitions were identified through light microscopy that focused on changes in cell morphology and function. Modern techniques have shifted toward probing molecular effectors to quantify these transitions, offering more precise quantification and mechanistic understanding. However, challenges remain in cases where the molecular signals are ambiguous, complicating the assignment of cell fate. During viral infection, programmed cell death (PCD) pathways, including apoptosis, necroptosis, and pyroptosis, exhibit complex signaling and molecular cross-talk. This can lead to simultaneous activation of multiple PCD pathways, which confounds assignment of cell fate based on molecular information alone. To address this challenge, we employed deep learning-based image classification of dying cells to analyze PCD in single herpes simplex virus-1 (HSV-1)-infected cells. Our approach reveals that despite heterogeneous activation of signaling, individual cells adopt predominantly prototypical death morphologies. Nevertheless, PCD is executed heterogeneously within a uniform population of virus-infected cells and varies over time. These findings demonstrate that image-based phenotyping can provide valuable insights into cell fate decisions, complementing molecular assays.

Machine learning approaches for image classification in developmental biology and clinical embryology

The rapid increase in the amount of available biological data together with increasing computational power and innovative new machine learning algorithms has resulted in great potential for machine learning approaches to revolutionise image analysis in developmental biology and clinical embryology. In this Spotlight, we provide an introduction to machine learning for developmental biologists interested in incorporating machine learning techniques into their research. We give an overview of essential machine learning concepts and models and describe a few recent examples of how these techniques can be used in developmental biology. We also briefly discuss latest advancements in the field and how it might develop in the future.

A highly efficient, scalable pipeline for fixed feature extraction from large-scale high-content imaging screens

Applying artificial intelligence (AI) to image-based morphological profiling cells offers significant potential for identifying disease states and drug responses in high-content imaging (HCI) screens. When differences between populations (e.g., healthy vs. diseased) are unknown or imperceptible to the human eye, large-scale HCI screens are essential, providing numerous replicates to build reliable models and accounting for confounding factors like donor and intra-experimental variations. As screen sizes grow, so does the challenge of analyzing high-dimensional datasets in an efficient way while preserving interpretable features and predictive power. Here, we introduce ScaleFEx℠, a memory-efficient, open-source Python pipeline that extracts biologically meaningful features from HCI datasets using minimal computational resources or scalable cloud infrastructure. ScaleFEx can be used together with AI models to successfully identify phenotypic shifts in drug-treated cells and rank interpretable features, and is applicable to public datasets, highlighting its potential to accelerate the discovery of disease-associated phenotypes and new therapeutics.

Computational Methods for Image Analysis in Craniofacial Development and Disease

Observation is at the center of all biological sciences. Advances in imaging technologies are therefore essential to derive novel biological insights to better understand the complex workings of living systems. Recent high-throughput sequencing and imaging techniques are allowing researchers to simultaneously address complex molecular variations spatially and temporarily in tissues and organs. The availability of increasingly large dataset sizes has allowed for the evolution of robust deep learning models, designed to interrogate biomedical imaging data. These models are emerging as transformative tools in diagnostic medicine. Combined, these advances allow for dynamic, quantitative, and predictive observations of entire organisms and tissues. Here, we address 3 main tasks of bioimage analysis, image restoration, segmentation, and tracking and discuss new computational tools allowing for 3-dimensional spatial genomics maps. Finally, we demonstrate how these advances have been applied in studies of craniofacial development and oral disease pathogenesis.

Interpretable Fine-Grained Phenotypes of Subcellular Dynamics via Unsupervised Deep Learning

Uncovering fine-grained phenotypes of live cell dynamics is pivotal for a comprehensive understanding of the heterogeneity in healthy and diseased biological processes. However, this endeavor poses significant technical challenges for unsupervised machine learning, requiring the extraction of features that not only faithfully preserve this heterogeneity but also effectively discriminate between established biological states, all while remaining interpretable. To tackle these challenges, a self-training deep learning framework designed for fine-grained and interpretable phenotyping is presented. This framework incorporates an unsupervised teacher model with interpretable features to facilitate feature learning in a student deep neural network (DNN). Significantly, an autoencoder-based regularizer is designed to encourage the student DNN to maximize the heterogeneity associated with molecular perturbations. This method enables the acquisition of features with enhanced discriminatory power, while simultaneously preserving the heterogeneity associated with molecular perturbations. This study successfully delineated fine-grained phenotypes within the heterogeneous protrusion dynamics of migrating epithelial cells, revealing specific responses to pharmacological perturbations. Remarkably, this framework adeptly captured a concise set of highly interpretable features uniquely linked to these fine-grained phenotypes, each corresponding to specific temporal intervals crucial for their manifestation. This unique capability establishes it as a valuable tool for investigating diverse cellular dynamics and their heterogeneity.

A self-supervised embedding of cell migration features for behavior discovery over cell populations

BACKGROUND AND OBJECTIVE

Recent studies point out that the dynamics and interaction of cell populations within their environment are related to several biological processes in immunology. Hence, single-cell analysis in immunology now relies on spatial omics. Moreover, recent literature suggests that immunology scenarios are hierarchically organized, including unknown cell behaviors appearing in different proportions across some observable control and therapy groups. These dynamic behaviors play a crucial role in identifying the causes of processes such as inflammation, aging, and fighting off pathogens or cancerous cells. In this work, we use a self-supervised learning approach to discover these behaviors associated with cell dynamics in an immunology scenario.

MATERIALS AND METHODS

Specifically, we study the different responses of control group and therapy groups in a scenario involving inflammation due to infarct, with a focus on neutrophil migration within blood vessels. Starting from a set of hand-crafted spatio-temporal features, we use a recurrent neural network to generate embeddings that properly describe the dynamics of the migration processes. The network is trained using a novel multi-task contrastive loss that, on the one hand, models the hierarchical structure of our scenario (groups-behaviors-samples) and, on the other, ensures temporal consistency within the embedding, enforcing that subsequent temporal samples obtained from a given cell stay close in the latent space.

RESULTS

Our experimental results demonstrate that the resulting embeddings improve the separability of cell behaviors and log-likelihood of the therapies, when compared to the hand-crafted feature extraction and recent methods from the state of the art, even with dimensionality reduction (16 vs. 21 hand-crafted features).

CONCLUSIONS

Our approach enables single-cell analyses at a population level, being able to automatically discover shared behaviors among different groups. This, in turn, enables the prediction of the therapy effectiveness based on their proportions within a study group.

A novel pipeline employing deep multi-attention channels network for the autonomous detection of metastasizing cells through fluorescence microscopy

Metastasis driven by cancer cell migration is the leading cause of cancer-related deaths. It involves significant changes in the organization of the cytoskeleton, which includes the actin microfilaments and the vimentin intermediate filaments. Understanding how these filament change cells from normal to invasive offers insights that can be used to improve cancer diagnosis and therapy. We have developed a computational, transparent, large-scale and imaging-based pipeline, that can distinguish between normal human cells and their isogenically matched, oncogenically transformed, invasive and metastasizing counterparts, based on the spatial organization of actin and vimentin filaments in the cell cytoplasm. Due to the intricacy of these subcellular structures, manual annotation is not trivial to automate. We used established deep learning methods and our new multi-attention channel architecture. To ensure a high level of interpretability of the network, which is crucial for the application area, we developed an interpretable global explainable approach correlating the weighted geometric mean of the total cell images and their local GradCam scores. The methods offer detailed, objective and measurable understanding of how different components of the cytoskeleton contribute to metastasis, insights that can be used for future development of novel diagnostic tools, such as a nanometer level, vimentin filament-based biomarker for digital pathology, and for new treatments that significantly can increase patient survival.

Interpreting Neural Operators: How Nonlinear Waves Propagate in Nonreciprocal Solids

We present a data-driven pipeline for model building that combines interpretable machine learning, hydrodynamic theories, and microscopic models. The goal is to uncover the underlying processes governing nonlinear dynamics experiments. We exemplify our method with data from microfluidic experiments where crystals of streaming droplets support the propagation of nonlinear waves absent in passive crystals. By combining physics-inspired neural networks, known as neural operators, with symbolic regression tools, we infer the solution, as well as the mathematical form, of a nonlinear dynamical system that accurately models the experimental data. Finally, we interpret this continuum model from fundamental physics principles. Informed by machine learning, we coarse grain a microscopic model of interacting droplets and discover that nonreciprocal hydrodynamic interactions stabilize and promote nonlinear wave propagation.

Mantis: High-throughput 4D imaging and analysis of the molecular and physical architecture of cells

High-throughput dynamic imaging of cells and organelles is essential for understanding complex cellular responses. We report Mantis, a high-throughput 4D microscope that integrates two complementary, gentle, live-cell imaging technologies: remote-refocus label-free microscopy and oblique light-sheet fluorescence microscopy. Additionally, we report shrimPy (Smart High-throughput Robust Imaging and Measurement in Python), an open-source software for high-throughput imaging, deconvolution, and single-cell phenotyping of 4D data. Using Mantis and shrimPy, we achieved high-content correlative imaging of molecular dynamics and the physical architecture of 20 cell lines every 15 min over 7.5 h. This platform also facilitated detailed measurements of the impacts of viral infection on the architecture of host cells and host proteins. The Mantis platform can enable high-throughput profiling of intracellular dynamics, long-term imaging and analysis of cellular responses to perturbations, and live-cell optical screens to dissect gene regulatory networks.

Visual interpretability of image-based classification models by generative latent space disentanglement applied to in vitro fertilization

The success of deep learning in identifying complex patterns exceeding human intuition comes at the cost of interpretability. Non-linear entanglement of image features makes deep learning a "black box" lacking human meaningful explanations for the models' decision. We present DISCOVER, a generative model designed to discover the underlying visual properties driving image-based classification models. DISCOVER learns disentangled latent representations, where each latent feature encodes a unique classification-driving visual property. This design enables "human-in-the-loop" interpretation by generating disentangled exaggerated counterfactual explanations. We apply DISCOVER to interpret classification of in vitro fertilization embryo morphology quality. We quantitatively and systematically confirm the interpretation of known embryo properties, discover properties without previous explicit measurements, and quantitatively determine and empirically verify the classification decision of specific embryo instances. We show that DISCOVER provides human-interpretable understanding of "black box" classification models, proposes hypotheses to decipher underlying biomedical mechanisms, and provides transparency for the classification of individual predictions.

Applying interpretable machine learning in computational biology-pitfalls, recommendations and opportunities for new developments

Recent advances in machine learning have enabled the development of next-generation predictive models for complex computational biology problems, thereby spurring the use of interpretable machine learning (IML) to unveil biological insights. However, guidelines for using IML in computational biology are generally underdeveloped. We provide an overview of IML methods and evaluation techniques and discuss common pitfalls encountered when applying IML methods to computational biology problems. We also highlight open questions, especially in the era of large language models, and call for collaboration between IML and computational biology researchers.

Deep learning identifies heterogeneous subpopulations in breast cancer cell lines

Motivation

Cells exhibit a wide array of morphological features, enabling computer vision methods to identify and track relevant parameters. Morphological analysis has long been implemented to identify specific cell types and cell responses. Here we asked whether morphological features might also be used to classify transcriptomic subpopulations within in vitro cancer cell lines. Identifying cell subpopulations furthers our understanding of morphology as a reflection of underlying cell phenotype and could enable a better understanding of how subsets of cells compete and cooperate in disease progression and treatment.

Results

We demonstrate that cell morphology can reflect underlying transcriptomic differences in vitro using convolutional neural networks. First, we find that changes induced by chemotherapy treatment are highly identifiable in a breast cancer cell line. We then show that the intra cell line subpopulations that comprise breast cancer cell lines under standard growth conditions are also identifiable using cell morphology. We find that cell morphology is influenced by neighborhood effects beyond the cell boundary, and that including image information surrounding the cell can improve model discrimination ability.

Microfluidic characterization of single-cell biophysical properties and the applications in cancer diagnosis

Single-cell biophysical properties play a crucial role in regulating cellular physiological states and functions, demonstrating significant potential in the fields of life sciences and clinical diagnostics. Therefore, over the last few decades, researchers have developed various detection tools to explore the relationship between the biophysical changes of biological cells and human diseases. With the rapid advancement of modern microfabrication technology, microfluidic devices have quickly emerged as a promising platform for single-cell analysis offering advantages including high-throughput, exceptional precision, and ease of manipulation. Consequently, this paper provides an overview of the recent advances in microfluidic analysis and detection systems for single-cell biophysical properties and their applications in the field of cancer. The working principles and latest research progress of single-cell biophysical property detection are first analyzed, highlighting the significance of electrical and mechanical properties. The development of data acquisition and processing methods for real-time, high-throughput, and practical applications are then discussed. Furthermore, the differences in biophysical properties between tumor and normal cells are outlined, illustrating the potential for utilizing single-cell biophysical properties for tumor cell identification, classification, and drug response assessment. Lastly, we summarize the limitations of existing microfluidic analysis and detection systems in single-cell biophysical properties, while also pointing out the prospects and future directions of their applications in cancer diagnosis and treatment.

Using deep learning to decipher the impact of telomerase promoter mutations on the dynamic metastatic morpholome

Melanoma showcases a complex interplay of genetic alterations and intra- and inter-cellular morphological changes during metastatic transformation. While pivotal, the role of specific mutations in dictating these changes still needs to be fully elucidated. Telomerase promoter mutations (TERTp mutations) significantly influence melanoma's progression, invasiveness, and resistance to various emerging treatments, including chemical inhibitors, telomerase inhibitors, targeted therapy, and immunotherapies. We aim to understand the morphological and phenotypic implications of the two dominant monoallelic TERTp mutations, C228T and C250T, enriched in melanoma metastasis. We developed isogenic clonal cell lines containing the TERTp mutations and utilized dual-color expression reporters steered by the endogenous Telomerase promoter, giving us allelic resolution. This approach allowed us to monitor morpholomic variations induced by these mutations. TERTp mutation-bearing cells exhibited significant morpholome differences from their wild-type counterparts, with increased allele expression patterns, augmented wound-healing rates, and unique spatiotemporal dynamics. Notably, the C250T mutation exerted more pronounced changes in the morpholome than C228T, suggesting a differential role in metastatic potential. Our findings underscore the distinct influence of TERTp mutations on melanoma's cellular architecture and behavior. The C250T mutation may offer a unique morpholomic and systems-driven advantage for metastasis. These insights provide a foundational understanding of how a non-coding mutation in melanoma metastasis affects the system, manifesting in cellular morpholome.

Single-cell morphodynamical trajectories enable prediction of gene expression accompanying cell state change

Extracellular signals induce changes to molecular programs that modulate multiple cellular phenotypes, including proliferation, motility, and differentiation status. The connection between dynamically adapting phenotypic states and the molecular programs that define them is not well understood. Here we develop data-driven models of single-cell phenotypic responses to extracellular stimuli by linking gene transcription levels to "morphodynamics" - changes in cell morphology and motility observable in time-lapse image data. We adopt a dynamics-first view of cell state by grouping single-cell trajectories into states with shared morphodynamic responses. The single-cell trajectories enable development of a first-of-its-kind computational approach to map live-cell dynamics to snapshot gene transcript levels, which we term MMIST, Molecular and Morphodynamics-Integrated Single-cell Trajectories. The key conceptual advance of MMIST is that cell behavior can be quantified based on dynamically defined states and that extracellular signals alter the overall distribution of cell states by altering rates of switching between states. We find a cell state landscape that is bound by epithelial and mesenchymal endpoints, with distinct sequences of epithelial to mesenchymal transition (EMT) and mesenchymal to epithelial transition (MET) intermediates. The analysis yields predictions for gene expression changes consistent with curated EMT gene sets and provides a prediction of thousands of RNA transcripts through extracellular signal-induced EMT and MET with near-continuous time resolution. The MMIST framework leverages true single-cell dynamical behavior to generate molecular-level omics inferences and is broadly applicable to other biological domains, time-lapse imaging approaches and molecular snapshot data.

Perspective on quantitative phase imaging to improve precision cancer medicine

Significance

Quantitative phase imaging (QPI) offers a label-free approach to non-invasively characterize cellular processes by exploiting their refractive index based intrinsic contrast. QPI captures this contrast by translating refractive index associated phase shifts into intensity-based quantifiable data with nanoscale sensitivity. It holds significant potential for advancing precision cancer medicine by providing quantitative characterization of the biophysical properties of cells and tissue in their natural states.

Aim

This perspective aims to discuss the potential of QPI to increase our understanding of cancer development and its response to therapeutics. It also explores new developments in QPI methods towards advancing personalized cancer therapy and early detection.

Approach

We begin by detailing the technical advancements of QPI, examining its implementations across transmission and reflection geometries and phase retrieval methods, both interferometric and non-interferometric. The focus then shifts to QPI's applications in cancer research, including dynamic cell mass imaging for drug response assessment, cancer risk stratification, and in-vivo tissue imaging.

Results

QPI has emerged as a crucial tool in precision cancer medicine, offering insights into tumor biology and treatment efficacy. Its sensitivity to detecting nanoscale changes holds promise for enhancing cancer diagnostics, risk assessment, and prognostication. The future of QPI is envisioned in its integration with artificial intelligence, morpho-dynamics, and spatial biology, broadening its impact in cancer research.

Conclusions

QPI presents significant potential in advancing precision cancer medicine and redefining our approach to cancer diagnosis, monitoring, and treatment. Future directions include harnessing high-throughput dynamic imaging, 3D QPI for realistic tumor models, and combining artificial intelligence with multi-omics data to extend QPI's capabilities. As a result, QPI stands at the forefront of cancer research and clinical application in cancer care.

PIFiA: self-supervised approach for protein functional annotation from single-cell imaging data

Fluorescence microscopy data describe protein localization patterns at single-cell resolution and have the potential to reveal whole-proteome functional information with remarkable precision. Yet, extracting biologically meaningful representations from cell micrographs remains a major challenge. Existing approaches often fail to learn robust and noise-invariant features or rely on supervised labels for accurate annotations. We developed PIFiA (Protein Image-based Functional Annotation), a self-supervised approach for protein functional annotation from single-cell imaging data. We imaged the global yeast ORF-GFP collection and applied PIFiA to generate protein feature profiles from single-cell images of fluorescently tagged proteins. We show that PIFiA outperforms existing approaches for molecular representation learning and describe a range of downstream analysis tasks to explore the information content of the feature profiles. Specifically, we cluster extracted features into a hierarchy of functional organization, study cell population heterogeneity, and develop techniques to distinguish multi-localizing proteins and identify functional modules. Finally, we confirm new PIFiA predictions using a colocalization assay, suggesting previously unappreciated biological roles for several proteins. Paired with a fully interactive website ( https://thecellvision.org/pifia/ ), PIFiA is a resource for the quantitative analysis of protein organization within the cell.

Toward a predictive understanding of epithelial cell death

Epithelial cell death is highly prevalent during development and tissue homeostasis. While we have a rather good understanding of the molecular regulators of programmed cell death, especially for apoptosis, we still fail to predict when, where, how many and which specific cells will die in a tissue. This likely relies on the much more complex picture of apoptosis regulation in a tissular and epithelial context, which entails cell autonomous but also non-cell autonomous factors, diverse feedback and multiple layers of regulation of the commitment to apoptosis. In this review, we illustrate this complexity of epithelial apoptosis regulation by describing these different layers of control, all demonstrating that local cell death probability is a complex emerging feature. We first focus on non-cell autonomous factors that can locally modulate the rate of cell death, including cell competition, mechanical input and geometry as well as systemic effects. We then describe the multiple feedback mechanisms generated by cell death itself. We also outline the multiple layers of regulation of epithelial cell death, including the coordination of extrusion and regulation occurring downstream of effector caspases. Eventually, we propose a roadmap to reach a more predictive understanding of cell death regulation in an epithelial context.

Cell morphology best predicts tumorigenicity and metastasis in vivo across multiple TNBC cell lines of different metastatic potential

BACKGROUND

Metastasis is the leading cause of death in breast cancer patients. For metastasis to occur, tumor cells must invade locally, intravasate, and colonize distant tissues and organs, all steps that require tumor cell migration. The majority of studies on invasion and metastasis rely on human breast cancer cell lines. While it is known that these cells have different properties and abilities for growth and metastasis, the in vitro morphological, proliferative, migratory, and invasive behavior of these cell lines and their correlation to in vivo behavior is poorly understood. Thus, we sought to classify each cell line as poorly or highly metastatic by characterizing tumor growth and metastasis in a murine model of six commonly used human triple-negative breast cancer xenografts, as well as determine which in vitro assays commonly used to study cell motility best predict in vivo metastasis.

METHODS

We evaluated the liver and lung metastasis of human TNBC cell lines MDA-MB-231, MDA-MB-468, BT549, Hs578T, BT20, and SUM159 in immunocompromised mice. We characterized each cell line's cell morphology, proliferation, and motility in 2D and 3D to determine the variation in these parameters between cell lines.

RESULTS

We identified MDA-MB-231, MDA-MB-468, and BT549 cells as highly tumorigenic and metastatic, Hs578T as poorly tumorigenic and metastatic, BT20 as intermediate tumorigenic with poor metastasis to the lungs but highly metastatic to the livers, and SUM159 as intermediate tumorigenic but poorly metastatic to the lungs and livers. We showed that metrics that characterize cell morphology are the most predictive of tumor growth and metastatic potential to the lungs and liver. Further, we found that no single in vitro motility assay in 2D or 3D significantly correlated with metastasis in vivo.

CONCLUSIONS

Our results provide an important resource for the TNBC research community, identifying the metastatic potential of 6 commonly used cell lines. Our findings also support the use of cell morphological analysis to investigate the metastatic potential and emphasize the need for multiple in vitro motility metrics using multiple cell lines to represent the heterogeneity of metastasis in vivo.

Machine learning inference of continuous single-cell state transitions during myoblast differentiation and fusion

Cells modify their internal organization during continuous state transitions, supporting functions from cell division to differentiation. However, tools to measure dynamic physiological states of individual transitioning cells are lacking. We combined live-cell imaging and machine learning to monitor ERK1/2-inhibited primary murine skeletal muscle precursor cells, that transition rapidly and robustly from proliferating myoblasts to post-mitotic myocytes and then fuse, forming multinucleated myotubes. Our models, trained using motility or actin intensity features from single-cell tracking data, effectively tracked real-time continuous differentiation, revealing that differentiation occurs 7.5-14.5 h post induction, followed by fusion ~3 h later. Co-inhibition of ERK1/2 and p38 led to differentiation without fusion. Our model inferred co-inhibition leads to terminal differentiation, indicating that p38 is specifically required for transitioning from terminal differentiation to fusion. Our model also predicted that co-inhibition leads to changes in actin dynamics. Mass spectrometry supported these in silico predictions and suggested novel fusion and maturation regulators downstream of differentiation. Collectively, this approach can be adapted to various biological processes to uncover novel links between dynamic single-cell states and their functional outcomes.

Machine learning interpretable models of cell mechanics from protein images

Cellular form and function emerge from complex mechanochemical systems within the cytoplasm. Currently, no systematic strategy exists to infer large-scale physical properties of a cell from its molecular components. This is an obstacle to understanding processes such as cell adhesion and migration. Here, we develop a data-driven modeling pipeline to learn the mechanical behavior of adherent cells. We first train neural networks to predict cellular forces from images of cytoskeletal proteins. Strikingly, experimental images of a single focal adhesion (FA) protein, such as zyxin, are sufficient to predict forces and can generalize to unseen biological regimes. Using this observation, we develop two approaches-one constrained by physics and the other agnostic-to construct data-driven continuum models of cellular forces. Both reveal how cellular forces are encoded by two distinct length scales. Beyond adherent cell mechanics, our work serves as a case study for integrating neural networks into predictive models for cell biology.

Particulate matter composition drives differential molecular and morphological responses in lung epithelial cells

Particulate matter (PM) is a ubiquitous component of air pollution that is epidemiologically linked to human pulmonary diseases. PM chemical composition varies widely, and the development of high-throughput experimental techniques enables direct profiling of cellular effects using compositionally unique PM mixtures. Here, we show that in a human bronchial epithelial cell model, exposure to three chemically distinct PM mixtures drive unique cell viability patterns, transcriptional remodeling, and the emergence of distinct morphological subtypes. Specifically, PM mixtures modulate cell viability, DNA damage responses, and induce the remodeling of gene expression associated with cell morphology, extracellular matrix organization, and cellular motility. Profiling cellular responses showed that cell morphologies change in a PM composition-dependent manner. Finally, we observed that PM mixtures with higher cadmium content induced increased DNA damage and drove redistribution among morphological subtypes. Our results demonstrate that quantitative measurement of individual cellular morphologies provides a robust, high-throughput approach to gauge the effects of environmental stressors on biological systems and score cellular susceptibilities to pollution.

Cusp bifurcation in a metastatic regulatory network

Understanding the potential for cancers to metastasize is still relatively unknown. While many predictive methods may use deep learning or stochastic processes, we highlight a long standing mathematical concept that may be useful for modeling metastatic breast cancer systems. Ordinary differential equations (ODEs) can model cell state transitions by considering the pertinent environmental variables as well as the paths systems take over time. Bifurcation theory is a branch of dynamical systems which studies changes in the behavior of an ODE system while one or more parameters are varied. Many studies have applied concepts in one-parameter bifurcation theory to model biological network dynamics, and cell division. However, studies of two-parameter bifurcations are much more rare. Two-parameter bifurcations have not been studied in metastatic systems. Here we show how a specific two-parameter bifurcation phenomenon called a cusp bifurcation separates two qualitatively different metastatic cell state transitions modalities and propose a new perspective on defining such transitions based on mathematical theory. We hope the observations and verification methods detailed here may help in the understanding of metastatic potential from a basic biological perspective and in clinical settings.

Bridging live-cell imaging and next-generation cancer treatment

By providing spatial, molecular and morphological data over time, live-cell imaging can provide a deeper understanding of the cellular and signalling events that determine cancer response to treatment. Understanding this dynamic response has the potential to enhance clinical outcome by identifying biomarkers or actionable targets to improve therapeutic efficacy. Here, we review recent applications of live-cell imaging for uncovering both tumour heterogeneity in treatment response and the mode of action of cancer-targeting drugs. Given the increasing uses of T cell therapies, we discuss the unique opportunity of time-lapse imaging for capturing the interactivity and motility of immunotherapies. Although traditionally limited in the number of molecular features captured, novel developments in multidimensional imaging and multi-omics data integration offer strategies to connect single-cell dynamics to molecular phenotypes. We review the effect of these recent technological advances on our understanding of the cellular dynamics of tumour targeting and discuss their implication for next-generation precision medicine.

Evolution and impact of high content imaging

The field of high content imaging has steadily evolved and expanded substantially across many industry and academic research institutions since it was first described in the early 1990's. High content imaging refers to the automated acquisition and analysis of microscopic images from a variety of biological sample types. Integration of high content imaging microscopes with multiwell plate handling robotics enables high content imaging to be performed at scale and support medium- to high-throughput screening of pharmacological, genetic and diverse environmental perturbations upon complex biological systems ranging from 2D cell cultures to 3D tissue organoids to small model organisms. In this perspective article the authors provide a collective view on the following key discussion points relevant to the evolution of high content imaging: • Evolution and impact of high content imaging: An academic perspective • Evolution and impact of high content imaging: An industry perspective • Evolution of high content image analysis • Evolution of high content data analysis pipelines towards multiparametric and phenotypic profiling applications • The role of data integration and multiomics • The role and evolution of image data repositories and sharing standards • Future perspective of high content imaging hardware and software.

Generative models of morphogenesis in developmental biology

Understanding the mechanism by which cells coordinate their differentiation and migration is critical to our understanding of many fundamental processes such as wound healing, disease progression, and developmental biology. Mathematical models have been an essential tool for testing and developing our understanding, such as models of cells as soft spherical particles, reaction-diffusion systems that couple cell movement to environmental factors, and multi-scale multi-physics simulations that combine bottom-up rule-based models with continuum laws. However, mathematical models can often be loosely related to data or have so many parameters that model behaviour is weakly constrained. Recent methods in machine learning introduce new means by which models can be derived and deployed. In this review, we discuss examples of mathematical models of aspects of developmental biology, such as cell migration, and how these models can be combined with these recent machine learning methods.

Big data in contemporary electron microscopy: challenges and opportunities in data transfer, compute and management

The second decade of the twenty-first century witnessed a new challenge in the handling of microscopy data. Big data, data deluge, large data, data compliance, data analytics, data integrity, data interoperability, data retention and data lifecycle are terms that have introduced themselves to the electron microscopy sciences. This is largely attributed to the booming development of new microscopy hardware tools. As a result, large digital image files with an average size of one terabyte within one single acquisition session is not uncommon nowadays, especially in the field of cryogenic electron microscopy. This brings along numerous challenges in data transfer, compute and management. In this review, we will discuss in detail the current state of international knowledge on big data in contemporary electron microscopy and how big data can be transferred, computed and managed efficiently and sustainably. Workflows, solutions, approaches and suggestions will be provided, with the example of the latest experiences in Australia. Finally, important principles such as data integrity, data lifetime and the FAIR and CARE principles will be considered.

Spatial topology of organelle is a new breast cancer cell classifier

Genomics and proteomics have been central to identify tumor cell populations, but more accurate approaches to classify cell subtypes are still lacking. We propose a new methodology to accurately classify cancer cells based on their organelle spatial topology. Herein, we developed an organelle topology-based cell classification pipeline (OTCCP), which integrates artificial intelligence (AI) and imaging quantification to analyze organelle spatial distribution and inter-organelle topology. OTCCP was used to classify a panel of human breast cancer cells, grown as 2D monolayer or 3D tumor spheroids using early endosomes, mitochondria, and their inter-organelle contacts. Organelle topology allows for a highly precise differentiation between cell lines of different subtypes and aggressiveness. These findings lay the groundwork for using organelle topological profiling as a fast and efficient method for phenotyping breast cancer function as well as a discovery tool to advance our understanding of cancer cell biology at the subcellular level.

Machine learning enhanced cell tracking

Quantifying cell biology in space and time requires computational methods to detect cells, measure their properties, and assemble these into meaningful trajectories. In this aspect, machine learning (ML) is having a transformational effect on bioimage analysis, now enabling robust cell detection in multidimensional image data. However, the task of cell tracking, or constructing accurate multi-generational lineages from imaging data, remains an open challenge. Most cell tracking algorithms are largely based on our prior knowledge of cell behaviors, and as such, are difficult to generalize to new and unseen cell types or datasets. Here, we propose that ML provides the framework to learn aspects of cell behavior using cell tracking as the task to be learned. We suggest that advances in representation learning, cell tracking datasets, metrics, and methods for constructing and evaluating tracking solutions can all form part of an end-to-end ML-enhanced pipeline. These developments will lead the way to new computational methods that can be used to understand complex, time-evolving biological systems.

Johann Gregor Mendel: the victory of statistics over human imagination

In 2022, we celebrated 200 years since the birth of Johann Gregor Mendel. Although his contributions to science went unrecognized during his lifetime, Mendel not only described the principles of monogenic inheritance but also pioneered the modern way of doing science based on precise experimental data acquisition and evaluation. Novel statistical and algorithmic approaches are now at the center of scientific work, showing that work that is considered marginal in one era can become a mainstream research approach in the next era. The onset of data-driven science caused a shift from hypothesis-testing to hypothesis-generating approaches in science. Mendel is remembered here as a promoter of this approach, and the benefits of big data and statistical approaches are discussed.

Adversarially-Regularized Mixed Effects Deep Learning (ARMED) Models Improve Interpretability, Performance, and Generalization on Clustered (non-iid) Data

Natural science datasets frequently violate assumptions of independence. Samples may be clustered (e.g., by study site, subject, or experimental batch), leading to spurious associations, poor model fitting, and confounded analyses. While largely unaddressed in deep learning, this problem has been handled in the statistics community through mixed effects models, which separate cluster-invariant fixed effects from cluster-specific random effects. We propose a general-purpose framework for Adversarially-Regularized Mixed Effects Deep learning (ARMED) models through non-intrusive additions to existing neural networks: 1) an adversarial classifier constraining the original model to learn only cluster-invariant features, 2) a random effects subnetwork capturing cluster-specific features, and 3) an approach to apply random effects to clusters unseen during training. We apply ARMED to dense, convolutional, and autoencoder neural networks on 4 datasets including simulated nonlinear data, dementia prognosis and diagnosis, and live-cell image analysis. Compared to prior techniques, ARMED models better distinguish confounded from true associations in simulations and learn more biologically plausible features in clinical applications. They can also quantify inter-cluster variance and visualize cluster effects in data. Finally, ARMED matches or improves performance on data from clusters seen during training (5-28% relative improvement) and generalization to unseen clusters (2-9% relative improvement) versus conventional models.

Cell morphology best predicts tumorigenicity and metastasis in vivo across multiple TNBC cell lines of different metastatic potential

Background

Metastasis is the leading cause of death in breast cancer patients. For metastasis to occur, tumor cells must invade locally, intravasate, and colonize distant tissues and organs, all steps that require tumor cell migration. The majority of studies on invasion and metastasis rely on human breast cancer cell lines. While it is known that these cells have different properties and abilities for growth and metastasis, the in vitro morphological, proliferative, migratory, and invasive behavior of these cell lines and their correlation to in vivo behavior is poorly understood. Thus, we sought to classify each cell line as poorly or highly metastatic by characterizing tumor growth and metastasis in a murine model of six commonly used human triple-negative breast cancer xenografts, as well as determine which in vitro assays commonly used to study cell motility best predict in vivo metastasis.

Methods

We evaluated the liver and lung metastasis of human TNBC cell lines MDA-MB-231, MDA-MB-468, BT549, Hs578T, BT20, and SUM159 in immunocompromised mice. We characterized each cell line's cell morphology, proliferation, and motility in 2D and 3D to determine the variation in these parameters between cell lines.

Results

We identified MDA-MB-231, MDA-MB-468, and BT549 cells as highly tumorigenic and metastatic, Hs578T as poorly tumorigenic and metastatic, BT20 as intermediate tumorigenic with poor metastasis to the lungs but highly metastatic to the livers, and SUM159 as intermediate tumorigenic but poorly metastatic to the lungs and livers. We showed that metrics that characterize cell morphology are the most predictive of tumor growth and metastatic potential to the lungs and liver. Further, we found that no single in vitro motility assay in 2D or 3D significantly correlated with metastasis in vivo.

Conclusions

Our results provide an important resource for the TNBC research community, identifying the metastatic potential of 6 commonly used cell lines. Our findings also support the use of cell morphological analysis to investigate the metastatic potential and emphasize the need for multiple in vitro motility metrics using multiple cell lines to represent the heterogeneity of metastasis in vivo.

Particulate matter composition drives differential molecular and morphological responses in lung epithelial cells

Particulate matter (PM) is a ubiquitous component of indoor and outdoor air pollution that is epidemiologically linked to many human pulmonary diseases. PM has many emission sources, making it challenging to understand the biological effects of exposure due to the high variance in chemical composition. However, the effects of compositionally unique particulate matter mixtures on cells have not been analyzed using both biophysical and biomolecular approaches. Here, we show that in a human bronchial epithelial cell model (BEAS-2B), exposure to three chemically distinct PM mixtures drives unique cell viability patterns, transcriptional remodeling, and the emergence of distinct morphological subtypes. Specifically, PM mixtures modulate cell viability and DNA damage responses and induce the remodeling of gene expression associated with cell morphology, extracellular matrix organization and structure, and cellular motility. Profiling cellular responses showed that cell morphologies change in a PM composition-dependent manner. Lastly, we observed that particulate matter mixtures with high contents of heavy metals, such as cadmium and lead, induced larger drops in viability, increased DNA damage, and drove a redistribution among morphological subtypes. Our results demonstrate that quantitative measurement of cellular morphology provides a robust approach to gauge the effects of environmental stressors on biological systems and determine cellular susceptibilities to pollution.

Optofluidic imaging meets deep learning: from merging to emerging

Propelled by the striking advances in optical microscopy and deep learning (DL), the role of imaging in lab-on-a-chip has dramatically been transformed from a silo inspection tool to a quantitative "smart" engine. A suite of advanced optical microscopes now enables imaging over a range of spatial scales (from molecules to organisms) and temporal window (from microseconds to hours). On the other hand, the staggering diversity of DL algorithms has revolutionized image processing and analysis at the scale and complexity that were once inconceivable. Recognizing these exciting but overwhelming developments, we provide a timely review of their latest trends in the context of lab-on-a-chip imaging, or coined optofluidic imaging. More importantly, here we discuss the strengths and caveats of how to adopt, reinvent, and integrate these imaging techniques and DL algorithms in order to tailor different lab-on-a-chip applications. In particular, we highlight three areas where the latest advances in lab-on-a-chip imaging and DL can form unique synergisms: image formation, image analytics and intelligent image-guided autonomous lab-on-a-chip. Despite the on-going challenges, we anticipate that they will represent the next frontiers in lab-on-a-chip imaging that will spearhead new capabilities in advancing analytical chemistry research, accelerating biological discovery, and empowering new intelligent clinical applications.

Blebs promote cell survival by assembling oncogenic signalling hubs

Most human cells require anchorage for survival. Cell-substrate adhesion activates diverse signalling pathways, without which cells undergo anoikis-a form of programmed cell death1. Acquisition of anoikis resistance is a pivotal step in cancer disease progression, as metastasizing cells often lose firm attachment to surrounding tissue2,3. In these poorly attached states, cells adopt rounded morphologies and form small hemispherical plasma membrane protrusions called blebs4-11. Bleb function has been thoroughly investigated in the context of amoeboid migration, but it has been examined far less in other scenarios12. Here we show by three-dimensional imaging and manipulation of cell morphological states that blebbing triggers the formation of plasma membrane-proximal signalling hubs that confer anoikis resistance. Specifically, in melanoma cells, blebbing generates plasma membrane contours that recruit curvature-sensing septin proteins as scaffolds for constitutively active mutant NRAS and effectors. These signalling hubs activate ERK and PI3K-well-established promoters of pro-survival pathways. Inhibition of blebs or septins has little effect on the survival of well-adhered cells, but in detached cells it causes NRAS mislocalization, reduced MAPK and PI3K activity, and ultimately, death. This unveils a morphological requirement for mutant NRAS to operate as an effective oncoprotein. Furthermore, whereas some BRAF-mutated melanoma cells do not rely on this survival pathway in a basal state, inhibition of BRAF and MEK strongly sensitizes them to both bleb and septin inhibition. Moreover, fibroblasts engineered to sustain blebbing acquire the same anoikis resistance as cancer cells even without harbouring oncogenic mutations. Thus, blebs are potent signalling organelles capable of integrating myriad cellular information flows into concerted cellular responses, in this case granting robust anoikis resistance.

PIFiA: Self-supervised Approach for Protein Functional Annotation from Single-Cell Imaging Data

Fluorescence microscopy data describe protein localization patterns at single-cell resolution and have the potential to reveal whole-proteome functional information with remarkable precision. Yet, extracting biologically meaningful representations from cell micrographs remains a major challenge. Existing approaches often fail to learn robust and noise-invariant features or rely on supervised labels for accurate annotations. We developed PIFiA, (Protein Image-based Functional Annotation), a self-supervised approach for protein functional annotation from single-cell imaging data. We imaged the global yeast ORF-GFP collection and applied PIFiA to generate protein feature profiles from single-cell images of fluorescently tagged proteins. We show that PIFiA outperforms existing approaches for molecular representation learning and describe a range of downstream analysis tasks to explore the information content of the feature profiles. Specifically, we cluster extracted features into a hierarchy of functional organization, study cell population heterogeneity, and develop techniques to distinguish multi-localizing proteins and identify functional modules. Finally, we confirm new PIFiA predictions using a colocalization assay, suggesting previously unappreciated biological roles for several proteins. Paired with a fully interactive website (https://thecellvision.org/pifia/), PIFiA is a resource for the quantitative analysis of protein organization within the cell.

In vivo 3D profiling of site-specific human cancer cell morphotypes in zebrafish

Tissue microenvironments affect the functional states of cancer cells, but determining these influences in vivo has remained a challenge. We present a quantitative high-resolution imaging assay of single cancer cells in zebrafish xenografts to probe functional adaptation to variable cell-extrinsic cues and molecular interventions. Using cell morphology as a surrogate readout of cell functional states, we examine environmental influences on the morphotype distribution of Ewing Sarcoma, a pediatric cancer associated with the oncogene EWSR1-FLI1 and whose plasticity is thought to determine disease outcome through non-genomic mechanisms. Computer vision analysis reveals systematic shifts in the distribution of 3D morphotypes as a function of cell type and seeding site, as well as tissue-specific cellular organizations that recapitulate those observed in human tumors. Reduced expression of the EWSR1-FLI1 protein product causes a shift to more protrusive cells and decreased tissue specificity of the morphotype distribution. Overall, this work establishes a framework for a statistically robust study of cancer cell plasticity in diverse tissue microenvironments.

Quantitative cell imaging approaches to metastatic state profiling

Genetic heterogeneity of metastatic dissemination has proven challenging to identify exploitable markers of metastasis; this bottom-up approach has caused a stalemate between advances in metastasis and the late stage of the disease. Advancements in quantitative cellular imaging have allowed the detection of morphological phenotype changes specific to metastasis, the morphological changes connected to the underlying complex signaling pathways, and a robust readout of metastatic cell state. This review focuses on the recent machine and deep learning developments to gain detailed information about the metastatic cell state using light microscopy. We describe the latest studies using quantitative cell imaging approaches to identify cell appearance-based metastatic patterns. We discuss how quantitative cancer biologists can use these frameworks to work backward toward exploitable hidden drivers in the metastatic cascade and pioneering new Frontier drug discoveries specific for metastasis.

Reconstructing data-driven governing equations for cell phenotypic transitions: integration of data science and systems biology

Cells with the same genome can exist in different phenotypes and can change between distinct phenotypes when subject to specific stimuli and microenvironments. Some examples include cell differentiation during development, reprogramming for induced pluripotent stem cells and transdifferentiation, cancer metastasis and fibrosis progression. The regulation and dynamics of cell phenotypic conversion is a fundamental problem in biology, and has a long history of being studied within the formalism of dynamical systems. A main challenge for mechanism-driven modeling studies is acquiring sufficient amount of quantitative information for constraining model parameters. Advances in quantitative experimental approaches, especially high throughput single-cell techniques, have accelerated the emergence of a new direction for reconstructing the governing dynamical equations of a cellular system from quantitative single-cell data, beyond the dominant statistical approaches. Here I review a selected number of recent studies using live- and fixed-cell data and provide my perspective on future development.

Reconstructing data-driven governing equations for cell phenotypic transitions: integration of data science and systems biology

Cells with the same genome can exist in different phenotypes and can change between distinct phenotypes when subject to specific stimuli and microenvironments. Some examples include cell differentiation during development, reprogramming for induced pluripotent stem cells and transdifferentiation, cancer metastasis and fibrosis progression. The regulation and dynamics of cell phenotypic conversion is a fundamental problem in biology, and has a long history of being studied within the formalism of dynamical systems. A main challenge for mechanism-driven modeling studies is acquiring sufficient amount of quantitative information for constraining model parameters. Advances in quantitative experimental approaches, especially high throughput single-cell techniques, have accelerated the emergence of a new direction for reconstructing the governing dynamical equations of a cellular system from quantitative single-cell data, beyond the dominant statistical approaches. Here I review a selected number of recent studies using live- and fixed-cell data and provide my perspective on future development.

Explainable artificial intelligence in skin cancer recognition: A systematic review

BACKGROUND

Due to their ability to solve complex problems, deep neural networks (DNNs) are becoming increasingly popular in medical applications. However, decision-making by such algorithms is essentially a black-box process that renders it difficult for physicians to judge whether the decisions are reliable. The use of explainable artificial intelligence (XAI) is often suggested as a solution to this problem. We investigate how XAI is used for skin cancer detection: how is it used during the development of new DNNs? What kinds of visualisations are commonly used? Are there systematic evaluations of XAI with dermatologists or dermatopathologists?

METHODS

Google Scholar, PubMed, IEEE Explore, Science Direct and Scopus were searched for peer-reviewed studies published between January 2017 and October 2021 applying XAI to dermatological images: the search terms histopathological image, whole-slide image, clinical image, dermoscopic image, skin, dermatology, explainable, interpretable and XAI were used in various combinations. Only studies concerned with skin cancer were included.

RESULTS

37 publications fulfilled our inclusion criteria. Most studies (19/37) simply applied existing XAI methods to their classifier to interpret its decision-making. Some studies (4/37) proposed new XAI methods or improved upon existing techniques. 14/37 studies addressed specific questions such as bias detection and impact of XAI on man-machine-interactions. However, only three of them evaluated the performance and confidence of humans using CAD systems with XAI.

CONCLUSION

XAI is commonly applied during the development of DNNs for skin cancer detection. However, a systematic and rigorous evaluation of its usefulness in this scenario is lacking.

SCHOOL: Software for Clinical Health in Oncology for Omics Laboratories

Bioinformatics analysis is a key element in the development of in-house next-generation sequencing assays for tumor genetic profiling that can include both tumor DNA and RNA with comparisons to matched-normal DNA in select cases. Bioinformatics analysis encompasses a computationally heavy component that requires a high-performance computing component and an assay-dependent quality assessment, aggregation, and data cleaning component. Although there are free, open-source solutions and fee-for-use commercial services for the computationally heavy component, these solutions and services can lack the options commonly utilized in increasingly complex genomic assays. Additionally, the cost to purchase commercial solutions or implement and maintain open-source solutions can be out of reach for many small clinical laboratories. Here, we present Software for Clinical Health in Oncology for Omics Laboratories (SCHOOL), a collection of genomics analysis workflows that (i) can be easily installed on any platform; (ii) run on the cloud with a user-friendly interface; and (iii) include the detection of single nucleotide variants, insertions/deletions, copy number variants (CNVs), and translocations from RNA and DNA sequencing. These workflows contain elements for customization based on target panel and assay design, including somatic mutational analysis with a matched-normal, microsatellite stability analysis, and CNV analysis with a single nucleotide polymorphism backbone. All of the features of SCHOOL have been designed to run on any computer system, where software dependencies have been containerized. SCHOOL has been built into apps with workflows that can be run on a cloud platform such as DNANexus using their point-and-click graphical interface, which could be automated for high-throughput laboratories.

Label-free multiplexed microtomography of endogenous subcellular dynamics using generalizable deep learning

Simultaneous imaging of various facets of intact biological systems across multiple spatiotemporal scales is a long-standing goal in biology and medicine, for which progress is hindered by limits of conventional imaging modalities. Here we propose using the refractive index (RI), an intrinsic quantity governing light-matter interaction, as a means for such measurement. We show that major endogenous subcellular structures, which are conventionally accessed via exogenous fluorescence labelling, are encoded in three-dimensional (3D) RI tomograms. We decode this information in a data-driven manner, with a deep learning-based model that infers multiple 3D fluorescence tomograms from RI measurements of the corresponding subcellular targets, thereby achieving multiplexed microtomography. This approach, called RI2FL for refractive index to fluorescence, inherits the advantages of both high-specificity fluorescence imaging and label-free RI imaging. Importantly, full 3D modelling of absolute and unbiased RI improves generalization, such that the approach is applicable to a broad range of new samples without retraining to facilitate immediate applicability. The performance, reliability and scalability of this technology are extensively characterized, and its various applications within single-cell profiling at unprecedented scales (which can generate new experimentally testable hypotheses) are demonstrated.