DynaMorph: self-supervised learning of morphodynamic states of live cells

AI analysis of super-resolution microscopy: Biological discovery in the absence of ground truth

Super-resolution microscopy, or nanoscopy, enables the use of fluorescent-based molecular localization tools to study molecular structure at the nanoscale level in the intact cell, bridging the mesoscale gap to classical structural biology methodologies. Analysis of super-resolution data by artificial intelligence (AI), such as machine learning, offers tremendous potential for the discovery of new biology, that, by definition, is not known and lacks ground truth. Herein, we describe the application of weakly supervised paradigms to super-resolution microscopy and its potential to enable the accelerated exploration of the nanoscale architecture of subcellular macromolecules and organelles.

Perspective on quantitative phase imaging to improve precision cancer medicine

Significance

Quantitative phase imaging (QPI) offers a label-free approach to non-invasively characterize cellular processes by exploiting their refractive index based intrinsic contrast. QPI captures this contrast by translating refractive index associated phase shifts into intensity-based quantifiable data with nanoscale sensitivity. It holds significant potential for advancing precision cancer medicine by providing quantitative characterization of the biophysical properties of cells and tissue in their natural states.

Aim

This perspective aims to discuss the potential of QPI to increase our understanding of cancer development and its response to therapeutics. It also explores new developments in QPI methods towards advancing personalized cancer therapy and early detection.

Approach

We begin by detailing the technical advancements of QPI, examining its implementations across transmission and reflection geometries and phase retrieval methods, both interferometric and non-interferometric. The focus then shifts to QPI's applications in cancer research, including dynamic cell mass imaging for drug response assessment, cancer risk stratification, and in-vivo tissue imaging.

Results

QPI has emerged as a crucial tool in precision cancer medicine, offering insights into tumor biology and treatment efficacy. Its sensitivity to detecting nanoscale changes holds promise for enhancing cancer diagnostics, risk assessment, and prognostication. The future of QPI is envisioned in its integration with artificial intelligence, morpho-dynamics, and spatial biology, broadening its impact in cancer research.

Conclusions

QPI presents significant potential in advancing precision cancer medicine and redefining our approach to cancer diagnosis, monitoring, and treatment. Future directions include harnessing high-throughput dynamic imaging, 3D QPI for realistic tumor models, and combining artificial intelligence with multi-omics data to extend QPI's capabilities. As a result, QPI stands at the forefront of cancer research and clinical application in cancer care.

Machine learning inference of continuous single-cell state transitions during myoblast differentiation and fusion

Cells modify their internal organization during continuous state transitions, supporting functions from cell division to differentiation. However, tools to measure dynamic physiological states of individual transitioning cells are lacking. We combined live-cell imaging and machine learning to monitor ERK1/2-inhibited primary murine skeletal muscle precursor cells, that transition rapidly and robustly from proliferating myoblasts to post-mitotic myocytes and then fuse, forming multinucleated myotubes. Our models, trained using motility or actin intensity features from single-cell tracking data, effectively tracked real-time continuous differentiation, revealing that differentiation occurs 7.5-14.5 h post induction, followed by fusion ~3 h later. Co-inhibition of ERK1/2 and p38 led to differentiation without fusion. Our model inferred co-inhibition leads to terminal differentiation, indicating that p38 is specifically required for transitioning from terminal differentiation to fusion. Our model also predicted that co-inhibition leads to changes in actin dynamics. Mass spectrometry supported these in silico predictions and suggested novel fusion and maturation regulators downstream of differentiation. Collectively, this approach can be adapted to various biological processes to uncover novel links between dynamic single-cell states and their functional outcomes.

Orientation-invariant autoencoders learn robust representations for shape profiling of cells and organelles

Cell and organelle shape are driven by diverse genetic and environmental factors and thus accurate quantification of cellular morphology is essential to experimental cell biology. Autoencoders are a popular tool for unsupervised biological image analysis because they learn a low-dimensional representation that maps images to feature vectors to generate a semantically meaningful embedding space of morphological variation. The learned feature vectors can also be used for clustering, dimensionality reduction, outlier detection, and supervised learning problems. Shape properties do not change with orientation, and thus we argue that representation learning methods should encode this orientation invariance. We show that conventional autoencoders are sensitive to orientation, which can lead to suboptimal performance on downstream tasks. To address this, we develop O2-variational autoencoder (O2-VAE), an unsupervised method that learns robust, orientation-invariant representations. We use O2-VAE to discover morphology subgroups in segmented cells and mitochondria, detect outlier cells, and rapidly characterise cellular shape and texture in large datasets, including in a newly generated synthetic benchmark.

Particulate matter composition drives differential molecular and morphological responses in lung epithelial cells

Particulate matter (PM) is a ubiquitous component of air pollution that is epidemiologically linked to human pulmonary diseases. PM chemical composition varies widely, and the development of high-throughput experimental techniques enables direct profiling of cellular effects using compositionally unique PM mixtures. Here, we show that in a human bronchial epithelial cell model, exposure to three chemically distinct PM mixtures drive unique cell viability patterns, transcriptional remodeling, and the emergence of distinct morphological subtypes. Specifically, PM mixtures modulate cell viability, DNA damage responses, and induce the remodeling of gene expression associated with cell morphology, extracellular matrix organization, and cellular motility. Profiling cellular responses showed that cell morphologies change in a PM composition-dependent manner. Finally, we observed that PM mixtures with higher cadmium content induced increased DNA damage and drove redistribution among morphological subtypes. Our results demonstrate that quantitative measurement of individual cellular morphologies provides a robust, high-throughput approach to gauge the effects of environmental stressors on biological systems and score cellular susceptibilities to pollution.

Bridging live-cell imaging and next-generation cancer treatment

By providing spatial, molecular and morphological data over time, live-cell imaging can provide a deeper understanding of the cellular and signalling events that determine cancer response to treatment. Understanding this dynamic response has the potential to enhance clinical outcome by identifying biomarkers or actionable targets to improve therapeutic efficacy. Here, we review recent applications of live-cell imaging for uncovering both tumour heterogeneity in treatment response and the mode of action of cancer-targeting drugs. Given the increasing uses of T cell therapies, we discuss the unique opportunity of time-lapse imaging for capturing the interactivity and motility of immunotherapies. Although traditionally limited in the number of molecular features captured, novel developments in multidimensional imaging and multi-omics data integration offer strategies to connect single-cell dynamics to molecular phenotypes. We review the effect of these recent technological advances on our understanding of the cellular dynamics of tumour targeting and discuss their implication for next-generation precision medicine.

Machine learning enhanced cell tracking

Quantifying cell biology in space and time requires computational methods to detect cells, measure their properties, and assemble these into meaningful trajectories. In this aspect, machine learning (ML) is having a transformational effect on bioimage analysis, now enabling robust cell detection in multidimensional image data. However, the task of cell tracking, or constructing accurate multi-generational lineages from imaging data, remains an open challenge. Most cell tracking algorithms are largely based on our prior knowledge of cell behaviors, and as such, are difficult to generalize to new and unseen cell types or datasets. Here, we propose that ML provides the framework to learn aspects of cell behavior using cell tracking as the task to be learned. We suggest that advances in representation learning, cell tracking datasets, metrics, and methods for constructing and evaluating tracking solutions can all form part of an end-to-end ML-enhanced pipeline. These developments will lead the way to new computational methods that can be used to understand complex, time-evolving biological systems.

Particulate matter composition drives differential molecular and morphological responses in lung epithelial cells

Particulate matter (PM) is a ubiquitous component of indoor and outdoor air pollution that is epidemiologically linked to many human pulmonary diseases. PM has many emission sources, making it challenging to understand the biological effects of exposure due to the high variance in chemical composition. However, the effects of compositionally unique particulate matter mixtures on cells have not been analyzed using both biophysical and biomolecular approaches. Here, we show that in a human bronchial epithelial cell model (BEAS-2B), exposure to three chemically distinct PM mixtures drives unique cell viability patterns, transcriptional remodeling, and the emergence of distinct morphological subtypes. Specifically, PM mixtures modulate cell viability and DNA damage responses and induce the remodeling of gene expression associated with cell morphology, extracellular matrix organization and structure, and cellular motility. Profiling cellular responses showed that cell morphologies change in a PM composition-dependent manner. Lastly, we observed that particulate matter mixtures with high contents of heavy metals, such as cadmium and lead, induced larger drops in viability, increased DNA damage, and drove a redistribution among morphological subtypes. Our results demonstrate that quantitative measurement of cellular morphology provides a robust approach to gauge the effects of environmental stressors on biological systems and determine cellular susceptibilities to pollution.

Morphodynamical cell state description via live-cell imaging trajectory embedding

Time-lapse imaging is a powerful approach to gain insight into the dynamic responses of cells, but the quantitative analysis of morphological changes over time remains challenging. Here, we exploit the concept of "trajectory embedding" to analyze cellular behavior using morphological feature trajectory histories-that is, multiple time points simultaneously, rather than the more common practice of examining morphological feature time courses in single timepoint (snapshot) morphological features. We apply this approach to analyze live-cell images of MCF10A mammary epithelial cells after treatment with a panel of microenvironmental perturbagens that strongly modulate cell motility, morphology, and cell cycle behavior. Our morphodynamical trajectory embedding analysis constructs a shared cell state landscape revealing ligand-specific regulation of cell state transitions and enables quantitative and descriptive models of single-cell trajectories. Additionally, we show that incorporation of trajectories into single-cell morphological analysis enables (i) systematic characterization of cell state trajectories, (ii) better separation of phenotypes, and (iii) more descriptive models of ligand-induced differences as compared to snapshot-based analysis. This morphodynamical trajectory embedding is broadly applicable to the quantitative analysis of cell responses via live-cell imaging across many biological and biomedical applications.

Deep-Manager: a versatile tool for optimal feature selection in live-cell imaging analysis

One of the major problems in bioimaging, often highly underestimated, is whether features extracted for a discrimination or regression task will remain valid for a broader set of similar experiments or in the presence of unpredictable perturbations during the image acquisition process. Such an issue is even more important when it is addressed in the context of deep learning features due to the lack of a priori known relationship between the black-box descriptors (deep features) and the phenotypic properties of the biological entities under study. In this regard, the widespread use of descriptors, such as those coming from pre-trained Convolutional Neural Networks (CNNs), is hindered by the fact that they are devoid of apparent physical meaning and strongly subjected to unspecific biases, i.e., features that do not depend on the cell phenotypes, but rather on acquisition artifacts, such as brightness or texture changes, focus shifts, autofluorescence or photobleaching. The proposed Deep-Manager software platform offers the possibility to efficiently select those features having lower sensitivity to unspecific disturbances and, at the same time, a high discriminating power. Deep-Manager can be used in the context of both handcrafted and deep features. The unprecedented performances of the method are proven using five different case studies, ranging from selecting handcrafted green fluorescence protein intensity features in chemotherapy-related breast cancer cell death investigation to addressing problems related to the context of Deep Transfer Learning. Deep-Manager, freely available at https://github.com/BEEuniroma2/Deep-Manager , is suitable for use in many fields of bioimaging and is conceived to be constantly upgraded with novel image acquisition perturbations and modalities.

Optofluidic imaging meets deep learning: from merging to emerging

Propelled by the striking advances in optical microscopy and deep learning (DL), the role of imaging in lab-on-a-chip has dramatically been transformed from a silo inspection tool to a quantitative "smart" engine. A suite of advanced optical microscopes now enables imaging over a range of spatial scales (from molecules to organisms) and temporal window (from microseconds to hours). On the other hand, the staggering diversity of DL algorithms has revolutionized image processing and analysis at the scale and complexity that were once inconceivable. Recognizing these exciting but overwhelming developments, we provide a timely review of their latest trends in the context of lab-on-a-chip imaging, or coined optofluidic imaging. More importantly, here we discuss the strengths and caveats of how to adopt, reinvent, and integrate these imaging techniques and DL algorithms in order to tailor different lab-on-a-chip applications. In particular, we highlight three areas where the latest advances in lab-on-a-chip imaging and DL can form unique synergisms: image formation, image analytics and intelligent image-guided autonomous lab-on-a-chip. Despite the on-going challenges, we anticipate that they will represent the next frontiers in lab-on-a-chip imaging that will spearhead new capabilities in advancing analytical chemistry research, accelerating biological discovery, and empowering new intelligent clinical applications.

Morphological signatures of actin organization in single cells accurately classify genetic perturbations using CNNs with transfer learning

The actin cytoskeleton plays essential roles in countless cell processes, from cell division to migration to signaling. In cancer cells, cytoskeletal dynamics, cytoskeletal filament organization, and overall cell morphology are known to be altered substantially. We hypothesize that actin fiber organization and cell shape may carry specific signatures of genetic or signaling perturbations. We used convolutional neural networks (CNNs) on a small fluorescence microscopy image dataset of retinal pigment epithelial (RPE) cells and triple-negative breast cancer (TNBC) cells for identifying morphological signatures in cancer cells. Using a transfer learning approach, CNNs could be trained to accurately distinguish between normal and oncogenically transformed RPE cells with an accuracy of about 95% or better at the single cell level. Furthermore, CNNs could distinguish transformed cell lines differing by an oncogenic mutation from each other and could also detect knockdown of cofilin in TNBC cells, indicating that each single oncogenic mutation or cytoskeletal perturbation produces a unique signature in actin morphology. Application of the Local Interpretable Model-Agnostic Explanations (LIME) method for visually interpreting the CNN results revealed features of the global actin structure relevant for some cells and classification tasks. Interestingly, many of these features were supported by previous biological observation. Actin fiber organization is thus a sensitive marker for cell identity, and identification of its perturbations could be very useful for assaying cell phenotypes, including disease states.

Cerebral Organoids as an Experimental Platform for Human Neurogenomics

The cerebral cortex forms early in development according to a series of heritable neurodevelopmental instructions. Despite deep evolutionary conservation of the cerebral cortex and its foundational six-layered architecture, significant variations in cortical size and folding can be found across mammals, including a disproportionate expansion of the prefrontal cortex in humans. Yet our mechanistic understanding of neurodevelopmental processes is derived overwhelmingly from rodent models, which fail to capture many human-enriched features of cortical development. With the advent of pluripotent stem cells and technologies for differentiating three-dimensional cultures of neural tissue in vitro, cerebral organoids have emerged as an experimental platform that recapitulates several hallmarks of human brain development. In this review, we discuss the merits and limitations of cerebral organoids as experimental models of the developing human brain. We highlight innovations in technology development that seek to increase its fidelity to brain development in vivo and discuss recent efforts to use cerebral organoids to study regeneration and brain evolution as well as to develop neurological and neuropsychiatric disease models.