Automated Learning of Subcellular Variation among Punctate Protein Patterns and a Generative Model of Their Relation to Microtubules

CytoSpatio: Learning cell type spatial relationships using multirange, multitype point process models

Recent advances in multiplexed fluorescence imaging have provided new opportunities for deciphering the complex spatial relationships among various cell types across diverse tissues. We introduce CytoSpatio, open-source software that constructs generative, multirange, and multitype point process models that capture interactions among multiple cell types at various distances simultaneously. On analyzing five cell types across five tissues, our software showed consistent spatial relationships within the same tissue type, with certain cell types like proliferating T cells consistently clustering across tissue types. It also revealed that the attraction-repulsion relationships between cell types like B cells and CD4-positive T cells vary with tissue type. CytoSpatio can also generate synthetic tissue structures that preserve the spatial relationships seen in training images, a capability not provided by previous descriptive, motif-based approaches. This potentially allows spatially realistic simulations of how cell relationships affect tissue biochemistry.

ExoJ - a Fiji/ImageJ2 plugin for automated spatiotemporal detection and analysis of exocytosis

Exocytosis is a dynamic physiological process that enables the release of biomolecules to the surrounding environment via the fusion of membrane compartments to the plasma membrane. Understanding its mechanisms is crucial, as defects can compromise essential biological functions. The development of pH-sensitive optical reporters alongside fluorescence microscopy enables the assessment of individual vesicle exocytosis events at the cellular level. Manual annotation represents, however, a time-consuming task that is prone to selection biases and human operational errors. Here, we introduce ExoJ, an automated plugin based on Fiji/ImageJ2 software. ExoJ identifies user-defined genuine populations of exocytosis events, recording quantitative features including intensity, apparent size and duration. We designed ExoJ to be fully user-configurable, making it suitable for studying distinct forms of vesicle exocytosis regardless of the imaging quality. Our plugin demonstrates its capabilities by showcasing distinct exocytic dynamics among tetraspanins and vesicular SNARE protein reporters. Assessment of performance on synthetic data shows that ExoJ is a robust tool that is capable of correctly identifying exocytosis events independently of signal-to-noise ratio conditions. We propose ExoJ as a standard solution for future comparative and quantitative studies of exocytosis.

Flavinated SDHA underlies the change in intrinsic optical properties of oral cancers

The molecular basis of reduced autofluorescence in oral squamous cell carcinoma (OSCC) cells relative to normal cells has been speculated to be due to lower levels of free flavin adenine dinucleotide (FAD). This speculation, along with differences in the intrinsic optical properties of extracellular collagen, lies at the foundation of the design of currently-used clinical optical detection devices. Here, we report that free FAD levels may not account for differences in autofluorescence of OSCC cells, but that the differences relate to FAD as a co-factor for flavination. Autofluorescence from a 70 kDa flavoprotein, succinate dehydrogenase A (SDHA), was found to be responsible for changes in optical properties within the FAD spectral region, with lower levels of flavinated SDHA in OSCC cells. Since flavinated SDHA is required for functional complexation with succinate dehydrogenase B (SDHB), decreased SDHB levels were observed in human OSCC tissue relative to normal tissues. Accordingly, the metabolism of OSCC cells was found to be significantly altered relative to normal cells, revealing vulnerabilities for both diagnosis and targeted therapy. Optimizing non-invasive tools based on optical and metabolic signatures of cancers will enable more precise and early diagnosis leading to improved outcomes in patients.

Flavinated SDHA Underlies the Change in Intrinsic Optical Properties of Oral Cancers

The molecular basis of reduced autofluorescence in oral squamous cell carcinoma (OSCC) cells relative to normal cells has been speculated to be due to lower levels of free flavin adenine dinucleotide (FAD). This speculation, along with differences in the intrinsic optical properties of extracellular collagen, lie at the foundation of the design of currently-used clinical optical detection devices. Here, we report that free FAD levels may not account for differences in autofluorescence of OSCC cells, but that the differences relate to FAD as a co-factor for flavination. Autofluorescence from a 70 kDa flavoprotein, succinate dehydrogenase A (SDHA), was found to be responsible for changes in optical properties within the FAD spectral region with lower levels of flavinated SDHA in OSCC cells. Since flavinated SDHA is required for functional complexation with succinate dehydrogenase B (SDHB), decreased SDHB levels were observed in human OSCC tissue relative to normal tissues. Accordingly, the metabolism of OSCC cells was found to be significantly altered relative to normal cells, revealing vulnerabilities for both diagnosis and targeted therapy. Optimizing non-invasive tools based on optical and metabolic signatures of cancers will enable more precise and early diagnosis leading to improved outcomes in patients.

Improving and evaluating deep learning models of cellular organization

MOTIVATION

Cells contain dozens of major organelles and thousands of other structures, many of which vary extensively in their number, size, shape and spatial distribution. This complexity and variation dramatically complicates the use of both traditional and deep learning methods to build accurate models of cell organization. Most cellular organelles are distinct objects with defined boundaries that do not overlap, while the pixel resolution of most imaging methods is n sufficient to resolve these boundaries. Thus while cell organization is conceptually object-based, most current methods are pixel-based. Using extensive image collections in which particular organelles were fluorescently labeled, deep learning methods can be used to build conditional autoencoder models for particular organelles. A major advance occurred with the use of a U-net approach to make multiple models all conditional upon a common reference, unlabeled image, allowing the relationships between different organelles to be at least partially inferred.

RESULTS

We have developed improved Generative Adversarial Networks-based approaches for learning these models and have also developed novel criteria for evaluating how well synthetic cell images reflect the properties of real images. The first set of criteria measure how well models preserve the expected property that organelles do not overlap. We also developed a modified loss function that allows retraining of the models to minimize that overlap. The second set of criteria uses object-based modeling to compare object shape and spatial distribution between synthetic and real images. Our work provides the first demonstration that, at least for some organelles, deep learning models can capture object-level properties of cell images.

AVAILABILITY AND IMPLEMENTATION

http://murphylab.cbd.cmu.edu/Software/2022_insilico.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Consistency and variation of protein subcellular location annotations

A major challenge for protein databases is reconciling information from diverse sources. This is especially difficult when some information consists of secondary, human-interpreted rather than primary data. For example, the Swiss-Prot database contains curated annotations of subcellular location that are based on predictions from protein sequence, statements in scientific articles, and published experimental evidence. The Human Protein Atlas (HPA) consists of millions of high-resolution microscopic images that show protein spatial distribution on a cellular and subcellular level. These images are manually annotated with protein subcellular locations by trained experts. The image annotations in HPA can capture the variation of subcellular location across different cell lines, tissues, or tissue states. Systematic investigation of the consistency between HPA and Swiss-Prot assignments of subcellular location, which is important for understanding and utilizing protein location data from the two databases, has not been described previously. In this paper, we quantitatively evaluate the consistency of subcellular location annotations between HPA and Swiss-Prot at multiple levels, as well as variation of protein locations across cell lines and tissues. Our results show that annotations of these two databases differ significantly in many cases, leading to proposed procedures for deriving and integrating the protein subcellular location data. We also find that proteins having highly variable locations are more likely to be biomarkers of diseases, providing support for incorporating analysis of subcellular location in protein biomarker identification and screening.

Dynamic organization of intracellular organelle networks

Intracellular organelles are membrane-bound and biochemically distinct compartments constructed to serve specialized functions in eukaryotic cells. Through extensive interactions, they form networks to coordinate and integrate their specialized functions for cell physiology. A fundamental property of these organelle networks is that they constantly undergo dynamic organization via membrane fusion and fission to remodel their internal connections and to mediate direct material exchange between compartments. The dynamic organization not only enables them to serve critical physiological functions adaptively but also differentiates them from many other biological networks such as gene regulatory networks and cell signaling networks. This review examines this fundamental property of the organelle networks from a systems point of view. The focus is exclusively on homotypic networks formed by mitochondria, lysosomes, endosomes, and the endoplasmic reticulum, respectively. First, key mechanisms that drive the dynamic organization of these networks are summarized. Then, several distinct organizational properties of these networks are highlighted. Next, spatial properties of the dynamic organization of these networks are emphasized, and their functional implications are examined. Finally, some representative molecular machineries that mediate the dynamic organization of these networks are surveyed. Overall, the dynamic organization of intracellular organelle networks is emerging as a fundamental and unifying paradigm in the internal organization of eukaryotic cells. This article is categorized under: Metabolic Diseases > Molecular and Cellular Physiology.

Evaluation of methods for generative modeling of cell and nuclear shape

MOTIVATION

Cell shape provides both geometry for, and a reflection of, cell function. Numerous methods for describing and modeling cell shape have been described, but previous evaluation of these methods in terms of the accuracy of generative models has been limited.

RESULTS

Here we compare traditional methods and deep autoencoders to build generative models for cell shapes in terms of the accuracy with which shapes can be reconstructed from models. We evaluated the methods on different collections of 2D and 3D cell images, and found that none of the methods gave accurate reconstructions using low dimensional encodings. As expected, much higher accuracies were observed using high dimensional encodings, with outline-based methods significantly outperforming image-based autoencoders. The latter tended to encode all cells as having smooth shapes, even for high dimensions. For complex 3D cell shapes, we developed a significant improvement of a method based on the spherical harmonic transform that performs significantly better than other methods. We obtained similar results for the joint modeling of cell and nuclear shape. Finally, we evaluated the modeling of shape dynamics by interpolation in the shape space. We found that our modified method provided lower deformation energies along linear interpolation paths than other methods. This allows practical shape evolution in high dimensional shape spaces. We conclude that our improved spherical harmonic based methods are preferable for cell and nuclear shape modeling, providing better representations, higher computational efficiency and requiring fewer training images than deep learning methods.

AVAILABILITY AND IMPLEMENTATION

All software and data is available at http://murphylab.cbd.cmu.edu/software.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Applications and Challenges of Machine Learning to Enable Realistic Cellular Simulations

In this perspective, we examine three key aspects of an end-to-end pipeline for realistic cellular simulations: reconstruction and segmentation of cellular structures; generation of cellular structures; and mesh generation, simulation, and data analysis. We highlight some of the relevant prior work in these distinct but overlapping areas, with a particular emphasis on current use of machine learning technologies, as well as on future opportunities.

Whole-Cell Scale Dynamic Organization of Lysosomes Revealed by Spatial Statistical Analysis

In eukaryotic cells, lysosomes are distributed in the cytoplasm as individual membrane-bound compartments to degrade macromolecules and to control cellular metabolism. A fundamental yet unanswered question is whether and, if so, how individual lysosomes are organized spatially to coordinate and integrate their functions. To address this question, we analyzed their collective behavior in cultured cells using spatial statistical techniques. We found that in single cells, lysosomes maintain non-random, stable, yet distinct spatial distributions mediated by the cytoskeleton, the endoplasmic reticulum (ER), and lysosomal biogenesis. Throughout the intracellular space, lysosomes form dynamic clusters that significantly increase their interactions with endosomes. Cluster formation is associated with local increases in ER spatial density but does not depend on fusion with endosomes or spatial exclusion by mitochondria. Taken together, our findings reveal whole-cell scale spatial organization of lysosomes and provide insights into how organelle interactions are mediated and regulated across the entire intracellular space.

CIRCOAST: a statistical hypothesis test for cellular colocalization with network structures

Motivation

Colocalization of structures in biomedical images can lead to insights into biological behaviors. One class of colocalization problems is examining an annular structure (disk-shaped such as a cell, vesicle or molecule) interacting with a network structure (vascular, neuronal, cytoskeletal, organellar). Examining colocalization events across conditions is often complicated by changes in density of both structure types, confounding traditional statistical approaches since colocalization cannot be normalized to the density of both structure types simultaneously. We have developed a technique to measure colocalization independent of structure density and applied it to characterizing intercellular colocation with blood vessel networks. This technique could be used to analyze colocalization of any annular structure with an arbitrarily shaped network structure.

Results

We present the circular colocalization affinity with network structures test (CIRCOAST), a novel statistical hypothesis test to probe for enriched network colocalization in 2D z-projected multichannel images by using agent-based Monte Carlo modeling and image processing to generate the pseudo-null distribution of random cell placement unique to each image. This hypothesis test was validated by confirming that adipose-derived stem cells (ASCs) exhibit enriched colocalization with endothelial cells forming arborized networks in culture and then applied to show that locally delivered ASCs have enriched colocalization with murine retinal microvasculature in a model of diabetic retinopathy. We demonstrate that the CIRCOAST test provides superior power and type I error rates in characterizing intercellular colocalization compared to generic approaches that are confounded by changes in cell or vessel density.

Availability and implementation

CIRCOAST source code available at: https://github.com/uva-peirce-cottler-lab/ARCAS.

Supplementary information

Supplementary data are available at Bioinformatics online.

Learning unsupervised feature representations for single cell microscopy images with paired cell inpainting

Cellular microscopy images contain rich insights about biology. To extract this information, researchers use features, or measurements of the patterns of interest in the images. Here, we introduce a convolutional neural network (CNN) to automatically design features for fluorescence microscopy. We use a self-supervised method to learn feature representations of single cells in microscopy images without labelled training data. We train CNNs on a simple task that leverages the inherent structure of microscopy images and controls for variation in cell morphology and imaging: given one cell from an image, the CNN is asked to predict the fluorescence pattern in a second different cell from the same image. We show that our method learns high-quality features that describe protein expression patterns in single cells both yeast and human microscopy datasets. Moreover, we demonstrate that our features are useful for exploratory biological analysis, by capturing high-resolution cellular components in a proteome-wide cluster analysis of human proteins, and by quantifying multi-localized proteins and single-cell variability. We believe paired cell inpainting is a generalizable method to obtain feature representations of single cells in multichannel microscopy images.

To understand the cell biology captured by microscopy images, researchers use features, or measurements of relevant properties of cells, such as the shape or size of cells, or the intensity of fluorescent markers. Features are the starting point of most image analysis pipelines, so their quality in representing cells is fundamental to the success of an analysis. Classically, researchers have relied on features manually defined by imaging experts. In contrast, deep learning techniques based on convolutional neural networks (CNNs) automatically learn features, which can outperform manually-defined features at image analysis tasks. However, most CNN methods require large manually-annotated training datasets to learn useful features, limiting their practical application. Here, we developed a new CNN method that learns high-quality features for single cells in microscopy images, without the need for any labeled training data. We show that our features surpass other comparable features in identifying protein localization from images, and that our method can generalize to diverse datasets. By exploiting our method, researchers will be able to automatically obtain high-quality features customized to their own image datasets, facilitating many downstream analyses, as we highlight by demonstrating many possible use cases of our features in this study.

From observing to predicting single-cell structure and function with high-throughput/high-content microscopy

In the past 15 years, cell-based microscopy has evolved its focus from observing cell function to aiming to predict it. In particular-powered by breakthroughs in computer vision, large-scale image analysis and machine learning-high-throughput and high-content microscopy imaging have enabled to uniquely harness single-cell information to systematically discover and annotate genes and regulatory pathways, uncover systems-level interactions and causal links between cellular processes, and begin to clarify and predict causal cellular behaviour and decision making. Here we review these developments, discuss emerging trends in the field, and describe how single-cell 'omics and single-cell microscopy are imminently in an intersecting trajectory. The marriage of these two fields will make possible an unprecedented understanding of cell and tissue behaviour and function.

A two-stage method for automated detection of ring-like endosomes in fluorescent microscopy images

Endosomes are subcellular organelles which serve as important transport compartments in eukaryotic cells. Fluorescence microscopy is a widely applied technology to study endosomes at the subcellular level. In general, a microscopy image can contain a large number of organelles and endosomes in particular. Detecting and annotating endosomes in fluorescence microscopy images is a critical part in the study of subcellular trafficking processes. Such annotation is usually performed by human inspection, which is time-consuming and prone to inaccuracy if carried out by inexperienced analysts. This paper proposes a two-stage method for automated detection of ring-like endosomes. The method consists of a localization stage cascaded by an identification stage. Given a test microscopy image, the localization stage generates a voting-map by locally comparing the query endosome patches and the test image based on a bag-of-words model. Using the voting-map, a number of candidate patches of endosomes are determined. Subsequently, in the identification stage, a support vector machine (SVM) is trained using the endosome patches and the background pattern patches. Each of the candidate patches is classified by the SVM to rule out those patches of endosome-like background patterns. The performance of the proposed method is evaluated with real microscopy images of human myeloid endothelial cells. It is shown that the proposed method significantly outperforms several state-of-the-art competing methods using multiple performance metrics.

Learning the sequence of influenza A genome assembly during viral replication using point process models and fluorescence in situ hybridization

Within influenza virus infected cells, viral genomic RNA are selectively packed into progeny virions, which predominantly contain a single copy of 8 viral RNA segments. Intersegmental RNA-RNA interactions are thought to mediate selective packaging of each viral ribonucleoprotein complex (vRNP). Clear evidence of a specific interaction network culminating in the full genomic set has yet to be identified. Using multi-color fluorescence in situ hybridization to visualize four vRNP segments within a single cell, we developed image-based models of vRNP-vRNP spatial dependence. These models were used to construct likely sequences of vRNP associations resulting in the full genomic set. Our results support the notion that selective packaging occurs during cytoplasmic transport and identifies the formation of multiple distinct vRNP sub-complexes that likely form as intermediate steps toward full genomic inclusion into a progeny virion. The methods employed demonstrate a statistically driven, model based approach applicable to other interaction and assembly problems.

A quantitative approach for analyzing the spatio-temporal distribution of 3D intracellular events in fluorescence microscopy

Analysis of the spatial distribution of endomembrane trafficking is fundamental to understand the mechanisms controlling cellular dynamics, cell homeostasy, and cell interaction with its external environment in normal and pathological situations. We present a semi-parametric framework to quantitatively analyze and visualize the spatio-temporal distribution of intracellular events from different conditions. From the spatial coordinates of intracellular features such as segmented subcellular structures or vesicle trajectories, QuantEv automatically estimates weighted densities that are easy to interpret and performs a comprehensive statistical analysis from distribution distances. We apply this approach to study the spatio-temporal distribution of moving Rab6 fluorescently labeled membranes with respect to their direction of movement in crossbow- and disk-shaped cells. We also investigate the position of the generating hub of Rab11-positive membranes and the effect of actin disruption on Rab11 trafficking in coordination with cell shape.

Proteins are the workhorses of the body, performing a range of roles that are essential for life. Often, this requires these molecules to move from one location to another inside a cell. Scientists are interested in following an individual protein in a living cell ‘in real time’, as this helps understand what this protein does.

Scientists can track the whereabouts of a protein by ‘tagging’ it with a fluorescent molecule that emits light which can be picked up by a powerful microscope. This process is repeated many times on different samples. Finally, researchers have to analyze all the resulting images, and conduct statistical analysis to draw robust conclusions about the overall trajectories of the proteins. This process often relies on experts assessing the images, and it is therefore time-consuming and not easily scalable or applied to other experiments.

To help with this, Pécot et al. have developed QuantEV, a free algorithm that can analyze proteins’ paths within a cell, and then return statistical graphs and 3D visualizations. The program also gives access to the statistical procedure that was used, which means that different experiments can be compared.

Pécot et al. used the method to follow the Rab6 protein in cells of different shapes, and found that the conformation of the cell influences where Rab6 is located. For example, in crossbow-shaped cells, Rab6 is found more often toward the three tips of the crossbow, while its distribution is uniform in cells that look like disks. Another experiment examined where the protein Rab11 is normally placed, and how this changes when the cell’s skeleton is artificially disrupted. Both studies help to gain an insight into the behavior of the cellular structures in which Rab6 and Rab11 are embedded.

Following proteins in the cell is an increasingly popular method, and there is therefore a growing amount of data to process. QuantEV should make it easier for biologists to analyze their results, which could help them to have a better grasp on how cells work in various circumstances.

Strategy and software for the statistical spatial analysis of 3D intracellular distributions

The localization of proteins in specific domains or compartments in the 3D cellular space is essential for many fundamental processes in eukaryotic cells. Deciphering spatial organization principles within cells is a challenging task, in particular because of the large morphological variations between individual cells. We present here an approach for normalizing variations in cell morphology and for statistically analyzing spatial distributions of intracellular compartments from collections of 3D images. The method relies on the processing and analysis of 3D geometrical models that are generated from image stacks and that are used to build representations at progressively increasing levels of integration, ultimately revealing statistical significant traits of spatial distributions. To make this methodology widely available to end-users, we implemented our algorithmic pipeline into a user-friendly, multi-platform, and freely available software. To validate our approach, we generated 3D statistical maps of endomembrane compartments at subcellular resolution within an average epidermal root cell from collections of image stacks. This revealed unsuspected polar distribution patterns of organelles that were not detectable in individual images. By reversing the classical 'measure-then-average' paradigm, one major benefit of the proposed strategy is the production and display of statistical 3D representations of spatial organizations, thus fully preserving the spatial dimension of image data and at the same time allowing their integration over individual observations. The approach and software are generic and should be of general interest for experimental and modeling studies of spatial organizations at multiple scales (subcellular, cellular, tissular) in biological systems.

Point process models for localization and interdependence of punctate cellular structures

Accurate representations of cellular organization for multiple eukaryotic cell types are required for creating predictive models of dynamic cellular function. To this end, we have previously developed the CellOrganizer platform, an open source system for generative modeling of cellular components from microscopy images. CellOrganizer models capture the inherent heterogeneity in the spatial distribution, size, and quantity of different components among a cell population. Furthermore, CellOrganizer can generate quantitatively realistic synthetic images that reflect the underlying cell population. A current focus of the project is to model the complex, interdependent nature of organelle localization. We built upon previous work on developing multiple non-parametric models of organelles or structures that show punctate patterns. The previous models described the relationships between the subcellular localization of puncta and the positions of cell and nuclear membranes and microtubules. We extend these models to consider the relationship to the endoplasmic reticulum (ER), and to consider the relationship between the positions of different puncta of the same type. Our results do not suggest that the punctate patterns we examined are dependent on ER position or inter- and intra-class proximity. With these results, we built classifiers to update previous assignments of proteins to one of 11 patterns in three distinct cell lines. Our generative models demonstrate the ability to construct statistically accurate representations of puncta localization from simple cellular markers in distinct cell types, capturing the complex phenomena of cellular structure interaction with little human input. This protocol represents a novel approach to vesicular protein annotation, a field that is often neglected in high-throughput microscopy. These results suggest that spatial point process models provide useful insight with respect to the spatial dependence between cellular structures. © 2016 International Society for Advancement of Cytometry.

Visualizing quantitative microscopy data: History and challenges

Data visualization is a fundamental aspect of science. In the context of microscopy-based studies, visualization typically involves presentation of the images themselves. However, data visualization is challenging when microscopy experiments entail imaging of millions of cells, and complex cellular phenotypes are quantified in a high-content manner. Most well-established visualization tools are inappropriate for displaying high-content data, which has driven the development of new visualization methodology. In this review, we discuss how data has been visualized in both classical and high-content microscopy studies; as well as the advantages, and disadvantages, of different visualization methods.