Global linking of cell tracks using the Viterbi algorithm

A collagen-based microwell migration assay to study NK-target cell interactions

Natural killer (NK) cell cytotoxicity in tissue is dependent on the ability of NK cells to migrate through the extracellular matrix (ECM) microenvironment. Traditional imaging studies of NK cell migration and cytotoxicity have utilized 2D surfaces, which do not properly reproduce the structural and mechanical cues that shape the migratory response of NK cells in vivo. Here, we have combined a microwell assay that allows long-term imaging and tracking of small, well-defined populations of NK cells with an interstitial ECM-like matrix. The assay allows for long-term imaging of NK-target cell interactions within a confined 3D volume. We found marked differences in motility between individual cells with a small fraction of the cells moving slowly and being confined to a small volume within the matrix, while other cells moved more freely. A majority of NK cells also exhibited transient variation in their motility, alternating between periods of migration arrest and movement. The assay could be used as a complement to in vivo imaging to study human NK cell heterogeneity in migration and cytotoxicity.

Cell Segmentation Using a Similarity Interface With a Multi-Task Convolutional Neural Network

Even though convolutional neural networks (CNN) have been used for cell segmentation, they require pixel-level ground truth annotations. This paper proposes a multitask learning algorithm for cell detection and segmentation using CNNs. We use dot annotations placed inside each cell indicating approximate cell centroids to create training datasets for the detection and segmentation tasks. The segmentation task is used to map the input image to foreground versus background regions, whereas the detection task is used to predict the centroids of the cells. Our multitask model shares convolutional layers between the two tasks, while having task-specific output layers. Learning two tasks simultaneously reduces the risks of overfitting and also helps in separating overlapping cells better. We also introduce a similarity interface (SI) that can be integrated with our multitask network to allow easy adaptation between domains, and to compensate for the variability in contrast and texture of cells seen in microscopy images. The SI comprises an unsupervised first layer in combination with a neighborhood similarity layer (NSL). A layer of logistic sigmoid functions is used as an unsupervised first layer to separate clustered image patches from each other. The NSL transforms its input feature map at a given pixel by computing its similarity to the surrounding neighborhood. Our proposed method achieves higher/comparable detection and segmentation scores as compared to recent state-of-the-art methods with significantly reduced effort for generating training data.

A Dynamic-Shape-Prior Guided Snake Model with Application in Visually Tracking Dense Cell Populations

This work proposes a dynamic-shape-prior guided snake model (DSP G-snake) that is designed to improve the overall stability of the point-based snake model. The dynamic shape prior is first proposed for snakes, that efficiently unifies different types of high-level priors into a new force term. To be specific, a global-topology regularity is first introduced that settles the inherent self-intersection problem with snakes. The problem that a snake's snaxels tend to unevenly distribute along the contour is also handled, leading to good parameterization. Unlike existing methods that employ learning templates or commonly enforce hard priors, the dynamic-template scheme strongly respects the deformation flexibility of the model, while retaining a decent global topology for the snake. It is verified by experiments that the proposed algorithm can effectively prevent snakes from self-crossing, or automatically untie an already selfintersected contour. In addition, the proposed model is combined with existing forces and applied to the very challenging task of tracking dense biological cell populations. The DSP G-snake model has enabled an improvement of up to 30% in tracking accuracy with respect to regular model-based approaches. Through experiments on real cellular datasets, with highly dense populations and relatively large displacements, it is confirmed that the proposed approach has enabled superior performance, in comparison to modern active-contour competitors as well as state-of-the-art cell tracking frameworks.

Cell Population Tracking in a Honeycomb Structure Using an IMM Filter Based 3D Local Graph Matching Model

Developing algorithms for plant cell population tracking is very critical for the modeling of plant cell growth pattern and gene expression dynamics. The tracking of plant cells in microscopic image stacks is very challenging for several reasons: (1) plant cells are densely packed in a specific honeycomb structure; (2) they are frequently dividing; and (3) they are imaged in different layers within 3D image stacks. Based on an existing 2D local graph matching algorithm, this paper focuses on building a 3D plant cell matching model, by exploiting the cells' 3D spatiotemporal context. Furthermore, the Interacting Multi-Model filter (IMM) is combined with the 3D local graph matching model to track the plant cell population simultaneously. Because our tracking algorithm does not require the identification of "tracking seeds", the tracking stability and efficiency are greatly enhanced. Last, the plant cell lineages are achieved by associating the cell tracklets, using a maximum-a-posteriori (MAP) method. Compared with the 2D matching method, the experimental results on multiple datasets show that our proposed approach does not only greatly improve the tracking accuracy by 18 percent, but also successfully tracks the plant cells located at the high curvature primordial region, which is not addressed in previous work.

A probabilistic approach to joint cell tracking and segmentation in high-throughput microscopy videos

We present a novel computational framework for the analysis of high-throughput microscopy videos of living cells. The proposed framework is generally useful and can be applied to different datasets acquired in a variety of laboratory settings. This is accomplished by tying together two fundamental aspects of cell lineage construction, namely cell segmentation and tracking, via a Bayesian inference of dynamic models. In contrast to most existing approaches, which aim to be general, no assumption of cell shape is made. Spatial, temporal, and cross-sectional variation of the analysed data are accommodated by two key contributions. First, time series analysis is exploited to estimate the temporal cell shape uncertainty in addition to cell trajectory. Second, a fast marching (FM) algorithm is used to integrate the inferred cell properties with the observed image measurements in order to obtain image likelihood for cell segmentation, and association. The proposed approach has been tested on eight different time-lapse microscopy data sets, some of which are high-throughput, demonstrating promising results for the detection, segmentation and association of planar cells. Our results surpass the state of the art for the Fluo-C2DL-MSC data set of the Cell Tracking Challenge (Maška et al., 2014).

Piecewise-Stationary Motion Modeling and Iterative Smoothing to Track Heterogeneous Particle Motions in Dense Environments

One of the major challenges in multiple particle tracking is the capture of extremely heterogeneous movements of objects in crowded scenes. The presence of numerous assignment candidates in the expected range of particle motion makes the tracking ambiguous and induces false positives. Lowering the ambiguity by reducing the search range, on the other hand, is not an option, as this would increase the rate of false negatives. We propose here a piecewise-stationary motion model (PMM) for the particle transport along an iterative smoother that exploits recursive tracking in multiple rounds in forward and backward temporal directions. By fusing past and future information, our method, termed PMMS, can recover fast transitions from freely or confined diffusive to directed motions with linear time complexity. To avoid false positives, we complemented recursive tracking with a robust inline estimator of the search radius for assignment (a.k.a. gating), where past and future information are exploited using only two frames at each optimization step. We demonstrate the improvement of our technique on simulated data especially the impact of density, variation in frame to frame displacements, and motion switching probability. We evaluated our technique on the 2D particle tracking challenge dataset published by Chenouard et al. in 2014. Using high SNR to focus on motion modeling challenges, we show superior performance at high particle density. On biological applications, our algorithm allows us to quantify the extremely small percentage of motor-driven movements of fluorescent particles along microtubules in a dense field of unbound, diffusing particles. We also show with virus imaging that our algorithm can cope with a strong reduction in recording frame rate while keeping the same performance relative to methods relying on fast sampling.

An objective comparison of cell-tracking algorithms

We present a combined report on the results of three editions of the Cell Tracking Challenge, an ongoing initiative aimed at promoting the development and objective evaluation of cell segmentation and tracking algorithms. With 21 participating algorithms and a data repository consisting of 13 data sets from various microscopy modalities, the challenge displays today's state-of-the-art methodology in the field. We analyzed the challenge results using performance measures for segmentation and tracking that rank all participating methods. We also analyzed the performance of all of the algorithms in terms of biological measures and practical usability. Although some methods scored high in all technical aspects, none obtained fully correct solutions. We found that methods that either take prior information into account using learning strategies or analyze cells in a global spatiotemporal video context performed better than other methods under the segmentation and tracking scenarios included in the challenge.

In situ genotyping of a pooled strain library after characterizing complex phenotypes

In this work, we present a proof-of-principle experiment that extends advanced live cell microscopy to the scale of pool-generated strain libraries. We achieve this by identifying the genotypes for individual cells in situ after a detailed characterization of the phenotype. The principle is demonstrated by single-molecule fluorescence time-lapse imaging of Escherichia coli strains harboring barcoded plasmids that express a sgRNA which suppresses different genes in the E. coli genome through dCas9 interference. In general, the method solves the problem of characterizing complex dynamic phenotypes for diverse genetic libraries of cell strains. For example, it allows screens of how changes in regulatory or coding sequences impact the temporal expression, location, or function of a gene product, or how the altered expression of a set of genes impacts the intracellular dynamics of a labeled reporter.

NucliTrack: an integrated nuclei tracking application

SUMMARY

Live imaging studies give unparalleled insight into dynamic single cell behaviours and fate decisions. However, the challenge of reliably tracking single cells over long periods of time limits both the throughput and ease with which such studies can be performed. Here, we present NucliTrack, a cross platform solution for automatically segmenting, tracking and extracting features from fluorescently labelled nuclei. NucliTrack performs similarly to other state-of-the-art cell tracking algorithms, but NucliTrack's interactive, graphical interface makes it significantly more user friendly.

AVAILABILITY AND IMPLEMENTATION

NucliTrack is available as a free, cross platform application and open source Python package. Installation details and documentation are at: http://nuclitrack.readthedocs.io/en/latest/ A video guide can be viewed online: https://www.youtube.com/watch?v=J6e0D9F-qSU Source code is available through Github: https://github.com/samocooper/nuclitrack. A Matlab toolbox is also available at: https://uk.mathworks.com/matlabcentral/fileexchange/61479-samocooper-nuclitrack-matlab.

CONTACT

sam@socooper.com.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Kinetics of dCas9 target search in Escherichia coli

How fast can a cell locate a specific chromosomal DNA sequence specified by a single-stranded oligonucleotide? To address this question, we investigate the intracellular search processes of the Cas9 protein, which can be programmed by a guide RNA to bind essentially any DNA sequence. This targeting flexibility requires Cas9 to unwind the DNA double helix to test for correct base pairing to the guide RNA. Here we study the search mechanisms of the catalytically inactive Cas9 (dCas9) in living Escherichia coli by combining single-molecule fluorescence microscopy and bulk restriction-protection assays. We find that it takes a single fluorescently labeled dCas9 6 hours to find the correct target sequence, which implies that each potential target is bound for less than 30 milliseconds. Once bound, dCas9 remains associated until replication. To achieve fast targeting, both Cas9 and its guide RNA have to be present at high concentrations.

Prostaglandin E2 is essential for efficacious skeletal muscle stem-cell function, augmenting regeneration and strength

Skeletal muscles harbor quiescent muscle-specific stem cells (MuSCs) capable of tissue regeneration throughout life. Muscle injury precipitates a complex inflammatory response in which a multiplicity of cell types, cytokines, and growth factors participate. Here we show that Prostaglandin E2 (PGE2) is an inflammatory cytokine that directly targets MuSCs via the EP4 receptor, leading to MuSC expansion. An acute treatment with PGE2 suffices to robustly augment muscle regeneration by either endogenous or transplanted MuSCs. Loss of PGE2 signaling by specific genetic ablation of the EP4 receptor in MuSCs impairs regeneration, leading to decreased muscle force. Inhibition of PGE2 production through nonsteroidal anti-inflammatory drug (NSAID) administration just after injury similarly hinders regeneration and compromises muscle strength. Mechanistically, the PGE2 EP4 interaction causes MuSC expansion by triggering a cAMP/phosphoCREB pathway that activates the proliferation-inducing transcription factor, Nurr1 Our findings reveal that loss of PGE2 signaling to MuSCs during recovery from injury impedes muscle repair and strength. Through such gain- or loss-of-function experiments, we found that PGE2 signaling acts as a rheostat for muscle stem-cell function. Decreased PGE2 signaling due to NSAIDs or increased PGE2 due to exogenous delivery dictates MuSC function, which determines the outcome of regeneration. The markedly enhanced and accelerated repair of damaged muscles following intramuscular delivery of PGE2 suggests a previously unrecognized indication for this therapeutic agent.

Uncertainty Footprint: Visualization of Nonuniform Behavior of Iterative Algorithms Applied to 4D Cell Tracking

Research on microscopy data from developing biological samples usually requires tracking individual cells over time. When cells are three-dimensionally and densely packed in a time-dependent scan of volumes, tracking results can become unreliable and uncertain. Not only are cell segmentation results often inaccurate to start with, but it also lacks a simple method to evaluate the tracking outcome. Previous cell tracking methods have been validated against benchmark data from real scans or artificial data, whose ground truth results are established by manual work or simulation. However, the wide variety of real-world data makes an exhaustive validation impossible. Established cell tracking tools often fail on new data, whose issues are also difficult to diagnose with only manual examinations. Therefore, data-independent tracking evaluation methods are desired for an explosion of microscopy data with increasing scale and resolution. In this paper, we propose the uncertainty footprint, an uncertainty quantification and visualization technique that examines nonuniformity at local convergence for an iterative evaluation process on a spatial domain supported by partially overlapping bases. We demonstrate that the patterns revealed by the uncertainty footprint indicate data processing quality in two algorithms from a typical cell tracking workflow - cell identification and association. A detailed analysis of the patterns further allows us to diagnose issues and design methods for improvements. A 4D cell tracking workflow equipped with the uncertainty footprint is capable of self diagnosis and correction for a higher accuracy than previous methods whose evaluation is limited by manual examinations.

Accelerating Live Single-Cell Signalling Studies

The dynamics of signalling networks that couple environmental conditions with cellular behaviour can now be characterised in exquisite detail using live single-cell imaging experiments. Recent improvements in our abilities to introduce fluorescent sensors into cells, coupled with advances in pipelines for quantifying and extracting single-cell data, mean that high-throughput systematic analyses of signalling dynamics are becoming possible. In this review, we consider current technologies that are driving progress in the scale and range of such studies. Moreover, we discuss novel approaches that are allowing us to explore how pathways respond to changes in inputs and even predict the fate of a cell based upon its signalling history and state.

Network Flow Integer Programming to Track Elliptical Cells in Time-Lapse Sequences

We propose a novel approach to automatically tracking elliptical cell populations in time-lapse image sequences. Given an initial segmentation, we account for partial occlusions and overlaps by generating an over-complete set of competing detection hypotheses. To this end, we fit ellipses to portions of the initial regions and build a hierarchy of ellipses, which are then treated as cell candidates. We then select temporally consistent ones by solving to optimality an integer program with only one type of flow variables. This eliminates the need for heuristics to handle missed detections due to partial occlusions and complex morphology. We demonstrate the effectiveness of our approach on a range of challenging sequences consisting of clumped cells and show that it outperforms state-of-the-art techniques.

DNA damage during S-phase mediates the proliferation-quiescence decision in the subsequent G1 via p21 expression

Following DNA damage caused by exogenous sources, such as ionizing radiation, the tumour suppressor p53 mediates cell cycle arrest via expression of the CDK inhibitor, p21. However, the role of p21 in maintaining genomic stability in the absence of exogenous DNA-damaging agents is unclear. Here, using live single-cell measurements of p21 protein in proliferating cultures, we show that naturally occurring DNA damage incurred over S-phase causes p53-dependent accumulation of p21 during mother G2- and daughter G1-phases. High p21 levels mediate G1 arrest via CDK inhibition, yet lower levels have no impact on G1 progression, and the ubiquitin ligases CRL4^Cdt2 and SCF^Skp2 couple to degrade p21 prior to the G1/S transition. Mathematical modelling reveals that a bistable switch, created by CRL4^Cdt2, promotes irreversible S-phase entry by keeping p21 levels low, preventing premature S-phase exit upon DNA damage. Thus, we characterize how p21 regulates the proliferation-quiescence decision to maintain genomic stability.

Cell cycle arrest after DNA damage is achieved by the expression of the CDK inhibitor p21. Here the authors show that spontaneous DNA damage incurred in unperturbed cell cycles, leads to cell populations exhibiting a bistable state, with p53 and p21 regulating the proliferation-quiescence decision.

Microcontact-Printed Hydrogel Microwell Arrays for Clonal Muscle Stem Cell Cultures

Adult muscle stem cells (also called satellite cells) are an anatomically defined population of cells that are essential for muscle regeneration. In aging and dystrophic diseases, muscle stem cells (MuSCs) exhibit functional and molecular heterogeneity; therefore, single-cell assay technologies are critical to illuminate the mechanisms of pathological stem cell dysfunction. Here, we describe the process of generating mechanically tunable hydrogels with micro-scale well features ("microwells") using micro-contact printing for clonal muscle stem cell culture assays. Microcontact printing (μCP) is a simple and versatile method for generating cell culture substrates for micro-scale features for spatially restricting the cultures of single cells and their progeny. We explain how to use photolithography and polydimethylsiloxane casting to generate stamps capable of printing purified extracellular matrix proteins onto soft, hydrated poly(ethylene glycol) hydrogels to generate arrayed microwells in a defined pattern. We summarize methods to analyze the viability, migration, and differentiation of individual MuSC clones within hydrogel microwell cultures.

A Hybrid Approach for Segmentation and Tracking of Myxococcus Xanthus Swarms

Cell segmentation and motion tracking in time-lapse images are fundamental problems in computer vision, and are also crucial for various biomedical studies. Myxococcus xanthus is a type of rod-like cells with highly coordinated motion. The segmentation and tracking of M. xanthus are challenging, because cells may touch tightly and form dense swarms that are difficult to identify individually in an accurate manner. The known cell tracking approaches mainly fall into two frameworks, detection association and model evolution, each having its own advantages and disadvantages. In this paper, we propose a new hybrid framework combining these two frameworks into one and leveraging their complementary advantages. Also, we propose an active contour model based on the Ribbon Snake, which is seamlessly integrated with our hybrid framework. Evaluated by 10 different datasets, our approach achieves considerable improvement over the state-of-the-art cell tracking algorithms on identifying complete cell trajectories, and higher segmentation accuracy than performing segmentation in individual 2D images.

Single-cell lineage tracking analysis reveals that an established cell line comprises putative cancer stem cells and their heterogeneous progeny

Mammalian cell culture has been used in many biological studies on the assumption that a cell line comprises putatively homogeneous clonal cells, thereby sharing similar phenotypic features. This fundamental assumption has not yet been fully tested; therefore, we developed a method for the chronological analysis of individual HeLa cells. The analysis was performed by live cell imaging, tracking of every single cell recorded on imaging videos, and determining the fates of individual cells. We found that cell fate varied significantly, indicating that, in contrast to the assumption, the HeLa cell line is composed of highly heterogeneous cells. Furthermore, our results reveal that only a limited number of cells are immortal and renew themselves, giving rise to the remaining cells. These cells have reduced reproductive ability, creating a functionally heterogeneous cell population. Hence, the HeLa cell line is maintained by the limited number of immortal cells, which could be putative cancer stem cells.

Cell Tracking Accuracy Measurement Based on Comparison of Acyclic Oriented Graphs

Tracking motile cells in time-lapse series is challenging and is required in many biomedical applications. Cell tracks can be mathematically represented as acyclic oriented graphs. Their vertices describe the spatio-temporal locations of individual cells, whereas the edges represent temporal relationships between them. Such a representation maintains the knowledge of all important cellular events within a captured field of view, such as migration, division, death, and transit through the field of view. The increasing number of cell tracking algorithms calls for comparison of their performance. However, the lack of a standardized cell tracking accuracy measure makes the comparison impracticable. This paper defines and evaluates an accuracy measure for objective and systematic benchmarking of cell tracking algorithms. The measure assumes the existence of a ground-truth reference, and assesses how difficult it is to transform a computed graph into the reference one. The difficulty is measured as a weighted sum of the lowest number of graph operations, such as split, delete, and add a vertex and delete, add, and alter the semantics of an edge, needed to make the graphs identical. The measure behavior is extensively analyzed based on the tracking results provided by the participants of the first Cell Tracking Challenge hosted by the 2013 IEEE International Symposium on Biomedical Imaging. We demonstrate the robustness and stability of the measure against small changes in the choice of weights for diverse cell tracking algorithms and fluorescence microscopy datasets. As the measure penalizes all possible errors in the tracking results and is easy to compute, it may especially help developers and analysts to tune their algorithms according to their needs.

Automated profiling of individual cell-cell interactions from high-throughput time-lapse imaging microscopy in nanowell grids (TIMING)

MOTIVATION

There is a need for effective automated methods for profiling dynamic cell-cell interactions with single-cell resolution from high-throughput time-lapse imaging data, especially, the interactions between immune effector cells and tumor cells in adoptive immunotherapy.

RESULTS

Fluorescently labeled human T cells, natural killer cells (NK), and various target cells (NALM6, K562, EL4) were co-incubated on polydimethylsiloxane arrays of sub-nanoliter wells (nanowells), and imaged using multi-channel time-lapse microscopy. The proposed cell segmentation and tracking algorithms account for cell variability and exploit the nanowell confinement property to increase the yield of correctly analyzed nanowells from 45% (existing algorithms) to 98% for wells containing one effector and a single target, enabling automated quantification of cell locations, morphologies, movements, interactions, and deaths without the need for manual proofreading. Automated analysis of recordings from 12 different experiments demonstrated automated nanowell delineation accuracy >99%, automated cell segmentation accuracy >95%, and automated cell tracking accuracy of 90%, with default parameters, despite variations in illumination, staining, imaging noise, cell morphology, and cell clustering. An example analysis revealed that NK cells efficiently discriminate between live and dead targets by altering the duration of conjugation. The data also demonstrated that cytotoxic cells display higher motility than non-killers, both before and during contact.

CONTACT

broysam@central.uh.edu or nvaradar@central.uh.edu

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.