Automated Cell Tracking Using Motion Prediction-Based Matching and Event Handling

Scale selection and machine learning based cell segmentation and tracking in time lapse microscopy

Monitoring and tracking of cell motion is a key component for understanding disease mechanisms and evaluating the effects of treatments. Time-lapse optical microscopy has been commonly employed for studying cell cycle phases. However, usual manual cell tracking is very time consuming and has poor reproducibility. Automated cell tracking techniques are challenged by variability of cell region intensity distributions and resolution limitations. In this work, we introduce a comprehensive cell segmentation and tracking methodology. A key contribution of this work is that it employs multi-scale space-time interest point detection and characterization for automatic scale selection and cell segmentation. Another contribution is the use of a neural network with class prototype balancing for detection of cell regions. This work also offers a structured mathematical framework that uses graphs for track generation and cell event detection. We evaluated cell segmentation, detection, and tracking performance of our method on time-lapse sequences of the Cell Tracking Challenge (CTC). We also compared our technique to top performing techniques from CTC. Performance evaluation results indicate that the proposed methodology is competitive with these techniques, and that it generalizes very well to diverse cell types and sizes, and multiple imaging techniques. The code of our method is publicly available on https://github.com/smakrogi/CSTQ_Pub/ , (release v.3.2).

The development of an automated microscope image tracking and analysis system

Microscopy image analysis plays a crucial role in understanding cellular behavior and uncovering important insights in various biological and medical research domains. Tracking cells within the time-lapse microscopy images is a fundamental technique that enables the study of cell dynamics, interactions, and migration. While manual cell tracking is possible, it is time-consuming and prone to subjective biases that impact results. In order to solve this issue, we sought to create an automated software solution, named cell analyzer, which is able to track cells within microscopy images with minimal input required from the user. The program of cell analyzer was written in Python utilizing the open source computer vision (OpenCV) library and featured a graphical user interface that makes it easy for users to access. The functions of all codes were verified through closeness, area, centroid, contrast, variance, and cell tracking test. Cell analyzer primarily utilizes image preprocessing and edge detection techniques to isolate cell boundaries for detection and analysis. It uniquely recorded the area, displacement, speed, size, and direction of detected cell objects and visualized the data collected automatically for fast analysis. Our cell analyzer provides an easy-to-use tool through a graphical user interface for tracking cell motion and analyzing quantitative cell images.

Scale Selection and Machine Learning-based Cell Segmentation and Tracking in Time Lapse Microscopy

Monitoring and tracking of cell motion is a key component for understanding disease mechanisms and evaluating the effects of treatments. Time-lapse optical microscopy has been commonly employed for studying cell cycle phases. However, usual manual cell tracking is very time consuming and has poor reproducibility. Automated cell tracking techniques are challenged by variability of cell region intensity distributions and resolution limitations. In this work, we introduce a comprehensive cell segmentation and tracking methodology. A key contribution of this work is that it employs multi-scale space-time interest point detection and characterization for automatic scale selection and cell segmentation. Another contribution is the use of a neural network with class prototype balancing for detection of cell regions. This work also offers a structured mathematical framework that uses graphs for track generation and cell event detection. We evaluated cell segmentation, detection, and tracking performance of our method on time-lapse sequences of the Cell Tracking Challenge (CTC). We also compared our technique to top performing techniques from CTC. Performance evaluation results indicate that the proposed methodology is competitive with these techniques, and that it generalizes very well to diverse cell types and sizes, and multiple imaging techniques.

Isolated Random Forest Assisted Spatio-Temporal Ant Colony Evolutionary Algorithm for Cell Tracking in Time-Lapse Sequences

Multi-Object tracking in real world environments is a tough problem, especially for cell morphogenesis with division. Most cell tracking methods are hard to achieve reliable mitosis detection, efficient inter-frame matching, and accurate state estimation simultaneously within a unified tracking framework. In this paper, we propose a novel unified framework that leverages a spatio-temporal ant colony evolutionary algorithm to track cells amidst mitosis under measurement uncertainty. Each Bernoulli ant colony representing a migrating cell is able to capture the occurrence of mitosis through the proposed Isolation Random Forest (IRF)-assisted temporal mitosis detection algorithm with the assumption that mitotic cells exhibit unique spatio-temporal features different from non-mitotic ones. Guided by prediction of a division event, multiple ant colonies evolve between consecutive frames according to an augmented assignment matrix solved by the extended Hungarian method. To handle dense cell populations, an efficient group partition between cells and measurements is exploited, which enables multiple assignment tasks to be executed in parallel with a reduction in matrix dimension. After inter-frame traversing, the ant colony transitions to a foraging stage in which it begins approximating the Bernoulli parameter to estimate cell state by iteratively updating its pheromone field. Experiments on multi-cell tracking in the presence of cell mitosis and morphological changes are conducted, and the results demonstrate that the proposed method outperforms state-of-the-art approaches, striking a balance between accuracy and computational efficiency.

Unlocking cardiac motion: assessing software and machine learning for single-cell and cardioid kinematic insights

The heart coordinates its functional parameters for optimal beat-to-beat mechanical activity. Reliable detection and quantification of these parameters still represent a hot topic in cardiovascular research. Nowadays, computer vision allows the development of open-source algorithms to measure cellular kinematics. However, the analysis software can vary based on analyzed specimens. In this study, we compared different software performances in in-silico model, in-vitro mouse adult ventricular cardiomyocytes and cardioids. We acquired in-vitro high-resolution videos during suprathreshold stimulation at 0.5-1-2 Hz, adapting the protocol for the cardioids. Moreover, we exposed the samples to inotropic and depolarizing substances. We analyzed in-silico and in-vitro videos by (i) MUSCLEMOTION, the gold standard among open-source software; (ii) CONTRACTIONWAVE, a recently developed tracking software; and (iii) ViKiE, an in-house customized video kinematic evaluation software. We enriched the study with three machine-learning algorithms to test the robustness of the motion-tracking approaches. Our results revealed that all software produced comparable estimations of cardiac mechanical parameters. For instance, in cardioids, beat duration measurements at 0.5 Hz were 1053.58 ms (MUSCLEMOTION), 1043.59 ms (CONTRACTIONWAVE), and 937.11 ms (ViKiE). ViKiE exhibited higher sensitivity in exposed samples due to its localized kinematic analysis, while MUSCLEMOTION and CONTRACTIONWAVE offered temporal correlation, combining global assessment with time-efficient analysis. Finally, machine learning reveals greater accuracy when trained with MUSCLEMOTION dataset in comparison with the other software (accuracy > 83%). In conclusion, our findings provide valuable insights for the accurate selection and integration of software tools into the kinematic analysis pipeline, tailored to the experimental protocol.

A graph-based cell tracking algorithm with few manually tunable parameters and automated segmentation error correction

Automatic cell segmentation and tracking enables to gain quantitative insights into the processes driving cell migration. To investigate new data with minimal manual effort, cell tracking algorithms should be easy to apply and reduce manual curation time by providing automatic correction of segmentation errors. Current cell tracking algorithms, however, are either easy to apply to new data sets but lack automatic segmentation error correction, or have a vast set of parameters that needs either manual tuning or annotated data for parameter tuning. In this work, we propose a tracking algorithm with only few manually tunable parameters and automatic segmentation error correction. Moreover, no training data is needed. We compare the performance of our approach to three well-performing tracking algorithms from the Cell Tracking Challenge on data sets with simulated, degraded segmentation—including false negatives, over- and under-segmentation errors. Our tracking algorithm can correct false negatives, over- and under-segmentation errors as well as a mixture of the aforementioned segmentation errors. On data sets with under-segmentation errors or a mixture of segmentation errors our approach performs best. Moreover, without requiring additional manual tuning, our approach ranks several times in the top 3 on the 6^th edition of the Cell Tracking Challenge.

An Automated Cell Tracking Approach With Multi-Bernoulli Filtering and Ant Colony Labor Division

In this article, we take as inspiration the labor division into scouts and workers in an ant colony and propose a novel approach for automated cell tracking in the framework of multi-Bernoulli random finite sets. To approximate the Bernoulli parameter sets, we first define an existence probability of an ant colony as well as its discrete density distribution. During foraging, the behavior of scouts is modeled as a chaotic movement to produce a set of potential candidates. Afterwards, a group of workers, i.e., a worker ant colony, is recruited for each candidate, which then embark on gathering heuristic information in a self-organized way. Finally, the pheromone field is formed by the corresponding worker ant colony, from which the Bernoulli parameter is derived and the state of the cell is estimated accordingly to be associated with the existing tracks. Performance comparisons with other previous approaches are conducted on both simulated and real cell image sequences and show the superiority of this algorithm.

CellMAPtracer: A User-Friendly Tracking Tool for Long-Term Migratory and Proliferating Cells Associated with FUCCI Systems

Cell migration is a fundamental biological process of key importance in health and disease. Advances in imaging techniques have paved the way to monitor cell motility. An ever-growing collection of computational tools to track cells has improved our ability to analyze moving cells. One renowned goal in the field is to provide tools that track cell movement as comprehensively and automatically as possible. However, fully automated tracking over long intervals of time is challenged by dividing cells, thus calling for a combination of automated and supervised tracking. Furthermore, after the emergence of various experimental tools to monitor cell-cycle phases, it is of relevance to integrate the monitoring of cell-cycle phases and motility. We developed CellMAPtracer, a multiplatform tracking system that achieves that goal. It can be operated as a conventional, automated tracking tool of single cells in numerous imaging applications. However, CellMAPtracer also allows adjusting tracked cells in a semiautomated supervised fashion, thereby improving the accuracy and facilitating the long-term tracking of migratory and dividing cells. CellMAPtracer is available with a user-friendly graphical interface and does not require any coding or programming skills. CellMAPtracer is compatible with two- and three-color fluorescent ubiquitination-based cell-cycle indicator (FUCCI) systems and allows the user to accurately monitor various migration parameters throughout the cell cycle, thus having great potential to facilitate new discoveries in cell biology.