Segmentation, tracking and cell cycle analysis of live-cell imaging data with Cell-ACDC

Optical microscopic imaging, manipulation, and analysis methods for morphogenesis research

Morphogenesis is a developmental process of organisms being shaped through complex and cooperative cellular movements. To understand the interplay between genetic programs and the resulting multicellular morphogenesis, it is essential to characterize the morphologies and dynamics at the single-cell level and to understand how physical forces serve as both signaling components and driving forces of tissue deformations. In recent years, advances in microscopy techniques have led to improvements in imaging speed, resolution and depth. Concurrently, the development of various software packages has supported large-scale, analyses of challenging images at the single-cell resolution. While these tools have enhanced our ability to examine dynamics of cells and mechanical processes during morphogenesis, their effective integration requires specialized expertise. With this background, this review provides a practical overview of those techniques. First, we introduce microscopic techniques for multicellular imaging and image analysis software tools with a focus on cell segmentation and tracking. Second, we provide an overview of cutting-edge techniques for mechanical manipulation of cells and tissues. Finally, we introduce recent findings on morphogenetic mechanisms and mechanosensations that have been achieved by effectively combining microscopy, image analysis tools and mechanical manipulation techniques.

Whi5 hypo- and hyper-phosphorylation dynamics control cell-cycle entry and progression

Progression through the cell cycle depends on the phosphorylation of key substrates by cyclin-dependent kinases. In budding yeast, these substrates include the transcriptional inhibitor Whi5 that regulates G1/S transition. In early G1 phase, Whi5 is hypo-phosphorylated and inhibits the Swi4/Swi6 (SBF) complex that promotes transcription of the cyclins CLN1 and CLN2. In late G1, Whi5 is rapidly hyper-phosphorylated by Cln1 and Cln2 in complex with the cyclin-dependent kinase Cdk1. This hyper-phosphorylation inactivates Whi5 and excludes it from the nucleus. Here, we set out to determine the molecular mechanisms responsible for Whi5's multi-site phosphorylation and how they regulate the cell cycle. To do this, we first identified the 19 Whi5 sites that are appreciably phosphorylated and then determined which of these sites are responsible for G1 hypo-phosphorylation. Mutation of 7 sites removed G1 hypo-phosphorylation, increased cell size, and delayed the G1/S transition. Moreover, the rapidity of Whi5 hyper-phosphorylation in late G1 depends on "priming" sites that dock the Cks1 subunit of Cln1,2-Cdk1 complexes. Hyper-phosphorylation is crucial for Whi5 nuclear export, normal cell size, full expression of SBF target genes, and timely progression through both the G1/S transition and S/G2/M phases. Thus, our work shows how Whi5 phosphorylation regulates the G1/S transition and how it is required for timely progression through S/G2/M phases and not only G1 as previously thought.

Deep learning-driven imaging of cell division and cell growth across an entire eukaryotic life cycle

The life cycle of biomedical and agriculturally relevant eukaryotic microorganisms involves complex transitions between proliferative and non-proliferative states such as dormancy, mating, meiosis, and cell division. New drugs, pesticides, and vaccines can be created by targeting specific life cycle stages of parasites and pathogens. However, defining the structure of a microbial life cycle often relies on partial observations that are theoretically assembled in an ideal life cycle path. To create a more quantitative approach to studying complete eukaryotic life cycles, we generated a deep learning-driven imaging framework to track microorganisms across sexually reproducing generations. Our approach combines microfluidic culturing, life cycle stage-specific segmentation of microscopy images using convolutional neural networks, and a novel cell tracking algorithm, FIEST, based on enhancing the overlap of single cell masks in consecutive images through deep learning video frame interpolation. As proof of principle, we used this approach to quantitatively image and compare cell growth and cell cycle regulation across the sexual life cycle of Saccharomyces cerevisiae . We developed a fluorescent reporter system based on a fluorescently labeled Whi5 protein, the yeast analog of mammalian Rb, and a new High-Cdk1 activity sensor, LiCHI, designed to report during DNA replication, mitosis, meiotic homologous recombination, meiosis I, and meiosis II. We found that cell growth preceded the exit from non-proliferative states such as mitotic G1, pre-meiotic G1, and the G0 spore state during germination. A decrease in the total cell concentration of Whi5 characterized the exit from non-proliferative states, which is consistent with a Whi5 dilution model. The nuclear accumulation of Whi5 was developmentally regulated, being at its highest during meiotic exit and spore formation. The temporal coordination of cell division and growth was not significantly different across three sexually reproducing generations. Our framework could be used to quantitatively characterize other single-cell eukaryotic life cycles that remain incompletely described. An off-the-shelf user interface Yeastvision provides free access to our image processing and single-cell tracking algorithms.

Single-cell tracking as a tool for studying EMT-phenotypes

This article demonstrates that label-free single-cell video tracking is a useful approach for in vitro studies of Epithelial-Mesenchymal Transition (EMT). EMT is a highly heterogeneous process, involved in wound healing, embryogenesis and cancer. The process promotes metastasis, and increased understanding can aid development of novel therapeutic strategies. The role of EMT-associated biomarkers depends on biological context, making it challenging to compare and interpret data from different studies. We demonstrate single-cell video tracking for comprehensive phenotype analysis. In this study we performed single-cell video tracking on 72-h long recordings. We quantified several behaviours at a single-cell level during induced EMT in MDA-MB-468 cells. This revealed notable variations in migration speed, with different dose-response patterns and varying distributions of speed. By registering cell morphologies during the recording, we determined preferred paths of morphological transitions. We also found a clear association between migration speed and cell morphology. We found elevated rates of cell death, diminished proliferation, and an increase in mitotic failures followed by re-fusion of sister-cells. The method allows tracking of phenotypes in cell lineages, which can be particularly useful in epigenetic studies. Sister-cells were found to have significant similarities in their speeds and morphologies, illustrating the heritability of these traits.

Automatic enhancement preprocessing for segmentation of low quality cell images

We present a novel automatic preprocessing and ensemble learning technique for the segmentation of low-quality cell images. Capturing cells subjected to intense light is challenging due to their vulnerability to light-induced cell death. Consequently, microscopic cell images tend to be of low quality and it causes low accuracy for semantic segmentation. This problem can not be satisfactorily solved by classical image preprocessing methods. Therefore, we propose a novel approach of automatic enhancement preprocessing (AEP), which translates an input image into images that are easy to recognize by deep learning. AEP is composed of two deep neural networks, and the penultimate feature maps of the first network are employed as filters to translate an input image with low quality into images that are easily classified by deep learning. Additionally, we propose an automatic weighted ensemble learning (AWEL), which combines the multiple segmentation results. Since the second network predicts segmentation results corresponding to each translated input image, multiple segmentation results can be aggregated by automatically determining suitable weights. Experiments on two types of cell image segmentation confirmed that AEP can translate low-quality cell images into images that are easy to segment and that segmentation accuracy improves using AWEL.

Adaptive t-vMF dice loss: An effective expansion of dice loss for medical image segmentation

Dice loss is widely used for medical image segmentation, and many improved loss functions have been proposed. However, further Dice loss improvements are still possible. In this study, we reconsidered the use of Dice loss and discovered that Dice loss can be rewritten in the loss function using the cosine similarity through a simple equation transformation. Using this knowledge, we present a novel t-vMF Dice loss based on the t-vMF similarity instead of the cosine similarity. Based on the t-vMF similarity, our proposed Dice loss is formulated in a more compact similarity loss function than the original Dice loss. Furthermore, we present an effective algorithm that automatically determines the parameter κ for the t-vMF similarity using a validation accuracy, called Adaptive t-vMF Dice loss. Using this algorithm, it is possible to apply more compact similarities for easy classes and wider similarities for difficult classes, and we are able to achieve adaptive training based on the accuracy of each class. We evaluated binary segmentation datasets of CVC-ClinicDB and Kvasir-SEG, and multi-class segmentation datasets of Automated Cardiac Diagnosis Challenge and Synapse multi-organ segmentation. Through experiments conducted on four datasets using a five-fold cross-validation, we confirmed that the Dice score coefficient (DSC) was further improved in comparison with the original Dice loss and other loss functions.

Segmentation of C. elegans germline nuclei

Immunofluorescence microscopy is a widely adopted method for studying meiotic prophase in the nematode model organism, Caenorhabditis elegans . An in-depth examination of specific meiotic processes requires the quantitative analysis of immunofluorescence images, which often involves the segmentation of individual cells or nuclei. Here, we introduce our image analysis pipeline to automate significant portions of this task. This pipeline relies on the powerful deep learning model Cellpose 2.0 to segment cellular structures. To further improve the segmentation accuracy for germline nuclei stained for chromatin or synaptonemal complexes, we retrained the generalist Cellpose model and integrated our data processing pipeline into the easy-to-use Cell-ACDC image analysis software. Our pipeline thus makes deep learning-based segmentation of nuclei in the distal germline of C. elegans accessible for users without coding experience.

Live-cell imaging in the deep learning era

Live imaging is a powerful tool, enabling scientists to observe living organisms in real time. In particular, when combined with fluorescence microscopy, live imaging allows the monitoring of cellular components with high sensitivity and specificity. Yet, due to critical challenges (i.e., drift, phototoxicity, dataset size), implementing live imaging and analyzing the resulting datasets is rarely straightforward. Over the past years, the development of bioimage analysis tools, including deep learning, is changing how we perform live imaging. Here we briefly cover important computational methods aiding live imaging and carrying out key tasks such as drift correction, denoising, super-resolution imaging, artificial labeling, tracking, and time series analysis. We also cover recent advances in self-driving microscopy.

Opportunities and challenges for deep learning in cell dynamics research

The growth of artificial intelligence (AI) has led to an increase in the adoption of computer vision and deep learning (DL) techniques for the evaluation of microscopy images and movies. This adoption has not only addressed hurdles in quantitative analysis of dynamic cell biological processes but has also started to support advances in drug development, precision medicine, and genome-phenome mapping. We survey existing AI-based techniques and tools, as well as open-source datasets, with a specific focus on the computational tasks of segmentation, classification, and tracking of cellular and subcellular structures and dynamics. We summarise long-standing challenges in microscopy video analysis from a computational perspective and review emerging research frontiers and innovative applications for DL-guided automation in cell dynamics research.

Whi5 hypo- and hyper-phosphorylation dynamics control cell cycle entry and progression

Progression through the cell cycle depends on the phosphorylation of key substrates by cyclin-dependent kinases. In budding yeast, these substrates include the transcriptional inhibitor Whi5 that regulates the G1/S transition. In early G1 phase, Whi5 is hypo-phosphorylated and inhibits the SBF complex that promotes transcription of the cyclins CLN1 and CLN2 . In late-G1, Whi5 is rapidly hyper-phosphorylated by Cln1,2 in complex with the cyclin-dependent kinase Cdk1. This hyper-phosphorylation inactivates Whi5 and excludes it from the nucleus. Here, we set out to determine the molecular mechanisms responsible for Whi5's multi-site phosphorylation and how they regulate the cell cycle. To do this, we first identified the 19 Whi5 sites that are appreciably phosphorylated and then determined which of these sites are responsible for G1 hypo-phosphorylation. Mutation of 7 sites removed G1 hypo-phosphorylation, increased cell size, and delayed the G1/S transition. Moreover, the rapidity of Whi5 hyper-phosphorylation in late G1 depends on 'priming' sites that dock the Cks1 subunit of Cln1,2-Cdk1 complexes. Hyper-phosphorylation is crucial for Whi5 nuclear export, normal cell size, full expression of SBF target genes, and timely progression through both the G1/S transition and S/G2/M phases. Thus, our work shows how Whi5 phosphorylation regulates the G1/S transition and how it is required for timely progression through S/G2/M phases and not only G1 as previously thought.

Regulation with cell size ensures mitochondrial DNA homeostasis during cell growth

To maintain stable DNA concentrations, proliferating cells need to coordinate DNA replication with cell growth. For nuclear DNA, eukaryotic cells achieve this by coupling DNA replication to cell-cycle progression, ensuring that DNA is doubled exactly once per cell cycle. By contrast, mitochondrial DNA replication is typically not strictly coupled to the cell cycle, leaving the open question of how cells maintain the correct amount of mitochondrial DNA during cell growth. Here, we show that in budding yeast, mitochondrial DNA copy number increases with cell volume, both in asynchronously cycling populations and during G1 arrest. Our findings suggest that cell-volume-dependent mitochondrial DNA maintenance is achieved through nuclear-encoded limiting factors, including the mitochondrial DNA polymerase Mip1 and the packaging factor Abf2, whose amount increases in proportion to cell volume. By directly linking mitochondrial DNA maintenance to nuclear protein synthesis and thus cell growth, constant mitochondrial DNA concentrations can be robustly maintained without a need for cell-cycle-dependent regulation.

pomBseen: An automated pipeline for analysis of fission yeast images

Fission yeast is a model organism widely used for studies of eukaryotic cell biology. As such, it is subject to bright-field and fluorescent microscopy. Manual analysis of such data can be laborious and subjective. Therefore, we have developed pomBseen, an image analysis pipeline for the quantitation of fission yeast micrographs containing a bright-field channel and up to two fluorescent channels. It accepts a wide range of image formats and produces a table with the size and total and nuclear fluorescent intensities of the cells in the image. Benchmarking of the pipeline against manually annotated datasets demonstrates that it reliably segments cells and acquires their image parameters. Written in MATLAB, pomBseen is also available as a standalone application.

The molecular basis of tumor metastasis and current approaches to decode targeted migration-promoting events in pediatric neuroblastoma

Cell motility is a crucial biological process that plays a critical role in the development of multicellular organisms and is essential for tissue formation and regeneration. However, uncontrolled cell motility can lead to the development of various diseases, including neoplasms. In this review, we discuss recent advances in the discovery of regulatory mechanisms underlying the metastatic spread of neuroblastoma, a solid pediatric tumor that originates in the embryonic migratory cells of the neural crest. The highly motile phenotype of metastatic neuroblastoma cells requires targeting of intracellular and extracellular processes, that, if affected, would be helpful for the treatment of high-risk patients with neuroblastoma, for whom current therapies remain inadequate. Development of new potentially migration-inhibiting compounds and standardized preclinical approaches for the selection of anti-metastatic drugs in neuroblastoma will also be discussed.

An mTOR/RNA pol I axis shapes chromatin architecture in response to fasting

Chromatin architecture is a fundamental mediator of genome function. Fasting is a major environmental cue across the animal kingdom. Yet, how it impacts on 3D genome organization is unknown. Here, we show that fasting induces a reversible and large-scale spatial reorganization of chromatin in C. elegans . This fasting-induced 3D genome reorganization requires inhibition of the nutrient-sensing mTOR pathway, a major regulator of ribosome biogenesis. Remarkably, loss of transcription by RNA Pol I, but not RNA Pol II nor Pol III, induces a similar 3D genome reorganization in fed animals, and prevents the restoration of the fed-state architecture upon restoring nutrients to fasted animals. Our work documents the first large-scale chromatin reorganization triggered by fasting and reveals that mTOR and RNA Pol I shape genome architecture in response to nutrients.

Microsystem Advances through Integration with Artificial Intelligence

Microfluidics is a rapidly growing discipline that involves studying and manipulating fluids at reduced length scale and volume, typically on the scale of micro- or nanoliters. Under the reduced length scale and larger surface-to-volume ratio, advantages of low reagent consumption, faster reaction kinetics, and more compact systems are evident in microfluidics. However, miniaturization of microfluidic chips and systems introduces challenges of stricter tolerances in designing and controlling them for interdisciplinary applications. Recent advances in artificial intelligence (AI) have brought innovation to microfluidics from design, simulation, automation, and optimization to bioanalysis and data analytics. In microfluidics, the Navier-Stokes equations, which are partial differential equations describing viscous fluid motion that in complete form are known to not have a general analytical solution, can be simplified and have fair performance through numerical approximation due to low inertia and laminar flow. Approximation using neural networks trained by rules of physical knowledge introduces a new possibility to predict the physicochemical nature. The combination of microfluidics and automation can produce large amounts of data, where features and patterns that are difficult to discern by a human can be extracted by machine learning. Therefore, integration with AI introduces the potential to revolutionize the microfluidic workflow by enabling the precision control and automation of data analysis. Deployment of smart microfluidics may be tremendously beneficial in various applications in the future, including high-throughput drug discovery, rapid point-of-care-testing (POCT), and personalized medicine. In this review, we summarize key microfluidic advances integrated with AI and discuss the outlook and possibilities of combining AI and microfluidics.

LapTrack: linear assignment particle tracking with tunable metrics

MOTIVATION

Particle tracking is an important step of analysis in a variety of scientific fields and is particularly indispensable for the construction of cellular lineages from live images. Although various supervised machine learning methods have been developed for cell tracking, the diversity of the data still necessitates heuristic methods that require parameter estimations from small amounts of data. For this, solving tracking as a linear assignment problem (LAP) has been widely applied and demonstrated to be efficient. However, there has been no implementation that allows custom connection costs, parallel parameter tuning with ground truth annotations, and the functionality to preserve ground truth connections, limiting the application to datasets with partial annotations.

RESULTS

We developed LapTrack, a LAP-based tracker which allows including arbitrary cost functions and inputs, parallel parameter tuning and ground-truth track preservation. Analysis of real and artificial datasets demonstrates the advantage of custom metric functions for tracking score improvement from distance-only cases. The tracker can be easily combined with other Python-based tools for particle detection, segmentation and visualization.

AVAILABILITY AND IMPLEMENTATION

LapTrack is available as a Python package on PyPi, and the notebook examples are shared at https://github.com/yfukai/laptrack. The data and code for this publication are hosted at https://github.com/NoneqPhysLivingMatterLab/laptrack-optimisation.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Single-molecule experiments reveal the elbow as an essential folding guide in SMC coiled-coil arms

Structural maintenance of chromosome (SMC) complexes form ring-like structures through exceptional elongated coiled-coils (CCs). Recent studies found that variable CC conformations, including open and collapsed forms, which might result from discontinuities in the CC, facilitate the diverse functions of SMCs in DNA organization. However, a detailed description of the SMC CC architecture is still missing. Here, we study the structural composition and mechanical properties of SMC proteins with optical tweezers unfolding experiments using the isolated Psm3 CC as a model system. We find a comparatively unstable protein with three unzipping intermediates, which we could directly assign to CC features by crosslinking experiments and state-of-the-art prediction software. Particularly, the CC elbow is shown to be a flexible, potentially non-structured feature, which divides the CC into sections, induces a pairing shift from one CC strand to the other and could facilitate large-scale conformational changes, most likely via thermal fluctuations of the flanking CC sections. A replacement of the elbow amino acids hinders folding of the consecutive CC region and frequently leads to non-native misalignments, revealing the elbow as a guide for proper folding. Additional in vivo manipulation of the elbow flexibility resulted in impaired cohesin complexes, which directly link the sensitive CC architecture to the biological function of cohesin.

Cellular enlargement - A new hallmark of aging?

Years of important research has revealed that cells heavily invest in regulating their size. Nevertheless, it has remained unclear why accurate size control is so important. Our recent study using hematopoietic stem cells (HSCs) in vivo indicates that cellular enlargement is causally associated with aging. Here, we present an overview of these findings and their implications. Furthermore, we performed a broad literature analysis to evaluate the potential of cellular enlargement as a new aging hallmark and to examine its connection to previously described aging hallmarks. Finally, we highlight interesting work presenting a correlation between cell size and age-related diseases. Taken together, we found mounting evidence linking cellular enlargement to aging and age-related diseases. Therefore, we encourage researchers from seemingly unrelated areas to take a fresh look at their data from the perspective of cell size.

Altered expression response upon repeated gene repression in single yeast cells

Cells must continuously adjust to changing environments and, thus, have evolved mechanisms allowing them to respond to repeated stimuli. While faster gene induction upon a repeated stimulus is known as reinduction memory, responses to repeated repression have been less studied so far. Here, we studied gene repression across repeated carbon source shifts in over 1,500 single Saccharomyces cerevisiae cells. By monitoring the expression of a carbon source-responsive gene, galactokinase 1 (Gal1), and fitting a mathematical model to the single-cell data, we observed a faster response upon repeated repressions at the population level. Exploiting our single-cell data and quantitative modeling approach, we discovered that the faster response is mediated by a shortened repression response delay, the estimated time between carbon source shift and Gal1 protein production termination. Interestingly, we can exclude two alternative hypotheses, i) stronger dilution because of e.g., increased proliferation, and ii) a larger fraction of repressing cells upon repeated repressions. Collectively, our study provides a quantitative description of repression kinetics in single cells and allows us to pinpoint potential mechanisms underlying a faster response upon repeated repression. The computational results of our study can serve as the starting point for experimental follow-up studies.

Cells have to continuously adjust to their environment and cope with changing temperature, stress conditions, or metabolic resources. Yeast cells exposed to repeated carbon source shifts have shown to be “primed” by their first exposure, exhibiting enhanced gene expression of specific genes later on. However, how cells respond to a repeated repressive stimulus, e.g., withdrawal of metabolic resources, has been so far much less studied.

For this, we investigated the expression kinetics of a carbon source-responsive gene across repeated repressions. We measured single-cell expression and used mathematical modeling to evaluate potential causes underlying an observed faster repression response upon a repeated stimulus. Specifically, we investigated whether i) an increased dilution due to e.g., proliferation, ii) an increased fraction of repressing cells, or iii) different kinetic parameters in the repeated repression cause the observed faster response in the second repression. Leveraging quantitative mathematical model comparison, we discovered that the faster response is mediated by a shortened estimated time between carbon source shift and protein production termination at the single-cell level.

Our study provides a quantitative description of repression kinetics in single cells and allows us to pinpoint potential mechanisms underlying a faster response upon repeated repression.