DeLTA: Automated cell segmentation, tracking, and lineage reconstruction using deep learning

Navigating Environmental Transitions: the Role of Phenotypic Variation in Bacterial Responses

The ability of bacteria to respond to changes in their environment is critical to their survival, allowing them to withstand stress, form complex communities, and induce virulence responses during host infection. A remarkable feature of many of these bacterial responses is that they are often variable across individual cells, despite occurring in an isogenic population exposed to a homogeneous environmental change, a phenomenon known as phenotypic heterogeneity. Phenotypic heterogeneity can enable bet-hedging or division of labor strategies that allow bacteria to survive fluctuating conditions. Investigating the significance of phenotypic heterogeneity in environmental transitions requires dynamic, single-cell data. Technical advances in quantitative single-cell measurements, imaging, and microfluidics have led to a surge of publications on this topic. Here, we review recent discoveries on single-cell bacterial responses to environmental transitions of various origins and complexities, from simple diauxic shifts to community behaviors in biofilm formation to virulence regulation during infection. We describe how these studies firmly establish that this form of heterogeneity is prevalent and a conserved mechanism by which bacteria cope with fluctuating conditions. We end with an outline of current challenges and future directions for the field. While it remains challenging to predict how an individual bacterium will respond to a given environmental input, we anticipate that capturing the dynamics of the process will begin to resolve this and facilitate rational perturbation of environmental responses for therapeutic and bioengineering purposes.

Synthetic Micrographs of Bacteria (SyMBac) allows accurate segmentation of bacterial cells using deep neural networks

BACKGROUND

Deep-learning-based image segmentation models are required for accurate processing of high-throughput timelapse imaging data of bacterial cells. However, the performance of any such model strictly depends on the quality and quantity of training data, which is difficult to generate for bacterial cell images. Here, we present a novel method of bacterial image segmentation using machine learning models trained with Synthetic Micrographs of Bacteria (SyMBac).

RESULTS

We have developed SyMBac, a tool that allows for rapid, automatic creation of arbitrary amounts of training data, combining detailed models of cell growth, physical interactions, and microscope optics to create synthetic images which closely resemble real micrographs, and is capable of training accurate image segmentation models. The major advantages of our approach are as follows: (1) synthetic training data can be generated virtually instantly and on demand; (2) these synthetic images are accompanied by perfect ground truth positions of cells, meaning no data curation is required; (3) different biological conditions, imaging platforms, and imaging modalities can be rapidly simulated, meaning any change in one's experimental setup no longer requires the laborious process of manually generating new training data for each change. Deep-learning models trained with SyMBac data are capable of analysing data from various imaging platforms and are robust to drastic changes in cell size and morphology. Our benchmarking results demonstrate that models trained on SyMBac data generate more accurate cell identifications and precise cell masks than those trained on human-annotated data, because the model learns the true position of the cell irrespective of imaging artefacts. We illustrate the approach by analysing the growth and size regulation of bacterial cells during entry and exit from dormancy, which revealed novel insights about the physiological dynamics of cells under various growth conditions.

CONCLUSIONS

The SyMBac approach will help to adapt and improve the performance of deep-learning-based image segmentation models for accurate processing of high-throughput timelapse image data.

Omnipose: a high-precision morphology-independent solution for bacterial cell segmentation

Advances in microscopy hold great promise for allowing quantitative and precise measurement of morphological and molecular phenomena at the single-cell level in bacteria; however, the potential of this approach is ultimately limited by the availability of methods to faithfully segment cells independent of their morphological or optical characteristics. Here, we present Omnipose, a deep neural network image-segmentation algorithm. Unique network outputs such as the gradient of the distance field allow Omnipose to accurately segment cells on which current algorithms, including its predecessor, Cellpose, produce errors. We show that Omnipose achieves unprecedented segmentation performance on mixed bacterial cultures, antibiotic-treated cells and cells of elongated or branched morphology. Furthermore, the benefits of Omnipose extend to non-bacterial subjects, varied imaging modalities and three-dimensional objects. Finally, we demonstrate the utility of Omnipose in the characterization of extreme morphological phenotypes that arise during interbacterial antagonism. Our results distinguish Omnipose as a powerful tool for characterizing diverse and arbitrarily shaped cell types from imaging data.

GEMA-An Automatic Segmentation Method for Real-Time Analysis of Mammalian Cell Growth in Microfluidic Devices

Nowadays, image analysis has a relevant role in most scientific and research areas. This process is used to extract and understand information from images to obtain a model, knowledge, and rules in the decision process. In the case of biological areas, images are acquired to describe the behavior of a biological agent in time such as cells using a mathematical and computational approach to generate a system with automatic control. In this paper, MCF7 cells are used to model their growth and death when they have been injected with a drug. These mammalian cells allow understanding of behavior, gene expression, and drug resistance to breast cancer. For this, an automatic segmentation method called GEMA is presented to analyze the apoptosis and confluence stages of culture by measuring the increase or decrease of the image area occupied by cells in microfluidic devices. In vitro, the biological experiments can be analyzed through a sequence of images taken at specific intervals of time. To automate the image segmentation, the proposed algorithm is based on a Gabor filter, a coefficient of variation (CV), and linear regression. This allows the processing of images in real time during the evolution of biological experiments. Moreover, GEMA has been compared with another three representative methods such as gold standard (manual segmentation), morphological gradient, and a semi-automatic algorithm using FIJI. The experiments show promising results, due to the proposed algorithm achieving an accuracy above 90% and a lower computation time because it requires on average 1 s to process each image. This makes it suitable for image-based real-time automatization of biological lab-on-a-chip experiments.

Neutron Imaging and Learning Algorithms: New Perspectives in Cultural Heritage Applications

Recently, learning algorithms such as Convolutional Neural Networks have been successfully applied in different stages of data processing from the acquisition to the data analysis in the imaging context. The aim of these algorithms is the dimensionality of data reduction and the computational effort, to find benchmarks and extract features, to improve the resolution, and reproducibility performances of the imaging data. Currently, no Neutron Imaging combined with learning algorithms was applied on cultural heritage domain, but future applications could help to solve challenges of this research field. Here, a review of pioneering works to exploit the use of Machine Learning and Deep Learning models applied to X-ray imaging and Neutron Imaging data processing is reported, spanning from biomedicine, microbiology, and materials science to give new perspectives on future cultural heritage applications.

Microfluidics for long-term single-cell time-lapse microscopy: Advances and applications

Cells are inherently dynamic, whether they are responding to environmental conditions or simply at equilibrium, with biomolecules constantly being made and destroyed. Due to their small volumes, the chemical reactions inside cells are stochastic, such that genetically identical cells display heterogeneous behaviors and gene expression profiles. Studying these dynamic processes is challenging, but the development of microfluidic methods enabling the tracking of individual prokaryotic cells with microscopy over long time periods under controlled growth conditions has led to many discoveries. This review focuses on the recent developments of one such microfluidic device nicknamed the mother machine. We overview the original device design, experimental setup, and challenges associated with this platform. We then describe recent methods for analyzing experiments using automated image segmentation and tracking. We further discuss modifications to the experimental setup that allow for time-varying environmental control, replicating batch culture conditions, cell screening based on their dynamic behaviors, and to accommodate a variety of microbial species. Finally, this review highlights the discoveries enabled by this technology in diverse fields, such as cell-size control, genetic mutations, cellular aging, and synthetic biology.

Cell region fingerprints enable highly precise single-cell tracking and lineage reconstruction

Experimental studies of cell growth, inheritance and their associated processes by microscopy require accurate single-cell observations of sufficient duration to reconstruct the genealogy. However, cell tracking-assigning identical cells on consecutive images to a track-is often challenging, resulting in laborious manual verification. Here, we propose fingerprints to identify problematic assignments rapidly. A fingerprint distance compares the structural information contained in the low frequencies of a Fourier transform to measure the similarity between cells in two consecutive images. We show that fingerprints are broadly applicable across cell types and image modalities, provided the image has sufficient structural information. Our tracker (Trac^X) uses fingerprints to reject unlikely assignments, thereby increasing tracking performance on published and newly generated long-term data sets. For Saccharomyces cerevisiae, we propose a comprehensive model for cell size control at the single-cell and population level centered on the Whi5 regulator, demonstrating how precise tracking can help uncover previously undescribed single-cell biology.

Recent advances in microfluidics-based cell migration research

Cell migration is crucial for many biological processes, including normal development, immune response, and tissue homeostasis and many pathological processes such as cancer metastasis and wound healing. Microfluidics has revolutionized the research in cell migration since its inception as it reduces the cost of studies and allows precise manipulation of different parameters that affect cell migratory response. Over the past decade, the field has made great strides in many directions, such as techniques for better control of the cellular microenvironment, application-oriented physiological-like models, and machine-assisted cell image analysis methods. Here we review recent developments in the field of microfluidic cell migration through the following aspects: 1) the co-culture models for studying host-pathogen interactions at single-cell resolution; 2) the spatiotemporal manipulation of the chemical gradients guiding cell migration; 3) the organ-on-chip models to study cell transmigration; and 4) the deep learning image processing strategies for cell migration data analysis. We further discuss the challenges, possible improvement and future perspectives of using microfluidic techniques to study cell migration.

Deep Learning Concepts and Applications for Synthetic Biology

Synthetic biology has a natural synergy with deep learning. It can be used to generate large data sets to train models, for example by using DNA synthesis, and deep learning models can be used to inform design, such as by generating novel parts or suggesting optimal experiments to conduct. Recently, research at the interface of engineering biology and deep learning has highlighted this potential through successes including the design of novel biological parts, protein structure prediction, automated analysis of microscopy data, optimal experimental design, and biomolecular implementations of artificial neural networks. In this review, we present an overview of synthetic biology-relevant classes of data and deep learning architectures. We also highlight emerging studies in synthetic biology that capitalize on deep learning to enable novel understanding and design, and discuss challenges and future opportunities in this space.

DeepBacs for multi-task bacterial image analysis using open-source deep learning approaches

This work demonstrates and guides how to use a range of state-of-the-art artificial neural-networks to analyse bacterial microscopy images using the recently developed ZeroCostDL4Mic platform. We generated a database of image datasets used to train networks for various image analysis tasks and present strategies for data acquisition and curation, as well as model training. We showcase different deep learning (DL) approaches for segmenting bright field and fluorescence images of different bacterial species, use object detection to classify different growth stages in time-lapse imaging data, and carry out DL-assisted phenotypic profiling of antibiotic-treated cells. To also demonstrate the ability of DL to enhance low-phototoxicity live-cell microscopy, we showcase how image denoising can allow researchers to attain high-fidelity data in faster and longer imaging. Finally, artificial labelling of cell membranes and predictions of super-resolution images allow for accurate mapping of cell shape and intracellular targets. Our purposefully-built database of training and testing data aids in novice users' training, enabling them to quickly explore how to analyse their data through DL. We hope this lays a fertile ground for the efficient application of DL in microbiology and fosters the creation of tools for bacterial cell biology and antibiotic research.

Machine learning approaches for biomolecular, biophysical, and biomaterials research

A fluent conversation with a virtual assistant, person-tailored news feeds, and deep-fake images created within seconds-all those things that have been unthinkable for a long time are now a part of our everyday lives. What these examples have in common is that they are realized by different means of machine learning (ML), a technology that has fundamentally changed many aspects of the modern world. The possibility to process enormous amount of data in multi-hierarchical, digital constructs has paved the way not only for creating intelligent systems but also for obtaining surprising new insight into many scientific problems. However, in the different areas of biosciences, which typically rely heavily on the collection of time-consuming experimental data, applying ML methods is a bit more challenging: Here, difficulties can arise from small datasets and the inherent, broad variability, and complexity associated with studying biological objects and phenomena. In this Review, we give an overview of commonly used ML algorithms (which are often referred to as "machines") and learning strategies as well as their applications in different bio-disciplines such as molecular biology, drug development, biophysics, and biomaterials science. We highlight how selected research questions from those fields were successfully translated into machine readable formats, discuss typical problems that can arise in this context, and provide an overview of how to resolve those encountered difficulties.

AI-Driven Cell Tracking to Enable High-Throughput Drug Screening Targeting Airway Epithelial Repair for Children with Asthma

The airway epithelium of children with asthma is characterized by aberrant repair that may be therapeutically modifiable. The development of epithelial-targeting therapeutics that enhance airway repair could provide a novel treatment avenue for childhood asthma. Drug discovery efforts utilizing high-throughput live cell imaging of patient-derived airway epithelial culture-based wound repair assays can be used to identify compounds that modulate airway repair in childhood asthma. Manual cell tracking has been used to determine cell trajectories and wound closure rates, but is time consuming, subject to bias, and infeasible for high-throughput experiments. We therefore developed software, EPIC, that automatically tracks low-resolution low-framerate cells using artificial intelligence, analyzes high-throughput drug screening experiments and produces multiple wound repair metrics and publication-ready figures. Additionally, unlike available cell trackers that perform cell segmentation, EPIC tracks cells using bounding boxes and thus has simpler and faster training data generation requirements for researchers working with other cell types. EPIC outperformed publicly available software in our wound repair datasets by achieving human-level cell tracking accuracy in a fraction of the time. We also showed that EPIC is not limited to airway epithelial repair for children with asthma but can be applied in other cellular contexts by outperforming the same software in the Cell Tracking with Mitosis Detection Challenge (CTMC) dataset. The CTMC is the only established cell tracking benchmark dataset that is designed for cell trackers utilizing bounding boxes. We expect our open-source and easy-to-use software to enable high-throughput drug screening targeting airway epithelial repair for children with asthma.

Enabling reactive microscopy with MicroMator

Microscopy image analysis has recently made enormous progress both in terms of accuracy and speed thanks to machine learning methods and improved computational resources. This greatly facilitates the online adaptation of microscopy experimental plans using real-time information of the observed systems and their environments. Applications in which reactiveness is needed are multifarious. Here we report MicroMator, an open and flexible software for defining and driving reactive microscopy experiments. It provides a Python software environment and an extensible set of modules that greatly facilitate the definition of events with triggers and effects interacting with the experiment. We provide a pedagogic example performing dynamic adaptation of fluorescence illumination on bacteria, and demonstrate MicroMator’s potential via two challenging case studies in yeast to single-cell control and single-cell recombination, both requiring real-time tracking and light targeting at the single-cell level.

In microscopy, applications in which reactiveness is needed are multifarious. Here the authors report MicroMator, a Python software package for reactive experiments, which they use for applications requiring real-time tracking and light-targeting at the single-cell level.

Dynamic gene expression and growth underlie cell-to-cell heterogeneity in Escherichia coli stress response

Individual bacteria that share identical genomes and growth environments can display substantial cell-to-cell differences in expression of stress-response genes and single-cell growth rates. This phenotypic heterogeneity can impact the survival of single cells facing sudden stress. However, the windows of time that cells spend in vulnerable or tolerant states are often unknown. We quantify the temporal expression of a suite of stress-response reporters, while simultaneously monitoring growth. We observe pulsatile expression across genes with a range of stress-response functions, finding that single-cell growth rates are often anticorrelated with reporter levels. These dynamic phenotypic differences have a concrete link to function, in which individual cells undergoing a pulse of elevated expression and slow growth are predisposed to survive antibiotic exposure.

Cell-to-cell heterogeneity in gene expression and growth can have critical functional consequences, such as determining whether individual bacteria survive or die following stress. Although phenotypic variability is well documented, the dynamics that underlie it are often unknown. This information is important because dramatically different outcomes can arise from gradual versus rapid changes in expression and growth. Using single-cell time-lapse microscopy, we measured the temporal expression of a suite of stress-response reporters in Escherichia coli, while simultaneously monitoring growth rate. In conditions without stress, we found several examples of pulsatile expression. Single-cell growth rates were often anticorrelated with reporter levels, with changes in growth preceding changes in expression. These dynamics have functional consequences, which we demonstrate by measuring survival after challenging cells with the antibiotic ciprofloxacin. Our results suggest that fluctuations in both gene expression and growth dynamics in stress-response networks have direct consequences on survival.

Fully automated platelet differential interference contrast image analysis via deep learning

Platelets mediate arterial thrombosis, a leading cause of myocardial infarction and stroke. During injury, platelets adhere and spread over exposed subendothelial matrix substrates of the damaged blood vessel wall. The mechanisms which govern platelet activation and their interaction with a range of substrates are therefore regularly investigated using platelet spreading assays. These assays often use differential interference contrast (DIC) microscopy to assess platelet morphology and analysis performed using manual annotation. Here, a convolutional neural network (CNN) allowed fully automated analysis of platelet spreading assays captured by DIC microscopy. The CNN was trained using 120 generalised training images. Increasing the number of training images increases the mean average precision of the CNN. The CNN performance was compared to six manual annotators. Significant variation was observed between annotators, highlighting bias when manual analysis is performed. The CNN effectively analysed platelet morphology when platelets spread over a range of substrates (CRP-XL, vWF and fibrinogen), in the presence and absence of inhibitors (dasatinib, ibrutinib and PRT-060318) and agonist (thrombin), with results consistent in quantifying spread platelet area which is comparable to published literature. The application of a CNN enables, for the first time, automated analysis of platelet spreading assays captured by DIC microscopy.

Automatic wound detection and size estimation using deep learning algorithms

Evaluating and tracking wound size is a fundamental metric for the wound assessment process. Good location and size estimates can enable proper diagnosis and effective treatment. Traditionally, laboratory wound healing studies include a collection of images at uniform time intervals exhibiting the wounded area and the healing process in the test animal, often a mouse. These images are then manually observed to determine key metrics -such as wound size progress- relevant to the study. However, this task is a time-consuming and laborious process. In addition, defining the wound edge could be subjective and can vary from one individual to another even among experts. Furthermore, as our understanding of the healing process grows, so does our need to efficiently and accurately track these key factors for high throughput (e.g., over large-scale and long-term experiments). Thus, in this study, we develop a deep learning-based image analysis pipeline that aims to intake non-uniform wound images and extract relevant information such as the location of interest, wound only image crops, and wound periphery size over-time metrics. In particular, our work focuses on images of wounded laboratory mice that are used widely for translationally relevant wound studies and leverages a commonly used ring-shaped splint present in most images to predict wound size. We apply the method to a dataset that was never meant to be quantified and, thus, presents many visual challenges. Additionally, the data set was not meant for training deep learning models and so is relatively small in size with only 256 images. We compare results to that of expert measurements and demonstrate preservation of information relevant to predicting wound closure despite variability from machine-to-expert and even expert-to-expert. The proposed system resulted in high fidelity results on unseen data with minimal human intervention. Furthermore, the pipeline estimates acceptable wound sizes when less than 50% of the images are missing reference objects.

Automated Cell Foreground–Background Segmentation with Phase-Contrast Microscopy Images: An Alternative to Machine Learning Segmentation Methods with Small-Scale Data

Cell segmentation is a critical step for image-based experimental analysis. Existing cell segmentation methods are neither entirely automated nor perform well under basic laboratory microscopy. This study proposes an efficient and automated cell segmentation method involving morphological operations to automatically achieve cell segmentation for phase-contrast microscopes. Manual/visual counting of cell segmentation serves as the control group (156 images as ground truth) to evaluate the proposed method’s performance. The proposed technology’s adaptive performance is assessed at varying conditions, including artificial blurriness, illumination, and image size. Compared to the Trainable Weka Segmentation method, the Empirical Gradient Threshold method, and the ilastik segmentation software, the proposed method achieved better segmentation accuracy (dice coefficient: 90.07, IoU: 82.16%, and 6.51% as the average relative error on measuring cell area). The proposed method also has good reliability, even under unfavored imaging conditions at which manual labeling or human intervention is inefficient. Additionally, similar degrees of segmentation accuracy were confirmed when the ground truth data and the generated data from the proposed method were applied individually to train modified U-Net models (16848 images). These results demonstrated good accuracy and high practicality of the proposed cell segmentation method with phase-contrast microscopy image data.

Bioimaging approaches for quantification of individual cell behavior during cell fate decisions

Tracking individual cells has allowed a new understanding of cellular behavior in human health and disease by adding a dynamic component to the already complex heterogeneity of single cells. Technically, despite countless advances, numerous experimental variables can affect data collection and interpretation and need to be considered. In this review, we discuss the main technical aspects and biological findings in the analysis of the behavior of individual cells. We discuss the most relevant contributions provided by these approaches in clinically relevant human conditions like embryo development, stem cells biology, inflammation, cancer and microbiology, along with the cellular mechanisms and molecular pathways underlying these conditions. We also discuss the key technical aspects to be considered when planning and performing experiments involving the analysis of individual cells over long periods. Despite the challenges in automatic detection, features extraction and long-term tracking that need to be tackled, the potential impact of single-cell bioimaging is enormous in understanding the pathogenesis and development of new therapies in human pathophysiology.

Live Plant Cell Tracking: Fiji plugin to analyze cell proliferation dynamics and understand morphogenesis

Arabidopsis (Arabidopsis thaliana) primary and lateral roots (LRs) are well suited for 3D and 4D microscopy, and their development provides an ideal system for studying morphogenesis and cell proliferation dynamics. With fast-advancing microscopy techniques used for live-imaging, whole tissue data are increasingly available, yet present the great challenge of analyzing complex interactions within cell populations. We developed a plugin "Live Plant Cell Tracking" (LiPlaCeT) coupled to the publicly available ImageJ image analysis program and generated a pipeline that allows, with the aid of LiPlaCeT, 4D cell tracking and lineage analysis of populations of dividing and growing cells. The LiPlaCeT plugin contains ad hoc ergonomic curating tools, making it very simple to use for manual cell tracking, especially when the signal-to-noise ratio of images is low or variable in time or 3D space and when automated methods may fail. Performing time-lapse experiments and using cell-tracking data extracted with the assistance of LiPlaCeT, we accomplished deep analyses of cell proliferation and clonal relations in the whole developing LR primordia and constructed genealogical trees. We also used cell-tracking data for endodermis cells of the root apical meristem (RAM) and performed automated analyses of cell population dynamics using ParaView software (also publicly available). Using the RAM as an example, we also showed how LiPlaCeT can be used to generate information at the whole-tissue level regarding cell length, cell position, cell growth rate, cell displacement rate, and proliferation activity. The pipeline will be useful in live-imaging studies of roots and other plant organs to understand complex interactions within proliferating and growing cell populations. The plugin includes a step-by-step user manual and a dataset example that are available at https://www.ibt.unam.mx/documentos/diversos/LiPlaCeT.zip.

Computational Methods for Single-Cell Imaging and Omics Data Integration

Integrating single cell omics and single cell imaging allows for a more effective characterisation of the underlying mechanisms that drive a phenotype at the tissue level, creating a comprehensive profile at the cellular level. Although the use of imaging data is well established in biomedical research, its primary application has been to observe phenotypes at the tissue or organ level, often using medical imaging techniques such as MRI, CT, and PET. These imaging technologies complement omics-based data in biomedical research because they are helpful for identifying associations between genotype and phenotype, along with functional changes occurring at the tissue level. Single cell imaging can act as an intermediary between these levels. Meanwhile new technologies continue to arrive that can be used to interrogate the genome of single cells and its related omics datasets. As these two areas, single cell imaging and single cell omics, each advance independently with the development of novel techniques, the opportunity to integrate these data types becomes more and more attractive. This review outlines some of the technologies and methods currently available for generating, processing, and analysing single-cell omics- and imaging data, and how they could be integrated to further our understanding of complex biological phenomena like ageing. We include an emphasis on machine learning algorithms because of their ability to identify complex patterns in large multidimensional data.

Robust optical flow algorithm for general single cell segmentation

Cell segmentation is crucial to the field of cell biology, as the accurate extraction of single-cell morphology, migration, and ultimately behavior from time-lapse live cell imagery are of paramount importance to elucidate and understand basic cellular processes. In an effort to increase available segmentation tools that can perform across research groups and platforms, we introduce a novel segmentation approach centered around optical flow and show that it achieves robust segmentation of single cells by validating it on multiple cell types, phenotypes, optical modalities, and in-vitro environments with or without labels. By leveraging cell movement in time-lapse imagery as a means to distinguish cells from their background and augmenting the output with machine vision operations, our algorithm reduces the number of adjustable parameters needed for manual optimization to two. We show that this approach offers the advantage of quicker processing times compared to contemporary machine learning based methods that require manual labeling for training, and in most cases achieves higher quality segmentation as well. This algorithm is packaged within MATLAB, offering an accessible means for general cell segmentation in a time-efficient manner.

CellTrackVis: analyzing the performance of cell tracking algorithms

Live-cell imaging is a common data acquisition technique used by biologists to analyze cell behavior. Since manually tracking cells in a video sequence is extremely time-consuming, many automatic algorithms have been developed in the last twenty years to accomplish the task. However, none of these algorithms can yet claim robust tracking performance at the varying of acquisition conditions (e.g., cell type, acquisition device, cell treatments). While many visualization tools exist to help with cell behavior analysis, there are no tools to help with the algorithm's validation. This paper proposes CellTrackVis, a new visualization tool for evaluating cell tracking algorithms. CellTrackVis allows comparing automatically generated cell tracks with ground truth data to help biologists select the best-suited algorithm for their experimented pipeline. Moreover, CellTackVis can be used as a debugging tool while developing a new cell tracking algorithm to investigate where, when, and why each tracking error occurred.

DeLTA 2.0: A deep learning pipeline for quantifying single-cell spatial and temporal dynamics

Improvements in microscopy software and hardware have dramatically increased the pace of image acquisition, making analysis a major bottleneck in generating quantitative, single-cell data. Although tools for segmenting and tracking bacteria within time-lapse images exist, most require human input, are specialized to the experimental set up, or lack accuracy. Here, we introduce DeLTA 2.0, a purely Python workflow that can rapidly and accurately analyze images of single cells on two-dimensional surfaces to quantify gene expression and cell growth. The algorithm uses deep convolutional neural networks to extract single-cell information from time-lapse images, requiring no human input after training. DeLTA 2.0 retains all the functionality of the original version, which was optimized for bacteria growing in the mother machine microfluidic device, but extends results to two-dimensional growth environments. Two-dimensional environments represent an important class of data because they are more straightforward to implement experimentally, they offer the potential for studies using co-cultures of cells, and they can be used to quantify spatial effects and multi-generational phenomena. However, segmentation and tracking are significantly more challenging tasks in two-dimensions due to exponential increases in the number of cells. To showcase this new functionality, we analyze mixed populations of antibiotic resistant and susceptible cells, and also track pole age and growth rate across generations. In addition to the two-dimensional capabilities, we also introduce several major improvements to the code that increase accessibility, including the ability to accept many standard microscopy file formats as inputs and the introduction of a Google Colab notebook so users can try the software without installing the code on their local machine. DeLTA 2.0 is rapid, with run times of less than 10 minutes for complete movies with hundreds of cells, and is highly accurate, with error rates around 1%, making it a powerful tool for analyzing time-lapse microscopy data.

Texture feature extraction from microscope images enables a robust estimation of ER body phenotype in Arabidopsis

BACKGROUND

Cellular components are controlled by genetic and physiological factors that define their shape and size. However, quantitively capturing the morphological characteristics and movement of cellular organelles from micrograph images is challenging, because the analysis deals with complexities of images that frequently lead to inaccuracy in the estimation of the features. Here we show a unique quantitative method to overcome biases and inaccuracy of biological samples from confocal micrographs.

RESULTS

We generated 2D images of cell walls and spindle-shaped cellular organelles, namely ER bodies, with a maximum contrast projection of 3D confocal fluorescent microscope images. The projected images were further processed and segmented by adaptive thresholding of the fluorescent levels in the cell walls. Micrographs are composed of pixels, which have information on position and intensity. From the pixel information we calculated three types of features (spatial, intensity and Haralick) in ER bodies corresponding to segmented cells. The spatial features include basic information on shape, e.g., surface area and perimeter. The intensity features include information on mean, standard deviation and quantile of fluorescence intensities within an ER body. Haralick features describe the texture features, which can be calculated mathematically from the interrelationship between the pixel information. Together these parameters were subjected to multivariate analysis to estimate the morphological diversity. Additionally, we calculated the displacement of the ER bodies using the positional information in time-lapse images. We captured similar morphological diversity and movement within ER body phenotypes in several microscopy experiments performed in different settings and scanned under different objectives. We then described differences in morphology and movement of ER bodies between A. thaliana wild type and mutants deficient in ER body-related genes.

CONCLUSIONS

The findings unexpectedly revealed multiple genetic factors that are involved in the shape and size of ER bodies in A. thaliana. This is the first report showing morphological characteristics in addition to the movement of cellular components and it quantitatively summarises plant phenotypic differences even in plants that show similar cellular components. The estimation of morphological diversity was independent of the cell staining method and the objective lens used in the microscopy. Hence, our study enables a robust estimation of plant phenotypes by recognizing small differences in complex cell organelle shapes and their movement, which is beneficial in a comprehensive analysis of the molecular mechanism for cell organelle formation that is independent of technical variations.

Automated Deep Lineage Tree Analysis Using a Bayesian Single Cell Tracking Approach

Single-cell methods are beginning to reveal the intrinsic heterogeneity in cell populations, arising from the interplay of deterministic and stochastic processes. However, it remains challenging to quantify single-cell behaviour from time-lapse microscopy data, owing to the difficulty of extracting reliable cell trajectories and lineage information over long time-scales and across several generations. Therefore, we developed a hybrid deep learning and Bayesian cell tracking approach to reconstruct lineage trees from live-cell microscopy data. We implemented a residual U-Net model coupled with a classification CNN to allow accurate instance segmentation of the cell nuclei. To track the cells over time and through cell divisions, we developed a Bayesian cell tracking methodology that uses input features from the images to enable the retrieval of multi-generational lineage information from a corpus of thousands of hours of live-cell imaging data. Using our approach, we extracted 20,000 + fully annotated single-cell trajectories from over 3,500 h of video footage, organised into multi-generational lineage trees spanning up to eight generations and fourth cousin distances. Benchmarking tests, including lineage tree reconstruction assessments, demonstrate that our approach yields high-fidelity results with our data, with minimal requirement for manual curation. To demonstrate the robustness of our minimally supervised cell tracking methodology, we retrieve cell cycle durations and their extended inter- and intra-generational family relationships in 5,000 + fully annotated cell lineages. We observe vanishing cycle duration correlations across ancestral relatives, yet reveal correlated cyclings between cells sharing the same generation in extended lineages. These findings expand the depth and breadth of investigated cell lineage relationships in approximately two orders of magnitude more data than in previous studies of cell cycle heritability, which were reliant on semi-manual lineage data analysis.

Yeast cell segmentation in microstructured environments with deep learning

Cell segmentation is a major bottleneck in extracting quantitative single-cell information from microscopy data. The challenge is exasperated in the setting of microstructured environments. While deep learning approaches have proven useful for general cell segmentation tasks, previously available segmentation tools for the yeast-microstructure setting rely on traditional machine learning approaches. Here we present convolutional neural networks trained for multiclass segmenting of individual yeast cells and discerning these from cell-similar microstructures. An U-Net based semantic segmentaiton approach, as well as a direct instance segmentation approach with a Mask R-CNN are demonstrated. We give an overview of the datasets recorded for training, validating and testing the networks, as well as a typical use-case. We showcase the methods' contribution to segmenting yeast in microstructured environments with a typical systems or synthetic biology application. The models achieve robust segmentation results, outperforming the previous state-of-the-art in both accuracy and speed. The combination of fast and accurate segmentation is not only beneficial for a posteriori data processing, it also makes online monitoring of thousands of trapped cells or closed-loop optimal experimental design feasible from an image processing perspective. Code is and data samples are available at https://git.rwth-aachen.de/bcs/projects/tp/multiclass-yeast-seg.

DMNet: Dual-Stream Marker Guided Deep Network for Dense Cell Segmentation and Lineage Tracking

Accurate segmentation and tracking of cells in microscopy image sequences is extremely beneficial in clinical diagnostic applications and biomedical research. A continuing challenge is the segmentation of dense touching cells and deforming cells with indistinct boundaries, in low signal-to-noise-ratio images. In this paper, we present a dual-stream marker-guided network (DMNet) for segmentation of touching cells in microscopy videos of many cell types. DMNet uses an explicit cell marker-detection stream, with a separate mask-prediction stream using a distance map penalty function, which enables supervised training to focus attention on touching and nearby cells. For multi-object cell tracking we use M2Track tracking-by-detection approach with multi-step data association. Our M2Track with mask overlap includes short term track-to-cell association followed by track-to-track association to re-link tracklets with missing segmentation masks over a short sequence of frames. Our combined detection, segmentation and tracking algorithm has proven its potential on the IEEE ISBI 2021 6th Cell Tracking Challenge (CTC-6) where we achieved multiple top three rankings for diverse cell types. Our team name is MU-Ba-US, and the implementation of DMNet is available at, http://celltrackingchallenge.net/participants/MU-Ba-US/.

Deep learning for bioimage analysis in developmental biology

Deep learning has transformed the way large and complex image datasets can be processed, reshaping what is possible in bioimage analysis. As the complexity and size of bioimage data continues to grow, this new analysis paradigm is becoming increasingly ubiquitous. In this Review, we begin by introducing the concepts needed for beginners to understand deep learning. We then review how deep learning has impacted bioimage analysis and explore the open-source resources available to integrate it into a research project. Finally, we discuss the future of deep learning applied to cell and developmental biology. We analyze how state-of-the-art methodologies have the potential to transform our understanding of biological systems through new image-based analysis and modelling that integrate multimodal inputs in space and time.

Quantitative Approaches to Study Retinal Neurogenesis

The study of the development of the vertebrate retina can be addressed from several perspectives: from a purely qualitative to a more quantitative approach that takes into account its spatio-temporal features, its three-dimensional structure and also the regulation and properties at the systems level. Here, we review the ongoing transition toward a full four-dimensional characterization of the developing vertebrate retina, focusing on the challenges at the experimental, image acquisition, image processing and quantification. Using the developing zebrafish retina, we illustrate how quantitative data extracted from these type of highly dense, three-dimensional tissues depend strongly on the image quality, image processing and algorithms used to segment and quantify. Therefore, we propose that the scientific community that focuses on developmental systems could strongly benefit from a more detailed disclosure of the tools and pipelines used to process and analyze images from biological samples.

Misic, a general deep learning-based method for the high-throughput cell segmentation of complex bacterial communities

Studies of bacterial communities, biofilms and microbiomes, are multiplying due to their impact on health and ecology. Live imaging of microbial communities requires new tools for the robust identification of bacterial cells in dense and often inter-species populations, sometimes over very large scales. Here, we developed MiSiC, a general deep-learning-based 2D segmentation method that automatically segments single bacteria in complex images of interacting bacterial communities with very little parameter adjustment, independent of the microscopy settings and imaging modality. Using a bacterial predator-prey interaction model, we demonstrate that MiSiC enables the analysis of interspecies interactions, resolving processes at subcellular scales and discriminating between species in millimeter size datasets. The simple implementation of MiSiC and the relatively low need in computing power make its use broadly accessible to fields interested in bacterial interactions and cell biology.

Advances and opportunities in image analysis of bacterial cells and communities

The cellular morphology and sub-cellular spatial structure critically influence the function of microbial cells. Similarly, the spatial arrangement of genotypes and phenotypes in microbial communities has important consequences for cooperation, competition, and community functions. Fluorescence microscopy techniques are widely used to measure spatial structure inside living cells and communities, which often results in large numbers of images that are difficult or impossible to analyze manually. The rapidly evolving progress in computational image analysis has recently enabled the quantification of a large number of properties of single cells and communities, based on traditional analysis techniques and convolutional neural networks. Here, we provide a brief introduction to core concepts of automated image processing, recent software tools and how to validate image analysis results. We also discuss recent advances in image analysis of microbial cells and communities, and how these advances open up opportunities for quantitative studies of spatiotemporal processes in microbiology, based on image cytometry and adaptive microscope control.

PyJAMAS: open-source, multimodal segmentation and analysis of microscopy images

SUMMARY

Our increasing ability to resolve fine details using light microscopy is matched by an increasing need to quantify images in order to detect and measure phenotypes. Despite their central role in cell biology, many image analysis tools require a financial investment, are released as proprietary software, or are implemented in languages not friendly for beginners, and thus are used as black boxes. To overcome these limitations, we have developed PyJAMAS, an open-source tool for image processing and analysis written in Python. PyJAMAS provides a variety of segmentation tools, including watershed and machine learning-based methods; takes advantage of Jupyter notebooks for the display and reproducibility of data analyses; and can be used through a cross-platform graphical user interface or as part of Python scripts via a comprehensive application programming interface.

AVAILABILITY AND IMPLEMENTATION

PyJAMAS is open-source and available at https://bitbucket.org/rfg_lab/pyjamas.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Senescence in Bacteria and Its Underlying Mechanisms

Bacteria have been thought to flee senescence by dividing into two identical daughter cells, but this notion of immortality has changed over the last two decades. Asymmetry between the resulting daughter cells after binary fission is revealed in physiological function, cell growth, and survival probabilities and is expected from theoretical understanding. Since the discovery of senescence in morphologically identical but physiologically asymmetric dividing bacteria, the mechanisms of bacteria aging have been explored across levels of biological organization. Quantitative investigations are heavily biased toward Escherichia coli and on the role of inclusion bodies—clusters of misfolded proteins. Despite intensive efforts to date, it is not evident if and how inclusion bodies, a phenotype linked to the loss of proteostasis and one of the consequences of a chain of reactions triggered by reactive oxygen species, contribute to senescence in bacteria. Recent findings in bacteria question that inclusion bodies are only deleterious, illustrated by fitness advantages of cells holding inclusion bodies under varying environmental conditions. The contributions of other hallmarks of aging, identified for metazoans, remain elusive. For instance, genomic instability appears to be age independent, epigenetic alterations might be little age specific, and other hallmarks do not play a major role in bacteria systems. What is surprising is that, on the one hand, classical senescence patterns, such as an early exponential increase in mortality followed by late age mortality plateaus, are found, but, on the other hand, identifying mechanisms that link to these patterns is challenging. Senescence patterns are sensitive to environmental conditions and to genetic background, even within species, which suggests diverse evolutionary selective forces on senescence that go beyond generalized expectations of classical evolutionary theories of aging. Given the molecular tool kits available in bacteria, the high control of experimental conditions, the high-throughput data collection using microfluidic systems, and the ease of life cell imaging of fluorescently marked transcription, translation, and proteomic dynamics, in combination with the simple demographics of growth, division, and mortality of bacteria, make the challenges surprising. The diversity of mechanisms and patterns revealed and their environmental dependencies not only present challenges but also open exciting opportunities for the discovery and deeper understanding of aging and its mechanisms, maybe beyond bacteria and aging.

Single-cell image analysis to explore cell-to-cell heterogeneity in isogenic populations

Single-cell image analysis provides a powerful approach for studying cell-to-cell heterogeneity, which is an important attribute of isogenic cell populations, from microbial cultures to individual cells in multicellular organisms. This phenotypic variability must be explained at a mechanistic level if biologists are to fully understand cellular function and address the genotype-to-phenotype relationship. Variability in single-cell phenotypes is obscured by bulk readouts or averaging of phenotypes from individual cells in a sample; thus, single-cell image analysis enables a higher resolution view of cellular function. Here, we consider examples of both small- and large-scale studies carried out with isogenic cell populations assessed by fluorescence microscopy, and we illustrate the advantages, challenges, and the promise of quantitative single-cell image analysis.

Machine Learning Algorithms, Applied to Intact Islets of Langerhans, Demonstrate Significantly Enhanced Insulin Staining at the Capillary Interface of Human Pancreatic β Cells

Pancreatic β cells secrete the hormone insulin into the bloodstream and are critical in the control of blood glucose concentrations. β cells are clustered in the micro-organs of the islets of Langerhans, which have a rich capillary network. Recent work has highlighted the intimate spatial connections between β cells and these capillaries, which lead to the targeting of insulin secretion to the region where the β cells contact the capillary basement membrane. In addition, β cells orientate with respect to the capillary contact point and many proteins are differentially distributed at the capillary interface compared with the rest of the cell. Here, we set out to develop an automated image analysis approach to identify individual β cells within intact islets and to determine if the distribution of insulin across the cells was polarised. Our results show that a U-Net machine learning algorithm correctly identified β cells and their orientation with respect to the capillaries. Using this information, we then quantified insulin distribution across the β cells to show enrichment at the capillary interface. We conclude that machine learning is a useful analytical tool to interrogate large image datasets and analyse sub-cellular organisation.

A survey on applications of deep learning in microscopy image analysis

Advanced microscopy enables us to acquire quantities of time-lapse images to visualize the dynamic characteristics of tissues, cells or molecules. Microscopy images typically vary in signal-to-noise ratios and include a wealth of information which require multiple parameters and time-consuming iterative algorithms for processing. Precise analysis and statistical quantification are often needed for the understanding of the biological mechanisms underlying these dynamic image sequences, which has become a big challenge in the field. As deep learning technologies develop quickly, they have been applied in bioimage processing more and more frequently. Novel deep learning models based on convolution neural networks have been developed and illustrated to achieve inspiring outcomes. This review article introduces the applications of deep learning algorithms in microscopy image analysis, which include image classification, region segmentation, object tracking and super-resolution reconstruction. We also discuss the drawbacks of existing deep learning-based methods, especially on the challenges of training datasets acquisition and evaluation, and propose the potential solutions. Furthermore, the latest development of augmented intelligent microscopy that based on deep learning technology may lead to revolution in biomedical research.

Deep Learning and Transfer Learning for Automatic Cell Counting in Microscope Images of Human Cancer Cell Lines

In biology and medicine, cell counting is one of the most important elements of cytometry, with applications to research and clinical practice. For instance, the complete cell count could help to determine conditions for which cancer cells could grow or not. However, cell counting is a laborious and time-consuming process, and its automatization is highly demanded. Here, we propose use of a Convolutional Neural Network-based regressor, a regression model trained end-to-end, to provide the cell count. First, unlike most of the related work, we formulate the problem of cell counting as the regression task rather than the classification task. This allows not only to reduce the required annotation information (i.e., the number of cells instead of pixel-level annotations) but also to reduce the burden of segmenting potential cells and then classifying them. Second, we propose use of xResNet, a successful convolutional architecture with residual connection, together with transfer learning (using a pretrained model) to achieve human-level performance. We demonstrate the performance of our approach to real-life data of two cell lines, human osteosarcoma and human leukemia, collected at the University of Amsterdam (133 training images, and 32 test images). We show that the proposed method (deep learning and transfer learning) outperforms currently used machine learning methods. It achieves the test mean absolute error equal 12 (±15) against 32 (±33) obtained by the deep learning without transfer learning, and 41 (±37) of the best-performing machine learning pipeline (Random Forest Regression with the Histogram of Gradients features).

Cheetah: A Computational Toolkit for Cybergenetic Control

Advances in microscopy, microfluidics, and optogenetics enable single-cell monitoring and environmental regulation and offer the means to control cellular phenotypes. The development of such systems is challenging and often results in bespoke setups that hinder reproducibility. To address this, we introduce Cheetah, a flexible computational toolkit that simplifies the integration of real-time microscopy analysis with algorithms for cellular control. Central to the platform is an image segmentation system based on the versatile U-Net convolutional neural network. This is supplemented with functionality to robustly count, characterize, and control cells over time. We demonstrate Cheetah's core capabilities by analyzing long-term bacterial and mammalian cell growth and by dynamically controlling protein expression in mammalian cells. In all cases, Cheetah's segmentation accuracy exceeds that of a commonly used thresholding-based method, allowing for more accurate control signals to be generated. Availability of this easy-to-use platform will make control engineering techniques more accessible and offer new ways to probe and manipulate living cells.

Image-based cell phenotyping with deep learning

A cell's phenotype is the culmination of several cellular processes through a complex network of molecular interactions that ultimately result in a unique morphological signature. Visual cell phenotyping is the characterization and quantification of these observable cellular traits in images. Recently, cellular phenotyping has undergone a massive overhaul in terms of scale, resolution, and throughput, which is attributable to advances across electronic, optical, and chemical technologies for imaging cells. Coupled with the rapid acceleration of deep learning-based computational tools, these advances have opened up new avenues for innovation across a wide variety of high-throughput cell biology applications. Here, we review applications wherein deep learning is powering the recognition, profiling, and prediction of visual phenotypes to answer important biological questions. As the complexity and scale of imaging assays increase, deep learning offers computational solutions to elucidate the details of previously unexplored cellular phenotypes.

Challenges of analysing stochastic gene expression in bacteria using single-cell time-lapse experiments

Stochastic gene expression causes phenotypic heterogeneity in a population of genetically identical bacterial cells. Such non-genetic heterogeneity can have important consequences for the population fitness, and therefore cells implement regulation strategies to either suppress or exploit such heterogeneity to adapt to their circumstances. By employing time-lapse microscopy of single cells, the fluctuation dynamics of gene expression may be analysed, and their regulatory mechanisms thus deciphered. However, a careful consideration of the experimental design and data-analysis is needed to produce useful data for deriving meaningful insights from them. In the present paper, the individual steps and challenges involved in a time-lapse experiment are discussed, and a rigorous framework for designing, performing, and extracting single-cell gene expression dynamics data from such experiments is outlined.

Automated in vivo Tracking of Cortical Oligodendrocytes

Oligodendrocytes exert a profound influence on neural circuits by accelerating action potential conduction, altering excitability, and providing metabolic support. As oligodendrogenesis continues in the adult brain and is essential for myelin repair, uncovering the factors that control their dynamics is necessary to understand the consequences of adaptive myelination and develop new strategies to enhance remyelination in diseases such as multiple sclerosis. Unfortunately, few methods exist for analysis of oligodendrocyte dynamics, and even fewer are suitable for in vivo investigation. Here, we describe the development of a fully automated cell tracking pipeline using convolutional neural networks (Oligo-Track) that provides rapid volumetric segmentation and tracking of thousands of cells over weeks in vivo. This system reliably replicated human analysis, outperformed traditional analytic approaches, and extracted injury and repair dynamics at multiple cortical depths, establishing that oligodendrogenesis after cuprizone-mediated demyelination is suppressed in deeper cortical layers. Volumetric data provided by this analysis revealed that oligodendrocyte soma size progressively decreases after their generation, and declines further prior to death, providing a means to predict cell age and eventual cell death from individual time points. This new CNN-based analysis pipeline offers a rapid, robust method to quantitatively analyze oligodendrocyte dynamics in vivo, which will aid in understanding how changes in these myelinating cells influence circuit function and recovery from injury and disease.

Investigating heterogeneities of live mesenchymal stromal cells using AI-based label-free imaging

Mesenchymal stromal cells (MSCs) are multipotent cells that have great potential for regenerative medicine, tissue repair, and immunotherapy. Unfortunately, the outcomes of MSC-based research and therapies can be highly inconsistent and difficult to reproduce, largely due to the inherently significant heterogeneity in MSCs, which has not been well investigated. To quantify cell heterogeneity, a standard approach is to measure marker expression on the protein level via immunochemistry assays. Performing such measurements non-invasively and at scale has remained challenging as conventional methods such as flow cytometry and immunofluorescence microscopy typically require cell fixation and laborious sample preparation. Here, we developed an artificial intelligence (AI)-based method that converts transmitted light microscopy images of MSCs into quantitative measurements of protein expression levels. By training a U-Net+ conditional generative adversarial network (cGAN) model that accurately (mean [Formula: see text] = 0.77) predicts expression of 8 MSC-specific markers, we showed that expression of surface markers provides a heterogeneity characterization that is complementary to conventional cell-level morphological analyses. Using this label-free imaging method, we also observed a multi-marker temporal-spatial fluctuation of protein distributions in live MSCs. These demonstrations suggest that our AI-based microscopy can be utilized to perform quantitative, non-invasive, single-cell, and multi-marker characterizations of heterogeneous live MSC culture. Our method provides a foundational step toward the instant integrative assessment of MSC properties, which is critical for high-throughput screening and quality control in cellular therapies.

YeastNet: Deep-Learning-Enabled Accurate Segmentation of Budding Yeast Cells in Bright-Field Microscopy

Accurate and efficient segmentation of live-cell images is critical in maximizing data extraction and knowledge generation from high-throughput biology experiments. Despite recent development of deep-learning tools for biomedical imaging applications, great demand for automated segmentation tools for high-resolution live-cell microscopy images remains in order to accelerate the analysis. YeastNet dramatically improves the performance of the non-trainable classic algorithm, and performs considerably better than the current state-of-the-art yeast-cell segmentation tools. We have designed and trained a U-Net convolutional network (named YeastNet) to conduct semantic segmentation on bright-field microscopy images and generate segmentation masks for cell labeling and tracking. YeastNet enables accurate automatic segmentation and tracking of yeast cells in biomedical applications. YeastNet is freely provided with model weights as a Python package on GitHub.

An updated toolkit for exploring bacterial cell wall structure and dynamics

The bacterial cell wall is made primarily from peptidoglycan, a complex biomolecule which forms a bag-like exoskeleton that envelops the cell. As it is unique to bacteria and typically essential for their growth and survival, it represents one of the most successful targets for antibiotics. Although peptidoglycan has been studied intensively for over 50 years, the past decade has seen major steps in our understanding of this molecule because of the advent of new analytical and imaging methods. Here, we outline the most recent developments in tools that have helped to elucidate peptidoglycan structure and dynamics.

ChipSeg: An Automatic Tool to Segment Bacterial and Mammalian Cells Cultured in Microfluidic Devices

Extracting quantitative measurements from time-lapse images is necessary in external feedback control applications, where segmentation results are used to inform control algorithms. We describe ChipSeg, a computational tool that segments bacterial and mammalian cells cultured in microfluidic devices and imaged by time-lapse microscopy, which can be used also in the context of external feedback control. The method is based on thresholding and uses the same core functions for both cell types. It allows us to segment individual cells in high cell density microfluidic devices, to quantify fluorescent protein expression over a time-lapse experiment, and to track individual mammalian cells. ChipSeg enables robust segmentation in external feedback control experiments and can be easily customized for other experimental settings and research aims.

Deep Learning for Imaging and Detection of Microorganisms

Despite tremendous recent interest, the application of deep learning in microbiology has still not reached its full potential. To tackle the challenges faced by human-operated microscopy, deep-learning-based methods have been proposed for microscopic image analysis of a wide range of microorganisms, including viruses, bacteria, fungi, and parasites. We believe that deep-learning technology-based systems will be on the front line of monitoring and investigation of microorganisms.

Phenotypic Characterization of Antibiotic Persisters at the Single-Cell Level: From Data Acquisition to Data Analysis

Persister cells are present at low frequency in isogenic populations. Moreover, they are only distinguishable from the bulk at the recovery time, after the antibiotic treatment. Therefore, time-lapse microscopy is the gold-standard method to investigate this phenomenon. Here, we describe an exhaustive procedure for acquiring single-cell data which is particularly suitable for persister cell analysis but could be applied to any other fields of research involving single-cell time-lapse microscopy. In addition, we discuss the challenges and critical aspects of the procedure with respect to the generation of robust data.