DeLTA: Automated cell segmentation, tracking, and lineage reconstruction using deep learning

Colony pattern multistability emerges from a bistable switch

Microbial colony development hinges upon a myriad of factors, including mechanical, biochemical, and environmental niches, which collectively shape spatial patterns governed by intricate gene regulatory networks. The inherent complexity of this phenomenon necessitates innovative approaches to comprehend and compare the mechanisms driving pattern formation. Here, we unveil the multistability of bacterial colony patterns, where bacterial colony patterns can stabilize into multiple distinct types including ring-like patterns and sector-like patterns on hard agar, orchestrated by a simple synthetic bistable switch. Utilizing quantitative imaging and spatially resolved transcriptome approaches, we explore the deterministic process of a ring-like colony pattern formation from a single cell. This process is primarily driven by bifurcation events programmed by the gene regulatory network and microenvironmental cues. Additionally, we observe a noise-induced process amplified by the founder effect, leading to patterns of symmetry-break during range expansion. The degrees of asymmetry are profoundly influenced by the initial conditions of single progenitor cells during the nascent stages of colony development. These findings underscore how the process of range expansion enables individual cells, exposed to a uniform growth-promoting environment, to exhibit inherent capabilities in generating emergent, self-organized behavior.

Resolving spatiotemporal dynamics in bacterial multicellular populations: approaches and challenges

SUMMARYThe development of multicellularity represents a key evolutionary transition that is crucial for the emergence of complex life forms. Although multicellularity has traditionally been studied in eukaryotes, it originates in prokaryotes. Coordinated aggregation of individual cells within the confines of a colony results in emerging, higher-level functions that benefit the population as a whole. During colony differentiation, an almost infinite number of ecological and physiological population-forming forces are at work, creating complex, intricate colony structures with divergent functions. Understanding the assembly and dynamics of such populations requires resolving individual cells or cell groups within such macroscopic structures. Addressing how each cell contributes to the collective action requires pushing the resolution boundaries of key technologies that will be presented in this review. In particular, single-cell techniques provide powerful tools for studying bacterial multicellularity with unprecedented spatial and temporal resolution. These advancements include novel microscopic techniques, mass spectrometry imaging, flow cytometry, spatial transcriptomics, single-bacteria RNA sequencing, and the integration of spatiotemporal transcriptomics with microscopy, alongside advanced microfluidic cultivation systems. This review encourages exploring the synergistic potential of the new technologies in the study of bacterial multicellularity, with a particular focus on individuals in differentiated bacterial biofilms (colonies). It highlights how resolving population structures at the single-cell level and understanding their respective functions can elucidate the overarching functions of bacterial multicellular populations.

Deep learning image analysis for continuous single-cell imaging of dynamic processes in Plasmodium falciparum-infected erythrocytes

Continuous high-resolution imaging of the disease-mediating blood stages of the human malaria parasite Plasmodium falciparum faces challenges due to photosensitivity, small parasite size, and the anisotropy and large refractive index of host erythrocytes. Previous studies often relied on snapshot galleries from multiple cells, limiting the investigation of dynamic cellular processes. We present a workflow enabling continuous, single-cell monitoring of live parasites throughout the 48-hour intraerythrocytic life cycle with high spatial and temporal resolution. This approach integrates label-free, three-dimensional differential interference contrast and fluorescence imaging using an Airyscan microscope, automated cell segmentation through pre-trained deep-learning algorithms, and 3D rendering for visualization and time-resolved analyses. As a proof of concept, we applied this workflow to study knob-associated histidine-rich protein (KAHRP) export into the erythrocyte compartment and its clustering beneath the plasma membrane. Our methodology opens avenues for in-depth exploration of dynamic cellular processes in malaria parasites, providing a valuable tool for further investigations.

A deep learning pipeline for three-dimensional brain-wide mapping of local neuronal ensembles in teravoxel light-sheet microscopy

Teravoxel-scale, cellular-resolution images of cleared rodent brains acquired with light-sheet fluorescence microscopy have transformed the way we study the brain. Realizing the potential of this technology requires computational pipelines that generalize across experimental protocols and map neuronal activity at the laminar and subpopulation-specific levels, beyond atlas-defined regions. Here, we present artficial intelligence-based cartography of ensembles (ACE), an end-to-end pipeline that employs three-dimensional deep learning segmentation models and advanced cluster-wise statistical algorithms, to enable unbiased mapping of local neuronal activity and connectivity. Validation against state-of-the-art segmentation and detection methods on unseen datasets demonstrated ACE's high generalizability and performance. Applying ACE in two distinct neurobiological contexts, we discovered subregional effects missed by existing atlas-based analyses and showcase ACE's ability to reveal localized or laminar neuronal activity brain-wide. Our open-source pipeline enables whole-brain mapping of neuronal ensembles at a high level of precision across a wide range of neuroscientific applications.

DeepKymoTracker: A tool for accurate construction of cell lineage trees for highly motile cells

Time-lapse microscopy has long been used to record cell lineage trees. Successful construction of a lineage tree requires tracking and preserving the identity of multiple cells across many images. If a single cell is misidentified the identity of all its progeny will be corrupted and inferences about heritability may be incorrect. Successfully avoiding such identity errors is challenging, however, when studying highly-motile cells such as T lymphocytes which readily change shape from one image to the next. To address this problem, we developed DeepKymoTracker, a pipeline for combined tracking and segmentation. Central to DeepKymoTracker is the use of a seed, a marker for each cell which transmits information about cell position and identity between sets of images during tracking, as well as between tracking and segmentation steps. The seed allows a 3D convolutional neural network (CNN) to detect and associate cells across several consecutive images in an integrated way, reducing the risk of a single poor image corrupting cell identity. DeepKymoTracker was trained extensively on synthetic and experimental T lymphocyte images. It was benchmarked against five publicly available, automatic analysis tools and outperformed them in almost all respects. The software is written in pure Python and is freely available. We suggest this tool is particularly suited to the tracking of cells in suspension, whose fast motion makes lineage assembly particularly difficult.

Image-guided optogenetic spatiotemporal tissue patterning using μPatternScope

In the field of tissue engineering, achieving precise spatiotemporal control over engineered cells is critical for sculpting functional 2D cell cultures into intricate morphological shapes. In this study, we engineer light-responsive mammalian cells and target them with dynamic light patterns to realize 2D cell culture patterning control. To achieve this, we developed μPatternScope (μPS), a modular framework for software-controlled projection of high-resolution light patterns onto microscope samples. μPS comprises hardware and software suite governing pattern projection and microscope maneuvers. Together with a 2D culture of the engineered cells, we utilize μPS for controlled spatiotemporal induction of apoptosis to generate desired 2D shapes. Furthermore, we introduce interactive closed-loop patterning, enabling a dynamic feedback mechanism between the measured cell culture patterns and the light illumination profiles to achieve the desired target patterning trends. Our work offers innovative tools for advanced tissue engineering applications through seamless fusion of optogenetics, optical engineering, and cybernetics.

Dynamic heterogeneity in an E. coli stress response regulon mediates gene activation and antimicrobial peptide tolerance

The bacterial stress response is an intricately regulated system that plays a critical role in cellular resistance to drug treatment. The complexity of this response is further complicated by cell-to-cell heterogeneity in the expression of bacterial stress response genes. These genes are often organized into networks comprising one or more transcriptional regulators that control expression of a suite of downstream genes. While the expression heterogeneity of many of these upstream regulators has been characterized, the way in which this variability affects the larger downstream stress response remains hard to predict, prompting two key questions. First, how does heterogeneity and expression noise in stress response regulators propagate to the diverse downstream genes in their regulons. Second, when expression levels vary, how do multiple downstream genes act together to protect cells from stress. To address these questions, we focus on the transcription factor PhoP, a critical virulence regulator which coordinates pathogenicity in several gram-negative species. We use optogenetic stimulation to precisely control PhoP expression levels and examine how variations in PhoP affect the downstream activation of genes in the PhoP regulon. We find that these downstream genes exhibit differences both in mean expression level and sensitivity to increasing levels of PhoP. These response functions can also vary between individual cells, increasing heterogeneity in the population. We tie these variations to cell survival when bacteria are exposed to a clinically-relevant antimicrobial peptide, showing that high expression of the PhoP-regulon gene pmrD provides a protective effect against Polymyxin B. Overall, we demonstrate that even subtle heterogeneity in expression of a stress response regulator can have clear consequences for enabling bacteria to survive stress.

A generative benchmark for evaluating the performance of fluorescent cell image segmentation

Fluorescent cell imaging technology is fundamental in life science research, offering a rich source of image data crucial for understanding cell spatial positioning, differentiation, and decision-making mechanisms. As the volume of this data expands, precise image analysis becomes increasingly critical. Cell segmentation, a key analysis step, significantly influences quantitative analysis outcomes. However, selecting the most effective segmentation method is challenging, hindered by existing evaluation methods' inaccuracies, lack of graded evaluation, and narrow assessment scope. Addressing this, we developed a novel framework with two modules: StyleGAN2-based contour generation and Pix2PixHD-based image rendering, producing diverse, graded-density cell images. Using this dataset, we evaluated three leading cell segmentation methods: DeepCell, CellProfiler, and CellPose. Our comprehensive comparison revealed CellProfiler's superior accuracy in segmenting cytoplasm and nuclei. Our framework diversifies cell image data generation and systematically addresses evaluation challenges in cell segmentation technologies, establishing a solid foundation for advancing research and applications in cell image analysis.

Effect of shear rate on early Shewanella oneidensis adhesion dynamics monitored by deep learning

Understanding pioneer bacterial adhesion is essential to appreciate bacterial colonization and consider appropriate control strategies. This bacterial entrapment at the wall is known to be controlled by many physical, chemical or biological factors, including hydrodynamic conditions. However, due to the nature of early bacterial adhesion, i.e. a short and dynamic process with low biomass involved, such investigations are challenging. In this context, our study aimed to evaluate the effect of wall shear rate on the early bacterial adhesion dynamics. Firstly, at the population scale by assessing bacterial colonization kinetics and the mechanisms responsible for wall transfer under shear rates using a time-lapse approach. Secondly, at the individual scale, by implementing an automated image processing method based on deep learning to track each individual pioneer bacterium on the wall. Bacterial adhesion experiments are performed on a model bacterium (Shewanella oneidensis MR-1) at different shear rates (0 to1250 s-1) in a microfluidic system mounted under a microscope equipped with a CCD camera. Image processing was performed using a trained neural network (YOLOv8), which allowed information extraction, i.e. bacterial wall residence time and orientation for each adhered bacterium during pioneer colonization (14 min). Collected from over 20,000 bacteria, our results showed that adhered bacteria had a very short residence time at the wall, with over 70 % remaining less than 1 min. Shear rates had a non-proportional effect on pioneer colonization with a bell-shape profile suggesting that intermediate shear rates improved both bacterial wall residence time as well as colonization rate and level. This lack of proportionality highlights the dual effect of wall shear rate on early bacterial colonization; initially increasing it improves bacterial colonization up to a threshold, beyond which it leads to higher bacterial wall detachment. The present study provides quantitative data on the individual dynamics of just adhered bacteria within a population when exposed to different rates of wall shear.

Computational Methods for Image Analysis in Craniofacial Development and Disease

Observation is at the center of all biological sciences. Advances in imaging technologies are therefore essential to derive novel biological insights to better understand the complex workings of living systems. Recent high-throughput sequencing and imaging techniques are allowing researchers to simultaneously address complex molecular variations spatially and temporarily in tissues and organs. The availability of increasingly large dataset sizes has allowed for the evolution of robust deep learning models, designed to interrogate biomedical imaging data. These models are emerging as transformative tools in diagnostic medicine. Combined, these advances allow for dynamic, quantitative, and predictive observations of entire organisms and tissues. Here, we address 3 main tasks of bioimage analysis, image restoration, segmentation, and tracking and discuss new computational tools allowing for 3-dimensional spatial genomics maps. Finally, we demonstrate how these advances have been applied in studies of craniofacial development and oral disease pathogenesis.

A Single-Cell Interrogation System from Scratch: Microfluidics and Deep Learning

Live-cell imaging using fluorescence microscopy enables researchers to study cellular processes in unprecedented detail. These techniques are becoming increasingly popular among microbiologists. The emergence of microfluidics and deep learning has significantly increased the amount of quantitative data that can be extracted from such experiments. However, these techniques require highly specialized expertise and equipment, making them inaccessible to many biologists. Here we present a guide for microbiologists, with a basic understanding of microfluidics, to construct a custom-made live-cell interrogation system that is capable of recording and analyzing thousands of bacterial cell-cycles per experiment. The requirements for different microbiological applications are varied, and experiments often demand a high level of versatility and custom-designed capabilities. This work is intended as a guide for the design and engineering of microfluidic master molds and how to build polydimethylsiloxane chips. Furthermore, we show how state-of-the-art deep-learning techniques can be used to design image processing algorithms that allow for the rapid extraction of highly quantitative information from large populations of individual bacterial cells.

Evaluating the predictive power of combined gene expression dynamics from single cells on antibiotic survival

Heteroresistance can allow otherwise drug-susceptible bacteria to survive and resume growth after antibiotic exposure. This temporary form of antibiotic tolerance can be caused by the upregulation of stress response genes or a decrease in cell growth rate. However, it is not clear how expression of multiple genes contributes to the tolerance phenotype. By using fluorescent reporters for stress related genes, we conducted real time measurements of expression prior to, during, and after antibiotic exposure. We first identified relationships between growth rate and reporter levels based on auto and cross correlation analysis, revealing consistent patterns where changes in growth rate were anticorrelated with fluorescence following a delay. We then used pairs of stress gene reporters and time lapse fluorescence microcopy to measure the growth rate and reporter levels in cells that survived or died following antibiotic exposure. Using these data, we asked whether combined information about reporter expression and growth rate could improve our ability to predict whether a cell would survive or die following antibiotic exposure. We developed a Bayesian inference model to predict how the combination of dual reporter expression levels and growth rate impact ciprofloxacin survival in Escherichia coli . We found clear evidence of the impact of growth rate and the gadX promoter activity on survival. Unexpectedly, our results also revealed examples where additional information from multiple genes decreased prediction accuracy, highlighting an important and underappreciated effect that can occur when integrating data from multiple simultaneous measurements.

Cellular behavior analysis from live-cell imaging of TCR T cell-cancer cell interactions

T cell therapies, such as chimeric antigen receptor (CAR) T cells and T cell receptor (TCR) T cells, are a growing class of anti-cancer treatments. However, expansion to novel indications and beyond last-line treatment requires engineering cells' dynamic population behaviors. Here we develop the tools for cellular behavior analysis of T cells from live-cell imaging, a common and inexpensive experimental setup used to evaluate engineered T cells. We first develop a state-of-the-art segmentation and tracking pipeline, Caliban, based on human-in-the-loop deep learning. We then build the Occident pipeline to collect a catalog of phenotypes that characterize cell populations, morphology, movement, and interactions in co-cultures of modified T cells and antigen-presenting tumor cells. We use Caliban and Occident to interrogate how interactions between T cells and cancer cells differ when beneficial knock-outs of RASA2 and CUL5 are introduced into TCR T cells. We apply spatiotemporal models to quantify T cell recruitment and proliferation after interactions with cancer cells. We discover that, compared to a safe harbor knockout control, RASA2 knockout T cells have longer interaction times with cancer cells leading to greater T cell activation and killing efficacy, while CUL5 knockout T cells have increased proliferation rates leading to greater numbers of T cells for hunting. Together, segmentation and tracking from Caliban and phenotype quantification from Occident enable cellular behavior analysis to better engineer T cell therapies for improved cancer treatment.

Progressive decline in old pole gene expression signal enhances phenotypic heterogeneity in bacteria

Cell growth and gene expression are heterogeneous processes at the single-cell level, leading to the emergence of multiple physiological states within bacterial populations. Aging is a known deterministic driver of growth asymmetry; however, its role in gene expression heterogeneity remains elusive. Here, we show that aging mother cells undergo a progressive decline in old pole activity, generating asymmetry in protein partitioning, gene expression, and cell morphology. We demonstrate that mother cells, when compared to their daughters, exhibit lower product inheritance and gene expression rates independently of promoter dynamics. The declining activity of maternal old poles generates gene expression gradients that manifest as mother-daughter asymmetry upon division, showing that asymmetry is progressively built over time within the maternal intracellular environment. Moreover, old pole aging correlates with a gradual increase in cell length, leading to morphological asymmetry. These findings provide further evidence for aging as a mechanism to enhance phenotypic heterogeneity in bacterial populations, with possible consequences for stress response and survival.

The development of an automated microscope image tracking and analysis system

Microscopy image analysis plays a crucial role in understanding cellular behavior and uncovering important insights in various biological and medical research domains. Tracking cells within the time-lapse microscopy images is a fundamental technique that enables the study of cell dynamics, interactions, and migration. While manual cell tracking is possible, it is time-consuming and prone to subjective biases that impact results. In order to solve this issue, we sought to create an automated software solution, named cell analyzer, which is able to track cells within microscopy images with minimal input required from the user. The program of cell analyzer was written in Python utilizing the open source computer vision (OpenCV) library and featured a graphical user interface that makes it easy for users to access. The functions of all codes were verified through closeness, area, centroid, contrast, variance, and cell tracking test. Cell analyzer primarily utilizes image preprocessing and edge detection techniques to isolate cell boundaries for detection and analysis. It uniquely recorded the area, displacement, speed, size, and direction of detected cell objects and visualized the data collected automatically for fast analysis. Our cell analyzer provides an easy-to-use tool through a graphical user interface for tracking cell motion and analyzing quantitative cell images.

Automatic segmentation of spine x-ray images based on multiscale feature enhancement network

BACKGROUND

Automatic segmentation of vertebrae in spinal x-ray images is crucial for clinical diagnosis, case analysis, and surgical planning of spinal lesions.

PURPOSE

However, due to the inherent characteristics of x-ray images, including low contrast, high noise, and uneven grey scale, it remains a critical and challenging problem in computer-aided spine image analysis and disease diagnosis applications.

METHODS

In this paper, a Multiscale Feature Enhancement Network (MFENet), is proposed for segmenting whole spinal x-ray images, to aid doctors in diagnosing spinal-related diseases. To enhance feature extraction, the network incorporates a Dual-branch Feature Extraction Module (DFEM) and a Semantic Aggregation Module (SAM). The DFEM has a parallel dual-branch structure. The upper branch utilizes multiscale convolutional kernels to extract features from images. Employing convolutional kernels of different sizes helps capture details and structural information at different scales. The lower branch incorporates attention mechanisms to further optimize feature representation. By modeling the feature maps spatially and across channels, the network becomes more focused on key feature regions and suppresses task-irrelevant information. The SAM leverages contextual semantic information to compensate for details lost during pooling and convolution operations. It integrates high-level feature information from different scales to reduce segmentation result discontinuity. In addition, a hybrid loss function is employed to enhance the network's feature extraction capability.

RESULTS

In this study, we conducted a multitude of experiments utilizing dataset provided by the Spine Surgery Department of Henan Provincial People's Hospital. The experimental results indicate that our proposed MFENet demonstrates superior segmentation performance in spinal segmentation on x-ray images compared to other advanced methods, achieving 92.61 ± 0.431 for MIoU, 92.42 ± 0.329 for DSC, and 99.51 ± 0.037 for Global_accuracy.

CONCLUSIONS

Our model is able to more effectively learn and extract global contextual semantic information, significantly improving spinal segmentation performance, further aiding doctors in analyzing patient conditions.

Bioinformatic analysis reveals the association between bacterial morphology and antibiotic resistance using light microscopy with deep learning

Although it is well known that the morphology of Gram-negative rods changes on exposure to antibiotics, the morphology of antibiotic-resistant bacteria in the absence of antibiotics has not been widely investigated. Here, we studied the morphologies of 10 antibiotic-resistant strains of Escherichia coli and used bioinformatics tools to classify the resistant cells under light microscopy in the absence of antibiotics. The antibiotic-resistant strains showed differences in morphology from the sensitive parental strain, and the differences were most prominent in the quinolone-and β-lactam-resistant bacteria. A cluster analysis revealed increased proportions of fatter or shorter cells in the antibiotic-resistant strains. A correlation analysis of morphological features and gene expression suggested that genes related to energy metabolism and antibiotic resistance were highly correlated with the morphological characteristics of the resistant strains. Our newly proposed deep learning method for single-cell classification achieved a high level of performance in classifying quinolone-and β-lactam-resistant strains.

A benchmarked comparison of software packages for time-lapse image processing of monolayer bacterial population dynamics

Time-lapse microscopy offers a powerful approach for analyzing cellular activity. In particular, this technique is valuable for assessing the behavior of bacterial populations, which can exhibit growth and intercellular interactions in a monolayer. Such time-lapse imaging typically generates large quantities of data, limiting the options for manual investigation. Several image-processing software packages have been developed to facilitate analysis. It can thus be a challenge to identify the software package best suited to a particular research goal. Here, we compare four software packages that support the analysis of 2D time-lapse images of cellular populations: CellProfiler, SuperSegger-Omnipose, DeLTA, and FAST. We compare their performance against benchmarked results on time-lapse observations of Escherichia coli populations. Performance varies across the packages, with each of the four outperforming the others in at least one aspect of the analysis. Not surprisingly, the packages that have been in development for longer showed the strongest performance. We found that deep learning-based approaches to object segmentation outperformed traditional approaches, but the opposite was true for frame-to-frame object tracking. We offer these comparisons, together with insight into usability, computational efficiency, and feature availability, as a guide to researchers seeking image-processing solutions.

IMPORTANCE

Time-lapse microscopy provides a detailed window into the world of bacterial behavior. However, the vast amount of data produced by these techniques is difficult to analyze manually. We have analyzed four software tools designed to process such data and compared their performance, using populations of commonly studied bacterial species as our test subjects. Our findings offer a roadmap to scientists, helping them choose the right tool for their research. This comparison bridges a gap between microbiology and computational analysis, streamlining research efforts.

Tools and methods for high-throughput single-cell imaging with the mother machine

Despite much progress, image processing remains a significant bottleneck for high-throughput analysis of microscopy data. One popular platform for single-cell time-lapse imaging is the mother machine, which enables long-term tracking of microbial cells under precisely controlled growth conditions. While several mother machine image analysis pipelines have been developed in the past several years, adoption by a non-expert audience remains a challenge. To fill this gap, we implemented our own software, MM3, as a plugin for the multidimensional image viewer napari. napari-MM3 is a complete and modular image analysis pipeline for mother machine data, which takes advantage of the high-level interactivity of napari. Here, we give an overview of napari-MM3 and test it against several well-designed and widely used image analysis pipelines, including BACMMAN and DeLTA. Researchers often analyze mother machine data with custom scripts using varied image analysis methods, but a quantitative comparison of the output of different pipelines has been lacking. To this end, we show that key single-cell physiological parameter correlations and distributions are robust to the choice of analysis method. However, we also find that small changes in thresholding parameters can systematically alter parameters extracted from single-cell imaging experiments. Moreover, we explicitly show that in deep learning-based segmentation, 'what you put is what you get' (WYPIWYG) - that is, pixel-level variation in training data for cell segmentation can propagate to the model output and bias spatial and temporal measurements. Finally, while the primary purpose of this work is to introduce the image analysis software that we have developed over the last decade in our lab, we also provide information for those who want to implement mother machine-based high-throughput imaging and analysis methods in their research.

Deep model predictive control of gene expression in thousands of single cells

Gene expression is inherently dynamic, due to complex regulation and stochastic biochemical events. However, the effects of these dynamics on cell phenotypes can be difficult to determine. Researchers have historically been limited to passive observations of natural dynamics, which can preclude studies of elusive and noisy cellular events where large amounts of data are required to reveal statistically significant effects. Here, using recent advances in the fields of machine learning and control theory, we train a deep neural network to accurately predict the response of an optogenetic system in Escherichia coli cells. We then use the network in a deep model predictive control framework to impose arbitrary and cell-specific gene expression dynamics on thousands of single cells in real time, applying the framework to generate complex time-varying patterns. We also showcase the framework's ability to link expression patterns to dynamic functional outcomes by controlling expression of the tetA antibiotic resistance gene. This study highlights how deep learning-enabled feedback control can be used to tailor distributions of gene expression dynamics with high accuracy and throughput without expert knowledge of the biological system.

Machine Learning and Deep Learning in Synthetic Biology: Key Architectures, Applications, and Challenges

Machine learning (ML), particularly deep learning (DL), has made rapid and substantial progress in synthetic biology in recent years. Biotechnological applications of biosystems, including pathways, enzymes, and whole cells, are being probed frequently with time. The intricacy and interconnectedness of biosystems make it challenging to design them with the desired properties. ML and DL have a synergy with synthetic biology. Synthetic biology can be employed to produce large data sets for training models (for instance, by utilizing DNA synthesis), and ML/DL models can be employed to inform design (for example, by generating new parts or advising unrivaled experiments to perform). This potential has recently been brought to light by research at the intersection of engineering biology and ML/DL through achievements like the design of novel biological components, best experimental design, automated analysis of microscopy data, protein structure prediction, and biomolecular implementations of ANNs (Artificial Neural Networks). I have divided this review into three sections. In the first section, I describe predictive potential and basics of ML along with myriad applications in synthetic biology, especially in engineering cells, activity of proteins, and metabolic pathways. In the second section, I describe fundamental DL architectures and their applications in synthetic biology. Finally, I describe different challenges causing hurdles in the progress of ML/DL and synthetic biology along with their solutions.

Navigating the landscapes of spatial transcriptomics: How computational methods guide the way

Spatially resolved transcriptomics has been dramatically transforming biological and medical research in various fields. It enables transcriptome profiling at single-cell, multi-cellular, or sub-cellular resolution, while retaining the information of geometric localizations of cells in complex tissues. The coupling of cell spatial information and its molecular characteristics generates a novel multi-modal high-throughput data source, which poses new challenges for the development of analytical methods for data-mining. Spatial transcriptomic data are often highly complex, noisy, and biased, presenting a series of difficulties, many unresolved, for data analysis and generation of biological insights. In addition, to keep pace with the ever-evolving spatial transcriptomic experimental technologies, the existing analytical theories and tools need to be updated and reformed accordingly. In this review, we provide an overview and discussion of the current computational approaches for mining of spatial transcriptomics data. Future directions and perspectives of methodology design are proposed to stimulate further discussions and advances in new analytical models and algorithms. This article is categorized under: RNA Methods > RNA Analyses in Cells RNA Evolution and Genomics > Computational Analyses of RNA RNA Export and Localization > RNA Localization.

Microfluidic approaches in microbial ecology

Microbial life is at the heart of many diverse environments and regulates most natural processes, from the functioning of animal organs to the cycling of global carbon. Yet, the study of microbial ecology is often limited by challenges in visualizing microbial processes and replicating the environmental conditions under which they unfold. Microfluidics operates at the characteristic scale at which microorganisms live and perform their functions, thus allowing for the observation and quantification of behaviors such as growth, motility, and responses to external cues, often with greater detail than classical techniques. By enabling a high degree of control in space and time of environmental conditions such as nutrient gradients, pH levels, and fluid flow patterns, microfluidics further provides the opportunity to study microbial processes in conditions that mimic the natural settings harboring microbial life. In this review, we describe how recent applications of microfluidic systems to microbial ecology have enriched our understanding of microbial life and microbial communities. We highlight discoveries enabled by microfluidic approaches ranging from single-cell behaviors to the functioning of multi-cellular communities, and we indicate potential future opportunities to use microfluidics to further advance our understanding of microbial processes and their implications.

Tools and methods for high-throughput single-cell imaging with the mother machine

Despite much progress, image processing remains a significant bottleneck for high-throughput analysis of microscopy data. One popular platform for single-cell time-lapse imaging is the mother machine, which enables long-term tracking of microbial cells under precisely controlled growth conditions. While several mother machine image analysis pipelines have been developed in the past several years, adoption by a non-expert audience remains a challenge. To fill this gap, we implemented our own software, MM3, as a plugin for the multidimensional image viewer napari. napari-MM3 is a complete and modular image analysis pipeline for mother machine data, which takes advantage of the high-level interactivity of napari. Here, we give an overview of napari-MM3 and test it against several well-designed and widely-used image analysis pipelines, including BACMMAN and DeLTA. Researchers often analyze mother machine data with custom scripts using varied image analysis methods, but a quantitative comparison of the output of different pipelines has been lacking. To this end, we show that key single-cell physiological parameter correlations and distributions are robust to the choice of analysis method. However, we also find that small changes in thresholding parameters can systematically alter parameters extracted from single-cell imaging experiments. Moreover, we explicitly show that in deep learning based segmentation, "what you put is what you get" (WYPIWYG) - i.e., pixel-level variation in training data for cell segmentation can propagate to the model output and bias spatial and temporal measurements. Finally, while the primary purpose of this work is to introduce the image analysis software that we have developed over the last decade in our lab, we also provide information for those who want to implement mother-machine-based high-throughput imaging and analysis methods in their research.

GA-Net: A geographical attention neural network for the segmentation of body torso tissue composition

PURPOSE

Body composition analysis (BCA) of the body torso plays a vital role in the study of physical health and pathology and provides biomarkers that facilitate the diagnosis and treatment of many diseases, such as type 2 diabetes mellitus, cardiovascular disease, obstructive sleep apnea, and osteoarthritis. In this work, we propose a body composition tissue segmentation method that can automatically delineate those key tissues, including subcutaneous adipose tissue, skeleton, skeletal muscle tissue, and visceral adipose tissue, on positron emission tomography/computed tomography scans of the body torso.

METHODS

To provide appropriate and precise semantic and spatial information that is strongly related to body composition tissues for the deep neural network, first we introduce a new concept of the body area and integrate it into our proposed segmentation network called Geographical Attention Network (GA-Net). The body areas are defined following anatomical principles such that the whole body torso region is partitioned into three non-overlapping body areas. Each body composition tissue of interest is fully contained in exactly one specific minimal body area. Secondly, the proposed GA-Net has a novel dual-decoder schema that is composed of a tissue decoder and an area decoder. The tissue decoder segments the body composition tissues, while the area decoder segments the body areas as an auxiliary task. The features of body areas and body composition tissues are fused through a soft attention mechanism to gain geographical attention relevant to the body tissues. Thirdly, we propose a body composition tissue annotation approach that takes the body area labels as the region of interest, which significantly improves the reproducibility, precision, and efficiency of delineating body composition tissues.

RESULTS

Our evaluations on 50 low-dose unenhanced CT images indicate that GA-Net outperforms other architectures statistically significantly based on the Dice metric. GA-Net also shows improvements for the 95% Hausdorff Distance metric in most comparisons. Notably, GA-Net exhibits more sensitivity to subtle boundary information and produces more reliable and robust predictions for such structures, which are the most challenging parts to manually mend in practice, with potentially significant time-savings in the post hoc correction of these subtle boundary placement errors. Due to the prior knowledge provided from body areas, GA-Net achieves competitive performance with less training data. Our extension of the dual-decoder schema to TransUNet and 3D U-Net demonstrates that the new schema significantly improves the performance of these classical neural networks as well. Heatmaps obtained from attention gate layers further illustrate the geographical guidance function of body areas for identifying body tissues.

CONCLUSIONS

(i) Prior anatomic knowledge supplied in the form of appropriately designed anatomic container objects significantly improves the segmentation of bodily tissues. (ii) Of particular note are the improvements achieved in the delineation of subtle boundary features which otherwise would take much effort for manual correction. (iii) The method can be easily extended to existing networks to improve their accuracy for this application.

Coupling Cell Size Regulation and Proliferation Dynamics of C. glutamicum Reveals Cell Division Based on Surface Area

Single cells actively coordinate growth and division to regulate their size, yet how this size homeostasis at the single-cell level propagates over multiple generations to impact clonal expansion remains fundamentally unexplored. Classical timer models for cell proliferation (where the duration of the cell cycle is an independent variable) predict that the stochastic variation in colony size will increase monotonically over time. In stark contrast, implementing size control according to adder strategy (where on average a fixed size added from cell birth to division) leads to colony size variations that eventually decay to zero. While these results assume a fixed size of the colony-initiating progenitor cell, further analysis reveals that the magnitude of the intercolony variation in population number is sensitive to heterogeneity in the initial cell size. We validate these predictions by tracking the growth of isogenic microcolonies of Corynebacterium glutamicum in microfluidic chambers. Approximating their cell shape to a capsule, we observe that the degree of random variability in cell size is different depending on whether the cell size is quantified as per length, surface area, or volume, but size control remains an adder regardless of these size metrics. A comparison of the observed variability in the colony population with the predictions suggests that proliferation matches better with a cell division based on the cell surface. In summary, our integrated mathematical-experimental approach bridges the paradigms of single-cell size regulation and clonal expansion at the population levels. This innovative approach provides elucidation of the mechanisms of size homeostasis from the stochastic dynamics of colony size for rod-shaped microbes.

TreeJ: an ImageJ plugin for interactive cell lineage reconstruction from static images

BACKGROUND

With the emergence of deep-learning methods, tools are needed to capture and standardize image annotations made by experimentalists. In developmental biology, cell lineages are generally reconstructed from time-lapse data. However, some tissues need to be fixed to be accessible or to improve the staining. In this case, classical software do not offer the possibility of generating any lineage. Because of their rigid cell walls, plants present the advantage of keeping traces of the cell division history over successive generations in the cell patterns. To record this information despite having only a static image, dedicated tools are required.

RESULTS

We developed an interface to assist users in the building and editing of a lineage tree from a 3D labeled image. Each cell within the tree can be tagged. From the created tree, cells of a sub-tree or cells sharing the same tag can be extracted. The tree can be exported in a format compatible with dedicated software for advanced graph visualization and manipulation.

CONCLUSIONS

The TreeJ plugin for ImageJ/Fiji allows the user to generate and manipulate a lineage tree structure. The tree is compatible with other software to analyze the tree organization at the graphical level and at the cell pattern level. The code source is available at https://github.com/L-EL/TreeJ .

Automated detection of apoptotic bodies and cells in label-free time-lapse high-throughput video microscopy using deep convolutional neural networks

MOTIVATION

Reliable label-free methods are needed for detecting and profiling apoptotic events in time-lapse cell-cell interaction assays. Prior studies relied on fluorescent markers of apoptosis, e.g. Annexin-V, that provide an inconsistent and late indication of apoptotic onset for human melanoma cells. Our motivation is to improve the detection of apoptosis by directly detecting apoptotic bodies in a label-free manner.

RESULTS

Our trained ResNet50 network identified nanowells containing apoptotic bodies with 92% accuracy and predicted the onset of apoptosis with an error of one frame (5 min/frame). Our apoptotic body segmentation yielded an IoU accuracy of 75%, allowing associative identification of apoptotic cells. Our method detected apoptosis events, 70% of which were not detected by Annexin-V staining.

AVAILABILITY AND IMPLEMENTATION

Open-source code and sample data provided at https://github.com/kwu14victor/ApoBDproject.

A hybrid cell image segmentation method based on the multilevel improvement of data

Over the years, several methods have been developed for the segmentation of cell images. Most of the related techniques operate directly on the raw data (noisy cell samples) of the medical image which leads to adverse effects on the structure of leucocytes because the medical images are affected by multiple distortions (varying illumination, deficient background light intensity, and non-uniform staining). To overcome these problems, we came up with an improved solution that performs the qualitative enhancement of cell images for the smooth extraction of cell-nucleus. Although various segmentation methods have adopted an image improvement operation in practice. These methods also amplify the magnitude of image noise which leads to over-sampling and under-sampling of data points. This mis-labelling of data points is minimized by the developed approach which adopts a collaborative fusion strategy (CNN and Nuclear-norm approach) for the qualitative improvement of cell images. The enhanced cell samples were forwarded to the U-net (deep learning model) model for the semantic segmentation of cell images. The performance evaluation of the model was performed on three biomedical cell imaging datasets, which include the ALL-IDB (99.89% accuracy, 99.51% recall, and 99.01% precision), CellaVision (99.68% accuracy, 98.75% precision, and 97.94% specificity) and JTSC (98.45% accuracy, 97.42% precision, and 97.21% specificity) dataset. The results were compared with the state-of-art methods in which the adopted hybrid approach has overpowered the related techniques in the quantitative and qualitative domains.

Plantorganelle Hunter is an effective deep-learning-based method for plant organelle phenotyping in electron microscopy

Accurate delineation of plant cell organelles from electron microscope images is essential for understanding subcellular behaviour and function. Here we develop a deep-learning pipeline, called the organelle segmentation network (OrgSegNet), for pixel-wise segmentation to identify chloroplasts, mitochondria, nuclei and vacuoles. OrgSegNet was evaluated on a large manually annotated dataset collected from 19 plant species and achieved state-of-the-art segmentation performance. We defined three digital traits (shape complexity, electron density and cross-sectional area) to track the quantitative features of individual organelles in 2D images and released an open-source web tool called Plantorganelle Hunter for quantitatively profiling subcellular morphology. In addition, the automatic segmentation method was successfully applied to a serial-sectioning scanning microscope technique to create a 3D cell model that offers unique views of the morphology and distribution of these organelles. The functionalities of Plantorganelle Hunter can be easily operated, which will increase efficiency and productivity for the plant science community, and enhance understanding of subcellular biology.

Single-cell massively-parallel multiplexed microbial sequencing (M3-seq) identifies rare bacterial populations and profiles phage infection

Bacterial populations are highly adaptive. They can respond to stress and survive in shifting environments. How the behaviours of individual bacteria vary during stress, however, is poorly understood. To identify and characterize rare bacterial subpopulations, technologies for single-cell transcriptional profiling have been developed. Existing approaches show some degree of limitation, for example, in terms of number of cells or transcripts that can be profiled. Due in part to these limitations, few conditions have been studied with these tools. Here we develop massively-parallel, multiplexed, microbial sequencing (M3-seq)-a single-cell RNA-sequencing platform for bacteria that pairs combinatorial cell indexing with post hoc rRNA depletion. We show that M3-seq can profile bacterial cells from different species under a range of conditions in single experiments. We then apply M3-seq to hundreds of thousands of cells, revealing rare populations and insights into bet-hedging associated with stress responses and characterizing phage infection.

Machine learning for cross-scale microscopy of viruses

Despite advances in virological sciences and antiviral research, viruses continue to emerge, circulate, and threaten public health. We still lack a comprehensive understanding of how cells and individuals remain susceptible to infectious agents. This deficiency is in part due to the complexity of viruses, including the cell states controlling virus-host interactions. Microscopy samples distinct cellular infection stages in a multi-parametric, time-resolved manner at molecular resolution and is increasingly enhanced by machine learning and deep learning. Here we discuss how state-of-the-art artificial intelligence (AI) augments light and electron microscopy and advances virological research of cells. We describe current procedures for image denoising, object segmentation, tracking, classification, and super-resolution and showcase examples of how AI has improved the acquisition and analyses of microscopy data. The power of AI-enhanced microscopy will continue to help unravel virus infection mechanisms, develop antiviral agents, and improve viral vectors.

Toward Source-Free Cross Tissues Histopathological Cell Segmentation via Target-Specific Finetuning

Recognition and quantitative analytics of histopathological cells are the golden standard for diagnosing multiple cancers. Despite recent advances in deep learning techniques that have been widely investigated for the automated segmentation of various types of histopathological cells, the heavy dependency on specific histopathological image types with sufficient supervised annotations, as well as the limited access to clinical data in hospitals, still pose significant challenges in the application of computer-aided diagnosis in pathology. In this paper, we focus on the model generalization of cell segmentation towards cross-tissue histopathological images. Remarkably, a novel target-specific finetuning-based self-supervised domain adaptation framework is proposed to transfer the cell segmentation model to unlabeled target datasets, without access to source datasets and annotations. When performed on the target unlabeled histopathological image set, the proposed method only needs to tune very few parameters of the pre-trained model in a self-supervised manner. Considering the morphological properties of pathological cells, we introduce two constraint terms at both local and global levels into this framework to access more reliable predictions. The proposed cross-domain framework is validated on three different types of histopathological tissues, showing promising performance in self-supervised cell segmentation. Additionally, the whole framework can be further applied to clinical tools in pathology without accessing the original training image data. The code and dataset are released at: https://github.com/NeuronXJTU/SFDA-CellSeg.

YOLOv5-FPN: A Robust Framework for Multi-Sized Cell Counting in Fluorescence Images

Cell counting in fluorescence microscopy is an essential task in biomedical research for analyzing cellular dynamics and studying disease progression. Traditional methods for cell counting involve manual counting or threshold-based segmentation, which are time-consuming and prone to human error. Recently, deep learning-based object detection methods have shown promising results in automating cell counting tasks. However, the existing methods mainly focus on segmentation-based techniques that require a large amount of labeled data and extensive computational resources. In this paper, we propose a novel approach to detect and count multiple-size cells in a fluorescence image slide using You Only Look Once version 5 (YOLOv5) with a feature pyramid network (FPN). Our proposed method can efficiently detect multiple cells with different sizes in a single image, eliminating the need for pixel-level segmentation. We show that our method outperforms state-of-the-art segmentation-based approaches in terms of accuracy and computational efficiency. The experimental results on publicly available datasets demonstrate that our proposed approach achieves an average precision of 0.8 and a processing time of 43.9 ms per image. Our approach addresses the research gap in the literature by providing a more efficient and accurate method for cell counting in fluorescence microscopy that requires less computational resources and labeled data.

Automated identification and tracking of cells in Cytometry of Reaction Rate Constant (CRRC)

Cytometry of Reaction Rate Constant (CRRC) is a method for studying cell-population heterogeneity using time-lapse fluorescence microscopy, which allows one to follow reaction kinetics in individual cells. The current and only CRRC workflow utilizes a single fluorescence image to manually identify cell contours which are then used to determine fluorescence intensity of individual cells in the entire time-stack of images. This workflow is only reliable if cells maintain their positions during the time-lapse measurements. If the cells move, the original cell contours become unsuitable for evaluating intracellular fluorescence and the CRRC experiment will be inaccurate. The requirement of invariant cell positions during a prolonged imaging is impossible to satisfy for motile cells. Here we report a CRRC workflow developed to be applicable to motile cells. The new workflow combines fluorescence microscopy with transmitted-light microscopy and utilizes a new automated tool for cell identification and tracking. A transmitted-light image is taken right before every fluorescence image to determine cell contours, and cell contours are tracked through the time-stack of transmitted-light images to account for cell movement. Each unique contour is used to determine fluorescence intensity of cells in the associated fluorescence image. Next, time dependencies of the intracellular fluorescence intensities are used to determine each cell's rate constant and construct a kinetic histogram "number of cells vs rate constant." The new workflow's robustness to cell movement was confirmed experimentally by conducting a CRRC study of cross-membrane transport in motile cells. The new workflow makes CRRC applicable to a wide range of cell types and eliminates the influence of cell motility on the accuracy of results. Additionally, the workflow could potentially monitor kinetics of varying biological processes at the single-cell level for sizable cell populations. Although our workflow was designed ad hoc for CRRC, this cell-segmentation/cell-tracking strategy also represents an entry-level, user-friendly option for a variety of biological assays (i.e., migration, proliferation assays, etc.). Importantly, no prior knowledge of informatics (i.e., training a model for deep learning) is required.

Ensemble Deep Learning Object Detection Fusion for Cell Tracking, Mitosis, and Lineage

Cell tracking and motility analysis are essential for understanding multicellular processes, automated quantification in biomedical experiments, and medical diagnosis and treatment. However, manual tracking is labor-intensive, tedious, and prone to selection bias and errors. Building upon our previous work, we propose a new deep learning-based method, EDNet, for cell detection, tracking, and motility analysis that is more robust to shape across different cell lines, and models cell lineage and proliferation. EDNet uses an ensemble approach for 2D cell detection that is deep-architecture-agnostic and achieves state-of-the-art performance surpassing single-model YOLO and FasterRCNN convolutional neural networks. EDNet detections are used in our M2Track multiobject tracking algorithm for tracking cells, detecting cell mitosis (cell division) events, and cell lineage graphs. Our methods produce state-of-the-art performance on the Cell Tracking and Mitosis (CTMCv1) dataset with a Multiple Object Tracking Accuracy (MOTA) score of 50.6% and tracking lineage graph edit (TRA) score of 52.5%. Additionally, we compare our detection and tracking methods to human performance on external data in studying the motility of muscle stem cells with different physiological and molecular stimuli. We believe that our method has the potential to improve the accuracy and efficiency of cell tracking and motility analysis. This could lead to significant advances in biomedical research and medical diagnosis. Our code is made publicly available on GitHub.

A deep learning framework for quantitative analysis of actin microridges

Microridges are evolutionarily conserved actin-rich protrusions present on the apical surface of squamous epithelial cells. In zebrafish epidermal cells, microridges form self-evolving patterns due to the underlying actomyosin network dynamics. However, their morphological and dynamic characteristics have remained poorly understood owing to a lack of computational methods. We achieved ~95% pixel-level accuracy with a deep learning microridge segmentation strategy enabling quantitative insights into their bio-physical-mechanical characteristics. From the segmented images, we estimated an effective microridge persistence length of ~6.1 μm. We discovered the presence of mechanical fluctuations and found relatively greater stresses stored within patterns of yolk than flank, indicating distinct regulation of their actomyosin networks. Furthermore, spontaneous formations and positional fluctuations of actin clusters within microridges were associated with pattern rearrangements over short length/time-scales. Our framework allows large-scale spatiotemporal analysis of microridges during epithelial development and probing of their responses to chemical and genetic perturbations to unravel the underlying patterning mechanisms.

Mechanobiology as a tool for addressing the genotype-to-phenotype problem in microbiology

The central hypothesis of the genotype-phenotype relationship is that the phenotype of a developing organism (i.e., its set of observable attributes) depends on its genome and the environment. However, as we learn more about the genetics and biochemistry of living systems, our understanding does not fully extend to the complex multiscale nature of how cells move, interact, and organize; this gap in understanding is referred to as the genotype-to-phenotype problem. The physics of soft matter sets the background on which living organisms evolved, and the cell environment is a strong determinant of cell phenotype. This inevitably leads to challenges as the full function of many genes, and the diversity of cellular behaviors cannot be assessed without wide screens of environmental conditions. Cellular mechanobiology is an emerging field that provides methodologies to understand how cells integrate chemical and physical environmental stress and signals, and how they are transduced to control cell function. Biofilm forming bacteria represent an attractive model because they are fast growing, genetically malleable and can display sophisticated self-organizing developmental behaviors similar to those found in higher organisms. Here, we propose mechanobiology as a new area of study in prokaryotic systems and describe its potential for unveiling new links between an organism's genome and phenome.

Integration of immune cells in organs-on-chips: a tutorial

Viral and bacterial infections continue to pose significant challenges for numerous individuals globally. To develop novel therapies to combat infections, more insight into the actions of the human innate and adaptive immune system during infection is necessary. Human in vitro models, such as organs-on-chip (OOC) models, have proven to be a valuable addition to the tissue modeling toolbox. The incorporation of an immune component is needed to bring OOC models to the next level and enable them to mimic complex biological responses. The immune system affects many (patho)physiological processes in the human body, such as those taking place during an infection. This tutorial review introduces the reader to the building blocks of an OOC model of acute infection to investigate recruitment of circulating immune cells into the infected tissue. The multi-step extravasation cascade in vivo is described, followed by an in-depth guide on how to model this process on a chip. Next to chip design, creation of a chemotactic gradient and incorporation of endothelial, epithelial, and immune cells, the review focuses on the hydrogel extracellular matrix (ECM) to accurately model the interstitial space through which extravasated immune cells migrate towards the site of infection. Overall, this tutorial review is a practical guide for developing an OOC model of immune cell migration from the blood into the interstitial space during infection.

The Quantification of Bacterial Cell Size: Discrepancies Arise from Varied Quantification Methods

The robust regulation of the cell cycle is critical for the survival and proliferation of bacteria. To gain a comprehensive understanding of the mechanisms regulating the bacterial cell cycle, it is essential to accurately quantify cell-cycle-related parameters and to uncover quantitative relationships. In this paper, we demonstrate that the quantification of cell size parameters using microscopic images can be influenced by software and by the parameter settings used. Remarkably, even if the consistent use of a particular software and specific parameter settings is maintained throughout a study, the type of software and the parameter settings can significantly impact the validation of quantitative relationships, such as the constant-initiation-mass hypothesis. Given these inherent characteristics of microscopic image-based quantification methods, it is recommended that conclusions be cross-validated using independent methods, especially when the conclusions are associated with cell size parameters that were obtained under different conditions. To this end, we presented a flexible workflow for simultaneously quantifying multiple bacterial cell-cycle-related parameters using microscope-independent methods.

A review of open-source image analysis tools for mammalian cell culture: algorithms, features and implementations

Cell culture is undeniably important for multiple scientific applications, including pharmaceuticals, transplants, and cosmetics. However, cell culture involves multiple manual steps, such as regularly analyzing cell images for their health and morphology. Computer scientists have developed algorithms to automate cell imaging analysis, but they are not widely adopted by biologists, especially those lacking an interactive platform. To address the issue, we compile and review existing open-source cell image processing tools that provide interactive interfaces for management and prediction tasks. We highlight the prediction tools that can detect, segment, and track different mammalian cell morphologies across various image modalities and present a comparison of algorithms and unique features of these tools, whether they work locally or in the cloud. This would guide non-experts to determine which is best suited for their purposes and, developers to acknowledge what is worth further expansion. In addition, we provide a general discussion on potential implementations of the tools for a more extensive scope, which guides the reader to not restrict them to prediction tasks only. Finally, we conclude the article by stating new considerations for the development of interactive cell imaging tools and suggesting new directions for future research.

A comparison of machine learning approaches for the quantification of microglial cells in the brain of mice, rats and non-human primates

Microglial cells are brain-specific macrophages that swiftly react to disruptive events in the brain. Microglial activation leads to specific modifications, including proliferation, morphological changes, migration to the site of insult, and changes in gene expression profiles. A change in inflammatory status has been linked to many neurodegenerative diseases such as Parkinson's disease and Alzheimer's disease. For this reason, the investigation and quantification of microglial cells is essential for better understanding their role in disease progression as well as for evaluating the cytocompatibility of novel therapeutic approaches for such conditions. In the following study we implemented a machine learning-based approach for the fast and automatized quantification of microglial cells; this tool was compared with manual quantification (ground truth), and with alternative free-ware such as the threshold-based ImageJ and the machine learning-based Ilastik. We first trained the algorithms on brain tissue obtained from rats and non-human primate immunohistochemically labelled for microglia. Subsequently we validated the accuracy of the trained algorithms in a preclinical rodent model of Parkinson's disease and demonstrated the robustness of the algorithms on tissue obtained from mice, as well as from images provided by three collaborating laboratories. Our results indicate that machine learning algorithms can detect and quantify microglial cells in all the three mammalian species in a precise manner, equipotent to the one observed following manual counting. Using this tool, we were able to detect and quantify small changes between the hemispheres, suggesting the power and reliability of the algorithm. Such a tool will be very useful for investigation of microglial response in disease development, as well as in the investigation of compatible novel therapeutics targeting the brain. As all network weights and labelled training data are made available, together with our step-by-step user guide, we anticipate that many laboratories will implement machine learning-based quantification of microglial cells in their research.

Microsystem Advances through Integration with Artificial Intelligence

Microfluidics is a rapidly growing discipline that involves studying and manipulating fluids at reduced length scale and volume, typically on the scale of micro- or nanoliters. Under the reduced length scale and larger surface-to-volume ratio, advantages of low reagent consumption, faster reaction kinetics, and more compact systems are evident in microfluidics. However, miniaturization of microfluidic chips and systems introduces challenges of stricter tolerances in designing and controlling them for interdisciplinary applications. Recent advances in artificial intelligence (AI) have brought innovation to microfluidics from design, simulation, automation, and optimization to bioanalysis and data analytics. In microfluidics, the Navier-Stokes equations, which are partial differential equations describing viscous fluid motion that in complete form are known to not have a general analytical solution, can be simplified and have fair performance through numerical approximation due to low inertia and laminar flow. Approximation using neural networks trained by rules of physical knowledge introduces a new possibility to predict the physicochemical nature. The combination of microfluidics and automation can produce large amounts of data, where features and patterns that are difficult to discern by a human can be extracted by machine learning. Therefore, integration with AI introduces the potential to revolutionize the microfluidic workflow by enabling the precision control and automation of data analysis. Deployment of smart microfluidics may be tremendously beneficial in various applications in the future, including high-throughput drug discovery, rapid point-of-care-testing (POCT), and personalized medicine. In this review, we summarize key microfluidic advances integrated with AI and discuss the outlook and possibilities of combining AI and microfluidics.

Optofluidic imaging meets deep learning: from merging to emerging

Propelled by the striking advances in optical microscopy and deep learning (DL), the role of imaging in lab-on-a-chip has dramatically been transformed from a silo inspection tool to a quantitative "smart" engine. A suite of advanced optical microscopes now enables imaging over a range of spatial scales (from molecules to organisms) and temporal window (from microseconds to hours). On the other hand, the staggering diversity of DL algorithms has revolutionized image processing and analysis at the scale and complexity that were once inconceivable. Recognizing these exciting but overwhelming developments, we provide a timely review of their latest trends in the context of lab-on-a-chip imaging, or coined optofluidic imaging. More importantly, here we discuss the strengths and caveats of how to adopt, reinvent, and integrate these imaging techniques and DL algorithms in order to tailor different lab-on-a-chip applications. In particular, we highlight three areas where the latest advances in lab-on-a-chip imaging and DL can form unique synergisms: image formation, image analytics and intelligent image-guided autonomous lab-on-a-chip. Despite the on-going challenges, we anticipate that they will represent the next frontiers in lab-on-a-chip imaging that will spearhead new capabilities in advancing analytical chemistry research, accelerating biological discovery, and empowering new intelligent clinical applications.

Segmentation-based tracking of macrophages in 2D＋time microscopy movies inside a living animal

The automated segmentation and tracking of macrophages during their migration are challenging tasks due to their dynamically changing shapes and motions. This paper proposes a new algorithm to achieve automatic cell tracking in time-lapse microscopy macrophage data. First, we design a segmentation method employing space-time filtering, local Otsu's thresholding, and the SUBSURF (subjective surface segmentation) method. Next, the partial trajectories for cells overlapping in the temporal direction are extracted in the segmented images. Finally, the extracted trajectories are linked by considering their direction of movement. The segmented images and the obtained trajectories from the proposed method are compared with those of the semi-automatic segmentation and manual tracking. The proposed tracking achieved 97.4% of accuracy for macrophage data under challenging situations, feeble fluorescent intensity, irregular shapes, and motion of macrophages. We expect that the automatically extracted trajectories of macrophages can provide pieces of evidence of how macrophages migrate depending on their polarization modes in the situation, such as during wound healing.

Marine animal evolutionary developmental biology-Advances through technology development

Evolutionary developmental biology, the interdisciplinary effort of illuminating the conserved similarities and differences during animal development across all phylogenetic clades, has gained renewed interest in the past decades. As technology (immunohistochemistry, next-generation sequencing, advanced imaging, and computational resources) has advanced, so has our ability of resolving fundamental hypotheses and overcoming the genotype-phenotype gap. This rapid progress, however, has also exposed gaps in the collective knowledge around the choice and representation of model organisms. It has become clear that evo-devo requires a comparative, large-scale approach including marine invertebrates to resolve some of the most urgent questions about the phylogenetic positioning and character traits of the last common ancestors. Many invertebrates at the base of the tree of life inhabit marine environments and have been used for some years due to their accessibility, husbandry, and morphology. Here, we briefly review the major concepts of evolutionary developmental biology and discuss the suitability of established model organisms to address current research questions, before focussing on the importance, application, and state-of-the-art of marine evo-devo. We highlight novel technical advances that progress evo-devo as a whole.

Tracking unlabeled cancer cells imaged with low resolution in wide migration chambers via U-NET class-1 probability (pseudofluorescence)

Cell migration is a pivotal biological process, whose dysregulation is found in many diseases including inflammation and cancer. Advances in microscopy technologies allow now to study cell migration in vitro, within engineered microenvironments that resemble in vivo conditions. However, to capture an entire 3D migration chamber for extended periods of time and with high temporal resolution, images are generally acquired with low resolution, which poses a challenge for data analysis. Indeed, cell detection and tracking are hampered due to the large pixel size (i.e., cell diameter down to 2 pixels), the possible low signal-to-noise ratio, and distortions in the cell shape due to changes in the z-axis position. Although fluorescent staining can be used to facilitate cell detection, it may alter cell behavior and it may suffer from fluorescence loss over time (photobleaching).Here we describe a protocol that employs an established deep learning method (U-NET), to specifically convert transmitted light (TL) signal from unlabeled cells imaged with low resolution to a fluorescent-like signal (class 1 probability). We demonstrate its application to study cancer cell migration, obtaining a significant improvement in tracking accuracy, while not suffering from photobleaching. This is reflected in the possibility of tracking cells for three-fold longer periods of time. To facilitate the application of the protocol we provide WID-U, an open-source plugin for FIJI and Imaris imaging software, the training dataset used in this paper, and the code to train the network for custom experimental settings.

Navigating Environmental Transitions: the Role of Phenotypic Variation in Bacterial Responses

The ability of bacteria to respond to changes in their environment is critical to their survival, allowing them to withstand stress, form complex communities, and induce virulence responses during host infection. A remarkable feature of many of these bacterial responses is that they are often variable across individual cells, despite occurring in an isogenic population exposed to a homogeneous environmental change, a phenomenon known as phenotypic heterogeneity. Phenotypic heterogeneity can enable bet-hedging or division of labor strategies that allow bacteria to survive fluctuating conditions. Investigating the significance of phenotypic heterogeneity in environmental transitions requires dynamic, single-cell data. Technical advances in quantitative single-cell measurements, imaging, and microfluidics have led to a surge of publications on this topic. Here, we review recent discoveries on single-cell bacterial responses to environmental transitions of various origins and complexities, from simple diauxic shifts to community behaviors in biofilm formation to virulence regulation during infection. We describe how these studies firmly establish that this form of heterogeneity is prevalent and a conserved mechanism by which bacteria cope with fluctuating conditions. We end with an outline of current challenges and future directions for the field. While it remains challenging to predict how an individual bacterium will respond to a given environmental input, we anticipate that capturing the dynamics of the process will begin to resolve this and facilitate rational perturbation of environmental responses for therapeutic and bioengineering purposes.