The influence of spatial and temporal resolutions on the analysis of cell-cell interaction: a systematic study for time-lapse microscopy applications

Assessing personalized responses to anti-PD-1 treatment using patient-derived lung tumor-on-chip

There is a compelling need for approaches to predict the efficacy of immunotherapy drugs. Tumor-on-chip technology exploits microfluidics to generate 3D cell co-cultures embedded in hydrogels that recapitulate simplified tumor ecosystems. Here, we present the development and validation of lung tumor-on-chip platforms to quickly and precisely measure ex vivo the effects of immune checkpoint inhibitors on T cell-mediated cancer cell death by exploiting the power of live imaging and advanced image analysis algorithms. The integration of autologous immunosuppressive FAP+ cancer-associated fibroblasts impaired the response to anti-PD-1, indicating that tumors-on-chips are capable of recapitulating stroma-dependent mechanisms of immunotherapy resistance. For a small cohort of non-small cell lung cancer patients, we generated personalized tumors-on-chips with their autologous primary cells isolated from fresh tumor samples, and we measured the responses to anti-PD-1 treatment. These results support the power of tumor-on-chip technology in immuno-oncology research and open a path to future clinical validations.

Cell Electrokinetic Fingerprint: A Novel Approach Based on Optically Induced Dielectrophoresis (ODEP) for In-Flow Identification of Single Cells

A novel optically induced dielectrophoresis (ODEP) system that can operate under flow conditions is designed for automatic trapping of cells and subsequent induction of 2D multi-frequency cell trajectories. Like in a "ping-pong" match, two virtual electrode barriers operate in an alternate mode with varying frequencies of the input voltage. The so-derived cell motions are characterized via time-lapse microscopy, cell tracking, and state-of-the-art machine learning algorithms, like the wavelet scattering transform (WST). As a cell-electrokinetic fingerprint, the dynamic of variation of the cell displacements happening, over time, is quantified in response to different frequency values of the induced electric field. When tested on two biological scenarios in the cancer domain, the proposed approach discriminates cellular dielectric phenotypes obtained, respectively, at different early phases of drug-induced apoptosis in prostate cancer (PC3) cells and for differential expression of the lectine-like oxidized low-density lipoprotein receptor-1 (LOX-1) transcript levels in human colorectal adenocarcinoma (DLD-1) cells. The results demonstrate increased discrimination of the proposed system and pose an additional basis for making ODEP-based assays addressing cancer heterogeneity for precision medicine and pharmacological research.

Advanced optical imaging for the rational design of nanomedicines

Despite the enormous potential of nanomedicines to shape the future of medicine, their clinical translation remains suboptimal. Translational challenges are present in every step of the development pipeline, from a lack of understanding of patient heterogeneity to insufficient insights on nanoparticle properties and their impact on material-cell interactions. Here, we discuss how the adoption of advanced optical microscopy techniques, such as super-resolution optical microscopies, correlative techniques, and high-content modalities, could aid the rational design of nanocarriers, by characterizing the cell, the nanomaterial, and their interaction with unprecedented spatial and/or temporal detail. In this nanomedicine arena, we will discuss how the implementation of these techniques, with their versatility and specificity, can yield high volumes of multi-parametric data; and how machine learning can aid the rapid advances in microscopy: from image acquisition to data interpretation.

Generative models of morphogenesis in developmental biology

Understanding the mechanism by which cells coordinate their differentiation and migration is critical to our understanding of many fundamental processes such as wound healing, disease progression, and developmental biology. Mathematical models have been an essential tool for testing and developing our understanding, such as models of cells as soft spherical particles, reaction-diffusion systems that couple cell movement to environmental factors, and multi-scale multi-physics simulations that combine bottom-up rule-based models with continuum laws. However, mathematical models can often be loosely related to data or have so many parameters that model behaviour is weakly constrained. Recent methods in machine learning introduce new means by which models can be derived and deployed. In this review, we discuss examples of mathematical models of aspects of developmental biology, such as cell migration, and how these models can be combined with these recent machine learning methods.

Organ-on-a-chip meets artificial intelligence in drug evaluation

Drug evaluation has always been an important area of research in the pharmaceutical industry. However, animal welfare protection and other shortcomings of traditional drug development models pose obstacles and challenges to drug evaluation. Organ-on-a-chip (OoC) technology, which simulates human organs on a chip of the physiological environment and functionality, and with high fidelity reproduction organ-level of physiology or pathophysiology, exhibits great promise for innovating the drug development pipeline. Meanwhile, the advancement in artificial intelligence (AI) provides more improvements for the design and data processing of OoCs. Here, we review the current progress that has been made to generate OoC platforms, and how human single and multi-OoCs have been used in applications, including drug testing, disease modeling, and personalized medicine. Moreover, we discuss issues facing the field, such as large data processing and reproducibility, and point to the integration of OoCs and AI in data analysis and automation, which is of great benefit in future drug evaluation. Finally, we look forward to the opportunities and challenges faced by the coupling of OoCs and AI. In summary, advancements in OoCs development, and future combinations with AI, will eventually break the current state of drug evaluation.

Microsystem Advances through Integration with Artificial Intelligence

Microfluidics is a rapidly growing discipline that involves studying and manipulating fluids at reduced length scale and volume, typically on the scale of micro- or nanoliters. Under the reduced length scale and larger surface-to-volume ratio, advantages of low reagent consumption, faster reaction kinetics, and more compact systems are evident in microfluidics. However, miniaturization of microfluidic chips and systems introduces challenges of stricter tolerances in designing and controlling them for interdisciplinary applications. Recent advances in artificial intelligence (AI) have brought innovation to microfluidics from design, simulation, automation, and optimization to bioanalysis and data analytics. In microfluidics, the Navier-Stokes equations, which are partial differential equations describing viscous fluid motion that in complete form are known to not have a general analytical solution, can be simplified and have fair performance through numerical approximation due to low inertia and laminar flow. Approximation using neural networks trained by rules of physical knowledge introduces a new possibility to predict the physicochemical nature. The combination of microfluidics and automation can produce large amounts of data, where features and patterns that are difficult to discern by a human can be extracted by machine learning. Therefore, integration with AI introduces the potential to revolutionize the microfluidic workflow by enabling the precision control and automation of data analysis. Deployment of smart microfluidics may be tremendously beneficial in various applications in the future, including high-throughput drug discovery, rapid point-of-care-testing (POCT), and personalized medicine. In this review, we summarize key microfluidic advances integrated with AI and discuss the outlook and possibilities of combining AI and microfluidics.

Liver-on-a-chip: Considerations, advances, and beyond

The liver is the largest internal organ in the human body with largest mass of glandular tissue. Modeling the liver has been challenging due to its variety of major functions, including processing nutrients and vitamins, detoxification, and regulating body metabolism. The intrinsic shortfalls of conventional two-dimensional (2D) cell culture methods for studying pharmacokinetics in parenchymal cells (hepatocytes) have contributed to suboptimal outcomes in clinical trials and drug development. This prompts the development of highly automated, biomimetic liver-on-a-chip (LOC) devices to simulate native liver structure and function, with the aid of recent progress in microfluidics. LOC offers a cost-effective and accurate model for pharmacokinetics, pharmacodynamics, and toxicity studies. This review provides a critical update on recent developments in designing LOCs and fabrication strategies. We highlight biomimetic design approaches for LOCs, including mimicking liver structure and function, and their diverse applications in areas such as drug screening, toxicity assessment, and real-time biosensing. We capture the newest ideas in the field to advance the field of LOCs and address current challenges.

Machine learning phenomics (MLP) combining deep learning with time-lapse-microscopy for monitoring colorectal adenocarcinoma cells gene expression and drug-response

High-throughput phenotyping is becoming increasingly available thanks to analytical and bioinformatics approaches that enable the use of very high-dimensional data and to the availability of dynamic models that link phenomena across levels: from genes to cells, from cells to organs, and through the whole organism. The combination of phenomics, deep learning, and machine learning represents a strong potential for the phenotypical investigation, leading the way to a more embracing approach, called machine learning phenomics (MLP). In particular, in this work we present a novel MLP platform for phenomics investigation of cancer-cells response to therapy, exploiting and combining the potential of time-lapse microscopy for cell behavior data acquisition and robust deep learning software architectures for the latent phenotypes extraction. A two-step proof of concepts is designed. First, we demonstrate a strict correlation among gene expression and cell phenotype with the aim to identify new biomarkers and targets for tailored therapy in human colorectal cancer onset and progression. Experiments were conducted on human colorectal adenocarcinoma cells (DLD-1) and their profile was compared with an isogenic line in which the expression of LOX-1 transcript was knocked down. In addition, we also evaluate the phenotypic impact of the administration of different doses of an antineoplastic drug over DLD-1 cells. Under the omics paradigm, proteomics results are used to confirm the findings of the experiments.

An Agent-Based Interpretation of Leukocyte Chemotaxis in Cancer-on-Chip Experiments

The present paper was inspired by recent developments in laboratory experiments within the framework of cancer-on-chip technology, an immune-oncology microfluidic chip aiming at studying the fundamental mechanisms of immunocompetent behavior. We focus on the laboratory setting where cancer is treated with chemotherapy drugs, and in this case, the effects of the treatment administration hypothesized by biologists are: the absence of migration and proliferation of tumor cells, which are dying; the stimulation of the production of chemical substances (annexin); the migration of leukocytes in the direction of higher concentrations of chemicals. Here, following the physiological hypotheses made by biologists on the phenomena occurring in these experiments, we introduce an agent-based model reproducing the dynamics of two cell populations (agents), i.e., tumor cells and leukocytes living in the microfluidic chip environment. Our model aims at proof of concept, demonstrating that the observations of the biological phenomena can be obtained by the model on the basis of the explicit assumptions made. In this framework, close adherence of the computational model to the biological results, as shown in the section devoted to the first calibration of the model with respect to available observations, is successfully accomplished.

Optimizing Long-Term Live Cell Imaging

Live cell microscopy has become a common technique for exploring dynamic biological processes. When combined with fluorescent markers of cellular structures of interest, or fluorescent reporters of a biological activity of interest, live cell microscopy enables precise temporally and spatially resolved quantitation of the biological processes under investigation. However, because living cells are not normally exposed to light, live cell fluorescence imaging is significantly hindered by the effects of photodamage, which encompasses photobleaching of fluorophores and phototoxicity of the cells under observation. In this chapter, we outline several methods for optimizing and maintaining long-term imaging of live cells while simultaneously minimizing photodamage. This protocol demonstrates the intracellular trafficking of early and late endosomes following phagocytosis using both two and three dimensional imaging, but this protocol can easily be modified to image any biological process of interest in nearly any cell type.

An Overview of Organs-on-Chips Based on Deep Learning

Microfluidic-based organs-on-chips (OoCs) are a rapidly developing technology in biomedical and chemical research and have emerged as one of the most advanced and promising in vitro models. The miniaturization, stimulated tissue mechanical forces, and microenvironment of OoCs offer unique properties for biomedical applications. However, the large amount of data generated by the high parallelization of OoC systems has grown far beyond the scope of manual analysis by researchers with biomedical backgrounds. Deep learning, an emerging area of research in the field of machine learning, can automatically mine the inherent characteristics and laws of "big data" and has achieved remarkable applications in computer vision, speech recognition, and natural language processing. The integration of deep learning in OoCs is an emerging field that holds enormous potential for drug development, disease modeling, and personalized medicine. This review briefly describes the basic concepts and mechanisms of microfluidics and deep learning and summarizes their successful integration. We then analyze the combination of OoCs and deep learning for image digitization, data analysis, and automation. Finally, the problems faced in current applications are discussed, and future perspectives and suggestions are provided to further strengthen this integration.

Recursive Deep Prior Video: A super resolution algorithm for time-lapse microscopy of organ-on-chip experiments

Biological experiments based on organ-on-chips (OOCs) exploit light Time-Lapse Microscopy (TLM) for a direct observation of cell movement that is an observable signature of underlying biological processes. A high spatial resolution is essential to capture cell dynamics and interactions from recorded experiments by TLM. Unfortunately, due to physical and cost limitations, acquiring high resolution videos is not always possible. To overcome the problem, we present here a new deep learning-based algorithm that extends the well-known Deep Image Prior (DIP) to TLM Video Super Resolution without requiring any training. The proposed Recursive Deep Prior Video method introduces some novelties. The weights of the DIP network architecture are initialized for each of the frames according to a new recursive updating rule combined with an efficient early stopping criterion. Moreover, the DIP loss function is penalized by two different Total Variation-based terms. The method has been validated on synthetic, i.e., artificially generated, as well as real videos from OOC experiments related to tumor-immune interaction. The achieved results are compared with several state-of-the-art trained deep learning Super Resolution algorithms showing outstanding performances.

Apoptosis mapping in space and time of 3D tumor ecosystems reveals transmissibility of cytotoxic cancer death

The emerging tumor-on-chip (ToC) approaches allow to address biomedical questions out of reach with classical cell culture techniques: in biomimetic 3D hydrogels they partially reconstitute ex vivo the complexity of the tumor microenvironment and the cellular dynamics involving multiple cell types (cancer cells, immune cells, fibroblasts, etc.). However, a clear bottleneck is the extraction and interpretation of the rich biological information contained, sometime hidden, in the cell co-culture videos. In this work, we develop and apply novel video analysis algorithms to automatically measure the cytotoxic effects on human cancer cells (lung and breast) induced either by doxorubicin chemotherapy drug or by autologous tumor-infiltrating cytotoxic T lymphocytes (CTL). A live fluorescent dye (red) is used to selectively pre-stain the cancer cells before co-cultures and a live fluorescent reporter for caspase activity (green) is used to monitor apoptotic cell death. The here described open-source computational method, named STAMP (spatiotemporal apoptosis mapper), extracts the temporal kinetics and the spatial maps of cancer death, by localizing and tracking cancer cells in the red channel, and by counting the red to green transition signals, over 2-3 days. The robustness and versatility of the method is demonstrated by its application to different cell models and co-culture combinations. Noteworthy, this approach reveals the strong contribution of primary cancer-associated fibroblasts (CAFs) to breast cancer chemo-resistance, proving to be a powerful strategy to investigate intercellular cross-talks and drug resistance mechanisms. Moreover, we defined a new parameter, the 'potential of death induction', which is computed in time and in space to quantify the impact of dying cells on neighbor cells. We found that, contrary to natural death, cancer death induced by chemotherapy or by CTL is transmissible, in that it promotes the death of nearby cancer cells, suggesting the release of diffusible factors which amplify the initial cytotoxic stimulus.

Oncoimmunology Meets Organs-on-Chip

Oncoimmunology represents a biomedical research discipline coined to study the roles of immune system in cancer progression with the aim of discovering novel strategies to arm it against the malignancy. Infiltration of immune cells within the tumor microenvironment is an early event that results in the establishment of a dynamic cross-talk. Here, immune cells sense antigenic cues to mount a specific anti-tumor response while cancer cells emanate inhibitory signals to dampen it. Animals models have led to giant steps in this research context, and several tools to investigate the effect of immune infiltration in the tumor microenvironment are currently available. However, the use of animals represents a challenge due to ethical issues and long duration of experiments. Organs-on-chip are innovative tools not only to study how cells derived from different organs interact with each other, but also to investigate on the crosstalk between immune cells and different types of cancer cells. In this review, we describe the state-of-the-art of microfluidics and the impact of OOC in the field of oncoimmunology underlining the importance of this system in the advancements on the complexity of tumor microenvironment.

Deciphering Cancer Cell Behavior From Motility and Shape Features: Peer Prediction and Dynamic Selection to Support Cancer Diagnosis and Therapy

Cell motility varies according to intrinsic features and microenvironmental stimuli, being a signature of underlying biological phenomena. The heterogeneity in cell response, due to multilevel cell diversity especially relevant in cancer, poses a challenge in identifying the biological scenario from cell trajectories. We propose here a novel peer prediction strategy among cell trajectories, deciphering cell state (tumor vs. nontumor), tumor stage, and response to the anticancer drug etoposide, based on morphology and motility features, solving the strong heterogeneity of individual cell properties. The proposed approach first barcodes cell trajectories, then automatically selects the good ones for optimal model construction (good teacher and test sample selection), and finally extracts a collective response from the heterogeneous populations via cooperative learning approaches, discriminating with high accuracy prostate noncancer vs. cancer cells of high vs. low malignancy. Comparison with standard classification methods validates our approach, which therefore represents a promising tool for addressing clinically relevant issues in cancer diagnosis and therapy, e.g., detection of potentially metastatic cells and anticancer drug screening.

Accelerating the experimental responses on cell behaviors: a long-term prediction of cell trajectories using Social Generative Adversarial Network

The incremented uptake provided by time-lapse microscopy in Organ-on-a-Chip (OoC) devices allowed increased attention to the dynamics of the co-cultured systems. However, the amount of information stored in long-time experiments may constitute a serious bottleneck of the experimental pipeline. Forward long-term prediction of cell trajectories may reduce the spatial–temporal burden of video sequences storage. Cell trajectory prediction becomes crucial especially to increase the trustworthiness in software tools designed to conduct a massive analysis of cell behavior under chemical stimuli. To address this task, we transpose here the exploitation of the presence of “social forces” from the human to the cellular level for motion prediction at microscale by adapting the potential of Social Generative Adversarial Network predictors to cell motility. To demonstrate the effectiveness of the approach, we consider here two case studies: one related to PC-3 prostate cancer cells cultured in 2D Petri dishes under control and treated conditions and one related to an OoC experiment of tumor-immune interaction in fibrosarcoma cells. The goodness of the proposed strategy has been verified by successfully comparing the distributions of common descriptors (kinematic descriptors and mean interaction time for the two scenarios respectively) from the trajectories obtained by video analysis and the predicted counterparts.

A Camera Sensors-Based System to Study Drug Effects On In Vitro Motility: The Case of PC-3 Prostate Cancer Cells

Cell motility is the brilliant result of cell status and its interaction with close environments. Its detection is now possible, thanks to the synergy of high-resolution camera sensors, time-lapse microscopy devices, and dedicated software tools for video and data analysis. In this scenario, we formulated a novel paradigm in which we considered the individual cells as a sort of sensitive element of a sensor, which exploits the camera as a transducer returning the movement of the cell as an output signal. In this way, cell movement allows us to retrieve information about the chemical composition of the close environment. To optimally exploit this information, in this work, we introduce a new setting, in which a cell trajectory is divided into sub-tracks, each one characterized by a specific motion kind. Hence, we considered all the sub-tracks of the single-cell trajectory as the signals of a virtual array of cell motility-based sensors. The kinematics of each sub-track is quantified and used for a classification task. To investigate the potential of the proposed approach, we have compared the achieved performances with those obtained by using a single-trajectory paradigm with the scope to evaluate the chemotherapy treatment effects on prostate cancer cells. Novel pattern recognition algorithms have been applied to the descriptors extracted at a sub-track level by implementing features, as well as samples selection (a good teacher learning approach) for model construction. The experimental results have put in evidence that the performances are higher when a further cluster majority role has been considered, by emulating a sort of sensor fusion procedure. All of these results highlighted the high strength of the proposed approach, and straightforwardly prefigure its use in lab-on-chip or organ-on-chip applications, where the cell motility analysis can be massively applied using time-lapse microscopy images.

From Petri Dishes to Organ on Chip Platform: The Increasing Importance of Machine Learning and Image Analysis

The increasing interest for microfluidic devices in medicine and biology has opened the way to new time-lapse microscopy era where the amount of images and their acquisition time will become crucial. In this optic, new data analysis algorithms have to be developed in order to extract novel features of cell behavior and cell-cell interactions. In this brief article, we emphasize the potential strength of a new paradigm arising in the integration of microfluidic devices (i.e., organ on chip), time-lapse microscopy analysis, and machine learning approaches. Some snapshots of previous case studies in the context of immunotherapy are included as proof of concepts of the proposed strategies while a visionary description concludes the work foreseeing future research and applicative scenarios.