Learning Cancer-Related Drug Efficacy Exploiting Consensus in Coordinated Motility Within Cell Clusters

Cell Electrokinetic Fingerprint: A Novel Approach Based on Optically Induced Dielectrophoresis (ODEP) for In-Flow Identification of Single Cells

A novel optically induced dielectrophoresis (ODEP) system that can operate under flow conditions is designed for automatic trapping of cells and subsequent induction of 2D multi-frequency cell trajectories. Like in a "ping-pong" match, two virtual electrode barriers operate in an alternate mode with varying frequencies of the input voltage. The so-derived cell motions are characterized via time-lapse microscopy, cell tracking, and state-of-the-art machine learning algorithms, like the wavelet scattering transform (WST). As a cell-electrokinetic fingerprint, the dynamic of variation of the cell displacements happening, over time, is quantified in response to different frequency values of the induced electric field. When tested on two biological scenarios in the cancer domain, the proposed approach discriminates cellular dielectric phenotypes obtained, respectively, at different early phases of drug-induced apoptosis in prostate cancer (PC3) cells and for differential expression of the lectine-like oxidized low-density lipoprotein receptor-1 (LOX-1) transcript levels in human colorectal adenocarcinoma (DLD-1) cells. The results demonstrate increased discrimination of the proposed system and pose an additional basis for making ODEP-based assays addressing cancer heterogeneity for precision medicine and pharmacological research.

Deep-Manager: a versatile tool for optimal feature selection in live-cell imaging analysis

One of the major problems in bioimaging, often highly underestimated, is whether features extracted for a discrimination or regression task will remain valid for a broader set of similar experiments or in the presence of unpredictable perturbations during the image acquisition process. Such an issue is even more important when it is addressed in the context of deep learning features due to the lack of a priori known relationship between the black-box descriptors (deep features) and the phenotypic properties of the biological entities under study. In this regard, the widespread use of descriptors, such as those coming from pre-trained Convolutional Neural Networks (CNNs), is hindered by the fact that they are devoid of apparent physical meaning and strongly subjected to unspecific biases, i.e., features that do not depend on the cell phenotypes, but rather on acquisition artifacts, such as brightness or texture changes, focus shifts, autofluorescence or photobleaching. The proposed Deep-Manager software platform offers the possibility to efficiently select those features having lower sensitivity to unspecific disturbances and, at the same time, a high discriminating power. Deep-Manager can be used in the context of both handcrafted and deep features. The unprecedented performances of the method are proven using five different case studies, ranging from selecting handcrafted green fluorescence protein intensity features in chemotherapy-related breast cancer cell death investigation to addressing problems related to the context of Deep Transfer Learning. Deep-Manager, freely available at https://github.com/BEEuniroma2/Deep-Manager , is suitable for use in many fields of bioimaging and is conceived to be constantly upgraded with novel image acquisition perturbations and modalities.

Machine learning phenomics (MLP) combining deep learning with time-lapse-microscopy for monitoring colorectal adenocarcinoma cells gene expression and drug-response

High-throughput phenotyping is becoming increasingly available thanks to analytical and bioinformatics approaches that enable the use of very high-dimensional data and to the availability of dynamic models that link phenomena across levels: from genes to cells, from cells to organs, and through the whole organism. The combination of phenomics, deep learning, and machine learning represents a strong potential for the phenotypical investigation, leading the way to a more embracing approach, called machine learning phenomics (MLP). In particular, in this work we present a novel MLP platform for phenomics investigation of cancer-cells response to therapy, exploiting and combining the potential of time-lapse microscopy for cell behavior data acquisition and robust deep learning software architectures for the latent phenotypes extraction. A two-step proof of concepts is designed. First, we demonstrate a strict correlation among gene expression and cell phenotype with the aim to identify new biomarkers and targets for tailored therapy in human colorectal cancer onset and progression. Experiments were conducted on human colorectal adenocarcinoma cells (DLD-1) and their profile was compared with an isogenic line in which the expression of LOX-1 transcript was knocked down. In addition, we also evaluate the phenotypic impact of the administration of different doses of an antineoplastic drug over DLD-1 cells. Under the omics paradigm, proteomics results are used to confirm the findings of the experiments.

Combining microfluidics with machine learning algorithms for RBC classification in rare hereditary hemolytic anemia

Combining microfluidics technology with machine learning represents an innovative approach to conduct massive quantitative cell behavior study and implement smart decision-making systems in support of clinical diagnostics. The spleen plays a key-role in rare hereditary hemolytic anemia (RHHA), being the organ responsible for the premature removal of defective red blood cells (RBCs). The goal is to adapt the physiological spleen filtering strategy for in vitro study and monitoring of blood diseases through RBCs shape analysis. Then, a microfluidic device mimicking the slits of the spleen red pulp area and video data analysis are combined for the characterization of RBCs in RHHA. This microfluidic unit is designed to evaluate RBC deformability by maintaining them fixed in planar orientation, allowing the visual inspection of RBC’s capacity to restore their original shape after crossing microconstrictions. Then, two cooperative learning approaches are used for the analysis: the majority voting scheme, in which the most voted label for all the cell images is the class assigned to the entire video; and the maximum sum of scores to decide the maximally scored class to assign. The proposed platform shows the capability to discriminate healthy controls and patients with an average efficiency of 91%, but also to distinguish between RHHA subtypes, with an efficiency of 82%.

Recursive Deep Prior Video: A super resolution algorithm for time-lapse microscopy of organ-on-chip experiments

Biological experiments based on organ-on-chips (OOCs) exploit light Time-Lapse Microscopy (TLM) for a direct observation of cell movement that is an observable signature of underlying biological processes. A high spatial resolution is essential to capture cell dynamics and interactions from recorded experiments by TLM. Unfortunately, due to physical and cost limitations, acquiring high resolution videos is not always possible. To overcome the problem, we present here a new deep learning-based algorithm that extends the well-known Deep Image Prior (DIP) to TLM Video Super Resolution without requiring any training. The proposed Recursive Deep Prior Video method introduces some novelties. The weights of the DIP network architecture are initialized for each of the frames according to a new recursive updating rule combined with an efficient early stopping criterion. Moreover, the DIP loss function is penalized by two different Total Variation-based terms. The method has been validated on synthetic, i.e., artificially generated, as well as real videos from OOC experiments related to tumor-immune interaction. The achieved results are compared with several state-of-the-art trained deep learning Super Resolution algorithms showing outstanding performances.

NeuriTES. Monitoring neurite changes through transfer entropy and semantic segmentation in bright-field time-lapse microscopy

One of the most challenging frontiers in biological systems understanding is fluorescent label-free imaging. We present here the NeuriTES platform that revisits the standard paradigms of video analysis to detect unlabeled objects and adapt to the dynamic evolution of the phenomenon under observation. Object segmentation is reformulated using robust algorithms to assure regular cell detection and transfer entropy measures are used to study the inter-relationship among the parameters related to the evolving system. We applied the NeuriTES platform to the automatic analysis of neurites degeneration in presence of amyotrophic lateral sclerosis (ALS) and to the study of the effects of a chemotherapy drug on living prostate cancer cells (PC3) cultures. Control cells have been considered in both the two cases study. Accuracy values of 93% and of 92% are achieved, respectively. NeuriTES not only represents a tool for investigation in fluorescent label-free images but demonstrates to be adaptable to individual needs.

•

Monitoring of cell phenotype changes by fluorescence label-free time-lapse microscopy

•

Adaptive semantic segmentation for the robust detection of cell shape

•

TE to correlate morphological and textural soma descriptors along time

•

Directed TE graph for the representation of mutual relationship among descriptors

One of the most challenging frontiers for the automatic understanding of biological systems is fluorescent label-free imaging in which the behavior changes of living being are characterized without cell staining. To this aim, we present here the NeuriTES platform that revisits standard paradigms of video analysis to detect unlabeled objects and correlate the analysis to phenotype evolution of the mechanisms under observation. Through the exploitation of adaptive algorithms and of transfer entropy measures, the platform assures regular cell detection and the possibility to extract reliable parameters related to the evolving cell system. As a proof-of-concept, NeuriTES is applied to two fascinating phenotype investigation scenarios, amyotrophic lateral sclerosis (ALS) disease mechanism and the study of the effects of a chemotherapy drug on living prostate cancer cells (PC3) cultures. Directed graphs assist the biologists with a visual understanding of the mechanisms identified.

Apoptosis mapping in space and time of 3D tumor ecosystems reveals transmissibility of cytotoxic cancer death

The emerging tumor-on-chip (ToC) approaches allow to address biomedical questions out of reach with classical cell culture techniques: in biomimetic 3D hydrogels they partially reconstitute ex vivo the complexity of the tumor microenvironment and the cellular dynamics involving multiple cell types (cancer cells, immune cells, fibroblasts, etc.). However, a clear bottleneck is the extraction and interpretation of the rich biological information contained, sometime hidden, in the cell co-culture videos. In this work, we develop and apply novel video analysis algorithms to automatically measure the cytotoxic effects on human cancer cells (lung and breast) induced either by doxorubicin chemotherapy drug or by autologous tumor-infiltrating cytotoxic T lymphocytes (CTL). A live fluorescent dye (red) is used to selectively pre-stain the cancer cells before co-cultures and a live fluorescent reporter for caspase activity (green) is used to monitor apoptotic cell death. The here described open-source computational method, named STAMP (spatiotemporal apoptosis mapper), extracts the temporal kinetics and the spatial maps of cancer death, by localizing and tracking cancer cells in the red channel, and by counting the red to green transition signals, over 2-3 days. The robustness and versatility of the method is demonstrated by its application to different cell models and co-culture combinations. Noteworthy, this approach reveals the strong contribution of primary cancer-associated fibroblasts (CAFs) to breast cancer chemo-resistance, proving to be a powerful strategy to investigate intercellular cross-talks and drug resistance mechanisms. Moreover, we defined a new parameter, the 'potential of death induction', which is computed in time and in space to quantify the impact of dying cells on neighbor cells. We found that, contrary to natural death, cancer death induced by chemotherapy or by CTL is transmissible, in that it promotes the death of nearby cancer cells, suggesting the release of diffusible factors which amplify the initial cytotoxic stimulus.

Deciphering Cancer Cell Behavior From Motility and Shape Features: Peer Prediction and Dynamic Selection to Support Cancer Diagnosis and Therapy

Cell motility varies according to intrinsic features and microenvironmental stimuli, being a signature of underlying biological phenomena. The heterogeneity in cell response, due to multilevel cell diversity especially relevant in cancer, poses a challenge in identifying the biological scenario from cell trajectories. We propose here a novel peer prediction strategy among cell trajectories, deciphering cell state (tumor vs. nontumor), tumor stage, and response to the anticancer drug etoposide, based on morphology and motility features, solving the strong heterogeneity of individual cell properties. The proposed approach first barcodes cell trajectories, then automatically selects the good ones for optimal model construction (good teacher and test sample selection), and finally extracts a collective response from the heterogeneous populations via cooperative learning approaches, discriminating with high accuracy prostate noncancer vs. cancer cells of high vs. low malignancy. Comparison with standard classification methods validates our approach, which therefore represents a promising tool for addressing clinically relevant issues in cancer diagnosis and therapy, e.g., detection of potentially metastatic cells and anticancer drug screening.

Accelerating the experimental responses on cell behaviors: a long-term prediction of cell trajectories using Social Generative Adversarial Network

The incremented uptake provided by time-lapse microscopy in Organ-on-a-Chip (OoC) devices allowed increased attention to the dynamics of the co-cultured systems. However, the amount of information stored in long-time experiments may constitute a serious bottleneck of the experimental pipeline. Forward long-term prediction of cell trajectories may reduce the spatial–temporal burden of video sequences storage. Cell trajectory prediction becomes crucial especially to increase the trustworthiness in software tools designed to conduct a massive analysis of cell behavior under chemical stimuli. To address this task, we transpose here the exploitation of the presence of “social forces” from the human to the cellular level for motion prediction at microscale by adapting the potential of Social Generative Adversarial Network predictors to cell motility. To demonstrate the effectiveness of the approach, we consider here two case studies: one related to PC-3 prostate cancer cells cultured in 2D Petri dishes under control and treated conditions and one related to an OoC experiment of tumor-immune interaction in fibrosarcoma cells. The goodness of the proposed strategy has been verified by successfully comparing the distributions of common descriptors (kinematic descriptors and mean interaction time for the two scenarios respectively) from the trajectories obtained by video analysis and the predicted counterparts.

Discovering the hidden messages within cell trajectories using a deep learning approach for in vitro evaluation of cancer drug treatments

We describe a novel method to achieve a universal, massive, and fully automated analysis of cell motility behaviours, starting from time-lapse microscopy images. The approach was inspired by the recent successes in application of machine learning for style recognition in paintings and artistic style transfer. The originality of the method relies i) on the generation of atlas from the collection of single-cell trajectories in order to visually encode the multiple descriptors of cell motility, and ii) on the application of pre-trained Deep Learning Convolutional Neural Network architecture in order to extract relevant features to be used for classification tasks from this visual atlas. Validation tests were conducted on two different cell motility scenarios: 1) a 3D biomimetic gels of immune cells, co-cultured with breast cancer cells in organ-on-chip devices, upon treatment with an immunotherapy drug; 2) Petri dishes of clustered prostate cancer cells, upon treatment with a chemotherapy drug. For each scenario, single-cell trajectories are very accurately classified according to the presence or not of the drugs. This original approach demonstrates the existence of universal features in cell motility (a so called “motility style”) which are identified by the DL approach in the rationale of discovering the unknown message in cell trajectories.

A Camera Sensors-Based System to Study Drug Effects On In Vitro Motility: The Case of PC-3 Prostate Cancer Cells

Cell motility is the brilliant result of cell status and its interaction with close environments. Its detection is now possible, thanks to the synergy of high-resolution camera sensors, time-lapse microscopy devices, and dedicated software tools for video and data analysis. In this scenario, we formulated a novel paradigm in which we considered the individual cells as a sort of sensitive element of a sensor, which exploits the camera as a transducer returning the movement of the cell as an output signal. In this way, cell movement allows us to retrieve information about the chemical composition of the close environment. To optimally exploit this information, in this work, we introduce a new setting, in which a cell trajectory is divided into sub-tracks, each one characterized by a specific motion kind. Hence, we considered all the sub-tracks of the single-cell trajectory as the signals of a virtual array of cell motility-based sensors. The kinematics of each sub-track is quantified and used for a classification task. To investigate the potential of the proposed approach, we have compared the achieved performances with those obtained by using a single-trajectory paradigm with the scope to evaluate the chemotherapy treatment effects on prostate cancer cells. Novel pattern recognition algorithms have been applied to the descriptors extracted at a sub-track level by implementing features, as well as samples selection (a good teacher learning approach) for model construction. The experimental results have put in evidence that the performances are higher when a further cluster majority role has been considered, by emulating a sort of sensor fusion procedure. All of these results highlighted the high strength of the proposed approach, and straightforwardly prefigure its use in lab-on-chip or organ-on-chip applications, where the cell motility analysis can be massively applied using time-lapse microscopy images.

High-throughput analysis of cell-cell crosstalk in ad hoc designed microfluidic chips for oncoimmunology applications

Understanding the interactions between immune and cancer cells occurring within the tumor microenvironment is a prerequisite for successful and personalized anti-cancer therapies. Microfluidic devices, coupled to advanced microscopy systems and automated analytical tools, can represent an innovative approach for high-throughput investigations on immune cell-cancer interactions. In order to study such interactions and to evaluate how therapeutic agents can affect this crosstalk, we employed two ad hoc fabricated microfluidic platforms reproducing advanced 2D or 3D tumor immune microenvironments. In the first type of chip, we confronted the capacity of tumor cells embedded in Matrigel containing one drug or Matrigel containing a combination of two drugs to attract differentially immune cells, by fluorescence microscopy analyses. In the second chip, we investigated the migratory/interaction response of naïve immune cells to danger signals emanated from tumor cells treated with an immunogenic drug, by time-lapse microscopy and automated tracking analysis. We demonstrate that microfluidic platforms and their associated high-throughput computed analyses can represent versatile and smart systems to: (i) monitor and quantify the recruitment and interactions of the immune cells with cancer in a controlled environment, (ii) evaluate the immunogenic effects of anti-cancer therapeutic agents and (iii) evaluate the immunogenic efficacy of combinatorial regimens with respect to single agents.

From Petri Dishes to Organ on Chip Platform: The Increasing Importance of Machine Learning and Image Analysis

The increasing interest for microfluidic devices in medicine and biology has opened the way to new time-lapse microscopy era where the amount of images and their acquisition time will become crucial. In this optic, new data analysis algorithms have to be developed in order to extract novel features of cell behavior and cell-cell interactions. In this brief article, we emphasize the potential strength of a new paradigm arising in the integration of microfluidic devices (i.e., organ on chip), time-lapse microscopy analysis, and machine learning approaches. Some snapshots of previous case studies in the context of immunotherapy are included as proof of concepts of the proposed strategies while a visionary description concludes the work foreseeing future research and applicative scenarios.