1
|
Benfenati A. upU-Net Approaches for Background Emission Removal in Fluorescence Microscopy. J Imaging 2022; 8:142. [PMID: 35621906 PMCID: PMC9146274 DOI: 10.3390/jimaging8050142] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Revised: 05/17/2022] [Accepted: 05/18/2022] [Indexed: 11/29/2022] Open
Abstract
The physical process underlying microscopy imaging suffers from several issues: some of them include the blurring effect due to the Point Spread Function, the presence of Gaussian or Poisson noise, or even a mixture of these two types of perturbation. Among them, auto-fluorescence presents other artifacts in the registered image, and such fluorescence may be an important obstacle in correctly recognizing objects and organisms in the image. For example, particle tracking may suffer from the presence of this kind of perturbation. The objective of this work is to employ Deep Learning techniques, in the form of U-Nets like architectures, for background emission removal. Such fluorescence is modeled by Perlin noise, which reveals to be a suitable candidate for simulating such a phenomenon. The proposed architecture succeeds in removing the fluorescence, and at the same time, it acts as a denoiser for both Gaussian and Poisson noise. The performance of this approach is furthermore assessed on actual microscopy images and by employing the restored images for particle recognition.
Collapse
Affiliation(s)
- Alessandro Benfenati
- Environmental and Science Policy Department, Università degli Studi di Milano, Via Celoria 2, 20133 Milan, Italy;
- Gruppo Nazionale Calcolo Scientifico, Istituto Nazionale di Alta Matematica, P.le Aldo Moro 5, 00185 Rome, Italy
| |
Collapse
|
2
|
Sorokin DV, Peterlik I, Ulman V, Svoboda D, Necasova T, Morgaenko K, Eiselleova L, Tesarova L, Maska M. FiloGen: A Model-Based Generator of Synthetic 3-D Time-Lapse Sequences of Single Motile Cells With Growing and Branching Filopodia. IEEE TRANSACTIONS ON MEDICAL IMAGING 2018; 37:2630-2641. [PMID: 29994200 DOI: 10.1109/tmi.2018.2845884] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
The existence of diverse image datasets accompanied by reference annotations is a crucial prerequisite for an objective benchmarking of bioimage analysis methods. Nevertheless, such a prerequisite is hard to satisfy for time lapse, multidimensional fluorescence microscopy image data, manual annotations of which are laborious and often impracticable. In this paper, we present a simulation system capable of generating 3-D time-lapse sequences of single motile cells with filopodial protrusions of user-controlled structural and temporal attributes, such as the number, thickness, length, level of branching, and lifetime of filopodia, accompanied by inherently generated reference annotations. The proposed simulation system involves three globally synchronized modules, each being responsible for a separate task: the evolution of filopodia on a molecular level, linear elastic deformation of the entire cell with filopodia, and the synthesis of realistic, time-coherent cell texture. Its flexibility is demonstrated by generating multiple synthetic 3-D time-lapse sequences of single lung cancer cells of two different phenotypes, qualitatively and quantitatively resembling their real counterparts acquired using a confocal fluorescence microscope.
Collapse
|
3
|
Using simulated fluorescence cell micrographs for the evaluation of cell image segmentation algorithms. BMC Bioinformatics 2017; 18:176. [PMID: 28315633 PMCID: PMC5357336 DOI: 10.1186/s12859-017-1591-2] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2016] [Accepted: 03/09/2017] [Indexed: 11/29/2022] Open
Abstract
Background Manual assessment and evaluation of fluorescent micrograph cell experiments is time-consuming and tedious. Automated segmentation pipelines can ensure efficient and reproducible evaluation and analysis with constant high quality for all images of an experiment. Such cell segmentation approaches are usually validated and rated in comparison to manually annotated micrographs. Nevertheless, manual annotations are prone to errors and display inter- and intra-observer variability which influence the validation results of automated cell segmentation pipelines. Results We present a new approach to simulate fluorescent cell micrographs that provides an objective ground truth for the validation of cell segmentation methods. The cell simulation was evaluated twofold: (1) An expert observer study shows that the proposed approach generates realistic fluorescent cell micrograph simulations. (2) An automated segmentation pipeline on the simulated fluorescent cell micrographs reproduces segmentation performances of that pipeline on real fluorescent cell micrographs. Conclusion The proposed simulation approach produces realistic fluorescent cell micrographs with corresponding ground truth. The simulated data is suited to evaluate image segmentation pipelines more efficiently and reproducibly than it is possible on manually annotated real micrographs. Electronic supplementary material The online version of this article (doi:10.1186/s12859-017-1591-2) contains supplementary material, which is available to authorized users.
Collapse
|
4
|
Quantitative Co-Localization and Pattern Analysis of Endo-Lysosomal Cargo in Subcellular Image Cytometry and Validation on Synthetic Image Sets. Methods Mol Biol 2017; 1594:93-128. [PMID: 28456978 DOI: 10.1007/978-1-4939-6934-0_6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Late endosomes and lysosomes (LE/LYSs) play a central role in trafficking of endocytic cargo, secretion of exosomes, and hydrolysis of ingested proteins and lipids. Failure in such processes can lead to lysosomal storage disorders in which a particular metabolite accumulates within LE/LYSs. Analysis of endocytic trafficking relies heavily on quantitative fluorescence microscopy, but evaluation of the huge image data sets is challenging and demands computer-assisted statistical tools. Here, we describe how to use SpatTrack ( www.sdu.dk/bmb/spattrack ), an imaging toolbox, which we developed for quantification of the distribution and dynamics of endo-lysosomal cargo from fluorescence images of living cells. First, we explain how to analyze experimental images of endocytic processes in Niemann Pick C2 disease fibroblasts using SpatTrack. We demonstrate how to quantify the location of the sterol-binding protein NPC2 in LE/LYSs relative to cholesterol -rich lysosomal storage organelles (LSOs) stained with filipin. Second, we show how to simulate realistic vesicle patterns in the cell geometry using Markov Chain Monte Carlo and suitable inter-vesicle and cell-vesicle interaction potentials. Finally, we use such synthetic vesicle patterns as "ground truth" for validation of two-channel analysis tools in SpatTrack, revealing their high reliability. An improved version of SpatTrack for microscopy-based quantification of cargo transport through the endo-lysosomal system accompanies this protocol.
Collapse
|
5
|
Svoboda D, Ulman V. MitoGen: A Framework for Generating 3D Synthetic Time-Lapse Sequences of Cell Populations in Fluorescence Microscopy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:310-321. [PMID: 27623575 DOI: 10.1109/tmi.2016.2606545] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The proper analysis of biological microscopy images is an important and complex task. Therefore, it requires verification of all steps involved in the process, including image segmentation and tracking algorithms. It is generally better to verify algorithms with computer-generated ground truth datasets, which, compared to manually annotated data, nowadays have reached high quality and can be produced in large quantities even for 3D time-lapse image sequences. Here, we propose a novel framework, called MitoGen, which is capable of generating ground truth datasets with fully 3D time-lapse sequences of synthetic fluorescence-stained cell populations. MitoGen shows biologically justified cell motility, shape and texture changes as well as cell divisions. Standard fluorescence microscopy phenomena such as photobleaching, blur with real point spread function (PSF), and several types of noise, are simulated to obtain realistic images. The MitoGen framework is scalable in both space and time. MitoGen generates visually plausible data that shows good agreement with real data in terms of image descriptors and mean square displacement (MSD) trajectory analysis. Additionally, it is also shown in this paper that four publicly available segmentation and tracking algorithms exhibit similar performance on both real and MitoGen-generated data. The implementation of MitoGen is freely available.
Collapse
|
6
|
Ulman V, Svoboda D, Nykter M, Kozubek M, Ruusuvuori P. Virtual cell imaging: A review on simulation methods employed in image cytometry. Cytometry A 2016; 89:1057-1072. [PMID: 27922735 DOI: 10.1002/cyto.a.23031] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2016] [Revised: 07/20/2016] [Accepted: 11/14/2016] [Indexed: 02/03/2023]
Abstract
The simulations of cells and microscope images thereof have been used to facilitate the development, selection, and validation of image analysis algorithms employed in cytometry as well as for modeling and understanding cell structure and dynamics beyond what is visible in the eyepiece. The simulation approaches vary from simple parametric models of specific cell components-especially shapes of cells and cell nuclei-to learning-based synthesis and multi-stage simulation models for complex scenes that simultaneously visualize multiple object types and incorporate various properties of the imaged objects and laws of image formation. This review covers advances in artificial digital cell generation at scales ranging from particles up to tissue synthesis and microscope image simulation methods, provides examples of the use of simulated images for various purposes ranging from subcellular object detection to cell tracking, and discusses how such simulators have been validated. Finally, the future possibilities and limitations of simulation-based validation are considered. © 2016 International Society for Advancement of Cytometry.
Collapse
Affiliation(s)
- Vladimír Ulman
- Centre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic
| | - David Svoboda
- Centre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic
| | - Matti Nykter
- Institute of Biosciences and Medical Technology - BioMediTech, University of Tampere, Tampere, Finland
| | - Michal Kozubek
- Centre for Biomedical Image Analysis, Faculty of Informatics, Masaryk University, Brno, Czech Republic
| | - Pekka Ruusuvuori
- Institute of Biosciences and Medical Technology - BioMediTech, University of Tampere, Tampere, Finland.,Pori Campus, Tampere University of Technology, Pori, Finland
| |
Collapse
|
7
|
Köklü G, Ghaye J, Etienne-Cummings R, Leblebici Y, De Micheli G, Carrara S. Empowering Low-Cost CMOS Cameras by Image Processing to Reach Comparable Results with Costly CCDs. BIONANOSCIENCE 2013. [DOI: 10.1007/s12668-013-0106-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
|
8
|
Ghaye J, Kamat MA, Corbino-Giunta L, Silacci P, Vergères G, De Micheli G, Carrara S. Image thresholding techniques for localization of sub-resolution fluorescent biomarkers. Cytometry A 2013; 83:1001-16. [PMID: 24105983 DOI: 10.1002/cyto.a.22345] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2012] [Revised: 04/29/2013] [Accepted: 07/16/2013] [Indexed: 11/09/2022]
Abstract
In this article, we explore adaptive global and local segmentation techniques for a lab-on-chip nutrition monitoring system (NutriChip). The experimental setup consists of Caco-2 intestinal cells that can be artificially stimulated to trigger an immune response. The eventual response is optically monitored using immunofluoresence techniques targeting toll-like receptor 2 (TLR2). Two problems of interest need to be addressed by means of image processing. First, a new cell sample must be properly classified as stimulated or not. Second, the location of the stained TLR2 must be recovered in case the sample has been stimulated. The algorithmic approach to solving these problems is based on the ability of a segmentation technique to properly segment fluorescent spots. The sample classification is based on the amount and intensity of the segmented pixels, while the various segmenting blobs provide an approximate localization of TLR2. A novel local thresholding algorithm and three well-known spot segmentation techniques are compared in this study. Quantitative assessment of these techniques based on real and synthesized data demonstrates the improved segmentation capabilities of the proposed algorithm.
Collapse
Affiliation(s)
- Julien Ghaye
- Laboratory of Integrated Systems (LSI), Swiss Federal Institute of Technology, EPFL, Lausanne, Switzerland
| | | | | | | | | | | | | |
Collapse
|
9
|
Ramadan Q, Jafarpoorchekab H, Huang C, Silacci P, Carrara S, Koklü G, Ghaye J, Ramsden J, Ruffert C, Vergeres G, Gijs MAM. NutriChip: nutrition analysis meets microfluidics. LAB ON A CHIP 2013. [PMID: 23184124 DOI: 10.1039/c2lc40845g] [Citation(s) in RCA: 85] [Impact Index Per Article: 7.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
This focus article introduces the concept of NutriChip, an integrated microfluidic platform for investigating the potential of the immuno-modulatory function of dairy food. The core component of the NutriChip is a miniaturized artificial human gastrointestinal tract (GIT), which consists of a confluent layer of epithelial cells separated from a co-culture of immune cells by a permeable membrane. This setting creates conditions mimicking the human GIT and allows studying processes that characterize the passage of nutrients though the human GIT, including the activation of immune cells in response to the transfer of nutrients across the epithelial layer. The NutriChip project started by developing a biologically active in vitro cellular system in a commercial Transwell co-culture system. This Transwell system serves as a reference for the micro-scale device which is being developed. The microfluidic setup of NutriChip allows monitoring of the response of immune cells to pro-inflammatory stimuli, such as lipid polysaccharide (LPS), and to the application of potentially anti-inflammatory dairy food. This differential response will be quantified by measuring the variation in expression of pro-inflammatory cytokines, including interleukin 1 (IL-1) and interleukin 6 (IL-6), secreted by the immune cells, and this is achieved by using a dedicated optical imager. A series of dairy products will be screened for their anti-inflammatory properties using the NutriChip system and, finally, the outcome of the NutriChip will be validated by a human nutrition trial. Therefore, the NutriChip platform offers a new option to evaluate the influence of food quality on health, by monitoring the expression of relevant immune cell biomarkers.
Collapse
Affiliation(s)
- Qasem Ramadan
- Laboratory of Microsystems 2, Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
10
|
Abstract
Advances in food transformation have dramatically increased the diversity of products on the market and, consequently, exposed consumers to a complex spectrum of bioactive nutrients whose potential risks and benefits have mostly not been confidently demonstrated. Therefore, tools are needed to efficiently screen products for selected physiological properties before they enter the market. NutriChip is an interdisciplinary modular project funded by the Swiss programme Nano-Tera, which groups scientists from several areas of research with the aim of developing analytical strategies that will enable functional screening of foods. The project focuses on postprandial inflammatory stress, which potentially contributes to the development of chronic inflammatory diseases. The first module of the NutriChip project is composed of three in vitro biochemical steps that mimic the digestion process, intestinal absorption, and subsequent modulation of immune cells by the bioavailable nutrients. The second module is a miniaturised form of the first module (gut-on-a-chip) that integrates a microfluidic-based cell co-culture system and super-resolution imaging technologies to provide a physiologically relevant fluid flow environment and allows sensitive real-time analysis of the products screened in vitro. The third module aims at validating the in vitro screening model by assessing the nutritional properties of selected food products in humans. Because of the immunomodulatory properties of milk as well as its amenability to technological transformation, dairy products have been selected as model foods. The NutriChip project reflects the opening of food and nutrition sciences to state-of-the-art technologies, a key step in the translation of transdisciplinary knowledge into nutritional advice.
Collapse
|