1
|
Kitahara Y, Itani A, Ohtomo K, Oda Y, Takahashi Y, Okamura M, Mizoshiri M, Shida Y, Nakamura T, Harakawa R, Iwahashi M, Ogasawara W. The monitoring of oil production process by deep learning based on morphology in oleaginous yeasts. Appl Microbiol Biotechnol 2023; 107:915-929. [PMID: 36576569 DOI: 10.1007/s00253-022-12338-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2022] [Revised: 12/08/2022] [Accepted: 12/10/2022] [Indexed: 12/29/2022]
Abstract
BACKGROUND Monitoring jar fermenter-cultured microorganisms in real time is important for controlling productivity of bioproducts in large-scale cultivation settings. Morphological data is used to understand the growth and fermentation states of these microorganisms during monitoring. Oleaginous yeasts are used for their high productivity of single-cell oils but the relationship between lipid productivity and morphology has not been elucidated in these organisms. RESULTS In this study, we investigated the relationship between the morphology of oleaginous yeasts (Lipomyces starkeyi and Rhodosporidium toruloides were used) and their cultivation state in a large-scale cultivation setting using a real-time monitoring system. We combined this with deep learning by feeding a large amount of high-definition cell images obtained from the monitoring system to a deep learning algorithm. Our results showed that the cell images could be grouped into 7 distinct groups and that a strong correlation existed between each group and its biochemical activity (growth and oil-productivity). CONCLUSIONS This is the first report describing the morphological variations of oleaginous yeasts in a large-scale cultivation, and describes a promising new avenue for improving productivity of microorganisms in large-scale cultivation through the use of a real-time monitoring system combined with deep learning. KEY POINTS • A real-time monitoring system followed the morphological change of oleaginous yeasts. • Deep learning grouped them into 7 distinct groups based on their morphology. • A correlation between the cultivation state and the shape of the yeast was observed.
Collapse
Affiliation(s)
- Yukina Kitahara
- Department of Science of Technology Innovation, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Ayaka Itani
- Department of Bioengineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Kazuma Ohtomo
- Department of Information Science and Control Engineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Yosuke Oda
- Department of Mechanical Engineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Yuka Takahashi
- Department of Bioengineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Makoto Okamura
- NRI System Techno Ltd, 4-4-1 Minato Mirai, Nishi-Ku, Yokohama, 220-0012, Japan
| | - Mizue Mizoshiri
- Department of Mechanical Engineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Yosuke Shida
- Department of Bioengineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Toru Nakamura
- Department of Science of Technology Innovation, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Ryosuke Harakawa
- Department of Electrical Electronics and Information Engineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Masahiro Iwahashi
- Department of Electrical Electronics and Information Engineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan
| | - Wataru Ogasawara
- Department of Science of Technology Innovation, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan. .,Department of Bioengineering, Nagaoka University of Technology, 1603-1, Kamitomioka, Nagaoka, Niigata, 940-2188, Japan.
| |
Collapse
|
2
|
Chen N, Feng Z, Li F, Wang H, Yu R, Jiang J, Tang L, Rong P, Wang W. A fully automatic target detection and quantification strategy based on object detection convolutional neural network YOLOv3 for one-step X-ray image grading. ANALYTICAL METHODS : ADVANCING METHODS AND APPLICATIONS 2023; 15:164-170. [PMID: 36533422 DOI: 10.1039/d2ay01526a] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/17/2023]
Abstract
Methods for automatic image analysis are demanded for dealing with the explosively increased imaging data in clinics. Osteoarthritis (OA) is a typical disease diagnosed based on X-ray imaging. Herein, we propose a novel modeling strategy based on YOLO version 3 (YOLOv3) for automatic simultaneous localization of knee joints and quantification of radiographic knee OA. As an advanced deep convolutional neural network (CNN) algorithm for target detection, YOLOv3 enables simultaneous small object detection and quantification due to its unique residual connection and feature map merging. Hence, a unified CNN model is built for the elegant integration of knee joint detection and corresponding OA severity grading using the YOLOv3 framework. We achieve desirable accuracy in knee OA grading using the public and clinical datasets. It provides improvements in the precision, recall, F1 score and diagnostic accuracy of knee OA as well. Because of the fully automatic target detection and quantification, the time of handling an image is merely 40 ms from inputting the image to getting its label, supporting quick clinic decisions. It, thus, affords convenient and efficient image analysis for daily clinical diagnosis.
Collapse
Affiliation(s)
- Nan Chen
- State Key Laboratory of Chemo/Biosensing and Chemometrics, College of Chemistry and Chemical Engineering, Hunan University, Changsha 410082, China.
| | - Zhichao Feng
- Department of Radiology, The Third Xiangya Hospital, Central South University, Changsha 410013, China
| | - Fei Li
- College of Electrical and Information Engineering, Hunan University, Changsha 410082, China
| | - Haibo Wang
- State Key Laboratory of Chemo/Biosensing and Chemometrics, College of Chemistry and Chemical Engineering, Hunan University, Changsha 410082, China.
| | - Ruqin Yu
- State Key Laboratory of Chemo/Biosensing and Chemometrics, College of Chemistry and Chemical Engineering, Hunan University, Changsha 410082, China.
| | - Jianhui Jiang
- State Key Laboratory of Chemo/Biosensing and Chemometrics, College of Chemistry and Chemical Engineering, Hunan University, Changsha 410082, China.
| | - Lijuan Tang
- State Key Laboratory of Chemo/Biosensing and Chemometrics, College of Chemistry and Chemical Engineering, Hunan University, Changsha 410082, China.
| | - Pengfei Rong
- Department of Radiology, The Third Xiangya Hospital, Central South University, Changsha 410013, China
| | - Wei Wang
- Department of Radiology, The Third Xiangya Hospital, Central South University, Changsha 410013, China
| |
Collapse
|
3
|
Liang H, Cheng Z, Zhong H, Qu A, Chen L. A region-based convolutional network for nuclei detection and segmentation in microscopy images. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103276] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
|
4
|
|
5
|
Mota SM, Rogers RE, Haskell AW, McNeill EP, Kaunas R, Gregory CA, Giger ML, Maitland KC. Automated mesenchymal stem cell segmentation and machine learning-based phenotype classification using morphometric and textural analysis. J Med Imaging (Bellingham) 2021; 8:014503. [PMID: 33542945 PMCID: PMC7849042 DOI: 10.1117/1.jmi.8.1.014503] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2020] [Accepted: 01/11/2021] [Indexed: 01/22/2023] Open
Abstract
Purpose: Mesenchymal stem cells (MSCs) have demonstrated clinically relevant therapeutic effects for treatment of trauma and chronic diseases. The proliferative potential, immunomodulatory characteristics, and multipotentiality of MSCs in monolayer culture is reflected by their morphological phenotype. Standard techniques to evaluate culture viability are subjective, destructive, or time-consuming. We present an image analysis approach to objectively determine morphological phenotype of MSCs for prediction of culture efficacy. Approach: The algorithm was trained using phase-contrast micrographs acquired during the early and mid-logarithmic stages of MSC expansion. Cell regions are localized using edge detection, thresholding, and morphological operations, followed by cell marker identification using H-minima transform within each region to differentiate individual cells from cell clusters. Clusters are segmented using marker-controlled watershed to obtain single cells. Morphometric and textural features are extracted to classify cells based on phenotype using machine learning. Results: Algorithm performance was validated using an independent test dataset of 186 MSCs in 36 culture images. Results show 88% sensitivity and 86% precision for overall cell detection and a mean Sorensen-Dice coefficient of 0.849 ± 0.106 for segmentation per image. The algorithm exhibited an area under the curve of 0.816 (CI 95 = 0.769 to 0.886) and 0.787 (CI 95 = 0.716 to 0.851) for classifying MSCs according to their phenotype at early and mid-logarithmic expansion, respectively. Conclusions: The proposed method shows potential to segment and classify low and moderately dense MSCs based on phenotype with high accuracy and robustness. It enables quantifiable and consistent morphology-based quality assessment for various culture protocols to facilitate cytotherapy development.
Collapse
Affiliation(s)
- Sakina M. Mota
- Texas A&M University, Department of Biomedical Engineering, College Station, Texas, United States
| | - Robert E. Rogers
- Texas A&M Health Science Center, College of Medicine, Bryan, Texas, United States
| | - Andrew W. Haskell
- Texas A&M Health Science Center, College of Medicine, Bryan, Texas, United States
| | - Eoin P. McNeill
- Texas A&M Health Science Center, College of Medicine, Bryan, Texas, United States
| | - Roland Kaunas
- Texas A&M University, Department of Biomedical Engineering, College Station, Texas, United States
- Texas A&M Health Science Center, College of Medicine, Bryan, Texas, United States
| | - Carl A. Gregory
- Texas A&M Health Science Center, College of Medicine, Bryan, Texas, United States
| | - Maryellen L. Giger
- University of Chicago, Department of Radiology, Committee on Medical Physics, Chicago, Illinois, United States
| | - Kristen C. Maitland
- Texas A&M University, Department of Biomedical Engineering, College Station, Texas, United States
| |
Collapse
|
6
|
Alteration of cell motility dynamics through collagen fiber density in photopolymerized polyethylene glycol hydrogels. Int J Biol Macromol 2020; 157:414-423. [DOI: 10.1016/j.ijbiomac.2020.04.144] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2019] [Revised: 04/03/2020] [Accepted: 04/18/2020] [Indexed: 12/17/2022]
|
7
|
Hailstone M, Waithe D, Samuels TJ, Yang L, Costello I, Arava Y, Robertson E, Parton RM, Davis I. CytoCensus, mapping cell identity and division in tissues and organs using machine learning. eLife 2020; 9:e51085. [PMID: 32423529 PMCID: PMC7237217 DOI: 10.7554/elife.51085] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Accepted: 03/17/2020] [Indexed: 01/16/2023] Open
Abstract
A major challenge in cell and developmental biology is the automated identification and quantitation of cells in complex multilayered tissues. We developed CytoCensus: an easily deployed implementation of supervised machine learning that extends convenient 2D 'point-and-click' user training to 3D detection of cells in challenging datasets with ill-defined cell boundaries. In tests on such datasets, CytoCensus outperforms other freely available image analysis software in accuracy and speed of cell detection. We used CytoCensus to count stem cells and their progeny, and to quantify individual cell divisions from time-lapse movies of explanted Drosophila larval brains, comparing wild-type and mutant phenotypes. We further illustrate the general utility and future potential of CytoCensus by analysing the 3D organisation of multiple cell classes in Zebrafish retinal organoids and cell distributions in mouse embryos. CytoCensus opens the possibility of straightforward and robust automated analysis of developmental phenotypes in complex tissues.
Collapse
Affiliation(s)
- Martin Hailstone
- Department of Biochemistry, University of OxfordOxfordUnited Kingdom
| | - Dominic Waithe
- Wolfson Imaging Center & MRC WIMM Centre for Computational Biology MRC Weather all Institute of Molecular Medicine University of OxfordOxfordUnited Kingdom
| | - Tamsin J Samuels
- Department of Biochemistry, University of OxfordOxfordUnited Kingdom
| | - Lu Yang
- Department of Biochemistry, University of OxfordOxfordUnited Kingdom
| | - Ita Costello
- The Dunn School of Pathology,University of OxfordOxfordUnited Kingdom
| | - Yoav Arava
- Department of Biology, Technion - Israel Institute of TechnologyHaifaIsrael
| | | | - Richard M Parton
- Department of Biochemistry, University of OxfordOxfordUnited Kingdom
- Micron Advanced Bioimaging Unit, Department of Biochemistry, University of OxfordOxfordUnited Kingdom
| | - Ilan Davis
- Department of Biochemistry, University of OxfordOxfordUnited Kingdom
- Micron Advanced Bioimaging Unit, Department of Biochemistry, University of OxfordOxfordUnited Kingdom
| |
Collapse
|
8
|
Kleinhans DS, Lecaudey V. Standardized mounting method of (zebrafish) embryos using a 3D-printed stamp for high-content, semi-automated confocal imaging. BMC Biotechnol 2019; 19:68. [PMID: 31640669 PMCID: PMC6805687 DOI: 10.1186/s12896-019-0558-y] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2019] [Accepted: 09/04/2019] [Indexed: 01/24/2023] Open
Abstract
Background Developmental biology relies to a large extent on the observation and comparison of phenotypic traits through time using high resolution microscopes. In this context, transparent model organisms such as the zebrafish Danio rerio in which developing tissues and organs can be easily observed and imaged using fluorescent proteins have become very popular. One limiting factor however is the acquisition of a sufficient amount of data, in standardized and reproducible conditions, to allow robust quantitative analysis. One way to improve this is by developing mounting methods to increase the number of embryos that can be imaged simultaneously in near-to-identical orientation. Results Here we present an improved mounting method allowing semi-automated and high-content imaging of zebrafish embryos. It is based on a 3D-printed stamp which is used to create a 2D coordinate system of multiple μ-wells in an agarose cast. Each μ-well models a negative of the average zebrafish embryo morphology between 22 and 96 h-post-fertilization. Due to this standardized and reproducible arrangement, it is possible to define a custom well plate in the respective imaging software that allows for a semi-automated imaging process. Furthermore, the improvement in Z-orientation significantly reduces post-processing and improves comparability of volumetric data while reducing light exposure and thus photo-bleaching and photo-toxicity, and improving signal-to-noise ratio (SNR). Conclusions We present here a new method that allows to standardize and improve mounting and imaging of embryos. The 3D-printed stamp creates a 2D coordinate system of μ-wells in an agarose cast thus standardizing specimen mounting and allowing high-content imaging of up to 44 live or mounted zebrafish embryos simultaneously in a semi-automated, well-plate like manner on inverted confocal microscopes. In summary, image data quality and acquisition efficiency (amount of data per time) are significantly improved. The latter might also be crucial when using the services of a microscopy facility.
Collapse
Affiliation(s)
- David Simon Kleinhans
- Department of Developmental Biology of Vertebrates, Institute for Cell biology and Neuroscience, Goethe University, Max-von-Laue-Str. 13, 60438, Frankfurt am Main, Germany
| | - Virginie Lecaudey
- Department of Developmental Biology of Vertebrates, Institute for Cell biology and Neuroscience, Goethe University, Max-von-Laue-Str. 13, 60438, Frankfurt am Main, Germany.
| |
Collapse
|
9
|
Xing F, Xie Y, Shi X, Chen P, Zhang Z, Yang L. Towards pixel-to-pixel deep nucleus detection in microscopy images. BMC Bioinformatics 2019; 20:472. [PMID: 31521104 PMCID: PMC6744696 DOI: 10.1186/s12859-019-3037-5] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2018] [Accepted: 08/21/2019] [Indexed: 12/21/2022] Open
Abstract
BACKGROUND Nucleus is a fundamental task in microscopy image analysis and supports many other quantitative studies such as object counting, segmentation, tracking, etc. Deep neural networks are emerging as a powerful tool for biomedical image computing; in particular, convolutional neural networks have been widely applied to nucleus/cell detection in microscopy images. However, almost all models are tailored for specific datasets and their applicability to other microscopy image data remains unknown. Some existing studies casually learn and evaluate deep neural networks on multiple microscopy datasets, but there are still several critical, open questions to be addressed. RESULTS We analyze the applicability of deep models specifically for nucleus detection across a wide variety of microscopy image data. More specifically, we present a fully convolutional network-based regression model and extensively evaluate it on large-scale digital pathology and microscopy image datasets, which consist of 23 organs (or cancer diseases) and come from multiple institutions. We demonstrate that for a specific target dataset, training with images from the same types of organs might be usually necessary for nucleus detection. Although the images can be visually similar due to the same staining technique and imaging protocol, deep models learned with images from different organs might not deliver desirable results and would require model fine-tuning to be on a par with those trained with target data. We also observe that training with a mixture of target and other/non-target data does not always mean a higher accuracy of nucleus detection, and it might require proper data manipulation during model training to achieve good performance. CONCLUSIONS We conduct a systematic case study on deep models for nucleus detection in a wide variety of microscopy images, aiming to address several important but previously understudied questions. We present and extensively evaluate an end-to-end, pixel-to-pixel fully convolutional regression network and report a few significant findings, some of which might have not been reported in previous studies. The model performance analysis and observations would be helpful to nucleus detection in microscopy images.
Collapse
Affiliation(s)
- Fuyong Xing
- Department of Biostatistics and Informatics, and the Data Science to Patient Value initiative, University of Colorado Anschutz Medical Campus, 13001 E 17th Pl, Aurora, Colorado 80045, United States
| | - Yuanpu Xie
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Gainesville, Florida 32611, United States
| | - Xiaoshuang Shi
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Gainesville, Florida 32611, United States
| | - Pingjun Chen
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Gainesville, Florida 32611, United States
| | - Zizhao Zhang
- Department of Computer and Information Science and Engineering, University of Florida, 432 Newell Drive, Gainesville, Florida 32611, United States
| | - Lin Yang
- J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida, 1275 Center Drive, Gainesville, Florida 32611, United States
- Department of Computer and Information Science and Engineering, University of Florida, 432 Newell Drive, Gainesville, Florida 32611, United States
| |
Collapse
|
10
|
Svensson CM, Shvydkiv O, Dietrich S, Mahler L, Weber T, Choudhary M, Tovar M, Figge MT, Roth M. Coding of Experimental Conditions in Microfluidic Droplet Assays Using Colored Beads and Machine Learning Supported Image Analysis. SMALL (WEINHEIM AN DER BERGSTRASSE, GERMANY) 2019; 15:e1802384. [PMID: 30549235 DOI: 10.1002/smll.201802384] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/21/2018] [Revised: 10/16/2018] [Indexed: 06/09/2023]
Abstract
To efficiently exploit the potential of several millions of droplets that can be considered as individual bioreactors in microfluidic experiments, methods to encode different experimental conditions in droplets are needed. The approach presented here is based on coencapsulation of colored polystyrene beads with biological samples. The decoding of the droplets, as well as content quantification, are performed by automated analysis of triggered images of individual droplets in-flow using bright-field microscopy. The decoding strategy combines bead classification using a random forest classifier and Bayesian inference to identify different codes and thus experimental conditions. Antibiotic susceptibility testing of nine different antibiotics and the determination of the minimal inhibitory concentration of a specific antibiotic against a laboratory strain of Escherichia coli are presented as a proof-of-principle. It is demonstrated that this method allows successful encoding and decoding of 20 different experimental conditions within a large droplet population of more than 105 droplets per condition. The decoding strategy correctly assigns 99.6% of droplets to the correct condition and a method for the determination of minimal inhibitory concentration using droplet microfluidics is established. The current encoding and decoding pipeline can readily be extended to more codes by adding more bead colors or color combinations.
Collapse
Affiliation(s)
- Carl-Magnus Svensson
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
| | - Oksana Shvydkiv
- Bio Pilot Plant, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
| | - Stefanie Dietrich
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
- Faculty of Biological Sciences, Friedrich Schiller University, 07743, Jena, Germany
| | - Lisa Mahler
- Bio Pilot Plant, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
- Faculty of Biological Sciences, Friedrich Schiller University, 07743, Jena, Germany
| | - Thomas Weber
- Bio Pilot Plant, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
| | - Mahipal Choudhary
- Bio Pilot Plant, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
| | - Miguel Tovar
- Bio Pilot Plant, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
- Faculty of Biological Sciences, Friedrich Schiller University, 07743, Jena, Germany
| | - Marc Thilo Figge
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
- Faculty of Biological Sciences, Friedrich Schiller University, 07743, Jena, Germany
| | - Martin Roth
- Bio Pilot Plant, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute, 07745, Jena, Germany
| |
Collapse
|
11
|
Abstract
The study of intracellular dynamic processes is of fundamental importance for understanding a wide variety of diseases and developing effective drugs and therapies. Advanced fluorescence microscopy imaging systems nowadays allow the recording of virtually any type of process in space and time with super-resolved detail and with high sensitivity and specificity. The large volume and high information content of the resulting image data, and the desire to obtain objective, quantitative descriptions and biophysical models of the processes of interest, require a high level of automation in data analysis. Two key tasks in extracting biologically meaningful information about intracellular dynamics from image data are particle tracking and particle trajectory analysis. Here we present state-of-the-art software tools for these tasks and describe how to use them.
Collapse
|
12
|
Svensson CM, Medyukhina A, Belyaev I, Al-Zaben N, Figge MT. Untangling cell tracks: Quantifying cell migration by time lapse image data analysis. Cytometry A 2017; 93:357-370. [DOI: 10.1002/cyto.a.23249] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/15/2022]
Affiliation(s)
- Carl-Magnus Svensson
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute (HKI); Jena Germany
| | - Anna Medyukhina
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute (HKI); Jena Germany
| | - Ivan Belyaev
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute (HKI); Jena Germany
- Friedrich Schiller University; Jena Germany
| | - Naim Al-Zaben
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute (HKI); Jena Germany
- Friedrich Schiller University; Jena Germany
| | - Marc Thilo Figge
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology, Hans Knöll Institute (HKI); Jena Germany
- Friedrich Schiller University; Jena Germany
| |
Collapse
|
13
|
Caudron Q, Garnier R, Pilkington JG, Watt KA, Hansen C, Grenfell BT, Aboellail T, Graham AL. Robust extraction of quantitative structural information from high-variance histological images of livers from necropsied Soay sheep. ROYAL SOCIETY OPEN SCIENCE 2017; 4:170111. [PMID: 28791138 PMCID: PMC5541533 DOI: 10.1098/rsos.170111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/06/2017] [Accepted: 06/23/2017] [Indexed: 06/07/2023]
Abstract
Quantitative information is essential to the empirical analysis of biological systems. In many such systems, spatial relations between anatomical structures is of interest, making imaging a valuable data acquisition tool. However, image data can be difficult to analyse quantitatively. Many image processing algorithms are highly sensitive to variations in the image, limiting their current application to fields where sample and image quality may be very high. Here, we develop robust image processing algorithms for extracting structural information from a dataset of high-variance histological images of inflamed liver tissue obtained during necropsies of wild Soay sheep. We demonstrate that features of the data can be measured in a fully automated manner, providing quantitative information which can be readily used in statistical analysis. We show that these methods provide measures that correlate well with a manual, expert operator-led analysis of the same images, that they provide advantages in terms of sampling a wider range of information and that information can be extracted far more quickly than in manual analysis.
Collapse
Affiliation(s)
- Q. Caudron
- Department of Ecology and Evolutionary Biology, Princeton University, Princeton, NJ, USA
| | - R. Garnier
- Department of Ecology and Evolutionary Biology, Princeton University, Princeton, NJ, USA
| | - J. G. Pilkington
- Institute of Evolutionary Biology, School of Biological Sciences, University of Edinburgh, Edinburgh, UK
| | - K. A. Watt
- Institute of Evolutionary Biology, School of Biological Sciences, University of Edinburgh, Edinburgh, UK
| | - C. Hansen
- Department of Ecology and Evolutionary Biology, Princeton University, Princeton, NJ, USA
| | - B. T. Grenfell
- Department of Ecology and Evolutionary Biology, Princeton University, Princeton, NJ, USA
| | - T. Aboellail
- Department of Microbiology, Immunology and Pathology, Colorado State University, Fort Collins, CO, USA
| | - A. L. Graham
- Department of Ecology and Evolutionary Biology, Princeton University, Princeton, NJ, USA
| |
Collapse
|
14
|
Criscenti G, Vasilevich A, Longoni A, De Maria C, van Blitterswijk CA, Truckenmuller R, Vozzi G, De Boer J, Moroni L. 3D screening device for the evaluation of cell response to different electrospun microtopographies. Acta Biomater 2017; 55:310-322. [PMID: 28373083 DOI: 10.1016/j.actbio.2017.03.049] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2016] [Revised: 03/04/2017] [Accepted: 03/27/2017] [Indexed: 12/28/2022]
Abstract
Micro- and nano-topographies of scaffold surfaces play a pivotal role in tissue engineering applications, influencing cell behavior such as adhesion, orientation, alignment, morphology and proliferation. In this study, a novel microfabrication method based on the combination of soft-lithography and electrospinning for the production of micro-patterned electrospun scaffolds was proposed. Subsequently, a 3D screening device for electrospun meshes with different micro-topographies was designed, fabricated and biologically validated. Results indicated that the use of defined patterns could induce specific morphological variations in human mesenchymal stem cell cytoskeletal organization, which could be related to differential activity of signaling pathways. STATEMENT OF SIGNIFICANCE We introduce a novel and time saving method to fabricate 3D micropatterns with controlled micro-architectures on electrospun meshes using a custom made collector and a PDMS mold with the desired topography. A possible application of this fabrication technique is represented by a 3D screening system for patterned electrospun meshes that allows the screening of different scaffold/electrospun parameters on cell activity. In addition, what we have developed in this study could be modularly applied to existing platforms. Considering the different patterned geometries, the cell morphological data indicated a change in the cytoskeletal organization with a close correspondence to the patterns, as shown by phenoplot and boxplot analysis, and might hint at the differential activity of cell signaling. The 3D screening system proposed in this study could be used to evaluate topographies favoring cell alignment, proliferation and functional performance, and has the potential to be upscaled for high-throughput.
Collapse
Affiliation(s)
- G Criscenti
- Department of Tissue Regeneration, MIRA Institute for Biomedical Technology and Technical Medicine, Faculty of Science and Technology, University of Twente, Enschede, The Netherlands; Research Center "E. Piaggio", Faculty of Engineering, University of Pisa, Pisa, Italy
| | - A Vasilevich
- Department of Tissue Regeneration, MIRA Institute for Biomedical Technology and Technical Medicine, Faculty of Science and Technology, University of Twente, Enschede, The Netherlands; Department of Cell Biology Inspired Tissue Engineering, MERLN Institute for Technology Inspired Regenerative Medicine, Maastricht University, Maastricht, The Netherlands
| | - A Longoni
- Department of Tissue Regeneration, MIRA Institute for Biomedical Technology and Technical Medicine, Faculty of Science and Technology, University of Twente, Enschede, The Netherlands
| | - C De Maria
- Research Center "E. Piaggio", Faculty of Engineering, University of Pisa, Pisa, Italy
| | - C A van Blitterswijk
- Department of Tissue Regeneration, MIRA Institute for Biomedical Technology and Technical Medicine, Faculty of Science and Technology, University of Twente, Enschede, The Netherlands; Department of Complex Tissue Regeneration, MERLN Institute for Technology Inspired Regenerative Medicine, Maastricht University, Maastricht, The Netherlands
| | - R Truckenmuller
- Department of Tissue Regeneration, MIRA Institute for Biomedical Technology and Technical Medicine, Faculty of Science and Technology, University of Twente, Enschede, The Netherlands; Department of Complex Tissue Regeneration, MERLN Institute for Technology Inspired Regenerative Medicine, Maastricht University, Maastricht, The Netherlands
| | - G Vozzi
- Research Center "E. Piaggio", Faculty of Engineering, University of Pisa, Pisa, Italy
| | - J De Boer
- Department of Tissue Regeneration, MIRA Institute for Biomedical Technology and Technical Medicine, Faculty of Science and Technology, University of Twente, Enschede, The Netherlands; Department of Cell Biology Inspired Tissue Engineering, MERLN Institute for Technology Inspired Regenerative Medicine, Maastricht University, Maastricht, The Netherlands
| | - L Moroni
- Department of Tissue Regeneration, MIRA Institute for Biomedical Technology and Technical Medicine, Faculty of Science and Technology, University of Twente, Enschede, The Netherlands; Department of Complex Tissue Regeneration, MERLN Institute for Technology Inspired Regenerative Medicine, Maastricht University, Maastricht, The Netherlands.
| |
Collapse
|
15
|
Grah JS, Harrington JA, Koh SB, Pike JA, Schreiner A, Burger M, Schönlieb CB, Reichelt S. Mathematical imaging methods for mitosis analysis in live-cell phase contrast microscopy. Methods 2017; 115:91-99. [PMID: 28189773 PMCID: PMC6414815 DOI: 10.1016/j.ymeth.2017.02.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2016] [Revised: 02/04/2017] [Accepted: 02/06/2017] [Indexed: 11/25/2022] Open
Abstract
In this paper we propose a workflow to detect and track mitotic cells in time-lapse microscopy image sequences. In order to avoid the requirement for cell lines expressing fluorescent markers and the associated phototoxicity, phase contrast microscopy is often preferred over fluorescence microscopy in live-cell imaging. However, common specific image characteristics complicate image processing and impede use of standard methods. Nevertheless, automated analysis is desirable due to manual analysis being subjective, biased and extremely time-consuming for large data sets. Here, we present the following workflow based on mathematical imaging methods. In the first step, mitosis detection is performed by means of the circular Hough transform. The obtained circular contour subsequently serves as an initialisation for the tracking algorithm based on variational methods. It is sub-divided into two parts: in order to determine the beginning of the whole mitosis cycle, a backwards tracking procedure is performed. After that, the cell is tracked forwards in time until the end of mitosis. As a result, the average of mitosis duration and ratios of different cell fates (cell death, no division, division into two or more daughter cells) can be measured and statistics on cell morphologies can be obtained. All of the tools are featured in the user-friendly MATLAB®Graphical User Interface MitosisAnalyser.
Collapse
Affiliation(s)
- Joana Sarah Grah
- University of Cambridge, Department of Applied Mathematics and Theoretical Physics, Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB3 0WA, United Kingdom.
| | - Jennifer Alison Harrington
- University of Cambridge, Cancer Research UK Cambridge Institute, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, United Kingdom
| | - Siang Boon Koh
- University of Cambridge, Cancer Research UK Cambridge Institute, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, United Kingdom
| | - Jeremy Andrew Pike
- University of Cambridge, Cancer Research UK Cambridge Institute, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, United Kingdom
| | - Alexander Schreiner
- University of Cambridge, Cancer Research UK Cambridge Institute, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, United Kingdom
| | - Martin Burger
- Westfälische Wilhelms-Universität Münster, Institute for Computational and Applied Mathematics, Einsteinstrasse 62, 48149 Münster, Germany
| | - Carola-Bibiane Schönlieb
- University of Cambridge, Department of Applied Mathematics and Theoretical Physics, Centre for Mathematical Sciences, Wilberforce Road, Cambridge CB3 0WA, United Kingdom
| | - Stefanie Reichelt
- University of Cambridge, Cancer Research UK Cambridge Institute, Li Ka Shing Centre, Robinson Way, Cambridge CB2 0RE, United Kingdom
| |
Collapse
|
16
|
Nketia TA, Sailem H, Rohde G, Machiraju R, Rittscher J. Analysis of live cell images: Methods, tools and opportunities. Methods 2017; 115:65-79. [DOI: 10.1016/j.ymeth.2017.02.007] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2016] [Revised: 02/20/2017] [Accepted: 02/21/2017] [Indexed: 01/19/2023] Open
|
17
|
Li C, Huang X, Jiang T, Xu N. Full-automatic computer aided system for stem cell clustering using content-based microscopic image analysis. Biocybern Biomed Eng 2017. [DOI: 10.1016/j.bbe.2017.01.004] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
|
18
|
Svoboda D, Ulman V. MitoGen: A Framework for Generating 3D Synthetic Time-Lapse Sequences of Cell Populations in Fluorescence Microscopy. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:310-321. [PMID: 27623575 DOI: 10.1109/tmi.2016.2606545] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
The proper analysis of biological microscopy images is an important and complex task. Therefore, it requires verification of all steps involved in the process, including image segmentation and tracking algorithms. It is generally better to verify algorithms with computer-generated ground truth datasets, which, compared to manually annotated data, nowadays have reached high quality and can be produced in large quantities even for 3D time-lapse image sequences. Here, we propose a novel framework, called MitoGen, which is capable of generating ground truth datasets with fully 3D time-lapse sequences of synthetic fluorescence-stained cell populations. MitoGen shows biologically justified cell motility, shape and texture changes as well as cell divisions. Standard fluorescence microscopy phenomena such as photobleaching, blur with real point spread function (PSF), and several types of noise, are simulated to obtain realistic images. The MitoGen framework is scalable in both space and time. MitoGen generates visually plausible data that shows good agreement with real data in terms of image descriptors and mean square displacement (MSD) trajectory analysis. Additionally, it is also shown in this paper that four publicly available segmentation and tracking algorithms exhibit similar performance on both real and MitoGen-generated data. The implementation of MitoGen is freely available.
Collapse
|
19
|
Kraibooj K, Schoeler H, Svensson CM, Brakhage AA, Figge MT. Automated quantification of the phagocytosis of Aspergillus fumigatus conidia by a novel image analysis algorithm. Front Microbiol 2015; 6:549. [PMID: 26106370 PMCID: PMC4460560 DOI: 10.3389/fmicb.2015.00549] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2015] [Accepted: 05/19/2015] [Indexed: 12/03/2022] Open
Abstract
Studying the pathobiology of the fungus Aspergillus fumigatus has gained a lot of attention in recent years. This is due to the fact that this fungus is a human pathogen that can cause severe diseases, like invasive pulmonary aspergillosis in immunocompromised patients. Because alveolar macrophages belong to the first line of defense against the fungus, here, we conduct an image-based study on the host-pathogen interaction between murine alveolar macrophages and A. fumigatus. This is achieved by an automated image analysis approach that uses a combination of thresholding, watershed segmentation and feature-based object classification. In contrast to previous approaches, our algorithm allows for the segmentation of individual macrophages in the images and this enables us to compute the distribution of phagocytosed and macrophage-adherent conidia over all macrophages. The novel automated image-based analysis provides access to all cell-cell interactions in the assay and thereby represents a framework that enables comprehensive computation of diverse characteristic parameters and comparative investigation for different strains. We here apply automated image analysis to confocal laser scanning microscopy images of the two wild-type strains ATCC 46645 and CEA10 of A. fumigatus and investigate the ability of macrophages to phagocytose the respective conidia. It is found that the CEA10 strain triggers a stronger response of the macrophages as revealed by a higher phagocytosis ratio and a larger portion of the macrophages being active in the phagocytosis process.
Collapse
Affiliation(s)
- Kaswara Kraibooj
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology - Hans Knöll Institute Jena, Germany ; Faculty of Biology and Pharmacy, Friedrich Schiller University Jena Jena, Germany
| | - Hanno Schoeler
- Faculty of Biology and Pharmacy, Friedrich Schiller University Jena Jena, Germany ; Department of Molecular and Applied Microbiology, Leibniz Institute for Natural Product Research and Infection Biology - Hans Knöll Institute Jena, Germany
| | - Carl-Magnus Svensson
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology - Hans Knöll Institute Jena, Germany
| | - Axel A Brakhage
- Faculty of Biology and Pharmacy, Friedrich Schiller University Jena Jena, Germany ; Department of Molecular and Applied Microbiology, Leibniz Institute for Natural Product Research and Infection Biology - Hans Knöll Institute Jena, Germany
| | - Marc Thilo Figge
- Applied Systems Biology, Leibniz Institute for Natural Product Research and Infection Biology - Hans Knöll Institute Jena, Germany ; Faculty of Biology and Pharmacy, Friedrich Schiller University Jena Jena, Germany
| |
Collapse
|
20
|
Yin Z, Su H, Ker E, Li M, Li H. Cell-sensitive phase contrast microscopy imaging by multiple exposures. Med Image Anal 2015; 25:111-21. [PMID: 25977155 DOI: 10.1016/j.media.2015.04.011] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2014] [Revised: 03/29/2015] [Accepted: 04/09/2015] [Indexed: 11/17/2022]
Abstract
We propose a novel way of imaging live cells in a Petri dish by the phase contrast microscope. By taking multiple exposures of phase contrast microscopy images on the same cell dish, we estimate a cell-sensitive camera response function which responds to cells' irradiance signals but generates a constant on non-cell background signal. The result of this new microscopy imaging is visually superior quality, which reveals the appearance details of cells and suppresses background noise near zero. Using the cell-sensitive microscopy imaging, cells' original irradiance signals are restored from all exposures and the irradiance signals on non-cell background regions are restored as a uniform constant (i.e., the imaging system is sensitive to cells only but insensitive to non-cell background). The restored irradiance signals greatly facilitate the cell segmentation by simple thresholding. The experimental results validate that high quality cell segmentation can be achieved by our approach.
Collapse
Affiliation(s)
- Zhaozheng Yin
- Missouri University of Science and Technology, Rolla, MO 65409 USA.
| | | | | | - Mingzhong Li
- Missouri University of Science and Technology, Rolla, MO 65409 USA
| | - Haohan Li
- Missouri University of Science and Technology, Rolla, MO 65409 USA
| |
Collapse
|
21
|
Brandes S, Mokhtari Z, Essig F, Hünniger K, Kurzai O, Figge MT. Automated segmentation and tracking of non-rigid objects in time-lapse microscopy videos of polymorphonuclear neutrophils. Med Image Anal 2015; 20:34-51. [DOI: 10.1016/j.media.2014.10.002] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/23/2014] [Revised: 09/28/2014] [Accepted: 10/11/2014] [Indexed: 11/30/2022]
|
22
|
Medyukhina A, Timme S, Mokhtari Z, Figge MT. Image-based systems biology of infection. Cytometry A 2015; 87:462-70. [PMID: 25641512 DOI: 10.1002/cyto.a.22638] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2014] [Revised: 01/05/2015] [Accepted: 01/07/2015] [Indexed: 12/21/2022]
Abstract
The successful treatment of infectious diseases requires interdisciplinary studies of all aspects of infection processes. The overarching combination of experimental research and theoretical analysis in a systems biology approach can unravel mechanisms of complex interactions between pathogens and the human immune system. Taking into account spatial information is especially important in the context of infection, since the migratory behavior and spatial interactions of cells are often decisive for the outcome of the immune response. Spatial information is provided by image and video data that are acquired in microscopy experiments and that are at the heart of an image-based systems biology approach. This review demonstrates how image-based systems biology improves our understanding of infection processes. We discuss the three main steps of this approach--imaging, quantitative characterization, and modeling--and consider the application of these steps in the context of studying infection processes. After summarizing the most relevant microscopy and image analysis approaches, we discuss ways to quantify infection processes, and address a number of modeling techniques that exploit image-derived data to simulate host-pathogen interactions in silico.
Collapse
Affiliation(s)
- Anna Medyukhina
- Applied Systems Biology, HKI-Center for Systems Biology of Infection, Leibniz-Institute for Natural Product Research and Infection Biology, Hans-Knöll-Institute (HKI), Jena, Germany
| | - Sandra Timme
- Applied Systems Biology, HKI-Center for Systems Biology of Infection, Leibniz-Institute for Natural Product Research and Infection Biology, Hans-Knöll-Institute (HKI), Jena, Germany.,Applied Systems Biology, Friedrich Schiller University, Jena, Germany
| | - Zeinab Mokhtari
- Applied Systems Biology, HKI-Center for Systems Biology of Infection, Leibniz-Institute for Natural Product Research and Infection Biology, Hans-Knöll-Institute (HKI), Jena, Germany.,Applied Systems Biology, Friedrich Schiller University, Jena, Germany
| | - Marc Thilo Figge
- Applied Systems Biology, HKI-Center for Systems Biology of Infection, Leibniz-Institute for Natural Product Research and Infection Biology, Hans-Knöll-Institute (HKI), Jena, Germany.,Applied Systems Biology, Friedrich Schiller University, Jena, Germany
| |
Collapse
|
23
|
Harder N, Batra R, Diessl N, Gogolin S, Eils R, Westermann F, König R, Rohr K. Large-scale tracking and classification for automatic analysis of cell migration and proliferation, and experimental optimization of high-throughput screens of neuroblastoma cells. Cytometry A 2015; 87:524-40. [DOI: 10.1002/cyto.a.22632] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Affiliation(s)
- Nathalie Harder
- Department of Bioinformatics and Functional Genomics; Biomedical Computer Vision Group, BioQuant and Institute of Pharmacy and Molecular Biotechnology (IPMB), Heidelberg University; 69120 Heidelberg Germany
- Division of Theoretical Bioinformatics; German Cancer Research Center (DKFZ); 69120 Heidelberg Germany
| | - Richa Batra
- Division of Theoretical Bioinformatics; German Cancer Research Center (DKFZ); 69120 Heidelberg Germany
| | - Nicolle Diessl
- Division of Theoretical Bioinformatics; German Cancer Research Center (DKFZ); 69120 Heidelberg Germany
| | - Sina Gogolin
- Division of Neuroblastoma Genomics; German Cancer Research Center (DKFZ); 69120 Heidelberg Germany
| | - Roland Eils
- Department of Bioinformatics and Functional Genomics; Biomedical Computer Vision Group, BioQuant and Institute of Pharmacy and Molecular Biotechnology (IPMB), Heidelberg University; 69120 Heidelberg Germany
- Division of Theoretical Bioinformatics; German Cancer Research Center (DKFZ); 69120 Heidelberg Germany
| | - Frank Westermann
- Division of Neuroblastoma Genomics; German Cancer Research Center (DKFZ); 69120 Heidelberg Germany
| | - Rainer König
- Division of Theoretical Bioinformatics; German Cancer Research Center (DKFZ); 69120 Heidelberg Germany
- Integrated Research and Treatment Center, Center for Sepsis Control and Care (CSCC), Jena University Hospital; 07747 Jena Germany
- Network Modeling, Leibniz Institute for Natural Product Research and Infection Biology - Hans Knöll Institute Jena; 07745 Jena Germany
| | - Karl Rohr
- Department of Bioinformatics and Functional Genomics; Biomedical Computer Vision Group, BioQuant and Institute of Pharmacy and Molecular Biotechnology (IPMB), Heidelberg University; 69120 Heidelberg Germany
- Division of Theoretical Bioinformatics; German Cancer Research Center (DKFZ); 69120 Heidelberg Germany
| |
Collapse
|
24
|
Yin Z, Su H, Ker E, Li M, Li H. Cell-sensitive microscopy imaging for cell image segmentation. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2014; 17:41-8. [PMID: 25333099 DOI: 10.1007/978-3-319-10404-1_6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/21/2023]
Abstract
We propose a novel cell segmentation approach by estimating a cell-sensitive camera response function based on variously exposed phase contrast microscopy images on the same cell dish. Using the cell-sensitive microscopy imaging, cells' original irradiance signals are restored from all exposures and the irradiance signals on non-cell background regions are restored as a uniform constant (i.e., the imaging system is sensitive to cells only but insensitive to non-cell background). Cell segmentation is then performed on the restored irradiance signals by simple thresholding. The experimental results validate that high quality cell segmentation can be achieved by our approach.
Collapse
|
25
|
El-Labban A, Zisserman A, Toyoda Y, Bird A, Hyman A. Temporal models for mitotic phase labelling. Med Image Anal 2014; 18:977-88. [DOI: 10.1016/j.media.2014.05.003] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2013] [Revised: 05/03/2014] [Accepted: 05/07/2014] [Indexed: 11/28/2022]
|
26
|
Bühnemann C, Li S, Yu H, Branford White H, Schäfer KL, Llombart-Bosch A, Machado I, Picci P, Hogendoorn PCW, Athanasou NA, Noble JA, Hassan AB. Quantification of the heterogeneity of prognostic cellular biomarkers in ewing sarcoma using automated image and random survival forest analysis. PLoS One 2014; 9:e107105. [PMID: 25243408 PMCID: PMC4171480 DOI: 10.1371/journal.pone.0107105] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2014] [Accepted: 08/12/2014] [Indexed: 02/05/2023] Open
Abstract
Driven by genomic somatic variation, tumour tissues are typically heterogeneous, yet unbiased quantitative methods are rarely used to analyse heterogeneity at the protein level. Motivated by this problem, we developed automated image segmentation of images of multiple biomarkers in Ewing sarcoma to generate distributions of biomarkers between and within tumour cells. We further integrate high dimensional data with patient clinical outcomes utilising random survival forest (RSF) machine learning. Using material from cohorts of genetically diagnosed Ewing sarcoma with EWSR1 chromosomal translocations, confocal images of tissue microarrays were segmented with level sets and watershed algorithms. Each cell nucleus and cytoplasm were identified in relation to DAPI and CD99, respectively, and protein biomarkers (e.g. Ki67, pS6, Foxo3a, EGR1, MAPK) localised relative to nuclear and cytoplasmic regions of each cell in order to generate image feature distributions. The image distribution features were analysed with RSF in relation to known overall patient survival from three separate cohorts (185 informative cases). Variation in pre-analytical processing resulted in elimination of a high number of non-informative images that had poor DAPI localisation or biomarker preservation (67 cases, 36%). The distribution of image features for biomarkers in the remaining high quality material (118 cases, 104 features per case) were analysed by RSF with feature selection, and performance assessed using internal cross-validation, rather than a separate validation cohort. A prognostic classifier for Ewing sarcoma with low cross-validation error rates (0.36) was comprised of multiple features, including the Ki67 proliferative marker and a sub-population of cells with low cytoplasmic/nuclear ratio of CD99. Through elimination of bias, the evaluation of high-dimensionality biomarker distribution within cell populations of a tumour using random forest analysis in quality controlled tumour material could be achieved. Such an automated and integrated methodology has potential application in the identification of prognostic classifiers based on tumour cell heterogeneity.
Collapse
Affiliation(s)
- Claudia Bühnemann
- CR-UK, Tumour Growth Group, Oxford Molecular Pathology Institute, Sir William Dunn School of Pathology, University of Oxford, Oxford, United Kingdom
| | - Simon Li
- Institute of Biomedical Engineering, Department of Engineering Science, Old Road Campus Research Building, University of Oxford, Headington, Oxford, United Kingdom
| | - Haiyue Yu
- CR-UK, Tumour Growth Group, Oxford Molecular Pathology Institute, Sir William Dunn School of Pathology, University of Oxford, Oxford, United Kingdom; Institute of Biomedical Engineering, Department of Engineering Science, Old Road Campus Research Building, University of Oxford, Headington, Oxford, United Kingdom
| | - Harriet Branford White
- CR-UK, Tumour Growth Group, Oxford Molecular Pathology Institute, Sir William Dunn School of Pathology, University of Oxford, Oxford, United Kingdom
| | - Karl L Schäfer
- Institute of Pathology, Heinrich-Heine University, Medical Faculty, Düsseldorf, Germany
| | | | - Isidro Machado
- Pathology Department, University of Valencia, Valencia, Spain
| | - Piero Picci
- Research, The Rizzoli Institute, Bologna, Italy
| | | | - Nicholas A Athanasou
- Nuffield Department of Orthopaedics, Rheumatology and Musculoskeletal Sciences, Nuffield Orthopaedic Centre, University of Oxford, Oxford, United Kingdom
| | - J Alison Noble
- Institute of Biomedical Engineering, Department of Engineering Science, Old Road Campus Research Building, University of Oxford, Headington, Oxford, United Kingdom
| | - A Bassim Hassan
- CR-UK, Tumour Growth Group, Oxford Molecular Pathology Institute, Sir William Dunn School of Pathology, University of Oxford, Oxford, United Kingdom
| |
Collapse
|
27
|
Neurient: an algorithm for automatic tracing of confluent neuronal images to determine alignment. J Neurosci Methods 2013; 214:210-22. [PMID: 23384629 DOI: 10.1016/j.jneumeth.2013.01.023] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2012] [Revised: 01/25/2013] [Accepted: 01/25/2013] [Indexed: 01/08/2023]
Abstract
A goal of neural tissue engineering is the development and evaluation of materials that guide neuronal growth and alignment. However, the methods available to quantitatively evaluate the response of neurons to guidance materials are limited and/or expensive, and may require manual tracing to be performed by the researcher. We have developed an open source, automated Matlab-based algorithm, building on previously published methods, to trace and quantify alignment of fluorescent images of neurons in culture. The algorithm is divided into three phases, including computation of a lookup table which contains directional information for each image, location of a set of seed points which may lie along neurite centerlines, and tracing neurites starting with each seed point and indexing into the lookup table. This method was used to obtain quantitative alignment data for complex images of densely cultured neurons. Complete automation of tracing allows for unsupervised processing of large numbers of images. Following image processing with our algorithm, available metrics to quantify neurite alignment include angular histograms, percent of neurite segments in a given direction, and mean neurite angle. The alignment information obtained from traced images can be used to compare the response of neurons to a range of conditions. This tracing algorithm is freely available to the scientific community under the name Neurient, and its implementation in Matlab allows a wide range of researchers to use a standardized, open source method to quantitatively evaluate the alignment of dense neuronal cultures.
Collapse
|
28
|
Abstract
We propose a method that automatically tracks and segments living cells in phase-contrast image sequences, especially for cells that deform and interact with each other or clutter. We formulate the problem as a many-to-one elastic partial matching problem between closed curves. We introduce Double Cyclic Dynamic Time Warping for the scenario where a collision event yields a single boundary that encloses multiple touching cells and that needs to be cut into separate cell boundaries. The resulting individual boundaries may consist of segments to be connected to produce closed curves that match well with the individual cell boundaries before the collision event. We show how to convert this partial-curve matching problem into a shortest path problem that we then solve efficiently by reusing the computed shortest path tree. We also use our shortest path algorithm to fill the gaps between the segments of the target curves. Quantitative results demonstrate the benefit of our method by showing maintained accurate recognition of individual cell boundaries across 8068 images containing multiple cell interactions.
Collapse
|
29
|
Nandy K, Gudla PR, Amundsen R, Meaburn KJ, Misteli T, Lockett SJ. Automatic segmentation and supervised learning-based selection of nuclei in cancer tissue images. Cytometry A 2012; 81:743-54. [PMID: 22899462 PMCID: PMC6362837 DOI: 10.1002/cyto.a.22097] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2012] [Revised: 05/18/2012] [Accepted: 06/12/2012] [Indexed: 01/14/2023]
Abstract
Analysis of preferential localization of certain genes within the cell nuclei is emerging as a new technique for the diagnosis of breast cancer. Quantitation requires accurate segmentation of 100-200 cell nuclei in each tissue section to draw a statistically significant result. Thus, for large-scale analysis, manual processing is too time consuming and subjective. Fortuitously, acquired images generally contain many more nuclei than are needed for analysis. Therefore, we developed an integrated workflow that selects, following automatic segmentation, a subpopulation of accurately delineated nuclei for positioning of fluorescence in situ hybridization-labeled genes of interest. Segmentation was performed by a multistage watershed-based algorithm and screening by an artificial neural network-based pattern recognition engine. The performance of the workflow was quantified in terms of the fraction of automatically selected nuclei that were visually confirmed as well segmented and by the boundary accuracy of the well-segmented nuclei relative to a 2D dynamic programming-based reference segmentation method. Application of the method was demonstrated for discriminating normal and cancerous breast tissue sections based on the differential positioning of the HES5 gene. Automatic results agreed with manual analysis in 11 out of 14 cancers, all four normal cases, and all five noncancerous breast disease cases, thus showing the accuracy and robustness of the proposed approach.
Collapse
Affiliation(s)
- Kaustav Nandy
- Optical Microscopy and Analysis Laboratory, Advanced Technology Program, SAIC-Frederick, Inc., Frederick National Laboratory for Cancer Research, Frederick, Maryland 21702, USA.
| | | | | | | | | | | |
Collapse
|
30
|
|
31
|
Integrated genetic and computation methods for in planta cytometry. Nat Methods 2012; 9:483-5. [DOI: 10.1038/nmeth.1940] [Citation(s) in RCA: 69] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2011] [Accepted: 02/02/2012] [Indexed: 11/08/2022]
|
32
|
Yin Z, Kanade T, Chen M. Understanding the phase contrast optics to restore artifact-free microscopy images for segmentation. Med Image Anal 2012; 16:1047-62. [PMID: 22386070 DOI: 10.1016/j.media.2011.12.006] [Citation(s) in RCA: 58] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2011] [Revised: 08/23/2011] [Accepted: 12/18/2011] [Indexed: 10/14/2022]
Abstract
Phase contrast, a noninvasive microscopy imaging technique, is widely used to capture time-lapse images to monitor the behavior of transparent cells without staining or altering them. Due to the optical principle, phase contrast microscopy images contain artifacts such as the halo and shade-off that hinder image segmentation, a critical step in automated microscopy image analysis. Rather than treating phase contrast microscopy images as general natural images and applying generic image processing techniques on them, we propose to study the optical properties of the phase contrast microscope to model its image formation process. The phase contrast imaging system can be approximated by a linear imaging model. Based on this model and input image properties, we formulate a regularized quadratic cost function to restore artifact-free phase contrast images that directly correspond to the specimen's optical path length. With artifacts removed, high quality segmentation can be achieved by simply thresholding the restored images. The imaging model and restoration method are quantitatively evaluated on microscopy image sequences with thousands of cells captured over several days. We also demonstrate that accurate restoration lays the foundation for high performance in cell detection and tracking.
Collapse
Affiliation(s)
- Zhaozheng Yin
- Department of Computer Science, Missouri University of Science and Technology, United States.
| | | | | |
Collapse
|
33
|
|
34
|
Oheim M. Advances and challenges in high-throughput microscopy for live-cell subcellular imaging. Expert Opin Drug Discov 2011; 6:1299-315. [DOI: 10.1517/17460441.2011.637105] [Citation(s) in RCA: 12] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
Affiliation(s)
- Martin Oheim
- INSERM U603, CNRS UMR 8154, Université Paris Descartes, PRES Sorbonne Paris Cité, Laboratory of Neurophysiology and New Microscopies, F-75006 Paris, France ;
| |
Collapse
|
35
|
Abstract
Methods to quantify cellular-level phenotypic differences between genetic groups are a key tool in genomics research. In disease processes such as cancer, phenotypic changes at the cellular level frequently manifest in the modification of cell population profiles. These changes are hard to detect due the ambiguity in identifying distinct cell phenotypes within a population. We present a methodology which enables the detection of such changes by generating a phenotypic signature of cell populations in a data-derived feature-space. Further, this signature is used to estimate a model for the redistribution of phenotypes that was induced by the genetic change. Results are presented on an experiment involving deletion of a tumor-suppressor gene dominant in breast cancer, where the methodology is used to detect changes in nuclear morphology between control and knockout groups.
Collapse
|
36
|
Light microscopic analysis of mitochondrial heterogeneity in cell populations and within single cells. ADVANCES IN BIOCHEMICAL ENGINEERING/BIOTECHNOLOGY 2010; 124:1-19. [PMID: 21072702 DOI: 10.1007/10_2010_81] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
Abstract
Heterogeneity in the shapes of individual multicellular organisms is a daily experience. Likewise, even a quick glance through the ocular of a light microscope reveals the morphological heterogeneities in genetically identical cultured cells, whereas heterogeneities on the level of the organelles are much less obvious. This short review focuses on intracellular heterogeneities at the example of the mitochondria and their analysis by fluorescence microscopy. The overall mitochondrial shape as well as mitochondrial dynamics can be studied by classical (fluorescence) light microscopy. However, with an organelle diameter generally close to the resolution limit of light, the heterogeneities within mitochondria cannot be resolved with conventional light microscopy. Therefore, we briefly discuss here the potential of subdiffraction light microscopy (nanoscopy) to study inner-mitochondrial heterogeneities.
Collapse
|