51
|
Ren J, Karagoz K, Gatza ML, Singer EA, Sadimin E, Foran DJ, Qi X. Recurrence analysis on prostate cancer patients with Gleason score 7 using integrated histopathology whole-slide images and genomic data through deep neural networks. J Med Imaging (Bellingham) 2018; 5:047501. [PMID: 30840742 PMCID: PMC6237203 DOI: 10.1117/1.jmi.5.4.047501] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2018] [Accepted: 10/23/2018] [Indexed: 12/22/2022] Open
Abstract
Prostate cancer is the most common nonskin-related cancer, affecting one in seven men in the United States. Gleason score, a sum of the primary and secondary Gleason patterns, is one of the best predictors of prostate cancer outcomes. Recently, significant progress has been made in molecular subtyping prostate cancer through the use of genomic sequencing. It has been established that prostate cancer patients presented with a Gleason score 7 show heterogeneity in both disease recurrence and survival. We built a unified system using publicly available whole-slide images and genomic data of histopathology specimens through deep neural networks to identify a set of computational biomarkers. Using a survival model, the experimental results on the public prostate dataset showed that the computational biomarkers extracted by our approach had hazard ratio as 5.73 and C -index as 0.74, which were higher than standard clinical prognostic factors and other engineered image texture features. Collectively, the results of this study highlight the important role of neural network analysis of prostate cancer and the potential of such approaches in other precision medicine applications.
Collapse
Affiliation(s)
- Jian Ren
- Rutgers, the State University of New Jersey, Department of Electrical and Computer Engineering, Piscataway, New Jersey, United States
| | - Kubra Karagoz
- Rutgers Cancer Institute of New Jersey, Department of Radiation Oncology, New Brunswick, New Jersey, United States
| | - Michael L. Gatza
- Rutgers Cancer Institute of New Jersey, Department of Radiation Oncology, New Brunswick, New Jersey, United States
| | - Eric A. Singer
- Rutgers Cancer Institute of New Jersey, Section of Urologic Oncology, New Brunswick, New Jersey, United States
| | - Evita Sadimin
- Rutgers Cancer Institute of New Jersey, Department of Pathology and Laboratory Medicine, New Brunswick, New Jersey, United States
| | - David J. Foran
- Rutgers Cancer Institute of New Jersey, Department of Pathology and Laboratory Medicine, New Brunswick, New Jersey, United States
| | - Xin Qi
- Rutgers Cancer Institute of New Jersey, Department of Pathology and Laboratory Medicine, New Brunswick, New Jersey, United States
| |
Collapse
|
52
|
Roy S, Kumar Jain A, Lal S, Kini J. A study about color normalization methods for histopathology images. Micron 2018; 114:42-61. [PMID: 30096632 DOI: 10.1016/j.micron.2018.07.005] [Citation(s) in RCA: 67] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2018] [Revised: 07/07/2018] [Accepted: 07/16/2018] [Indexed: 11/16/2022]
Abstract
Histopathology images are used for the diagnosis of the cancerous disease by the examination of tissue with the help of Whole Slide Imaging (WSI) scanner. A decision support system works well by the analysis of the histopathology images but a lot of problems arise in its decision. Color variation in the histopathology images is occurring due to use of the different scanner, use of various equipments, different stain coloring and reactivity from a different manufacturer. In this paper, detailed study and performance evaluation of color normalization methods on histopathology image datasets are presented. Color normalization of the source image by transferring the mean color of the target image in the source image and also to separate stain present in the source image. Stain separation and color normalization of the histopathology images can be helped for both pathology and computerized decision support system. Quality performances of different color normalization methods are evaluated and compared in terms of quaternion structure similarity index matrix (QSSIM), structure similarity index matrix (SSIM) and Pearson correlation coefficient (PCC) on various histopathology image datasets. Our experimental analysis suggests that structure-preserving color normalization (SPCN) provides better qualitatively and qualitatively results in comparison to the all the presented methods for breast and colorectal cancer histopathology image datasets.
Collapse
Affiliation(s)
- Santanu Roy
- Department of E&C Engineering, National Institute of Technology Karnataka, Surathkal, Mangalore-575025, India.
| | - Alok Kumar Jain
- Department of E&C Engineering, National Institute of Technology Karnataka, Surathkal, Mangalore-575025, India.
| | - Shyam Lal
- Department of E&C Engineering, National Institute of Technology Karnataka, Surathkal, Mangalore-575025, India.
| | - Jyoti Kini
- Department of Pathology, Kasturba Medical College, Mangalore, Manipal Academy of Higher Education, Karnataka, 575001, India.
| |
Collapse
|
53
|
Kolarević D, Vujasinović T, Kanjer K, Milovanović J, Todorović-Raković N, Nikolić-Vukosavljević D, Radulovic M. Effects of different preprocessing algorithms on the prognostic value of breast tumour microscopic images. J Microsc 2018; 270:17-26. [PMID: 28940426 DOI: 10.1111/jmi.12645] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2017] [Revised: 09/01/2017] [Accepted: 09/04/2017] [Indexed: 01/17/2023]
Abstract
The purpose of this study was to improve the prognostic value of tumour histopathology image analysis methodology by image preprocessing. Key image qualities were modified including contrast, sharpness and brightness. The texture information was subsequently extracted from images of haematoxylin/eosin-stained tumour tissue sections by GLCM, monofractal and multifractal algorithms without any analytical limitation to predefined structures. Images were derived from patient groups with invasive breast carcinoma (BC, 93 patients) and inflammatory breast carcinoma (IBC, 51 patients). The prognostic performance was indeed significantly enhanced by preprocessing with the average AUCs of individual texture features improving from 0.68 ± 0.05 for original to 0.78 ± 0.01 for preprocessed images in the BC group and 0.75 ± 0.01 to 0.80 ± 0.02 in the IBC group. Image preprocessing also improved the prognostic independence of texture features as indicated by multivariate analysis. Surprisingly, the tonal histogram compression by the nonnormalisation preprocessing has prognostically outperformed the tested contrast normalisation algorithms. Generally, features without prognostic value showed higher susceptibility to prognostic enhancement by preprocessing whereas IDM texture feature was exceptionally susceptible. The obtained results are suggestive of the existence of distinct texture prognostic clues in the two examined types of breast cancer. The obtained enhancement of prognostic performance is essential for the anticipated clinical use of this method as a simple and cost-effective prognosticator of cancer outcome.
Collapse
Affiliation(s)
- D Kolarević
- Daily Chemotherapy Hospital, Institute for Oncology and Radiology of Serbia, Beograd, Serbia
| | - T Vujasinović
- Department of Experimental Oncology, Institute for Oncology and Radiology of Serbia, Beograd, Serbia
| | - K Kanjer
- Department of Experimental Oncology, Institute for Oncology and Radiology of Serbia, Beograd, Serbia
| | - J Milovanović
- Department of Experimental Oncology, Institute for Oncology and Radiology of Serbia, Beograd, Serbia
| | - N Todorović-Raković
- Department of Experimental Oncology, Institute for Oncology and Radiology of Serbia, Beograd, Serbia
| | - D Nikolić-Vukosavljević
- Department of Experimental Oncology, Institute for Oncology and Radiology of Serbia, Beograd, Serbia
| | - M Radulovic
- Department of Experimental Oncology, Institute for Oncology and Radiology of Serbia, Beograd, Serbia
| |
Collapse
|
54
|
Nguyen L, Tosun AB, Fine JL, Lee AV, Taylor DL, Chennubhotla SC. Spatial Statistics for Segmenting Histological Structures in H&E Stained Tissue Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:1522-1532. [PMID: 28328502 PMCID: PMC5498226 DOI: 10.1109/tmi.2017.2681519] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
Segmenting a broad class of histological structures in transmitted light and/or fluorescence-based images is a prerequisite for determining the pathological basis of cancer, elucidating spatial interactions between histological structures in tumor microenvironments (e.g., tumor infiltrating lymphocytes), facilitating precision medicine studies with deep molecular profiling, and providing an exploratory tool for pathologists. This paper focuses on segmenting histological structures in hematoxylin- and eosin-stained images of breast tissues, e.g., invasive carcinoma, carcinoma in situ, atypical and normal ducts, adipose tissue, and lymphocytes. We propose two graph-theoretic segmentation methods based on local spatial color and nuclei neighborhood statistics. For benchmarking, we curated a data set of 232 high-power field breast tissue images together with expertly annotated ground truth. To accurately model the preference for histological structures (ducts, vessels, tumor nets, adipose, etc.) over the remaining connective tissue and non-tissue areas in ground truth annotations, we propose a new region-based score for evaluating segmentation algorithms. We demonstrate the improvement of our proposed methods over the state-of-the-art algorithms in both region- and boundary-based performance measures.
Collapse
|
55
|
Van Eycke YR, Allard J, Salmon I, Debeir O, Decaestecker C. Image processing in digital pathology: an opportunity to solve inter-batch variability of immunohistochemical staining. Sci Rep 2017; 7:42964. [PMID: 28220842 PMCID: PMC5318955 DOI: 10.1038/srep42964] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2016] [Accepted: 01/17/2017] [Indexed: 12/18/2022] Open
Abstract
Immunohistochemistry (IHC) is a widely used technique in pathology to evidence protein expression in tissue samples. However, this staining technique is known for presenting inter-batch variations. Whole slide imaging in digital pathology offers a possibility to overcome this problem by means of image normalisation techniques. In the present paper we propose a methodology to objectively evaluate the need of image normalisation and to identify the best way to perform it. This methodology uses tissue microarray (TMA) materials and statistical analyses to evidence the possible variations occurring at colour and intensity levels as well as to evaluate the efficiency of image normalisation methods in correcting them. We applied our methodology to test different methods of image normalisation based on blind colour deconvolution that we adapted for IHC staining. These tests were carried out for different IHC experiments on different tissue types and targeting different proteins with different subcellular localisations. Our methodology enabled us to establish and to validate inter-batch normalization transforms which correct the non-relevant IHC staining variations. The normalised image series were then processed to extract coherent quantitative features characterising the IHC staining patterns.
Collapse
Affiliation(s)
- Yves-Rémi Van Eycke
- DIAPath, Center for Microscopy and Molecular Imaging, Université Libre de Bruxelles (ULB), Gosselies, Belgium.,Laboratories of Image, Signal processing &Acoustics, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Justine Allard
- DIAPath, Center for Microscopy and Molecular Imaging, Université Libre de Bruxelles (ULB), Gosselies, Belgium
| | - Isabelle Salmon
- DIAPath, Center for Microscopy and Molecular Imaging, Université Libre de Bruxelles (ULB), Gosselies, Belgium.,Department of Pathology, Erasme Hospital, Université Libre de Bruxelles (ULB), Brussels, Belgium
| | - Olivier Debeir
- Laboratories of Image, Signal processing &Acoustics, Université Libre de Bruxelles (ULB), Brussels, Belgium.,MIP, Center for Microscopy and Molecular Imaging, Université Libre de Bruxelles (ULB), Gosselies, Belgium
| | - Christine Decaestecker
- DIAPath, Center for Microscopy and Molecular Imaging, Université Libre de Bruxelles (ULB), Gosselies, Belgium.,Laboratories of Image, Signal processing &Acoustics, Université Libre de Bruxelles (ULB), Brussels, Belgium
| |
Collapse
|
56
|
Stain Deconvolution Using Statistical Analysis of Multi-Resolution Stain Colour Representation. PLoS One 2017; 12:e0169875. [PMID: 28076381 PMCID: PMC5226799 DOI: 10.1371/journal.pone.0169875] [Citation(s) in RCA: 32] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2016] [Accepted: 12/23/2016] [Indexed: 01/16/2023] Open
Abstract
Stain colour estimation is a prominent factor of the analysis pipeline in most of histology image processing algorithms. Providing a reliable and efficient stain colour deconvolution approach is fundamental for robust algorithm. In this paper, we propose a novel method for stain colour deconvolution of histology images. This approach statistically analyses the multi-resolutional representation of the image to separate the independent observations out of the correlated ones. We then estimate the stain mixing matrix using filtered uncorrelated data. We conducted an extensive set of experiments to compare the proposed method to the recent state of the art methods and demonstrate the robustness of this approach using three different datasets of scanned slides, prepared in different labs using different scanners.
Collapse
|
57
|
Segmentation methods of H&E-stained histological images of lymphoma: A review. INFORMATICS IN MEDICINE UNLOCKED 2017. [DOI: 10.1016/j.imu.2017.05.009] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023] Open
|
58
|
Li X, Plataniotis KN. Circular Mixture Modeling of Color Distribution for Blind Stain Separation in Pathology Images. IEEE J Biomed Health Inform 2017; 21:150-161. [DOI: 10.1109/jbhi.2015.2503720] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
59
|
Aswathy M, Jagannath M. Detection of breast cancer on digital histopathology images: Present status and future possibilities. INFORMATICS IN MEDICINE UNLOCKED 2017. [DOI: 10.1016/j.imu.2016.11.001] [Citation(s) in RCA: 26] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022] Open
|
60
|
Gupta V, Bhavsar A. An Integrated Multi-scale Model for Breast Cancer Histopathological Image Classification with Joint Colour-Texture Features. COMPUTER ANALYSIS OF IMAGES AND PATTERNS 2017. [DOI: 10.1007/978-3-319-64698-5_30] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/14/2023]
|
61
|
|