1
|
Shafi S, Parwani AV. Artificial intelligence in diagnostic pathology. Diagn Pathol 2023; 18:109. [PMID: 37784122 PMCID: PMC10546747 DOI: 10.1186/s13000-023-01375-z] [Citation(s) in RCA: 45] [Impact Index Per Article: 22.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 07/21/2023] [Indexed: 10/04/2023] Open
Abstract
Digital pathology (DP) is being increasingly employed in cancer diagnostics, providing additional tools for faster, higher-quality, accurate diagnosis. The practice of diagnostic pathology has gone through a staggering transformation wherein new tools such as digital imaging, advanced artificial intelligence (AI) algorithms, and computer-aided diagnostic techniques are being used for assisting, augmenting and empowering the computational histopathology and AI-enabled diagnostics. This is paving the way for advancement in precision medicine in cancer. Automated whole slide imaging (WSI) scanners are now rendering diagnostic quality, high-resolution images of entire glass slides and combining these images with innovative digital pathology tools is making it possible to integrate imaging into all aspects of pathology reporting including anatomical, clinical, and molecular pathology. The recent approvals of WSI scanners for primary diagnosis by the FDA as well as the approval of prostate AI algorithm has paved the way for starting to incorporate this exciting technology for use in primary diagnosis. AI tools can provide a unique platform for innovations and advances in anatomical and clinical pathology workflows. In this review, we describe the milestones and landmark trials in the use of AI in clinical pathology with emphasis on future directions.
Collapse
Affiliation(s)
- Saba Shafi
- Department of Pathology, The Ohio State University Wexner Medical Center, E409 Doan Hall, 410 West 10th Ave, Columbus, OH, 43210, USA
| | - Anil V Parwani
- Department of Pathology, The Ohio State University Wexner Medical Center, E409 Doan Hall, 410 West 10th Ave, Columbus, OH, 43210, USA.
| |
Collapse
|
2
|
Ayyad SM, Shehata M, Shalaby A, Abou El-Ghar M, Ghazal M, El-Melegy M, Abdel-Hamid NB, Labib LM, Ali HA, El-Baz A. Role of AI and Histopathological Images in Detecting Prostate Cancer: A Survey. SENSORS (BASEL, SWITZERLAND) 2021; 21:2586. [PMID: 33917035 PMCID: PMC8067693 DOI: 10.3390/s21082586] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/05/2021] [Revised: 03/29/2021] [Accepted: 04/04/2021] [Indexed: 02/07/2023]
Abstract
Prostate cancer is one of the most identified cancers and second most prevalent among cancer-related deaths of men worldwide. Early diagnosis and treatment are substantial to stop or handle the increase and spread of cancer cells in the body. Histopathological image diagnosis is a gold standard for detecting prostate cancer as it has different visual characteristics but interpreting those type of images needs a high level of expertise and takes too much time. One of the ways to accelerate such an analysis is by employing artificial intelligence (AI) through the use of computer-aided diagnosis (CAD) systems. The recent developments in artificial intelligence along with its sub-fields of conventional machine learning and deep learning provide new insights to clinicians and researchers, and an abundance of research is presented specifically for histopathology images tailored for prostate cancer. However, there is a lack of comprehensive surveys that focus on prostate cancer using histopathology images. In this paper, we provide a very comprehensive review of most, if not all, studies that handled the prostate cancer diagnosis using histopathological images. The survey begins with an overview of histopathological image preparation and its challenges. We also briefly review the computing techniques that are commonly applied in image processing, segmentation, feature selection, and classification that can help in detecting prostate malignancies in histopathological images.
Collapse
Affiliation(s)
- Sarah M. Ayyad
- Computers and Systems Department, Faculty of Engineering, Mansoura University, Mansoura 35511, Egypt; (S.M.A.); (N.B.A.-H.); (L.M.L.); (H.A.A.)
| | - Mohamed Shehata
- BioImaging Laboratory, Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (M.S.); (A.S.)
| | - Ahmed Shalaby
- BioImaging Laboratory, Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (M.S.); (A.S.)
| | - Mohamed Abou El-Ghar
- Department of Radiology, Urology and Nephrology Center, Mansoura University, Mansoura 35516, Egypt;
| | - Mohammed Ghazal
- Department of Electrical and Computer Engineering, College of Engineering, Abu Dhabi University, Abu Dhabi 59911, United Arab Emirates;
| | - Moumen El-Melegy
- Department of Electrical Engineering, Assiut University, Assiut 71511, Egypt;
| | - Nahla B. Abdel-Hamid
- Computers and Systems Department, Faculty of Engineering, Mansoura University, Mansoura 35511, Egypt; (S.M.A.); (N.B.A.-H.); (L.M.L.); (H.A.A.)
| | - Labib M. Labib
- Computers and Systems Department, Faculty of Engineering, Mansoura University, Mansoura 35511, Egypt; (S.M.A.); (N.B.A.-H.); (L.M.L.); (H.A.A.)
| | - H. Arafat Ali
- Computers and Systems Department, Faculty of Engineering, Mansoura University, Mansoura 35511, Egypt; (S.M.A.); (N.B.A.-H.); (L.M.L.); (H.A.A.)
| | - Ayman El-Baz
- BioImaging Laboratory, Bioengineering Department, University of Louisville, Louisville, KY 40292, USA; (M.S.); (A.S.)
| |
Collapse
|
3
|
Xu H, Park S, Hwang TH. Computerized Classification of Prostate Cancer Gleason Scores from Whole Slide Images. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2020; 17:1871-1882. [PMID: 31536012 DOI: 10.1109/tcbb.2019.2941195] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Histological Gleason grading of tumor patterns is one of the most powerful prognostic predictors in prostate cancer. However, manual analysis and grading performed by pathologists are typically subjective and time-consuming. In this paper, we present an automatic technique for Gleason grading of prostate cancer from H&E stained whole slide pathology images using a set of novel completed and statistical local binary pattern (CSLBP) descriptors. First, the technique divides the whole slide image (WSI) into a set of small image tiles, where salient tumor tiles with high nuclei densities are selected for analysis. The CSLBP texture features that encode pixel intensity variations from circularly surrounding neighborhoods are extracted from salient image tiles to characterize different Gleason patterns. Finally, the CSLBP texture features computed from all tiles are integrated and utilized by the multi-class support vector machine (SVM) that assigns patient slides with different Gleason scores such as 6, 7, or ≥ 8. Experiments have been performed on 312 different patient cases selected from the cancer genome atlas (TCGA) and have achieved superior performances over state-of-the-art texture descriptors and baseline methods including deep learning models for prostate cancer Gleason grading.
Collapse
|
4
|
Ibrahim A, Gamble P, Jaroensri R, Abdelsamea MM, Mermel CH, Chen PHC, Rakha EA. Artificial intelligence in digital breast pathology: Techniques and applications. Breast 2020; 49:267-273. [PMID: 31935669 PMCID: PMC7375550 DOI: 10.1016/j.breast.2019.12.007] [Citation(s) in RCA: 101] [Impact Index Per Article: 20.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2019] [Accepted: 12/12/2019] [Indexed: 12/16/2022] Open
Abstract
Breast cancer is the most common cancer and second leading cause of cancer-related death worldwide. The mainstay of breast cancer workup is histopathological diagnosis - which guides therapy and prognosis. However, emerging knowledge about the complex nature of cancer and the availability of tailored therapies have exposed opportunities for improvements in diagnostic precision. In parallel, advances in artificial intelligence (AI) along with the growing digitization of pathology slides for the primary diagnosis are a promising approach to meet the demand for more accurate detection, classification and prediction of behaviour of breast tumours. In this article, we cover the current and prospective uses of AI in digital pathology for breast cancer, review the basics of digital pathology and AI, and outline outstanding challenges in the field.
Collapse
Affiliation(s)
- Asmaa Ibrahim
- Department of Histopathology, Division of Cancer and Stem Cells, School of Medicine, The University of Nottingham and Nottingham University Hospitals NHS Trust, Nottingham City Hospital, Nottingham, NG5 1PB, UK
| | | | | | - Mohammed M Abdelsamea
- School of Computing and Digital Technology, Birmingham City University, Birmingham, UK
| | | | | | - Emad A Rakha
- Department of Histopathology, Division of Cancer and Stem Cells, School of Medicine, The University of Nottingham and Nottingham University Hospitals NHS Trust, Nottingham City Hospital, Nottingham, NG5 1PB, UK.
| |
Collapse
|
5
|
Ren J, Karagoz K, Gatza ML, Singer EA, Sadimin E, Foran DJ, Qi X. Recurrence analysis on prostate cancer patients with Gleason score 7 using integrated histopathology whole-slide images and genomic data through deep neural networks. J Med Imaging (Bellingham) 2018; 5:047501. [PMID: 30840742 PMCID: PMC6237203 DOI: 10.1117/1.jmi.5.4.047501] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2018] [Accepted: 10/23/2018] [Indexed: 12/22/2022] Open
Abstract
Prostate cancer is the most common nonskin-related cancer, affecting one in seven men in the United States. Gleason score, a sum of the primary and secondary Gleason patterns, is one of the best predictors of prostate cancer outcomes. Recently, significant progress has been made in molecular subtyping prostate cancer through the use of genomic sequencing. It has been established that prostate cancer patients presented with a Gleason score 7 show heterogeneity in both disease recurrence and survival. We built a unified system using publicly available whole-slide images and genomic data of histopathology specimens through deep neural networks to identify a set of computational biomarkers. Using a survival model, the experimental results on the public prostate dataset showed that the computational biomarkers extracted by our approach had hazard ratio as 5.73 and C -index as 0.74, which were higher than standard clinical prognostic factors and other engineered image texture features. Collectively, the results of this study highlight the important role of neural network analysis of prostate cancer and the potential of such approaches in other precision medicine applications.
Collapse
Affiliation(s)
- Jian Ren
- Rutgers, the State University of New Jersey, Department of Electrical and Computer Engineering, Piscataway, New Jersey, United States
| | - Kubra Karagoz
- Rutgers Cancer Institute of New Jersey, Department of Radiation Oncology, New Brunswick, New Jersey, United States
| | - Michael L. Gatza
- Rutgers Cancer Institute of New Jersey, Department of Radiation Oncology, New Brunswick, New Jersey, United States
| | - Eric A. Singer
- Rutgers Cancer Institute of New Jersey, Section of Urologic Oncology, New Brunswick, New Jersey, United States
| | - Evita Sadimin
- Rutgers Cancer Institute of New Jersey, Department of Pathology and Laboratory Medicine, New Brunswick, New Jersey, United States
| | - David J. Foran
- Rutgers Cancer Institute of New Jersey, Department of Pathology and Laboratory Medicine, New Brunswick, New Jersey, United States
| | - Xin Qi
- Rutgers Cancer Institute of New Jersey, Department of Pathology and Laboratory Medicine, New Brunswick, New Jersey, United States
| |
Collapse
|
6
|
Ren J, Sadimin ET, Wang D, Epstein JI, Foran DJ, Qi X. Computer aided analysis of prostate histopathology images Gleason grading especially for Gleason score 7. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2015:3013-6. [PMID: 26736926 DOI: 10.1109/embc.2015.7319026] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Clinically, prostate adenocarcinoma is diagnosed by recognizing certain morphology on histology. While the Gleason grading system has been shown to be the strongest prognostic factor for men with prostrate adenocarcinoma, there is a significant intra and interobserver variability between pathologists in assigning this grading system. In this study, we present a new method for prostate gland segmentation from which we then utilize to develop a computer aided Gleason grading. The novelty of our method is a region-based nuclei segmentation to get individual gland without using lumen as prior information. Because each gland region is surrounded by nuclei, individual gland can be segmented by using the structure features and Delaunay Triangulation. The precision, recal and F1 of this approach are 0.94±0.11, 0.60±0.23 and 0.70±0.19 respectively. Our method achieves a high accuracy for prostate gland segmentation with less computation time.
Collapse
|
7
|
Mercan E, Aksoy S, Shapiro LG, Weaver DL, Brunyé TT, Elmore JG. Localization of Diagnostically Relevant Regions of Interest in Whole Slide Images: a Comparative Study. J Digit Imaging 2018; 29:496-506. [PMID: 26961982 DOI: 10.1007/s10278-016-9873-1] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/10/2023] Open
Abstract
Whole slide digital imaging technology enables researchers to study pathologists' interpretive behavior as they view digital slides and gain new understanding of the diagnostic medical decision-making process. In this study, we propose a simple yet important analysis to extract diagnostically relevant regions of interest (ROIs) from tracking records using only pathologists' actions as they viewed biopsy specimens in the whole slide digital imaging format (zooming, panning, and fixating). We use these extracted regions in a visual bag-of-words model based on color and texture features to predict diagnostically relevant ROIs on whole slide images. Using a logistic regression classifier in a cross-validation setting on 240 digital breast biopsy slides and viewport tracking logs of three expert pathologists, we produce probability maps that show 74 % overlap with the actual regions at which pathologists looked. We compare different bag-of-words models by changing dictionary size, visual word definition (patches vs. superpixels), and training data (automatically extracted ROIs vs. manually marked ROIs). This study is a first step in understanding the scanning behaviors of pathologists and the underlying reasons for diagnostic errors.
Collapse
Affiliation(s)
- Ezgi Mercan
- Department of Computer Science & Engineering, Paul G. Allen Center for Computing, University of Washington, 185 Stevens Way, Seattle, WA, 98195, USA.
| | - Selim Aksoy
- Department of Computer Engineering, Bilkent University, Bilkent, 06800, Ankara, Turkey
| | - Linda G Shapiro
- Department of Computer Science & Engineering, Paul G. Allen Center for Computing, University of Washington, 185 Stevens Way, Seattle, WA, 98195, USA
| | - Donald L Weaver
- Department of Pathology, University of Vermont, Burlington, VT, 05405, USA
| | - Tad T Brunyé
- Department of Psychology, Tufts University, Medford, MA, 02155, USA
| | - Joann G Elmore
- Department of Medicine, University of Washington, Seattle, WA, 98195, USA
| |
Collapse
|
8
|
Ren J, Karagoz K, Gatza M, Foran DJ, Qi X. Differentiation among prostate cancer patients with Gleason score of 7 using histopathology whole-slide image and genomic data. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2018; 10579:1057904. [PMID: 30662142 PMCID: PMC6338219 DOI: 10.1117/12.2293193] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
Prostate cancer is the most common non-skin related cancer affecting 1 in 7 men in the United States. Treatment of patients with prostate cancer still remains a difficult decision-making process that requires physicians to balance clinical benefits, life expectancy, comorbidities, and treatment-related side effects. Gleason score (a sum of the primary and secondary Gleason patterns) solely based on morphological prostate glandular architecture has shown as one of the best predictors of prostate cancer outcome. Significant progress has been made on molecular subtyping prostate cancer delineated through the increasing use of gene sequencing. Prostate cancer patients with Gleason score of 7 show heterogeneity in recurrence and survival outcomes. Therefore, we propose to assess the correlation between histopathology images and genomic data with disease recurrence in prostate tumors with a Gleason 7 score to identify prognostic markers. In the study, we identify image biomarkers within tissue WSIs by modeling the spatial relationship from automatically created patches as a sequence within WSI by adopting a recurrence network model, namely long short-term memory (LSTM). Our preliminary results demonstrate that integrating image biomarkers from CNN with LSTM and genomic pathway scores, is more strongly correlated with patients recurrence of disease compared to standard clinical markers and engineered image texture features. The study further demonstrates that prostate cancer patients with Gleason score of 4+3 have a higher risk of disease progression and recurrence compared to prostate cancer patients with Gleason score of 3+4.
Collapse
Affiliation(s)
- Jian Ren
- Dept. of Electrical and Computer Engineering, Rutgers University, Piscataway, NJ, USA
| | - Kubra Karagoz
- Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, USA
| | - Michael Gatza
- Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, USA
| | - David J Foran
- Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, USA
| | - Xin Qi
- Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, USA
| |
Collapse
|
9
|
Powell RT, Olar A, Narang S, Rao G, Sulman E, Fuller GN, Rao A. Identification of Histological Correlates of Overall Survival in Lower Grade Gliomas Using a Bag-of-words Paradigm: A Preliminary Analysis Based on Hematoxylin & Eosin Stained Slides from the Lower Grade Glioma Cohort of The Cancer Genome Atlas. J Pathol Inform 2017; 8:9. [PMID: 28382223 PMCID: PMC5364741 DOI: 10.4103/jpi.jpi_43_16] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2016] [Accepted: 01/21/2017] [Indexed: 11/04/2022] Open
Abstract
Background: Glioma, the most common primary brain neoplasm, describes a heterogeneous tumor of multiple histologic subtypes and cellular origins. At clinical presentation, gliomas are graded according to the World Health Organization guidelines (WHO), which reflect the malignant characteristics of the tumor based on histopathological and molecular features. Lower grade diffuse gliomas (LGGs) (WHO Grade II–III) have fewer malignant characteristics than high-grade gliomas (WHO Grade IV), and a better clinical prognosis, however, accurate discrimination of overall survival (OS) remains a challenge. In this study, we aimed to identify tissue-derived image features using a machine learning approach to predict OS in a mixed histology and grade cohort of lower grade glioma patients. To achieve this aim, we used H and E stained slides from the public LGG cohort of The Cancer Genome Atlas (TCGA) to create a machine learned dictionary of “image-derived visual words” associated with OS. We then evaluated the combined efficacy of using these visual words in predicting short versus long OS by training a generalized machine learning model. Finally, we mapped these predictive visual words back to molecular signaling cascades to infer potential drivers of the machine learned survival-associated phenotypes. Methods: We analyzed digitized histological sections downloaded from the LGG cohort of TCGA using a bag-of-words approach. This method identified a diverse set of histological patterns that were further correlated with OS, histology, and molecular signaling activity using Cox regression, analysis of variance, and Spearman correlation, respectively. A support vector machine (SVM) model was constructed to discriminate patients into short and long OS groups dichotomized at 24-month. Results: This method identified disease-relevant phenotypes associated with OS, some of which are correlated with disease-associated molecular pathways. From these image-derived phenotypes, a generalized SVM model which could discriminate 24-month OS (area under the curve, 0.76) was obtained. Conclusion: Here, we demonstrated one potential strategy to incorporate image features derived from H and E stained slides into predictive models of OS. In addition, we showed how these image-derived phenotypic characteristics correlate with molecular signaling activity underlying the etiology or behavior of LGG.
Collapse
Affiliation(s)
- Reid Trenton Powell
- Center for Translational Cancer Research, Texas A and M Health Science Center, Institute of Biosciences and Technology, Houston, TX 77030, USA
| | - Adriana Olar
- Department of Hematopathology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Shivali Narang
- Department of Bioinformatics and Computational Biology, Division of Quantitative Sciences, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Ganesh Rao
- Department of Neurosurgery, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Erik Sulman
- Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Gregory N Fuller
- Department of Pathology (Section of Neuropathology), The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| | - Arvind Rao
- Department of Bioinformatics and Computational Biology, Division of Quantitative Sciences, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA; Department of Radiation Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX 77030, USA
| |
Collapse
|
10
|
Ren J, Sadimin E, Foran DJ, Qi X. Computer aided analysis of prostate histopathology images to support a refined Gleason grading system. PROCEEDINGS OF SPIE--THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING 2017; 10133. [PMID: 30828124 DOI: 10.1117/12.2253887] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/14/2022]
Abstract
The Gleason grading system used to render prostate cancer diagnosis has recently been updated to allow more accurate grade stratification and higher prognostic discrimination when compared to the traditional grading system. In spite of progress made in trying to standardize the grading process, there still remains approximately a 30% grading discrepancy between the score rendered by general pathologists and those provided by experts while reviewing needle biopsies for Gleason pattern 3 and 4, which accounts for more than 70% of daily prostate tissue slides at most institutions. We propose a new computational imaging method for Gleason pattern 3 and 4 classification, which better matches the newly established prostate cancer grading system. The computer-aided analysis method includes two phases. First, the boundary of each glandular region is automatically segmented using a deep convolutional neural network. Second, color, shape and texture features are extracted from superpixels corresponding to the outer and inner glandular regions and are subsequently forwarded to a random forest classifier to give a gradient score between 3 and 4 for each delineated glandular region. The F 1 score for glandular segmentation is 0.8460 and the classification accuracy is 0.83±0.03.
Collapse
Affiliation(s)
- Jian Ren
- Dept. of Electrical and Computer Engineering, Rutgers, The State University of NJ
| | - Evita Sadimin
- Cancer Institute of New Jersey, Rutgers, The State University of NJ
| | - David J Foran
- Cancer Institute of New Jersey, Rutgers, The State University of NJ
| | - Xin Qi
- Cancer Institute of New Jersey, Rutgers, The State University of NJ
| |
Collapse
|
11
|
Automated tumor analysis for molecular profiling in lung cancer. Oncotarget 2016; 6:27938-52. [PMID: 26317646 PMCID: PMC4695036 DOI: 10.18632/oncotarget.4391] [Citation(s) in RCA: 39] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/09/2015] [Accepted: 07/24/2015] [Indexed: 12/12/2022] Open
Abstract
The discovery and clinical application of molecular biomarkers in solid tumors, increasingly relies on nucleic acid extraction from FFPE tissue sections and subsequent molecular profiling. This in turn requires the pathological review of haematoxylin & eosin (H&E) stained slides, to ensure sample quality, tumor DNA sufficiency by visually estimating the percentage tumor nuclei and tumor annotation for manual macrodissection. In this study on NSCLC, we demonstrate considerable variation in tumor nuclei percentage between pathologists, potentially undermining the precision of NSCLC molecular evaluation and emphasising the need for quantitative tumor evaluation. We subsequently describe the development and validation of a system called TissueMark for automated tumor annotation and percentage tumor nuclei measurement in NSCLC using computerized image analysis. Evaluation of 245 NSCLC slides showed precise automated tumor annotation of cases using Tissuemark, strong concordance with manually drawn boundaries and identical EGFR mutational status, following manual macrodissection from the image analysis generated tumor boundaries. Automated analysis of cell counts for % tumor measurements by Tissuemark showed reduced variability and significant correlation (p < 0.001) with benchmark tumor cell counts. This study demonstrates a robust image analysis technology that can facilitate the automated quantitative analysis of tissue samples for molecular profiling in discovery and diagnostics.
Collapse
|
12
|
|
13
|
Niazi MKK, Zynger DL, Clinton SK, Chen J, Koyuturk M, LaFramboise T, Gurcan M. Visually Meaningful Histopathological Features for Automatic Grading of Prostate Cancer. IEEE J Biomed Health Inform 2016; 21:1027-1038. [PMID: 28113734 DOI: 10.1109/jbhi.2016.2565515] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Histopathologic features, particularly Gleason grading system, have contributed significantly to the diagnosis, treatment, and prognosis of prostate cancer for decades. However, prostate cancer demonstrates enormous heterogeneity in biological behavior, thus establishing improved prognostic and predictive markers is particularly important to personalize therapy of men with clinically localized and newly diagnosed malignancy. Many automated grading systems have been developed for Gleason grading but acceptance in the medical community has been lacking due to poor interpretability. To overcome this problem, we developed a set of visually meaningful features to differentiate between low- and high-grade prostate cancer. The visually meaningful feature set consists of luminal and architectural features. For luminal features, we compute: 1) the shortest path from the nuclei to their closest luminal spaces; 2) ratio of the epithelial nuclei to the total number of nuclei. A nucleus is considered an epithelial nucleus if the shortest path between it and the luminal space does not contain any other nucleus; 3) average shortest distance of all nuclei to their closest luminal spaces. For architectural features, we compute directional changes in stroma and nuclei using directional filter banks. These features are utilized to create two subspaces; one for prostate images histopathologically assessed as low grade and the other for high grade. The grade associated with a subspace, which results in the minimum reconstruction error is considered as the prediction for the test image. For training, we utilized 43 regions of interest (ROI) images, which were extracted from 25 prostate whole slide images of The Cancer Genome Atlas (TCGA) database. For testing, we utilized an independent dataset of 88 ROIs extracted from 30 prostate whole slide images. The method resulted in 93.0% and 97.6% training and testing accuracies, respectively, for the spectrum of cases considered. The application of visually meaningful features provided promising levels of accuracy and consistency for grading prostate cancer.
Collapse
|
14
|
Xing F, Yang L. Robust Nucleus/Cell Detection and Segmentation in Digital Pathology and Microscopy Images: A Comprehensive Review. IEEE Rev Biomed Eng 2016; 9:234-63. [PMID: 26742143 PMCID: PMC5233461 DOI: 10.1109/rbme.2016.2515127] [Citation(s) in RCA: 219] [Impact Index Per Article: 24.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Digital pathology and microscopy image analysis is widely used for comprehensive studies of cell morphology or tissue structure. Manual assessment is labor intensive and prone to interobserver variations. Computer-aided methods, which can significantly improve the objectivity and reproducibility, have attracted a great deal of interest in recent literature. Among the pipeline of building a computer-aided diagnosis system, nucleus or cell detection and segmentation play a very important role to describe the molecular morphological information. In the past few decades, many efforts have been devoted to automated nucleus/cell detection and segmentation. In this review, we provide a comprehensive summary of the recent state-of-the-art nucleus/cell segmentation approaches on different types of microscopy images including bright-field, phase-contrast, differential interference contrast, fluorescence, and electron microscopies. In addition, we discuss the challenges for the current methods and the potential future work of nucleus/cell detection and segmentation.
Collapse
|
15
|
Gibbs SL, Genega E, Salemi J, Kianzad V, Goodwill HL, Xie Y, Oketokoun R, Khurd P, Kamen A, Frangioni JV. Near-infrared fluorescent digital pathology for the automation of disease diagnosis and biomarker assessment. Mol Imaging 2016; 14. [PMID: 25812603 DOI: 10.2310/7290.2015.00005] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
Hematoxylin-eosin (H&E) staining of tissue has been the mainstay of pathology for more than a century. However, the learning curve for H&E tissue interpretation is long, whereas intra- and interobserver variability remain high. Computer-assisted image analysis of H&E sections holds promise for increased throughput and decreased variability but has yet to demonstrate significant improvement in diagnostic accuracy. Addition of biomarkers to H&E staining can improve diagnostic accuracy; however, coregistration of immunohistochemical staining with H&E is problematic as immunostaining is completed on slides that are at best 4 μm apart. Simultaneous H&E and immunostaining would alleviate coregistration problems; however, current opaque pigments used for immunostaining obscure H&E. In this study, we demonstrate that diagnostic information provided by two or more independent wavelengths of near-infrared (NIR) fluorescence leave the H&E stain unchanged while enabling computer-assisted diagnosis and assessment of human disease. Using prostate cancer as a model system, we introduce NIR digital pathology and demonstrate its utility along the spectrum from prostate biopsy to whole mount analysis of H&E-stained tissue.
Collapse
|
16
|
Fernández-Carrobles MM, Bueno G, Déniz O, Salido J, García-Rojo M, González-López L. Influence of Texture and Colour in Breast TMA Classification. PLoS One 2015; 10:e0141556. [PMID: 26513238 PMCID: PMC4626403 DOI: 10.1371/journal.pone.0141556] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2015] [Accepted: 10/09/2015] [Indexed: 11/18/2022] Open
Abstract
Breast cancer diagnosis is still done by observation of biopsies under the microscope. The development of automated methods for breast TMA classification would reduce diagnostic time. This paper is a step towards the solution for this problem and shows a complete study of breast TMA classification based on colour models and texture descriptors. The TMA images were divided into four classes: i) benign stromal tissue with cellularity, ii) adipose tissue, iii) benign and benign anomalous structures, and iv) ductal and lobular carcinomas. A relevant set of features was obtained on eight different colour models from first and second order Haralick statistical descriptors obtained from the intensity image, Fourier, Wavelets, Multiresolution Gabor, M-LBP and textons descriptors. Furthermore, four types of classification experiments were performed using six different classifiers: (1) classification per colour model individually, (2) classification by combination of colour models, (3) classification by combination of colour models and descriptors, and (4) classification by combination of colour models and descriptors with a previous feature set reduction. The best result shows an average of 99.05% accuracy and 98.34% positive predictive value. These results have been obtained by means of a bagging tree classifier with combination of six colour models and the use of 1719 non-correlated (correlation threshold of 97%) textural features based on Statistical, M-LBP, Gabor and Spatial textons descriptors.
Collapse
Affiliation(s)
| | - Gloria Bueno
- VISILAB, Universidad de Castilla-La Mancha, Ciudad Real, Spain
- * E-mail: (MMFC); (GB)
| | - Oscar Déniz
- VISILAB, Universidad de Castilla-La Mancha, Ciudad Real, Spain
| | - Jesús Salido
- VISILAB, Universidad de Castilla-La Mancha, Ciudad Real, Spain
| | - Marcial García-Rojo
- Department of Pathology, Hospital de Jerez de la Frontera, Jerez de la Frontera, Cádiz, Spain
| | - Lucía González-López
- Department of Pathology, Hospital General Universitario de Ciudad Real, Ciudad Real, Spain
| |
Collapse
|
17
|
Yap CK, Kalaw EM, Singh M, Chong KT, Giron DM, Huang CH, Cheng L, Law YN, Lee HK. Automated image based prominent nucleoli detection. J Pathol Inform 2015; 6:39. [PMID: 26167383 PMCID: PMC4485194 DOI: 10.4103/2153-3539.159232] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2014] [Accepted: 01/07/2015] [Indexed: 11/19/2022] Open
Abstract
Introduction: Nucleolar changes in cancer cells are one of the cytologic features important to the tumor pathologist in cancer assessments of tissue biopsies. However, inter-observer variability and the manual approach to this work hamper the accuracy of the assessment by pathologists. In this paper, we propose a computational method for prominent nucleoli pattern detection. Materials and Methods: Thirty-five hematoxylin and eosin stained images were acquired from prostate cancer, breast cancer, renal clear cell cancer and renal papillary cell cancer tissues. Prostate cancer images were used for the development of a computer-based automated prominent nucleoli pattern detector built on a cascade farm. An ensemble of approximately 1000 cascades was constructed by permuting different combinations of classifiers such as support vector machines, eXclusive component analysis, boosting, and logistic regression. The output of cascades was then combined using the RankBoost algorithm. The output of our prominent nucleoli pattern detector is a ranked set of detected image patches of patterns of prominent nucleoli. Results: The mean number of detected prominent nucleoli patterns in the top 100 ranked detected objects was 58 in the prostate cancer dataset, 68 in the breast cancer dataset, 86 in the renal clear cell cancer dataset, and 76 in the renal papillary cell cancer dataset. The proposed cascade farm performs twice as good as the use of a single cascade proposed in the seminal paper by Viola and Jones. For comparison, a naive algorithm that randomly chooses a pixel as a nucleoli pattern would detect five correct patterns in the first 100 ranked objects. Conclusions: Detection of sparse nucleoli patterns in a large background of highly variable tissue patterns is a difficult challenge our method has overcome. This study developed an accurate prominent nucleoli pattern detector with the potential to be used in the clinical settings.
Collapse
Affiliation(s)
- Choon K Yap
- Imaging Informatics Division, Bioinformatics Institute, 30 Biopolis Street, #07-01, Matrix 138671, Novena, Singapore
| | - Emarene M Kalaw
- Imaging Informatics Division, Bioinformatics Institute, 30 Biopolis Street, #07-01, Matrix 138671, Novena, Singapore ; Department of Pathology, Tan Tock Seng Hospital, 11 Jalan Tan Tock Seng, 308433, Novena, Singapore
| | - Malay Singh
- Imaging Informatics Division, Bioinformatics Institute, 30 Biopolis Street, #07-01, Matrix 138671, Novena, Singapore ; Department of Computer Science, School of Computing, National University of Singapore, 13 Computing Drive, 117417, Novena, Singapore
| | - Kian T Chong
- Department of Urology, Tan Tock Seng Hospital, 11 Jalan Tan Tock Seng, 308433, Novena, Singapore
| | - Danilo M Giron
- Department of Pathology, Tan Tock Seng Hospital, 11 Jalan Tan Tock Seng, 308433, Novena, Singapore
| | - Chao-Hui Huang
- Imaging Informatics Division, Bioinformatics Institute, 30 Biopolis Street, #07-01, Matrix 138671, Novena, Singapore
| | - Li Cheng
- Imaging Informatics Division, Bioinformatics Institute, 30 Biopolis Street, #07-01, Matrix 138671, Novena, Singapore
| | - Yan N Law
- Imaging Informatics Division, Bioinformatics Institute, 30 Biopolis Street, #07-01, Matrix 138671, Novena, Singapore
| | - Hwee Kuan Lee
- Imaging Informatics Division, Bioinformatics Institute, 30 Biopolis Street, #07-01, Matrix 138671, Novena, Singapore
| |
Collapse
|
18
|
Zhang X, Liu W, Dundar M, Badve S, Zhang S. Towards large-scale histopathological image analysis: hashing-based image retrieval. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:496-506. [PMID: 25314696 DOI: 10.1109/tmi.2014.2361481] [Citation(s) in RCA: 77] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Automatic analysis of histopathological images has been widely utilized leveraging computational image-processing methods and modern machine learning techniques. Both computer-aided diagnosis (CAD) and content-based image-retrieval (CBIR) systems have been successfully developed for diagnosis, disease detection, and decision support in this area. Recently, with the ever-increasing amount of annotated medical data, large-scale and data-driven methods have emerged to offer a promise of bridging the semantic gap between images and diagnostic information. In this paper, we focus on developing scalable image-retrieval techniques to cope intelligently with massive histopathological images. Specifically, we present a supervised kernel hashing technique which leverages a small amount of supervised information in learning to compress a 10 000-dimensional image feature vector into only tens of binary bits with the informative signatures preserved. These binary codes are then indexed into a hash table that enables real-time retrieval of images in a large database. Critically, the supervised information is employed to bridge the semantic gap between low-level image features and high-level diagnostic information. We build a scalable image-retrieval framework based on the supervised hashing technique and validate its performance on several thousand histopathological images acquired from breast microscopic tissues. Extensive evaluations are carried out in terms of image classification (i.e., benign versus actionable categorization) and retrieval tests. Our framework achieves about 88.1% classification accuracy as well as promising time efficiency. For example, the framework can execute around 800 queries in only 0.01 s, comparing favorably with other commonly used dimensionality reduction and feature selection methods.
Collapse
|
19
|
Nguyen K, Sarkar A, Jain AK. Prostate cancer grading: use of graph cut and spatial arrangement of nuclei. IEEE TRANSACTIONS ON MEDICAL IMAGING 2014; 33:2254-2270. [PMID: 25029379 DOI: 10.1109/tmi.2014.2336883] [Citation(s) in RCA: 36] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
Tissue image grading is one of the most important steps in prostate cancer diagnosis, where the pathologist relies on the gland structure to assign a Gleason grade to the tissue image. In this grading scheme, the discrimination between grade 3 and grade 4 is the most difficult, and receives the most attention from researchers. In this study, we propose a novel method (called nuclei-based method) that 1) utilizes graph theory techniques to segment glands and 2) computes a gland-score (based on the spatial arrangement of nuclei) to estimate how similar a segmented region is to a gland. Next, we create a fusion method by combining this nuclei-based method with the lumen-based method presented in our previous work to improve the performance of grade 3 versus grade 4 classification problem (the accuracy is now improved to 87.3% compared to 81.1% of the lumen-based method alone). To segment glands, we build a graph of nuclei and lumina in the image, and use the normalized cut method to partition the graph into different components, each corresponding to a gland. Unlike most state-of-the-art lumen-based gland segmentation method, the nuclei-based method is able to segment glands without lumen or glands with multiple lumina. Moreover, another important contribution in this research is the development of a set of measures to exploit the difference in nuclei spatial arrangement between grade 3 images (where nuclei form closed chain structure on the gland boundary) and grade 4 image (where nuclei distribute more randomly in the gland). These measures are combined to generate a single gland-score value, which estimates how similar a segmented region (which is a set of nuclei and lumina) is to a gland.
Collapse
|
20
|
Zhang F, Song Y, Cai W, Lee MZ, Zhou Y, Huang H, Shan S, Fulham MJ, Feng DD. Lung nodule classification with multilevel patch-based context analysis. IEEE Trans Biomed Eng 2014; 61:1155-66. [PMID: 24658240 DOI: 10.1109/tbme.2013.2295593] [Citation(s) in RCA: 35] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
In this paper, we propose a novel classification method for the four types of lung nodules, i.e., well-circumscribed, vascularized, juxta-pleural, and pleural-tail, in low dose computed tomography scans. The proposed method is based on contextual analysis by combining the lung nodule and surrounding anatomical structures, and has three main stages: an adaptive patch-based division is used to construct concentric multilevel partition; then, a new feature set is designed to incorporate intensity, texture, and gradient information for image patch feature description, and then a contextual latent semantic analysis-based classifier is designed to calculate the probabilistic estimations for the relevant images. Our proposed method was evaluated on a publicly available dataset and clearly demonstrated promising classification performance.
Collapse
|
21
|
Mosquera-Lopez C, Agaian S, Velez-Hoyos A, Thompson I. Computer-Aided Prostate Cancer Diagnosis From Digitized Histopathology: A Review on Texture-Based Systems. IEEE Rev Biomed Eng 2014; 8:98-113. [PMID: 25055385 DOI: 10.1109/rbme.2014.2340401] [Citation(s) in RCA: 51] [Impact Index Per Article: 4.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Prostate cancer (PCa) is currently diagnosed by microscopic evaluation of biopsy samples. Since tissue assessment heavily relies on the pathologists level of expertise and interpretation criteria, it is still a subjective process with high intra- and interobserver variabilities. Computer-aided diagnosis (CAD) may have a major impact on detection and grading of PCa by reducing the pathologists reading time, and increasing the accuracy and reproducibility of diagnosis outcomes. However, the complexity of the prostatic tissue and the large volumes of data generated by biopsy procedures make the development of CAD systems for PCa a challenging task. The problem of automated diagnosis of prostatic carcinoma from histopathology has received a lot of attention. As a result, a number of CAD systems, have been proposed for quantitative image analysis and classification. This review aims at providing a detailed description of selected literature in the field of CAD of PCa, emphasizing the role of texture analysis methods in tissue description. It includes a review of image analysis tools for image preprocessing, feature extraction, classification, and validation techniques used in PCa detection and grading, as well as future directions in pursuit of better texture-based CAD systems.
Collapse
|
22
|
Bhagavatula R, McCann MT, Fickus M, Castro CA, Ozolek JA, Kovacevic J. A vocabulary for the identification and delineation of teratoma tissue components in hematoxylin and eosin-stained samples. J Pathol Inform 2014; 5:19. [PMID: 25191619 PMCID: PMC4141425 DOI: 10.4103/2153-3539.135606] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2013] [Accepted: 04/16/2014] [Indexed: 12/01/2022] Open
Abstract
UNLABELLED We propose a methodology for the design of features mimicking the visual cues used by pathologists when identifying tissues in hematoxylin and eosin (H&E)-stained samples. BACKGROUND H&E staining is the gold standard in clinical histology; it is cheap and universally used, producing a vast number of histopathological samples. While pathologists accurately and consistently identify tissues and their pathologies, it is a time-consuming and expensive task, establishing the need for automated algorithms for improved throughput and robustness. METHODS We use an iterative feedback process to design a histopathology vocabulary (HV), a concise set of features that mimic the visual cues used by pathologists, e.g. "cytoplasm color" or "nucleus density". These features are based in histology and understood by both pathologists and engineers. We compare our HV to several generic texture-feature sets in a pixel-level classification algorithm. RESULTS Results on delineating and identifying tissues in teratoma tumor samples validate our expert knowledge-based approach. CONCLUSIONS The HV can be an effective tool for identifying and delineating teratoma components from images of H&E-stained tissue samples.
Collapse
Affiliation(s)
| | - Michael T. McCann
- Department of Biomedical Engineering, Center for Bioimage Informatics, Pittsburgh, USA
| | - Matthew Fickus
- Department of Mathematics and Statistics, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA
| | - Carlos A. Castro
- Department of Obstetrics and Gynecology, Magee-Womens Research Institute and Foundation of the University of Pittsburgh, Pittsburgh, USA
| | - John A. Ozolek
- Department of Pathology, Children's Hospital of Pittsburgh of the University of Pittsburgh, Pittsburgh, PA, USA
| | - Jelena Kovacevic
- Department of Biomedical Engineering, Center for Bioimage Informatics, Pittsburgh, USA
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, USA
| |
Collapse
|
23
|
Khanna A, Patil R, Deshmukh A. Assessment of the potential of pathological stains in human prostate cancer. J Clin Diagn Res 2014; 8:124-8. [PMID: 24596742 DOI: 10.7860/jcdr/2014/7002.3938] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2013] [Accepted: 09/26/2013] [Indexed: 11/24/2022]
Abstract
BACKGROUND Incidence of prostate cancer in India is relatively low compared to the western countries. Nevertheless, an increase by 1% yearly has been recorded in the last three years, thereby making early diagnosis of prostate cancer crucial for controlling its incidence. Differentiating between benign and malignant lesions has been a diagnostic dilemma, especially in prostate pathology. This is compounded by unavailability of modern tests in certain regions of developing nations. METHODS A cohort of one hundred seventy six prostatomegaly patients used in the current study was obtained both retrospectively and prospectively at the Jawaharlal Nehru Medical College, Sawangi, Wardha, Maharashtra, India. Details of the patients were recorded which included their age. The samples were then cut into 5 sections, each of 5micron thickness. One section was preserved and the other 4 sections were subjected to Hematoxylin and Eosin (H and E), Periodic Acid-Schiff (PAS), Alcian Blue and AgNOR stains. Degree of differentiation was estimated and correlated with the Gleason score and the outcome of the stainings. RESULTS Majority of benign prostatic hyperplasia and all primary carcinoma patients were in their sixth to eighth decade of life. While all the benign lesions were negative, 6 out of 9 primary prostate carcinomas were positive for Alcian Blue stain. Majority of both benign and malignant lesions were positive for Periodic Acid Schiff (PAS) stain. In terms of Argyrophilic Nucleolar Organiser Region (AgNOR) count per nucleus, the value in benign lesions was observed to be half the count observed in malignant lesions per nucleus. CONCLUSION Although the potential use of the orthodox stains individually may not serve the purpose to differentiate between benign and malignant lesions, together they may have the potential to identify relatively more malignant cases. This may be helpful especially in low socio-economic countries and rural areas where molecular based tests may not yet be available.
Collapse
Affiliation(s)
- Anchit Khanna
- Adult Cancer Program, Lowy Cancer Centre and Prince of Wales Hospital, UNSW Medicine, University of New South Wales , Sydney, Australia
| | - Rani Patil
- Department of Pathology, Jawaharlal Nehru Medical College , Wardha, Maharashtra, India
| | - Abhay Deshmukh
- Department of Surgery, Jawaharlal Nehru Medical College , Wardha, Maharashtra, India
| |
Collapse
|
24
|
Nuclear morphometry, epigenetic changes, and clinical relevance in prostate cancer. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2013; 773:77-99. [PMID: 24563344 PMCID: PMC7123969 DOI: 10.1007/978-1-4899-8032-8_4] [Citation(s) in RCA: 20] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Nuclear structure alterations in cancer involve global genetic (mutations, amplifications, copy number variations, translocations, etc.) and epigenetic (DNA methylation and histone modifications) events that dramatically and dynamically spatially change chromatin, nuclear body, and chromosome organization. In prostate cancer (CaP) there appears to be early (<50 years) versus late (>60 years) onset clinically significant cancers, and we have yet to clearly understand the hereditary and somatic-based molecular pathways involved. We do know that once cancer is initiated, dedifferentiation of the prostate gland occurs with significant changes in nuclear structure driven by numerous genetic and epigenetic processes. This review focuses upon the nuclear architecture and epigenetic dynamics with potential translational clinically relevant applications to CaP. Further, the review correlates changes in the cancer-driven epigenetic process at the molecular level and correlates these alterations to nuclear morphological quantitative measurements. Finally, we address how we can best utilize this knowledge to improve the efficacy of personalized treatment of cancer.
Collapse
|
25
|
Gorelick L, Veksler O, Gaed M, Gomez JA, Moussa M, Bauman G, Fenster A, Ward AD. Prostate histopathology: learning tissue component histograms for cancer detection and classification. IEEE TRANSACTIONS ON MEDICAL IMAGING 2013; 32:1804-1818. [PMID: 23739794 DOI: 10.1109/tmi.2013.2265334] [Citation(s) in RCA: 63] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
Radical prostatectomy is performed on approximately 40% of men with organ-confined prostate cancer. Pathologic information obtained from the prostatectomy specimen provides important prognostic information and guides recommendations for adjuvant treatment. The current pathology protocol in most centers involves primarily qualitative assessment. In this paper, we describe and evaluate our system for automatic prostate cancer detection and grading on hematoxylin & eosin-stained tissue images. Our approach is intended to address the dual challenges of large data size and the need for high-level tissue information about the locations and grades of tumors. Our system uses two stages of AdaBoost-based classification. The first provides high-level tissue component labeling of a superpixel image partitioning. The second uses the tissue component labeling to provide a classification of cancer versus noncancer, and low-grade versus high-grade cancer. We evaluated our system using 991 sub-images extracted from digital pathology images of 50 whole-mount tissue sections from 15 prostatectomy patients. We measured accuracies of 90% and 85% for the cancer versus noncancer and high-grade versus low-grade classification tasks, respectively. This system represents a first step toward automated cancer quantification on prostate digital histopathology imaging, which could pave the way for more accurately informed postprostatectomy patient care.
Collapse
|
26
|
Galaro J, Judkins AR, Ellison D, Baccon J, Madabhushi A. An integrated texton and bag of words classifier for identifying anaplastic medulloblastomas. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2012; 2011:3443-6. [PMID: 22255080 DOI: 10.1109/iembs.2011.6090931] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
In this paper we present a combined Bag of Words and texton based classifier for differentiating anaplastic and non-anaplastic medulloblastoma on digitized histopathology. The hypothesis behind this work is that histological image signatures may reflect different levels of aggressiveness of the disease and that texture based approaches can help discriminate between more aggressive and less aggressive phenotypes of medulloblastoma. The bag of words approach attempts to model the occurrence of differently expressed image features. In this work we choose to model the image features via textons which can quantitatively capture and model texture appearance in the images. The texton-based features, obtained via two methods, the Haar Wavelet responses and MR8 filter bank, provide spatial orientation and rotation invariant attributes. Applying these features to the bag of words framework yields textural representations that can be used in conjunction with a classifier (κ-nearest neighbor) or a content based image retrieval system. Over multiple runs of randomized cross validation, a κ-NN classifier in conjunction with Haar wavelets and the texton, bag of words approach yielded a mean classification accuracy of 80, an area under the precision recall curve of 87 and an area under the ROC curve of 83 in distinguishing between anaplastic and non-anaplastic medulloblastomas on a cohort of 36 patient studies.
Collapse
Affiliation(s)
- Joseph Galaro
- Rutgers, Department of Biomedical Engineering. Piscataway, NJ, USA
| | | | | | | | | |
Collapse
|
27
|
Cooper LAD, Carter AB, Farris AB, Wang F, Kong J, Gutman DA, Widener P, Pan TC, Cholleti SR, Sharma A, Kurc TM, Brat DJ, Saltz JH. Digital Pathology: Data-Intensive Frontier in Medical Imaging: Health-information sharing, specifically of digital pathology, is the subject of this paper which discusses how sharing the rich images in pathology can stretch the capabilities of all otherwise well-practiced disciplines. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2012; 100:991-1003. [PMID: 25328166 PMCID: PMC4197933 DOI: 10.1109/jproc.2011.2182074] [Citation(s) in RCA: 22] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Pathology is a medical subspecialty that practices the diagnosis of disease. Microscopic examination of tissue reveals information enabling the pathologist to render accurate diagnoses and to guide therapy. The basic process by which anatomic pathologists render diagnoses has remained relatively unchanged over the last century, yet advances in information technology now offer significant opportunities in image-based diagnostic and research applications. Pathology has lagged behind other healthcare practices such as radiology where digital adoption is widespread. As devices that generate whole slide images become more practical and affordable, practices will increasingly adopt this technology and eventually produce an explosion of data that will quickly eclipse the already vast quantities of radiology imaging data. These advances are accompanied by significant challenges for data management and storage, but they also introduce new opportunities to improve patient care by streamlining and standardizing diagnostic approaches and uncovering disease mechanisms. Computer-based image analysis is already available in commercial diagnostic systems, but further advances in image analysis algorithms are warranted in order to fully realize the benefits of digital pathology in medical discovery and patient care. In coming decades, pathology image analysis will extend beyond the streamlining of diagnostic workflows and minimizing interobserver variability and will begin to provide diagnostic assistance, identify therapeutic targets, and predict patient outcomes and therapeutic responses.
Collapse
Affiliation(s)
- Lee A. D. Cooper
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Alexis B. Carter
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA 30306 USA
| | - Alton B. Farris
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA 30306 USA
| | - Fusheng Wang
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Jun Kong
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - David A. Gutman
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Patrick Widener
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Tony C. Pan
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Sharath R. Cholleti
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Ashish Sharma
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Tahsin M. Kurc
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Daniel J. Brat
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA 30306 USA
| | - Joel H. Saltz
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| |
Collapse
|
28
|
Cooper LAD, Kong J, Gutman DA, Wang F, Gao J, Appin C, Cholleti S, Pan T, Sharma A, Scarpace L, Mikkelsen T, Kurc T, Moreno CS, Brat DJ, Saltz JH. Integrated morphologic analysis for the identification and characterization of disease subtypes. J Am Med Inform Assoc 2012; 19:317-23. [PMID: 22278382 PMCID: PMC3277636 DOI: 10.1136/amiajnl-2011-000700] [Citation(s) in RCA: 73] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2011] [Accepted: 12/26/2011] [Indexed: 11/16/2022] Open
Abstract
BACKGROUND AND OBJECTIVE Morphologic variations of disease are often linked to underlying molecular events and patient outcome, suggesting that quantitative morphometric analysis may provide further insight into disease mechanisms. In this paper a methodology for the subclassification of disease is developed using image analysis techniques. Morphologic signatures that represent patient-specific tumor morphology are derived from the analysis of hundreds of millions of cells in digitized whole slide images. Clustering these signatures aggregates tumors into groups with cohesive morphologic characteristics. This methodology is demonstrated with an analysis of glioblastoma, using data from The Cancer Genome Atlas to identify a prognostically significant morphology-driven subclassification, in which clusters are correlated with transcriptional, genetic, and epigenetic events. MATERIALS AND METHODS Methodology was applied to 162 glioblastomas from The Cancer Genome Atlas to identify morphology-driven clusters and their clinical and molecular correlates. Signatures of patient-specific tumor morphology were generated from analysis of 200 million cells in 462 whole slide images. Morphology-driven clusters were interrogated for associations with patient outcome, response to therapy, molecular classifications, and genetic alterations. An additional layer of deep, genome-wide analysis identified characteristic transcriptional, epigenetic, and copy number variation events. RESULTS AND DISCUSSION Analysis of glioblastoma identified three prognostically significant patient clusters (median survival 15.3, 10.7, and 13.0 months, log rank p=1.4e-3). Clustering results were validated in a separate dataset. Clusters were characterized by molecular events in nuclear compartment signaling including developmental and cell cycle checkpoint pathways. This analysis demonstrates the potential of high-throughput morphometrics for the subclassification of disease, establishing an approach that complements genomics.
Collapse
Affiliation(s)
- Lee A D Cooper
- Center for Comprehensive Informatics, Emory University, Atlanta, Georgia 30322, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
29
|
Jiao Y, Berman H, Kiehl TR, Torquato S. Spatial organization and correlations of cell nuclei in brain tumors. PLoS One 2011; 6:e27323. [PMID: 22110626 PMCID: PMC3217938 DOI: 10.1371/journal.pone.0027323] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2011] [Accepted: 10/13/2011] [Indexed: 01/11/2023] Open
Abstract
Accepting the hypothesis that cancers are self-organizing, opportunistic systems, it is crucial to understand the collective behavior of cancer cells in their tumorous heterogeneous environment. In the present paper, we ask the following basic question: Is this self-organization of tumor evolution reflected in the manner in which malignant cells are spatially distributed in their heterogeneous environment? We employ a variety of nontrivial statistical microstructural descriptors that arise in the theory of heterogeneous media to characterize the spatial distributions of the nuclei of both benign brain white matter cells and brain glioma cells as obtained from histological images. These descriptors, which include the pair correlation function, structure factor and various nearest neighbor functions, quantify how pairs of cell nuclei are correlated in space in various ways. We map the centroids of the cell nuclei into point distributions to show that while commonly used local spatial statistics (e.g., cell areas and number of neighboring cells) cannot clearly distinguish spatial correlations in distributions of normal and abnormal cell nuclei, their salient structural features are captured very well by the aforementioned microstructural descriptors. We show that the tumorous cells pack more densely than normal cells and exhibit stronger effective repulsions between any pair of cells. Moreover, we demonstrate that brain gliomas are organized in a collective way rather than randomly on intermediate and large length scales. The existence of nontrivial spatial correlations between the abnormal cells strongly supports the view that cancer is not an unorganized collection of malignant cells but rather a complex emergent integrated system.
Collapse
Affiliation(s)
- Yang Jiao
- Physical Science in Oncology Center, Princeton Institute for the Science and Technology of Materials, Princeton University, Princeton, New Jersey, United States of America
| | - Hal Berman
- Department of Laboratory Medicine and Pathobiology, Campbell Family Institute for Cancer Research, University of Toronto, Toronto, Ontario, Canada
| | - Tim-Rasmus Kiehl
- Department of Pathology, University Health Network, Toronto Department of Laboratory Medicine and Pathobiology, University of Toronto, Toronto, Ontario, Canada
| | - Salvatore Torquato
- Department of Chemistry and Physics, Program in Applied and Computational Mathematics, Princeton Center for Theoretical Science, Physical Science in Oncology Center, Princeton Institute for the Science and Technology of Materials, Princeton University, Princeton, New Jersey, United States of America
- * E-mail:
| |
Collapse
|