1
|
Roszkowiak L, Korzynska A, Siemion K, Zak J, Pijanowska D, Bosch R, Lejeune M, Lopez C. System for quantitative evaluation of DAB&H-stained breast cancer biopsy digital images (CHISEL). Sci Rep 2021; 11:9291. [PMID: 33927266 PMCID: PMC8085130 DOI: 10.1038/s41598-021-88611-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/11/2020] [Accepted: 04/14/2021] [Indexed: 02/02/2023] Open
Abstract
This study presents CHISEL (Computer-assisted Histopathological Image Segmentation and EvaLuation), an end-to-end system capable of quantitative evaluation of benign and malignant (breast cancer) digitized tissue samples with immunohistochemical nuclear staining of various intensity and diverse compactness. It stands out with the proposed seamless segmentation based on regions of interest cropping as well as the explicit step of nuclei cluster splitting followed by a boundary refinement. The system utilizes machine learning and recursive local processing to eliminate distorted (inaccurate) outlines. The method was validated using two labeled datasets which proved the relevance of the achieved results. The evaluation was based on the IISPV dataset of tissue from biopsy of breast cancer patients, with markers of T cells, along with Warwick Beta Cell Dataset of DAB&H-stained tissue from postmortem diabetes patients. Based on the comparison of the ground truth with the results of the detected and classified objects, we conclude that the proposed method can achieve better or similar results as the state-of-the-art methods. This system deals with the complex problem of nuclei quantification in digitalized images of immunohistochemically stained tissue sections, achieving best results for DAB&H-stained breast cancer tissue samples. Our method has been prepared with user-friendly graphical interface and was optimized to fully utilize the available computing power, while being accessible to users with fewer resources than needed by deep learning techniques.
Collapse
Affiliation(s)
- Lukasz Roszkowiak
- Nalecz Institute of Biocybernetics and Biomedical Engineering Polish Academy of Sciences, Ks. Trojdena 4 st., 02-109, Warsaw, Poland.
| | - Anna Korzynska
- Nalecz Institute of Biocybernetics and Biomedical Engineering Polish Academy of Sciences, Ks. Trojdena 4 st., 02-109, Warsaw, Poland
| | - Krzysztof Siemion
- Nalecz Institute of Biocybernetics and Biomedical Engineering Polish Academy of Sciences, Ks. Trojdena 4 st., 02-109, Warsaw, Poland
- Medical Pathomorphology Department, Medical University of Bialystok, Białystok, Poland
| | - Jakub Zak
- Nalecz Institute of Biocybernetics and Biomedical Engineering Polish Academy of Sciences, Ks. Trojdena 4 st., 02-109, Warsaw, Poland
| | - Dorota Pijanowska
- Nalecz Institute of Biocybernetics and Biomedical Engineering Polish Academy of Sciences, Ks. Trojdena 4 st., 02-109, Warsaw, Poland
| | - Ramon Bosch
- Pathology Department, Hospital de Tortosa Verge de la Cinta, Institut d'Investigacio Sanitaria Pere Virgili (IISPV), URV, Tortosa, Spain
| | - Marylene Lejeune
- Molecular Biology and Research Section, Hospital de Tortosa Verge de la Cinta, Institut d'Investigacio Sanitaria Pere Virgili (IISPV), URV, Tortosa, Spain
| | - Carlos Lopez
- Molecular Biology and Research Section, Hospital de Tortosa Verge de la Cinta, Institut d'Investigacio Sanitaria Pere Virgili (IISPV), URV, Tortosa, Spain
| |
Collapse
|
2
|
Abstract
Histopathological images (HIs) are the gold standard for evaluating some types of tumors for cancer diagnosis. The analysis of such images is time and resource-consuming and very challenging even for experienced pathologists, resulting in inter-observer and intra-observer disagreements. One of the ways of accelerating such an analysis is to use computer-aided diagnosis (CAD) systems. This paper presents a review on machine learning methods for histopathological image analysis, including shallow and deep learning methods. We also cover the most common tasks in HI analysis, such as segmentation and feature extraction. Besides, we present a list of publicly available and private datasets that have been used in HI research.
Collapse
|
3
|
Song TH, Sanchez V, EIDaly H, Rajpoot NM. Dual-Channel Active Contour Model for Megakaryocytic Cell Segmentation in Bone Marrow Trephine Histology Images. IEEE Trans Biomed Eng 2017; 64:2913-2923. [DOI: 10.1109/tbme.2017.2690863] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
4
|
Yi F, Huang J, Yang L, Xie Y, Xiao G. Automatic extraction of cell nuclei from H&E-stained histopathological images. J Med Imaging (Bellingham) 2017; 4:027502. [PMID: 28653017 PMCID: PMC5478972 DOI: 10.1117/1.jmi.4.2.027502] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2017] [Accepted: 05/31/2017] [Indexed: 12/15/2022] Open
Abstract
Extraction of cell nuclei from hematoxylin and eosin (H&E)-stained histopathological images is an essential preprocessing step in computerized image analysis for disease detection, diagnosis, and prognosis. We present an automated cell nuclei segmentation approach that works with H&E-stained images. A color deconvolution algorithm was first applied to the image to get the hematoxylin channel. Using a morphological operation and thresholding technique on the hematoxylin channel image, candidate target nuclei and background regions were detected, which were then used as markers for a marker-controlled watershed transform segmentation algorithm. Moreover, postprocessing was conducted to split the touching nuclei. For each segmented region from the previous steps, the regional maximum value positions were identified as potential nuclei centers. These maximum values were further grouped into [Formula: see text]-clusters, and the locations within each cluster were connected with the minimum spanning tree technique. Then, these connected positions were utilized as new markers for a watershed segmentation approach. The final number of nuclei at each region was determined by minimizing an objective function that iterated all of the possible [Formula: see text]-values. The proposed method was applied to the pathological images of the tumor tissues from The Cancer Genome Atlas study. Experimental results show that the proposed method can lead to promising results in terms of segmentation accuracy and separation of touching nuclei.
Collapse
Affiliation(s)
- Faliu Yi
- University of Texas Southwestern Medical Center, Quantitative Biomedical Research Center, Department of Clinical Science, Dallas, Texas, United States
| | - Junzhou Huang
- University of Texas at Arlington, Department of Computer Science and Engineering, Arlington, Texas, United States
| | - Lin Yang
- University of Texas Southwestern Medical Center, Quantitative Biomedical Research Center, Department of Clinical Science, Dallas, Texas, United States
- Chinese Academy of Medical Science and Peking Union Medical College, National Cancer Center/Cancer Hospital, Department of Pathology, Chaoyang District, Beijing, China
| | - Yang Xie
- University of Texas Southwestern Medical Center, Quantitative Biomedical Research Center, Department of Clinical Science, Dallas, Texas, United States
- University of Texas Southwestern Medical Center, Department of Bioinformatics, Dallas, Texas, United States
- University of Texas Southwestern Medical Center, Harold C. Simmons Comprehensive Cancer Center, Dallas, Texas, United States
| | - Guanghua Xiao
- University of Texas Southwestern Medical Center, Quantitative Biomedical Research Center, Department of Clinical Science, Dallas, Texas, United States
- University of Texas Southwestern Medical Center, Department of Bioinformatics, Dallas, Texas, United States
- University of Texas Southwestern Medical Center, Harold C. Simmons Comprehensive Cancer Center, Dallas, Texas, United States
| |
Collapse
|
5
|
Irshad H, Veillard A, Roux L, Racoceanu D. Methods for nuclei detection, segmentation, and classification in digital histopathology: a review-current status and future potential. IEEE Rev Biomed Eng 2014; 7:97-114. [PMID: 24802905 DOI: 10.1109/rbme.2013.2295804] [Citation(s) in RCA: 281] [Impact Index Per Article: 25.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Digital pathology represents one of the major evolutions in modern medicine. Pathological examinations constitute the gold standard in many medical protocols, and also play a critical and legal role in the diagnosis process. In the conventional cancer diagnosis, pathologists analyze biopsies to make diagnostic and prognostic assessments, mainly based on the cell morphology and architecture distribution. Recently, computerized methods have been rapidly evolving in the area of digital pathology, with growing applications related to nuclei detection, segmentation, and classification. In cancer research, these approaches have played, and will continue to play a key (often bottleneck) role in minimizing human intervention, consolidating pertinent second opinions, and providing traceable clinical information. Pathological studies have been conducted for numerous cancer detection and grading applications, including brain, breast, cervix, lung, and prostate cancer grading. Our study presents, discusses, and extracts the major trends from an exhaustive overview of various nuclei detection, segmentation, feature computation, and classification techniques used in histopathology imagery, specifically in hematoxylin-eosin and immunohistochemical staining protocols. This study also enables us to measure the challenges that remain, in order to reach robust analysis of whole slide images, essential high content imaging with diagnostic biomarkers and prognosis support in digital pathology.
Collapse
|
6
|
Moreno JC, Surya Prasath V, Proença H, Palaniappan K. Fast and globally convex multiphase active contours for brain MRI segmentation. COMPUTER VISION AND IMAGE UNDERSTANDING 2014; 125:237-250. [DOI: 10.1016/j.cviu.2014.04.010] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
7
|
Histopathology tissue segmentation by combining fuzzy clustering with multiphase vector level sets. ADVANCES IN EXPERIMENTAL MEDICINE AND BIOLOGY 2011; 696:413-24. [PMID: 21431581 DOI: 10.1007/978-1-4419-7046-6_41] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/07/2023]
Abstract
High resolution, multispectral, and multimodal imagery of tissue biopsies is an indispensable source of information for diagnosis and prognosis of diseases. Automatic extraction of relevant features from these imagery is a valuable assistance for medical experts. A primary step in computational histology is accurate image segmentation to detect the number and spatial distribution of cell nuclei in the tissue, along with segmenting other structures such as lumen and epithelial regions which together make up a gland structure. This chapter presents an automatic segmentation system for histopathology imaging. Spatial constraint fuzzy C-means provides an unsupervised initialization. An active contour algorithm that combines multispectral edge and region informations through a vector multiphase level set framework and Beltrami color metric tensors refines the segmentation. An improved iterative kernel filtering approach detects individual nuclei centers and decomposes densely clustered nuclei structures. The obtained results show high performances for nuclei detection compared to the human annotation.
Collapse
|
8
|
Nath SK, Palaniappan K. Fast Graph Partitioning Active Contours for Image Segmentation Using Histograms. EURASIP JOURNAL ON IMAGE AND VIDEO PROCESSING 2010; 2009:820986. [PMID: 35599853 PMCID: PMC9121993] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
We present a method to improve the accuracy and speed, as well as significantly reduce the memory requirements, for the recently proposed Graph Partitioning Active Contours (GPACs) algorithm for image segmentation in the work of Sumengen and Manjunath (2006). Instead of computing an approximate but still expensive dissimilarity matrix of quadratic size, ( N s 2 M s 2 ) ∕ ( n s m s ) , for a 2D image of size Ns ×Ms and regular image tiles of size ns ×ms , we use fixed length histograms and an intensity-based symmetric-centrosymmetric extensor matrix to jointly compute terms associated with the complete NsMs × NsMs dissimilarity matrix. This computationally efficient reformulation of GPAC using a very small memory footprint offers two distinct advantages over the original implementation. It speeds up convergence of the evolving active contour and seamlessly extends performance of GPAC to multidimensional images.
Collapse
Affiliation(s)
- Sumit K Nath
- Department of Computer Science, University of Missouri, Columbia, MO 65211, USA
| | | |
Collapse
|