1
|
Li Z, Li C, Luo X, Zhou Y, Zhu J, Xu C, Yang M, Wu Y, Chen Y. Toward Source-Free Cross Tissues Histopathological Cell Segmentation via Target-Specific Finetuning. IEEE TRANSACTIONS ON MEDICAL IMAGING 2023; 42:2666-2677. [PMID: 37030826 DOI: 10.1109/tmi.2023.3263465] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/19/2023]
Abstract
Recognition and quantitative analytics of histopathological cells are the golden standard for diagnosing multiple cancers. Despite recent advances in deep learning techniques that have been widely investigated for the automated segmentation of various types of histopathological cells, the heavy dependency on specific histopathological image types with sufficient supervised annotations, as well as the limited access to clinical data in hospitals, still pose significant challenges in the application of computer-aided diagnosis in pathology. In this paper, we focus on the model generalization of cell segmentation towards cross-tissue histopathological images. Remarkably, a novel target-specific finetuning-based self-supervised domain adaptation framework is proposed to transfer the cell segmentation model to unlabeled target datasets, without access to source datasets and annotations. When performed on the target unlabeled histopathological image set, the proposed method only needs to tune very few parameters of the pre-trained model in a self-supervised manner. Considering the morphological properties of pathological cells, we introduce two constraint terms at both local and global levels into this framework to access more reliable predictions. The proposed cross-domain framework is validated on three different types of histopathological tissues, showing promising performance in self-supervised cell segmentation. Additionally, the whole framework can be further applied to clinical tools in pathology without accessing the original training image data. The code and dataset are released at: https://github.com/NeuronXJTU/SFDA-CellSeg.
Collapse
|
2
|
An H, Ding L, Ma M, Huang A, Gan Y, Sheng D, Jiang Z, Zhang X. Deep Learning-Based Recognition of Cervical Squamous Interepithelial Lesions. Diagnostics (Basel) 2023; 13:diagnostics13101720. [PMID: 37238206 DOI: 10.3390/diagnostics13101720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2023] [Revised: 05/05/2023] [Accepted: 05/10/2023] [Indexed: 05/28/2023] Open
Abstract
Cervical squamous intraepithelial lesions (SILs) are precursor lesions of cervical cancer, and their accurate diagnosis enables patients to be treated before malignancy manifests. However, the identification of SILs is usually laborious and has low diagnostic consistency due to the high similarity of pathological SIL images. Although artificial intelligence (AI), especially deep learning algorithms, has drawn a lot of attention for its good performance in cervical cytology tasks, the use of AI for cervical histology is still in its early stages. The feature extraction, representation capabilities, and use of p16 immunohistochemistry (IHC) among existing models are inadequate. Therefore, in this study, we first designed a squamous epithelium segmentation algorithm and assigned the corresponding labels. Second, p16-positive area of IHC slides were extracted with Whole Image Net (WI-Net), followed by mapping the p16-positive area back to the H&E slides and generating a p16-positive mask for training. Finally, the p16-positive areas were inputted into Swin-B and ResNet-50 to classify the SILs. The dataset comprised 6171 patches from 111 patients; patches from 80% of the 90 patients were used for the training set. The accuracy of the Swin-B method for high-grade squamous intraepithelial lesion (HSIL) that we propose was 0.914 [0.889-0.928]. The ResNet-50 model for HSIL achieved an area under the receiver operating characteristic curve (AUC) of 0.935 [0.921-0.946] at the patch level, and the accuracy, sensitivity, and specificity were 0.845, 0.922, and 0.829, respectively. Therefore, our model can accurately identify HSIL, assisting the pathologist in solving actual diagnostic issues and even directing the follow-up treatment of patients.
Collapse
Affiliation(s)
- Huimin An
- Department of Pathology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
| | - Liya Ding
- Department of Pathology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
| | - Mengyuan Ma
- Zhejiang Dahua Technology Co., Ltd., Hangzhou 310053, China
| | - Aihua Huang
- Department of Pathology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
| | - Yi Gan
- Department of Pathology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
| | - Danli Sheng
- Department of Pathology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
| | - Zhinong Jiang
- Department of Pathology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
| | - Xin Zhang
- Department of Pathology, Sir Run Run Shaw Hospital, Zhejiang University School of Medicine, Hangzhou 310016, China
| |
Collapse
|
3
|
Vu QD, Rajpoot K, Raza SEA, Rajpoot N. Handcrafted Histological Transformer (H2T): Unsupervised representation of whole slide images. Med Image Anal 2023; 85:102743. [PMID: 36702037 DOI: 10.1016/j.media.2023.102743] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Revised: 11/30/2022] [Accepted: 01/05/2023] [Indexed: 01/20/2023]
Abstract
Diagnostic, prognostic and therapeutic decision-making of cancer in pathology clinics can now be carried out based on analysis of multi-gigapixel tissue images, also known as whole-slide images (WSIs). Recently, deep convolutional neural networks (CNNs) have been proposed to derive unsupervised WSI representations; these are attractive as they rely less on expert annotation which is cumbersome. However, a major trade-off is that higher predictive power generally comes at the cost of interpretability, posing a challenge to their clinical use where transparency in decision-making is generally expected. To address this challenge, we present a handcrafted framework based on deep CNN for constructing holistic WSI-level representations. Building on recent findings about the internal working of the Transformer in the domain of natural language processing, we break down its processes and handcraft them into a more transparent framework that we term as the Handcrafted Histological Transformer or H2T. Based on our experiments involving various datasets consisting of a total of 10,042 WSIs, the results demonstrate that H2T based holistic WSI-level representations offer competitive performance compared to recent state-of-the-art methods and can be readily utilized for various downstream analysis tasks. Finally, our results demonstrate that the H2T framework can be up to 14 times faster than the Transformer models.
Collapse
Affiliation(s)
- Quoc Dang Vu
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, UK
| | - Kashif Rajpoot
- School of Computer Science, University of Birmingham, UK
| | - Shan E Ahmed Raza
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, UK
| | - Nasir Rajpoot
- Tissue Image Analytics Centre, Department of Computer Science, University of Warwick, UK; The Alan Turing Institute, London, UK; Department of Pathology, University Hospitals Coventry & Warwickshire, UK.
| |
Collapse
|
4
|
A Novel Lightweight Deep Learning-Based Histopathological Image Classification Model for IoMT. Neural Process Lett 2023; 55:205-228. [PMID: 34121912 PMCID: PMC8185315 DOI: 10.1007/s11063-021-10555-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 06/02/2021] [Indexed: 11/24/2022]
Abstract
The unavailability of appropriate mechanisms for timely detection of diseases and successive treatment causes the death of a large number of people around the globe. The timely diagnosis of grave diseases like different forms of cancer and other life-threatening diseases can save a valuable life or at least extend the life span of an afflicted individual. The advancement of the Internet of Medical Things (IoMT) enabled healthcare technologies can provide effective medical facilities to the population and contribute greatly towards the recuperation of patients. The usage of IoMT in the diagnosis and study of histopathological images can enable real-time identification of diseases and corresponding remedial actions can be taken to save an affected individual. This can be achieved by the use of imaging apparatus with the capacity of auto-analysis of captured images. However, most deep learning-based image classifying models are bulk in size and are inappropriate for use in IoT based imaging devices. The objective of this research work is to design a deep learning-based lightweight model suitable for histopathological image analysis with appreciable accuracy. This paper presents a novel lightweight deep learning-based model "ReducedFireNet", for auto-classification of histopathological images. The proposed method attained a mean accuracy of 96.88% and an F1 score of 0.968 on evaluating an actual histopathological image data set. The results are encouraging, considering the complexity of histopathological images. In addition to the high accuracy the lightweight design (size in few KBs) of the ReducedFireNet model, makes it suitable for IoMT imaging equipment. The simulation results show the proposed model has computational requirement of 0.201 GFLOPS and has a mere size of only 0.391 MB.
Collapse
|
5
|
Kim I, Kang K, Song Y, Kim TJ. Application of Artificial Intelligence in Pathology: Trends and Challenges. Diagnostics (Basel) 2022; 12:diagnostics12112794. [PMID: 36428854 PMCID: PMC9688959 DOI: 10.3390/diagnostics12112794] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2022] [Revised: 11/03/2022] [Accepted: 11/11/2022] [Indexed: 11/16/2022] Open
Abstract
Given the recent success of artificial intelligence (AI) in computer vision applications, many pathologists anticipate that AI will be able to assist them in a variety of digital pathology tasks. Simultaneously, tremendous advancements in deep learning have enabled a synergy with artificial intelligence (AI), allowing for image-based diagnosis on the background of digital pathology. There are efforts for developing AI-based tools to save pathologists time and eliminate errors. Here, we describe the elements in the development of computational pathology (CPATH), its applicability to AI development, and the challenges it faces, such as algorithm validation and interpretability, computing systems, reimbursement, ethics, and regulations. Furthermore, we present an overview of novel AI-based approaches that could be integrated into pathology laboratory workflows.
Collapse
Affiliation(s)
- Inho Kim
- College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul 06591, Republic of Korea
| | - Kyungmin Kang
- College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul 06591, Republic of Korea
| | - Youngjae Song
- College of Medicine, The Catholic University of Korea, 222 Banpo-daero, Seocho-gu, Seoul 06591, Republic of Korea
| | - Tae-Jung Kim
- Department of Hospital Pathology, Yeouido St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, 10, 63-ro, Yeongdeungpo-gu, Seoul 07345, Republic of Korea
- Correspondence: ; Tel.: +82-2-3779-2157
| |
Collapse
|
6
|
Allahqoli L, Laganà AS, Mazidimoradi A, Salehiniya H, Günther V, Chiantera V, Karimi Goghari S, Ghiasvand MM, Rahmani A, Momenimovahed Z, Alkatout I. Diagnosis of Cervical Cancer and Pre-Cancerous Lesions by Artificial Intelligence: A Systematic Review. Diagnostics (Basel) 2022; 12:2771. [PMID: 36428831 PMCID: PMC9689914 DOI: 10.3390/diagnostics12112771] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2022] [Revised: 11/06/2022] [Accepted: 11/10/2022] [Indexed: 11/16/2022] Open
Abstract
OBJECTIVE The likelihood of timely treatment for cervical cancer increases with timely detection of abnormal cervical cells. Automated methods of detecting abnormal cervical cells were established because manual identification requires skilled pathologists and is time consuming and prone to error. The purpose of this systematic review is to evaluate the diagnostic performance of artificial intelligence (AI) technologies for the prediction, screening, and diagnosis of cervical cancer and pre-cancerous lesions. MATERIALS AND METHODS Comprehensive searches were performed on three databases: Medline, Web of Science Core Collection (Indexes = SCI-EXPANDED, SSCI, A & HCI Timespan) and Scopus to find papers published until July 2022. Articles that applied any AI technique for the prediction, screening, and diagnosis of cervical cancer were included in the review. No time restriction was applied. Articles were searched, screened, incorporated, and analyzed in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses guidelines. RESULTS The primary search yielded 2538 articles. After screening and evaluation of eligibility, 117 studies were incorporated in the review. AI techniques were found to play a significant role in screening systems for pre-cancerous and cancerous cervical lesions. The accuracy of the algorithms in predicting cervical cancer varied from 70% to 100%. AI techniques make a distinction between cancerous and normal Pap smears with 80-100% accuracy. AI is expected to serve as a practical tool for doctors in making accurate clinical diagnoses. The reported sensitivity and specificity of AI in colposcopy for the detection of CIN2+ were 71.9-98.22% and 51.8-96.2%, respectively. CONCLUSION The present review highlights the acceptable performance of AI systems in the prediction, screening, or detection of cervical cancer and pre-cancerous lesions, especially when faced with a paucity of specialized centers or medical resources. In combination with human evaluation, AI could serve as a helpful tool in the interpretation of cervical smears or images.
Collapse
Affiliation(s)
- Leila Allahqoli
- Midwifery Department, Ministry of Health and Medical Education, Tehran 1467664961, Iran
| | - Antonio Simone Laganà
- Unit of Gynecologic Oncology, ARNAS “Civico-Di Cristina-Benfratelli”, Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (PROMISE), University of Palermo, 90127 Palermo, Italy
| | - Afrooz Mazidimoradi
- Neyriz Public Health Clinic, Shiraz University of Medical Sciences, Shiraz 7134814336, Iran
| | - Hamid Salehiniya
- Social Determinants of Health Research Center, Birjand University of Medical Sciences, Birjand 9717853577, Iran
| | - Veronika Günther
- University Hospitals Schleswig-Holstein, Campus Kiel, Kiel School of Gynaecological Endoscopy, Arnold-Heller-Str. 3, Haus 24, 24105 Kiel, Germany
| | - Vito Chiantera
- Unit of Gynecologic Oncology, ARNAS “Civico-Di Cristina-Benfratelli”, Department of Health Promotion, Mother and Child Care, Internal Medicine and Medical Specialties (PROMISE), University of Palermo, 90127 Palermo, Italy
| | - Shirin Karimi Goghari
- School of Industrial and Systems Engineering, Tarbiat Modares University (TMU), Tehran 1411713114, Iran
| | - Mohammad Matin Ghiasvand
- Department of Computer Engineering, Amirkabir University of Technology (AUT), Tehran 1591634311, Iran
| | - Azam Rahmani
- Nursing and Midwifery Care Research Centre, School of Nursing and Midwifery, Tehran University of Medical Sciences, Tehran 141973317, Iran
| | - Zohre Momenimovahed
- Reproductive Health Department, Qom University of Medical Sciences, Qom 3716993456, Iran
| | - Ibrahim Alkatout
- University Hospitals Schleswig-Holstein, Campus Kiel, Kiel School of Gynaecological Endoscopy, Arnold-Heller-Str. 3, Haus 24, 24105 Kiel, Germany
| |
Collapse
|
7
|
Blocker SJ, Cook J, Everitt JI, Austin WM, Watts TL, Mowery YM. Automated Nuclear Segmentation in Head and Neck Squamous Cell Carcinoma Pathology Reveals Relationships between Cytometric Features and ESTIMATE Stromal and Immune Scores. THE AMERICAN JOURNAL OF PATHOLOGY 2022; 192:1305-1320. [PMID: 35718057 PMCID: PMC9484476 DOI: 10.1016/j.ajpath.2022.06.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Revised: 05/26/2022] [Accepted: 06/02/2022] [Indexed: 04/09/2023]
Abstract
The tumor microenvironment (TME) plays an important role in the progression of head and neck squamous cell carcinoma (HNSCC). Currently, pathologic assessment of TME is nonstandardized and subject to observer bias. Genome-wide transcriptomic approaches to understanding the TME, while less subject to bias, are expensive and not currently a part of the standard of care for HNSCC. To identify pathology-based biomarkers that correlate with genomic and transcriptomic signatures of TME in HNSCC, cytometric feature maps were generated in a publicly available data set from a cohort of patients with HNSCC, including whole-slide tissue images and genomic and transcriptomic phenotyping (N = 49). Cytometric feature maps were generated based on whole-slide nuclear detection, using a deep-learning algorithm trained for StarDist nuclear segmentation. Cytometric features in each patient were compared to transcriptomic measurements, including Estimation of Stromal and Immune Cells in Malignant Tumor Tissues Using Expression Data (ESTIMATE) scores and stemness scores. With correction for multiple comparisons, one feature (nuclear circularity) demonstrated a significant linear correlation with ESTIMATE stromal score. Two features (nuclear maximum and minimum diameter) correlated significantly with ESTIMATE immune score. Three features (nuclear solidity, nuclear minimum diameter, and nuclear circularity) correlated significantly with transcriptomic stemness score. This study provides preliminary evidence that observer-independent, automated tissue-slide analysis can provide insights into the HNSCC TME which correlate with genomic and transcriptomic assessments.
Collapse
Affiliation(s)
- Stephanie J Blocker
- Center for In Vivo Microscopy, Duke University Medical Center, Durham, North Carolina.
| | - James Cook
- Center for In Vivo Microscopy, Duke University Medical Center, Durham, North Carolina
| | | | - Wyatt M Austin
- Center for In Vivo Microscopy, Duke University Medical Center, Durham, North Carolina
| | - Tammara L Watts
- Department of Head and Neck Surgery & Communication Sciences, Duke University School of Medicine, Durham, North Carolina
| | - Yvonne M Mowery
- Department of Head and Neck Surgery & Communication Sciences, Duke University School of Medicine, Durham, North Carolina; Department of Radiation Oncology, Duke University Medical Center, Durham, North Carolina
| |
Collapse
|
8
|
Petroleum Pipeline Interface Recognition and Pose Detection Based on Binocular Stereo Vision. Processes (Basel) 2022. [DOI: 10.3390/pr10091722] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022] Open
Abstract
Liquified natural gas (LNG) manipulator arms have been widely used in natural gas transportation. However, the automatic docking technology of LNG manipulator arms has not yet been realized. The first step of automatic docking is to identify and locate the target and estimate its pose. This work proposes a petroleum pipeline interface recognition and pose judgment method based on binocular stereo vision technology for the automatic docking of LNG manipulator arms. The proposed method has three main steps, including target detection, 3D information acquisition, and plane fitting. First, the target petroleum pipeline interface is segmented by using a color mask. Then, color space and Hu moment are used to obtain the pixel coordinates of the contour and center of the target petroleum pipeline interface. The semi-global block matching (SGBM) algorithm is used for stereo matching to obtain the depth information of an image. Finally, a plane fitting and center point estimation method based on a random sample consensus (RANSAC) algorithm is proposed. This work performs a measurement accuracy verification experiment to verify the accuracy of the proposed method. The experimental results show that the distance measurement error is not more than 1% and the angle measurement error is less than one degree. The measurement accuracy of the method meets the requirements of subsequent automatic docking, which proves the feasibility of the proposed method and provides data support for the subsequent automatic docking of manipulator arms.
Collapse
|
9
|
Prabhu S, Prasad K, Robels-Kelly A, Lu X. AI-based carcinoma detection and classification using histopathological images: A systematic review. Comput Biol Med 2022; 142:105209. [DOI: 10.1016/j.compbiomed.2022.105209] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 01/01/2022] [Accepted: 01/01/2022] [Indexed: 02/07/2023]
|
10
|
Cho BJ, Kim JW, Park J, Kwon GY, Hong M, Jang SH, Bang H, Kim G, Park ST. Automated Diagnosis of Cervical Intraepithelial Neoplasia in Histology Images via Deep Learning. Diagnostics (Basel) 2022; 12:diagnostics12020548. [PMID: 35204638 PMCID: PMC8871214 DOI: 10.3390/diagnostics12020548] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2021] [Revised: 02/05/2022] [Accepted: 02/17/2022] [Indexed: 02/04/2023] Open
Abstract
Artificial intelligence has enabled the automated diagnosis of several cancer types. We aimed to develop and validate deep learning models that automatically classify cervical intraepithelial neoplasia (CIN) based on histological images. Microscopic images of CIN3, CIN2, CIN1, and non-neoplasm were obtained. The performances of two pre-trained convolutional neural network (CNN) models adopting DenseNet-161 and EfficientNet-B7 architectures were evaluated and compared with those of pathologists. The dataset comprised 1106 images from 588 patients; images of 10% of patients were included in the test dataset. The mean accuracies for the four-class classification were 88.5% (95% confidence interval [CI], 86.3–90.6%) by DenseNet-161 and 89.5% (95% CI, 83.3–95.7%) by EfficientNet-B7, which were similar to human performance (93.2% and 89.7%). The mean per-class area under the receiver operating characteristic curve values by EfficientNet-B7 were 0.996, 0.990, 0.971, and 0.956 in the non-neoplasm, CIN3, CIN1, and CIN2 groups, respectively. The class activation map detected the diagnostic area for CIN lesions. In the three-class classification of CIN2 and CIN3 as one group, the mean accuracies of DenseNet-161 and EfficientNet-B7 increased to 91.4% (95% CI, 88.8–94.0%), and 92.6% (95% CI, 90.4–94.9%), respectively. CNN-based deep learning is a promising tool for diagnosing CIN lesions on digital histological images.
Collapse
Affiliation(s)
- Bum-Joo Cho
- Medical Artificial Intelligence Center, Hallym University Medical Center, Anyang 14068, Korea;
- Department of Ophthalmology, Hallym University Sacred Heart Hospital, Hallym University College of Medicine, Anyang 14068, Korea
- Correspondence: (B.-J.C.); (J.-W.K.)
| | - Jeong-Won Kim
- Department of Pathology, Kangnam Sacred Heart Hospital, Hallym University College of Medicine, Seoul 07441, Korea;
- Correspondence: (B.-J.C.); (J.-W.K.)
| | - Jungkap Park
- Medical Artificial Intelligence Center, Hallym University Medical Center, Anyang 14068, Korea;
| | | | - Mineui Hong
- Department of Pathology, Chung-Ang University Hospital, Chung-Ang University College of Medicine, Seoul 06973, Korea;
| | - Si-Hyong Jang
- Department of Pathology, Soonchunhyang University Cheonan Hospital, Soonchunhyang University College of Medicine, Cheonan 31151, Korea;
| | - Heejin Bang
- Department of Pathology, Konkuk University Medical Center, Konkuk University School of Medicine, Seoul 05030, Korea;
| | - Gilhyang Kim
- Department of Pathology, Kangnam Sacred Heart Hospital, Hallym University College of Medicine, Seoul 07441, Korea;
| | - Sung-Taek Park
- Department of Obstetrics and Gynecology, Kangnam Sacred Heart Hospital, Hallym University College of Medicine, Seoul 07441, Korea;
| |
Collapse
|
11
|
Pal A, Xue Z, Desai K, Aina F Banjo A, Adepiti CA, Long LR, Schiffman M, Antani S. Deep multiple-instance learning for abnormal cell detection in cervical histopathology images. Comput Biol Med 2021; 138:104890. [PMID: 34601391 DOI: 10.1016/j.compbiomed.2021.104890] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2021] [Revised: 09/15/2021] [Accepted: 09/22/2021] [Indexed: 01/18/2023]
Abstract
Cervical cancer is a disease of significant concern affecting women's health worldwide. Early detection of and treatment at the precancerous stage can help reduce mortality. High-grade cervical abnormalities and precancer are confirmed using microscopic analysis of cervical histopathology. However, manual analysis of cervical biopsy slides is time-consuming, needs expert pathologists, and suffers from reader variability errors. Prior work in the literature has suggested using automated image analysis algorithms for analyzing cervical histopathology images captured with the whole slide digital scanners (e.g., Aperio, Hamamatsu, etc.). However, whole-slide digital tissue scanners with good optical magnification and acceptable imaging quality are cost-prohibitive and difficult to acquire in low and middle-resource regions. Hence, the development of low-cost imaging systems and automated image analysis algorithms are of critical importance. Motivated by this, we conduct an experimental study to assess the feasibility of developing a low-cost diagnostic system with the H&E stained cervical tissue image analysis algorithm. In our imaging system, the image acquisition is performed by a smartphone affixing it on the top of a commonly available light microscope which magnifies the cervical tissues. The images are not captured in a constant optical magnification, and, unlike whole-slide scanners, our imaging system is unable to record the magnification. The images are mega-pixel images and are labeled based on the presence of abnormal cells. In our dataset, there are total 1331 (train: 846, validation: 116 test: 369) images. We formulate the classification task as a deep multiple instance learning problem and quantitatively evaluate the classification performance of four different types of multiple instance learning algorithms trained with five different architectures designed with varying instance sizes. Finally, we designed a sparse attention-based multiple instance learning framework that can produce a maximum of 84.55% classification accuracy on the test set.
Collapse
Affiliation(s)
- Anabik Pal
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA.
| | - Zhiyun Xue
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA
| | - Kanan Desai
- National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | | | | | - L Rodney Long
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA
| | - Mark Schiffman
- National Cancer Institute, National Institutes of Health, Bethesda, MD, USA
| | - Sameer Antani
- National Library of Medicine, National Institutes of Health, Bethesda, MD, USA
| |
Collapse
|
12
|
Korzynska A, Roszkowiak L, Zak J, Siemion K. A review of current systems for annotation of cell and tissue images in digital pathology. Biocybern Biomed Eng 2021. [DOI: 10.1016/j.bbe.2021.04.012] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
|
13
|
A whole-slide image grading benchmark and tissue classification for cervical cancer precursor lesions with inter-observer variability. Med Biol Eng Comput 2021; 59:1545-1561. [PMID: 34245400 DOI: 10.1007/s11517-021-02388-w] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2020] [Accepted: 06/03/2021] [Indexed: 10/20/2022]
Abstract
The cervical cancer developing from the precancerous lesions caused by the human papillomavirus (HPV) has been one of the preventable cancers with the help of periodic screening. Cervical intraepithelial neoplasia (CIN) and squamous intraepithelial lesion (SIL) are two types of grading conventions widely accepted by pathologists. On the other hand, inter-observer variability is an important issue for final diagnosis. In this paper, a whole-slide image grading benchmark for cervical cancer precursor lesions is created and the "Uterine Cervical Cancer Database" introduced in this article is the first publicly available cervical tissue microscopy image dataset. In addition, a morphological feature representing the angle between the basal membrane (BM) and the major axis of each nucleus in the tissue is proposed. The presence of papillae of the cervical epithelium and overlapping cell problems are also discussed. Besides that, the inter-observer variability is also evaluated by thorough comparisons among decisions of pathologists, as well as the final diagnosis.
Collapse
|
14
|
Hoque IT, Ibtehaz N, Chakravarty S, Rahman MS, Rahman MS. A contour property based approach to segment nuclei in cervical cytology images. BMC Med Imaging 2021; 21:15. [PMID: 33509110 PMCID: PMC7841885 DOI: 10.1186/s12880-020-00533-9] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2020] [Accepted: 12/06/2020] [Indexed: 11/14/2022] Open
Abstract
Background Segmentation of nuclei in cervical cytology pap smear images is a crucial stage in automated cervical cancer screening. The task itself is challenging due to the presence of cervical cells with spurious edges, overlapping cells, neutrophils, and artifacts. Methods After the initial preprocessing steps of adaptive thresholding, in our approach, the image passes through a convolution filter to filter out some noise. Then, contours from the resultant image are filtered by their distinctive contour properties followed by a nucleus size recovery procedure based on contour average intensity value. Results We evaluate our method on a public (benchmark) dataset collected from ISBI and also a private real dataset. The results show that our algorithm outperforms other state-of-the-art methods in nucleus segmentation on the ISBI dataset with a precision of 0.978 and recall of 0.933. A promising precision of 0.770 and a formidable recall of 0.886 on the private real dataset indicate that our algorithm can effectively detect and segment nuclei on real cervical cytology images. Tuning various parameters, the precision could be increased to as high as 0.949 with an acceptable decrease of recall to 0.759. Our method also managed an Aggregated Jaccard Index of 0.681 outperforming other state-of-the-art methods on the real dataset. Conclusion We have proposed a contour property-based approach for segmentation of nuclei. Our algorithm has several tunable parameters and is flexible enough to adapt to real practical scenarios and requirements.
Collapse
Affiliation(s)
- Iram Tazim Hoque
- Department of CSE, BUET, ECE Building, West Palashi, Dhaka, Bangladesh
| | - Nabil Ibtehaz
- Department of CSE, BUET, ECE Building, West Palashi, Dhaka, Bangladesh
| | - Saumitra Chakravarty
- Department of Pathology, Bangabandhu Sheikh Mujib Medical University, Shahabag, Dhaka, Bangladesh
| | - M Saifur Rahman
- Department of CSE, BUET, ECE Building, West Palashi, Dhaka, Bangladesh
| | - M Sohel Rahman
- Department of CSE, BUET, ECE Building, West Palashi, Dhaka, Bangladesh.
| |
Collapse
|
15
|
Hu T, Xu X, Chen S, Liu Q. Accurate Neuronal Soma Segmentation Using 3D Multi-Task Learning U-Shaped Fully Convolutional Neural Networks. Front Neuroanat 2021; 14:592806. [PMID: 33551758 PMCID: PMC7860594 DOI: 10.3389/fnana.2020.592806] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2020] [Accepted: 12/02/2020] [Indexed: 12/12/2022] Open
Abstract
Neuronal soma segmentation is a crucial step for the quantitative analysis of neuronal morphology. Automated neuronal soma segmentation methods have opened up the opportunity to improve the time-consuming manual labeling required during the neuronal soma morphology reconstruction for large-scale images. However, the presence of touching neuronal somata and variable soma shapes in images brings challenges for automated algorithms. This study proposes a neuronal soma segmentation method combining 3D U-shaped fully convolutional neural networks with multi-task learning. Compared to existing methods, this technique applies multi-task learning to predict the soma boundary to split touching somata, and adopts U-shaped architecture convolutional neural network which is effective for a limited dataset. The contour-aware multi-task learning framework is applied to the proposed method to predict the masks of neuronal somata and boundaries simultaneously. In addition, a spatial attention module is embedded into the multi-task model to improve neuronal soma segmentation results. The Nissl-stained dataset captured by the micro-optical sectioning tomography system is used to validate the proposed method. Following comparison to four existing segmentation models, the proposed method outperforms the others notably in both localization and segmentation. The novel method has potential for high-throughput neuronal soma segmentation in large-scale optical imaging data for neuron morphology quantitative analysis.
Collapse
Affiliation(s)
- Tianyu Hu
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.,MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Huazhong University of Science and Technology, Wuhan, China
| | - Xiaofeng Xu
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.,MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Huazhong University of Science and Technology, Wuhan, China
| | - Shangbin Chen
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.,MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Huazhong University of Science and Technology, Wuhan, China
| | - Qian Liu
- Britton Chance Center for Biomedical Photonics, Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China.,MoE Key Laboratory for Biomedical Photonics, School of Engineering Sciences, Huazhong University of Science and Technology, Wuhan, China.,School of Biomedical Engineering, Hainan University, Haikou, China
| |
Collapse
|
16
|
AF-SENet: Classification of Cancer in Cervical Tissue Pathological Images Based on Fusing Deep Convolution Features. SENSORS 2020; 21:s21010122. [PMID: 33375508 PMCID: PMC7795214 DOI: 10.3390/s21010122] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/16/2020] [Revised: 12/03/2020] [Accepted: 12/24/2020] [Indexed: 11/26/2022]
Abstract
Cervical cancer is the fourth most common cancer in the world. Whole-slide images (WSIs) are an important standard for the diagnosis of cervical cancer. Missed diagnoses and misdiagnoses often occur due to the high similarity in pathological cervical images, the large number of readings, the long reading time, and the insufficient experience levels of pathologists. Existing models have insufficient feature extraction and representation capabilities, and they suffer from insufficient pathological classification. Therefore, this work first designs an image processing algorithm for data augmentation. Second, the deep convolutional features are extracted by fine-tuning pre-trained deep network models, including ResNet50 v2, DenseNet121, Inception v3, VGGNet19, and Inception-ResNet, and then local binary patterns and a histogram of the oriented gradient to extract traditional image features are used. Third, the features extracted by the fine-tuned models are serially fused according to the feature representation ability parameters and the accuracy of multiple experiments proposed in this paper, and spectral embedding is used for dimension reduction. Finally, the fused features are inputted into the Analysis of Variance-F value-Spectral Embedding Net (AF-SENet) for classification. There are four different pathological images of the dataset: normal, low-grade squamous intraepithelial lesion (LSIL), high-grade squamous intraepithelial lesion (HSIL), and cancer. The dataset is divided into a training set (90%) and a test set (10%). The serial fusion effect of the deep features extracted by Resnet50v2 and DenseNet121 (C5) is the best, with average classification accuracy reaching 95.33%, which is 1.07% higher than ResNet50 v2 and 1.05% higher than DenseNet121. The recognition ability is significantly improved, especially in LSIL, reaching 90.89%, which is 2.88% higher than ResNet50 v2 and 2.1% higher than DenseNet121. Thus, this method significantly improves the accuracy and generalization ability of pathological cervical WSI recognition by fusing deep features.
Collapse
|
17
|
Deng S, Zhang X, Yan W, Chang EIC, Fan Y, Lai M, Xu Y. Deep learning in digital pathology image analysis: a survey. Front Med 2020; 14:470-487. [PMID: 32728875 DOI: 10.1007/s11684-020-0782-9] [Citation(s) in RCA: 46] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/19/2019] [Accepted: 03/05/2020] [Indexed: 12/21/2022]
Abstract
Deep learning (DL) has achieved state-of-the-art performance in many digital pathology analysis tasks. Traditional methods usually require hand-crafted domain-specific features, and DL methods can learn representations without manually designed features. In terms of feature extraction, DL approaches are less labor intensive compared with conventional machine learning methods. In this paper, we comprehensively summarize recent DL-based image analysis studies in histopathology, including different tasks (e.g., classification, semantic segmentation, detection, and instance segmentation) and various applications (e.g., stain normalization, cell/gland/region structure analysis). DL methods can provide consistent and accurate outcomes. DL is a promising tool to assist pathologists in clinical diagnosis.
Collapse
Affiliation(s)
- Shujian Deng
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China
| | - Xin Zhang
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China
| | - Wen Yan
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China
| | | | - Yubo Fan
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China
| | - Maode Lai
- Department of Pathology, School of Medicine, Zhejiang University, Hangzhou, 310007, China
| | - Yan Xu
- School of Biological Science and Medical Engineering, Beihang University, Beijing, 100191, China.
- Key Laboratory of Biomechanics and Mechanobiology of Ministry of Education and State Key Laboratory of Software Development Environment, Beihang University, Beijing, 100191, China.
- Beijing Advanced Innovation Center for Biomedical Engineering, Beihang University, Beijing, 100191, China.
- Microsoft Research Asia, Beijing, 100080, China.
| |
Collapse
|
18
|
Konstandinou C, Kostopoulos S, Glotsos D, Pappa D, Ravazoula P, Michail G, Kalatzis I, Asvestas P, Lavdas E, Cavouras D, Sakellaropoulos G. GPU-enabled design of an adaptable pattern recognition system for discriminating squamous intraepithelial lesions of the cervix. ACTA ACUST UNITED AC 2020; 65:315-325. [PMID: 31747374 DOI: 10.1515/bmt-2019-0040] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2019] [Accepted: 08/30/2019] [Indexed: 11/15/2022]
Abstract
The aim of the present study was to design an adaptable pattern recognition (PR) system to discriminate low- from high-grade squamous intraepithelial lesions (LSIL and HSIL, respectively) of the cervix using microscopy images of hematoxylin and eosin (H&E)-stained biopsy material from two different medical centers. Clinical material comprised H&E-stained biopsies of 66 patients diagnosed with LSIL (34 cases) or HSIL (32 cases). Regions of interest were selected from each patient's digitized microscopy images. Seventy-seven features were generated, regarding the texture, morphology and spatial distribution of nuclei. The probabilistic neural network (PNN) classifier, the exhaustive search feature selection method, the leave-one-out (LOO) and the bootstrap validation methods were used to design the PR system and to assess its precision. Optimal PR system design and evaluation were made feasible by the employment of graphics processing unit (GPU) and Compute Unified Device Architecture (CUDA) technologies. The accuracy of the PR-system was 93% and 88.6% when using the LOO and bootstrap validation methods, respectively. The proposed PR system for discriminating LSIL from HSIL of the cervix was designed to operate in a clinical environment, having the capability of being redesigned when new verified cases are added to its repository and when data from other medical centers are included, following similar biopsy material preparation procedures.
Collapse
Affiliation(s)
- Christos Konstandinou
- Department of Medical Physics, School of Health Sciences, Faculty of Medicine, University of Patras, Rio, Patras, Greece
| | - Spiros Kostopoulos
- Medical Image and Signal Processing Laboratory (MEDISP), Department of Biomedical Engineering, University of West Attica, Ag. Spyridonos Street, Egaleo, 122 43 Athens, Greece
| | - Dimitris Glotsos
- Medical Image and Signal Processing Laboratory (MEDISP), Department of Biomedical Engineering, University of West Attica, Athens, Greece
| | - Dimitra Pappa
- Department of Pathology, IASO Thessalias, Larissa, Greece
| | | | - George Michail
- Department of Obstetrics and Gynecology, University Hospital of Patras, Rio, Greece
| | - Ioannis Kalatzis
- Medical Image and Signal Processing Laboratory (MEDISP), Department of Biomedical Engineering, University of West Attica, Athens, Greece
| | - Pantelis Asvestas
- Medical Image and Signal Processing Laboratory (MEDISP), Department of Biomedical Engineering, University of West Attica, Athens, Greece
| | - Eleftherios Lavdas
- Department of Biomedical Sciences, University of West Attica, Athens, Greece
| | - Dionisis Cavouras
- Medical Image and Signal Processing Laboratory (MEDISP), Department of Biomedical Engineering, University of West Attica, Athens, Greece
| | - George Sakellaropoulos
- Department of Medical Physics, School of Health Sciences, Faculty of Medicine, University of Patras, Rio, Patras, Greece
| |
Collapse
|
19
|
|
20
|
AlMubarak HA, Stanley J, Guo P, Long R, Antani S, Thoma G, Zuna R, Frazier S, Stoecker W. A Hybrid Deep Learning and Handcrafted Feature Approach for Cervical Cancer Digital Histology Image Classification. INTERNATIONAL JOURNAL OF HEALTHCARE INFORMATION SYSTEMS AND INFORMATICS 2019. [DOI: 10.4018/ijhisi.2019040105] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Cervical cancer is the second most common cancer affecting women worldwide but is curable if diagnosed early. Routinely, expert pathologists visually examine histology slides for assessing cervix tissue abnormalities. A localized, fusion-based, hybrid imaging and deep learning approach is explored to classify squamous epithelium into cervical intraepithelial neoplasia (CIN) grades for a dataset of 83 digitized histology images. Partitioning the epithelium region into 10 vertical segments, 27 handcrafted image features and rectangular patch, sliding window-based convolutional neural network features are computed for each segment. The imaging and deep learning patch features are combined and used as inputs to a secondary classifier for individual segment and whole epithelium classification. The hybrid method achieved a 15.51% and 11.66% improvement over the deep learning and imaging approaches alone, respectively, with a 80.72% whole epithelium CIN classification accuracy, showing the enhanced epithelium CIN classification potential of fusing image and deep learning features.
Collapse
Affiliation(s)
- Haidar A AlMubarak
- Missouri University of Science and Technology, Rolla, USA & Advanced Lab for Intelligent Systems Rresearch, Department of Computer Engineering, College of Information and Computer Sciences, King Saud University, Riyadh, Saudi Arabia & Electrical and Computer Engineering Department, Missouri University of Science and Technology, Rolla, USA
| | - Joe Stanley
- Missouri University of Science and Technology, Rolla, USA
| | - Peng Guo
- Missouri University of Science and Technology, Rolla, USA
| | - Rodney Long
- Lister Hill National Center for Biomedical Communications for National Library of Medicine, Bethesda, USA
| | - Sameer Antani
- Lister Hill National Center for Biomedical Communications for National Library of Medicine, Bethesda, USA
| | - George Thoma
- Lister Hill National Center for Biomedical Communications for National Library of Medicine, Bethesda, USA
| | - Rosemary Zuna
- Department of Pathology for the University of Oklahoma Health Sciences Center, Oklahoma City, USA
| | | | - William Stoecker
- The Dermatology Center, Missouri University of Science and Technology, Rolla, USA
| |
Collapse
|
21
|
Evaluation of Microscopic Changes in Fallopian Tubes of BRCA Mutation Carriers by Morphometric Analysis of Histologic Slides: A Preliminary Pilot Study. Int J Gynecol Pathol 2018; 37:460-467. [PMID: 28863070 DOI: 10.1097/pgp.0000000000000440] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/30/2023]
Abstract
Mutations in BRCA genes increase the risk of ovarian cancer, yet no method for early diagnosis is available. Some serous ovarian tumors are hypothesized to stem from cells of the fallopian tube fimbria. Using a novel method of computerized morphometry of the fimbrial epithelium, this study aimed to detect morphologic differences in noncancerous fimbriae between BRCA mutation carriers and noncarriers, and between healthy and serous ovarian cancer patients. Twenty-four fimbriae from healthy women (13 BRCA+, 11 BRCA-) and 21 fimbriae from women with serous ovarian cancer (10 BRCA+, 11 BRCA-), all reported as "normal" by hematoxylin and eosin examination, were subjected to computerized histomorphometric analysis. A Fast Fourier Transformation was applied to images of fimbrial epithelium and the Fast Fourier Transformation 2-dimensional frequency maps were subsequently quantified for nuclear orientation and planar distribution by a cooccurrence matrix analysis. Additional analysis of nuclear contour was applied to the fimbriae of the healthy women. Among the healthy women, significant differences were found in morphometric characteristics between the BRCA mutation carriers and noncarriers. Among the women with ovarian cancer, no significant differences were found between BRCA mutation carriers and noncarriers. Between healthy women and those with ovarian cancer, significant differences were detected, regardless of BRCA mutational status. A novel method, which combined Fast Fourier Transformation with cooccurrence matrix analysis, demonstrated differences in morphometric characteristics in the fimbriae between healthy and ovarian cancer patients, and between BRCA mutation carriers and noncarriers. The clinical significance of these observations should be investigated.
Collapse
|
22
|
Multifeature Quantification of Nuclear Properties from Images of H&E-Stained Biopsy Material for Investigating Changes in Nuclear Structure with Advancing CIN Grade. JOURNAL OF HEALTHCARE ENGINEERING 2018; 2018:6358189. [PMID: 30073048 PMCID: PMC6057323 DOI: 10.1155/2018/6358189] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/13/2017] [Revised: 05/03/2018] [Accepted: 06/03/2018] [Indexed: 01/27/2023]
Abstract
Background Cervical dysplasia is a precancerous condition, and if left untreated, it may lead to cervical cancer, which is the second most common cancer in women. The purpose of this study was to investigate differences in nuclear properties of the H&E-stained biopsy material between low CIN and high CIN cases and associate those properties with the CIN grade. Methods The clinical material comprised hematoxylin and eosin- (H&E-) stained biopsy specimens from lesions of 44 patients diagnosed with cervical intraepithelial neoplasia (CIN). Four or five nonoverlapping microscopy images were digitized from each patient's H&E specimens, from regions indicated by the expert physician. Sixty-three textural and morphological nuclear features were generated for each patient's images. The Wilcoxon statistical test and the point biserial correlation were used to estimate each feature's discriminatory power between low CIN and high CIN cases and its correlation with the advancing CIN grade, respectively. Results Statistical analysis showed 19 features that quantify nuclear shape, size, and texture and sustain statistically significant differences between low CIN and high CIN cases. These findings revealed that nuclei in high CIN cases, as compared to nuclei in low CIN cases, have more irregular shape, are larger in size, are coarser in texture, contain higher edges, have higher local contrast, are more inhomogeneous, and comprise structures of different intensities. Conclusion A systematic statistical analysis of nucleus features, quantified from the H&E-stained biopsy material, showed that there are significant differences in the shape, size, and texture of nuclei between low CIN and high CIN cases.
Collapse
|
23
|
Nag R, Kumar Das R. Analysis of images for detection of oral epithelial dysplasia: A review. Oral Oncol 2018; 78:8-15. [PMID: 29496062 DOI: 10.1016/j.oraloncology.2018.01.003] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2017] [Revised: 01/02/2018] [Accepted: 01/07/2018] [Indexed: 10/18/2022]
Abstract
This paper provides a review of various image analysis approaches that have been previously used for recognition of dysplasia in images of the epithelium of the oral cavity. This domain has become especially admissible with the uncovering of the importance of image analysis which can probably be an aid to subjective diagnosis by histopathologists. Oral malignancy is a rampant form of cancer found among people of the Indian subcontinent due to various deleterious habits like consumption of tobacco, areca nut, betel leaf etc. Oral Submucous Fibrosis, a precancer, whose pathological category falls between normal epithelium and epithelial dysplasia, is caused because of these habits and can ultimately lead to oral cancer. Hence early detection of this condition is necessary. Image analysis methods for this purpose have an enormous potential which can also reduce the heavy workload of pathologists and to refine the criterion of interpretation. This paper starts with a critique of statistics of oral carcinoma in India and distribution of cancer in intra-oral sites and moves on to its causes and diagnostic approaches including causative agents, problems in curative approach and importance of image analysis in cancer detection. The various image analysis methods to appraise the cytological and architectural changes accompanied by Oral Epithelial Dysplasia in the images of the oral epithelial region have been described in relation to 2005 WHO Classification System and it was found that in future, analysis of images based on the mentioned methods has the potential in better interpretation and diagnosis of oral carcinoma.
Collapse
Affiliation(s)
- Reetoja Nag
- Centre for Biomaterials, Cellular, and Molecular Theranostics, VIT University, Vellore 632014, India.
| | - Raunak Kumar Das
- Centre for Biomaterials, Cellular, and Molecular Theranostics, VIT University, Vellore 632014, India; School of Biotechnology and Biomolecular Sciences, University of New South Wales, Sydney, Australia.
| |
Collapse
|
24
|
Wei L, Gan Q, Ji T. Cervical cancer histology image identification method based on texture and lesion area features. Comput Assist Surg (Abingdon) 2017; 22:186-199. [PMID: 29037083 DOI: 10.1080/24699322.2017.1389397] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022] Open
Abstract
The issue of an automated approach for detecting cervical cancer is proposed to improve the accuracy of recognition. Firstly, the cervical cancer histology source images are needed to use image preprocessing for reducing the impact brought by noise of images as well as the impact on subsequent precise feature extraction brought by irrelevant background. Secondly, the images are grouped into ten vertical images and the information of texture feature is extracted by Grey Level Co-occurrence Matrix (GLCM). GLCM is an effective tool to analyze the features of texture. The textures of different diseases in the source image of Cervical Cancer Histology (such as contrast, correlation, entropy, uniformity and energy, etc.) can all be obtained in this way. Thirdly, the image is segmented by using K-means clustering and Marker-controlled watershed Algorithm. And each vertical image is divided into three layers to calculate the areas of different layers. Based on GLCM and lesion area features, the tissues are investigated with segmentation by using Support Vector Machine (SVM) method. Finally, the results show that it is effective and feasible to recognize cervical cancer by automated approach and verified by experiment.
Collapse
Affiliation(s)
- Lisheng Wei
- a Anhui Key Laboratory of Detection Technology and Energy Saving Devices , Anhui Polytechnic University , Wuhu , China
| | - Quan Gan
- b School of Electrical Engineering , Anhui Polytechnic University , Wuhu , China
| | - Tao Ji
- b School of Electrical Engineering , Anhui Polytechnic University , Wuhu , China
| |
Collapse
|
25
|
Almubarak HA, Stanley RJ, Long R, Antani S, Thoma G, Zuna R, Frazier SR. Convolutional Neural Network Based Localized Classification of Uterine Cervical Cancer Digital Histology Images. ACTA ACUST UNITED AC 2017. [DOI: 10.1016/j.procs.2017.09.044] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
|
26
|
Lannin TB, Thege FI, Kirby BJ. Comparison and optimization of machine learning methods for automated classification of circulating tumor cells. Cytometry A 2016; 89:922-931. [DOI: 10.1002/cyto.a.22993] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2015] [Revised: 08/15/2016] [Accepted: 09/15/2016] [Indexed: 12/11/2022]
Affiliation(s)
- Timothy B. Lannin
- Sibley School of Mechanical and Aerospace Engineering; Cornell University; Ithaca, NY U.S.A
| | - Fredrik I. Thege
- Department of Biomedical Engineering; Cornell University; Ithaca, NY U.S.A
| | - Brian J. Kirby
- Sibley School of Mechanical and Aerospace Engineering; Cornell University; Ithaca, NY U.S.A
- Division of Hematology & Medical Oncology, Department of Medicine; Weill Cornell Medicine; New York, NY U.S.A
| |
Collapse
|
27
|
Sokouti M, Sokouti B. ARTIFICIAL INTELLIGENT SYSTEMS APPLICATION IN CERVICAL CANCER PATHOLOGICAL CELL IMAGE CLASSIFICATION SYSTEMS — A REVIEW. BIOMEDICAL ENGINEERING: APPLICATIONS, BASIS AND COMMUNICATIONS 2016. [DOI: 10.4015/s1016237216300017] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Cervical cancer cell images play an important part in diagnosing the cancer among the females worldwide. Existing noises, overlapping cells, mucus, blood and air artifacts in cervical cancer cell images makes their classification a hard task. It makes it difficult for both pathologists and intelligent systems to segment and classify them into normal, pre-cancerous and cancerous cells. However, true cell segmentation is needed for pathologists to make for accurate diagnosis. In this paper, a review of algorithms used for cervical cancer cell image classification is presented. This includes pre-processing steps (noise reduction and cell segmentation/without segmentation), feature extraction, and intelligent diagnosis systems and their evaluations. Finally, future research trends on cervical cell classification to achieve complete accuracy are described.
Collapse
Affiliation(s)
- Massoud Sokouti
- Nuclear Medicine Research Center, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Babak Sokouti
- Biotechnology Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
| |
Collapse
|
28
|
Xing F, Yang L. Robust Nucleus/Cell Detection and Segmentation in Digital Pathology and Microscopy Images: A Comprehensive Review. IEEE Rev Biomed Eng 2016; 9:234-63. [PMID: 26742143 PMCID: PMC5233461 DOI: 10.1109/rbme.2016.2515127] [Citation(s) in RCA: 212] [Impact Index Per Article: 26.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Digital pathology and microscopy image analysis is widely used for comprehensive studies of cell morphology or tissue structure. Manual assessment is labor intensive and prone to interobserver variations. Computer-aided methods, which can significantly improve the objectivity and reproducibility, have attracted a great deal of interest in recent literature. Among the pipeline of building a computer-aided diagnosis system, nucleus or cell detection and segmentation play a very important role to describe the molecular morphological information. In the past few decades, many efforts have been devoted to automated nucleus/cell detection and segmentation. In this review, we provide a comprehensive summary of the recent state-of-the-art nucleus/cell segmentation approaches on different types of microscopy images including bright-field, phase-contrast, differential interference contrast, fluorescence, and electron microscopies. In addition, we discuss the challenges for the current methods and the potential future work of nucleus/cell detection and segmentation.
Collapse
|
29
|
Guo P, Banerjee K, Joe Stanley R, Long R, Antani S, Thoma G, Zuna R, Frazier SR, Moss RH, Stoecker WV. Nuclei-Based Features for Uterine Cervical Cancer Histology Image Analysis With Fusion-Based Classification. IEEE J Biomed Health Inform 2015; 20:1595-1607. [PMID: 26529792 DOI: 10.1109/jbhi.2015.2483318] [Citation(s) in RCA: 31] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
Abstract
Cervical cancer, which has been affecting women worldwide as the second most common cancer, can be cured if detected early and treated well. Routinely, expert pathologists visually examine histology slides for cervix tissue abnormality assessment. In previous research, we investigated an automated, localized, fusion-based approach for classifying squamous epithelium into Normal, CIN1, CIN2, and CIN3 grades of cervical intraepithelial neoplasia (CIN) based on image analysis of 61 digitized histology images. This paper introduces novel acellular and atypical cell concentration features computed from vertical segment partitions of the epithelium region within digitized histology images to quantize the relative increase in nuclei numbers as the CIN grade increases. Based on the CIN grade assessments from two expert pathologists, image-based epithelium classification is investigated with voting fusion of vertical segments using support vector machine and linear discriminant analysis approaches. Leave-one-out is used for the training and testing for CIN classification, achieving an exact grade labeling accuracy as high as 88.5%.
Collapse
|
30
|
Irshad H, Veillard A, Roux L, Racoceanu D. Methods for nuclei detection, segmentation, and classification in digital histopathology: a review-current status and future potential. IEEE Rev Biomed Eng 2014; 7:97-114. [PMID: 24802905 DOI: 10.1109/rbme.2013.2295804] [Citation(s) in RCA: 278] [Impact Index Per Article: 27.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Digital pathology represents one of the major evolutions in modern medicine. Pathological examinations constitute the gold standard in many medical protocols, and also play a critical and legal role in the diagnosis process. In the conventional cancer diagnosis, pathologists analyze biopsies to make diagnostic and prognostic assessments, mainly based on the cell morphology and architecture distribution. Recently, computerized methods have been rapidly evolving in the area of digital pathology, with growing applications related to nuclei detection, segmentation, and classification. In cancer research, these approaches have played, and will continue to play a key (often bottleneck) role in minimizing human intervention, consolidating pertinent second opinions, and providing traceable clinical information. Pathological studies have been conducted for numerous cancer detection and grading applications, including brain, breast, cervix, lung, and prostate cancer grading. Our study presents, discusses, and extracts the major trends from an exhaustive overview of various nuclei detection, segmentation, feature computation, and classification techniques used in histopathology imagery, specifically in hematoxylin-eosin and immunohistochemical staining protocols. This study also enables us to measure the challenges that remain, in order to reach robust analysis of whole slide images, essential high content imaging with diagnostic biomarkers and prognosis support in digital pathology.
Collapse
|
31
|
Hamilton PW, Bankhead P, Wang Y, Hutchinson R, Kieran D, McArt DG, James J, Salto-Tellez M. Digital pathology and image analysis in tissue biomarker research. Methods 2014; 70:59-73. [PMID: 25034370 DOI: 10.1016/j.ymeth.2014.06.015] [Citation(s) in RCA: 124] [Impact Index Per Article: 12.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2014] [Revised: 06/26/2014] [Accepted: 06/27/2014] [Indexed: 12/14/2022] Open
Abstract
Digital pathology and the adoption of image analysis have grown rapidly in the last few years. This is largely due to the implementation of whole slide scanning, advances in software and computer processing capacity and the increasing importance of tissue-based research for biomarker discovery and stratified medicine. This review sets out the key application areas for digital pathology and image analysis, with a particular focus on research and biomarker discovery. A variety of image analysis applications are reviewed including nuclear morphometry and tissue architecture analysis, but with emphasis on immunohistochemistry and fluorescence analysis of tissue biomarkers. Digital pathology and image analysis have important roles across the drug/companion diagnostic development pipeline including biobanking, molecular pathology, tissue microarray analysis, molecular profiling of tissue and these important developments are reviewed. Underpinning all of these important developments is the need for high quality tissue samples and the impact of pre-analytical variables on tissue research is discussed. This requirement is combined with practical advice on setting up and running a digital pathology laboratory. Finally, we discuss the need to integrate digital image analysis data with epidemiological, clinical and genomic data in order to fully understand the relationship between genotype and phenotype and to drive discovery and the delivery of personalized medicine.
Collapse
Affiliation(s)
- Peter W Hamilton
- Centre for Cancer Research & Cell Biology, Queen's University Belfast, 97 Lisburn Road, Belfast BT9 7BL, Northern Ireland, United Kingdom.
| | - Peter Bankhead
- Centre for Cancer Research & Cell Biology, Queen's University Belfast, 97 Lisburn Road, Belfast BT9 7BL, Northern Ireland, United Kingdom
| | - Yinhai Wang
- Centre for Cancer Research & Cell Biology, Queen's University Belfast, 97 Lisburn Road, Belfast BT9 7BL, Northern Ireland, United Kingdom
| | - Ryan Hutchinson
- Centre for Cancer Research & Cell Biology, Queen's University Belfast, 97 Lisburn Road, Belfast BT9 7BL, Northern Ireland, United Kingdom
| | - Declan Kieran
- Centre for Cancer Research & Cell Biology, Queen's University Belfast, 97 Lisburn Road, Belfast BT9 7BL, Northern Ireland, United Kingdom
| | - Darragh G McArt
- Centre for Cancer Research & Cell Biology, Queen's University Belfast, 97 Lisburn Road, Belfast BT9 7BL, Northern Ireland, United Kingdom
| | - Jacqueline James
- Centre for Cancer Research & Cell Biology, Queen's University Belfast, 97 Lisburn Road, Belfast BT9 7BL, Northern Ireland, United Kingdom
| | - Manuel Salto-Tellez
- Centre for Cancer Research & Cell Biology, Queen's University Belfast, 97 Lisburn Road, Belfast BT9 7BL, Northern Ireland, United Kingdom
| |
Collapse
|
32
|
Jusman Y, Ng SC, Abu Osman NA. Intelligent screening systems for cervical cancer. ScientificWorldJournal 2014; 2014:810368. [PMID: 24955419 PMCID: PMC4037632 DOI: 10.1155/2014/810368] [Citation(s) in RCA: 39] [Impact Index Per Article: 3.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2013] [Accepted: 02/11/2014] [Indexed: 12/20/2022] Open
Abstract
Advent of medical image digitalization leads to image processing and computer-aided diagnosis systems in numerous clinical applications. These technologies could be used to automatically diagnose patient or serve as second opinion to pathologists. This paper briefly reviews cervical screening techniques, advantages, and disadvantages. The digital data of the screening techniques are used as data for the computer screening system as replaced in the expert analysis. Four stages of the computer system are enhancement, features extraction, feature selection, and classification reviewed in detail. The computer system based on cytology data and electromagnetic spectra data achieved better accuracy than other data.
Collapse
Affiliation(s)
- Yessi Jusman
- Department of Biomedical Engineering, Faculty of Engineering Building, University of Malaya, 50603 Kuala Lumpur, Malaysia
| | - Siew Cheok Ng
- Department of Biomedical Engineering, Faculty of Engineering Building, University of Malaya, 50603 Kuala Lumpur, Malaysia
| | - Noor Azuan Abu Osman
- Department of Biomedical Engineering, Faculty of Engineering Building, University of Malaya, 50603 Kuala Lumpur, Malaysia
| |
Collapse
|
33
|
Litjens RJ, Van de Vijver KK, Hopman AH, Ummelen MI, Speel EJM, Sastrowijoto SH, Van Gorp T, Slangen BF, Kruitwagen RF, Krüse AJ. The majority of metachronous CIN1 and CIN3 lesions are caused by different human papillomavirus genotypes, indicating that the presence of CIN1 seems not to determine the risk for subsequent detection of CIN3. Hum Pathol 2014; 45:221-6. [DOI: 10.1016/j.humpath.2013.10.014] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2013] [Revised: 09/24/2013] [Accepted: 10/09/2013] [Indexed: 11/30/2022]
|
34
|
De S, Stanley RJ, Lu C, Long R, Antani S, Thoma G, Zuna R. A fusion-based approach for uterine cervical cancer histology image classification. Comput Med Imaging Graph 2013; 37:475-87. [PMID: 24075360 PMCID: PMC3904450 DOI: 10.1016/j.compmedimag.2013.08.001] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2012] [Revised: 06/12/2013] [Accepted: 08/12/2013] [Indexed: 11/21/2022]
Abstract
Expert pathologists commonly perform visual interpretation of histology slides for cervix tissue abnormality diagnosis. We investigated an automated, localized, fusion-based approach for cervix histology image analysis for squamous epithelium classification into Normal, CIN1, CIN2, and CIN3 grades of cervical intraepithelial neoplasia (CIN). The epithelium image analysis approach includes medial axis determination, vertical segment partitioning as medial axis orthogonal cuts, individual vertical segment feature extraction and classification, and image-based classification using a voting scheme fusing the vertical segment CIN grades. Results using 61 images showed at least 15.5% CIN exact grade classification improvement using the localized vertical segment fusion versus global image features.
Collapse
Affiliation(s)
- Soumya De
- Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, MO 65409-0040, USA
| | - R. Joe Stanley
- Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, MO 65409-0040, USA
| | - Cheng Lu
- Department of Electrical and Computer Engineering, Missouri University of Science and Technology, Rolla, MO 65409-0040, USA
| | - Rodney Long
- Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, DHHS, Bethesda, MD 20894, USA
| | - Sameer Antani
- Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, DHHS, Bethesda, MD 20894, USA
| | - George Thoma
- Lister Hill National Center for Biomedical Communications, National Library of Medicine, National Institutes of Health, DHHS, Bethesda, MD 20894, USA
| | - Rosemary Zuna
- Department of Pathology, University of Oklahoma Health Sciences Center, Oklahoma City, OK 73117, USA
| |
Collapse
|
35
|
Rathore S, Hussain M, Ali A, Khan A. A recent survey on colon cancer detection techniques. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2013; 10:545-63. [PMID: 24091390 DOI: 10.1109/tcbb.2013.84] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/15/2023]
Abstract
Colon cancer causes deaths of about half a million people every year. Common method of its detection is histopathological tissue analysis, which, though leads to vital diagnosis, is significantly correlated to the tiredness, experience, and workload of the pathologist. Researchers have been working since decades to get rid of manual inspection, and to develop trustworthy systems for detecting colon cancer. Several techniques, based on spectral/spatial analysis of colon biopsy images, and serum and gene analysis of colon samples, have been proposed in this regard. Due to rapid evolution of colon cancer detection techniques, a latest review of recent research in this field is highly desirable. The aim of this paper is to discuss various colon cancer detection techniques. In this survey, we categorize the techniques on the basis of the adopted methodology and underlying data set, and provide detailed description of techniques in each category. Additionally, this study provides an extensive comparison of various colon cancer detection categories, and of multiple techniques within each category. Further, most of the techniques have been evaluated on similar data set to provide a fair performance comparison. Analysis reveals that neither of the techniques is perfect; however, research community is progressively inching toward the finest possible solution.
Collapse
Affiliation(s)
- Saima Rathore
- DCIS, Pakistan Institute of Engineering and Applied Sciences, Nilore, Islamabad and University of Azad Jammu and Kashmir, Muzaffarabad, Azad Kashmir
| | | | | | | |
Collapse
|
36
|
|
37
|
Liu X, Tan J, Hatem I, Smith BL. Image processing of hematoxylin and eosin-stained tissues for pathological evaluation. Toxicol Mech Methods 2012; 14:301-7. [PMID: 20021110 DOI: 10.1080/15376520490434638] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Abstract
Color and geometric characteristics of stained areas in histochemical slides are among the features pathologists assess to evaluate the severity of lesions. In this research, image processing techniques were used to perform objective quantification of these characteristics in images of H&E-stained spleen tissues. A segmentation algorithm was developed to isolate the areas of interest in microscopic tissue images. Image features important to pathological evaluation were then extracted. These features were used to build statistical and neural network models to predict pathologist scores. A linear regression model predicted the scores to an R(2)-value of 0.6, and a neural network model classified samples to an accuracy of 75%. The results show the usefulness of image processing as a tool for pathological evaluation.
Collapse
Affiliation(s)
- Xioqiu Liu
- Department of Biological Engineering, University of Missouri, Columbia, Missouri, USA
| | | | | | | |
Collapse
|
38
|
He L, Long LR, Antani S, Thoma GR. Histology image analysis for carcinoma detection and grading. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2012; 107:538-56. [PMID: 22436890 PMCID: PMC3587978 DOI: 10.1016/j.cmpb.2011.12.007] [Citation(s) in RCA: 155] [Impact Index Per Article: 12.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/23/2010] [Revised: 09/27/2011] [Accepted: 12/13/2011] [Indexed: 05/25/2023]
Abstract
This paper presents an overview of the image analysis techniques in the domain of histopathology, specifically, for the objective of automated carcinoma detection and classification. As in other biomedical imaging areas such as radiology, many computer assisted diagnosis (CAD) systems have been implemented to aid histopathologists and clinicians in cancer diagnosis and research, which have been attempted to significantly reduce the labor and subjectivity of traditional manual intervention with histology images. The task of automated histology image analysis is usually not simple due to the unique characteristics of histology imaging, including the variability in image preparation techniques, clinical interpretation protocols, and the complex structures and very large size of the images themselves. In this paper we discuss those characteristics, provide relevant background information about slide preparation and interpretation, and review the application of digital image processing techniques to the field of histology image analysis. In particular, emphasis is given to state-of-the-art image segmentation methods for feature extraction and disease classification. Four major carcinomas of cervix, prostate, breast, and lung are selected to illustrate the functions and capabilities of existing CAD systems.
Collapse
Affiliation(s)
- Lei He
- National Library of Medicine, National Institutes of Health, 8600 Rockville Pike, Bethesda, MD, USA.
| | | | | | | |
Collapse
|
39
|
Cooper LAD, Carter AB, Farris AB, Wang F, Kong J, Gutman DA, Widener P, Pan TC, Cholleti SR, Sharma A, Kurc TM, Brat DJ, Saltz JH. Digital Pathology: Data-Intensive Frontier in Medical Imaging: Health-information sharing, specifically of digital pathology, is the subject of this paper which discusses how sharing the rich images in pathology can stretch the capabilities of all otherwise well-practiced disciplines. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2012; 100:991-1003. [PMID: 25328166 PMCID: PMC4197933 DOI: 10.1109/jproc.2011.2182074] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Pathology is a medical subspecialty that practices the diagnosis of disease. Microscopic examination of tissue reveals information enabling the pathologist to render accurate diagnoses and to guide therapy. The basic process by which anatomic pathologists render diagnoses has remained relatively unchanged over the last century, yet advances in information technology now offer significant opportunities in image-based diagnostic and research applications. Pathology has lagged behind other healthcare practices such as radiology where digital adoption is widespread. As devices that generate whole slide images become more practical and affordable, practices will increasingly adopt this technology and eventually produce an explosion of data that will quickly eclipse the already vast quantities of radiology imaging data. These advances are accompanied by significant challenges for data management and storage, but they also introduce new opportunities to improve patient care by streamlining and standardizing diagnostic approaches and uncovering disease mechanisms. Computer-based image analysis is already available in commercial diagnostic systems, but further advances in image analysis algorithms are warranted in order to fully realize the benefits of digital pathology in medical discovery and patient care. In coming decades, pathology image analysis will extend beyond the streamlining of diagnostic workflows and minimizing interobserver variability and will begin to provide diagnostic assistance, identify therapeutic targets, and predict patient outcomes and therapeutic responses.
Collapse
Affiliation(s)
- Lee A. D. Cooper
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Alexis B. Carter
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA 30306 USA
| | - Alton B. Farris
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA 30306 USA
| | - Fusheng Wang
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Jun Kong
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - David A. Gutman
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Patrick Widener
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Tony C. Pan
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Sharath R. Cholleti
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Ashish Sharma
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Tahsin M. Kurc
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| | - Daniel J. Brat
- Department of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA 30306 USA
| | - Joel H. Saltz
- Center for Comprehensive Informatics, Emory University, Atlanta, GA 30306 USA
| |
Collapse
|
40
|
Coupled analysis of in vitro and histology tissue samples to quantify structure-function relationship. PLoS One 2012; 7:e32227. [PMID: 22479315 PMCID: PMC3316529 DOI: 10.1371/journal.pone.0032227] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2011] [Accepted: 01/25/2012] [Indexed: 11/19/2022] Open
Abstract
The structure/function relationship is fundamental to our understanding of biological systems at all levels, and drives most, if not all, techniques for detecting, diagnosing, and treating disease. However, at the tissue level of biological complexity we encounter a gap in the structure/function relationship: having accumulated an extraordinary amount of detailed information about biological tissues at the cellular and subcellular level, we cannot assemble it in a way that explains the correspondingly complex biological functions these structures perform. To help close this information gap we define here several quantitative temperospatial features that link tissue structure to its corresponding biological function. Both histological images of human tissue samples and fluorescence images of three-dimensional cultures of human cells are used to compare the accuracy of in vitro culture models with their corresponding human tissues. To the best of our knowledge, there is no prior work on a quantitative comparison of histology and in vitro samples. Features are calculated from graph theoretical representations of tissue structures and the data are analyzed in the form of matrices and higher-order tensors using matrix and tensor factorization methods, with a goal of differentiating between cancerous and healthy states of brain, breast, and bone tissues. We also show that our techniques can differentiate between the structural organization of native tissues and their corresponding in vitro engineered cell culture models.
Collapse
|
41
|
Bilgin CC, Ray S, Baydil B, Daley WP, Larsen M, Yener B. Multiscale feature analysis of salivary gland branching morphogenesis. PLoS One 2012; 7:e32906. [PMID: 22403724 PMCID: PMC3293912 DOI: 10.1371/journal.pone.0032906] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/23/2011] [Accepted: 02/07/2012] [Indexed: 11/18/2022] Open
Abstract
Pattern formation in developing tissues involves dynamic spatio-temporal changes in cellular organization and subsequent evolution of functional adult structures. Branching morphogenesis is a developmental mechanism by which patterns are generated in many developing organs, which is controlled by underlying molecular pathways. Understanding the relationship between molecular signaling, cellular behavior and resulting morphological change requires quantification and categorization of the cellular behavior. In this study, tissue-level and cellular changes in developing salivary gland in response to disruption of ROCK-mediated signaling by are modeled by building cell-graphs to compute mathematical features capturing structural properties at multiple scales. These features were used to generate multiscale cell-graph signatures of untreated and ROCK signaling disrupted salivary gland organ explants. From confocal images of mouse submandibular salivary gland organ explants in which epithelial and mesenchymal nuclei were marked, a multiscale feature set capturing global structural properties, local structural properties, spectral, and morphological properties of the tissues was derived. Six feature selection algorithms and multiway modeling of the data was performed to identify distinct subsets of cell graph features that can uniquely classify and differentiate between different cell populations. Multiscale cell-graph analysis was most effective in classification of the tissue state. Cellular and tissue organization, as defined by a multiscale subset of cell-graph features, are both quantitatively distinct in epithelial and mesenchymal cell types both in the presence and absence of ROCK inhibitors. Whereas tensor analysis demonstrate that epithelial tissue was affected the most by inhibition of ROCK signaling, significant multiscale changes in mesenchymal tissue organization were identified with this analysis that were not identified in previous biological studies. We here show how to define and calculate a multiscale feature set as an effective computational approach to identify and quantify changes at multiple biological scales and to distinguish between different states in developing tissues.
Collapse
Affiliation(s)
- Cemal Cagatay Bilgin
- Rensselaer Polytechnic Institute, Computer Science Department, Troy, New York, United States of America
| | - Shayoni Ray
- University at Albany, State University of New York, Department of Biological Sciences, Albany, New York, United States of America
| | - Banu Baydil
- Rensselaer Polytechnic Institute, Computer Science Department, Troy, New York, United States of America
| | - William P. Daley
- University at Albany, State University of New York, Department of Biological Sciences, Albany, New York, United States of America
| | - Melinda Larsen
- University at Albany, State University of New York, Department of Biological Sciences, Albany, New York, United States of America
| | - Bülent Yener
- Rensselaer Polytechnic Institute, Computer Science Department, Troy, New York, United States of America
| |
Collapse
|
42
|
Issac Niwas S, Palanisamy P, Chibbar R, Zhang WJ. An expert support system for breast cancer diagnosis using color wavelet features. J Med Syst 2011; 36:3091-102. [PMID: 22005900 DOI: 10.1007/s10916-011-9788-9] [Citation(s) in RCA: 25] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2011] [Accepted: 09/29/2011] [Indexed: 01/21/2023]
Abstract
Breast cancer diagnosis can be done through the pathologic assessments of breast tissue samples such as core needle biopsy technique. The result of analysis on this sample by pathologist is crucial for breast cancer patient. In this paper, nucleus of tissue samples are investigated after decomposition by means of the Log-Gabor wavelet on HSV color domain and an algorithm is developed to compute the color wavelet features. These features are used for breast cancer diagnosis using Support Vector Machine (SVM) classifier algorithm. The ability of properly trained SVM is to correctly classify patterns and make them particularly suitable for use in an expert system that aids in the diagnosis of cancer tissue samples. The results are compared with other multivariate classifiers such as Naïves Bayes classifier and Artificial Neural Network. The overall accuracy of the proposed method using SVM classifier will be further useful for automation in cancer diagnosis.
Collapse
Affiliation(s)
- S Issac Niwas
- Department of Electronics and Communication Engineering, National Institute of Technology, Tiruchirappalli, India.
| | | | | | | |
Collapse
|
43
|
Kong H, Gurcan M, Belkacem-Boussaid K. Partitioning histopathological images: an integrated framework for supervised color-texture segmentation and cell splitting. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:1661-77. [PMID: 21486712 PMCID: PMC3165069 DOI: 10.1109/tmi.2011.2141674] [Citation(s) in RCA: 75] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/04/2023]
Abstract
For quantitative analysis of histopathological images, such as the lymphoma grading systems, quantification of features is usually carried out on single cells before categorizing them by classification algorithms. To this end, we propose an integrated framework consisting of a novel supervised cell-image segmentation algorithm and a new touching-cell splitting method. For the segmentation part, we segment the cell regions from the other areas by classifying the image pixels into either cell or extra-cellular category. Instead of using pixel color intensities, the color-texture extracted at the local neighborhood of each pixel is utilized as the input to our classification algorithm. The color-texture at each pixel is extracted by local Fourier transform (LFT) from a new color space, the most discriminant color space (MDC). The MDC color space is optimized to be a linear combination of the original RGB color space so that the extracted LFT texture features in the MDC color space can achieve most discrimination in terms of classification (segmentation) performance. To speed up the texture feature extraction process, we develop an efficient LFT extraction algorithm based on image shifting and image integral. For the splitting part, given a connected component of the segmentation map, we initially differentiate whether it is a touching-cell clump or a single nontouching cell. The differentiation is mainly based on the distance between the most likely radial-symmetry center and the geometrical center of the connected component. The boundaries of touching-cell clumps are smoothed out by Fourier shape descriptor before carrying out an iterative, concave-point and radial-symmetry based splitting algorithm. To test the validity, effectiveness and efficiency of the framework, it is applied to follicular lymphoma pathological images, which exhibit complex background and extracellular texture with nonuniform illumination condition. For comparison purposes, the results of the proposed segmentation algorithm are evaluated against the outputs of superpixel, graph-cut, mean-shift, and two state-of-the-art pathological image segmentation methods using ground-truth that was established by manual segmentation of cells in the original images. Our segmentation algorithm achieves better results than the other compared methods. The results of splitting are evaluated in terms of under-splitting, over-splitting, and encroachment errors. By summing up the three types of errors, we achieve a total error rate of 5.25% per image.
Collapse
Affiliation(s)
- Hui Kong
- Department of Biomedical Informatics, the Ohio State University, Columbus, OH, USA,
| | - Metin Gurcan
- Department of Biomedical Informatics, the Ohio State University, Columbus, OH, USA,
| | | |
Collapse
|
44
|
Adegun OK, Tomlins PH, Hagi-Pavli E, Mckenzie G, Piper K, Bader DL, Fortune F. Quantitative analysis of optical coherence tomography and histopathology images of normal and dysplastic oral mucosal tissues. Lasers Med Sci 2011; 27:795-804. [DOI: 10.1007/s10103-011-0975-1] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2011] [Accepted: 07/18/2011] [Indexed: 10/17/2022]
|
45
|
Bilgin CC, Lund AW, Can A, Plopper GE, Yener B. Quantification of three-dimensional cell-mediated collagen remodeling using graph theory. PLoS One 2010; 5. [PMID: 20927339 PMCID: PMC2948014 DOI: 10.1371/journal.pone.0012783] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2010] [Accepted: 08/20/2010] [Indexed: 11/24/2022] Open
Abstract
Background Cell cooperation is a critical event during tissue development. We present the first precise metrics to quantify the interaction between mesenchymal stem cells (MSCs) and extra cellular matrix (ECM). In particular, we describe cooperative collagen alignment process with respect to the spatio-temporal organization and function of mesenchymal stem cells in three dimensions. Methodology/Principal Findings We defined two precise metrics: Collagen Alignment Index and Cell Dissatisfaction Level, for quantitatively tracking type I collagen and fibrillogenesis remodeling by mesenchymal stem cells over time. Computation of these metrics was based on graph theory and vector calculus. The cells and their three dimensional type I collagen microenvironment were modeled by three dimensional cell-graphs and collagen fiber organization was calculated from gradient vectors. With the enhancement of mesenchymal stem cell differentiation, acceleration through different phases was quantitatively demonstrated. The phases were clustered in a statistically significant manner based on collagen organization, with late phases of remodeling by untreated cells clustering strongly with early phases of remodeling by differentiating cells. The experiments were repeated three times to conclude that the metrics could successfully identify critical phases of collagen remodeling that were dependent upon cooperativity within the cell population. Conclusions/Significance Definition of early metrics that are able to predict long-term functionality by linking engineered tissue structure to function is an important step toward optimizing biomaterials for the purposes of regenerative medicine.
Collapse
Affiliation(s)
- Cemal Cagatay Bilgin
- Computer Science Department, Rensselaer Polytechnic Institute, Troy, New York, United States of America
| | - Amanda W. Lund
- Biology Department, Rensselaer Polytechnic Institute, Troy, New York, United States of America
| | - Ali Can
- General Electric Global Research Center, Niskayuna, New York, United States of America
| | - George E. Plopper
- Biology Department, Rensselaer Polytechnic Institute, Troy, New York, United States of America
| | - Bülent Yener
- Computer Science Department, Rensselaer Polytechnic Institute, Troy, New York, United States of America
- * E-mail:
| |
Collapse
|
46
|
Jondet M, Agoli-Agbo R, Dehennin L. Automatic measurement of epithelium differentiation and classification of cervical intraneoplasia by computerized image analysis. Diagn Pathol 2010; 5:7. [PMID: 20148100 PMCID: PMC2819044 DOI: 10.1186/1746-1596-5-7] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2009] [Accepted: 01/22/2010] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND The feasibility of evaluating an objective grading of cervical intraneoplasia lesions (CIN) is attempted using an automatic computerized system able to measure several valuable parameters with special reference to epithelium differentiation. METHODS 4 groups of 10 images each were selected at random from 68 consensus images coming from 80 archival cervical biopsies, normal (n = 10), CIN 1 (n = 10), CIN 2 (n = 10), CIN 3 (n = 10). Representative images of lesions were captured from the microscopic slides and were analyzed using mathematical morphology, with special reference toVoronoï tessellation and Delaunay triangulation. Epithelium surface, nuclear and cytoplasm area, triangle edge and area, total and upper nuclear index were precisely measured in each lesion, and discriminant coefficients were calculated therewith. A dilation/erosion coefficient was automatically defined using triangle edge length and nuclear radius in order to measure the epithelium ratio of differentiation. A histogram ratio was also automatically established between total nuclei and upper nuclei on top of differentiated epithelium. With the latter two ratios added to the nucleo-cytoplasmic ratio, a cervical score able to classify CIN is proposed. RESULTS There is a quasi-linear increase of mean cervical score values between normal epithelium and CIN 3: (27) for normal epithelium, (51) for CIN 1, (78) for CIN 2 and (100) for CIN 3, with significant differences (P < 0.05). CONCLUSION Our results highlight the possibility of applying a cervical score for the automatic grading of CIN lesions and thereby assisting the pathologist for improvement of grading. The automatic measure of epithelium differentiation ratio appears to be a new interesting parameter in computerized image analysis of cervical lesions.
Collapse
Affiliation(s)
- Michel Jondet
- Cabinet de Pathologie, 34 Rue Ducouedic, 75014 Paris, France
| | | | - Louis Dehennin
- Cabinet de Pathologie, 34 Rue Ducouedic, 75014 Paris, France
| |
Collapse
|
47
|
Quantification of spatial parameters in 3D cellular constructs using graph theory. J Biomed Biotechnol 2009; 2009:928286. [PMID: 19920859 PMCID: PMC2775910 DOI: 10.1155/2009/928286] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/16/2008] [Revised: 06/22/2009] [Accepted: 08/16/2009] [Indexed: 11/23/2022] Open
Abstract
Multispectral three-dimensional (3D) imaging provides spatial information for biological structures that cannot be measured by traditional methods. This work presents a method of tracking 3D biological structures to quantify changes over time using graph theory. Cell-graphs were generated based on the pairwise distances, in 3D-Euclidean space, between nuclei during collagen I gel compaction. From these graphs quantitative features are extracted that measure both the global topography and the frequently occurring local structures of the “tissue constructs.” The feature trends can be controlled by manipulating compaction through cell density and are significant when compared to random graphs. This work presents a novel methodology to track a simple 3D biological event and quantitatively analyze the underlying structural change. Further application of this method will allow for the study of complex biological problems that require the quantification of temporal-spatial information in 3D and establish a new paradigm in understanding structure-function relationships.
Collapse
|
48
|
Gurcan MN, Boucheron L, Can A, Madabhushi A, Rajpoot N, Yener B. Histopathological image analysis: a review. IEEE Rev Biomed Eng 2009; 2:147-71. [PMID: 20671804 PMCID: PMC2910932 DOI: 10.1109/rbme.2009.2034865] [Citation(s) in RCA: 810] [Impact Index Per Article: 54.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/16/2022]
Abstract
Over the past decade, dramatic increases in computational power and improvement in image analysis algorithms have allowed the development of powerful computer-assisted analytical approaches to radiological data. With the recent advent of whole slide digital scanners, tissue histopathology slides can now be digitized and stored in digital image form. Consequently, digitized tissue histopathology has now become amenable to the application of computerized image analysis and machine learning techniques. Analogous to the role of computer-assisted diagnosis (CAD) algorithms in medical imaging to complement the opinion of a radiologist, CAD algorithms have begun to be developed for disease detection, diagnosis, and prognosis prediction to complement the opinion of the pathologist. In this paper, we review the recent state of the art CAD technology for digitized histopathology. This paper also briefly describes the development and application of novel image analysis technology for a few specific histopathology related problems being pursued in the United States and Europe.
Collapse
Affiliation(s)
- Metin N. Gurcan
- Department of Biomedical Informatics, The Ohio State University, Columbus, OH 43210 USA (phone: 614-292-1084; fax: 614-688-6600; )
| | - Laura Boucheron
- New Mexico State University, Klipsch School of Electrical and Computer Engineering, Las Cruces, NM 88003, USA ()
| | - Ali Can
- Global Research Center, General Electric Corporation, Niskayuna, NY 12309, USA ()
| | - Anant Madabhushi
- Biomedical Engineering Department, Rutgers University, Piscataway, NJ 08854, USA ()
| | - Nasir Rajpoot
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL, England ()
| | - Bulent Yener
- Computer Science Department, Rensselaer Polytechnic Institute, Troy, NY 12180, USA ()
| |
Collapse
|
49
|
Gurcan MN, Boucheron LE, Can A, Madabhushi A, Rajpoot NM, Yener B. Histopathological image analysis: a review. IEEE Rev Biomed Eng 2009. [PMID: 20671804 DOI: 10.1109/rbme.2009.2034865.histopathological] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Over the past decade, dramatic increases in computational power and improvement in image analysis algorithms have allowed the development of powerful computer-assisted analytical approaches to radiological data. With the recent advent of whole slide digital scanners, tissue histopathology slides can now be digitized and stored in digital image form. Consequently, digitized tissue histopathology has now become amenable to the application of computerized image analysis and machine learning techniques. Analogous to the role of computer-assisted diagnosis (CAD) algorithms in medical imaging to complement the opinion of a radiologist, CAD algorithms have begun to be developed for disease detection, diagnosis, and prognosis prediction to complement the opinion of the pathologist. In this paper, we review the recent state of the art CAD technology for digitized histopathology. This paper also briefly describes the development and application of novel image analysis technology for a few specific histopathology related problems being pursued in the United States and Europe.
Collapse
Affiliation(s)
- Metin N Gurcan
- Department of Biomedical Informatics, The Ohio State University, Columbus, OH 43210, USA.
| | | | | | | | | | | |
Collapse
|
50
|
ECM-Aware Cell-Graph Mining for Bone Tissue Modeling and Classification. Data Min Knowl Discov 2009; 20:416-438. [PMID: 20543911 DOI: 10.1007/s10618-009-0153-2] [Citation(s) in RCA: 24] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Pathological examination of a biopsy is the most reliable and widely used technique to diagnose bone cancer. However, it suffers from both inter- and intra- observer subjectivity. Techniques for automated tissue modeling and classification can reduce this subjectivity and increases the accuracy of bone cancer diagnosis. This paper presents a graph theoretical method, called extracellular matrix (ECM)-aware cell-graph mining, that combines the ECM formation with the distribution of cells in hematoxylin and eosin (H&E) stained histopathological images of bone tissues samples. This method can identify different types of cells that coexist in the same tissue as a result of its functional state. Thus, it models the structure-function relationships more precisely and classifies bone tissue samples accurately for cancer diagnosis. The tissue images are segmented, using the eigenvalues of the Hessian matrix, to compute spatial coordinates of cell nuclei as the nodes of corresponding cell-graph. Upon segmentation a color code is assigned to each node based on the composition of its surrounding ECM. An edge is hypothesized (and established) between a pair of nodes if the corresponding cell membranes are in physical contact and if they share the same color. Hence, multiple colored-cell-graphs coexist in a tissue each modeling a different cell-type organization. Both topological and spectral features of ECM-aware cell-graphs are computed to quantify the structural properties of tissue samples and classify their different functional states as healthy, fractured, or cancerous using support vector machines. Classification accuracy comparison to related work shows that ECM-aware cell-graph approach yields 90.0% whereas Delaunay triangulation and simple cell-graph approach achieves 75.0% and 81.1% accuracy, respectively.
Collapse
|