1
|
Amin MS, Ahn H. FabNet: A Features Agglomeration-Based Convolutional Neural Network for Multiscale Breast Cancer Histopathology Images Classification. Cancers (Basel) 2023; 15:cancers15041013. [PMID: 36831359 PMCID: PMC9954749 DOI: 10.3390/cancers15041013] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2023] [Revised: 01/31/2023] [Accepted: 01/31/2023] [Indexed: 02/08/2023] Open
Abstract
The definitive diagnosis of histology specimen images is largely based on the radiologist's comprehensive experience; however, due to the fine to the coarse visual appearance of such images, experts often disagree with their assessments. Sophisticated deep learning approaches can help to automate the diagnosis process of the images and reduce the analysis duration. More efficient and accurate automated systems can also increase the diagnostic impartiality by reducing the difference between the operators. We propose a FabNet model that can learn the fine-to-coarse structural and textural features of multi-scale histopathological images by using accretive network architecture that agglomerate hierarchical feature maps to acquire significant classification accuracy. We expand on a contemporary design by incorporating deep and close integration to finely combine features across layers. Our deep layer accretive model structure combines the feature hierarchy in an iterative and hierarchically manner that infers higher accuracy and fewer parameters. The FabNet can identify malignant tumors from images and patches from histopathology images. We assessed the efficiency of our suggested model standard cancer datasets, which included breast cancer as well as colon cancer histopathology images. Our proposed avant garde model significantly outperforms existing state-of-the-art models in respect of the accuracy, F1 score, precision, and sensitivity, with fewer parameters.
Collapse
|
2
|
Mercan C, Balkenhol M, Salgado R, Sherman M, Vielh P, Vreuls W, Polónia A, Horlings HM, Weichert W, Carter JM, Bult P, Christgen M, Denkert C, van de Vijver K, Bokhorst JM, van der Laak J, Ciompi F. Deep learning for fully-automated nuclear pleomorphism scoring in breast cancer. NPJ Breast Cancer 2022; 8:120. [DOI: 10.1038/s41523-022-00488-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2021] [Accepted: 10/21/2022] [Indexed: 11/11/2022] Open
Abstract
AbstractTo guide the choice of treatment, every new breast cancer is assessed for aggressiveness (i.e., graded) by an experienced histopathologist. Typically, this tumor grade consists of three components, one of which is the nuclear pleomorphism score (the extent of abnormalities in the overall appearance of tumor nuclei). The degree of nuclear pleomorphism is subjectively classified from 1 to 3, where a score of 1 most closely resembles epithelial cells of normal breast epithelium and 3 shows the greatest abnormalities. Establishing numerical criteria for grading nuclear pleomorphism is challenging, and inter-observer agreement is poor. Therefore, we studied the use of deep learning to develop fully automated nuclear pleomorphism scoring in breast cancer. The reference standard used for training the algorithm consisted of the collective knowledge of an international panel of 10 pathologists on a curated set of regions of interest covering the entire spectrum of tumor morphology in breast cancer. To fully exploit the information provided by the pathologists, a first-of-its-kind deep regression model was trained to yield a continuous scoring rather than limiting the pleomorphism scoring to the standard three-tiered system. Our approach preserves the continuum of nuclear pleomorphism without necessitating a large data set with explicit annotations of tumor nuclei. Once translated to the traditional system, our approach achieves top pathologist-level performance in multiple experiments on regions of interest and whole-slide images, compared to a panel of 10 and 4 pathologists, respectively.
Collapse
|
3
|
Papparella S, Crescio MI, Baldassarre V, Brunetti B, Burrai GP, Cocumelli C, Grieco V, Iussich S, Maniscalco L, Mariotti F, Millanta F, Paciello O, Rasotto R, Romanucci M, Sfacteria A, Zappulli V. Reproducibility and Feasibility of Classification and National Guidelines for Histological Diagnosis of Canine Mammary Gland Tumours: A Multi-Institutional Ring Study. Vet Sci 2022; 9:vetsci9070357. [PMID: 35878374 PMCID: PMC9325225 DOI: 10.3390/vetsci9070357] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Revised: 07/04/2022] [Accepted: 07/06/2022] [Indexed: 11/30/2022] Open
Abstract
Simple Summary Tumours of the mammary gland are common in humans, as in canine species. They are very heterogenous with numerous morphological variants and different biologic behaviours. In the last few decades, several efforts have been made to classify these tumours histologically and establish the level of malignancy by using histologic grading systems. However, reproducibility and diagnostic agreement of such classification and grading have been only rarely assessed. In this study, we tested the variability in diagnoses performed by 15 pathologists using the same classification and grading system. Prior to the study, pathologists agreed on guidelines regarding how to apply these systems. Pathologists worked blindly on 36 digital histologic slides of canine mammary tumours. The agreement was statistically analysed using Cohen’s kappa coefficient that, when equal to 1, indicates perfect agreement. The overall agreement in the identification of hyperplastic-dysplastic/benign/malignant lesions was substantial (kappa 0.76), while outcomes on morphological classification had only a moderate agreement (k = 0.54). Tumour grade assigned by pathologists was the least concordant and kappa could not be calculated. Although promising, the results underline that each diagnostic/grading system should be assessed and optimized for standardization and high diagnostic agreement. Abstract Histological diagnosis of Canine Mammary Tumours (CMTs) provides the basis for proper treatment and follow-up. Nowadays, its accuracy is poorly understood and variable interpretation of histological criteria leads to a lack of standardisation and impossibility to compare studies. This study aimed to quantify the reproducibility of histological diagnosis and grading in CMTs. A blinded ring test on 36 CMTs was performed by 15 veterinary pathologists with different levels of education, after discussion of critical points on the Davis-Thompson Foundation Classification and providing consensus guidelines. Kappa statistics were used to compare the interobserver variability. The overall concordance rate of diagnostic interpretations of WP on identification of hyperplasia-dysplasia/benign/malignant lesions showed a substantial agreement (average k ranging from 0.66 to 0.82, with a k-combined of 0.76). Instead, outcomes on ICD-O-3.2 morphological code /diagnosis of histotype had only a moderate agreement (average k ranging from 0.44 and 0.64, with a k-combined of 0.54). The results demonstrated that standardised classification and consensus guidelines can produce moderate to substantial agreement; however, further efforts are needed to increase this agreement in distinguishing benign versus malignant lesions and in histological grading.
Collapse
Affiliation(s)
- Serenella Papparella
- Department of Veterinary Medicine and Animal Production, Unit of Pathology, University of Naples Federico II, 80138 Naples, Italy; (S.P.); (V.B.); (O.P.)
| | - Maria Ines Crescio
- National Reference Center for the Veterinary and Comparative Oncology (CEROVEC), Experimental Zooprophylactic Institute of Piedmont, Liguria and Valle d’Aosta, 10154 Turin, Italy;
| | - Valeria Baldassarre
- Department of Veterinary Medicine and Animal Production, Unit of Pathology, University of Naples Federico II, 80138 Naples, Italy; (S.P.); (V.B.); (O.P.)
| | - Barbara Brunetti
- Department of Veterinary Medical Sciences, University of Bologna, 40126 Bologna, Italy;
| | - Giovanni P. Burrai
- Department of Veterinary Medicine, University of Sassari, 07100 Sassari, Italy;
- Mediterranean Center for Disease Control (MCDC), University of Sassari, 07100 Sassari, Italy
| | - Cristiano Cocumelli
- Experimental Zooprophylactic Institute of Lazio and Toscana M. Aleandri, 00178 Rome, Italy;
| | - Valeria Grieco
- Department of Veterinary Medicine, University of Milan, 26900 Lodi, Italy;
| | - Selina Iussich
- Department of Veterinary Science, University of Turin, 10095 Turin, Italy; (S.I.); (L.M.)
| | - Lorella Maniscalco
- Department of Veterinary Science, University of Turin, 10095 Turin, Italy; (S.I.); (L.M.)
| | - Francesca Mariotti
- School of Bioscience and Veterinary Medicine, University of Camerino, 62032 Camerino, Italy;
| | - Francesca Millanta
- Department of Veterinary Sciences, University of Pisa, 56124 Pisa, Italy;
| | - Orlando Paciello
- Department of Veterinary Medicine and Animal Production, Unit of Pathology, University of Naples Federico II, 80138 Naples, Italy; (S.P.); (V.B.); (O.P.)
| | - Roberta Rasotto
- Independent Researcher, Via Messer Ottonello 1, 37127 Verona, Italy;
| | | | | | - Valentina Zappulli
- Department of Comparative Biomedicine and Food Science, University of Padua, 35020 Padua, Italy
- Correspondence: ; Tel.: +39-049-8272962
| |
Collapse
|
4
|
Das A, Devarampati VK, Nair MS. NAS-SGAN: A Semi-supervised Generative Adversarial Network Model for Atypia Scoring of Breast Cancer Histopathological Images. IEEE J Biomed Health Inform 2021; 26:2276-2287. [PMID: 34826299 DOI: 10.1109/jbhi.2021.3131103] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Nuclear atypia scoring (NAS), forms a significant factor in determining individualized treatment plans and also for the prognosis of the disease. Automation of cancer grading using quantitative image-based analysis of histopathological images can circumvent the shortcomings of the prevailing manual grading and can assist the pathologists in cancer diagnosis. However, developing such a robust classifier model require sufficient amount of annotated data, while the labeled histopathological images are scarce and expensive to procure as annotation forms a time-consuming and laborious task. Hence, a semisupervised learning framework combined with the deep neural network based generative adversarial training, that can improve the performance of the classification model with limited annotated data, is proposed in this paper. The proposed NAS-SGAN model consists of discriminator and generator models that are trained in an adversarial manner using both labeled and unlabeled samples. The discriminator model is designed as an unsupervised model stacked over the supervised model sharing the model parameters and learns the data distribution by extracting the discriminative features. The generator model is trained over a stable feature matching objective function following a composite GAN architecture. The novelty of the proposed model is that, we have used a stacked supervised and unsupervised discriminator and a feature matching generator for the NAS-SGAN model and its for the first time the semi-supervised GAN model is explored for the grading of breast cancer. Experimental analysis shows that the proposed model could better discriminate different cancer grades thereby improving the robustness and accuracy of the system, even with limited amount of labeled samples.
Collapse
|
5
|
Finkelman BS, Meindl A, LaBoy C, Griffin B, Narayan S, Brancamp R, Siziopikou KP, Pincus JL, Blanco LZ. Correlation of manual semi-quantitative and automated quantitative Ki-67 proliferative index with OncotypeDXTM recurrence score in invasive breast carcinoma. Breast Dis 2021; 41:55-65. [PMID: 34397396 DOI: 10.3233/bd-201011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Abstract
BACKGROUND Ki-67 immunohistochemistry (IHC) staining is a widely used cancer proliferation assay; however, its limitations could be improved with automated scoring. The OncotypeDXTM Recurrence Score (ORS), which primarily evaluates cancer proliferation genes, is a prognostic indicator for breast cancer chemotherapy response; however, it is more expensive and slower than Ki-67. OBJECTIVE To compare manual Ki-67 (mKi-67) with automated Ki-67 (aKi-67) algorithm results based on manually selected Ki-67 "hot spots" in breast cancer, and correlate both with ORS. METHODS 105 invasive breast carcinoma cases from 100 patients at our institution (2011-2013) with available ORS were evaluated. Concordance was assessed via Cohen's Kappa (κ). RESULTS 57/105 cases showed agreement between mKi-67 and aKi-67 (κ 0.31, 95% CI 0.18-0.45), with 41 cases overestimated by aKi-67. Concordance was higher when estimated on the same image (κ 0.53, 95% CI 0.37-0.69). Concordance between mKi-67 score and ORS was fair (κ 0.27, 95% CI 0.11-0.42), and concordance between aKi-67 and ORS was poor (κ 0.10, 95% CI -0.03-0.23). CONCLUSIONS These results highlight the limits of Ki-67 algorithms that use manual "hot spot" selection. Due to suboptimal concordance, Ki-67 is likely most useful as a complement to, rather than a surrogate for ORS, regardless of scoring method.
Collapse
Affiliation(s)
- Brian S Finkelman
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Amanda Meindl
- Department of Pathology, Great Lakes Pathologists, West Allis, WI, USA
| | - Carissa LaBoy
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Brannan Griffin
- Department of Pathology, University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Suguna Narayan
- Department of Pathology, University of Colorado Denver School of Medicine, Aurora, CO, USA
| | - Ryan Brancamp
- Department of Pathology, Microbiology, and Immunology, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Kalliopi P Siziopikou
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Jennifer L Pincus
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Luis Z Blanco
- Department of Pathology, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
6
|
CACTUS: A Digital Tool for Quality Assurance, Education and Evaluation in Surgical Pathology. J Med Biol Eng 2021. [DOI: 10.1007/s40846-021-00643-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
7
|
Das A, Nair MS, Peter SD. Computer-Aided Histopathological Image Analysis Techniques for Automated Nuclear Atypia Scoring of Breast Cancer: a Review. J Digit Imaging 2021; 33:1091-1121. [PMID: 31989390 DOI: 10.1007/s10278-019-00295-z] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
Breast cancer is the most common type of malignancy diagnosed in women. Through early detection and diagnosis, there is a great chance of recovery and thereby reduce the mortality rate. Many preliminary tests like non-invasive radiological diagnosis using ultrasound, mammography, and MRI are widely used for the diagnosis of breast cancer. However, histopathological analysis of breast biopsy specimen is inevitable and is considered to be the golden standard for the affirmation of cancer. With the advancements in the digital computing capabilities, memory capacity, and imaging modalities, the development of computer-aided powerful analytical techniques for histopathological data has increased dramatically. These automated techniques help to alleviate the laborious work of the pathologist and to improve the reproducibility and reliability of the interpretation. This paper reviews and summarizes digital image computational algorithms applied on histopathological breast cancer images for nuclear atypia scoring and explores the future possibilities. The algorithms for nuclear pleomorphism scoring of breast cancer can be widely grouped into two categories: handcrafted feature-based and learned feature-based. Handcrafted feature-based algorithms mainly include the computational steps like pre-processing the images, segmenting the nuclei, extracting unique features, feature selection, and machine learning-based classification. However, most of the recent algorithms are based on learned features, that extract high-level abstractions directly from the histopathological images utilizing deep learning techniques. In this paper, we discuss the various algorithms applied for the nuclear pleomorphism scoring of breast cancer, discourse the challenges to be dealt with, and outline the importance of benchmark datasets. A comparative analysis of some prominent works on breast cancer nuclear atypia scoring is done using a benchmark dataset which enables to quantitatively measure and compare the different features and algorithms used for breast cancer grading. Results show that improvements are still required, to have an automated cancer grading system suitable for clinical applications.
Collapse
Affiliation(s)
- Asha Das
- Artificial Intelligence & Computer Vision Lab, Department of Computer Science, Cochin University of Science and Technology, Kochi, Kerala, 682022, India.
| | - Madhu S Nair
- Artificial Intelligence & Computer Vision Lab, Department of Computer Science, Cochin University of Science and Technology, Kochi, Kerala, 682022, India
| | - S David Peter
- Artificial Intelligence & Computer Vision Lab, Department of Computer Science, Cochin University of Science and Technology, Kochi, Kerala, 682022, India
| |
Collapse
|
8
|
Liew XY, Hameed N, Clos J. A Review of Computer-Aided Expert Systems for Breast Cancer Diagnosis. Cancers (Basel) 2021; 13:2764. [PMID: 34199444 PMCID: PMC8199592 DOI: 10.3390/cancers13112764] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 05/25/2021] [Accepted: 05/28/2021] [Indexed: 11/18/2022] Open
Abstract
A computer-aided diagnosis (CAD) expert system is a powerful tool to efficiently assist a pathologist in achieving an early diagnosis of breast cancer. This process identifies the presence of cancer in breast tissue samples and the distinct type of cancer stages. In a standard CAD system, the main process involves image pre-processing, segmentation, feature extraction, feature selection, classification, and performance evaluation. In this review paper, we reviewed the existing state-of-the-art machine learning approaches applied at each stage involving conventional methods and deep learning methods, the comparisons within methods, and we provide technical details with advantages and disadvantages. The aims are to investigate the impact of CAD systems using histopathology images, investigate deep learning methods that outperform conventional methods, and provide a summary for future researchers to analyse and improve the existing techniques used. Lastly, we will discuss the research gaps of existing machine learning approaches for implementation and propose future direction guidelines for upcoming researchers.
Collapse
Affiliation(s)
- Xin Yu Liew
- Jubilee Campus, University of Nottingham, Wollaton Road, Nottingham NG8 1BB, UK; (N.H.); (J.C.)
| | | | | |
Collapse
|
9
|
Batch Mode Active Learning on the Riemannian Manifold for Automated Scoring of Nuclear Pleomorphism in Breast Cancer. Artif Intell Med 2020; 103:101805. [PMID: 32143801 DOI: 10.1016/j.artmed.2020.101805] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/07/2019] [Revised: 01/12/2020] [Accepted: 01/13/2020] [Indexed: 11/22/2022]
Abstract
Breast cancer is the most prevalent invasive type of cancer among women. The mortality rate of the disease can be reduced considerably through timely prognosis and felicitous treatment planning, by utilizing the computer aided detection and diagnosis techniques. With the advent of whole slide image (WSI) scanners for digitizing the histopathological tissue samples, there is a drastic increase in the availability of digital histopathological images. However, these samples are often unlabeled and hence they need labeling to be done through manual annotations by domain experts and experienced pathologists. But this annotation process required for acquiring high quality large labeled training set for nuclear atypia scoring is a tedious, expensive and time consuming job. Active learning techniques have achieved widespread acceptance in reducing this human effort in annotating the data samples. In this paper, we explore the possibilities of active learning on nuclear pleomorphism scoring over a non-Euclidean framework, the Riemannian manifold. Active learning technique adopted for the cancer grading is in the batch-mode framework, that adaptively identifies the apt batch size along with the batch of instances to be queried, following a submodular optimization framework. Samples for annotation are selected considering the diversity and redundancy between the pair of samples, based on the kernelized Riemannian distance measures such as log-Euclidean metrics and the two Bregman divergences - Stein and Jeffrey divergences. Results of the adaptive Batch Mode Active Learning on the Riemannian metric show a superior performance when compared with the state-of-the-art techniques for breast cancer nuclear pleomorphism scoring, as it makes use of the information from the unlabeled samples.
Collapse
|