Visually Meaningful Histopathological Features for Automatic Grading of Prostate Cancer

High RRM2 Correlates with Mitochondrial and Immune Responses in the Eosinophilic Subtype of Clear Cell Renal Cell Carcinoma

Background

Clear cell renal cell carcinoma (ccRCC), the predominant subtype of RCC, is distinguished by unique biological characteristics and heterogeneity, including eosinophilic and clear subtypes. Notwithstanding progress in therapy, immune checkpoint inhibitors (ICIs), and tyrosine kinase inhibitors (TKIs), the prognosis for individuals with metastatic ccRCC remains poor, presumably owing to metabolic alterations leading to mitochondrial dysfunction, which affects treatment response variability.

Methods

We analyzed histological and immunohistochemical data from a cohort at Dalian Medical University's First Affiliated Hospital alongside RNA-sequencing transcriptome data from the TCGA database. Histologically, eosinophilic and clear ccRCC subtypes were evaluated using Kaplan-Meier and Cox proportional hazards models for survival analysis and prognosis. Differential gene expression (DEG) analysis and Gene Set Enrichment Analysis were performed to explore transcriptomic differences and relevant pathways.

Results

The study discovered substantial histological and molecular differences between the eosinophilic and clear cell subtypes of ccRCC. The eosinophilic subtype linked with frequent high-grade tumors (69.05% eosinophil vs 35.35% clear) and a poorer prognosis (HR=2.659, 95% CI:1.437-4.919, P=0.002). DEG analysis revealed distinct expression patterns among subtypes and identified a risk score signature that remained significant even after adjusting for clinical variables (HR=3.967, 95% CI: 1.665-9.449, P=0.002), showing less favorable survival in the high-risk group (P < 0.0001). RRM2 emerged as the most prognostic gene from this risk score, particularly in the eosinophilic subtype, alongside other clinical variables. By IHC, RRM2 shows high IHC score in eosinophilic compared to clear subtype (P=0.019). In addition, highly expressed RRM2 correlates with poor outcomes and is linked to mitochondrial genes, immunological pathways, and ICIs treatment.

Conclusion

These findings show significant differences in prognosis between subtypes. RRM2 was the most prognostic gene from the discovered novel risk score signature associated with subtypes. Future research is essential to validate these insights and their therapeutic implications for ccRCC management.

Machine learning-based pathomics signature of histology slides as a novel prognostic indicator in primary central nervous system lymphoma

PURPOSE

To develop and validate a pathomics signature for predicting the outcomes of Primary Central Nervous System Lymphoma (PCNSL).

METHODS

In this study, 132 whole-slide images (WSIs) of 114 patients with PCNSL were enrolled. Quantitative features of hematoxylin and eosin (H&E) stained slides were extracted using CellProfiler. A pathomics signature was established and validated. Cox regression analysis, receiver operating characteristic (ROC) curves, Calibration, decision curve analysis (DCA), and net reclassification improvement (NRI) were performed to assess the significance and performance.

RESULTS

In total, 802 features were extracted using a fully automated pipeline. Six machine-learning classifiers demonstrated high accuracy in distinguishing malignant neoplasms. The pathomics signature remained a significant factor of overall survival (OS) and progression-free survival (PFS) in the training cohort (OS: HR 7.423, p < 0.001; PFS: HR 2.143, p = 0.022) and independent validation cohort (OS: HR 4.204, p = 0.017; PFS: HR 3.243, p = 0.005). A significantly lower response rate to initial treatment was found in high Path-score group (19/35, 54.29%) as compared to patients in the low Path-score group (16/70, 22.86%; p < 0.001). The DCA and NRI analyses confirmed that the nomogram showed incremental performance compared with existing models. The ROC curve demonstrated a relatively sensitive and specific profile for the nomogram (1-, 2-, and 3-year AUC = 0.862, 0.932, and 0.927, respectively).

CONCLUSION

As a novel, non-invasive, and convenient approach, the newly developed pathomics signature is a powerful predictor of OS and PFS in PCNSL and might be a potential predictive indicator for therapeutic response.

Transforming Diagnosis and Therapeutics Using Cancer Genomics

In past quarter of the century, much has been understood about the genetic variation and abnormal genes that activate cancer in humans. All the cancers somehow possess alterations in the DNA sequence of cancer cell's genome. In present, we are heading toward the era where it is possible to obtain complete genome of the cancer cells for their better diagnosis, categorization and to explore treatment options.

Attention2majority: Weak multiple instance learning for regenerative kidney grading on whole slide images

Deep learning consistently demonstrates high performance in classifying and segmenting medical images like CT, PET, and MRI. However, compared to these kinds of images, whole slide images (WSIs) of stained tissue sections are huge and thus much less efficient to process, especially for deep learning algorithms. To overcome these challenges, we present attention2majority, a weak multiple instance learning model to automatically and efficiently process WSIs for classification. Our method initially assigns exhaustively sampled label-free patches with the label of the respective WSIs and trains a convolutional neural network to perform patch-wise classification. Then, an intelligent sampling method is performed in which patches with high confidence are collected to form weak representations of WSIs. Lastly, we apply a multi-head attention-based multiple instance learning model to do slide-level classification based on high-confidence patches (intelligently sampled patches). Attention2majority was trained and tested on classifying the quality of 127 WSIs (of regenerated kidney sections) into three categories. On average, attention2majority resulted in 97.4%±2.4 AUC for the four-fold cross-validation. We demonstrate that the intelligent sampling module within attention2majority is superior to the current state-of-the-art random sampling method. Furthermore, we show that the replacement of random sampling with intelligent sampling in attention2majority results in its performance boost (from 94.9%±3.1 to 97.4%±2.4 average AUC for the four-fold cross-validation). We also tested a variation of attention2majority on the famous Camelyon16 dataset, which resulted in 89.1%±0.8 AUC¹. When compared to random sampling, the attention2majority demonstrated excellent slide-level interpretability. It also provided an efficient framework to arrive at a multi-class slide-level prediction.

Integrative Analysis of Histopathological Images and Genomic Data in Colon Adenocarcinoma

Background

Colon adenocarcinoma (COAD) is one of the most common malignant tumors in the world. The histopathological features are crucial for the diagnosis, prognosis, and therapy of COAD.

Methods

We downloaded 719 whole-slide histopathological images from TCIA, and 459 corresponding HTSeq-counts mRNA expression and clinical data were obtained from TCGA. Histopathological image features were extracted by CellProfiler. Prognostic image features were selected by the least absolute shrinkage and selection operator (LASSO) and support vector machine (SVM) algorithms. The co-expression gene module correlated with prognostic image features was identified by weighted gene co-expression network analysis (WGCNA). Random forest was employed to construct an integrative prognostic model and calculate the histopathological-genomic prognosis factor (HGPF).

Results

There were five prognostic image features and one co-expression gene module involved in the model construction. The time-dependent receiver operating curve showed that the prognostic model had a significant prognostic value. Patients were divided into high-risk group and low-risk group based on the HGPF. Kaplan-Meier analysis indicated that the overall survival of the low-risk group was significantly better than the high-risk group.

Conclusions

These results suggested that the histopathological image features had a certain ability to predict the survival of COAD patients. The integrative prognostic model based on the histopathological images and genomic features could further improve the prognosis prediction in COAD, which may assist the clinical decision in the future.

Role of AI and Histopathological Images in Detecting Prostate Cancer: A Survey

Prostate cancer is one of the most identified cancers and second most prevalent among cancer-related deaths of men worldwide. Early diagnosis and treatment are substantial to stop or handle the increase and spread of cancer cells in the body. Histopathological image diagnosis is a gold standard for detecting prostate cancer as it has different visual characteristics but interpreting those type of images needs a high level of expertise and takes too much time. One of the ways to accelerate such an analysis is by employing artificial intelligence (AI) through the use of computer-aided diagnosis (CAD) systems. The recent developments in artificial intelligence along with its sub-fields of conventional machine learning and deep learning provide new insights to clinicians and researchers, and an abundance of research is presented specifically for histopathology images tailored for prostate cancer. However, there is a lack of comprehensive surveys that focus on prostate cancer using histopathology images. In this paper, we provide a very comprehensive review of most, if not all, studies that handled the prostate cancer diagnosis using histopathological images. The survey begins with an overview of histopathological image preparation and its challenges. We also briefly review the computing techniques that are commonly applied in image processing, segmentation, feature selection, and classification that can help in detecting prostate malignancies in histopathological images.

Narrative review of prostate cancer grading systems: will the Gleason scores be replaced by the Grade Groups?

The Gleason grading system, proposed by Dr. Donald F. Gleason in 1966, is one of the most important prognostic factors in men with prostate cancer (PCa). At consensus conferences held in 2005 and 2014, organized by the International Society of Urological Pathology (ISUP), the system was modified to reflect the current diagnostic and therapeutic approaches. In particular, in the 2014 Conference, it was recognized that there were weaknesses with the original and the 2005 ISUP modified Gleason systems. Based on the results of a research conducted by Prof. JI Epstein and his group, a new grading system was proposed by the ISUP in order to address some of such deficiencies: i.e., the five distinct Grade Groups (GGs). Since 2014, results of studies have been published by different groups and societies, including the Genitourinary Pathology Society (GUPS), giving additional support to the prognostic role of the architectural Gleason patterns and, in particular, of the GGs. A revised GG system, taking into account the percentage of Gleason pattern (GP) 4, cribriform and intraductal carcinoma, tertiary GP 5, and reactive stroma grade, has shown to have some advantages, however not ready for adoption in the current practice. The aim of this contribution was to review the major updates and recommendations regarding the GPs and GSs, as well as the GGs, trying to give an answer to the following questions: “How has the grade group system been used in the routine?” and “will the Gleason scoring system be replace by the grade groups?” We also discussed the potential implementation in the future of molecular pathology and artificial intelligence in grading to further define risk groups in patients with PCa.

Computerized Classification of Prostate Cancer Gleason Scores from Whole Slide Images

Histological Gleason grading of tumor patterns is one of the most powerful prognostic predictors in prostate cancer. However, manual analysis and grading performed by pathologists are typically subjective and time-consuming. In this paper, we present an automatic technique for Gleason grading of prostate cancer from H&E stained whole slide pathology images using a set of novel completed and statistical local binary pattern (CSLBP) descriptors. First, the technique divides the whole slide image (WSI) into a set of small image tiles, where salient tumor tiles with high nuclei densities are selected for analysis. The CSLBP texture features that encode pixel intensity variations from circularly surrounding neighborhoods are extracted from salient image tiles to characterize different Gleason patterns. Finally, the CSLBP texture features computed from all tiles are integrated and utilized by the multi-class support vector machine (SVM) that assigns patient slides with different Gleason scores such as 6, 7, or ≥ 8. Experiments have been performed on 312 different patient cases selected from the cancer genome atlas (TCGA) and have achieved superior performances over state-of-the-art texture descriptors and baseline methods including deep learning models for prostate cancer Gleason grading.

Automated gleason grading on prostate biopsy slides by statistical representations of homology profile

BACKGROUND AND OBJECTIVE

Gleason grading system is currently the clinical gold standard for determining prostate cancer aggressiveness. Prostate cancer is typically classified into one of 5 different categories with 1 representing the most indolent disease and 5 reflecting the most aggressive disease. Grades 3 and 4 are the most common and difficult patterns to be discriminated in clinical practice. Even though the degree of gland differentiation is the strongest determinant of Gleason grade, manual grading is subjective and is hampered by substantial inter-reader disagreement, especially with regard to intermediate grade groups.

METHODS

To capture the topological characteristics and the degree of connectivity between nuclei around the gland, the concept of Homology Profile (HP) for prostate cancer grading is presented in this paper. HP is an algebraic tool, whereby, certain algebraic invariants are computed based on the structure of a topological space. We utilized the Statistical Representation of Homology Profile (SRHP) features to quantify the extent of glandular differentiation. The quantitative characteristics which represent the image patch are fed into a supervised classifier model for discrimination of grade patterns 3 and 4.

RESULTS

On the basis of the novel homology profile, we evaluated 43 digitized images of prostate biopsy slides annotated for regions corresponding to Grades 3 and 4. The quantitative patch-level evaluation results showed that our approach achieved an Area Under Curve (AUC) of 0.96 and an accuracy of 0.89 in terms of discriminating Grade 3 and 4 patches. Our approach was found to be superior to comparative methods including handcrafted cellular features, Stacked Sparse Autoencoder (SSAE) algorithm and end-to-end supervised learning method (DLGg). Also, slide-level quantitative and qualitative evaluation results reflect the ability of our approach in discriminating Gleason Grade 3 from 4 patterns on H&E tissue images.

CONCLUSIONS

We presented a novel Statistical Representation of Homology Profile (SRHP) approach for automated Gleason grading on prostate biopsy slides. The most discriminating topological descriptions of cancerous regions for grade 3 and 4 in prostate cancer were identified. Moreover, these characteristics of homology profile are interpretable, visually meaningful and highly consistent with the rubric employed by pathologists for the task of Gleason grading.

Mosaic-Based Color-Transform Optimization for Lossy and Lossy-to-Lossless Compression of Pathology Whole-Slide Images

The use of whole-slide images (WSIs) in pathology entails stringent storage and transmission requirements because of their huge dimensions. Therefore, image compression is an essential tool to enable efficient access to these data. In particular, color transforms are needed to exploit the very high degree of inter-component correlation and obtain competitive compression performance. Even though the state-of-the-art color transforms remove some redundancy, they disregard important details of the compression algorithm applied after the transform. Therefore, their coding performance is not optimal. We propose an optimization method called mosaic optimization for designing irreversible and reversible color transforms simultaneously optimized for any given WSI and the subsequent compression algorithm. Mosaic optimization is designed to attain reasonable computational complexity and enable continuous scanner operation. Exhaustive experimental results indicate that, for JPEG 2000 at identical compression ratios, the optimized transforms yield images more similar to the original than the other state-of-the-art transforms. Specifically, irreversible optimized transforms outperform the Karhunen-Loève Transform in terms of PSNR (up to 1.1 dB), the HDR-VDP-2 visual distortion metric (up to 3.8 dB), and the accuracy of computer-aided nuclei detection tasks (F1 score up to 0.04 higher). In addition, reversible optimized transforms achieve PSNR, HDR-VDP-2, and nuclei detection accuracy gains of up to 0.9 dB, 7.1 dB, and 0.025, respectively, when compared with the reversible color transform in lossy-to-lossless compression regimes.

Predicting cancer outcomes from histology and genomics using convolutional networks

Predicting the expected outcome of patients diagnosed with cancer is a critical step in treatment. Advances in genomic and imaging technologies provide physicians with vast amounts of data, yet prognostication remains largely subjective, leading to suboptimal clinical management. We developed a computational approach based on deep learning to predict the overall survival of patients diagnosed with brain tumors from microscopic images of tissue biopsies and genomic biomarkers. This method uses adaptive feedback to simultaneously learn the visual patterns and molecular biomarkers associated with patient outcomes. Our approach surpasses the prognostic accuracy of human experts using the current clinical standard for classifying brain tumors and presents an innovative approach for objective, accurate, and integrated prediction of patient outcomes.

Cancer histology reflects underlying molecular processes and disease progression and contains rich phenotypic information that is predictive of patient outcomes. In this study, we show a computational approach for learning patient outcomes from digital pathology images using deep learning to combine the power of adaptive machine learning algorithms with traditional survival models. We illustrate how these survival convolutional neural networks (SCNNs) can integrate information from both histology images and genomic biomarkers into a single unified framework to predict time-to-event outcomes and show prediction accuracy that surpasses the current clinical paradigm for predicting the overall survival of patients diagnosed with glioma. We use statistical sampling techniques to address challenges in learning survival from histology images, including tumor heterogeneity and the need for large training cohorts. We also provide insights into the prediction mechanisms of SCNNs, using heat map visualization to show that SCNNs recognize important structures, like microvascular proliferation, that are related to prognosis and that are used by pathologists in grading. These results highlight the emerging role of deep learning in precision medicine and suggest an expanding utility for computational analysis of histology in the future practice of pathology.

The Heterogeneity of Prostate Cancer: A Practical Approach

Prostate cancer is a paradigm tumor model for heterogeneity in almost every sense. Its clinical, spatial, and morphological heterogeneity divided by the high-level molecular genetic diversity outline the complexity of this disease in the clinical and research settings. In this review, we summarize the main aspects of prostate cancer heterogeneity at different levels, with special attention given to the spatial heterogeneity within the prostate, and to the standard morphological heterogeneity, with respect to tumor grading and modern classifications. We also cover the complex issue of molecular genetic heterogeneity, discussing it in the context of the current evidence of the genetic characterization of prostate carcinoma; the interpatient, intertumoral (multifocal disease), and intratumoral heterogeneity; tumor clonality; and metastatic disease. Clinical and research implications are summarized and serve to address the most pertinent problems stemming from the extreme heterogeneity of prostate cancer.

Predicting and replacing the pathological Gleason grade with automated gland ring morphometric features from immunofluorescent prostate cancer images

The Gleason grade is the most common architectural and morphological assessment of prostate cancer severity and prognosis. There have been numerous algorithms developed to approximate and duplicate the Gleason scoring system, mostly developed in standard H&E brightfield microscopy. Immunofluorescence (IF) image analysis of tissue pathology has recently been proven to be robust in developing prognostic assessments of disease, particularly in prostate cancer. We leverage a method of segmenting gland rings in IF images for predicting the pathological Gleason, both the clinical and the image specific grades, which may not necessarily be the same. We combine these measures with nuclear specific characteristics. In 324 images from 324 patients, our individual features correlate well univariately with the Gleason grades and in a multivariate setting have an accuracy of 85% in predicting the Gleason grade. Additionally, these features correlate strongly with clinical progression outcomes [concordance index (CI) of 0.89], significantly outperforming the clinical Gleason grades (CI of 0.78). Finally, in multivariate models for multiple prostate cancer progression endpoints, replacing the Gleason with these features results in equivalent or improved performances. This work presents the first assessment of morphological gland unit features from IF images for predicting the Gleason grade, and even replacing it in prostate cancer prognostics.

Segmentation of digitized histological sections for quantification of the muscularized vasculature in the mouse hind limb

Immunohistochemical tissue staining enhances microvasculature characteristics, including the smooth muscle in the medial layer of the vessel walls that is responsible for regulation of blood flow. The vasculature can be imaged in a comprehensive fashion using whole-slide scanning. However, since each such image potentially contains hundreds of small vessels, manual vessel delineation and quantification is not practically feasible. In this work, we present a fully automatic segmentation and vasculature quantification algorithm for whole-slide images. We evaluated its performance on tissue samples drawn from the hind limbs of wild-type mice, stained for smooth muscle using 3,3'-Diaminobenzidine (DAB) immunostain. The algorithm was designed to be robust to vessel fragmentation due to staining irregularity, and artefactual staining of nonvessel objects. Colour deconvolution was used to isolate the DAB stain for detection of vessel wall fragments. Complete vessels were reconstructed from the fragments by joining endpoints of topological skeletons. Automatic measures of vessel density, perimeter, wall area and local wall thickness were taken. The segmentation algorithm was validated against manual measures, resulting in a Dice similarity coefficient of 89%. The relationships observed between these measures were as expected from a biological standpoint, providing further reinforcement of the accuracy of this system. This system provides a fully automated and accurate means of measuring the arteriolar and venular morphology of vascular smooth muscle.

Quantitative Image Analysis on Histologic Virtual Slides for Prostate Pathology Diagnosis, Response to Chemopreventive Agents, and Prognosis

A recent investigation follows and expands the field of previous studies on the malignancy-associated changes and, above all, adds the missing piece: the role of image analysis of normal-looking prostate epithelium in the prediction of prognosis. This requires combining and integrating our knowledge of uropathology with that of engineering and informatics.