Harnessing artificial intelligence for prostate cancer management

Prostate cancer (PCa) is a common malignancy in males. The pathology review of PCa is crucial for clinical decision-making, but traditional pathology review is labor intensive and subjective to some extent. Digital pathology and whole-slide imaging enable the application of artificial intelligence (AI) in pathology. This review highlights the success of AI in detecting and grading PCa, predicting patient outcomes, and identifying molecular subtypes. We propose that AI-based methods could collaborate with pathologists to reduce workload and assist clinicians in formulating treatment recommendations. We also introduce the general process and challenges in developing AI pathology models for PCa. Importantly, we summarize publicly available datasets and open-source codes to facilitate the utilization of existing data and the comparison of the performance of different models to improve future studies.

Deep learning-based accurate diagnosis and quantitative evaluation of microvascular invasion in hepatocellular carcinoma on whole-slide histopathology images

BACKGROUND

Microvascular invasion (MVI) is an independent prognostic factor that is associated with early recurrence and poor survival after resection of hepatocellular carcinoma (HCC). However, the traditional pathology approach is relatively subjective, time-consuming, and heterogeneous in the diagnosis of MVI. The aim of this study was to develop a deep-learning model that could significantly improve the efficiency and accuracy of MVI diagnosis.

MATERIALS AND METHODS

We collected H&E-stained slides from 753 patients with HCC at the First Affiliated Hospital of Zhejiang University. An external validation set with 358 patients was selected from The Cancer Genome Atlas database. The deep-learning model was trained by simulating the method used by pathologists to diagnose MVI. Model performance was evaluated with accuracy, precision, recall, F1 score, and the area under the receiver operating characteristic curve.

RESULTS

We successfully developed a MVI artificial intelligence diagnostic model (MVI-AIDM) which achieved an accuracy of 94.25% in the independent external validation set. The MVI positive detection rate of MVI-AIDM was significantly higher than the results of pathologists. Visualization results demonstrated the recognition of micro MVIs that were difficult to differentiate by the traditional pathology. Additionally, the model provided automatic quantification of the number of cancer cells and spatial information regarding MVI.

CONCLUSIONS

We developed a deep learning diagnostic model, which performed well and improved the efficiency and accuracy of MVI diagnosis. The model provided spatial information of MVI that was essential to accurately predict HCC recurrence after surgery.

Morphology-based molecular classification of spinal cord ependymomas using deep neural networks

Based on DNA-methylation, ependymomas growing in the spinal cord comprise two major molecular types termed spinal (SP-EPN) and myxopapillary ependymomas (MPE(-A/B)), which differ with respect to their clinical features and prognosis. Due to the existing discrepancy between histomorphogical diagnoses and classification using methylation data, we asked whether deep neural networks can predict the DNA methylation class of spinal cord ependymomas from hematoxylin and eosin stained whole-slide images. Using explainable AI, we further aimed to prospectively improve the consistency of histology-based diagnoses with DNA methylation profiling by identifying and quantifying distinct morphological patterns of these molecular ependymoma types. We assembled a case series of 139 molecularly characterized spinal cord ependymomas (nMPE  = 84, nSP-EPN  = 55). Self-supervised and weakly-supervised neural networks were used for classification. We employed attention analysis and supervised machine-learning methods for the discovery and quantification of morphological features and their correlation to the diagnoses of experienced neuropathologists. Our best performing model predicted the DNA methylation class with 98% test accuracy and used self-supervised learning to outperform pretrained encoder-networks (86% test accuracy). In contrast, the diagnoses of neuropathologists matched the DNA methylation class in only 83% of cases. Domain-adaptation techniques improved model generalization to an external validation cohort by up to 22%. Statistically significant morphological features were identified per molecular type and quantitatively correlated to human diagnoses. The approach was extended to recently defined subtypes of myxopapillary ependymomas (MPE-(A/B), 80% test accuracy). In summary, we demonstrated the accurate prediction of the DNA methylation class of spinal cord ependymomas (SP-EPN, MPE(-A/B)) using hematoxylin and eosin stained whole-slide images. Our approach may prospectively serve as a supplementary resource for integrated diagnostics and may even help to establish a standardized, high-quality level of histology-based diagnostics across institutions-in particular in low-income countries, where expensive DNA-methylation analyses may not be readily available.

Automated Cellular-Level Dual Global Fusion of Whole-Slide Imaging for Lung Adenocarcinoma Prognosis

Histopathologic whole-slide images (WSI) are generally considered the gold standard for cancer diagnosis and prognosis. Survival prediction based on WSI has recently attracted substantial attention. Nevertheless, it remains a central challenge owing to the inherent difficulties of predicting patient prognosis and effectively extracting informative survival-specific representations from WSI with highly compounded gigapixels. In this study, we present a fully automated cellular-level dual global fusion pipeline for survival prediction. Specifically, the proposed method first describes the composition of different cell populations on WSI. Then, it generates dimension-reduced WSI-embedded maps, allowing for efficient investigation of the tumor microenvironment. In addition, we introduce a novel dual global fusion network to incorporate global and inter-patch features of cell distribution, which enables the sufficient fusion of different types and locations of cells. We further validate the proposed pipeline using The Cancer Genome Atlas lung adenocarcinoma dataset. Our model achieves a C-index of 0.675 (±0.05) in the five-fold cross-validation setting and surpasses comparable methods. Further, we extensively analyze embedded map features and survival probabilities. These experimental results manifest the potential of our proposed pipeline for applications using WSI in lung adenocarcinoma and other malignancies.

Classifying Malignancy in Prostate Glandular Structures from Biopsy Scans with Deep Learning

Histopathological classification in prostate cancer remains a challenge with high dependence on the expert practitioner. We develop a deep learning (DL) model to identify the most prominent Gleason pattern in a highly curated data cohort and validate it on an independent dataset. The histology images are partitioned in tiles (14,509) and are curated by an expert to identify individual glandular structures with assigned primary Gleason pattern grades. We use transfer learning and fine-tuning approaches to compare several deep neural network architectures that are trained on a corpus of camera images (ImageNet) and tuned with histology examples to be context appropriate for histopathological discrimination with small samples. In our study, the best DL network is able to discriminate cancer grade (GS3/4) from benign with an accuracy of 91%, F₁-score of 0.91 and AUC 0.96 in a baseline test (52 patients), while the cancer grade discrimination of the GS3 from GS4 had an accuracy of 68% and AUC of 0.71 (40 patients).

Immunohistochemical HER2 Recognition and Analysis of Breast Cancer Based on Deep Learning

Breast cancer is one of the common malignant tumors in women. It seriously endangers women's life and health. The human epidermal growth factor receptor 2 (HER2) protein is responsible for the division and growth of healthy breast cells. The overexpression of the HER2 protein is generally evaluated by immunohistochemistry (IHC). The IHC evaluation criteria mainly includes three indexes: staining intensity, circumferential membrane staining pattern, and proportion of positive cells. Manually scoring HER2 IHC images is an error-prone, variable, and time-consuming work. To solve these problems, this study proposes an automated predictive method for scoring whole-slide images (WSI) of HER2 slides based on a deep learning network. A total of 95 HER2 pathological slides from September 2021 to December 2021 were included. The average patch level precision and f1 score were 95.77% and 83.09%, respectively. The overall accuracy of automated scoring for slide-level classification was 97.9%. The proposed method showed excellent specificity for all IHC 0 and 3+ slides and most 1+ and 2+ slides. The evaluation effect of the integrated method is better than the effect of using the staining result only.

Quantitative Assessment of Tumor-Infiltrating Lymphocytes Using Machine Learning Predicts Survival in Muscle-Invasive Bladder Cancer

(1) Purpose: Although assessment of tumor-infiltrating lymphocytes (TILs) has been acknowledged to have important predictive prognostic value in muscle-invasive bladder cancer (MIBC), it is limited by inter- and intra-observer variability, hampering widespread clinical application. We aimed to evaluate the prognostic value of quantitative TILs score based on a machine learning (ML) algorithm to identify MIBC patients who might benefit from immunotherapy or the de-escalation of therapy. (2) Methods: We constructed an artificial neural network classifier for tumor cells, lymphocytes, stromal cells, and “ignore” cells from hematoxylin-and-eosin-stained slide images using the QuPath open source software. We defined four unique TILs variables based on ML to analyze TILs measurements. Pathological slide images from 133 MIBC patients were retrospectively collected as the discovery set to determine the optimal association of ML-read TILs variables with patient survival outcomes. For validation, we evaluated an independent external validation set consisting of 247 MIBC patients. (3) Results: We found that all four TILs variables had significant prognostic associations with survival outcomes in MIBC patients (p < 0.001 for all comparisons), with higher TILs score being associated with better prognosis. Univariate and multivariate Cox regression analyses demonstrated that electronic TILs (eTILs) variables were independently associated with overall survival after adjustment for clinicopathological factors including age, sex, and pathological stage (p < 0.001 for all analyses). Results analyzed in different subgroups showed that the eTILs variable was a strong prognostic factor that was not redundant with pre-existing clinicopathological features (p < 0.05 for all analyses). (4) Conclusion: ML-driven cell classifier-defined TILs variables were robust and independent prognostic factors in two independent cohorts of MIBC patients. eTILs have the potential to identify a subset of high-risk stage II or stage III-IV MIBC patients who might benefit from adjuvant immunotherapy.

Spatial analysis of tumor-infiltrating lymphocytes in histological sections using deep learning techniques predicts survival in colorectal carcinoma

This study aimed to explore the prognostic impact of spatial distribution of tumor‐infiltrating lymphocytes (TILs) quantified by deep learning (DL) approaches based on digitalized whole‐slide images stained with hematoxylin and eosin in patients with colorectal cancer (CRC). The prognostic impact of spatial distributions of TILs in patients with CRC was explored in the Yonsei cohort (n = 180) and validated in The Cancer Genome Atlas (TCGA) cohort (n = 268). Two experienced pathologists manually measured TILs at the most invasive margin (IM) as 0–3 by the Klintrup–Mäkinen (KM) grading method and this was compared to DL approaches. Inter‐rater agreement for TILs was measured using Cohen's kappa coefficient. On multivariate analysis of spatial TIL features derived by DL approaches and clinicopathological variables including tumor stage, microsatellite instability, and KRAS mutation, TIL densities within 200 μm of the IM (f_im200) remained the most significant prognostic factor for progression‐free survival (PFS) (hazard ratio [HR] 0.004 [95% confidence interval, CI, 0.0001–0.15], p = 0.0028) in the Yonsei cohort. On multivariate analysis using the TCGA dataset, f_im200 retained prognostic significance for PFS (HR 0.031 [95% CI 0.001–0.645], p = 0.024). Inter‐rater agreement of manual KM grading was insignificant in the Yonsei (κ = 0.109) and the TCGA (κ = 0.121) cohorts. The survival analysis based on KM grading showed statistically significant different PFS in the TCGA cohort, but not the Yonsei cohort. Automatic quantification of TILs at the IM based on DL approaches shows prognostic utility to predict PFS, and could provide robust and reproducible TIL density measurement in patients with CRC.

Evaluation of an artificial intelligence algorithm for assisting the Paris System in reporting urinary cytology: A pilot study

BACKGROUND

The Paris System for Reporting Urinary Cytology (TPS) has been shown to improve bladder cancer diagnosis. Advances in artificial intelligence (AI) may assist and improve the clinical workflow by applying TPS in routine diagnostic services.

METHODS

A deep-learning-based algorithm was developed to identify urothelial cancer candidate cells using whole-slide images (WSIs). In the testing cohort, 131 urine cytology slides were retrospectively retrieved and analyzed using this AI algorithm. The authors compared the performance of one cytopathologist and two cytotechnologists using AI-assisted digital urine cytology. Then, the AI-assisted WSIs were evaluated in the clinical workflow. The cytopathologist first made a diagnosis by reviewing the AI-inferred WSIs and quantitative data (nuclear-to-cytoplasmic ratio and nuclear size) for each sample. After a washout period, the same cytopathologist made a diagnosis for the same samples using direct microscopy. All diagnosis results were compared with the expert panel consensus.

RESULTS

The AI-assisted diagnosis by the two cytotechnologists and the one cytopathologist demonstrated performance results that were comparable to the expert panel consensus (sensitivity, 79.5% and 82.1% vs. 92.3%, respectively; specificity, 100% and 98.9% vs. 100%, respectively). Furthermore, the performance of the AI-assisted WSIs compared with the microscopic diagnosis by the cytopathologist demonstrated superior sensitivity (92.3% vs. 87.2%) and negative predictive value (96.8% vs. 94.8%). In addition, the AI-assisted reporting demonstrated near perfect agreement with the expert panel consensus (κ = 0.944) and the microscopic diagnosis (κ = 0.862).

CONCLUSIONS

The AI algorithm developed by the authors effectively assisted TPS-based reporting by providing AI-inferred WSIs and quantitative data.

Scientific and Regulatory Policy Committee Points to Consider: Primary Digital Histopathology Evaluation and Peer Review for Good Laboratory Practice (GLP) Nonclinical Toxicology Studies

The Society of Toxicologic Pathology's Scientific and Regulatory Policy Committee formed a working group to consider the present and future use of digital pathology in toxicologic pathology in general and specifically its use in primary evaluation and peer review in Good Laboratory Practice (GLP) environments. Digital histopathology systems can save costs by reducing travel, enhancing organizational flexibility, decreasing slide handling, improving collaboration, increasing access to historical images, and improving quality and efficiency through integration with laboratory information management systems. However, the resources to implement and operate a digital pathology system can be significant. Given the magnitude and risks involved in the decision to adopt digital histopathology, this working group used pertinent previously published survey results and its members' expertise to create a Points-to-Consider article to assist organizations with building and implementing digital pathology workflows. With the aim of providing a comprehensive perspective, the current publication summarizes aspects of digital whole-slide imaging relevant to nonclinical histopathology evaluations, and then presents points to consider applicable to both primary digital histopathology evaluation and digital peer review in GLP toxicology studies. The Supplemental Appendices provide additional tabulated resources.

Scientific and Regulatory Policy Committee Brief Communication: 2019 Survey on Use of Digital Histopathology Systems in Nonclinical Toxicology Studies

Histopathologic evaluation and peer review using digital whole-slide images (WSIs) is a relatively new medium for assessing nonclinical toxicology studies in Good Laboratory Practice (GLP) environments. To better understand the present and future use of digital pathology in nonclinical toxicology studies, the Society of Toxicologic Pathology (STP) formed a working group to survey STP members with the goal of creating recommendations for implementation. The survey was administered in December 2019, immediately before the COVID-19 pandemic, and the results suggested that the use of digital histopathology for routine GLP histopathology assessment was not widespread. Subsequently, in follow-up correspondence during the pandemic, many responding institutions either began investigating or adopting digital WSI systems to reduce employee exposure to COVID-19. Therefore, the working group presents the survey results as a pre-pandemic baseline data set. Recommendations for use of WSI systems in GLP environments will be the subject of a separate publication.

A Deep Learning Model for Prostate Adenocarcinoma Classification in Needle Biopsy Whole-Slide Images Using Transfer Learning

The histopathological diagnosis of prostate adenocarcinoma in needle biopsy specimens is of pivotal importance for determining optimum prostate cancer treatment. Since diagnosing a large number of cases containing 12 core biopsy specimens by pathologists using a microscope is time-consuming manual system and limited in terms of human resources, it is necessary to develop new techniques that can rapidly and accurately screen large numbers of histopathological prostate needle biopsy specimens. Computational pathology applications that can assist pathologists in detecting and classifying prostate adenocarcinoma from whole-slide images (WSIs) would be of great benefit for routine pathological practice. In this paper, we trained deep learning models capable of classifying needle biopsy WSIs into adenocarcinoma and benign (non-neoplastic) lesions. We evaluated the models on needle biopsy, transurethral resection of the prostate (TUR-P), and The Cancer Genome Atlas (TCGA) public dataset test sets, achieving an ROC-AUC up to 0.978 in needle biopsy test sets and up to 0.9873 in TCGA test sets for adenocarcinoma.

Automated Analysis of Proliferating Cells Spatial Organisation Predicts Prognosis in Lung Neuroendocrine Neoplasms

Simple Summary

Lung neuroendocrine neoplasms (lung NENs) are categorised by morphology, defining a classification sometimes unable to reflect ultimate clinical outcome, particularly for the intermediate domains of adenocarcinomas and large-cell neuroendocrine carcinomas. Moreover, subjectivity and poor reproducibility characterise diagnosis and prognosis assessment of all NENs. The aim of this study was to design and evaluate an objective and reproducible approach to the grading of lung NENs, potentially extendable to other NENs, by exploring a completely new perspective of interpreting the well-recognised proliferation marker Ki-67. We designed an automated pipeline to harvest quantitative information from the spatial distribution of Ki-67-positive cells, analysing its heterogeneity in the entire extent of tumour tissue—which currently represents the main weakness of Ki-67—and employed machine learning techniques to predict prognosis based on this information. Demonstrating the efficacy of the proposed framework would hint at a possible path for the future of grading and classification of NENs.

Abstract

Lung neuroendocrine neoplasms (lung NENs) are categorised by morphology, defining a classification sometimes unable to reflect ultimate clinical outcome. Subjectivity and poor reproducibility characterise diagnosis and prognosis assessment of all NENs. Here, we propose a machine learning framework for tumour prognosis assessment based on a quantitative, automated and repeatable evaluation of the spatial distribution of cells immunohistochemically positive for the proliferation marker Ki-67, performed on the entire extent of high-resolution whole slide images. Combining features from the fields of graph theory, fractality analysis, stochastic geometry and information theory, we describe the topology of replicating cells and predict prognosis in a histology-independent way. We demonstrate how our approach outperforms the well-recognised prognostic role of Ki-67 Labelling Index on a multi-centre dataset comprising the most controversial lung NENs. Moreover, we show that our system identifies arrangement patterns in the cells positive for Ki-67 that appear independently of tumour subtyping. Strikingly, the subset of these features whose presence is also independent of the value of the Labelling Index and the density of Ki-67-positive cells prove to be especially relevant in discerning prognostic classes. These findings disclose a possible path for the future of grading and classification of NENs.

Remote Reporting During a Pandemic Using Digital Pathology Solution: Experience from a Tertiary Care Cancer Center

Background:

Remote reporting in anatomic pathology is an important advantage of digital pathology that has not been much explored. The COVID-19 pandemic has provided an opportunity to explore this important application of digital pathology system in a tertiary care cancer center to ensure patient care and staff safety. Regulatory guidelines have been described for remote reporting following the pandemic. Herein, we describe our experience of validation of digital pathology workflow for remote reporting to encourage pathologists to utilize this facility which opens door for multiple, multidisciplinary collaborations.

Objective:

To demonstrate the validation and the operational feasibility of remote reporting using a digital pathology system.

Materials and Methods:

Our retrospective validation included whole-slide images (WSIs) of 60 cases of histopathology and 20 cases each of frozen sections and a digital image-based breast algorithm after a washout period of 3 months. Three pathologists with different models of consumer-grade laptops reviewed the cases remotely to assess the diagnostic concordance and operational feasibility of the modified workflow. The slides were digitized on a USFDA-approved Philips UFS 300 scanner at ×40 resolution (0.25 μm/pixel) and viewed on the Image Management System through a web browser. All the essential parameters were reported for each case. After successful validation, 886 cases were reported remotely from March 29, 2020, to June 30, 2020, prospectively. Light microscopy formed the gold standard reference in remote reporting.

Results:

100% major diagnostic concordance was observed in the validation of remote reporting in the retrospective and prospective studies using consumer-grade laptops. The deferral rate was 0.34%. 97.6% of histopathology and 100% of frozen sections were signed out within the turnaround time. Network speed and a lack of virtual private network did not significantly affect the study.

Conclusion:

This study of validation and reporting of complete pathology cases remotely, including their operational feasibility during a public health emergency, proves that remote sign-out using a digital pathology system is not inferior to WSIs on medical-grade monitors and light microscopy. Such studies on remote reporting open the door for the use of digital pathology for interinstitutional consultation and collaboration: Its main intended use.

Computational Image Analysis Identifies Histopathological Image Features Associated With Somatic Mutations and Patient Survival in Gastric Adenocarcinoma

Computational analysis of histopathological images can identify sub-visual objective image features that may not be visually distinguishable by human eyes, and hence provides better modeling of disease phenotypes. This study aims to investigate whether specific image features are associated with somatic mutations and patient survival in gastric adenocarcinoma (sample size = 310). An automated image analysis pipeline was developed to extract quantitative morphological features from H&E stained whole-slide images. We found that four frequently somatically mutated genes (TP53, ARID1A, OBSCN, and PIK3CA) were significantly associated with tumor morphological changes. A prognostic model built on the image features significantly stratified patients into low-risk and high-risk groups (log-rank test p-value = 2.6e-4). Multivariable Cox regression showed the model predicted risk index was an additional prognostic factor besides tumor grade and stage. Gene ontology enrichment analysis showed that the genes whose expressions mostly correlated with the contributing features in the prognostic model were enriched on biological processes such as cell cycle and muscle contraction. These results demonstrate that histopathological image features can reflect underlying somatic mutations and identify high-risk patients that may benefit from more precise treatment regimens. Both the image features and pipeline are highly interpretable to enable translational applications.

Loss of fidelity in scanned digital images compared to glass slides of brain tumors resected using cavitron ultrasonic surgical aspirator

Conversion of glass slides to digital images is necessary to capitalize on advances in computational pathology and could potentially transform our approach to primary diagnosis, research, and medical education. Most slide scanners have a limited maximum scannable area and utilize proprietary tissue detection algorithms to selectively scan regions that contain tissue, allowing for increased scanning speed and reduced file size compared to scanning the entire slide at high resolution. However, very small and faintly stained tissue fragments may not be recognized by these algorithms, leading to loss of fidelity in the digital image compared to the glass slides. Cavitron ultrasonic surgical aspirator (CUSA) is frequently used in brain tumor resections, resulting in highly fragmented specimens that are used for primary diagnosis. Here we evaluated the rate of loss of fidelity in 296 digital images from 40 CUSA-resected brain tumors scanned using a Philips Ultra Fast Scanner. Overall, 54% of the slides (at least one from every case) showed loss of fidelity, with at least one tissue fragment not scanned at high resolution. The majority of the missed tissue fragments were small (<0.5 mm), but rare slides were missing fragments greater than 5 mm in greatest dimension. In addition, 19% of the slides with missing tissue showed no indication of loss of fidelity in the digital image itself; the missing tissue could only be appreciated upon review of the glass slides. These results highlight a potential liability in the use of digital images for primary diagnosis in CUSA-resected brain tumor specimens.

Assessment of a computerized quantitative quality control tool for whole slide images of kidney biopsies

Inconsistencies in the preparation of histology slides and whole-slide images (WSIs) may lead to challenges with subsequent image analysis and machine learning approaches for interrogating the WSI. These variabilities are especially pronounced in multicenter cohorts, where batch effects (i.e. systematic technical artifacts unrelated to biological variability) may introduce biases to machine learning algorithms. To date, manual quality control (QC) has been the de facto standard for dataset curation, but remains highly subjective and is too laborious in light of the increasing scale of tissue slide digitization efforts. This study aimed to evaluate a computer-aided QC pipeline for facilitating a reproducible QC process of WSI datasets. An open source tool, HistoQC, was employed to identify image artifacts and compute quantitative metrics describing visual attributes of WSIs to the Nephrotic Syndrome Study Network (NEPTUNE) digital pathology repository. A comparison in inter-reader concordance between HistoQC aided and unaided curation was performed to quantify improvements in curation reproducibility. HistoQC metrics were additionally employed to quantify the presence of batch effects within NEPTUNE WSIs. Of the 1814 WSIs (458 H&E, 470 PAS, 438 silver, 448 trichrome) from n = 512 cases considered in this study, approximately 9% (163) were identified as unsuitable for subsequent computational analysis. The concordance in the identification of these WSIs among computational pathologists rose from moderate (Gwet's AC1 range 0.43 to 0.59 across stains) to excellent (Gwet's AC1 range 0.79 to 0.93 across stains) agreement when aided by HistoQC. Furthermore, statistically significant batch effects (p < 0.001) in the NEPTUNE WSI dataset were discovered. Taken together, our findings strongly suggest that quantitative QC is a necessary step in the curation of digital pathology cohorts. © 2020 The Pathological Society of Great Britain and Ireland. Published by John Wiley & Sons, Ltd.

Prognostic value of a modified Immunoscore in patients with stage IIII resectable colon cancer

Objective

The Immunoscore method has proved fruitful for predicting prognosis in patients with colon cancer. However, there is still room for improvement in this scoring method to achieve further advances in its clinical translation. This study aimed to develop and validate a modified Immunoscore (IS-mod) system for predicting overall survival (OS) in patients with stage I-III colon cancer.

Methods

The IS-mod was proposed by counting CD3+ and CD8+ immune cells in regions of the tumor core and its invasive margin by drawing two lines of interest. A discovery cohort (N=212) and validation cohort (N=103) from two centers were used to evaluate the prognostic value of the IS-mod.

Results

In the discovery cohort, 5-year survival rates were 88.6% in the high IS-mod group and 60.7% in the low IS-mod group. Multivariate analysis confirmed that the IS-mod was an independent prognostic factor for OS [adjusted hazard ratio (HR)=0.36, 95% confidence interval (95% CI): 0.20-0.63]. With less annotation and computation cost, the IS-mod achieved performance comparable to that of the Immunoscore-like (IS-like) system (C-index, 0.676 vs. 0.661, P=0.231). The 2-category IS-mod using 47.5% as the threshold had a better prognostic value than that using a fixed threshold of 25% (C-index, 0.653 vs. 0.573, P=0.004). Similar results were confirmed in the validation cohort.

Conclusions

Our method simplifies the annotation and accelerates the calculation of Immunoscore method, thus making it easier for clinical implementation. The IS-mod achieved comparable prognostic performance when compared to the IS-like system in both cohorts. Besides, we further found that even with a small reference set (N≥120), the IS-mod still demonstrated a stable prognostic value. This finding may inspire other institutions to develop a local reference set of an IS-mod system for more accurate risk stratification of colon cancer.

LibMI: An Open Source Library for Efficient Histopathological Image Processing

BACKGROUND

Whole-slide images (WSIs) as a kind of image data are rapidly growing in the digital pathology domain. With unusual high resolution, these images make them hard to be supported by conventional tools or file formats. Thus, it obstructs data sharing and automated analysis. Here, we propose a library, LibMI, along with its open and standardized image file format. They can be used together to efficiently read, write, modify, and annotate large images.

MATERIALS AND METHODS

LibMI utilizes the concept of pyramid image structure and lazy propagation from a segment tree algorithm to support reading and modifying and to guarantee that both operations have linear time complexity. Further, a cache mechanism was introduced to speed up the program.

RESULTS

LibMI is an open and efficient library for histopathological image processing. To demonstrate its functions, we applied it to several tasks including image thresholding, microscopic color correction, and storing pixel-wise information on WSIs. The result shows that libMI is particularly suitable for modifying large images. Furthermore, compared with congeneric libraries and file formats, libMI and modifiable multiscale image (MMSI) run 18.237 times faster on read-only tasks.

CONCLUSIONS

The combination of libMI library and MMSI file format enables developers to efficiently read and modify WSIs, thus can assist in pixel-wise image processing on extremely large images to promote building image processing pipeline. The library together with the data schema is freely available on GitLab: https://gitlab.com/BioAI/libMI.

Validation of Whole-slide Digitally Imaged Melanocytic Lesions: Does Z-Stack Scanning Improve Diagnostic Accuracy?

Background

Accurate diagnosis of melanocytic lesions is challenging, even for expert pathologists. Nowadays, whole-slide imaging (WSI) is used for routine clinical pathology diagnosis in several laboratories. One of the limitations of WSI, as it is most often used, is the lack of a multiplanar focusing option. In this study, we aim to establish the diagnostic accuracy of WSI for melanocytic lesions and investigate the potential accuracy increase of z-stack scanning. Z-stack enables pathologists to use a software focus adjustment, comparable to the fine-focus knob of a conventional light microscope.

Materials and Methods

Melanocytic lesions (n = 102) were selected from our pathology archives: 35 nevi, 5 spitzoid tumors of unknown malignant potential, and 62 malignant melanomas, including 10 nevoid melanomas. All slides were scanned at a magnification comparable to use of a ×40 objective, in z-stack mode. A ground truth diagnosis was established on the glass slides by four academic dermatopathologists with a special interest in the diagnosis of melanoma. Six nonacademic surgical pathologists subspecialized in dermatopathology examined the cases by WSI.

Results

An expert consensus diagnosis was achieved in 99 (97%) of cases. Concordance rates between surgical pathologists and the ground truth varied between 75% and 90%, excluding nevoid melanoma cases. Concordance rates of nevoid melanoma varied between 10% and 80%. Pathologists used the software focusing option in 7%-28% of cases, which in 1 case of nevoid melanoma resulted in correcting a misdiagnosis after finding a dermal mitosis.

Conclusion

Diagnostic accuracy of melanocytic lesions based on glass slides and WSI is comparable with previous publications. A large variability in diagnostic accuracy of nevoid melanoma does exist. Our results show that z-stack scanning, in general, does not increase the diagnostic accuracy of melanocytic.

Twenty Years of Digital Pathology: An Overview of the Road Travelled, What is on the Horizon, and the Emergence of Vendor-Neutral Archives

Almost 20 years have passed since the commercial introduction of whole-slide imaging (WSI) scanners. During this time, the creation of various WSI devices with the ability to digitize an entire glass slide has transformed the field of pathology. Parallel advances in computational technology and storage have permitted rapid processing of large-scale WSI datasets. This article provides an overview of important past and present efforts related to WSI. An account of how the virtual microscope evolved from the need to visualize and manage satellite data for earth science applications is provided. The article also discusses important milestones beginning from the first WSI scanner designed by Bacus to the Food and Drug Administration approval of the first digital pathology system for primary diagnosis in surgical pathology. As pathology laboratories commit to going fully digitalize, the need has emerged to include WSIs into an enterprise-level vendor-neutral archive (VNA). The different types of VNAs available are reviewed as well as how best to implement them and how pathology can benefit from participating in this effort. Differences between traditional image algorithms that extract pixel-, object-, and semantic-level features versus deep learning methods are highlighted. The need for large-scale data management, analysis, and visualization in computational pathology is also addressed.

Reimagining the microscope in the 21(st) century using the scalable adaptive graphics environment

Background:

Whole-slide imaging (WSI), while technologically mature, remains in the early adopter phase of the technology adoption lifecycle. One reason for this current situation is that current methods of visualizing and using WSI closely follow long-existing workflows for glass slides. We set out to “reimagine” the digital microscope in the era of cloud computing by combining WSI with the rich collaborative environment of the Scalable Adaptive Graphics Environment (SAGE). SAGE is a cross-platform, open-source visualization and collaboration tool that enables users to access, display and share a variety of data-intensive information, in a variety of resolutions and formats, from multiple sources, on display walls of arbitrary size.

Methods:

A prototype of a WSI viewer app in the SAGE environment was created. While not full featured, it enabled the testing of our hypothesis that these technologies could be blended together to change the essential nature of how microscopic images are utilized for patient care, medical education, and research.

Results:

Using the newly created WSI viewer app, demonstration scenarios were created in the patient care and medical education scenarios. This included a live demonstration of a pathology consultation at the International Academy of Digital Pathology meeting in Boston in November 2014.

Conclusions:

SAGE is well suited to display, manipulate and collaborate using WSIs, along with other images and data, for a variety of purposes. It goes beyond how glass slides and current WSI viewers are being used today, changing the nature of digital pathology in the process. A fully developed WSI viewer app within SAGE has the potential to encourage the wider adoption of WSI throughout pathology.

OpenSlide: A vendor-neutral software foundation for digital pathology

Although widely touted as a replacement for glass slides and microscopes in pathology, digital slides present major challenges in data storage, transmission, processing and interoperability. Since no universal data format is in widespread use for these images today, each vendor defines its own proprietary data formats, analysis tools, viewers and software libraries. This creates issues not only for pathologists, but also for interoperability. In this paper, we present the design and implementation of OpenSlide, a vendor-neutral C library for reading and manipulating digital slides of diverse vendor formats. The library is extensible and easily interfaced to various programming languages. An application written to the OpenSlide interface can transparently handle multiple vendor formats. OpenSlide is in use today by many academic and industrial organizations world-wide, including many research sites in the United States that are funded by the National Institutes of Health.